CN113254677A

CN113254677A - Multimedia information processing method and device, electronic equipment and storage medium

Info

Publication number: CN113254677A
Application number: CN202110761832.5A
Authority: CN
Inventors: 李倩
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-07-06
Filing date: 2021-07-06
Publication date: 2021-08-13

Abstract

The disclosure relates to a multimedia information processing method, a multimedia information processing device, an electronic device and a computer readable storage medium. The method comprises the following steps: responding to the auxiliary information acquisition operation of the first multimedia information, and displaying the auxiliary information of the first multimedia information; and displaying second multimedia information obtained by applying the target auxiliary information to the first multimedia information in response to the trigger operation of applying the target auxiliary information in the auxiliary information to the first multimedia information. The method and the device have the advantages that the auxiliary information is provided by other users, and the second multimedia can be obtained without the multimedia creation user executing a complex editing process, so that the operation process of multimedia information processing is simplified, and the efficiency of multimedia information processing is improved.

Description

Multimedia information processing method and device, electronic equipment and storage medium

Technical Field

The present disclosure relates to the field of multimedia technologies, and in particular, to a method and an apparatus for processing multimedia information, an electronic device, and a computer-readable storage medium.

Background

With the development of multimedia technology, a multimedia creation user can add additional auxiliary information to a multimedia work when the multimedia work is published, for example, when the multimedia creation user publishes a certain video, the multimedia creation user can carry additional description information on a published video cover, and after publishing the video together, the multimedia creation user can display the additional description information in the video cover.

In the current multimedia processing method, multimedia auxiliary information usually needs to be provided by a multimedia creation user, and if the multimedia creation user cannot provide the auxiliary information, the auxiliary information can be provided by other users after the multimedia creation without the auxiliary information is completed. At this time, if a multimedia creation user needs to use auxiliary information provided by other users, the multimedia creation user needs to re-edit and release the multimedia works to obtain the multimedia works carrying the auxiliary information.

Disclosure of Invention

The present disclosure provides a multimedia information processing method, an apparatus, an electronic device and a computer readable storage medium, so as to at least solve the problem of low efficiency of multimedia processing in the related art. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a multimedia information processing method, including:

responding to an auxiliary information acquisition operation of first multimedia information, and displaying the auxiliary information of the first multimedia information;

and responding to the trigger operation of applying the target auxiliary information in the auxiliary information to the first multimedia information, and displaying second multimedia information obtained by applying the target auxiliary information to the first multimedia information.

In an exemplary embodiment, the presenting the auxiliary information of the first multimedia information includes: presenting auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information.

In an exemplary embodiment, the presenting auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information comprises: displaying an auxiliary information list including at least one auxiliary information; the presenting, in response to a trigger operation of applying target auxiliary information in the auxiliary information to the first multimedia information, second multimedia information obtained by applying the target auxiliary information to the first multimedia information, includes: determining target auxiliary information based on the auxiliary information list, and displaying the target auxiliary information in the auxiliary information list in a distinguishing manner from other auxiliary information.

In an exemplary embodiment, the presenting an auxiliary information list including a plurality of auxiliary information includes: sequentially displaying the auxiliary information in the auxiliary information list according to the matching degree of the auxiliary information and the first multimedia information respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

In an exemplary embodiment, the presenting second multimedia information obtained by applying the target assistance information to the first multimedia information includes: displaying the second multimedia information and displaying the account identification of the target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

In an exemplary embodiment, the presenting, after applying the target auxiliary information to second multimedia information obtained by first multimedia information, further includes: canceling the application of the target auxiliary information in the second multimedia information, redisplaying the first multimedia information, canceling the differentiated display of the target auxiliary information in the auxiliary information list, and canceling the display of the account identifier of the target audience account.

According to a second aspect of the embodiments of the present disclosure, there is provided a multimedia information processing method, including:

displaying the first multimedia information; the first multimedia information is provided with an auxiliary information acquisition identifier;

responding to a triggering operation of a viewer account of the first multimedia information aiming at the auxiliary information acquisition identifier, acquiring auxiliary information of the first multimedia information input by the viewer account, and sending the auxiliary information to a multimedia account providing the first multimedia information;

displaying the second multimedia information; the second multimedia information is multimedia information obtained by applying target auxiliary information in auxiliary information to the first multimedia information through the multimedia account.

In an exemplary embodiment, the acquiring auxiliary information of the first multimedia information input by the viewer account in response to the triggering operation of the viewer account of the first multimedia information for the auxiliary information acquisition identifier includes: responding to the triggering operation of the audience account on the auxiliary information acquisition identifier, and displaying an auxiliary information input interface; and acquiring the auxiliary information provided by the audience account in the auxiliary information input interface.

In an exemplary embodiment, after the presenting the auxiliary information input interface, the method further includes: responding to interface switching operation triggered by the audience account, and switching the auxiliary information input interface into an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information.

In an exemplary embodiment, after the switching the auxiliary information input interface to the auxiliary information presentation interface, the method further includes: acquiring voting information of the audience account on auxiliary information contained in the auxiliary information list; sequentially displaying a plurality of auxiliary information in the auxiliary information list according to the fit degree of the plurality of auxiliary information of the first multimedia information with the first multimedia information respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

In an exemplary embodiment, the auxiliary information input interface includes an auxiliary information presentation area for presenting auxiliary information; the display auxiliary information input interface comprises: an assistance information list including at least one assistance information of the first multimedia information is presented in the assistance information presentation area.

In an exemplary embodiment, the acquiring auxiliary information of the first multimedia information input by the viewer account in response to the triggering operation of the viewer account of the first multimedia information for the auxiliary information acquisition identifier includes: if the audience account provides the auxiliary information of the first multimedia information, responding to the triggering operation of the audience account on the auxiliary information acquisition identifier, and displaying an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information; and responding to the interface switching operation triggered by the audience account, switching the auxiliary information display interface into the auxiliary information input interface, and acquiring the auxiliary information provided by the audience account on the auxiliary information input interface.

In an exemplary embodiment, the presenting the second multimedia information includes: displaying the second multimedia information and displaying the account identification of the target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

According to a third aspect of the embodiments of the present disclosure, there is provided a multimedia information processing apparatus including:

an auxiliary information presentation unit configured to perform an auxiliary information acquisition operation in response to first multimedia information, to present auxiliary information of the first multimedia information;

and the auxiliary information application unit is configured to execute a triggering operation of applying target auxiliary information in the auxiliary information to the first multimedia information and display second multimedia information obtained by applying the target auxiliary information to the first multimedia information.

In an exemplary embodiment, the auxiliary information presentation unit is further configured to perform presentation of auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information.

In an exemplary embodiment, the auxiliary information presentation unit is further configured to perform presentation of an auxiliary information list including at least one auxiliary information; the auxiliary information application unit is further configured to perform determining target auxiliary information based on the auxiliary information list, and to perform differentiated display of the target auxiliary information from other auxiliary information in the auxiliary information list.

In an exemplary embodiment, the auxiliary information presenting unit is further configured to perform presenting the plurality of auxiliary information in the auxiliary information list in sequence according to the degree of matching between the plurality of auxiliary information and the first multimedia information, respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

In an exemplary embodiment, the auxiliary information application unit is further configured to perform presenting the second multimedia information and presenting an account identifier of a target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

In an exemplary embodiment, the auxiliary information application unit is further configured to execute an application for canceling the target auxiliary information in the second multimedia information, redisplay the first multimedia information, cancel the differentiated display of the target auxiliary information in the auxiliary information list, and cancel the account identifier of the target audience account.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a multimedia information processing apparatus including:

a first multimedia presentation unit configured to perform presentation of first multimedia information; the first multimedia information is provided with an auxiliary information acquisition identifier;

an auxiliary information input unit configured to perform a trigger operation for the auxiliary information acquisition identifier in response to a viewer account of the first multimedia information, acquire auxiliary information of the first multimedia information input by the viewer account, and send the auxiliary information to a multimedia account providing the first multimedia information;

a second multimedia presentation unit configured to perform presentation of second multimedia information; the second multimedia information is multimedia information obtained by applying target auxiliary information in auxiliary information to the first multimedia information through the multimedia account.

In an exemplary embodiment, the auxiliary information input unit is further configured to perform a triggering operation on the auxiliary information acquisition identifier in response to the viewer account, and display an auxiliary information input interface; and acquiring the auxiliary information provided by the audience account in the auxiliary information input interface.

In an exemplary embodiment, the multimedia information processing apparatus further includes: the information list display unit is configured to execute interface switching operation triggered by the audience account and switch the auxiliary information input interface into an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information.

In an exemplary embodiment, the information list presenting unit is further configured to perform obtaining voting information of the audience account for the auxiliary information included in the auxiliary information list; sequentially displaying a plurality of auxiliary information in the auxiliary information list according to the fit degree of the plurality of auxiliary information of the first multimedia information with the first multimedia information respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

In an exemplary embodiment, the auxiliary information input interface includes an auxiliary information presentation area for presenting auxiliary information; the auxiliary information input unit is further configured to perform presentation of an auxiliary information list including at least one auxiliary information of the first multimedia information in the auxiliary information presentation area.

In an exemplary embodiment, the auxiliary information input unit is further configured to execute, if the viewer account provides the auxiliary information of the first multimedia information, a display of an auxiliary information display interface in response to a trigger operation of the viewer account on the auxiliary information acquisition identifier; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information; and responding to the interface switching operation triggered by the audience account, switching the auxiliary information display interface into the auxiliary information input interface, and acquiring the auxiliary information provided by the audience account on the auxiliary information input interface.

In an exemplary embodiment, the second multimedia presentation unit is further configured to perform presenting the second multimedia information and presenting the account identifier of the target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

According to a fifth aspect of embodiments of the present disclosure, there is provided an electronic apparatus including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the multimedia information processing method as described in any one of the embodiments of the first aspect or the second aspect.

According to a sixth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, wherein instructions of the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the multimedia information processing method according to any one of the first or second aspects.

According to a seventh aspect of the embodiments of the present disclosure, there is provided a computer program product comprising a computer program, which when executed by a processor implements the multimedia information processing method described in any one of the first or second aspects.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

displaying auxiliary information of the first multimedia information through auxiliary information acquisition operation responding to the first multimedia information; and displaying second multimedia information obtained by applying the target auxiliary information to the first multimedia information in response to the trigger operation of applying the target auxiliary information in the auxiliary information to the first multimedia information. According to the method and the device, the auxiliary information aiming at the first multimedia is displayed on the client, and the client user can display the second multimedia applying the target auxiliary information corresponding to the trigger operation only by triggering the displayed auxiliary information, so that the auxiliary information provided by other users can be obtained without a multimedia creator executing a complex editing process, the operating process of multimedia information processing is simplified, and the efficiency of multimedia information processing is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a diagram illustrating an application environment of a multimedia processing method according to an exemplary embodiment.

Fig. 2 is a flow chart illustrating a method of multimedia processing according to an exemplary embodiment.

Fig. 3 is a flow diagram illustrating the distribution of second multimedia according to an exemplary embodiment.

Fig. 4 is a schematic diagram illustrating an interface for a client to present a list of assistance information, according to an example embodiment.

Fig. 5 is a schematic diagram illustrating an interface of a client presenting second multimedia according to an example embodiment.

Fig. 6 is a flow chart illustrating a multimedia processing method according to another exemplary embodiment.

FIG. 7 is a flow diagram illustrating obtaining input assistance information according to an example embodiment.

Fig. 8 is a schematic diagram illustrating an interface for a client to present first multimedia according to an example embodiment.

FIG. 9 is an interface diagram illustrating a secondary information input interface, according to an example embodiment.

Fig. 10 is an interface diagram illustrating an auxiliary information input interface according to another example embodiment.

FIG. 11 is an interface diagram illustrating a presentation of an auxiliary information presentation interface, according to an example embodiment.

FIG. 12 is an interface diagram illustrating a presentation of an auxiliary information presentation interface according to another example embodiment.

Fig. 13 is a flowchart illustrating a multimedia processing method according to yet another exemplary embodiment.

FIG. 14 is a block diagram illustrating a multimedia processing apparatus according to an example embodiment.

Fig. 15 is a block diagram illustrating a multimedia processing apparatus according to another exemplary embodiment.

FIG. 16 is a block diagram illustrating an electronic device in accordance with an example embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The multimedia processing method provided by the present disclosure can be applied to the application environment shown in fig. 1. Among them, a client 101 providing an account of multimedia information and a client 103 providing an account of a viewer of multimedia information interact with a server 102 through a network. Specifically, the account providing the multimedia information may publish, on the server 102, the first multimedia information that needs to obtain the auxiliary information through the client 101, and the viewer account may present, through the client 103, the first multimedia information in the server 102, input the auxiliary information for the first multimedia information through the client 103, and send the auxiliary information to the server 102. When the account providing the multimedia information triggers the auxiliary information obtaining operation aiming at the first multimedia information, the client 101 can obtain the auxiliary information from the multimedia audience account from the server 102 and display the auxiliary information, the multimedia publishing account can trigger the displayed auxiliary information, the server 102 applies the target auxiliary information corresponding to the multimedia publishing account triggering operation to the first multimedia to obtain the second multimedia, and the client 101 displays the second multimedia. The client 101 and the client 103 may be, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices, and the server 102 may be implemented by an independent server or a server cluster composed of a plurality of servers.

Fig. 2 is a flowchart illustrating a multimedia processing method according to an exemplary embodiment, where the multimedia processing method is used in the client 101 of the multimedia publishing account, as shown in fig. 2, and includes the following steps.

In step S201, the client 101 displays the auxiliary information of the first multimedia information in response to the auxiliary information obtaining operation of the first multimedia information.

Wherein, the first multimedia information refers to the multimedia information that needs to obtain the auxiliary information, and the first multimedia information may be the multimedia information issued to the server 102 by the account providing the multimedia information, or the multimedia information stored in the draft box of the server 102 in advance, the first multimedia information does not carry auxiliary information, for example, the first multimedia information may be a piece of video information lacking background music, and then the background music of the video may be the auxiliary information of the first multimedia information, or may be a piece of video cover information lacking textual description, and then the textual description for the cover may be used as the auxiliary information, in addition, the first multimedia information may also be picture information without adding picture special effect elements such as magic expressions, and the picture special effect elements can be used as auxiliary information. When the client 101 issues a certain multimedia message to the server 102, the server 102 may determine whether the uploaded multimedia message belongs to the first multimedia message that needs to provide the auxiliary information, for example, by means of multimedia recognition. For example, when the multimedia information uploaded to the server 102 lacks corresponding description information or is related to a music score, the server 102 may use the multimedia information as the first multimedia information, or an account providing the first multimedia information leaves a related identifier indicating that auxiliary information needs to be provided when the multimedia information is uploaded, and when the server 102 detects the identifier, the published multimedia information may also be used as the first multimedia information. The auxiliary information may be various types of additional information for the first multimedia information, such as a text description for the first multimedia information, background music, and a special display effect.

Specifically, after the client 101 uploads the first multimedia information on the server 102, the server 102 may obtain the auxiliary information for the first multimedia information, for example, the auxiliary information may be obtained in a manner actively generated by the server 102, when an account providing the first multimedia information needs to apply the auxiliary information to the first multimedia, an auxiliary information obtaining operation may be triggered for the client 101, for example, the auxiliary information obtaining operation may be triggered by clicking a certain display control for obtaining the auxiliary information of the first multimedia information in the client 101, and the client 101 may respond to the auxiliary information obtaining operation and display the auxiliary information of the first multimedia information.

In step S202, the client 101 presents second multimedia information obtained by applying the target assistance information to the first multimedia information in response to a trigger operation of applying the target assistance information in the assistance information to the first multimedia information.

The second multimedia information is the first multimedia information to which the auxiliary information is applied, when the client 101 displays the auxiliary information corresponding to the first multimedia information, the account providing the multimedia information can perform a trigger operation on the auxiliary information displayed by the client 101, and the server 102 applies the target auxiliary information corresponding to the trigger operation to the first multimedia information, so as to obtain the second multimedia information and return the second multimedia information to the client 101 for display.

In the multimedia information processing method, the client 101 responds to the auxiliary information acquisition operation of the first multimedia information to display the auxiliary information of the first multimedia information; and displaying second multimedia information obtained by applying the target auxiliary information to the first multimedia information in response to the trigger operation of applying the target auxiliary information in the auxiliary information to the first multimedia information. According to the method and the device, the auxiliary information aiming at the first multimedia is displayed on the client 101, and the client user can display the second multimedia applying the target auxiliary information corresponding to the trigger operation only by triggering the displayed auxiliary information, so that the auxiliary information provided by other users can be obtained without a multimedia creator executing a complex editing process, the operating process of multimedia information processing is simplified, and the efficiency of multimedia information processing is improved.

In an exemplary embodiment, the step S201 may further include: the client 101 presents the auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information.

In this embodiment, the first multimedia information may be multimedia information that is issued to the server 102 from an account providing the multimedia information, and after the account issues the first multimedia information to the server 102, the server 102 may carry, for the first multimedia information, an auxiliary information acquisition identifier for representing that the first multimedia information needs to be acquired by auxiliary information. When the first multimedia information is displayed in the client 103 of the account in the official account, the auxiliary information for the first multimedia information, which is entered by the audience account of the first multimedia information through the client 103, may also be received, and when the account providing the multimedia information, that is, the issuing account of the multimedia information, triggers the auxiliary information obtaining operation, the client 101 may display the auxiliary information provided by the audience account of the first multimedia information.

In this embodiment, the auxiliary information of the first multimedia information may be derived from the audience account of the first multimedia information, and compared with the auxiliary information generated by the server 102, the auxiliary information provided by the audience account may better meet the requirement of the audience account, so as to improve the matching degree between the auxiliary information and the first multimedia information.

In an exemplary embodiment, the step S201 may further include: the client 101 displays an assistance information list including a plurality of assistance information; as shown in fig. 3, the client 101 presents the auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information, and further can be implemented by the following steps:

in step S301, the client 101 determines target assistance information based on the assistance information list, and displays the target assistance information in the assistance information list in distinction from other assistance information.

In this embodiment, the auxiliary information provided by the viewer account for the first multimedia information may be multiple, for example, the auxiliary information provided by multiple different viewer accounts for the first multimedia information, or multiple pieces of auxiliary information provided by a certain viewer account for the first multimedia information, the client 101 may display an auxiliary information list formed by the multiple pieces of auxiliary information on the client 101 after responding to an auxiliary information obtaining operation triggered by a publishing account of the multimedia information, and then the client 101 may determine one piece of target auxiliary information from the auxiliary information included in the auxiliary information list, where the publishing account may select the auxiliary information included in the displayed auxiliary information list to trigger a selecting operation, and the selecting may be performed by clicking the auxiliary information in the auxiliary information list, or the auxiliary information is selected by triggering a selection control carried in the auxiliary information list, the client 101 may determine the auxiliary information selected by the release account, and if the release account selects the auxiliary information by triggering the selection control, the client 101 may use the auxiliary information corresponding to the triggered selection control as the target auxiliary information.

After the target auxiliary information is applied to the first multimedia information to obtain the second multimedia information, the client 101 may further perform differentiated display on the target auxiliary information and other auxiliary information in the auxiliary information list, for example, perform boldface display or highlight display on the target auxiliary information, or perform highlight display on a selection control corresponding to the target auxiliary information, and the like.

In this embodiment, the client 101 may present an auxiliary information list including a plurality of auxiliary information for the first multimedia information, and when the publishing account selects the auxiliary information in the presented auxiliary information list, the selected target auxiliary information may be displayed separately from other auxiliary information, so that the plurality of pieces of auxiliary information from the audience account and the target auxiliary information selected by the publishing account may be displayed more intuitively.

Further, the displaying, by the client 101, an assistance information list including a plurality of assistance information may further include: the client 101 displays a plurality of auxiliary information in an auxiliary information list in sequence according to the matching degree of the plurality of auxiliary information and the first multimedia information respectively; the degree of fit is represented by voting information of the audience account of the first multimedia information to each auxiliary information.

In this embodiment, the plurality of auxiliary information displayed in the auxiliary information list by the client 101 is displayed after being sorted according to the matching degree between each auxiliary information and the first multimedia information, for example, the client 101 may preferentially display the auxiliary information with a high matching degree, and the matching degree between the auxiliary information and the first multimedia information is represented by the voting information of the audience account for each auxiliary information in the auxiliary information list. Specifically, the audience account may vote for a plurality of auxiliary information of the first multimedia information through the client 103 to represent the matching degree of each auxiliary information with the first multimedia information, the server 102 may collect the number of vote corresponding to each auxiliary information, so as to sort the plurality of auxiliary information according to the sequence of the number of vote from small to small, thereby forming an auxiliary information list, and the client 101 may display the sorted auxiliary information list, thereby enabling the auxiliary information with high matching degree to have a higher display sequence.

In this embodiment, the client 101 may display the plurality of pieces of auxiliary information in the auxiliary information list according to the order of the pieces of auxiliary information through voting on the auxiliary information of the first multimedia information by the audience account, so that the auxiliary information with a high degree of conformity may be preferentially displayed, thereby optimizing the display order of the auxiliary information in the auxiliary information list.

For example, as shown in fig. 4, fig. 4 is an interface diagram of the client 101 displaying the auxiliary information list in one embodiment, the auxiliary information list shows three pieces of auxiliary information for the first multimedia information, namely auxiliary information a, auxiliary information B and auxiliary information C, wherein the ordering of the auxiliary information is determined by the order of the number of votes voted for the multimedia viewer account, that is, the number of tickets A corresponding to the auxiliary information A is greater than the number of tickets B corresponding to the auxiliary information B, the number of tickets B corresponding to the auxiliary information B is greater than the number of tickets C corresponding to the auxiliary information C, and each auxiliary information corresponds to a selection control, when the multimedia publishing account triggers the selection control of the auxiliary information A, the auxiliary information a can be used as auxiliary information selected by the multimedia publishing account, and the selection control of the auxiliary information a can be displayed in a distinguishing manner.

Further, step S202 may further include: the client 101 displays the second multimedia information and displays the account identifier of the target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

Wherein, the target audience account refers to an audience account providing the target auxiliary information for the second multimedia information. Specifically, while the client 101 displays the second multimedia information, it may also carry an account identifier of the target audience account, for example, an account avatar of the target audience account, as shown in fig. 5. The account id may be used for, when the issuing account performs a trigger operation on the exposed account id, the client 101 may respond to the trigger operation and expose an account information page of the target audience account in the client 101, for example, the account information page may be an account home page of the target audience account.

In this embodiment, the second multimedia information may further show an account identifier of a target audience account providing the target auxiliary information, so that the enthusiasm of the multimedia audience account for providing the auxiliary information may be improved, and the sources of the auxiliary information may be increased.

In addition, after step S202, the method may further include: the client 101 cancels the application of the target auxiliary information in the second multimedia information, redisplays the first multimedia information, cancels the differentiated display of the target auxiliary information in the auxiliary information list, and cancels the account identification of the target audience account.

If the publishing account needs to cancel the application of the selected auxiliary information to the second multimedia information, for example, the publishing account may select the target auxiliary information selected in the auxiliary information list again through the client 101, or trigger the selection control of the target auxiliary information again, and the client 101 may cancel the application of the target auxiliary information in the second multimedia information, and cancel the differentiated display of the target auxiliary information and cancel the account identifier of the target audience account providing the auxiliary information while displaying the first multimedia information to which the auxiliary information is not applied again.

For example, the publishing account already applies the auxiliary information a as the target auxiliary information to the second multimedia information, and then the publishing account may select the auxiliary information a again through the client 101, that is, the application of the auxiliary information a to the second multimedia information may be cancelled, the differentiated display of the auxiliary information a from other auxiliary information in the auxiliary information list may be cancelled while the first multimedia information is redisplayed, and the presentation of the account identifier of the target audience account may be cancelled.

In this embodiment, the multimedia publishing account may also cancel the application of the target auxiliary information at any time, so that the diversity of multimedia publishing may be improved.

Fig. 6 is a flowchart illustrating a multimedia information processing method according to an exemplary embodiment, where the multimedia information processing method is used in the client 103 of the viewer account, as shown in fig. 6, and includes the following steps.

In step S601, the client 103 displays the first multimedia information; the first multimedia information is provided with an auxiliary information acquisition identifier.

The first multimedia information refers to multimedia information needing to obtain auxiliary information from the audience account, and the auxiliary information obtaining identification is used for identifying that the multimedia information needs to obtain the auxiliary information from the audience account. Specifically, the audience account may obtain, through the client 103, first multimedia information that needs to be assisted by the auxiliary information acquisition, and present the first multimedia information on the client 103.

In step S602, the client 103 acquires the auxiliary information of the first multimedia information input by the viewer account in response to the triggering operation of the viewer account of the first multimedia information for the auxiliary information acquisition identifier, and sends the auxiliary information to the multimedia account providing the first multimedia information.

Then, after the auxiliary information acquisition identifier is observed in the client 103, the auxiliary information input operation for inputting the auxiliary information for the first multimedia information may be triggered by the auxiliary information acquisition identifier displayed on the client 103, for example, the multimedia viewer account may input the auxiliary information for the first multimedia information to the client 103 through the auxiliary information acquisition identifier to trigger the operation, and the client 103 may respond to the trigger operation to acquire the auxiliary information for the first multimedia information input by the viewer account, and send the auxiliary information for the first multimedia information to the server 102, and the server 102 sends the auxiliary information to the multimedia account providing the first multimedia information.

In step S603, the client 103 displays the second multimedia information; the second multimedia information is multimedia information obtained by applying target auxiliary information in the auxiliary information to the first multimedia information through the multimedia account.

The second multimedia information refers to the first multimedia information after the multimedia account providing the first multimedia information selects the target auxiliary information and applies the target auxiliary information. After the client 103 sends the auxiliary information to the multimedia account, when the account needs to apply the auxiliary information input by the viewer account to the first multimedia information, the client 101 may trigger an auxiliary information obtaining operation for the first multimedia information, so that the auxiliary information may be displayed on the client 101, the auxiliary information displayed on the client 101 may also be selected, and the server 102 applies the target auxiliary information selected by the multimedia publishing account to the first multimedia information, thereby obtaining the second multimedia information. The viewer account may then present the second multimedia information with the targeted assistance information via the client 103.

In the multimedia information processing method, first multimedia information is displayed through a client 103; the first multimedia information is provided with an auxiliary information acquisition identifier; responding to the triggering operation of the audience account of the first multimedia information aiming at the auxiliary information acquisition identifier, acquiring the auxiliary information of the first multimedia information input by the audience account, and sending the auxiliary information to the multimedia account providing the first multimedia information; displaying the second multimedia information; the second multimedia information is multimedia information obtained by applying target auxiliary information in the auxiliary information to the first multimedia information through the multimedia account. According to the method and the device, the first multimedia is displayed on the client-side 103 of the audience account, the auxiliary information of the first multimedia information is input through the audience account, then the multimedia account providing the multimedia information can select the auxiliary information of the displayed first multimedia information through the client-side 101, so that the second multimedia information applying the selected target auxiliary information is obtained and displayed on the client-side 103 of the audience account, the auxiliary information provided by the audience account is realized, the second multimedia information can be obtained without the multimedia account executing a complex editing process, the operating process of multimedia information processing is simplified, and the efficiency of multimedia information processing is improved.

In an exemplary embodiment, as shown in fig. 7, step S602 may be further implemented by:

in step S701, the client 103 presents the auxiliary information input interface in response to the trigger operation of the viewer account on the auxiliary information acquisition identifier.

In this embodiment, the auxiliary information obtaining identifier may be an invitation entry for inviting the multimedia audience account to input auxiliary information for the first multimedia. Specifically, the auxiliary information obtaining identifier may be simultaneously displayed in the process of displaying the first multimedia information in the client 103, as shown in fig. 8, when the audience account performs a trigger operation on the auxiliary information obtaining identifier in the first multimedia information, for example, the audience account clicks the displayed auxiliary information obtaining identifier, the client 103 may display an auxiliary information input interface for the audience account to input the auxiliary information of the first multimedia information, as shown in fig. 9.

In step S702, the client 103 acquires the auxiliary information provided by the viewer account on the auxiliary information input interface.

Then, the audience account may input the auxiliary information of the first multimedia information in the auxiliary information input interface displayed by the client 103, so that the client 103 obtains the auxiliary information input by the audience account.

In this embodiment, the client 103 may display the auxiliary information acquisition identifier during the process of displaying the first multimedia information, and when the audience account triggers the auxiliary information acquisition identifier, the auxiliary information input interface may be displayed, and the auxiliary information input may be implemented through the auxiliary information input interface, so that the audience account may be intuitively guided to implement the input of the auxiliary information in the client 103, and the efficiency of the auxiliary information input may be improved.

In addition, after step S701, the method may further include: the client 103 switches the auxiliary information input interface to an auxiliary information display interface in response to an interface switching operation triggered by the audience account; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information.

In this embodiment, after the client 103 displays the auxiliary information input interface, the audience account may further switch the auxiliary information input interface currently displayed in the client 103 to an auxiliary information display interface of an auxiliary information list for displaying the first multimedia information by triggering an interface switching operation, where the list includes a plurality of pieces of auxiliary information of the first multimedia information, and a source of the plurality of pieces of auxiliary information may be a plurality of pieces of auxiliary information input to the first multimedia information by a plurality of audience accounts or a plurality of pieces of auxiliary information input to the first multimedia information by a certain audience account for a plurality of times.

In this embodiment, in the process of displaying the auxiliary information input interface by the client 103, the auxiliary information input interface displayed by the client 103 may be switched to the auxiliary information display interface displaying the auxiliary information list by triggering an interface switching operation, so that the plurality of pieces of auxiliary information of the first multimedia information can be conveniently viewed by the audience account at any time, and the efficiency of querying the auxiliary information by the audience account is improved.

Further, after the client 103 switches the auxiliary information input interface to the auxiliary information display interface, the method further includes: the client 103 acquires voting information of the audience account for the auxiliary information included in the auxiliary information list; displaying a plurality of auxiliary information in an auxiliary information list in sequence according to the matching degree of the plurality of auxiliary information of the first multimedia information and the first multimedia information respectively; the fitting degree is represented by the voting information of each multimedia audience account to each auxiliary information.

Meanwhile, the display order of the plurality of pieces of auxiliary information in the auxiliary information list displayed in the client 103 may be determined by the order of the degree of matching between each piece of auxiliary information and the first multimedia information, for example, the client 103 may preferentially display the auxiliary information with high degree of matching, and the degree of matching may be represented by the voting information of the audience account for each piece of auxiliary information. Specifically, the audience account may vote for a plurality of pieces of auxiliary information of the first multimedia information through the client 103, the server 102 counts the number of voting votes corresponding to each piece of auxiliary information, and sorts the plurality of pieces of auxiliary information in order of the number of voting votes from top to bottom to form an auxiliary information list, so that the client 103 may display the sorted auxiliary information list in an auxiliary information display interface, so that the auxiliary information with a high degree of conformity has a higher display order.

In this embodiment, the client 103 can display a plurality of auxiliary information in the auxiliary information list according to the order of the voting information through the voting operation of the audience account on the auxiliary information of the first multimedia information, so that the auxiliary information with a high degree of conformity can be preferentially displayed, thereby optimizing the display order of the auxiliary information in the auxiliary information list.

For example, as shown in fig. 10, fig. 10 is an auxiliary information input interface displayed by the client 103 in an embodiment, the input interface may be used for the audience account to execute input of auxiliary information, and also carries an interface switching control for switching the displayed auxiliary information input interface into a display auxiliary information display interface, and when the audience account triggers the switching control in a click manner, the client 103 may display the auxiliary information display interface shown in fig. 11. The auxiliary information display interface carries an auxiliary information list, three pieces of auxiliary information of first multimedia information are displayed in the auxiliary information list, namely auxiliary information A, auxiliary information B and auxiliary information C, wherein the sequencing of the auxiliary information is determined by the sequence of the voting numbers of the audience accounts, namely the voting number A corresponding to the auxiliary information A is greater than the voting number B corresponding to the auxiliary information B, the voting number B corresponding to the auxiliary information B is greater than the voting number C corresponding to the auxiliary information C, each piece of auxiliary information corresponds to a voting control, when the audience accounts trigger the voting control of the auxiliary information A, voting can be performed on the auxiliary information A, and the voting control of the auxiliary information A can be displayed in a manner of being distinguished from other voting controls.

In an exemplary embodiment, the auxiliary information input interface includes an auxiliary information presentation area for presenting auxiliary information; step S701 may further include: the client 103 presents an assistance information list including at least one assistance information of the first multimedia information in an assistance information presentation area.

In this embodiment, the auxiliary information input interface may further carry an auxiliary information display area for displaying an auxiliary information list including the first multimedia information, that is, in the same interface, there are an auxiliary information display area for displaying the auxiliary information list and an input area for inputting the auxiliary information by the audience account, for example, in one interface, the upper half area part displays the auxiliary information list, and the lower half area part displays the input area for inputting the auxiliary information.

In this embodiment, the auxiliary information input interface may further include an auxiliary information display area, and when the auxiliary information is input by the audience account, if the auxiliary information provided by other audience accounts needs to be checked, the auxiliary information can be input without performing interface switching operation, so that the user operation is simplified, and the input efficiency of the auxiliary information is further improved.

In addition, step S602 may further include: if the audience account provides the auxiliary information of the first multimedia information, responding to the triggering operation of the audience account on the auxiliary information acquisition identifier, and displaying an auxiliary information display interface by the client 103; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information; and responding to interface switching operation triggered by the audience account, switching the auxiliary information display interface into an auxiliary information input interface, and acquiring the auxiliary information provided by the audience account on the auxiliary information input interface.

If the audience account of the client 103 has provided the auxiliary information for the first multimedia information, and if the audience account performs the corresponding trigger operation on the auxiliary information acquisition identifier displayed in the first multimedia information again, the client 103 may respond to the trigger operation, and compared with the auxiliary information input interface displayed when the auxiliary information is not provided, the client 103 may directly display an auxiliary information display interface of an auxiliary information list including at least one auxiliary information of the first multimedia information, as shown in fig. 12, and meanwhile, the auxiliary information display interface may further carry an interface switching control for switching the auxiliary information display interface displayed by the client 103 to a display auxiliary information input interface, and when the audience account triggers the interface switching operation by clicking the interface switching control, the client 103 may switch the displayed auxiliary information display interface to the display auxiliary information input interface, for the viewer account to re-enter the auxiliary information in the auxiliary information input interface.

In this embodiment, if the audience account has already completed providing the auxiliary information, the audience account may directly display the auxiliary information display interface through the auxiliary information acquisition identifier, so as to further improve the efficiency of inquiring the auxiliary information, and meanwhile, the audience account may trigger an interface switching operation on the auxiliary information display interface, so that the client 103 displays the auxiliary information input interface again, and the audience account may provide the auxiliary information for multiple times.

In an exemplary embodiment, step S603 may further include: the client 103 displays the second multimedia information and displays the account identification of the target audience account in the second multimedia information; the target audience account is an audience account that provides the target auxiliary information.

Wherein, the target audience account refers to an audience account providing the target auxiliary information for the second multimedia information. Specifically, when the second multimedia information is displayed on the client 103, the second multimedia information may carry an account identifier of the target audience account, for example, an account avatar of the target audience account. The account id may be used for, when the audience account performs a trigger operation on the presented account id, the client 103 may respond to the trigger operation and present an account information page of the target audience account in the client 103, for example, an account home page of the target audience account.

In this embodiment, the second multimedia information may further show an account identifier of a target audience account providing the target auxiliary information, so that the enthusiasm of the audience account to provide the auxiliary information may be improved, and the sources of the auxiliary information may be increased.

In an exemplary embodiment, a multimedia processing method is further provided, which may be applied to provide works and texts for short videos, as shown in fig. 13, and specifically includes the following steps:

1. when the work issued by the publisher has keywords such as 'give you a copy' and 'give you a copy', or the work has no description added manually, the work of the type is identified by copy identification or judgment of work information, and an entry button 'contribution copy' is automatically configured on the consumption detail page of the work.

2. The viewer can click when he sees the "contribution case" button entry on the publisher's work. After clicking the 'contribution case', the audience directly calls up the mobile phone keyboard and displays a default prompt 'please input the case' on the input box. After the audience inputs the description file and finishes typing characters, the lower right corner of the keyboard is changed into a clickable state, and the file is sent to the publisher after clicking.

3. The publisher clicks the 'contribution case' button, directly calls up a case ranking list for displaying all audience contribution cases, the case ranking list is provided with an 'application' button, and the publisher directly replaces the original case of the work with the current case after clicking the application. The publisher selects the document on the ranking list at most from one work. After the file application succeeds, the file can be directly replaced and displayed in the work description area, the color of the key identification is highlighted to be red, the file application is cancelled after clicking again, and the original file of the publisher is changed back.

4. Showing the "document contribution" identification and the head portrait of the contributor. The four characters of the 'contribution to the case' are highlighted, and after the 'contribution to the case' or the head portrait of the contributor is clicked, the user jumps to the personal homepage of the head portrait of the contributor.

In addition, each audience user can input the documents after initially clicking the 'contribution documents', meanwhile, the keyboard is also provided with a 'document ranking list' option, after clicking the document ranking list, a half-screen ranking list is called up, and all the documents contributed to the work are displayed.

After a user who inputs a case clicks the 'contribution case', the contribution case ranking list is opened by default, an 'item is written' option is arranged at the upper right corner of the list, and the user enters a writing case state by clicking, namely the keyboard state is called. The writing case and the case ranking list can be switched mutually, and audiences can write the writing case and check the case ranking list.

Meanwhile, the paperings contributed by all audiences are displayed on the papering ranking list, and the right side is provided with a voting button and vote number information, so that a user can spontaneously initiate voting, feels that the paperings are very suitable for the content of works or the writing is very good, and can click to vote. Clicking again to cancel, and after the voting is successful, highlighting the red color of the voting button to identify the successful state. A user can vote for a plurality of documents, but only can vote for one document at most and cannot vote repeatedly. The whole document ranking list is ranked according to the number of the tickets.

In the embodiment, after the works are shot or uploaded, the publisher can invite the audience and friends to contribute the works to the publishers without knowing what works should be matched, the works selected by the author can be applied to the works, and the head portraits of the contributors are displayed, so that a new source is added to the work description of the publisher, the audience can help the wanted works, the creation cost of meditation and thinking of the publisher is reduced, and the users are promoted to send the works. In addition, the cost of copying, re-editing and pasting of a publisher can be reduced, and the method can be applied by one key and is very convenient and fast. In addition, besides the comments, an interaction mode of the audience and the publisher is added, so that the participation sense of the user is stronger, other users can also participate in voting, the interactive playing method is enriched, and the contact between the audience and the publisher is enhanced.

It should be understood that, although the steps in the flowcharts of the present disclosure are shown in order as indicated by the arrows, the steps are not necessarily performed in order as indicated by the arrows. The steps are not performed in the exact order shown and described, and may be performed in other orders, unless explicitly stated otherwise. Moreover, at least some of the steps in the figures may include multiple steps or multiple stages, which are not necessarily performed at the same time, but may be performed at different times, and the order of execution of the steps or stages is not necessarily sequential, but may be performed alternately or in alternation with other steps or at least some of the other steps or stages.

Fig. 14 is a block diagram illustrating a multimedia information processing apparatus according to an exemplary embodiment. Referring to fig. 14, the apparatus includes an auxiliary information presentation unit 1401 and an auxiliary information application unit 1402.

An auxiliary information presentation unit 1401 configured to perform an auxiliary information acquisition operation in response to the first multimedia information, and present the auxiliary information of the first multimedia information;

the auxiliary information application unit 1402 is configured to perform a triggering operation of applying target auxiliary information in the auxiliary information to the first multimedia information, and presenting second multimedia information obtained by applying the target auxiliary information to the first multimedia information.

In an exemplary embodiment, the auxiliary information presentation unit 1401 is further configured to perform presentation of auxiliary information of the first multimedia information from the viewer account of the at least one first multimedia information.

In an exemplary embodiment, the auxiliary information presentation unit 1401 is further configured to perform presenting an auxiliary information list including at least one auxiliary information; the auxiliary information application unit 1402 is further configured to perform determining target auxiliary information based on the auxiliary information list, and displaying the target auxiliary information in the auxiliary information list in distinction from other auxiliary information.

In an exemplary embodiment, the auxiliary information presentation unit 1401 is further configured to perform presentation of a plurality of auxiliary information in the auxiliary information list in sequence according to the degree of matching between the plurality of auxiliary information and the first multimedia information, respectively; the degree of fit is represented by voting information of the audience account of the first multimedia information to each auxiliary information.

In an exemplary embodiment, the auxiliary information application unit 1402 is further configured to perform presenting the second multimedia information and presenting the account identification of the target audience account in the second multimedia information; the target audience account is an audience account that provides the target auxiliary information.

In an exemplary embodiment, the assistant information application unit 1402 is further configured to execute an application of canceling the target assistant information in the second multimedia information, redisplaying the first multimedia information, canceling the differentiated display of the target assistant information in the assistant information list, and canceling the account identification of the target audience account from being displayed.

Fig. 15 is a block diagram illustrating a multimedia information processing apparatus according to an exemplary embodiment. Referring to fig. 15, the apparatus includes a first multimedia presentation unit 1501, an auxiliary information input unit 1502, and a second multimedia presentation unit 1503.

A first multimedia presentation unit 1501 configured to perform presentation of first multimedia information; the first multimedia information is provided with an auxiliary information acquisition identifier;

an auxiliary information input unit 1502 configured to perform a trigger operation for an auxiliary information acquisition identifier in response to a viewer account of the first multimedia information, acquire auxiliary information of the first multimedia information input by the viewer account, and transmit the auxiliary information to a multimedia account providing the first multimedia information;

a second multimedia presentation unit 1503 configured to perform presentation of the second multimedia information; the second multimedia information is multimedia information obtained by applying target auxiliary information in the auxiliary information to the first multimedia information through the multimedia account.

In an exemplary embodiment, the auxiliary information input unit 1502 is further configured to perform a trigger operation on the auxiliary information acquisition identifier in response to the viewer account, and display an auxiliary information input interface; and acquiring auxiliary information provided by the audience account on an auxiliary information input interface.

In an exemplary embodiment, the multimedia information processing apparatus further includes: the information list display unit is configured to execute interface switching operation triggered by a viewer account and switch the auxiliary information input interface into an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information.

In an exemplary embodiment, the information list presenting unit is further configured to perform obtaining voting information of the audience account for the auxiliary information included in the auxiliary information list; displaying a plurality of auxiliary information in an auxiliary information list in sequence according to the matching degree of the plurality of auxiliary information of the first multimedia information and the first multimedia information respectively; the degree of fit is represented by voting information of the audience account of the first multimedia information to each auxiliary information.

In an exemplary embodiment, the auxiliary information input interface includes an auxiliary information presentation area for presenting auxiliary information; the auxiliary information input unit 1502 is further configured to perform presentation of an auxiliary information list including at least one auxiliary information of the first multimedia information in an auxiliary information presentation area.

In an exemplary embodiment, the auxiliary information input unit 1502 is further configured to perform, if the audience account has provided the auxiliary information of the first multimedia information, a step of presenting an auxiliary information presentation interface in response to a trigger operation of the audience account on the auxiliary information acquisition identifier; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information; and responding to the interface switching operation triggered by the audience account, switching the auxiliary information display interface into an auxiliary information input interface, and acquiring the auxiliary information provided by the audience account on the auxiliary information input interface.

In an exemplary embodiment, the second multimedia presentation unit 1503 is further configured to perform presenting the second multimedia information and presenting the account identification of the target audience account in the second multimedia information; the target audience account is an audience account that provides the target auxiliary information.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 16 is a block diagram illustrating an apparatus 1600 for multimedia information processing according to an example embodiment. For example, device 1600 may be a mobile phone, computer, digital broadcast terminal, messaging device, game console, tablet device, medical device, fitness device, personal digital assistant, and so forth.

Referring to fig. 16, device 1600 may include one or more of the following components: processing component 1602, memory 1604, power component 1606, multimedia component 1608, audio component 1610, input/output (I/O) interface 1612, sensor component 1614, and communications component 1616.

The processing component 1602 generally controls overall operation of the device 1600, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 1602 may include one or more processors 1620 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 1602 can include one or more modules that facilitate interaction between the processing component 1602 and other components. For example, the processing component 1602 can include a multimedia module to facilitate interaction between the multimedia component 1608 and the processing component 1602.

The memory 1604 is configured to store various types of data to support operation at the device 1600. Examples of such data include instructions for any application or method operating on device 1600, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 1604 may be implemented by any type of volatile or non-volatile storage device or combination thereof, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

A power supply component 1606 provides power to the various components of the device 1600. The power components 1606 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 1600.

The multimedia component 1608 comprises a screen that provides an output interface between the device 1600 and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 1608 comprises a front-facing camera and/or a rear-facing camera. The front-facing camera and/or the back-facing camera may receive external multimedia data when device 1600 is in an operational mode, such as a capture mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 1610 is configured to output and/or input an audio signal. For example, audio component 1610 includes a Microphone (MIC) configured to receive external audio signals when device 1600 is in an operational mode, such as a call mode, recording mode, and voice recognition mode. The received audio signal may further be stored in the memory 1604 or transmitted via the communications component 1616. In some embodiments, audio component 1610 further includes a speaker for outputting audio signals.

The I/O interface 1612 provides an interface between the processing component 1602 and peripheral interface modules, such as keyboards, click wheels, buttons, and the like. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

Sensor assembly 1614 includes one or more sensors for providing status assessment of various aspects of device 1600. For example, sensor assembly 1614 can detect an open/closed state of device 1600, the relative positioning of components, such as a display and keypad of device 1600, a change in position of device 1600 or a component of device 1600, the presence or absence of user contact with device 1600, orientation or acceleration/deceleration of device 1600, and a change in temperature of device 1600. The sensor assembly 1614 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 1614 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 1614 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communications component 1616 is configured to facilitate communications between device 1600 and other devices in a wired or wireless manner. The device 1600 may access a wireless network based on a communication standard, such as WiFi, an operator network (such as 2G, 3G, 4G, or 5G), or a combination thereof. In an exemplary embodiment, the communication component 1616 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communications component 1616 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the device 1600 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a computer-readable storage medium comprising instructions, such as the memory 1604 comprising instructions, executable by the processor 1620 of the device 1600 to perform the above-described method is also provided. For example, the computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

In an exemplary embodiment, there is also provided a computer program product comprising a computer program which, when executed by a processor, implements the multimedia information processing method as described in any of the above embodiments.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A method for processing multimedia information, comprising:

2. The method of claim 1, wherein said presenting the auxiliary information of the first multimedia information comprises:

presenting auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information.

3. The method of claim 2,

the auxiliary information for presenting the first multimedia information from at least one viewer account of the first multimedia information comprises:

displaying an auxiliary information list including at least one auxiliary information;

the presenting, in response to a trigger operation of applying target auxiliary information in the auxiliary information to the first multimedia information, second multimedia information obtained by applying the target auxiliary information to the first multimedia information, includes:

determining target auxiliary information based on the auxiliary information list, and displaying the target auxiliary information in the auxiliary information list in a distinguishing manner from other auxiliary information.

4. The method of claim 3, wherein the presenting an auxiliary information list comprising a plurality of auxiliary information comprises:

sequentially displaying the auxiliary information in the auxiliary information list according to the matching degree of the auxiliary information and the first multimedia information respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

5. The method of claim 3, wherein the presenting the second multimedia information obtained by applying the target assistance information to the first multimedia information comprises:

displaying the second multimedia information and displaying the account identification of the target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

6. The method of claim 5, wherein the presenting applies the target assistance information to the first multimedia information to obtain second multimedia information, and further comprising:

canceling the application of the target auxiliary information in the second multimedia information, redisplaying the first multimedia information, canceling the differentiated display of the target auxiliary information in the auxiliary information list, and canceling the display of the account identifier of the target audience account.

7. A method for processing multimedia information, comprising:

8. The method of claim 7, wherein the obtaining the auxiliary information of the first multimedia information input by the viewer account in response to the triggering operation of the viewer account of the first multimedia information for the auxiliary information obtaining identifier comprises:

responding to the triggering operation of the audience account on the auxiliary information acquisition identifier, and displaying an auxiliary information input interface;

and acquiring the auxiliary information provided by the audience account in the auxiliary information input interface.

9. The method of claim 8, wherein after presenting the auxiliary information input interface, further comprising:

responding to interface switching operation triggered by the audience account, and switching the auxiliary information input interface into an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information.

10. The method of claim 9, wherein after switching the auxiliary information input interface to an auxiliary information presentation interface, further comprising:

acquiring voting information of the audience account on auxiliary information contained in the auxiliary information list;

sequentially displaying a plurality of auxiliary information in the auxiliary information list according to the fit degree of the plurality of auxiliary information of the first multimedia information with the first multimedia information respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

11. The method of claim 8, wherein the auxiliary information input interface includes an auxiliary information presentation area for presenting auxiliary information;

the display auxiliary information input interface comprises:

an assistance information list including at least one assistance information of the first multimedia information is presented in the assistance information presentation area.

12. The method of claim 7, wherein the obtaining the auxiliary information of the first multimedia information input by the viewer account in response to the triggering operation of the viewer account of the first multimedia information for the auxiliary information obtaining identifier comprises:

if the audience account provides the auxiliary information of the first multimedia information, responding to the triggering operation of the audience account on the auxiliary information acquisition identifier, and displaying an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information;

and responding to the interface switching operation triggered by the audience account, switching the auxiliary information display interface into the auxiliary information input interface, and acquiring the auxiliary information provided by the audience account on the auxiliary information input interface.

13. The method according to any one of claims 7 to 12, wherein said presenting the second multimedia information comprises:

14. A multimedia information processing apparatus, characterized by comprising:

15. The apparatus of claim 14, wherein the auxiliary information presentation unit is further configured to perform presentation of auxiliary information of the first multimedia information from at least one viewer account of the first multimedia information.

16. The apparatus according to claim 15, wherein the auxiliary information presenting unit is further configured to perform presenting an auxiliary information list containing at least one auxiliary information; the auxiliary information application unit is further configured to perform determining target auxiliary information based on the auxiliary information list, and to perform differentiated display of the target auxiliary information from other auxiliary information in the auxiliary information list.

17. The apparatus according to claim 16, wherein the auxiliary information presenting unit is further configured to perform presenting the plurality of auxiliary information in the auxiliary information list in sequence according to the degree of matching between the plurality of auxiliary information and the first multimedia information, respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

18. The apparatus of claim 16, wherein the auxiliary information application unit is further configured to perform presenting the second multimedia information and presenting an account identifier of a target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

19. The apparatus of claim 18, wherein the auxiliary information application unit is further configured to execute an application for canceling the target auxiliary information in the second multimedia information, re-presenting the first multimedia information, canceling the differentiated display of the target auxiliary information in the auxiliary information list, and canceling the account identifier of the target audience account.

20. A multimedia information processing apparatus, characterized by comprising:

21. The apparatus of claim 20, wherein the auxiliary information input unit is further configured to perform a triggering operation of the auxiliary information acquisition identifier in response to the viewer account, and to display an auxiliary information input interface; and acquiring the auxiliary information provided by the audience account in the auxiliary information input interface.

22. The apparatus of claim 21, further comprising: the information list display unit is configured to execute interface switching operation triggered by the audience account and switch the auxiliary information input interface into an auxiliary information display interface; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information.

23. The apparatus according to claim 22, wherein the information list presenting unit is further configured to perform obtaining voting information of the audience account for the auxiliary information included in the auxiliary information list; sequentially displaying a plurality of auxiliary information in the auxiliary information list according to the fit degree of the plurality of auxiliary information of the first multimedia information with the first multimedia information respectively; and the fit degree is characterized by voting information of the audience account of the first multimedia information to each piece of auxiliary information.

24. The apparatus of claim 21, wherein the auxiliary information input interface comprises an auxiliary information presentation area for presenting auxiliary information; the auxiliary information input unit is further configured to perform presentation of an auxiliary information list including at least one auxiliary information of the first multimedia information in the auxiliary information presentation area.

25. The apparatus according to claim 20, wherein the auxiliary information input unit is further configured to perform, if the viewer account already provides the auxiliary information of the first multimedia information, an auxiliary information presentation interface is presented in response to a trigger operation of the viewer account on the auxiliary information acquisition identifier; the auxiliary information display interface is used for displaying an auxiliary information list containing at least one auxiliary information of the first multimedia information; and responding to the interface switching operation triggered by the audience account, switching the auxiliary information display interface into the auxiliary information input interface, and acquiring the auxiliary information provided by the audience account on the auxiliary information input interface.

26. The apparatus according to any one of claims 20 to 25, wherein the second multimedia presentation unit is further configured to perform presenting the second multimedia information and presenting an account identifier of a target audience account in the second multimedia information; the target audience account is an audience account providing the target auxiliary information.

27. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the multimedia information processing method of any of claims 1 to 13.

28. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the multimedia information processing method of any of claims 1 to 13.