CN113343827A

CN113343827A - Video processing method and device, electronic equipment and computer readable storage medium

Info

Publication number: CN113343827A
Application number: CN202110606514.1A
Authority: CN
Inventors: 梁斐然; 刘洋
Original assignee: Beijing Dajia Internet Information Technology Co Ltd
Current assignee: Beijing Dajia Internet Information Technology Co Ltd
Priority date: 2021-05-31
Filing date: 2021-05-31
Publication date: 2021-09-03

Abstract

The present disclosure relates to a video processing method, an apparatus, an electronic device, and a computer-readable storage medium, wherein the method comprises: acquiring a video to be published in a video interactive application; and when the video comprises news materials, acquiring element contents of news corresponding to the news materials, and adding the element contents into the video. Through the method and the device, the problem that the video content is incomplete after the video to be published is processed in the related art is solved, and the effect of effectively improving the integrity of the video content is achieved.

Description

Video processing method and device, electronic equipment and computer readable storage medium

Technical Field

The present disclosure relates to the field of computers, and in particular, to a video processing method and apparatus, an electronic device, and a computer-readable storage medium.

Background

When the video is played on the interactive application software, the video is edited by the publisher according to the needs of the publisher, for example, the publisher clips or renders the video. However, when the video is processed as described above, the video may lack some important information, resulting in incomplete content.

Disclosure of Invention

The disclosure provides a video processing method, a video processing device, an electronic device and a computer-readable storage medium, so as to at least solve the problem that the content of a video is incomplete after the video to be distributed is processed in the related art. The technical scheme of the disclosure is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a video processing method, including: acquiring a video to be published in a video interactive application; under the condition that the video comprises news materials, acquiring element contents of news corresponding to the news materials; adding the element content to the video.

Optionally, the obtaining of the element content of the news corresponding to the news material includes: acquiring audio data from the video; capturing news keywords from the audio data; and searching news corresponding to the news materials according to the news keywords to obtain the element content of the news.

Optionally, the method further comprises: acquiring image data from the video; acquiring news image data from news corresponding to the news materials; verifying the image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to an uploading terminal of the video.

Optionally, adding the element content to the video comprises: determining a predetermined frame video image in the video, wherein a target object corresponding to the element content exists in the predetermined frame video image; adding the element content to the predetermined frame video image.

Optionally, adding the element content to the predetermined frame video image includes: determining the position of the target object in the predetermined frame video image; displaying the elemental content for the target object based on the determined location.

In a second aspect of the embodiments of the present disclosure, a video processing method is provided, including: receiving a video playing request on a display interface; responding to the video playing request, and playing a video on the display interface, wherein the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

In a third aspect of the embodiments of the present disclosure, a video processing method is provided, including: receiving a sliding operation; and responding to the sliding operation, and playing a video, wherein the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

In a fourth aspect of the embodiments of the present disclosure, there is provided a video processing apparatus including: the first acquisition module is used for acquiring a video to be published in the video interactive application; the second acquisition module is used for acquiring element contents of news corresponding to the news materials under the condition that the video comprises the news materials; a first adding module for adding the element content to the video.

Optionally, the second obtaining module includes: a first acquisition unit configured to acquire audio data from the video; the second acquisition unit is used for acquiring news keywords from the audio data; and the first searching unit is used for searching news corresponding to the news material according to the news keywords to obtain the element content of the news.

Optionally, the apparatus further comprises: the third acquisition module is used for acquiring image data from the video; the fourth acquisition module is used for acquiring news image data from news corresponding to the news materials; the inspection module is used for inspecting the image data in the video according to the news image data to obtain an inspection result; and the feedback module is used for feeding back the verification result to the video uploading terminal.

Optionally, the first adding module includes: a determining unit configured to determine a predetermined frame video image in the video, wherein a target object corresponding to the element content is present in the predetermined frame video image; an adding unit configured to add the element content to the predetermined frame video image.

Optionally, the adding unit includes: a determining subunit, configured to determine a position of the target object in the predetermined frame of video image; a display subunit, configured to display the element content for the target object based on the determined position.

In a fifth aspect of the embodiments of the present disclosure, there is provided a video processing apparatus including: the first receiving module is used for receiving a video playing request on a display interface; the first playing module is configured to respond to the video playing request and play a video on the display interface, where the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

In a sixth aspect of the disclosed embodiments, there is provided a video processing apparatus comprising: the second receiving module is used for receiving the sliding operation; and the second playing module is used for responding to the sliding operation and playing a video, wherein the video is a video in the video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

A seventh aspect of the disclosed embodiments provides an electronic device, including: a processor; a memory for storing the processor-executable instructions; wherein the processor is configured to execute the instructions to implement the video processing method according to any one of the above.

In an eighth aspect of the embodiments of the present disclosure, a computer-readable storage medium is provided, in which instructions, when executed by a processor of an electronic device, enable the electronic device to perform any one of the video processing methods described above.

According to a ninth aspect of embodiments of the present disclosure, there is provided a computer program product, which, when executed by a processor of an electronic device, enables the electronic device to perform any one of the video processing methods described above.

The technical scheme provided by the embodiment of the disclosure at least brings the following beneficial effects:

the element content of news is added in the video aiming at the news materials in the video, so that missing information in the video can be supplemented, a video viewer can effectively view complete information of the video, and the experience of the user in viewing the video is improved. The problem of incomplete video content caused by processing of the video to be published in the related art is solved, and the effect of effectively improving the integrity of the video content is achieved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure and are not to be construed as limiting the disclosure.

Fig. 1 is a block diagram illustrating a hardware configuration of a computer terminal for implementing a video processing method according to an exemplary embodiment.

Fig. 2 is a flow chart illustrating a first video processing method according to an example embodiment.

Fig. 3 is a schematic diagram of an interface for adding element content to a video frame according to an embodiment of the present invention.

Fig. 4 is a flowchart illustrating a second video processing method according to an exemplary embodiment.

Fig. 5 is a flow diagram illustrating a video processing method three in accordance with an exemplary embodiment.

Fig. 6 is a flow diagram illustrating a video processing method four in accordance with an exemplary embodiment.

Fig. 7 is an apparatus block diagram illustrating a first video processing apparatus according to an example embodiment.

Fig. 8 is a device block diagram of a second video processing device shown in accordance with an example embodiment.

Fig. 9 is an apparatus block diagram of a video processing apparatus iii shown according to an exemplary embodiment.

Fig. 10 is an apparatus block diagram of a terminal shown in accordance with an example embodiment.

FIG. 11 is a block diagram illustrating the structure of a server in accordance with an exemplary embodiment.

Detailed Description

In order to make the technical solutions of the present disclosure better understood by those of ordinary skill in the art, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and claims of the present disclosure and in the above-described drawings are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the disclosure described herein are capable of operation in sequences other than those illustrated or otherwise described herein. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

Example 1

According to an embodiment of the present disclosure, a method embodiment of a video processing method is presented. It should be noted that the steps illustrated in the flowcharts of the figures may be performed in a computer system such as a set of computer-executable instructions and that, although a logical order is illustrated in the flowcharts, in some cases, the steps illustrated or described may be performed in an order different than presented herein.

The method provided by the embodiment 1 of the present disclosure can be executed in a mobile terminal, a computer terminal or a similar operation device. Fig. 1 is a block diagram illustrating a hardware structure of a computer terminal (or mobile device) for implementing a video processing method according to an exemplary embodiment. As shown in fig. 1, the computer terminal 10 (or mobile device) may include one or more (shown as 102a, 102b, … …, 102 n) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), memories 104 for storing data, and a transmission device for communication functions. Besides, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a Universal Serial BUS (USB) port (which may be included as one of the ports of the BUS), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 10 may also include more or fewer components than shown in FIG. 1, or have a different configuration than shown in FIG. 1.

It should be noted that the one or more processors 102 and/or other data processing circuitry described above may be referred to generally herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part in software, hardware, firmware, or any combination thereof. Further, the data processing circuit may be a single stand-alone processing module, or incorporated in whole or in part into any of the other elements in the computer terminal 10 (or mobile device). As referred to in the disclosed embodiments, the data processing circuit acts as a processor control (e.g., selection of a variable resistance termination path connected to the interface).

The memory 104 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the video processing method in the embodiment of the present disclosure, and the processor 102 executes various functional applications and data processing by running the software programs and modules stored in the memory 104, that is, implementing the vulnerability detection method of the application program. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to the computer terminal 10 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission device is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 10. In one example, the transmission device includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the computer terminal 10 (or mobile device).

It should be noted here that in some alternative embodiments, the computer device (or mobile device) shown in fig. 1 described above may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that fig. 1 is only one example of a particular specific example and is intended to illustrate the types of components that may be present in the computer device (or mobile device) described above.

The data (e.g., data for analysis, data presented, etc.) to which the present disclosure relates may be data that is authorized by a user or sufficiently authorized by various parties.

In the above operating environment, the present disclosure provides a video processing method as shown in fig. 2. Fig. 2 is a flowchart illustrating a first video processing method according to an exemplary embodiment, which is used in the computer terminal described above and includes the following steps, as shown in fig. 2.

In step S21, a video to be published in the video interactive application is acquired.

In step S22, when the video includes news-like material, the element content of news corresponding to the news-like material is acquired.

The content of the above elements may include: time of news occurrence, place of news occurrence, character of news occurrence, and the like.

In step S23, the element content is added to the video.

By adopting the processing, the element content of news is added in the video aiming at the news materials in the video, so that the missing information in the video can be supplemented, the video viewer can effectively view the complete information of the video, and the experience of the user in viewing the video is improved. The problem of incomplete video content caused by processing of the video to be published in the related art is solved, and the effect of effectively improving the integrity of the video content is achieved.

In one or more optional embodiments, the video processing method one may be applied to a variety of video processing scenarios, where the scenario may be a scenario for processing a video to be published in a video interaction application. The first video processing method may be executed in various manners, and for example, the first video processing method may be executed in a server that performs an audit or edit process on a video to be distributed, or may be executed in a terminal, such as a computer cluster having a parallel processing function.

In one or more optional embodiments, the video to be published in the video interaction application is acquired, that is, the user publishing the video uploads the video to the server, and the server receives the uploaded video. It should be noted that, when the user uploads the video to be published, the user may be provided with an option of selecting a type, and the user selects the type of the uploaded video to be published, which may be, for example, news, entertainment, self-timer, life, and the like, according to the provided option. Of course, the user selects the provided option, which may not be a necessary operation, i.e., the user may select whether to identify the genre.

In one or more alternative embodiments, there are a number of ways in which the determination of whether a video includes news-like material may be made. For example, when the user uploads the video to be distributed, and the type of the video to be distributed is already selected, it may be determined whether the video includes news material directly according to the type selected by the user. For example, when a user uploads a video, which has been identified as belonging to a news category, the video can be confirmed to include news-like material to a greater extent. For another example, when determining whether a video includes news-like material, the specific content of the video may be analyzed, so as to accurately determine whether the video belongs to news-like material. For example, voice and image data may be obtained from a video (i.e., the video is split to obtain audio data and image data, respectively), and a keyword in the video content may be captured from the voice, for example, the keyword may be compared with a predetermined news word bank, and when the keyword matches a news word in the news word bank, it is determined that news material is included in the video. Whether the video comprises news materials or not can be determined more accurately by matching with a predetermined news word bank.

In one or more optional embodiments, when the element content of the news corresponding to the news-type material is obtained, the news corresponding to the news-type material may be determined first, and then the element content of the news may be obtained. For example, the following processing may be employed: acquiring audio data from a video; acquiring news keywords from audio data; and searching news corresponding to the news materials according to the news keywords to obtain the element content of the news. In one or more optional embodiments, when obtaining the news keyword from the audio data, that is, splitting the video to obtain the audio data, some video editing software may be used, and the audio data in the video is separated by the software, so as to be stored as an audio data file. Capturing news keywords from audio data can be implemented by Natural Language Processing (NLP). For example, the audio data may be converted into a text, the text may be preprocessed (e.g., the text may be segmented, stop words may be removed, etc.) to obtain segmented words, and then, each segmented word may be matched with a word in a news word bank to obtain a news keyword included in the audio data. When the news corresponding to the news-type material is searched according to the news keyword to obtain the element content of the news, the news keyword may be processed first, for example, the context of the news keyword in the audio data may be processed semantically to obtain a news entry, and then, the news corresponding to the news-type material is searched in a news database (for example, an authorized news website) according to the news entry, and the information of the searched news is extracted to obtain the element content of the news. For example, the following may be employed: firstly, semantic processing is carried out on the context of a news keyword in audio data to obtain a complete information segment; and refining the complete information segment to obtain a news entry. Wherein, the complete information segment is used for completely expressing the content of news materials in the video. After the complete information segment is refined, the obtained news entry is convenient for subsequent searching. After the context of the news keyword is subjected to semantic processing, a complete information segment is obtained, the content of news can be comprehensively and accurately expressed, and the follow-up search is accurate; and the complete information segment is refined to obtain news entries, which is more beneficial to subsequent search. And searching news corresponding to the news materials according to the news keywords, and when obtaining the element content of the news, searching in a news database, and refining the information of the news corresponding to the news materials to obtain the element content of the news. When news is searched according to the news keywords, the news database to be searched can be selected, and the completeness of the searched news is high.

In one or more optional embodiments, image data may also be acquired from the video; acquiring news image data from news corresponding to the news materials; verifying image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to an uploading terminal of the video. The news image data acquired from the news corresponding to the news material is complete image data of the news, and when the image data in the video is verified, the image data in the video can be compared with key information in the news image data in the news, so that a verification result of whether the image data in the video is complete is obtained, and the verification result is fed back to a video uploading user. And when the verification result represents that the image data in the video is incomplete, feeding back user prompt information for prompting that the video needs to be modified, so that the uploaded video is complete and accurate. For example, the video upload user may be prompted to supplement some information of the uploaded video, for example, supplement some key elements of the uploaded video: time, place, people, etc. By adopting the processing, the video uploading user can be prompted to upload the complete video content, and the satisfaction degree of the video watching user is improved.

In one or more optional embodiments, after the element content is acquired, when the element content is added to the video, a predetermined frame of video image in the video may be determined, wherein a target object corresponding to the element content appears in the predetermined frame of video image; the element contents are added to a predetermined frame video image. Since the target object corresponding to the element content is present in the predetermined frame video image, the integrity of the video can be displayed more clearly when the element content is added to the predetermined frame video image. For example, when the element content is a character with news, the character with news is added to a video image of a predetermined frame of the character in the video, and the video frame without the character in the video is not added, so that a video viewer can more directly confirm the integrity of the video content during video playing, and the viewing experience of the user is further improved.

In one or more optional embodiments, when the element content is added to the predetermined frame video image, the position of the target object in the predetermined frame video image may be determined; based on the determined position, the elemental content is displayed for the target object. The element content is displayed aiming at the target object at the position of the target object, so that when a video is played, a video viewer can confirm the integrity of the video content more directly, and the position of the target object corresponding to the element content in a video image can be known more clearly, so that the user can further conveniently know the element information, and the video viewing experience of the user is further improved. Fig. 3 is a schematic diagram of an interface for adding element content to a video frame according to an embodiment of the present invention, as shown in fig. 3, when a target object (e.g., a handbag in a car) appears in the video image of the predetermined frame, an arrow may be drawn at the position of the object, an image frame is displayed at a short distance from the arrow (e.g., at a position that does not obstruct the video image), and the target object in the news (clearer than the image in the video) is displayed in the image frame, so that a viewer can recognize the object in the video, and thus the viewer of the video can know more details of the target object, and the like.

In one or more optional embodiments, when the element content is added to the video after the element content is acquired, the addition may be implemented in various ways according to different adding manners and different adding positions. The following examples are given.

When the adding mode is different, the element content can be added into the video by at least one of the following modes: adding element content to a video in a watermark mode; adding element content to the video in an animation mode; adding element content to the video in a bullet screen mode; element content is added to the video in a moving window manner. The key content is added to the video in a watermark mode, so that the video watched by the user is not shielded, and the video watched by the user is not influenced. The element content is added to the video in an animation mode, so that the integrity of the video content can be shown to a user through a more friendly picture. The element content is added to the video in a bullet screen mode, and the element content can be flexibly expressed. When the element content is added to the video in a mobile window mode, after a user pays attention to the element content, the mobile window can be conveniently closed, and therefore the user can effectively control the element content.

When the adding positions are different, the element content can be added into the video in at least one of the following ways: adding the element content to a first frame video image of the video; adding the element content to each frame of video image of the video; the element content is added to a predetermined frame video image of the video. Wherein the element content is added to the first frame video image of the video, and the element content can be watched by the user at the first time. Adding the element content to each frame of video image of the video can enable a video viewer to obtain the element content of the news material for a long time, for example, if the video viewer does not see the element content in the first frame of video image, the element content can also be seen in other frames of video images, and the video viewer can be prevented from missing the element content. The element content is added to the predetermined frame of video image of the video, so that the element content can be prevented from being missed by the user as much as possible, and the operation of adding the element content can be effectively reduced because the addition of each frame of video image is not needed. It should be noted that the predetermined frame images referred to above may be some more specific frame images, for example, frame images corresponding to a news key information display screen.

It should be noted that, the above-mentioned adding of the element content to the video is to realize that the element content is displayed when the video is played, so that the video and the element content are displayed together. Therefore, when the element content is added to the video, the element content may be played back as a part of the video, or the element content and the video may be treated as separate bodies and displayed when the video is played back. When the element content independent from the video is displayed when the video is played, various modes may be adopted, for example, the element content is displayed in a control mode, the element content is displayed in a window-skipping mode, and the like.

In one or more optional embodiments, when the element content is added to the video, in order to show the complete news material included in the video to the user as much as possible, the integrity of the video itself can be shown in addition to the element content of the news material. For example, it may be determined whether a news image included in a video is complete, and then the determination result is also added to the video to be presented to the user. For example, the following method can be adopted: acquiring image data split from a video; acquiring news image data searched from a news database; comparing image data split from the video with news image data searched from a news database to obtain comparison result information; and adding the element content into the video in combination with the comparison result information. It should be noted that, when determining the integrity of the video itself, higher accuracy may be obtained, and the computational complexity may be involved. For example, when the specific details of each frame of video image of news material in the video are determined in detail, the amount of calculation or analysis required is large, and thus the cost is large.

In one or more alternative embodiments, the determination of the integrity of the news images included in the video may be selected when the determination of the integrity of the video itself is made. For example, the image data split from the video is compared with news image data corresponding to news materials, and if the difference between the two is within a certain range, it can be determined that the news image included in the video is complete. The determination of the integrity of the video itself may be optional, for example, the determination may be made on a news image corresponding to some news-like material with high attention and high importance. Therefore, before verifying the image data split from the video and the news image data corresponding to the news material, the method may further include: determining the attention and/or importance value of news corresponding to the news materials; detecting that the attention is greater than a predetermined attention threshold and/or detecting that the importance value is greater than a predetermined importance threshold; and determining to verify the image data split from the video and news image data corresponding to the news materials under the condition that the attention degree is larger than a preset attention degree threshold value and/or the importance value is larger than a preset importance threshold value. As mentioned above, the predetermined attention threshold may be determined according to the influence degree of news, and may be represented by an influence factor, for example, where the influence factor may be a value smaller than 1. When the influence range of the news material is large and the time is long, the corresponding attention degree is higher; otherwise the smaller. The predetermined importance threshold may also be determined according to the predetermined attention threshold, which is not described herein again.

In one or more optional embodiments, after the element content is added to the video, the video with the element content added thereto may also be published. The video added with the element content is published, so that the video is audited and published, and the published video content is more complete.

Fig. 4 is a flowchart illustrating a second video processing method according to an exemplary embodiment, as shown in fig. 4, the method includes the following steps.

In step S41, a video playing request is received on the display interface;

in step S42, in response to the video playing request, playing a video on the display interface, where the video is a video in the video interaction application, the played video is added with element content of news, and the news is news corresponding to news-like materials included in the video.

By adopting the processing, the video added with the news element content is played on the display interface, so that a video viewer can accurately know the news element content, and the video viewing experience of the user is improved. The problem of incomplete video content caused by processing of the video to be published in the related art is solved, and the effect of effectively improving the integrity of the video content is achieved.

Fig. 5 is a flow diagram illustrating a video processing method three, according to an example embodiment, which includes the following steps, as shown in fig. 5.

In step S51, a slide operation is received.

In step S52, in response to the sliding operation, a video is played, where the video is a video in the video interaction application, the played video is added with element content of news, and the news is news corresponding to news-like material included in the video.

By adopting the processing, the video is played by responding to specific application operation (for example, the video playing is triggered by the sliding operation in the video interaction application), and the element content of the news is added in the played video, so that a video viewer can accurately know the element content of the news in the process of watching the video by sliding, and the experience of watching the video by the user is improved. The problem of incomplete video content caused by processing of the video to be published in the related art is solved, and the effect of effectively improving the integrity of the video content is achieved.

An alternative embodiment of the present invention will be described below using one scenario as an example. In this scenario, a user uploads a video for distribution in a video interaction application. The type of the user is not particularly limited herein.

On a video playing application (for example, the video interactive application mentioned above), there are many news-like materials in a video when video browsing is performed. News-like material generally needs to be focused on the event itself, and the place, time and task where the event happens, namely the so-called news element, should be described in detail. However, some video uploading users may clip news materials, but some essential information (e.g., time) may be lost during the clipping process. Once the information of the elements is lost, the news material may not express the information accurately. Therefore, when the video uploading user uploads the video including the news material, the information may be missing, and the content may be incomplete.

In view of this, in this alternative embodiment, an alternative embodiment of a video processing method is provided. Fig. 6 is a flow diagram illustrating a fourth method of video processing, according to an example embodiment, as shown in fig. 6, including the following steps.

S1, the description is made with the video published by the user as a starting point. A user uploads material of a video to be published, at which time category selections (e.g., news, entertainment, self-timer, life, etc.) of the material included in the published video may be added, wherein the user may not select but adopt a default value; the selection can also be carried out according to the actual situation;

s2, performing qualification audit on the materials uploaded by the user, namely the materials in the video can be various, for example, the materials can contain image information and audio information, the materials uploaded by the user can be audited, if the materials are qualified for distribution, the subsequent process can be continued, otherwise, the materials are returned;

s3, splitting the material uploaded by the user to obtain audio data and image data, namely when the user has a publishing qualification through preliminary examination, the server side can split the audio and video of the uploaded original video to obtain audio and image data, so that subsequent processing is facilitated;

s4, determining whether the materials uploaded by the user belong to news materials according to the obtained audio data, and acquiring three news elements under the condition that the materials belong to news materials: and the server performs voice analysis on the audio data, and determines whether the audio data comprises news materials or not by performing voice comparison with the news word stock. If news-like material is included, the news keywords are refined. After capturing the news keywords, performing semantic analysis on the context of the news keywords, and confirming the information to be captured again (the news keywords trigger the context semantic analysis, and a complete piece of information is obtained through the semantic analysis). Obtaining final news keywords (obtaining the news keywords after a section of complete information simplification) after multiple sampling capture and voice semantic analysis;

after obtaining news keywords, the server side can search the news keywords through each big news database to obtain information related to the news, and then extracts the information by 'three-element (time, place and character)' to obtain short three-element content;

and S5, determining whether the material uploaded by the user is accurate according to the obtained image data: after the audio data is processed, whether the image data needs to be screened or not can be determined according to the attention and importance of the obtained news so as to ensure the accuracy of the related content. If image discrimination is needed, image comparison is needed, and the two comparison sides are as follows: images in the material; secondly, the accuracy of image information is ensured through the images obtained by the news keywords or the news keywords on a news database;

and S6, adding three news elements to the materials uploaded by the user under the condition that the materials uploaded by the user are accurate: after the above processing, the following information can be obtained: the method comprises the steps of judging whether materials included in the video are news materials, obtaining related three elements through auxiliary means, confirming whether published images are accurate through image comparison and the like, and therefore the method has the capacity of assisting in increasing the three elements. Therefore, on the basis of the steps, the server can also select to process the first frame image of the video, add the acquired information, integrate the audio and video data, and then release the audio and video data to a release system for subsequent release.

In the optional implementation mode, on the basis of the existing platform service, the information transmission is more accurate by helping the user to perfect the necessary information of the 'news class' material uploaded by the user. In this optional embodiment, an option of selecting a type may be provided when the user uploads the material, and the category to which the material belongs is preliminarily determined to correspond to a subsequent different process. When the material has the distribution qualification after being primarily screened, content analysis can be added, and whether the material is news material or not is confirmed again through voice semantic analysis. If the news material is confirmed, capturing the key words to split the key words, and then searching the key words on a news database to obtain complete information of the news, such as time, people, places and the like. After the above important information of news is acquired, three elements of the news are extracted, and then the information is added to the first frame of the video material in a watermark mode, so that a video viewer can watch the information conveniently. In the optional embodiment, the publisher publishing process is basically unchanged, the publishing cost is not increased, and the video viewer can acquire complete news information.

Therefore, with the above alternative embodiment, the following advantageous effects can be achieved: on the basis of not changing the existing flow, the news three elements are added in an auxiliary mode, and on the premise of reducing the input cost, news information can be transmitted more accurately; secondly, the accuracy of the system is greatly improved through machine learning and language processing; moreover, the video auditing efficiency is further improved through automatic verification and identification of the image content.

It is noted that while for simplicity of explanation, the foregoing method embodiments have been described as a series of acts or combination of acts, it will be appreciated by those skilled in the art that the present disclosure is not limited by the order of acts, as some steps may, in accordance with the present disclosure, occur in other orders and concurrently. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required for the disclosure.

Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present disclosure may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method of the embodiments of the present disclosure.

Example 2

According to an embodiment of the present disclosure, there is also provided an apparatus for implementing the first video processing method, and fig. 7 is an apparatus block diagram of the first video processing apparatus according to an exemplary embodiment. Referring to fig. 7, the apparatus, which is described below, includes a first acquiring module 71, a second acquiring module 72, and a first adding module 73.

A first obtaining module 71, configured to obtain a video to be published in a video interaction application; a second obtaining module 72, connected to the first obtaining module 71, for obtaining the element content of news corresponding to the news material when the video includes the news material; and a first adding module 73 connected to the second obtaining module 72 for adding the element content to the video.

It should be noted here that the first obtaining module 71, the second obtaining module 72 and the first adding module 73 correspond to steps S21 to S23 in embodiment 1, and the modules are the same as the corresponding steps in the implementation example and application scenarios, but are not limited to the disclosure in embodiment 1. It should be noted that the above modules may be operated in the computer terminal 10 provided in embodiment 1 as a part of the apparatus.

In one or more optional embodiments, the second obtaining module comprises: a first acquisition unit configured to acquire audio data from the video; the second acquisition unit is used for acquiring news keywords from the audio data; and the first searching unit is used for searching news corresponding to the news material according to the news keywords to obtain the element content of the news.

In one or more optional embodiments, the apparatus further comprises: the third acquisition module is used for acquiring image data from the video; the fourth acquisition module is used for acquiring news image data from news corresponding to the news materials; the inspection module is used for inspecting the image data in the video according to the news image data to obtain an inspection result; and the feedback module is used for feeding back the verification result to the video uploading terminal.

In one or more optional embodiments, the first adding module comprises: a determining unit configured to determine a predetermined frame video image in the video, wherein a target object corresponding to the element content is present in the predetermined frame video image; an adding unit configured to add the element content to the predetermined frame video image.

In one or more optional embodiments, the adding unit comprises: a determining subunit, configured to determine a position of the target object in the predetermined frame of video image; a display subunit, configured to display the element content for the target object based on the determined position.

According to an embodiment of the present disclosure, there is also provided an apparatus for implementing the second video processing method, and fig. 8 is an apparatus block diagram of the second video processing apparatus according to an exemplary embodiment. Referring to fig. 8, the apparatus, which is described below, includes a first receiving module 81 and a first playing module 82.

A first receiving module 81, configured to receive a video playing request on a display interface; the first playing module 82 is connected to the first receiving module 81, and configured to respond to a video playing request, and play a video on a display interface, where the video is a video in a video interaction application, an element content of news is added to the played video, and the news is news corresponding to a news material included in the video.

It should be noted that the first receiving module 81 and the first playing module 82 correspond to steps S41 to S42 in embodiment 1, and the modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in embodiment 1. It should be noted that the above modules may be operated in the computer terminal 10 provided in embodiment 1 as a part of the apparatus.

According to an embodiment of the present disclosure, there is also provided an apparatus for implementing the video processing method three described above, and fig. 9 is an apparatus block diagram of the video processing apparatus three shown according to an exemplary embodiment. Referring to fig. 9, the apparatus includes a second receiving module 91 and a second playing module 92, which will be described below.

A second receiving module 91, configured to receive a sliding operation; and a second playing module 92, connected to the second receiving module 91, and configured to play a video in response to a sliding operation, where the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

It should be noted that the second receiving module 91 and the second playing module 92 correspond to steps S51 to S52 in embodiment 1, and the modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in embodiment 1. It should be noted that the above modules may be operated in the computer terminal 10 provided in embodiment 1 as a part of the apparatus.

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Example 3

The embodiment of the disclosure can provide an electronic device, which can be a terminal or a server. For example, when the electronic device is a terminal, the terminal may be any one of computer terminal devices in a computer terminal group. Optionally, in this embodiment, the terminal may also be a terminal device such as a mobile terminal.

Optionally, in this embodiment, the terminal may be located in at least one network device of a plurality of network devices of a computer network.

Alternatively, fig. 10 is a block diagram illustrating a structure of a terminal according to an exemplary embodiment. As shown in fig. 10, the terminal may include: one or more processors (only one shown) 101, a memory 102 for storing processor-executable instructions; wherein the processor is configured to execute the instructions to implement the video processing method of any of the above.

The memory may be configured to store software programs and modules, such as program instructions/modules corresponding to the video processing method and apparatus in the embodiments of the present disclosure, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, so as to implement the video processing method. The memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory may further include memory located remotely from the processor, and these remote memories may be connected to the computer terminal through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: .

Optionally, the processor may further execute the program code of the following steps: acquiring a video to be published in a video interactive application; under the condition that the video comprises news materials, acquiring element contents of news corresponding to the news materials; the element content is added to the video.

Optionally, the processor may further execute the program code of the following steps: acquiring element content of news corresponding to news materials, wherein the element content comprises the following steps: acquiring audio data from a video; capturing news keywords from the audio data; and searching news corresponding to the news materials according to the news keywords to obtain the element content of the news.

Optionally, the processor may further execute the program code of the following steps: acquiring image data from a video; acquiring news image data from news corresponding to the news materials; verifying image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to an uploading terminal of the video.

Optionally, the processor may further execute the program code of the following steps: adding element content to a video, comprising: determining a preset frame video image in the video, wherein a target object corresponding to the element content exists in the preset frame video image; the element contents are added to a predetermined frame video image.

Optionally, the processor may further execute the program code of the following steps: adding element content to a predetermined frame video image, including: determining the position of a target object in a predetermined frame of video image; based on the determined position, the elemental content is displayed for the target object.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: receiving a video playing request on a display interface; responding to a video playing request, and playing a video on a display interface, wherein the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: receiving a sliding operation; and responding to the sliding operation, and playing the video, wherein the video is a video in the video interaction application, the element content of news is added in the played video, and the news is news corresponding to news materials included in the video.

In a case where the electronic device is a server, in an embodiment of the present disclosure, a server is provided, and fig. 11 is a block diagram illustrating a configuration of a server according to an exemplary embodiment. As shown in fig. 11, the server 110 may include: one or more (only one shown) processing components 111, a memory 112 for storing instructions executable by the processing components 111, a power supply component 113 for supplying power, a network interface 114 for implementing communication with an external network, and an I/O input/output interface 115 for data transmission with the outside; wherein the processing component 111 is configured to execute instructions to implement the video processing method of any of the above.

The processing component can call the information and the application program stored in the memory through the transmission device to execute the following steps: acquiring a video to be published in a video interactive application; under the condition that the video comprises news materials, acquiring element contents of news corresponding to the news materials; the element content is added to the video.

Optionally, the processing component may further execute program codes of the following steps: acquiring audio data from a video; capturing news keywords from the audio data; and searching news corresponding to the news materials according to the news keywords to obtain the element content of the news.

Optionally, the processing component may further execute program codes of the following steps: acquiring image data from a video; acquiring news image data from news corresponding to the news materials; verifying image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to an uploading terminal of the video.

Optionally, the processing component may further execute program codes of the following steps: adding element content to a video, comprising: determining a preset frame video image in the video, wherein a target object corresponding to the element content exists in the preset frame video image; the element contents are added to a predetermined frame video image.

Optionally, the processing component may further execute program codes of the following steps: adding the element content to the predetermined frame video image, including: determining the position of a target object in a predetermined frame of video image; based on the determined position, the elemental content is displayed for the target object.

The processing component can call the information and the application program stored in the memory through the transmission device to execute the following steps: receiving a video playing request on a display interface; responding to a video playing request, and playing a video on a display interface, wherein the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

The processing component can call the information and the application program stored in the memory through the transmission device to execute the following steps: receiving a sliding operation; and responding to the sliding operation, and playing the video, wherein the video is a video in the video interaction application, the element content of news is added in the played video, and the news is news corresponding to news materials included in the video.

It can be understood by those skilled in the art that the structures shown in fig. 10 and fig. 11 are only schematic, for example, the terminal may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 10 and 11 do not limit the structure of the electronic device. For example, it may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in fig. 10, 11, or have a different configuration than shown in fig. 10, 11.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

Example 4

In an exemplary embodiment, there is also provided a computer-readable storage medium including instructions that, when executed by a processor of a terminal, enable the terminal to perform the video processing method of any one of the above. Alternatively, the computer readable storage medium may be a non-transitory computer readable storage medium, for example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

Alternatively, in this embodiment, the computer-readable storage medium may be used to store the program code executed by the video processing method provided in embodiment 1.

Optionally, in this embodiment, the computer-readable storage medium may be located in any one of a group of computer terminals in a computer network, or in any one of a group of mobile terminals.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: acquiring a video to be published in a video interactive application; under the condition that the video comprises news materials, acquiring element contents of news corresponding to the news materials; the element content is added to the video.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: acquiring element content of news corresponding to news materials, wherein the element content comprises the following steps: acquiring audio data from a video; capturing news keywords from the audio data; and searching news corresponding to the news materials according to the news keywords to obtain the element content of the news.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: acquiring image data from a video; acquiring news image data from news corresponding to the news materials; verifying image data in the video according to the news image data to obtain a verification result; and feeding back the verification result to an uploading terminal of the video.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: adding element content to a video, comprising: determining a preset frame video image in the video, wherein a target object corresponding to the element content exists in the preset frame video image; the element contents are added to a predetermined frame video image.

Optionally, in this embodiment, the computer readable storage medium is further configured to store program code for performing the following steps: adding element content to a predetermined frame video image, including: determining the position of a target object in a predetermined frame of video image; based on the determined position, the elemental content is displayed for the target object.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: receiving a video playing request on a display interface; responding to a video playing request, and playing a video on a display interface, wherein the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

Optionally, in this embodiment, the computer readable storage medium is configured to store program code for performing the following steps: receiving a sliding operation; and responding to the sliding operation, and playing the video, wherein the video is a video in the video interaction application, the element content of news is added in the played video, and the news is news corresponding to news materials included in the video.

In an exemplary embodiment, a computer program product is also provided, in which the computer program, when executed by a processor of an electronic device, enables the electronic device to perform the video processing method of any of the above.

The above-mentioned serial numbers of the embodiments of the present disclosure are merely for description and do not represent the merits of the embodiments.

In the above embodiments of the present disclosure, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, a division of a unit is merely a division of a logic function, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present disclosure may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present disclosure may be embodied in the form of a software product, which is stored in a computer-readable storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present disclosure. And the aforementioned computer-readable storage media comprise: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A video processing method, comprising:

acquiring a video to be published in a video interactive application;

under the condition that the video comprises news materials, acquiring element contents of news corresponding to the news materials;

adding the element content to the video.

2. The method of claim 1, wherein obtaining the element content of the news corresponding to the news-like material comprises:

acquiring audio data from the video;

acquiring news keywords from the audio data;

and searching news corresponding to the news materials according to the news keywords to obtain the element content of the news.

3. The method of claim 1, further comprising:

acquiring image data from the video;

acquiring news image data from news corresponding to the news materials;

verifying the image data in the video according to the news image data to obtain a verification result;

and feeding back the verification result to an uploading terminal of the video.

4. The method of claim 1, wherein adding the element content to the video comprises:

determining a predetermined frame video image in the video, wherein a target object corresponding to the element content exists in the predetermined frame video image;

adding the element content to the predetermined frame video image.

5. The method according to claim 4, wherein adding the element content to the predetermined frame video image comprises:

determining the position of the target object in the predetermined frame video image;

displaying the elemental content for the target object based on the determined location.

6. A video processing method, comprising:

receiving a video playing request on a display interface;

responding to the video playing request, and playing a video on the display interface, wherein the video is a video in a video interaction application, the played video is added with element content of news, and the news is news corresponding to news materials included in the video.

7. A video processing apparatus, comprising:

the first acquisition module is used for acquiring a video to be published in the video interactive application;

the second acquisition module is used for acquiring element contents of news corresponding to the news materials under the condition that the video comprises the news materials;

a first adding module for adding the element content to the video.

8. An electronic device, comprising:

a processor;

a memory for storing the processor-executable instructions;

wherein the processor is configured to execute the instructions to implement the video processing method of any of claims 1 to 6.

9. A computer-readable storage medium, wherein instructions in the computer-readable storage medium, when executed by a processor of an electronic device, enable the electronic device to perform the video processing method of any of claims 1 to 6.

10. A computer program product comprising a computer program, characterized in that the computer program realizes the video processing method of any of claims 1 to 6 when executed by a processor.