WO2021052130A1 - Video processing method, apparatus and device, and computer-readable storage medium - Google Patents

Video processing method, apparatus and device, and computer-readable storage medium Download PDF

Info

Publication number
WO2021052130A1
WO2021052130A1 PCT/CN2020/111462 CN2020111462W WO2021052130A1 WO 2021052130 A1 WO2021052130 A1 WO 2021052130A1 CN 2020111462 W CN2020111462 W CN 2020111462W WO 2021052130 A1 WO2021052130 A1 WO 2021052130A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
animation
special effect
video file
processing method
Prior art date
Application number
PCT/CN2020/111462
Other languages
French (fr)
Chinese (zh)
Inventor
余俊
Original Assignee
西安中兴新软件有限责任公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 西安中兴新软件有限责任公司 filed Critical 西安中兴新软件有限责任公司
Publication of WO2021052130A1 publication Critical patent/WO2021052130A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects

Definitions

  • the present invention relates to the field of video processing, and in particular to a video processing method, device, equipment and computer-readable storage medium.
  • the video processing method, device, device, and computer-readable storage medium provided by the embodiments of the present invention are intended to at least to some extent solve the problem of a single viewing mode of videos and pictures in some situations, which is not conducive to improving user experience satisfaction.
  • an embodiment of the present invention provides a video processing method, including: obtaining a video file and picture to be processed, and obtaining a corresponding video playback special effect; and decoding the video file and picture according to the obtained video playing special effect And after rendering, play, and/or, according to the acquired video play special effects, decode and render the video files and pictures, and store them in a new video file.
  • the embodiment of the present invention also provides a video processing device, including: an acquisition module for acquiring video files and pictures to be processed, and acquiring corresponding video playback special effects; a processing module, for playing special effects according to the acquired video, After the video file and picture are decoded and rendered, they are played, and/or the video file and picture are decoded and rendered according to the acquired video playing special effects, and then stored in a new video file.
  • a video processing device including: an acquisition module for acquiring video files and pictures to be processed, and acquiring corresponding video playback special effects; a processing module, for playing special effects according to the acquired video, After the video file and picture are decoded and rendered, they are played, and/or the video file and picture are decoded and rendered according to the acquired video playing special effects, and then stored in a new video file.
  • the embodiment of the present invention also provides a video processing device, including a processor and a memory; the processor is configured to execute a computer program stored in the memory to implement the steps of the video processing method as described above.
  • the embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program can be executed by a processor to implement the steps of the video processing method as described above.
  • FIG. 1 is a schematic flowchart of a video processing method according to Embodiment 1 of the present invention
  • FIG. 2 is a schematic diagram of the structure of a video processing device according to the second embodiment of the present invention.
  • FIG. 3 is a schematic diagram of a video playback process according to the second embodiment of the present invention.
  • FIG. 4 is a schematic diagram of a new video generation process according to the second embodiment of the present invention.
  • Fig. 5 is a schematic structural diagram of a video processing device according to the third embodiment of the present invention.
  • the embodiment of the present invention can play and/or save the video files and pictures to be processed after decoding and rendering according to the obtained video playback special effects.
  • New video files are used to generate new video files for easy export or sharing, etc., so that video files and pictures can be mixed/spliced and played with video playback special effects, which enriches the viewing methods of videos and pictures, and improves the playback of videos and pictures The effect is more conducive to improving the satisfaction of user experience.
  • FIG. 1 For ease of understanding, this embodiment is described below with reference to the video processing method shown in FIG. 1 as an example, including:
  • video files and pictures can be stored in an application database or in other locations, and the application database can be a network-side database or a local database of the device, which can be flexibly set according to application scenarios.
  • the video file and/or picture can be obtained by, but not limited to, inputting the corresponding query keyword query, or directly according to the received selection instruction to obtain the video file and/or picture corresponding to the selection instruction.
  • a corresponding selection interface and query interface may be provided for selection and/or query.
  • the video file to be processed may be a complete video file or a part of a video file.
  • a complete video file may be divided into at least two parts (that is, divided into at least two subunits), and the to-be-processed video file may be one of the subunits.
  • the subunits of the video file can be processed flexibly by using the video processing method in this embodiment according to requirements. And it should be understood that when the video file is divided into subunits in this embodiment, the division method can be flexibly determined according to requirements.
  • it can be divided according to the set playing time, or flexibly divided according to the division instructions received in real time, and the division of the subunits can be executed before the video file is played, or during the video file playback, for the currently unplayed part Divide.
  • the corresponding relationship may be preset between the video file to be processed and the picture. At this time, after the video file to be processed is obtained, the corresponding picture can be obtained according to the corresponding relationship. In other examples of this embodiment, there may be no pre-set correspondence between the video file to be processed and the picture. At this time, after the video file to be processed is obtained, it can be obtained according to the corresponding picture selection or query command. Go to the corresponding picture as the picture corresponding to the to-be-processed video file.
  • the picture corresponding to a video file to be processed in this embodiment may be one, or may be set to two or more according to requirements.
  • a video image frame or two or more video image frames can be generated according to the picture, and the generated video image frame is in the video file to be processed
  • the position in the video file can also be flexibly set according to requirements.
  • a corresponding editing interface or configuration interface may be provided for editing and configuring the corresponding relationship between the video file and the picture.
  • the method of obtaining the corresponding video playback special effect may include, but is not limited to, any one of the following:
  • Method 1 Obtain the video playback special effect indicated by the playback special effect selection instruction according to the received playback special effect selection instruction; the playback special effect selection instruction can be issued by but not limited to the user, or automatically triggered when the set conditions are met
  • Method 2 Obtain special effect matching information, and according to the obtained special effect matching information and the preset correspondence between special effect matching information and video playback special effects, match the video playback special effects corresponding to the acquired special effect matching information; you can also match the information according to the special effects Automatically match out the video playback special effects corresponding to the current video files and pictures to be processed.
  • the special effect matching information can be any information that can correspond to the video playing special effect for subsequent selection and matching.
  • the method for obtaining the corresponding video playback special effect to obtain the special effect matching information includes the second method described above, the obtaining of the special effect matching information may include at least one of the following:
  • the music style of the background music is acquired as the special effect matching information
  • At least one of the current time and location is acquired as special effect matching information.
  • the special effect matching information may include, but is not limited to, the music style of the background music, the theme and/or scene to which the image content belongs, the theme and/or scene to which the video content belongs, the current time, and the current location.
  • the video files and pictures to be processed can be decoded and rendered according to the acquired video playback special effects for real-time playback; or the acquired video playback special effects can be played according to the video files and pictures to be processed.
  • the picture is decoded and rendered, it is stored in a new video file to obtain a new video file, and the new video file can also be exported.
  • the new video file has the same effect as the previous real-time playback during playback; the resulting new video file can be saved, You can also share.
  • decoding and rendering of video files and pictures includes: generating at least one video image frame after decoding the picture to be processed and inserting it into the corresponding position in the decoded video file, and then comparing the data in the obtained video file Each video image frame is rendered.
  • the video file can be encoded and decoded through but not limited to a hard decoder, and pictures can be encoded and decoded through but not limited to using a graphics decoding framework.
  • the decoded texture of the video file and picture may be specifically rendered.
  • the decoded texture may be processed and rendered using but not limited to the use of graphic programming interface technology.
  • the foregoing video processing method may further include:
  • Playing the aforementioned video files and pictures after decoding and rendering also includes: decoding background music and playing synchronously; this process may include, but not limited to, decoding the background music through a hard decoder and playing synchronously;
  • decoding and rendering the above-mentioned video files and pictures and storing them into a new video file also includes: storing the audio code stream obtained by decoding the background music into the new video file.
  • the video playback special effects in this embodiment can also be flexibly selected according to specific application scenarios.
  • the video playback special effect may include but is not limited to at least one of the following:
  • Play animation includes but is not limited to at least one of the following: pan animation, zoom in animation, zoom out animation, crop animation, rotation animation, fade in and/or fade out animation, jelly effect animation, flip animation, clone animation, mask animation, bullet screen animation , Superimposition animation, numerical value change animation, delay animation; it should be understood that in addition to the animation in the above example, other animation effects can be flexibly selected according to the needs;
  • the lens focus rules include: the focus of the face is greater than the focus of the scene. That is, when the face is recognized, the face area is used as the focus of the lens, and when the face difference is not recognized, the scene area is used as the focus of the lens; it can also be set as the focus of the face is greater than other focus, or according to the current focus
  • the key content changes and flexibly update the lens focus rules
  • Filter methods can include but are not limited to: at least one of noise filters, distortion filters, extraction filters, rendering filters, CSS filters, stylized filters, liquefaction filters, and blur filters; it should be understood What's more, in addition to the filter method in the above example, other animation effects can be flexibly selected according to the needs.
  • the acquired video playback special effects include filter mode
  • the filter mode determined according to the method but not limited to the above At least one of the exemplary path methods) performs filter processing on the decoded video file and texture obtained from the picture.
  • the foregoing decoding and rendering of the video file and picture may include: rendering the decoded video file and the texture obtained from the picture according to the playback animation .
  • the video playback special effects include lens focus rules
  • it may also include: acquiring and recording at least one image of the video file according to the acquired lens focus rules The focus area in the frame, and/or, acquiring and recording the focus area in at least one image frame of the picture;
  • rendering the video file and the picture may include: performing the video according to the recorded focus area The corresponding focus area in the corresponding video frame in the file is rendered as the lens focus, and/or the corresponding focus area in at least one frequency frame generated according to the picture is rendered as the lens focus.
  • the video file and picture to be processed are decoded and rendered according to the acquired video playing special effect, and then played in real time, it may also include:
  • the video file is edited according to the received video playback editing instruction.
  • the video playback editing instruction in this embodiment can edit at least one of the following objects, but not limited to:
  • Background music including but not limited to the length and content of the background music
  • the current video file to be processed including but not limited to the length and content of the video file, etc.
  • the current picture to be processed including but not limited to the length and content of the video file, etc.
  • the picture and video file to be processed can be mixed and played in real time.
  • the above method can also be used to export the entire process to generate a new video file, and the generated new video file can be stored , Share, and also play.
  • the above-mentioned video processing method provided in this embodiment can be applied to various terminal devices (for example, various terminal devices whose operating system is but not limited to the Android system), and the pictures, video files, and audios currently to be processed can be processed according to the above examples.
  • Method for encoding and decoding you can use but not limited to the graphical programming interface technology environment to process and render the decoded texture, use the audio system for music playback, and use but not limited to intelligent recognition technology to change the shots of the pictures and video files to be processed
  • the focus is marked, the music style of the background music is recognized, the theme and/or scene of the image content, the theme and/or scene of the video content, the current time, and the current location are used to determine the playback animation and filter used.
  • At least one of mode and lens focus rule can implement but is not limited to the following functions:
  • a complete video file can be divided into at least two subunits, or a complete video file can be divided into one subunit, and at least one subunit can be processed using the video processing method in the above example, and the effect of the video obtained after processing can be It is simply understood that the pictures and video files to be processed are played out according to the determined video playback special effects with the cooperation of background music.
  • a complete video can be divided into several independent sub-units according to requirements or set rules.
  • Each sub-unit is the display of the corresponding pictures and video files of the sub-unit.
  • Animation effects on the pictures and video files are added during the display process.
  • the graphics programming interface technology can be used, but not limited to, to filter the texture generated by video and picture decoding (that is, filter effect), and to render the animation (that is, to play on the terminal).
  • Smart recognition can be used, but not limited to, to recognize scenes and faces in each frame of image. After recognition, the image rectangles are recorded and connected in series, and the lens uses this rectangle as the focal point of the lens for rendering during playback.
  • intelligent recognition can be used to identify the music style and identify different music styles.
  • the style for example, recognizing scenes such as cheerful (light music), warm (slow rhythm), rhythm (fast rhythm and consistent rhythm), etc.
  • the focus is different according to the recognition of the background music during playback.
  • the picture recognizes the scene and the face separately, and after the cheerful music is recognized, the focus of the face is played first, followed by the scene focus or other focus.
  • the scene and/or theme to which the content of the video file and/or picture belongs can also be determined by video playback special effects.
  • the recognized music style it can dynamically match and determine the play animation of the sub-unit to be processed (the sub-unit is the time period for the separate display of a picture and video file to be processed), and all the play animations can be stored On the terminal device, it is read during initialization, and the playing animation of a subunit may be a combination of at least one of the above example animations.
  • the animation combination of a subunit is the display time of the subunit, and the display time of all subunits is the duration of a complete video file.
  • the terminal device can replace/edit the entire video file or the background music of a single subunit. After changing the background music, it can automatically generate and update the playback animation, filter mode, and focus effect of the corresponding subunit according to the result of intelligently identifying the music. If the duration of the background music is less than the duration of the entire video, it can be played in but not limited to loop playback.
  • At least one of animation playback, filter mode, and focus effect can be configured or updated and edited in units of subunits.
  • its subunits can be edited, deleted, or new subunits can be added. After editing, it can automatically generate the corresponding playback animation, filter mode, and focus effect of each sub-unit according to the result of intelligently identifying the music.
  • the hard decoder and multiplexer can be used to encode and decode the rendering to generate new video files for viewing, sharing or playing.
  • this embodiment can realize the mixing/splicing playback of video files and pictures with special effects of video playback during video playback, which enriches the viewing methods of videos and pictures, improves the playback effect of videos and pictures, and is more conducive to improving user experience. Satisfaction.
  • This embodiment provides a video processing device, which can be set in various video processing devices.
  • the video processing device in this embodiment can be, but is not limited to, a set-top box, various smart terminals (such as mobile phones, IPADs, and laptops). , Server, etc.
  • the video processing device includes:
  • the obtaining module 201 is used to obtain video files and pictures to be processed, and obtain corresponding video playback special effects; for the specific obtaining process, please refer to the above-mentioned embodiment, which will not be repeated here.
  • the processing module 202 is configured to decode and render the video files and pictures according to the acquired video playback special effects, and then play them, and/or, according to the acquired video playback special effects, decode and render the video files and pictures. , Save the new video file.
  • the specific processing process please refer to the above-mentioned embodiment, which will not be repeated here.
  • S302 Enter the application database, and obtain the current to-be-processed video files, pictures, background music information, etc.
  • S304 Determine the playing animation effect, filter mode, and lens focus rule of the video file (or subunit of the video file) according to the recognized music style.
  • S305 Obtain a set of video files and picture files to be processed, and intelligently identify the focus of each video image frame or image.
  • S402 Enter the application database, and obtain the current to-be-processed video files, pictures, background music information, etc.
  • S404 Determine the playing animation effect, filter mode, and lens focus rule of the video file (or subunit of the video file) according to the recognized music style.
  • S405 Obtain a set of video files and picture files to be processed, and intelligently identify the focus of each video image frame or image.
  • S406 According to the determined play animation effect, filter effect, and lens focus, use the graphic programming interface to start rendering the texture, and store the texture texture in a new video file.
  • S408 Store the decoded audio code stream into the above-mentioned new video file.
  • the application of intelligent recognition can give the user a good user experience.
  • the user only needs to determine the picture and video that he wants to view, then a video can be generated intelligently, and the user can adjust Corresponding animation effects, filter effects, lens focus effects, etc.
  • the smart lens focus can highlight the focus of the display, and a better user experience.
  • intelligent music recognition can make the coordination of animation effects, filter effects, lens focus effects, and music more tacit, making it more convenient for users to operate.
  • This embodiment also provides a video processing device. As shown in FIG. 5, it includes a processor 501, a memory 502, and a communication bus 503;
  • the communication bus 503 is used to implement a communication connection between the processor 501 and the memory 502;
  • the processor 501 may be used to execute a computer program stored in the memory 502 to implement the steps of the task video processing method in the above embodiments.
  • the video processing device in this embodiment may be, but is not limited to, a set-top box, various intelligent terminals (for example, mobile phones, IPAD, notebook computers), servers, and the like.
  • This embodiment also provides a computer-readable storage medium, which is included in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules, or other data). Volatile or non-volatile, removable or non-removable media.
  • Computer-readable storage media include but are not limited to RAM (Random Access Memory), ROM (Read-Only Memory, read-only memory), EEPROM (Electrically Erasable Programmable read only memory, charged Erasable Programmable Read-Only Memory) ), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, Or any other medium that can be used to store desired information and that can be accessed by a computer.
  • the computer-readable storage medium in this embodiment may be used to store a computer program, and the computer program may be executed by a processor to implement the steps of the video processing method for the tasks in the above embodiments.
  • This embodiment also provides a computer program (or computer software).
  • the computer program can be distributed on a computer-readable medium and executed by a computable device to implement at least one of the video processing methods in the above embodiments.
  • One step; and in some cases, at least one step shown or described can be performed in an order different from that described in the foregoing embodiment.
  • This embodiment also provides a computer program product, including a computer readable device, and any computer program as shown above is stored on the computer readable device.
  • the computer-readable device in this embodiment may include the computer-readable storage medium as shown above.
  • the video files and pictures to be processed are acquired, and the corresponding video playback special effects are acquired; After the video files and pictures are decoded and rendered, they are played, and/or stored in new video files to generate new video files for easy export or sharing, etc.; in this way, video playback special effects can be used to apply video playback effects to video files and pictures during video playback.
  • Mixed/spliced playback enriches the viewing methods of videos and pictures, can improve the playback effect of videos and pictures, and is more conducive to improving user experience satisfaction.
  • communication media usually contain computer-readable instructions, data structures, computer program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery medium. Therefore, the present invention is not limited to any specific combination of hardware and software.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

A video processing method, apparatus and device, and a computer-readable storage medium. The method comprises: acquiring a video file to be processed and an image to be processed, and acquiring a corresponding video playing special effect (S101); and then, after the video file to be processed and the image to be processed are decoded and rendered, playing same according to the acquired video playing special effect, and/or saving a new video file so as to generate a new video file (S102).

Description

视频处理方法、装置、设备及计算机可读存储介质Video processing method, device, equipment and computer readable storage medium
相关申请的交叉引用Cross-references to related applications
本申请基于申请号为201910877779.8、申请日为2019年9月17日的中国专利申请提出，并要求该中国专利申请的优先权，该中国专利申请的全部内容在此引入本申请作为参考。This application is based on a Chinese patent application with an application number of 201910877779.8 and an application date of September 17, 2019, and claims the priority of the Chinese patent application. The entire content of the Chinese patent application is hereby incorporated into this application by reference.
技术领域Technical field
本发明涉及视频处理领域，尤其涉及一种视频处理方法、装置、设备及计算机可读存储介质。The present invention relates to the field of video processing, and in particular to a video processing method, device, equipment and computer-readable storage medium.
背景技术Background technique
随着智能终端的普及，智能终端拍照和下载视频等生成图片和视频的手段越来越多。但是，目前智能终端播放视频和查看图片的方式都很单一。例如，对于视频播放，都是通过对应的播放软件或界面进行单一视频内容的播放；对于图片查看，则都是通过相应的图片查看软件打开查看；这种单一的视频和图片查看方式带给用户的体验也单一，不利于提升用户体验满意度。With the popularity of smart terminals, there are more and more methods for generating pictures and videos, such as taking pictures and downloading videos on smart terminals. However, at present, the ways for smart terminals to play videos and view pictures are very simple. For example, for video playback, a single video content is played through the corresponding playback software or interface; for picture viewing, it is opened and viewed through the corresponding picture viewing software; this single video and picture viewing method brings users The experience is also single, which is not conducive to improving user experience satisfaction.
发明内容Summary of the invention
本发明实施例提供的视频处理方法、装置、设备及计算机可读存储介质，旨在至少一定程度上解决一些情形中，视频和图片查看方式单一，不利于提升用户体验满意度的问题。The video processing method, device, device, and computer-readable storage medium provided by the embodiments of the present invention are intended to at least to some extent solve the problem of a single viewing mode of videos and pictures in some situations, which is not conducive to improving user experience satisfaction.
有鉴于此，本发明实施例提供了一种视频处理方法，包括：获取待处理的视频文件、图片，并获取对应的视频播放特效；根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，进行播放，和/或，根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，存入新的视频文件。In view of this, an embodiment of the present invention provides a video processing method, including: obtaining a video file and picture to be processed, and obtaining a corresponding video playback special effect; and decoding the video file and picture according to the obtained video playing special effect And after rendering, play, and/or, according to the acquired video play special effects, decode and render the video files and pictures, and store them in a new video file.
本发明实施例还提供了一种视频处理装置，包括：获取模块，用于获取待处理的视频文件、图片，并获取对应的视频播放特效；处理模块，用于根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，进行播放，和/或，根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，存入新的视频文件。The embodiment of the present invention also provides a video processing device, including: an acquisition module for acquiring video files and pictures to be processed, and acquiring corresponding video playback special effects; a processing module, for playing special effects according to the acquired video, After the video file and picture are decoded and rendered, they are played, and/or the video file and picture are decoded and rendered according to the acquired video playing special effects, and then stored in a new video file.
本发明实施例还提供了一种视频处理设备，包括处理器、存储器；所述处理器用于执行所述存储器中存储的计算机程序，以实现如上所述的视频处理方法的步骤。本发明实施例还提供了一种计算机可读存储介质，所述计算机可读存储介质存储有计算机程序，所述计算机程序可被处理器执行，以实现如上所述的视频处理方法的步骤。The embodiment of the present invention also provides a video processing device, including a processor and a memory; the processor is configured to execute a computer program stored in the memory to implement the steps of the video processing method as described above. The embodiment of the present invention also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and the computer program can be executed by a processor to implement the steps of the video processing method as described above.
本发明其他特征和相应的有益效果在说明书的后面部分进行阐述说明，且应当理解，至少部分有益效果从本发明说明书中的记载变的显而易见。Other features and corresponding beneficial effects of the present invention are described in the latter part of the specification, and it should be understood that at least part of the beneficial effects will become apparent from the description in the specification of the present invention.
附图说明Description of the drawings
图1为本发明实施例一的视频处理方法的流程示意图；FIG. 1 is a schematic flowchart of a video processing method according to Embodiment 1 of the present invention;
图2为本发明实施例二的视频处理装置结构示意图；2 is a schematic diagram of the structure of a video processing device according to the second embodiment of the present invention;
图3为本发明实施例二的视频播放流程示意图；FIG. 3 is a schematic diagram of a video playback process according to the second embodiment of the present invention;
图4为本发明实施例二的新视频生成流程示意图；FIG. 4 is a schematic diagram of a new video generation process according to the second embodiment of the present invention;
图5为本发明实施例三的视频处理设备结构示意图。Fig. 5 is a schematic structural diagram of a video processing device according to the third embodiment of the present invention.
具体实施方式detailed description
为了使本发明的目的、技术方案及优点更加清楚明白，下面通过具体实施方式结合附图对本发明实施例作进一步详细说明。应当理解，此处所描述的具体实施例仅仅用以解释本发明，并不用于限定本发明。In order to make the objectives, technical solutions, and advantages of the present invention clearer, the following further describes the embodiments of the present invention in detail through specific implementations in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.
实施例一：Example one:
针对视频和图片查看方式单一，不利于提升用户体验满意度的问题，本发明实施例可根据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后，进行播放，和/或存入新的视频文件以生成新视频文件，以便于导出或分享等，从而可实现用视频播放特效对视频文件和图片混合/拼接播放，丰富了视频和图片的查看方式，提升了视频和图片的播放效果，更利于提升用户体验的满意度。In view of the single viewing mode of videos and pictures, which is not conducive to improving user experience satisfaction, the embodiment of the present invention can play and/or save the video files and pictures to be processed after decoding and rendering according to the obtained video playback special effects. New video files are used to generate new video files for easy export or sharing, etc., so that video files and pictures can be mixed/spliced and played with video playback special effects, which enriches the viewing methods of videos and pictures, and improves the playback of videos and pictures The effect is more conducive to improving the satisfaction of user experience.
为了便于理解，本实施例下面结合图1所示的视频处理方法为示例说明，包括：For ease of understanding, this embodiment is described below with reference to the video processing method shown in FIG. 1 as an example, including:
S101：获取待处理的视频文件、图片，并获取对应的视频播放特效。S101: Obtain video files and pictures to be processed, and obtain corresponding video playback special effects.
本实施例中，视频文件、图片可存储于应用数据库或存储于其他位置，且该应用数据库可以为网络侧对数据库，也可为设备本地的数据库，具体可根据应用场景灵活设定。In this embodiment, video files and pictures can be stored in an application database or in other locations, and the application database can be a network-side database or a local database of the device, which can be flexibly set according to application scenarios.
本实施例中，视频文件和/或图片的获取，可以通过但不限于输入相应的查询关键字查询获取，或直接根据接收到的选择指令获取该选择指令对应的视频文件和/或图片。在一些应用场景中，可提供相应的选择界面、查询界面供选择和/或查询。In this embodiment, the video file and/or picture can be obtained by, but not limited to, inputting the corresponding query keyword query, or directly according to the received selection instruction to obtain the video file and/or picture corresponding to the selection instruction. In some application scenarios, a corresponding selection interface and query interface may be provided for selection and/or query.
在本实施例中，该待处理器的视频文件可以为一个完整的视频文件，也可以为一个视频文件中的一部分。例如，一些应用场景中，可以将一个完整的视频文件划分为至少两部分(也即划分为至少两个子单元)，该待处理的视频文件可以为其中的一个子单元。针对该视频文件的各子单元可以根据需求灵活的采用本实施例中的视频处理方法进行处理。且应当理解的是，本实施例中对视频文件进行子单元的划分时，划分方式可以灵活的根据需求确定。例如可以按照设定播放时长划分，或者根据实时接收到的划分指令灵活的划分，且该子单元的划分可以为在视频文件播放之前执行，也可在视频文件播放过程中，对于当前未播放部分进行划分。In this embodiment, the video file to be processed may be a complete video file or a part of a video file. For example, in some application scenarios, a complete video file may be divided into at least two parts (that is, divided into at least two subunits), and the to-be-processed video file may be one of the subunits. The subunits of the video file can be processed flexibly by using the video processing method in this embodiment according to requirements. And it should be understood that when the video file is divided into subunits in this embodiment, the division method can be flexibly determined according to requirements. For example, it can be divided according to the set playing time, or flexibly divided according to the division instructions received in real time, and the division of the subunits can be executed before the video file is played, or during the video file playback, for the currently unplayed part Divide.
在本实施例的一些示例中，待处理的视频文件和图片之间可以预先设置好对应关系，此时获取到待处理的视频文件之后，即可根据该对应关系获取到对应的图片。在本实施例的另一些示例中，待处理的视频文件和图片之间也可无预先设置好的对应关系，此时获取到待处理的视频文件之后，可根据对应的图片选择或查询指令获取到对应的图片，作为该 待处理的视频文件所对应的图片。另外，应当理解的是，本实施例中一个待处理视频文件所对应的图片可以为一张，也可根据需求设置为两张或两张以上。且针对一张待处理的图片，将其***待处理的视频文件中时，可根据该图片生成一帧视频图像帧或两张以上的视频图像帧，且所生成的视频图像帧在待处理的视频文件中的位置也可根据需求灵活设定。In some examples of this embodiment, the corresponding relationship may be preset between the video file to be processed and the picture. At this time, after the video file to be processed is obtained, the corresponding picture can be obtained according to the corresponding relationship. In other examples of this embodiment, there may be no pre-set correspondence between the video file to be processed and the picture. At this time, after the video file to be processed is obtained, it can be obtained according to the corresponding picture selection or query command. Go to the corresponding picture as the picture corresponding to the to-be-processed video file. In addition, it should be understood that the picture corresponding to a video file to be processed in this embodiment may be one, or may be set to two or more according to requirements. And for a picture to be processed, when it is inserted into the video file to be processed, a video image frame or two or more video image frames can be generated according to the picture, and the generated video image frame is in the video file to be processed The position in the video file can also be flexibly set according to requirements.
在本实施例的一些示例中，可以提供相应的编辑界面或配置界面，以供进行视频文件和图片之间的对应关系的编辑、配置。In some examples of this embodiment, a corresponding editing interface or configuration interface may be provided for editing and configuring the corresponding relationship between the video file and the picture.
本实施例中，获取对应的视频播放特效的方式可以包括但不限于以下任意之一：In this embodiment, the method of obtaining the corresponding video playback special effect may include, but is not limited to, any one of the following:
方式一：根据接收到的播放特效选择指令，获取播放特效选择指令所指示的视频播放特效；该播放特效选择指令可以为但不限于用户下发，或设定条件满足时自动触发Method 1: Obtain the video playback special effect indicated by the playback special effect selection instruction according to the received playback special effect selection instruction; the playback special effect selection instruction can be issued by but not limited to the user, or automatically triggered when the set conditions are met
方式二：获取特效匹配信息，根据获取的特效匹配信息，以及预设的特效匹配信息与视频播放特效对应关系，匹配出所获取的特效匹配信息所对应的视频播放特效；也即可根据特效匹配信息自动匹配出当前待处理的视频文件、图片所对应的视频播放特效。本实施例中，特效匹配信息可以为任意能与视频播放特效对应以供后续选择匹配的各种信息。例如，一种示例中，获取对应的视频播放特效的方式获取特效匹配信息包括上述方式二时，获取特效匹配信息可包括以下中的至少一种：Method 2: Obtain special effect matching information, and according to the obtained special effect matching information and the preset correspondence between special effect matching information and video playback special effects, match the video playback special effects corresponding to the acquired special effect matching information; you can also match the information according to the special effects Automatically match out the video playback special effects corresponding to the current video files and pictures to be processed. In this embodiment, the special effect matching information can be any information that can correspond to the video playing special effect for subsequent selection and matching. For example, in an example, when the method for obtaining the corresponding video playback special effect to obtain the special effect matching information includes the second method described above, the obtaining of the special effect matching information may include at least one of the following:
当前待处理的视频文件包括背景音乐时，获取背景音乐的音乐风格作为特效匹配信息；When the current video file to be processed includes background music, the music style of the background music is acquired as the special effect matching information;
获取图片中图片内容所属的主题和/或场景作为特效匹配信息；Obtain the subject and/or scene to which the picture content in the picture belongs as special effect matching information;
获取视频文件中视频内容所属的主题和/或场景作为特效匹配信息；Obtain the subject and/or scene to which the video content in the video file belongs as special effect matching information;
获取当前时间和地点中的至少一种作为特效匹配信息。At least one of the current time and location is acquired as special effect matching information.
可见，在本实施例中，特效匹配信息可以包括但不限于背景音乐的音乐风格、图片内容所属的主题和/或场景、视频内容所属的主题和/或场景、当前时间、当前地点中的至少一种，具体包括哪些信息可根据具体需求灵活选择设定。It can be seen that, in this embodiment, the special effect matching information may include, but is not limited to, the music style of the background music, the theme and/or scene to which the image content belongs, the theme and/or scene to which the video content belongs, the current time, and the current location. One type, which information can be flexibly selected and set according to specific needs.
且应当理解的是，本实施例中特效匹配信息与视频播放特效对应关系可以根据具体应用场景灵活设定。And it should be understood that the corresponding relationship between the special effect matching information and the video playing special effect in this embodiment can be flexibly set according to specific application scenarios.
S102：根据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后，进行播放，和/或，根据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后，存入新的视频文件。S102: According to the acquired video playing special effects, the video files and pictures to be processed are decoded and rendered before being played, and/or, according to the acquired video playing special effects, the video files and pictures to be processed are decoded and rendered and stored in the new Video files.
也即本实施例中，在需要时，可以根据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后进行实时的播放；也可以根据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后存入新的视频文件，从而得到新视频文件，也即可导出新视频文件，该新视频文件在播放时与前面实时播放的效果相同；所得到的新视频文件可以保存、也可以分享。That is, in this embodiment, when necessary, the video files and pictures to be processed can be decoded and rendered according to the acquired video playback special effects for real-time playback; or the acquired video playback special effects can be played according to the video files and pictures to be processed. After the picture is decoded and rendered, it is stored in a new video file to obtain a new video file, and the new video file can also be exported. The new video file has the same effect as the previous real-time playback during playback; the resulting new video file can be saved, You can also share.
在本实施例中，对视频文件和图片解码及渲染则包括：对待处理的图片进行解码后生成至少一个视频图像帧并***解码后的视频文件中的对应位置，然后对得到的视频文件中 的各视频图像帧进行渲染。In this embodiment, decoding and rendering of video files and pictures includes: generating at least one video image frame after decoding the picture to be processed and inserting it into the corresponding position in the decoded video file, and then comparing the data in the obtained video file Each video image frame is rendered.
在本实施例中，可通过但不限于通过硬解码器对视频文件进行编解码，可通过但不限于使用图形解码框架对图片进行编解码。本实施例中，具体可对视频文件和图片解码后得到的纹理进行渲染，例如，可采用但不限于使用图形编程接口技术对解码后的纹理进行处理和渲染。In this embodiment, the video file can be encoded and decoded through but not limited to a hard decoder, and pictures can be encoded and decoded through but not limited to using a graphics decoding framework. In this embodiment, the decoded texture of the video file and picture may be specifically rendered. For example, the decoded texture may be processed and rendered using but not limited to the use of graphic programming interface technology.
相应的，在本实施例的一些示例中，当前待处理的视频文件包括背景音乐时，上述视频处理方法还可包括：Correspondingly, in some examples of this embodiment, when the currently to-be-processed video file includes background music, the foregoing video processing method may further include:
对上述视频文件和图片解码渲染后进行播放还包括：对背景音乐进行解码同步播放；该过程可包括通过但不限于硬解码器对背景音乐进行解码后进行同步播放；Playing the aforementioned video files and pictures after decoding and rendering also includes: decoding background music and playing synchronously; this process may include, but not limited to, decoding the background music through a hard decoder and playing synchronously;
和/或，对上述视频文件和图片解码渲染后存入新的视频文件还包括：将对背景音乐进行解码得到的音频码流存入新的视频文件。And/or, decoding and rendering the above-mentioned video files and pictures and storing them into a new video file also includes: storing the audio code stream obtained by decoding the background music into the new video file.
应当理解的是，本实施例中视频播放特效也可根据具体应用场景灵活选定。例如，一种示例中，视频播放特效可包括但不限于以下至少之一：It should be understood that the video playback special effects in this embodiment can also be flexibly selected according to specific application scenarios. For example, in an example, the video playback special effect may include but is not limited to at least one of the following:
播放动画；镜头焦点规则；滤镜方式，其中：Play animation; lens focus rule; filter mode, where:
播放动画包括但不限于以下至少之一：平移动画、放大动画、缩小动画、裁剪动画、旋转动画、淡入和/或淡出动画、果冻效果动画、翻转动画、克隆动画、遮罩动画、弹幕动画、叠加动画、数值变动动画、延迟动画；应当理解的是，除了上述示例的动画外，还可根据需求灵活的选择其他动画效果；Play animation includes but is not limited to at least one of the following: pan animation, zoom in animation, zoom out animation, crop animation, rotation animation, fade in and/or fade out animation, jelly effect animation, flip animation, clone animation, mask animation, bullet screen animation , Superimposition animation, numerical value change animation, delay animation; it should be understood that in addition to the animation in the above example, other animation effects can be flexibly selected according to the needs;
镜头焦点规则包括：人脸焦点大于场景焦点。也即在识别出人脸时，以该人脸区域作为镜头焦点，在没有识别出人脸区别时，则以场景区域作为镜头焦点；也可设置为人脸焦点大于其他焦点，或根据当前所关注的重点内容的变化而灵活的更新设置镜头焦点规则；The lens focus rules include: the focus of the face is greater than the focus of the scene. That is, when the face is recognized, the face area is used as the focus of the lens, and when the face difference is not recognized, the scene area is used as the focus of the lens; it can also be set as the focus of the face is greater than other focus, or according to the current focus The key content changes and flexibly update the lens focus rules;
滤镜方式可包括但不限于：杂色滤镜、扭曲滤镜、抽出滤镜、渲染滤镜、CSS滤镜、风格化滤镜、液化滤镜、模糊滤镜中的至少一种；应当理解的是，除了上述示例的滤镜方式外，还可根据需求灵活的选择其他动画效果。Filter methods can include but are not limited to: at least one of noise filters, distortion filters, extraction filters, rendering filters, CSS filters, stylized filters, liquefaction filters, and blur filters; it should be understood What's more, in addition to the filter method in the above example, other animation effects can be flexibly selected according to the needs.
例如，在一些应用场景中，获取的视频播放特效包括滤镜方式时，对当前待处理的视频文件和图片解码后，进行渲染之前，还包括根据确定的滤镜方式(可为但不限于上述示例的路径方式中的至少一种)对解码后的视频文件和图片所得到的纹理进行滤镜处理。For example, in some application scenarios, when the acquired video playback special effects include filter mode, after decoding the currently to-be-processed video file and picture, before rendering, it also includes the filter mode determined according to the method (but not limited to the above At least one of the exemplary path methods) performs filter processing on the decoded video file and texture obtained from the picture.
又例如，在一些应用场景中，获取的视频播放特效包括播放动画时，上述对视频文件和图片解码及渲染可包括：对解码后的视频文件和图片所得到的纹理根据所述播放动画进行渲染。For another example, in some application scenarios, when the acquired video playback special effects include playing an animation, the foregoing decoding and rendering of the video file and picture may include: rendering the decoded video file and the texture obtained from the picture according to the playback animation .
又例如，在一些应用场景中，视频播放特效包括镜头焦点规则时，上述对所述视频文件和图片进行渲染之前，还可包括：根据获取的镜头焦点规则，获取并记录视频文件的至少一个图像帧中的焦点区域，和/或，获取并记录所述图片的至少一个图像帧中的焦点区域；在本应用场景中，对视频文件和图片进行渲染则可包括：根据记录的焦点区域对视频 文件中对应视频帧中对应焦点区域作为镜头焦点进行渲染，和/或，对根据图片生成的至少一个频帧中对应焦点区域作为镜头焦点进行渲染。For another example, in some application scenarios, when the video playback special effects include lens focus rules, before rendering the video files and pictures, it may also include: acquiring and recording at least one image of the video file according to the acquired lens focus rules The focus area in the frame, and/or, acquiring and recording the focus area in at least one image frame of the picture; in this application scenario, rendering the video file and the picture may include: performing the video according to the recorded focus area The corresponding focus area in the corresponding video frame in the file is rendered as the lens focus, and/or the corresponding focus area in at least one frequency frame generated according to the picture is rendered as the lens focus.
在本实施例中，当据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后，进行实时播放时，还可包括：In this embodiment, when the video file and picture to be processed are decoded and rendered according to the acquired video playing special effect, and then played in real time, it may also include:
在播放过程中，在接收到视频播放编辑指令时，根据接收到的视频播放编辑指令对视频文件进行编辑处理。本实施例中的视频播放编辑指令可对以下对象但不限于以下对象中的至少一种进行编辑：During the playback process, when the video playback editing instruction is received, the video file is edited according to the received video playback editing instruction. The video playback editing instruction in this embodiment can edit at least one of the following objects, but not limited to:
背景音乐(包括但不限于背景音乐的长度、内容等)、当前待处理的视频文件(包括但不限于视频文件的长度、内容等)、当前待处理的图片。Background music (including but not limited to the length and content of the background music), the current video file to be processed (including but not limited to the length and content of the video file, etc.), and the current picture to be processed.
根据上述示例可知，在本实施例中，可以实现实时的将待处理的图片和视频文件进行混合播放，也可以采用上述方法将整个过程导出生成一个新视频文件，所生成的新视频文件可以存储、分享，也可以播放。According to the above example, in this embodiment, the picture and video file to be processed can be mixed and played in real time. The above method can also be used to export the entire process to generate a new video file, and the generated new video file can be stored , Share, and also play.
本实施例提供的上述视频处理方法可应用于各种终端设备上(例如操作***为但不限于安卓***的各种终端设备)，可对当前待处理的图片、视频文件、音频按照上述示例的方法进行编解码，可使用但不限于图形编程接口技术环境对解码后的纹理进行处理和渲染，使用音频***进行音乐播放，可使用但不限于智能识别技术将待处理的图片和视频文件的镜头焦点标记出来、识别背景音乐的音乐风格、图片内容所属的主题和/或场景、视频内容所属的主题和/或场景、当前时间、当前地点中的至少一种来确定使用的播放动画、滤镜方式、镜头焦点规则中的至少一种。具体的，本示例中的终端设备可实现但不限于以下功能：The above-mentioned video processing method provided in this embodiment can be applied to various terminal devices (for example, various terminal devices whose operating system is but not limited to the Android system), and the pictures, video files, and audios currently to be processed can be processed according to the above examples. Method for encoding and decoding, you can use but not limited to the graphical programming interface technology environment to process and render the decoded texture, use the audio system for music playback, and use but not limited to intelligent recognition technology to change the shots of the pictures and video files to be processed The focus is marked, the music style of the background music is recognized, the theme and/or scene of the image content, the theme and/or scene of the video content, the current time, and the current location are used to determine the playback animation and filter used. At least one of mode and lens focus rule. Specifically, the terminal device in this example can implement but is not limited to the following functions:
可将一个完整的视频文件划分为至少两个子单元，或者一个完整的视频文件为一个子单元，且至少一个子单元可采用上述示例的视频处理地方法进行处理，处理后得到的视频的效果可简单的理解为将待处理的图片和视频文件在背景音乐配合下根据确定的视频播放特效播放出来。A complete video file can be divided into at least two subunits, or a complete video file can be divided into one subunit, and at least one subunit can be processed using the video processing method in the above example, and the effect of the video obtained after processing can be It is simply understood that the pictures and video files to be processed are played out according to the determined video playback special effects with the cooperation of background music.
一个完整对视频可以根据需求或设定的规则划分成若干独立的子单元，每个子单元是该子单元对应的图片和视频文件的展示，在展示过程中加入对图片和视频文件的动画效果、滤镜效果、智能镜头焦点效果中的至少一种。A complete video can be divided into several independent sub-units according to requirements or set rules. Each sub-unit is the display of the corresponding pictures and video files of the sub-unit. Animation effects on the pictures and video files are added during the display process. At least one of filter effect and smart lens focus effect.
可使用但不限于硬解码器对音频和视频进行编解码，使用图形解码框架进行图片解码；Can use but not limited to the hard decoder to encode and decode audio and video, and use the graphics decoding framework to decode pictures;
可使用但不限于图形编程接口技术对视频和图片解码生成的纹理进行滤波处理(即滤镜效果)，对动画进行渲染(即在终端上播放)。The graphics programming interface technology can be used, but not limited to, to filter the texture generated by video and picture decoding (that is, filter effect), and to render the animation (that is, to play on the terminal).
可使用但不限于智能识别对每帧图像进行场景、人脸等识别，识别后将图像矩形记录并串联，在播放时镜头使用该矩形作为镜头焦点进行渲染。Smart recognition can be used, but not limited to, to recognize scenes and faces in each frame of image. After recognition, the image rectangles are recorded and connected in series, and the lens uses this rectangle as the focal point of the lens for rendering during playback.
可对背景音乐解码后使用智能识别对音乐风格进行识别，识别出不同的音乐风格。识别出风格后，例如识别出欢快(轻音乐)、温馨(节奏慢)、律动(节奏快且节奏一致)等 场景，在播放时根据背景音乐的识别，焦点的重点也不同。例如：图片分别识别出了场景和人脸，在识别出欢快的音乐后，优先播放人脸的焦点，其次是场景焦点或者其他焦点。当然，也可对视频文件和/或图片的内容所属的场景和/或主题进行视频播放特效确定。After decoding the background music, intelligent recognition can be used to identify the music style and identify different music styles. After recognizing the style, for example, recognizing scenes such as cheerful (light music), warm (slow rhythm), rhythm (fast rhythm and consistent rhythm), etc., the focus is different according to the recognition of the background music during playback. For example: the picture recognizes the scene and the face separately, and after the cheerful music is recognized, the focus of the face is played first, followed by the scene focus or other focus. Of course, the scene and/or theme to which the content of the video file and/or picture belongs can also be determined by video playback special effects.
可根据识别出的音乐风格，来动态匹配确定需要处理的子单元的播放动画(子单元元即为一个待处理的图片和视频文件的单独展示的时间段)，所有的播放动画可被存入到终端设备上，在初始化时读取出来，一个子单元的播放动画可以是上述示例动画中的至少一种的组合。According to the recognized music style, it can dynamically match and determine the play animation of the sub-unit to be processed (the sub-unit is the time period for the separate display of a picture and video file to be processed), and all the play animations can be stored On the terminal device, it is read during initialization, and the playing animation of a subunit may be a combination of at least one of the above example animations.
一个子单元的动画组合即为该子单元的展示时间，所有子单元的展示时间即组成一个完整视频文件的时长。The animation combination of a subunit is the display time of the subunit, and the display time of all subunits is the duration of a complete video file.
终端设备可以更换/编辑整个视频文件或单个子单元的背景音乐，更换背景音乐后可自动根据智能识别音乐的结果生成更新相应子单元的播放动画、滤镜方式、焦点效果。若背景音乐时长小于整个视频的时长，可采用但不限于循环播放的方式播放。The terminal device can replace/edit the entire video file or the background music of a single subunit. After changing the background music, it can automatically generate and update the playback animation, filter mode, and focus effect of the corresponding subunit according to the result of intelligently identifying the music. If the duration of the background music is less than the duration of the entire video, it can be played in but not limited to loop playback.
可以编辑背景音乐的长度(小于等于音频本身的时长)、区段。You can edit the length of the background music (less than or equal to the duration of the audio itself) and section.
可以子单元为单位进行播放动画、滤镜方式、焦点效果中的至少一种进行配置或更新编辑。At least one of animation playback, filter mode, and focus effect can be configured or updated and edited in units of subunits.
针对一个完整的视频文件，其子单元可被编辑、删除，也可以加入新的子单元。编辑后可自动跟据智能识别音乐的结果生成相应的各个子单元的播放动画、滤镜方式、焦点效果。For a complete video file, its subunits can be edited, deleted, or new subunits can be added. After editing, it can automatically generate the corresponding playback animation, filter mode, and focus effect of each sub-unit according to the result of intelligently identifying the music.
可使用硬解码器和复用器对渲染进行编解码，生成新的视频文件，以供查看，分享或播放。The hard decoder and multiplexer can be used to encode and decode the rendering to generate new video files for viewing, sharing or playing.
因此本实施例可实现在视频播放时可实现采用视频播放特效对视频文件和图片混合/拼接播放，丰富了视频和图片的查看方式，可提升视频和图片的播放效果，更利于提升用户体验的满意度。Therefore, this embodiment can realize the mixing/splicing playback of video files and pictures with special effects of video playback during video playback, which enriches the viewing methods of videos and pictures, improves the playback effect of videos and pictures, and is more conducive to improving user experience. Satisfaction.
实施例二：Embodiment two:
本实施例提供了一种视频处理装置，其可设置于各种视频处理设备中，本实施例中的视频处理设备可以为但不限于机顶盒、各种智能终端(例如手机、IPAD、笔记本电脑)、服务器等。请参见图2所示，视频处理装置包括：This embodiment provides a video processing device, which can be set in various video processing devices. The video processing device in this embodiment can be, but is not limited to, a set-top box, various smart terminals (such as mobile phones, IPADs, and laptops). , Server, etc. As shown in Figure 2, the video processing device includes:
获取模块201，用于获取待处理的视频文件、图片，并获取对应的视频播放特效；具体获取过程请参见上述实施例所示，在此不再赘述。The obtaining module 201 is used to obtain video files and pictures to be processed, and obtain corresponding video playback special effects; for the specific obtaining process, please refer to the above-mentioned embodiment, which will not be repeated here.
处理模块202，用于根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，进行播放，和/或，根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，存入新的视频文件。具体处理过程请参见上述实施例所示，在此也不再赘述。The processing module 202 is configured to decode and render the video files and pictures according to the acquired video playback special effects, and then play them, and/or, according to the acquired video playback special effects, decode and render the video files and pictures. , Save the new video file. For the specific processing process, please refer to the above-mentioned embodiment, which will not be repeated here.
为了便于理解，本实施例下面结合一种视频播放过程为示例进行说明，请参见图3所示，包括：For ease of understanding, this embodiment is described below with a video playback process as an example, as shown in Figure 3, including:
S301：进入播放界面。S301: Enter the playback interface.
S302：进入应用数据库，获取当前待处理的视频文件、图片、背景音乐信息等。S302: Enter the application database, and obtain the current to-be-processed video files, pictures, background music information, etc.
S303：获取背景音乐后，开始智能识别得到该背景音乐的音乐风格。S303: After acquiring the background music, start to intelligently identify the music style of the background music.
S304：根据识别得到的音乐风格确定视频文件(或该视频文件的子单元)的播放动画效果、滤镜方式、镜头焦点规则。S304: Determine the playing animation effect, filter mode, and lens focus rule of the video file (or subunit of the video file) according to the recognized music style.
S305：获取到待处理的视频文件和图片文件集合，智能识别各视频图像帧或图像的镜头焦点。S305: Obtain a set of video files and picture files to be processed, and intelligently identify the focus of each video image frame or image.
S306：根据确定的播放动画效果、滤镜效果、镜头焦点，使用图形编程接口开始渲染后开始播放。S306: According to the determined play animation effect, filter effect, and lens focus, use the graphics programming interface to start rendering and then start playing.
为了便于理解，本实施例下面结合一种新视频播的生成过程为示例进行说明，请参见图4所示，包括：For ease of understanding, this embodiment will be described below with reference to the generation process of a new video broadcast as an example, as shown in Figure 4, including:
S401：进入导出界面。S401: Enter the export interface.
S402：进入应用数据库，获取当前待处理的视频文件、图片、背景音乐信息等。S402: Enter the application database, and obtain the current to-be-processed video files, pictures, background music information, etc.
S403：获取背景音乐后，开始智能识别得到该背景音乐的音乐风格。S403: After acquiring the background music, start to intelligently identify the music style of the background music.
S404：根据识别得到的音乐风格确定视频文件(或该视频文件的子单元)的播放动画效果、滤镜方式、镜头焦点规则。S404: Determine the playing animation effect, filter mode, and lens focus rule of the video file (or subunit of the video file) according to the recognized music style.
S405：获取到待处理的视频文件和图片文件集合，智能识别各视频图像帧或图像的镜头焦点。S405: Obtain a set of video files and picture files to be processed, and intelligently identify the focus of each video image frame or image.
S406：根据确定的播放动画效果、滤镜效果、镜头焦点，使用图形编程接口开始渲纹理，将纹理纹理存入到新的视频文件中。S406: According to the determined play animation effect, filter effect, and lens focus, use the graphic programming interface to start rendering the texture, and store the texture texture in a new video file.
S407：将背景音乐使用硬解码器进行硬解码。S407: Use a hard decoder to hard decode the background music.
S408：将解码的音频码流存入上述新的视频文件中。S408: Store the decoded audio code stream into the above-mentioned new video file.
S409：完成视频编码，弹出新视频文件生成提示。S409: The video encoding is completed, and a new video file generation prompt pops up.
可见，通过本实施例提供的视频处理装置，采用智能识别的应用可以给用户很好的用户体验，用户只需要确定想要查看的图片和视频，就可以智能的生成一个视频，并且用户可以调整相应的动画效果、滤镜效果、镜头焦点效果等等。且智能镜头焦点可以突出展示的重点，更好的用户体验。另外，智能音乐识别，可以使得动画效果、滤镜效果、镜头焦点效果和音乐的配合更默契，更方便用户的操作。It can be seen that through the video processing device provided in this embodiment, the application of intelligent recognition can give the user a good user experience. The user only needs to determine the picture and video that he wants to view, then a video can be generated intelligently, and the user can adjust Corresponding animation effects, filter effects, lens focus effects, etc. And the smart lens focus can highlight the focus of the display, and a better user experience. In addition, intelligent music recognition can make the coordination of animation effects, filter effects, lens focus effects, and music more tacit, making it more convenient for users to operate.
实施例三：Embodiment three:
本实施例还提供了一种视频处理设备，参见图5所示，其包括处理器501、存储器502以及通信总线503；This embodiment also provides a video processing device. As shown in FIG. 5, it includes a processor 501, a memory 502, and a communication bus 503;
通信总线503用于实现处理器501与存储器502之间的通信连接；The communication bus 503 is used to implement a communication connection between the processor 501 and the memory 502;
一种示例中，处理器501可用于执行存储器502中存储的算机程序，以实现如上各实施例中的任务的视频处理方法的步骤。本实施例中的视频处理设备可以为但不限于机顶盒、 各种智能终端(例如手机、IPAD、笔记本电脑)、服务器等。In an example, the processor 501 may be used to execute a computer program stored in the memory 502 to implement the steps of the task video processing method in the above embodiments. The video processing device in this embodiment may be, but is not limited to, a set-top box, various intelligent terminals (for example, mobile phones, IPAD, notebook computers), servers, and the like.
本实施例还提供了一种计算机可读存储介质，该计算机可读存储介质包括在用于存储信息(诸如计算机可读指令、数据结构、计算机程序模块或其他数据)的任何方法或技术中实施的易失性或非易失性、可移除或不可移除的介质。计算机可读存储介质包括但不限于RAM(Random Access Memory，随机存取存储器)，ROM(Read-Only Memory，只读存储器)，EEPROM(Electrically Erasable Programmable read only memory，带电可擦可编程只读存储器)、闪存或其他存储器技术、CD-ROM(Compact Disc Read-Only Memory，光盘只读存储器)，数字多功能盘(DVD)或其他光盘存储、磁盒、磁带、磁盘存储或其他磁存储装置、或者可以用于存储期望的信息并且可以被计算机访问的任何其他的介质。This embodiment also provides a computer-readable storage medium, which is included in any method or technology for storing information (such as computer-readable instructions, data structures, computer program modules, or other data). Volatile or non-volatile, removable or non-removable media. Computer-readable storage media include but are not limited to RAM (Random Access Memory), ROM (Read-Only Memory, read-only memory), EEPROM (Electrically Erasable Programmable read only memory, charged Erasable Programmable Read-Only Memory) ), flash memory or other memory technology, CD-ROM (Compact Disc Read-Only Memory), digital versatile disk (DVD) or other optical disk storage, magnetic cassettes, magnetic tapes, magnetic disk storage or other magnetic storage devices, Or any other medium that can be used to store desired information and that can be accessed by a computer.
在一种示例中，本实施例中的计算机可读存储介质可用于存储计算机程序，该计算机程序可被处理器执行，以实现如上各实施例中的任务的视频处理方法的步骤。In an example, the computer-readable storage medium in this embodiment may be used to store a computer program, and the computer program may be executed by a processor to implement the steps of the video processing method for the tasks in the above embodiments.
本实施例还提供了一种计算机程序(或称计算机软件)，该计算机程序可以分布在计算机可读介质上，由可计算装置来执行，以实现如上各实施例中的视频处理方法中的至少一个步骤；并且在某些情况下，可以采用不同于上述实施例所描述的顺序执行所示出或描述的至少一个步骤。This embodiment also provides a computer program (or computer software). The computer program can be distributed on a computer-readable medium and executed by a computable device to implement at least one of the video processing methods in the above embodiments. One step; and in some cases, at least one step shown or described can be performed in an order different from that described in the foregoing embodiment.
本实施例还提供了一种计算机程序产品，包括计算机可读装置，该计算机可读装置上存储有如上所示的任一计算机程序。本实施例中该计算机可读装置可包括如上所示的计算机可读存储介质。This embodiment also provides a computer program product, including a computer readable device, and any computer program as shown above is stored on the computer readable device. The computer-readable device in this embodiment may include the computer-readable storage medium as shown above.
根据本发明实施例提供的视频处理方法、装置、设备及计算机可读存储介质，通过获取待处理的视频文件、图片，并获取对应的视频播放特效；然后根据获取的视频播放特效，对待处理的视频文件和图片解码及渲染后，进行播放，和/或存入新的视频文件以生成新视频文件，以便于导出或分享等；这样在视频播放时可实现采用视频播放特效对视频文件和图片混合/拼接播放，丰富了视频和图片的查看方式，可提升视频和图片的播放效果，更利于提升用户体验的满意度。According to the video processing method, device, equipment, and computer-readable storage medium provided by the embodiments of the present invention, the video files and pictures to be processed are acquired, and the corresponding video playback special effects are acquired; After the video files and pictures are decoded and rendered, they are played, and/or stored in new video files to generate new video files for easy export or sharing, etc.; in this way, video playback special effects can be used to apply video playback effects to video files and pictures during video playback. Mixed/spliced playback enriches the viewing methods of videos and pictures, can improve the playback effect of videos and pictures, and is more conducive to improving user experience satisfaction.
可见，本领域的技术人员应该明白，上文中所公开方法中的全部或某些步骤、***、装置中的功能模块/单元可以被实施为软件(可以用计算装置可执行的计算机程序代码来实现)、固件、硬件及其适当的组合。在硬件实施方式中，在以上描述中提及的功能模块/单元之间的划分不一定对应于物理组件的划分；例如，一个物理组件可以具有多个功能，或者一个功能或步骤可以由若干物理组件合作执行。某些物理组件或所有物理组件可以被实施为由处理器，如中央处理器、数字信号处理器或微处理器执行的软件，或者被实施为硬件，或者被实施为集成电路，如专用集成电路。It can be seen that those skilled in the art should understand that all or some of the steps, functional modules/units in the system, and devices in the methods disclosed above can be implemented as software (which can be implemented by computer program code executable by a computing device). ), firmware, hardware and their appropriate combination. In the hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, a physical component may have multiple functions, or a function or step may consist of several physical components. The components are executed cooperatively. Some physical components or all physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit .
此外，本领域普通技术人员公知的是，通信介质通常包含计算机可读指令、数据结构、计算机程序模块或者诸如载波或其他传输机制之类的调制数据信号中的其他数据，并且可包括任何信息递送介质。所以，本发明不限制于任何特定的硬件和软件结合。In addition, as is well known to those of ordinary skill in the art, communication media usually contain computer-readable instructions, data structures, computer program modules, or other data in a modulated data signal such as carrier waves or other transmission mechanisms, and may include any information delivery medium. Therefore, the present invention is not limited to any specific combination of hardware and software.
以上内容是结合具体的实施方式对本发明实施例所作的进一步详细说明，不能认定本发明的具体实施只局限于这些说明。对于本发明所属技术领域的普通技术人员来说，在不脱离本发明构思的前提下，还可以做出若干简单推演或替换，都应当视为属于本发明的保护范围。The above content is a further detailed description of the embodiments of the present invention in combination with specific implementations, and it cannot be considered that the specific implementation of the present invention is limited to these descriptions. For those of ordinary skill in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as belonging to the protection scope of the present invention.

Claims (15)

  1. 一种视频处理方法，包括：A video processing method, including:
    获取待处理的视频文件、图片，并获取对应的视频播放特效；Obtain the video files and pictures to be processed, and obtain the corresponding video playback special effects;
    根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，进行播放，和/或，根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，存入新的视频文件。According to the acquired video playback special effects, the video files and pictures are decoded and rendered before being played, and/or, according to the acquired video playback special effects, the video files and pictures are decoded and rendered and stored in a new video file.
  2. 如权利要求1所述的视频处理方法，其中，所述获取对应的视频播放特效包括以下任意之一：5. The video processing method according to claim 1, wherein said obtaining the corresponding video playing special effect comprises any one of the following:
    根据接收到的播放特效选择指令，获取所述播放特效选择指令所指示的视频播放特效；Acquire the video playback special effect indicated by the playback special effect selection instruction according to the received playback special effect selection instruction;
    获取特效匹配信息，根据所述特效匹配信息，以及预设的特效匹配信息与视频播放特效对应关系，匹配出所述特效匹配信息所对应的视频播放特效。The special effect matching information is acquired, and the video playing special effect corresponding to the special effect matching information is matched according to the special effect matching information and the preset correspondence between the special effect matching information and the video playing special effect.
  3. 如权利要求2所述的视频处理方法，其中，获取对应的视频播放特效包括：获取特效匹配信息，所述获取特效匹配信息包括以下至少之一：3. The video processing method of claim 2, wherein acquiring the corresponding video playback special effect comprises: acquiring special effect matching information, and the acquiring special effect matching information includes at least one of the following:
    所述视频文件包括背景音乐时，获取所述背景音乐对音乐风格作为特效匹配信息；When the video file includes background music, acquiring the background music to music style as special effect matching information;
    获取所述图片中图片内容所属的主题和/或场景作为特效匹配信息；Acquiring the subject and/or scene to which the picture content in the picture belongs as special effect matching information;
    获取所述视频文件中视频内容所属的主题和/或场景作为特效匹配信息。The subject and/or scene to which the video content in the video file belongs is acquired as special effect matching information.
  4. 如权利要求3所述的视频处理方法，其中，所述视频文件包括背景音乐时，所述视频处理方法还包括：5. The video processing method according to claim 3, wherein when the video file includes background music, the video processing method further comprises:
    所述对所述视频文件和图片解码渲染后进行播放还包括：对所述背景音乐进行解码同步播放；The decoding and rendering of the video files and pictures and then playing them further includes: decoding and synchronously playing the background music;
    和/或，and / or,
    对所述视频文件和图片解码渲染后存入新的视频文件还包括：将对所述背景音乐进行解码得到的音频码流存入所述新的视频文件。Decoding and rendering the video files and pictures and storing them into a new video file further includes: storing an audio code stream obtained by decoding the background music into the new video file.
  5. 如权利要求1-4任一项所述的视频处理方法，其中，所述对所述视频文件和图片解码及渲染包括：5. The video processing method according to any one of claims 1 to 4, wherein the decoding and rendering of the video file and picture comprises:
    对所述图片进行解码后生成至少一个视频图像帧并***所述解码后的视频文件中的对应位置，然后对得到的视频文件中的各视频图像帧进行渲染。After decoding the picture, at least one video image frame is generated and inserted into a corresponding position in the decoded video file, and then each video image frame in the obtained video file is rendered.
  6. 如权利要求1-4任一项所述的视频处理方法，其中，对所述视频文件和图片解码及渲染后，进行播放时，还包括：The video processing method according to any one of claims 1 to 4, wherein, after decoding and rendering the video file and picture, when playing, it further comprises:
    在播放过程中，接收到视频播放编辑指令时，根据所述视频播放编辑指令对所述视频文件进行编辑处理。During the playback process, when a video playback editing instruction is received, the video file is edited according to the video playback editing instruction.
  7. 如权利要求1-4任一项所述的视频处理方法，其中，所述视频播放特效包括以下至少之一：5. The video processing method according to any one of claims 1 to 4, wherein the video playback special effect comprises at least one of the following:
    滤镜方式；Filter mode
    播放动画；Play animation
    镜头焦点规则。Lens focus rules.
  8. 如权利要求7所述的视频处理方法，其中，所述播放动画包括以下至少之一：8. The video processing method according to claim 7, wherein the playing animation includes at least one of the following:
    平移动画、放大动画、缩小动画、裁剪动画、旋转动画、淡入和/或淡出动画、果冻效果动画、翻转动画、克隆动画、遮罩动画、弹幕动画、叠加动画、数值变动动画、延迟动画。Pan animation, zoom in animation, zoom out animation, crop animation, rotation animation, fade in and/or fade out animation, jelly effect animation, flip animation, clone animation, mask animation, barrage animation, overlay animation, value change animation, delay animation.
  9. 如权利要求7所述的视频处理方法，其中，所述镜头焦点规则包括：人脸焦点大于场景焦点。8. The video processing method of claim 7, wherein the lens focus rule comprises: the focus of the face is greater than the focus of the scene.
  10. 如权利要求7所述的视频处理方法，其中，所述视频播放特效包括滤镜方式，所述对所述视频文件和图片解码后，进行渲染之前，还包括根据所述滤镜方式对解码后的所述视频文件和图片所得到的纹理进行滤镜处理。8. The video processing method of claim 7, wherein the video playback special effect includes a filter mode, and after the video file and picture are decoded, before rendering, it further includes decoding the video file and picture according to the filter mode. Filter processing is performed on the textures obtained from the video files and pictures.
  11. 如权利要求7所述的视频处理方法，其中，所述视频播放特效包括播放动画，所述对所述视频文件和图片解码及渲染包括：8. The video processing method according to claim 7, wherein the video playing special effect comprises playing an animation, and the decoding and rendering of the video file and picture comprises:
    对解码后的所述视频文件和图片所得到的纹理根据所述播放动画进行渲染。Rendering the texture obtained from the decoded video file and picture according to the playing animation.
  12. 如权利要求7所述的视频处理方法，其中，所述视频播放特效包括镜头焦点规则，所述对所述视频文件和图片进行渲染之前，还包括：8. The video processing method of claim 7, wherein the video playback special effect includes lens focus rules, and before the rendering of the video file and picture, the method further includes:
    根据所述镜头焦点规则，获取并记录所述视频文件的至少一个图像帧中的焦点区域，和/或，获取并记录所述图片的至少一个图像帧中的焦点区域；Acquire and record the focus area in at least one image frame of the video file according to the lens focus rule, and/or acquire and record the focus area in at least one image frame of the picture;
    所述对所述视频文件和图片进行渲染包括：根据记录的所述焦点区域对所述视频文件中对应视频帧中对应焦点区域作为镜头焦点进行渲染，和/或，对根据所述图片生成的至少一个频帧中对应焦点区域作为镜头焦点进行渲染。The rendering of the video file and the picture includes: rendering a corresponding focus area in a corresponding video frame in the video file as a lens focus according to the recorded focus area, and/or The corresponding focal area in at least one frequency frame is rendered as the focal point of the lens.
  13. 一种视频处理装置，包括：A video processing device includes:
    获取模块，用于获取待处理的视频文件、图片，并获取对应的视频播放特效；The obtaining module is used to obtain the to-be-processed video files and pictures, and obtain the corresponding video playback special effects;
    处理模块，用于根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，进行播放，和/或，根据获取的视频播放特效，对所述视频文件和图片解码及渲染后，存入新的视频文件。The processing module is used to decode and render the video files and pictures according to the acquired video playback special effects, and then play them, and/or, after decoding and rendering the video files and pictures according to the acquired video playback special effects, Save the new video file.
  14. 一种视频处理设备，包括处理器、存储器；其中，A video processing device, including a processor and a memory; among them,
    所述处理器用于执行所述存储器中存储的计算机程序，以实现如权利要求1-12所述的视频处理方法的步骤。The processor is configured to execute a computer program stored in the memory to implement the steps of the video processing method according to claims 1-12.
  15. 一种计算机可读存储介质，存储有计算机程序，其中，所述计算机程序可被处理器执行，以实现如权利要求1-12所述的视频处理方法的步骤。A computer-readable storage medium storing a computer program, wherein the computer program can be executed by a processor to implement the steps of the video processing method according to claims 1-12.
PCT/CN2020/111462 2019-09-17 2020-08-26 Video processing method, apparatus and device, and computer-readable storage medium WO2021052130A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910877779.8A CN112533058A (en) 2019-09-17 2019-09-17 Video processing method, device, equipment and computer readable storage medium
CN201910877779.8 2019-09-17

Publications (1)

Publication Number Publication Date
WO2021052130A1 true WO2021052130A1 (en) 2021-03-25

Family

ID=74883323

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/111462 WO2021052130A1 (en) 2019-09-17 2020-08-26 Video processing method, apparatus and device, and computer-readable storage medium

Country Status (2)

Country Link
CN (1) CN112533058A (en)
WO (1) WO2021052130A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113115099B (en) * 2021-05-14 2022-07-05 北京市商汤科技开发有限公司 Video recording method and device, electronic equipment and storage medium
CN113422912B (en) * 2021-05-25 2023-05-23 深圳市闪剪智能科技有限公司 Interactive generation method, device and equipment of short video and storage medium
CN114900736A (en) * 2022-03-28 2022-08-12 网易（杭州）网络有限公司 Video generation method and device and electronic equipment

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050003690A (en) * 2003-07-04 2005-01-12 주식회사 엠투그래픽스 System and method of automatic moving picture editing and storage media for the method
CN103391414A (en) * 2013-07-24 2013-11-13 杭州趣维科技有限公司 Video processing device and processing method applied to mobile phone platform
CN103905885A (en) * 2014-03-25 2014-07-02 广州华多网络科技有限公司 Video live broadcast method and device
CN106993209A (en) * 2016-01-20 2017-07-28 上海慧体网络科技有限公司 A kind of method that short video clip is carried out based on mobile terminal technology
CN107241646A (en) * 2017-07-12 2017-10-10 北京奇虎科技有限公司 The edit methods and device of multimedia video
CN107967706A (en) * 2017-11-27 2018-04-27 腾讯音乐娱乐科技（深圳）有限公司 Processing method, device and the computer-readable recording medium of multi-medium data
CN110611776A (en) * 2018-05-28 2019-12-24 腾讯科技（深圳）有限公司 Special effect processing method, computer device and computer storage medium

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108471554A (en) * 2017-02-23 2018-08-31 合网络技术（北京）有限公司 Multimedia resource synthetic method and device
CN108259984A (en) * 2017-12-29 2018-07-06 广州市百果园信息技术有限公司 Method of video image processing, computer readable storage medium and terminal
CN108307127A (en) * 2018-01-12 2018-07-20 广州市百果园信息技术有限公司 Method for processing video frequency and computer storage media, terminal
CN108769562B (en) * 2018-06-29 2021-03-26 广州酷狗计算机科技有限公司 Method and device for generating special effect video
CN109040615A (en) * 2018-08-10 2018-12-18 北京微播视界科技有限公司 Special video effect adding method, device, terminal device and computer storage medium
CN109462776B (en) * 2018-11-29 2021-08-20 北京字节跳动网络技术有限公司 Video special effect adding method and device, terminal equipment and storage medium
CN109618222B (en) * 2018-12-27 2019-11-22 北京字节跳动网络技术有限公司 A kind of splicing video generation method, device, terminal device and storage medium
CN110049371A (en) * 2019-05-14 2019-07-23 北京比特星光科技有限公司 Video Composition, broadcasting and amending method, image synthesizing system and equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20050003690A (en) * 2003-07-04 2005-01-12 주식회사 엠투그래픽스 System and method of automatic moving picture editing and storage media for the method
CN103391414A (en) * 2013-07-24 2013-11-13 杭州趣维科技有限公司 Video processing device and processing method applied to mobile phone platform
CN103905885A (en) * 2014-03-25 2014-07-02 广州华多网络科技有限公司 Video live broadcast method and device
CN106993209A (en) * 2016-01-20 2017-07-28 上海慧体网络科技有限公司 A kind of method that short video clip is carried out based on mobile terminal technology
CN107241646A (en) * 2017-07-12 2017-10-10 北京奇虎科技有限公司 The edit methods and device of multimedia video
CN107967706A (en) * 2017-11-27 2018-04-27 腾讯音乐娱乐科技（深圳）有限公司 Processing method, device and the computer-readable recording medium of multi-medium data
CN110611776A (en) * 2018-05-28 2019-12-24 腾讯科技（深圳）有限公司 Special effect processing method, computer device and computer storage medium

Also Published As

Publication number Publication date
CN112533058A (en) 2021-03-19

Similar Documents

Publication Publication Date Title
WO2021052130A1 (en) Video processing method, apparatus and device, and computer-readable storage medium
JP7134248B2 (en) Video production method and apparatus, computer equipment, storage medium, and computer program
CN106257930B (en) Generate the dynamic time version of content
US9620169B1 (en) Systems and methods for creating a processed video output
WO2020062683A1 (en) Video acquisition method and device, terminal and medium
KR20210082232A (en) Real-time video special effects systems and methods
EP3361738A1 (en) Method and device for stitching multimedia files
US20230144635A1 (en) Methods and Apparatus for Metadata-Based Processing of Media Content
US20220188357A1 (en) Video generating method and device
US8943020B2 (en) Techniques for intelligent media show across multiple devices
US20210350545A1 (en) Image processing method and apparatus, and hardware apparatus
US20140193138A1 (en) System and a method for constructing and for exchanging multimedia content
US9852772B2 (en) Device and method for playing an interactive audiovisual movie
GB2589731A (en) Video processing method and apparatus, terminal and medium
US9325776B2 (en) Mixed media communication
CN108124170A (en) A kind of video broadcasting method, device and terminal device
CN105578224A (en) Multimedia data acquisition method, device, smart television and set-top box
JP4940333B2 (en) Electronic apparatus and moving image reproduction method
US20170047093A1 (en) Methods and systems of creation and catalog of media recordings
JP5225330B2 (en) Electronic apparatus and image processing method
WO2022194070A1 (en) Video processing method for application, and electronic device
EP3547698A1 (en) Method and device for determining inter-cut time bucket in audio/video
CN115002335B (en) Video processing method, apparatus, electronic device, and computer-readable storage medium
CN116095388A (en) Video generation method, video playing method and related equipment
CN115243087A (en) Audio and video co-shooting processing method and device, terminal equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20866060

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20866060

Country of ref document: EP

Kind code of ref document: A1