WO2024094052A1 - 音视频编辑方法、装置、电子设备及存储介质 - Google Patents

音视频编辑方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2024094052A1
WO2024094052A1 PCT/CN2023/129024 CN2023129024W WO2024094052A1 WO 2024094052 A1 WO2024094052 A1 WO 2024094052A1 CN 2023129024 W CN2023129024 W CN 2023129024W WO 2024094052 A1 WO2024094052 A1 WO 2024094052A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
video
data
editing
plug
Prior art date
Application number
PCT/CN2023/129024
Other languages
English (en)
French (fr)
Inventor
徐志勇
李健
Original Assignee
抖音视界有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 抖音视界有限公司 filed Critical 抖音视界有限公司
Publication of WO2024094052A1 publication Critical patent/WO2024094052A1/zh

Links

Classifications

    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals

Definitions

  • the embodiments of the present disclosure relate to the technical field of audio and video editing and processing, and in particular to an audio and video editing method, device, electronic device and storage medium.
  • the operations that need to be performed include audio and video data storage, cropping, playback control, reverberation, etc.
  • the present invention provides an audio and video editing method, device, electronic device and storage medium, so as to realize the effect of plug-in editing of the audio and video data to be edited based on the browser, simplify the audio and video editing process, and introduce the audio and video editing plug-in to make the target audio routing scalable, further Improved user experience.
  • an embodiment of the present disclosure provides an audio and video editing method, the method comprising:
  • each audio and video editing plug-in to be used is obtained;
  • the target audio and video data is played based on the target audio route.
  • the present disclosure also provides an audio and video editing device, the device comprising:
  • An audio and video editing plug-in acquisition module is used to acquire each audio and video editing plug-in to be used when a trigger to play the audio and video data to be edited is detected;
  • a target audio and video editing plug-in determination module used to determine a target audio and video editing plug-in according to the pre-received audio and video state management data and each of the audio and video editing plug-ins to be used;
  • the audio and video data processing module to be edited is used to edit the audio and video data to be edited based on the functional module integrated in the target audio and video editing plug-in to obtain the target audio and video data;
  • the target audio and video data playing module is used to play the target audio and video data based on the target audio route.
  • an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:
  • processors one or more processors
  • a storage device for storing one or more programs
  • the one or more processors When the one or more programs are executed by the one or more processors, the one or more processors implement the audio and video editing method as described in any of the embodiments of the present disclosure.
  • the embodiments of the present disclosure further provide a storage medium comprising computer executable instructions, which, when executed by a computer processor, are used to execute the audio and video editing method as described in any one of the embodiments of the present disclosure.
  • the technical solution of the embodiment of the present disclosure is as follows: when a trigger for playing the audio and video data to be edited is detected, each audio and video editing plug-in to be used is obtained, and then, based on the pre-received audio and video status management data and each audio and video editing plug-in to be used, a target audio and video editing plug-in is determined; further, the audio and video data to be edited is edited based on the functional modules integrated in the target audio and video editing plug-in to obtain the target audio and video data; finally, the target audio and video data is played based on the target audio route, which solves the problem in the prior art that the editing process often requires different applications or software to complete, resulting in low efficiency and weak functionality, and achieves the effect of plug-in editing of the audio and video data to be edited based on the browser, simplifies the audio and video editing process, and the introduction of the audio and video editing plug-in can make the target audio route scalable, further improving the user experience.
  • FIG1 is a flow chart of an audio and video editing method provided by an embodiment of the present disclosure
  • FIG2 is a schematic diagram of the structure of a plug-in management module provided in an embodiment of the present disclosure
  • FIG3 is a flow chart of an audio and video editing method provided by an embodiment of the present disclosure.
  • FIG4 is a flow chart of an audio and video editing method provided by an embodiment of the present disclosure.
  • FIG5 is a flow chart of an audio and video editing method provided by an embodiment of the present disclosure.
  • FIG6 is a schematic diagram of the structure of an audio and video editing device provided by an embodiment of the present disclosure.
  • FIG. 7 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure.
  • a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information.
  • the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.
  • the prompt information in response to receiving an active request from the user, may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form.
  • the pop-up window may also carry a selection control for the user to choose "agree” or “disagree” to provide personal information to the electronic device.
  • the browser-based display interface can display the audio and video data to be edited.
  • each pre-built audio and video editing plug-in to be used can be selected.
  • a target audio and video editing plug-in is defined to edit the audio and video data to be edited based on the target audio and video editing plug-in.
  • a target audio route is created to play the target audio and video data based on the target audio route after obtaining the target audio and video data. This allows the editing and playback of the audio and video data to be edited to be realized on the browser display interface, thereby achieving the effect of simplifying the audio and video data editing and processing flow.
  • FIG1 is a flowchart of an audio and video editing method provided by an embodiment of the present disclosure.
  • the embodiment of the present disclosure is applicable to the case where the audio and video data to be edited is edited based on a pre-built target audio and video editing plug-in, and the target audio and video data obtained after the editing is played.
  • the method can be executed by an audio and video editing device, which can be implemented in the form of software and/or hardware, and optionally, by an electronic device, which can be a mobile terminal, a PC or a server, etc.
  • the technical solution provided by the embodiment of the present disclosure can be executed based on the client, can be executed based on the server, or can be executed based on the cooperation of the client and the server.
  • the method comprises:
  • each audio or video editing plug-in to be used is obtained.
  • the audio and video data to be edited can be a multimedia data stream that stores sound content and image content.
  • the sound content and image content stored in this data stream can be the sound information and image information that the user currently needs to edit.
  • the audio and video data to be edited can also be a data stream that needs to be edited again.
  • the re-editing may include: audio and video data storage, cropping, playback control, reverberation, and filtering.
  • the audio and video data to be edited can be any audio and video clip that needs to be edited.
  • multiple audio and video data can be uploaded to the system, and a playback trigger control can be set in any area of these audio and video data. When a trigger operation of the playback trigger control of any audio and video data is detected, this audio and video data can be used as the audio and video data to be edited. And get each audio and video editing plugin to be used.
  • the audio and video editing plug-in to be used may be a functional plug-in capable of editing and processing audio and video data.
  • the audio and video editing plug-in to be used may include a noise reduction editing plug-in, a volume editing plug-in, a hotkey editing plug-in, a reverberation editing plug-in, an export editing plug-in, and a fade-in and fade-out plug-in.
  • the audio and video editing plug-in to be used includes multiple hook files, and the hook files include function files for editing the audio and video data to be edited.
  • the hook file may be a file for performing audio and video editing operations.
  • the hook file may include, but is not limited to, a hook file for playing audio and video data to be edited (play), a hook file for playing audio tracks (play Track), a hook file for playing clips (play Clip), a hook file for stopping playback (stop), a hook file for content change (content Change), a hook file for selection change (selection Change), and a hook file for destroying audio and video data to be edited (destory).
  • the hooks in the audio and video editing plug-in to be used can be determined based on the developer's needs, and in the subsequent application process, the newly generated hook file can also be sent to each audio and video editing plug-in to be used at any time.
  • the advantage of this setting is that it can realize the creation of a recording module in the target audio route, expand the target audio route, and achieve the effects of multiple audio editing processes.
  • the plug-in system architecture including the audio and video editing plug-in to be used can be described in conjunction with FIG. 2: the inclusion relationship of the plug-in system can be that the audio editor includes a plug-in management module, and the plug-in management module includes at least one audio and video editing plug-in to be used, wherein each audio and video editing plug-in to be used includes multiple hook files.
  • the hook files included in the audio and video editing plug-in to be used may include a hook file for playing the audio and video data to be edited, a hook file for playing the audio track, a hook file for playing the clip, a hook file for stopping the playback, a hook file for changing the content, a hook file for changing the selection area, and a hook file for destroying the audio and video data to be edited.
  • the hook file for playing audio and video data to be edited can be triggered once when a trigger operation of the audio and video data to be edited is detected; the hook file for playing audio tracks can be triggered once when a trigger operation of any audio track data in the audio and video data to be edited is detected when playing the audio and video data to be edited.
  • the web page audio interface context, audio track data and the connection method of the target audio route can be obtained; the hook file for playing clips can be triggered once when a trigger operation of any audio clip data in the audio and video data to be edited is detected when playing the audio and video data to be edited.
  • the web page audio interface context, audio track data and the connection method of the target audio route can be obtained; the hook file for stopping playback can be triggered once when a stop playback operation is detected; the hook file for content change can be triggered once when the audio and video status management data changes; the hook file for selection change can be triggered once when the to-be-edited area of the audio and video data to be edited changes; the hook file for destroying audio and video data to be edited can be triggered once when the audio editor is destroyed.
  • the audio and video editing plug-ins to be used can be pre-stored in the system plug-in library in the early development stage.
  • each audio and video editing plug-in to be used can be directly called from the plug-in library.
  • the audio and video editing plug-ins to be used in the plug-in library are in a dynamically updated state.
  • these subsequently developed audio and video editing plug-ins can be updated to the plug-in library as audio and video editing plug-ins to be used, so that when editing operations on the audio and video data to be edited are detected subsequently, each audio and video editing plug-in to be used can be called.
  • each audio and video plug-in to be used can correspond to the plug-in management system, and this plug-in management system is extensible, and each audio and video plug-in to be used in the plug-in management system can be changed at any time.
  • Video editing plug-in to update can be set based on actual needs, that is, each audio and video plug-in to be used can correspond to the plug-in management system, and this plug-in management system is extensible, and each audio and video plug-in to be used in the plug-in management system can be changed at any time.
  • Video editing plug-in to update can be set based on actual needs, that is, each audio and video plug-in to be used can correspond to the plug-in management system, and this plug-in management system is extensible, and each audio and video plug-in to be used in the plug-in management system can be changed at any time.
  • a trigger operation can be input into the playback trigger control of the audio or video data to be edited.
  • each audio or video editing plug-in to be used can be obtained to process the audio or video data to be edited based on each audio or video editing plug-in to be used.
  • the audio and video state management data can be used to characterize all data expressions of the audio and video data to be edited during the editing process.
  • the audio and video state management data may include all data applied to the editing process of the audio and video data to be edited.
  • the audio and video state management data may include track data, audio data, audio effect parameters, audio meta information, and global configuration data.
  • the audio and video state management data can be represented by JSON.
  • the target audio and video editing plug-in can be a plug-in that edits the audio and video data to be edited. It should be noted that the target audio and video editing plug-in can be one of the audio and video editing plug-ins to be used, or it can be multiple plug-ins in the audio and video editing plug-ins to be used.
  • corresponding audio and video status management data can be generated based on the editing and processing operations on the audio and video data to be edited.
  • the pre-generated audio and video status management data can be sent to the audio and video editing system, so that when the user's playback trigger operation on the audio and video data to be edited is detected, the editing and processing operations to be performed on the audio and video data to be edited can be determined according to the audio and video status management data.
  • each audio and video editing plug-in to be used can be traversed according to the audio and video state management data.
  • the audio and video state management data contains a field corresponding to at least one audio and video editing plug-in to be used
  • these audio and video editing plug-ins to be used can be used as target audio and video editing plug-ins.
  • a target audio and video editing plug-in is determined based on pre-received audio and video status management data and each audio and video editing plug-in to be used, including: determining the number of audio tracks based on the audio and video status management data, and calling the corresponding audio track data in sequence; based on the audio track data and a data set corresponding to at least one audio and video editing feature data in the audio and video status management data; for each audio and video editing plug-in to be used, if the audio and video editing feature data in the data set is included in the current audio and video editing plug-in to be used, determining the current audio and video editing plug-in to be used as the target audio and video editing plug-in.
  • audio tracks are parallel "tracks" displayed one by one in audio editing software.
  • Each audio track defines the properties of the audio track, such as the timbre, timbre library, number of channels, input/output ports, and volume of the audio track.
  • the audio track data can be data used to characterize the properties of the audio track.
  • the audio track data can be used to describe the details, position, and playback duration of the audio track.
  • Audio and video editing feature data can be data used to characterize the properties of audio and video editing.
  • the pre-received audio and video status management data can be parsed and processed, and the number of audio tracks can be determined according to the audio and video status management data, and each audio track data can be called in sequence. Furthermore, a data set corresponding to at least one audio and video editing feature data is determined in the audio and video status management data, and each audio and video editing plug-in to be used is traversed according to each audio data and each data set.
  • the current audio and video editing plug-in can be used as the target audio and video editing plug-in.
  • the advantage of this setting is that the audio and video status management plug-in that matches the audio and video editing feature data in each data set can be determined in multiple audio and video editing plug-ins to be used.
  • the target audio and video editing plug-in corresponding to the data can achieve the effect of editing the audio and video data to be edited based on user needs.
  • the function module can be a collection of program elements such as data descriptions and executable statements.
  • the function module can be a collection of execution statements and data containing specific functions that can be implemented by the target audio and video editing plug-in.
  • different target audio and video editing plug-ins can implement different audio and video editing functions. Therefore, the data files contained in the function modules integrated in each target audio and video editing plug-in are also different; and in the actual application process, the function modules integrated in the target audio and video editing plug-in can be dynamically adjusted, and the specific function modules included in the target audio and video editing plug-in can be determined based on the user's current needs during each editing process.
  • the target audio and video data may be a multimedia data stream storing audio content and image content.
  • the audio content stored in the data stream may be audio information that meets the current needs of the user.
  • the functional module integrated in the target audio and video editing plug-in can be determined, so as to edit the audio and video data to be edited based on the audio and video editing execution statements contained in the functional module, so that the audio and video data to be edited can be edited and processed into audio and video data that meets the current needs of the user.
  • the audio and video data obtained after the editing process can be used as the target audio and video data.
  • the target audio and video plug-in is a volume editing plug-in
  • the editing data contained in its integrated functional module is to adjust the volume to "1”
  • the target audio and video data finally obtained is the audio and video data that adjusts the volume of the audio and video data to be edited to "1".
  • each target audio and video editing plug-in treats the editing When the audio and video data are edited and processed, if there are multiple target audio and video plug-ins, each target audio and video editing plug-in can be traversed and processed.
  • each target audio and video editing plug-in since the audio and video data to be edited is to be played based on the terminal device after the editing process is completed and the target audio and video data is obtained, in order to realize the playback function of the target audio and video data, each target audio and video editing plug-in will generate a corresponding target audio route after processing the audio and video data to be edited, so as to play the target audio and video data based on the target audio route.
  • an audio processing module that includes both input and output can also be created to connect the target audio and video data with its corresponding playback terminal, thereby realizing playback.
  • the process of determining the target audio and video editing plug-in and editing and processing the audio and video data to be edited based on the target audio and video editing plug-in it also includes: creating a recording module to connect to the target audio route.
  • the recording module can be a module for processing audio and video data and playing the processed audio and video data.
  • the target audio route can be an audio processing graph constructed by linked audio modules.
  • the target audio route can include multiple modules, and optionally, can include a data source module, a recording module, and a destination module.
  • the target audio route can control the creation of the modules it includes, as well as the execution of audio processing or data stream decoding.
  • a corresponding recording module can be created, and the recording module can be connected to the target audio route, so that the processed audio and video data to be edited can be connected to a predetermined destination after output.
  • S140 Play the target audio and video data based on the target audio route.
  • the target audio and video data can be played according to the modules sequentially connected in the target audio routing.
  • target audio and video editing plug-ins if there are multiple target audio and video editing plug-ins, corresponding target audio routes will be generated after the editing processing of the audio and video data to be edited is completed based on each target audio and video editing plug-in.
  • the target audio route for finally playing the target audio and video data can be determined in each target audio route, so that the target audio and video data can be played based on the determined target audio route.
  • it also includes: using the target audio route corresponding to the last target audio and video editing plug-in as the target audio route for finally playing the target audio and video data.
  • target audio routes corresponding to each target audio and video plug-in will be generated.
  • the target audio route corresponding to the last target audio and video editing plug-in can be used as the target audio route for the final playback of the target audio and video data, so that this target audio route can play the target audio and video data.
  • the audio and video editing and processing system may also include a selection management module (Selection Manager) and a clipboard management module (Clopboard Manager), wherein in the Selection Manager, Selection can be described by seconds, and the audio and video data to be edited can be deleted, copied, and other operations can be performed through the selection; a clipboard is provided in the Clopboard Manager, which can perform corresponding operations on the audio and video data to be edited, and also depends on the Selection Manager.
  • Selection Manager selection management module
  • Clopboard Manager clipboard management module
  • each audio and video editing plug-in to be used can be obtained; based on the plug-in management module, each audio and video editing plug-in to be used is traversed; according to the number of audio tracks (Track) in the audio and video status management data, play Track is called in sequence, and the corresponding audio track data, i.e., track 1 and track 2, are uploaded; based on the audio track data and the audio and video editing feature data (Attributes) in the audio and video status management data, the target audio and video plug-in is determined to be a noise reduction editing plug-in and a volume editing plug-in from each audio and video editing plug-in to be used, and a corresponding recording module (Audio node) is created and connected to the target audio routing (Audio Routing Graph); according to the audio clip (Cli p) number, call play Clip in sequence, and upload the corresponding audio clip data, that is, audio track 1 includes audio clip 1, audio clip 1, audio clip 1, audio clip
  • the technical solution of the disclosed embodiment when detecting the triggering of playing the audio and video data to be edited, obtains each audio and video editing plug-in to be used, then determines the target audio and video editing plug-in according to the pre-received audio and video status management data and each audio and video editing plug-in to be used, further, edits and processes the audio and video data to be edited based on the functional module integrated in the target audio and video editing plug-in to obtain the target audio and video data, and finally plays the target audio and video data based on the target audio routing, which solves the problem that the editing process in the prior art often requires different applications or software to complete, has low efficiency and weak functionality, and realizes the plug-in-based editing of audio and video data to be edited based on the browser
  • the editing effect simplifies the audio and video editing process.
  • the introduction of audio and video editing plug-ins can make the target audio routing scalable, further improving the user experience.
  • FIG4 is a flowchart of an audio and video editing method provided by an embodiment of the present disclosure.
  • the audio and video data to be edited can be determined from the uploaded audio and video data to be processed, and the audio and video state management data can be obtained to edit the audio and video data to be edited based on the audio and video state management data.
  • the specific implementation method can refer to the technical solution of this embodiment. The technical terms that are the same or corresponding to the above embodiment are not repeated here.
  • the method specifically includes the following steps:
  • S210 Receive at least one uploaded audio or video data to be processed, and determine audio or video data to be edited based on the at least one audio or video data to be processed.
  • the audio and video data to be processed may be the audio and video data that currently needs to be processed and uploaded to the audio and video editing system.
  • the audio and video data to be processed may be one or more.
  • the audio and video data to be processed may be used as the audio and video data to be edited; when there are multiple audio and video data to be processed, the audio and video data to be edited may be determined from the multiple audio and video data to be processed based on user needs.
  • the audio and video data to be processed can be uploaded to the system in real time or periodically, so that the audio and video data to be edited can be determined based on the uploaded audio and video data to be processed.
  • the audio and video data to be processed that need to be edited can be uploaded to the system, and the uploaded audio and video data to be processed can be stored in the database.
  • each audio and video data to be processed can be displayed in the display interface in a list or other display form, so that the user can edit each audio and video data to be processed.
  • Another implementation method is: after storing the uploaded audio and video data to be processed in the database, the audio and video data screening conditions can be entered in the search box displayed in the display interface to screen the audio and video data to be processed based on the screening conditions entered by the user. At this time, the audio and video data to be processed displayed in the screening result display interface can be used as the audio and video data to be edited.
  • S220 Acquire audio and video status management data, so as to edit at least one audio and video data to be edited based on the audio and video status management data.
  • obtaining audio and video status management data includes: obtaining at least one audio and video editing feature data corresponding to the status object, and updating the audio and video status management data based on the at least one audio and video editing feature data.
  • the state object may be an object with instance variables, may store data, and is non-thread-safe.
  • the state object may store audio and video editing feature data, and each audio and video editing feature data may be readable and writable at any time.
  • At least one audio and video editing feature data corresponding to the state object can be first obtained, and then the audio and video state management data can be updated according to each audio and video editing feature data, so that the audio and video state management data can include various attribute features in the audio and video editing process, so that the audio and video state management data can be determined based on the audio and video state management data.
  • the target audio and video editing plug-in for editing the audio and video data to be edited has the advantage of being able to determine the editing function to be implemented during the audio and video editing process, thereby enabling the selection of the target audio and video editing plug-in.
  • the audio and video status management data also includes various attribute feature data of the audio, which can be set based on user needs.
  • the audio and video status management data contains all data of the audio and video data to be edited during the editing process.
  • the audio and video status management data can be changed to edit the audio and video data based on the changed audio and video status management data.
  • the target audio route used to play the target audio and video data will also change accordingly.
  • it also includes: when a change in the audio and video status management data is detected, the audio and video data to be edited is traversed based on the audio management module, and the audio and video data to be edited is edited based on the updated audio and video status management data.
  • the audio management module can be a data set used to manage audio and video data.
  • the audio management module when a change in the audio and video status management data is detected, the audio management module can be triggered. Then, the audio management module can traverse all audio clips in the audio and video data to be edited according to the changed audio and video status management data, and recreate the modules connected in the target audio route, thereby realizing the mapping relationship between the updated audio and video status management data and the audio editing system based on the recreated target audio route.
  • the advantage of this setting is that it simplifies the editing process of the audio and video data to be edited, improves the editing process efficiency, and the editing process can be changed at any time, which improves the user experience.
  • a history management module for storing the data of each editing operation can be created, so that when an undo operation is detected, the data required by the user can be retrieved from the module.
  • the audio and video status management data is saved in the history management module, so that when the undo or rollback editing instruction corresponding to the audio and video data to be edited is received, the corresponding audio and video status management data is retrieved from the history management module to edit the audio and video data to be edited.
  • the history management module may be a collection of data corresponding to each editing operation in the editing process.
  • the undo or rollback editing instruction may be a pre-written program code, which may be used to perform the undo or rollback operation.
  • an undo or rollback control may be pre-set in any area of the audio and video editing interface.
  • the audio and video status management data can be stored in a history management module, and whenever a change in the audio and video status management data is detected, the changed audio and video status management data can be stored in the history management module. At the same time, the audio and video status management data previously stored in the history management module will not be deleted.
  • an undo or rollback editing instruction can be generated and sent to the server.
  • the server receives the undo or rollback editing instruction, it can retrieve the corresponding audio and video status management data from the history management module to edit the audio and video data again based on the retrieved audio and video status management data.
  • the advantage of this setting is that it can realize the storage of historical editing operation data, which is convenient for subsequent editing. It can be called up at any time, and when a fault occurs, troubleshooting can be carried out based on the pre-stored audio and video status management data.
  • the audio and video status management data changes, it must be stored in the history management module so that the history management module stores audio and video status management data in multiple states, and the undo or rollback editing operation is to undo the editing processing operation at the current moment, so that the audio and video data to be edited rolls back to the state before editing.
  • the audio and video status management data is to be retrieved from the history management module
  • the audio and video status management data corresponding to the undo or rollback editing operation can be determined from the multiple audio and video status management data corresponding to the data to be edited, so that the audio and video data to be edited can be edited based on the retrieved audio and video status management data.
  • it also includes: when an undo or rollback control is detected, the audio and video status management data with the shortest distance from the current moment is obtained from the history management module, and the audio and video status management data is reused.
  • the current time may be a triggering time for canceling or rolling back the control.
  • the corresponding timestamp is generated so that the audio and video status management data is stored in the history management module in the time order shown by the timestamp.
  • the audio and video status management data with the smallest distance from the current moment can be determined based on the current moment and the timestamp corresponding to each audio and video status management data, and this audio and video status management data is used as the audio and video status management data corresponding to the undo or rollback operation, and the audio and video data to be edited is edited again based on this audio and video status management data, so that the audio and video data to be edited can be rolled back to the state required by the user.
  • the advantage of this setting is that the corresponding audio and video status management data can be quickly retrieved when the undo or rollback operation is detected. Manage data so that undo or rollback functions can be quickly implemented.
  • S240 Determine a target audio and video editing plug-in according to the pre-received audio and video status management data and each audio and video editing plug-in to be used.
  • S260 Play the target audio and video data based on the target audio route.
  • FIG. 5 Crop the audio clip 1 (Clip 1) and call the clip.move method in the state object (State module); 2. Process the movement logic based on clip.move in the state object (State module); 3. Based on the State module, call the audio and video state management data module (Voice Set) to update the result after the move to the Voice Set; 4. Get the updated Voice Set, save the data snapshot, and save it to the history management module (History Manager); 5. When the content of Voice Set changes, notify the audio management module (Audio Manager); 6. Based on Audio Manager, traverse the audio and video state management data, recreate the data source module (Web audio Source Node), and complete the mapping relationship between Voice Set and Web audio.
  • Coffee Set audio and video state management data module
  • the technical solution of the embodiment of the present disclosure receives at least one uploaded audio and video data to be processed, determines the audio and video data to be edited based on the at least one audio and video data to be processed, and then obtains the audio and video state management data to edit the at least one audio and video data to be edited based on the audio and video state management data.
  • a trigger is detected to play the audio and video data to be edited, obtains each audio and video editing plug-in to be used, and plays the audio and video data according to the pre-received audio and video state management data and each audio and video editing plug-in to be used.
  • a component is used to determine the target audio and video editing plug-in, and the audio and video data to be edited is edited based on the functional module integrated in the target audio and video editing plug-in to obtain the target audio and video data, and the target audio and video data is played based on the target audio routing, thereby achieving the effect of editing the audio and video data to be edited based on the browser, and by processing the audio and video status management data to realize the corresponding editing and processing functions, the multi-dimensional audio and video data expression capability is improved, and the effect of expressing the complex editing and processing process based on data is achieved.
  • Figure 6 is a structural schematic diagram of an audio and video editing device provided by an embodiment of the present disclosure. As shown in Figure 6, the device includes: an audio and video editing plug-in acquisition module 310, a target audio and video editing plug-in determination module 320, an audio and video data processing module 330 to be edited, and a target video determination module 340.
  • the audio and video editing plug-in acquisition module 310 is used to acquire each audio and video editing plug-in to be used when a trigger to play the audio and video data to be edited is detected;
  • a target audio and video editing plug-in determination module 320 is used to determine a target audio and video editing plug-in according to the pre-received audio and video state management data and each of the audio and video editing plug-ins to be used;
  • the audio and video data processing module 330 to be edited is used to edit the audio and video data to be edited based on the functional modules integrated in the target audio and video editing plug-in to obtain the target audio and video data;
  • the target audio and video data playing module 340 is used to play the target audio and video data based on the target audio route.
  • the device further includes: a module for receiving audio and video data to be processed and a module for acquiring audio and video status management data.
  • the receiving module for receiving audio and video data to be processed is used to trigger the playing of the audio and video data to be edited when the trigger is detected.
  • receiving at least one uploaded audio and video data to be processed so as to determine the audio and video data to be edited based on the at least one audio and video data to be processed;
  • the audio and video status management data acquisition module is used to acquire the audio and video status management data so as to edit the at least one audio and video data to be edited based on the audio and video status management data.
  • the audio and video status management data acquisition module includes: an audio and video status management data acquisition unit.
  • the audio and video state management data acquisition unit is used to acquire at least one audio and video editing feature data corresponding to the state object, and update the audio and video state management data based on the at least one audio and video editing feature data.
  • the device further includes: an audio and video status management data storage module.
  • the audio and video status management data saving module is used to save the audio and video status management data into the history management module after determining the audio and video status management data, so that when receiving the undo or rollback editing instruction corresponding to the audio and video data to be edited, the corresponding audio and video status management data is retrieved from the history management module to edit the audio and video data to be edited.
  • the device further includes: an audio and video status management data multiplexing module.
  • the audio and video status management data multiplexing module is used to obtain the audio and video status management data with the shortest distance from the current moment from the history management module when a cancel or rollback control is detected, and multiplex the audio and video status management data.
  • the device further includes: a module for traversing audio and video data to be edited.
  • the audio and video data traversal module to be edited is used to traverse the audio and video data to be edited based on the audio management module when a change in the audio and video status management data is detected, so as to edit and process the audio and video data to be edited based on the updated audio and video status management data.
  • the audio and video editing plug-in to be used includes a plurality of hook files, and the hook files include function files for editing the audio and video data to be edited.
  • the target audio and video editing plug-in determination module 320 includes: an audio track data calling unit, a data set based unit and a target audio and video editing plug-in determination unit.
  • An audio track data calling unit used to determine the number of audio tracks based on the audio and video state management data, and call corresponding audio track data in sequence;
  • the data set is based on a unit, and is used for a data set corresponding to at least one audio and video editing feature data in the audio track data and the audio and video state management data;
  • the target audio and video editing plug-in determination unit is used to determine, for each audio and video editing plug-in to be used, if the audio and video editing plug-in currently to be used includes the audio and video editing feature data in the data set, then determine the audio and video editing plug-in currently to be used as the target audio and video editing plug-in.
  • the device further includes: a recording module creation module.
  • the recording module creation module is used to create a recording module to connect to the target audio route during the process of determining the target audio and video editing plug-in and editing the audio and video data to be edited based on the target audio and video editing plug-in.
  • the device further includes: a target audio route determination module.
  • the target audio route determination module is used to use the target audio route corresponding to the last target audio and video editing plug-in as the target audio route for finally playing the target audio and video data.
  • a trigger when a trigger is detected to play the audio and video data to be edited, obtain Each audio and video editing plug-in to be used, then, according to the pre-received audio and video status management data and each audio and video editing plug-in to be used, a target audio and video editing plug-in is determined, further, based on the functional module integrated in the target audio and video editing plug-in, the audio and video data to be edited are edited and processed to obtain the target audio and video data, finally, based on the target audio routing, the target audio and video data are played, which solves the problem that the editing processing process in the prior art requires different applications or software to complete, and has low efficiency and weak functionality, realizes the effect of plug-in editing of the audio and video data to be edited based on the browser, simplifies the audio and video editing processing flow, and the introduction of audio and video editing plug-ins can make the target audio routing scalable, further improving the user experience.
  • the video processing device provided in the embodiments of the present disclosure can execute the audio and video editing method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.
  • FIG7 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure.
  • a schematic diagram of the structure of an electronic device e.g., a terminal device or server in FIG7
  • the terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (e.g., vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc.
  • the electronic device shown in FIG7 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.
  • the electronic device 500 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 501, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 502 or a program loaded from a storage device 508 to a random access memory (RAM) 503.
  • a processing device 501 e.g., a central processing unit, a graphics processing unit, etc.
  • RAM random access memory
  • Various programs and data required for the operation of the electronic device 500 are also stored in the RAM 503.
  • the processing device 501, the ROM 502, and the RAM 503 are connected to each other via a bus 504.
  • An edit/output (I/O) interface 505 is also connected to the bus 504.
  • the following devices may be connected to the I/O interface 505: input devices 506 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 507 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 508 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 509.
  • the communication devices 509 may allow the electronic device 500 to communicate wirelessly or wired with other devices to exchange data.
  • FIG. 7 shows an electronic device 500 with various devices, it should be understood that it is not required to implement or have all the devices shown. More or fewer devices may be implemented or have alternatively.
  • an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart.
  • the computer program can be downloaded and installed from a network through a communication device 509, or installed from a storage device 508, or installed from a ROM 502.
  • the processing device 501 the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.
  • the electronic device provided in the embodiment of the present disclosure and the audio and video editing method provided in the above embodiment belong to the same inventive concept.
  • the technical details not fully described in this embodiment can be referred to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.
  • the embodiments of the present disclosure provide a computer storage medium on which a computer program is stored.
  • the program is executed by a processor, the audio and video editing method provided in the above embodiments is implemented.
  • the computer-readable medium disclosed above may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two.
  • the computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above.
  • Computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
  • a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, device or device.
  • a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which a computer-readable program code is carried.
  • This propagated data signal may take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above.
  • Computer readable signal media may also be any computer readable medium other than computer readable storage media that can send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device.
  • the program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.
  • the client and server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network).
  • HTTP HyperText Transfer Protocol
  • Examples of communication networks include a local area network ("LAN”), a wide area network ("WAN”), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.
  • the computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.
  • the computer-readable medium carries one or more programs.
  • the electronic device When the one or more programs are executed by the electronic device, the electronic device:
  • each audio and video editing plug-in to be used is obtained;
  • the target audio and video data is played based on the target audio route.
  • Computer program code for performing operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages such as Java, Smalltalk, C++, and conventional procedural programming languages such as "C" or similar programming languages.
  • the program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer, and partially on the computer.
  • the program may be executed on a remote computer or entirely on a remote computer or server.
  • the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).
  • LAN local area network
  • WAN wide area network
  • each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function.
  • the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved.
  • each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
  • the units involved in the embodiments described in the present disclosure may be implemented by software or hardware.
  • the name of a unit does not limit the unit itself in some cases.
  • the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses".
  • exemplary types of hardware logic components include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.
  • FPGAs field programmable gate arrays
  • ASICs application specific integrated circuits
  • ASSPs application specific standard products
  • SOCs systems on chip
  • CPLDs complex programmable logic devices
  • a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment.
  • a machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium.
  • a machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing.
  • a more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
  • RAM random access memory
  • ROM read-only memory
  • EPROM or flash memory erasable programmable read-only memory
  • CD-ROM portable compact disk read-only memory
  • CD-ROM compact disk read-only memory
  • magnetic storage device or any suitable combination of the foregoing.
  • Example 1 provides an audio and video editing method, the method comprising:
  • each audio and video editing plug-in to be used is obtained;
  • the target audio and video data is played based on the target audio route.
  • Example 2 provides an audio and video editing method, the method further comprising:
  • receiving at least one uploaded audio and video data to be processed so as to determine the audio and video data to be edited based on the at least one audio and video data to be processed;
  • Acquire audio and video status management data to edit the at least one audio and video data to be edited based on the audio and video status management data.
  • Example 3 provides an audio and video editing method, the method further comprising:
  • At least one audio and video editing feature data corresponding to the state object is obtained, and the audio and video state management data is updated based on the at least one audio editing feature data.
  • Example 4 provides an audio and video editing method, the method further comprising:
  • the audio and video status management data is saved in a history management module, so that when an undo or rollback editing instruction corresponding to the audio and video data to be edited is received, the corresponding audio and video status management data is retrieved from the history management module to edit the audio and video data to be edited.
  • Example 5 provides an audio and video editing method, the method further comprising:
  • the audio and video state management data with the shortest distance from the current moment is obtained from the history management module, and the audio and video state management data is reused.
  • Example 6 provides an audio and video editing method, the method further comprising:
  • the audio and video data to be edited is traversed based on the audio management module to edit and process the audio and video data to be edited based on the updated audio and video status management data.
  • Example 7 provides an audio and video editing method, The method further includes:
  • the audio and video editing plug-in to be used includes multiple hook files, and the hook files include function files for editing the audio and video data to be edited.
  • Example 8 provides an audio and video editing method, the method further comprising:
  • the number of audio tracks is determined based on the audio and video status management data, and corresponding audio track data is called in sequence;
  • the audio and video editing plug-in currently to be used includes the audio and video editing feature data in the data set and, then the audio and video editing plug-in currently to be used is determined to be the target audio and video editing plug-in.
  • Example 9 provides an audio and video editing method, the method further comprising:
  • a recording module is created to connect to a target audio route.
  • Example 10 provides an audio and video editing method, the method further comprising:
  • the target audio route corresponding to the last target audio and video editing plug-in is used as the target audio route for finally playing the target audio and video data.
  • Example 11 provides an audio and video editing device, The device includes:
  • the audio and video editing plug-in acquisition module is used to acquire each audio and video editing plug-in to be used when a trigger is detected to play the audio and video data to be edited;
  • a target audio and video editing plug-in determination module used to determine a target audio and video editing plug-in according to the pre-received audio and video state management data and each of the audio and video editing plug-ins to be used;
  • the audio and video data processing module to be edited is used to edit the audio and video data to be edited based on the functional module integrated in the target audio and video editing plug-in to obtain the target audio and video data;
  • the target audio and video data playing module is used to play the target audio and video data based on the target audio route.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

一种音视频编辑方法、装置、电子设备（500）及存储介质。方法包括：当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件（S110）；根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件（S120）；基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据（S130）；基于目标音频路由播放目标音视频数据（S140）。实现了基于浏览器对待编辑音视频数据进行插件化编辑的效果，简化了音视频编辑处理流程，并且，引入音视频编辑插件可以使目标音频路由实现可扩展化，进一步提升了用户体验。

Description

音视频编辑方法、装置、电子设备及存储介质
交叉引用
本公开要求于2022年11月1日提交的题为“音视频编辑方法、装置、电子设备及存储介质”的中国专利申请第202211358778.0号的优先权，其公开内容通过引用整体并入本文。
技术领域
本公开实施例涉及音视频编辑处理技术领域，尤其涉及一种音视频编辑方法、装置、电子设备及存储介质。
背景技术
随着网络的发展，越来越来的用户可以编辑相应的音视频内容并发布，在音视频编辑的场景下，需要执行的操作包括音视频数据存储、裁剪、播放控制、混响等。
上述操作的实现多需要不同的应用程序或者软件来完成，存在效率较低以及功能性较弱的问题。
发明内容
本公开提供一种音视频编辑方法、装置、电子设备及存储介质，以实现基于浏览器对待编辑音视频数据进行插件化编辑的效果，简化了音视频编辑处理流程，并且，引入音视频编辑插件可以使目标音频路由实现可扩展化，进一步 提升了用户体验。
第一方面，本公开实施例提供了一种音视频编辑方法，该方法包括：
当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
基于目标音频路由播放所述目标音视频数据。
第二方面，本公开实施例还提供了一种音视频编辑装置，该装置包括：
音视频编辑插件获取模块，用于当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
目标音视频编辑插件确定模块，用于根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
待编辑音视频数据处理模块，用于基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
目标音视频数据播放模块，用于基于目标音频路由播放所述目标音视频数据。
第三方面，本公开实施例还提供了一种电子设备，所述电子设备包括：
一个或多个处理器；
存储装置，用于存储一个或多个程序，
当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如本公开实施例任一所述的音视频编辑方法。
第四方面，本公开实施例还提供了一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如本公开实施例任一所述的音视频编辑方法。
本公开实施例的技术方案，当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件，然后，根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件，进一步的，基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据，最后，基于目标音频路由播放目标音视频数据，解决了现有技术中编辑处理过程多需要不同的应用程序或者软件来完成，存在效率较低以及功能性较弱的问题，实现了基于浏览器对待编辑音视频数据进行插件化编辑的效果，简化了音视频编辑处理流程，并且，引入音视频编辑插件可以使目标音频路由实现可扩展化，进一步提升了用户体验。
附图说明
结合附图并参考以下具体实施方式，本公开各实施例的上述和其他特征、优点及方面将变得更加明显。贯穿附图中，相同或相似的附图标记表示相同或相似的元素。应当理解附图是示意性的，原件和元素不一定按照比例绘制。
图1是本公开实施例所提供的一种音视频编辑方法流程示意图；
图2是本公开实施例所提供的插件管理模块的结构示意图；
图3是本公开实施例所提供的一种音视频编辑方法流程示意图；
图4是本公开实施例所提供的一种音视频编辑方法流程示意图；
图5是本公开实施例所提供的一种音视频编辑方法流程示意图；
图6是本公开实施例所提供的一种音视频编辑装置结构示意图；
图7是本公开实施例所提供的一种电子设备的结构示意图。
具体实施方式
下面将参照附图更详细地描述本公开的实施例。虽然附图中显示了本公开的某些实施例，然而应当理解的是，本公开可以通过各种形式来实现，而且不应该被解释为限于这里阐述的实施例，相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是，本公开的附图及实施例仅用于示例性作用，并非用于限制本公开的保护范围。
应当理解，本公开的方法实施方式中记载的各个步骤可以按照不同的顺序执行，和/或并行执行。此外，方法实施方式可以包括附加的步骤和/或省略执行示出的步骤。本公开的范围在此方面不受限制。
本文使用的术语“包括”及其变形是开放性包括，即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”；术语“另一实施例”表示“至少一个另外的实施例”；术语“一些实施例”表示“至少一些实施例”。其他术语的相关定义将在下文描述中给出。
需要注意，本公开中提及的“第一”、“第二”等概念仅用于对不同的装置、模块或单元进行区分，并非用于限定这些装置、模块或单元所执行的功能的顺序或者相互依存关系。
需要注意，本公开中提及的“一个”、“多个”的修饰是示意性而非限制性的，本领域技术人员应当理解，除非在上下文另有明确指出，否则应该理解为“一个或多个”。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
可以理解的是，在使用本公开各实施例公开的技术方案之前，均应当依据相关法律法规通过恰当的方式对本公开所涉及个人信息的类型、使用范围、使用场景等告知用户并获得用户的授权。
例如，在响应于接收到用户的主动请求时，向用户发送提示信息，以明确地提示用户，其请求执行的操作将需要获取和使用到用户的个人信息。从而，使得用户可以根据提示信息来自主地选择是否向执行本公开技术方案的操作的电子设备、应用程序、服务器或存储介质等软件或硬件提供个人信息。
作为一种可选的但非限定性的实现方式，响应于接收到用户的主动请求，向用户发送提示信息的方式例如可以是弹窗的方式，弹窗中可以以文字的方式呈现提示信息。此外，弹窗中还可以承载供用户选择“同意”或者“不同意”向电子设备提供个人信息的选择控件。
可以理解的是，上述通知和获取用户授权过程仅是示意性的，不对本公开的实现方式构成限定，其它满足相关法律法规的方式也可应用于本公开的实现方式中。
可以理解的是，本技术方案所涉及的数据(包括但不限于数据本身、数据的获取或使用)应当遵循相应法律法规及相关规定的要求。
在介绍本技术方案之前，可以先对应用场景进行示例性说明。可以将本公开实施例的技术方案应用在任意音视频数据进行编辑处理的场景中，示例性的，基于浏览器的显示界面可以在待编辑音视频数据进行显示，当检测到对待编辑音视频数据的触发操作时，即可从预先构建的每个待使用音视频编辑插件中确 定目标音视频编辑插件，以基于目标音视频编辑插件对待编辑音视频数据进行编辑，同时，创建目标音频路由，以在得到目标音视频数据后，基于目标音频路由播放目标音视频数据，从而可以在浏览器显示界面实现待编辑音视频数据的编辑处理以及播放过程，达到了简化音视频数据编辑处理流程的效果。
图1是本公开实施例所提供的一种音视频编辑方法流程示意图，本公开实施例适用于基于预先构建的目标音视频编辑插件对待编辑音视频数据进行编辑处理，并对编辑处理后得到的目标音视频数据进行播放的情形，该方法可以由音视频编辑装置来执行，该装置可以通过软件和/或硬件的形式实现，可选的，通过电子设备来实现，该电子设备可以是移动终端、PC端或服务器等。本公开实施例所提供的技术方案可以基于客户端执行，也可以基于服务端执行，还可以基于客户端和服务端配合执行。
如图1所示，所述方法包括：
S110、当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件。
其中，待编辑音视频数据可以为存储声音内容以及图像内容的多媒体数据流，同时，此数据流中的所存储的声音内容以及图像内容可以是用户当前需要编辑的声音信息以及图像信息。待编辑音视频数据也可以是需要对其进行再次编辑的数据流，例如，再次编辑可以包括：音视频数据存储、裁剪、播放控制、混响以及滤波等。示例性的，待编辑音视频数据可以为任意需要编辑的音频影像片段。在实际应用过程中，可以将多个音视频数据上传至***中，并且可以在这些音视频数据中的任意区域设置播放触发控件，当检测到对任一音视频数据的播放触发控件的触发操作时，可以将此音视频数据作为待编辑音视频数据， 并获取每个待使用音视频编辑插件。
其中，待使用音视频编辑插件可以为能够对音视频数据进行编辑处理的功能性插件。示例性的，待使用音视频编辑插件可以包括降噪编辑插件、音量编辑插件、热键编辑插件、混响编辑插件、导出编辑插件以及淡入淡出插件等。
可选的，待使用音视频编辑插件中包括多个钩子文件，钩子文件中包括对待编辑音视频数据进行编辑的功能文件。
在本实施例中，钩子文件可以为用于执行音视频编辑操作的文件。可选的，钩子文件可以包括但不限于播放待编辑音视频数据钩子文件(play)、播放音轨钩子文件(play Track)、播放片段钩子文件(play Clip)、停止播放钩子文件(stop)、内容更改钩子文件(content Change)、选区更改钩子文件(selection Change)以及待编辑音视频数据销毁钩子文件(destory)等。需要说明的是，待使用音视频编辑插件中的钩子可以基于开发者需求进行确定，并且，在后续应用过程中，还可以随时将新生成的钩子文件发送至每个待使用音视频编辑插件中。这样设置的好处在于：可以实现目标音频路由中录音模块的创建，扩展了目标音频路由，并且，可以实现多种音频编辑处理的效果。
示例性的，可以结合图2对包含待使用音视频编辑插件的插件***架构进行说明：插件***的包含关系可以为音频编辑器包括插件管理模块，插件管理模块包含至少一个待使用音视频编辑插件，其中，每个待使用音视频编辑插件中均包含多个钩子文件。待使用音视频编辑插件中所包含的钩子文件可以包括播放待编辑音视频数据钩子文件、播放音轨钩子文件、播放片段钩子文件、停止播放钩子文件、内容更改钩子文件、选区更改钩子文件以及待编辑音视频数据销毁钩子文件。
其中，播放待编辑音视频数据钩子文件可以在检测到待编辑音视频数据的触发操作时触发一次；播放音轨钩子文件可以在播放待编辑音视频数据时，当检测到对待编辑音视频数据中任一音轨数据的触发操作时触发一次，通过触发此钩子文件可以获取网页音频接口上下文、音轨数据以及目标音频路由的连接方法；播放片段钩子文件可以在播放待编辑音视频数据时，当检测到对待编辑音视频数据中任一音频片段数据的触发操作时触发一次，通过触发此钩子文件，可以获取网页音频接口上下文、音轨数据以及目标音频路由的连接方法；停止播放钩子文件可以在检测到停止播放操作时触发一次；内容更改钩子文件可以在音视频状态管理数据发生变化时触发一次；选区更改钩子文件可以在待编辑音视频数据的待编辑区域发生变化时触发一次；待编辑音视频数据销毁钩子文件可以在音频编辑器销毁时触发一次。
在实际应用过程中，可以在前期开发阶段，将待使用音视频编辑插件预先存储在***插件库中，当检测到用户触发待编辑音视频数据的播放控件时，可以直接从插件库中调取每个待使用音视频编辑插件。
需要说明的是，插件库中的待使用音视频编辑插件是处于动态更新状态的，当在后续应用过程中，基于用户需求开发出其他音视频编辑插件时，可以将这些后续开发的音视频编辑插件作为待使用音视频编辑插件更新至插件库中，以在后续检测到对待编辑音视频数据的编辑操作时，可以对每个待使用音视频编辑插件进行调取。
还需要说明的是，待使用音视频编辑插件的数量以及所能实现的功能可以基于实际需求进行设定，即每个待使用音视频插件均可以对应插件管理***，且此插件管理***是可扩展的，可以随时对插件管理***中的每个待使用音视 频编辑插件进行更新。
在具体实施中，当用户要对任一待编辑音视频进行编辑处理时，可以对此待编辑音视频数据的播放触发控件输入触发操作，当检测到触发播放待编辑音视频数据时，可以获取每个待使用音视频编辑插件，以基于每个待使用音视频编辑插件对待编辑音视频数据进行处理。
S120、根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件。
在本实施例中，音视频状态管理数据可以用于表征待编辑音视频数据在编辑处理过程中的所有数据表达。音视频状态管理数据中可以包含对待编辑音视频数据进行编辑处理所应用到的全部数据。可选的，音视频状态管理数据可以包括音轨数据、音频数据、音频效果参数、音频元信息以及全局配置数据等。示例性的，音视频状态管理数据可以通过JSON表示。目标音视频编辑插件可以为对待编辑音视频数据进行编辑处理的插件。需要说明的是，目标音视频编辑插件可以为各待使用音视频编辑插件中的一个插件，也可以为各待使用音视频编辑插件中的多个插件。
在实际应用中，可以基于对待编辑音视频数据的编辑处理操作，生成相对应的音视频状态管理数据，在打开音视频编辑处理界面时，可以将预先生成的音视频状态管理数据发送至音视频编辑***中，以在检测到用户对待编辑音视频数据的播放触发操作时，可以根据音视频状态管理数据，确定对待编辑音视频数据所要执行的编辑处理操作。
在实际应用过程中，当在每个待使用音视频编辑插件中确定目标音视频编辑插件时，可以根据音视频状态管理数据，对各待使用音视频编辑插件进行遍 历，当检测到音视频状态管理数据中包含与至少一个待使用音视频编辑插件相对应的字段时，则可以将这些待使用音视频编辑插件作为目标音视频编辑插件。
可选的，根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件，包括：基于音视频状态管理数据确定音轨数量，并依次调用相应的音轨数据；基于音轨数据和音视频状态管理数据中至少一个音视频编辑特征数据所对应的数据集合；对于各待使用音视频编辑插件，若当前待使用音视频编辑插件中包括数据集合中的音视频编辑特征数据，则确定当前待使用音视频编辑插件为目标音视频编辑插件。
本领域技术人员应当理解，音轨即为音频编辑软件中所显示的一条一条的平行“轨道”。每条音轨分别定义了该条音轨的属性，如音轨的音色、音色库、通道数、输入/输出端口以及音量等。相应的，音轨数据可以为用于表征音轨属性的数据。可选的，音轨数据可以用于描述音轨的细节、位置以及播放时长等。音视频编辑特征数据可以为用于表征音视频编辑属性的数据。
在具体实施中，在获取每个待使用音视频编辑插件之后，为了可以在每个待使用音视频编辑插件中确定目标音视频编辑插件，可以对预先接收的音视频状态管理数据进行解析处理，根据音视频状态管理数据，确定音轨数量，并对各音轨数据进行依次调用，进一步的，在音视频状态管理数据中确定与至少一个音视频编辑特征数据相对应的数据集合，并根据各音频数据以及各数据集合对每个待使用音视频编辑插件进行遍历，对于各待使用音视频编辑插件，若在当前待使用音视频编辑插件中检测到与各数据集合中的音视频编辑特征数据相匹配的数据时，则可以将当前音视频编辑插件作为目标音视频编辑插件。这样设置的好处在于：可以在多个待使用音视频编辑插件中确定与音视频状态管理 数据相对应的目标音视频编辑插件，从而可以实现基于用户需求对待编辑音视频数据进行编辑处理的效果。
S130、基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据。
其中，功能模块可以为数据说明、可执行语句等程序元素的集合。在本实施例中，功能模块可以为包含目标音视频编辑插件所能实现的具体功能的执行语句以及数据的集合。需要说明的是，不同的目标音视频编辑插件所能实现的音视频编辑功能是不一样，因此，各目标音视频编辑插件中所集成的功能模块中所包含的数据文件也是不同的；并且，在实际应用过程中，目标音视频编辑插件中集成的功能模块是可以动态调整的，可以在每次编辑过程中基于用户当前需求，确定目标音视频编辑插件中具体包括哪些功能模块。
在本实施例中，目标音视频数据可以为存储声音内容和图像内容的多媒体数据流，同时，此数据流中所存储的声音内容可以是满足用户当前需求的声音信息。
在实际应用过程中，在确定目标音视频编辑插件后，即可确定目标音视频编辑插件中集成的功能模块，以基于功能模块中所包含的音视频编辑执行语句对待编辑音视频数据进行编辑处理，以使待编辑音视频数据可以编辑处理成满足用户当前需求的音视频数据，此时，可以将编辑处理后得到的音视频数据作为目标音视频数据。示例性的，若目标音视频插件为音量编辑插件，且其集成的功能模块中所包含的编辑数据为将音量调整至“1”，则最终得到的目标音视频数据即为将待编辑音视频数据的音量调整至“1”的音视频数据。
需要说明的是，在基于目标音视频编辑插件中所集成的功能模块对待编辑 音视频数据进行编辑处理时，当目标音视频插件为多个时，则可以对各目标音视频编辑插件进行遍历处理，同时，由于待编辑音视频数据在编辑处理结束，得到目标音视频数据后，是要基于终端设备进行播放，为了可以实现目标音视频数据的播放功能，在各目标音视频编辑插件对待编辑音视频数据进行处理结束后，均会生成相对应的目标音频路由，以基于目标音频路由对目标音视频数据进行播放。还需说明的是，为了实现基于目标音频路由对目标音视频数据进行播放的功能，还可以创建既包含输入、又包含输出的音频处理模块，以使目标音视频数据与其对应的播放终端连接起来，从而实现播放。
基于此，在确定目标音视频编辑插件，并基于目标音视频编辑插件对待编辑音视频数据编辑处理的过程中，还包括：创建录音模块以连接到目标音频路由。
在本实施例中，录音模块可以为处理音视频数据，并可实现将处理后的音视频数据进行播放的模块。目标音频路由可以为由链接在一起的音频模块所构建的音频处理图。目标音频路由中可以包含多个模块，可选的，可以包含数据源模块、录音模块以及目的地模块等。目标音频路由可以控制其所包含的模块的创建，以及音频处理或数据流解码的执行等。
在实际应用过程中，在基于目标音视频编辑插件对待编辑音视频数据进行编辑处理的过程中，为了可以将处理之后的待编辑音视频数据连接至播放终端进行播放，可以创建相对应的录音模块，并将录音模块连接至目标音频路由中，以使处理后的待编辑音视频数据可以在输出后连接到一个预先确定的目的地中。这样设置的好处在于：可以实现目标音频路由的构建，从而可以基于构建好的目标音频路由对目标音视频数据进行播放，实现了目标音视频数据的播放功能。
S140、基于目标音频路由播放目标音视频数据。
在本实施例中，在得到目标音视频数据后，即可根据目标音频路由中依次连接的各个模块，播放目标音视频数据。
需要说明的是，若目标音视频编辑插件为多个时，则基于各目标音视频编辑插件对待编辑音视频数据进行编辑处理结束后，均会生成相对应的目标音频路由，但是，当基于目标音频路由对目标音视频数据进行播放时，则可以在各目标音频路由中确定最终播放目标音视频数据的目标音频路由，从而可以基于确定的目标音频路由播放目标音视频数据。
基于此，在上述各技术方案的基础上，还包括：将最后一个目标音视频编辑插件所对应的目标音频路由作为最终播放目标音视频数据的目标音频路由。
在实际应用过程中，在经过多个目标音视频编辑插件对待编辑音视频数据进行编辑处理后，均会生成与各目标音视频插件相对应的目标音频路由，当在将全部目标音视频编辑插件遍历完成后，即可将最后一个目标音视频编辑插件所对应的目标音频路由作为最终播放目标音视频数据的目标音频路由，以使此目标音频路由可以对目标音视频数据进行播放。这样设置的好处在于：可以实现目标音视频数据的播放功能，并且，可以实现音视频数据编辑过程的可视化。
需要说明的是，本实施所提供的音视频编辑处理***中还可以包括选区管理模块(Selection Manager)以及剪切板管理模块(Clopboard Manager)，其中，在Selection Manager中，可以通过秒来描述Selection，通过选区可以对待编辑音视频数据进行删除、复制等操作；在Clopboard Manager提供了剪切板，可以对待编辑音视频数据进行相应的操作，同时也依赖于Selection Manager。
示例性的，可以结合图3对音视频编辑方法的具体执行流程进行说明。
如图3所示，当检测到待编辑音视频数据的播放操作时，可以获取每个待使用音视频编辑插件；基于插件管理模块对每个待使用音视频编辑编辑插件进行遍历；根据音视频状态管理数据中的音轨(Track)数量，依次调用play Track，并上传相应的音轨数据，即音轨1和音轨2；基于音轨数据，以及音视频状态管理数据中的音视频编辑特征数据(Attributes)，从每个待使用音视频编辑插件中确定目标音视频插件为降噪编辑插件和音量编辑插件，并创建相应的录音模块(Audio node)连接至目标音频路由(Audio Routing Graph)中；根据音频状态管理数据中的音频片段(Clip)数量，依次调用play Clip，并上传相应的音频片段数据，即音轨1包括音频片段1、音频片段2以及音频片段3，音轨2包括音频片段1；基于音频片段数据，以及音视频状态管理数据中的音视频编辑特征数据(Attributes)，从每个待使用音视频编辑插件中确定目标音视频插件为降噪编辑插件和音量编辑插件，并创建相应的录音模块(Audio node)连接至目标音频路由(Audio Routing Graph)中；当对每个目标音视频编辑插件遍历结束后，即可根据最后一个目标音视频编辑插件所对应的目标音频路由(Audio Routing Graph)对目标音视频数据进行播放。
本公开实施例的技术方案，当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件，然后，根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件，进一步的，基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据，最后，基于目标音频路由播放目标音视频数据，解决了现有技术中编辑处理过程多需要不同的应用程序或者软件来完成，存在效率较低以及功能性较弱的问题，实现了基于浏览器对待编辑音视频数据进行插件化 编辑的效果，简化了音视频编辑处理流程，并且，引入音视频编辑插件可以使目标音频路由实现可扩展化，进一步提升了用户体验。
图4是本公开实施例所提供的一种音视频编辑方法流程示意图，在前述实施例的基础上，可以在上传的各待处理音视频数据中确定待编辑音视频数据，并获取音视频状态管理数据，以基于音视频状态管理数据对待编辑音视频数据进行编辑处理，其具体的实施方式可以参见本实施例技术方案。其中，与上述实施例相同或者相应的技术术语在此不再赘述。
如图4所示，该方法具体包括如下步骤：
S210、接收上传的至少一个待处理音视频数据，以基于至少一个待处理音视频数据确定待编辑音视频数据。
在本实施例中，待处理音视频数据可以为当前需要处理并上传至音视频编辑***中的音视频数据。待处理音视频数据可以为一个或多个，当待处理音视频数据为一个时，即可将此待处理音视频数据作为待编辑音视频数据；当待处理音视频数据为多个时，则可以基于用户需求，在多个待处理音视频数据中确定待编辑音视频数据。
需要说明的是，可以实时或周期性的将需要处理的音视频数据上传至***中，从而可以基于已上传的待处理音视频数据确定待编辑音视频数据。
在实际应用过程中，可以将需要进行编辑处理的待处理音视频数据上传至***中，并将已上传的各待处理音视频数据存储在数据库中，当检测到对各待处理音视频数据的编辑触发操作时，可以将各待处理音视频数据通过列表或其他展示形式展示在显示界面中，以使用户可以在各待处理音视频编辑数据中进 行挑选，以确定待编辑音视频数据。还有一种实现方式可以为：在将已上传的各待处理音视频数据存储至数据库之后，可以在显示界面中显示的搜索框中输入音视频数据筛选条件，以基于用户输入的筛选条件对各待处理音视频数据进行筛选，此时，可以将筛选结果显示界面中显示的待处理音视频数据作为待编辑音视频数据。
S220、获取音视频状态管理数据，以基于音视频状态管理数据对至少一个待编辑音视频数据进行编辑处理。
在本实施例中，在将各待处理音视频数据上传至***之后，为了可以确定待编辑音视频数据在整个编辑处理过程中的全部数据表达，还可以在对各待编辑音视频数据进行编辑处理之前，获取音视频状态管理数据，以基于音视频状态管理数据中所包含的至少一个音视频编辑特征数据，确定目标音视频编辑插件，从而可以基于目标音视频编辑插件对待编辑音视频数据进行编辑处理。
可选的，获取音视频状态管理数据，包括：获取与状态对象所对应的至少一个音视频编辑特征数据，并基于至少一个音视频编辑特征数据更新音视频状态管理数据。
其中，状态对象可以为有实例变量的对象，可以保存数据，是非线程安全的。在本实施例中，状态对象中可以存储音视频编辑特征数据，并且，各音视频编辑特征数据是可以随时可读、可写的。
在实际应用过程中，在确定音视频状态管理数据时，可以首先获取与状态对象相对应的至少一个音视频编辑特征数据，进而，根据各音视频编辑特征数据对音视频状态管理数据进行更新，以使音视频状态管理数据中可以包含音视频编辑过程中的各项属性特征，从而，可以基于音视频状态管理数据，确定对 待编辑音视频数据进行编辑处理的目标音视频编辑插件。这样设置的好处在于：可以确定音视频编辑处理过程中所要实现的编辑功能，从而可以实现目标音视频编辑插件的选取。
需要说明的是，音视频状态管理数据中还包括音频的各项属性特征数据，这些数据可以基于用户需求进行设置。
需要说明的是，音视频状态管理数据中包含待编辑音视频数据在编辑处理过程中的全部数据，当用户对待编辑音视频数据存在编辑需求时，则可以通过对音视频状态管理数据进行更改，以基于更改后的音视频状态管理数据对待编辑音视频数据进行编辑处理来实现，同时，每当音视频状态管理数据发生变化时，用于对目标音视频数据进行播放的目标音频路由也会发生相应的变化。
基于此，在上述各技术方案的基础上，还包括：当检测到音视频状态管理数据发生变化时，基于音频管理模块遍历待编辑音视频数据，以基于更新后的音视频状态管理数据对待编辑音视频数据编辑处理。
其中，音频管理模块可以为用于音视频数据进行管理的数据集合。
在实际应用中，当检测到音视频状态管理数据发生变化时，则可以实现音频管理模块的触发，进而，音频管理模块可以根据变化后的音视频状态管理数据，对待编辑音视频数据中的所有音频片段进行遍历，并重新创建目标音频路由中所连接的各个模块，从而基于重新创建的目标音频路由实现更新后的音视频状态管理数据与音频编辑***之间的映射关系。这样设置的好处在于：简化了待编辑音视频数据的编辑处理流程，提高了编辑处理效率，并且，可以随时对编辑处理流程进行更改，提升了用户体验。
还需说明的是，在实际编辑处理过程中，会遇到想要对当前执行的编辑操 作进行撤销，并恢复至编辑之前的状态的情况，此时，则可以创建用于存储每次编辑操作数据的历史管理模块，从而可以在检测到撤销操作时，可以从该模块中调取用户所需的数据。
在上述各技术方案的基础上，还包括：在确定音视频状态管理数据之后，将音视频状态管理数据保存至历史管理模块中，以在接收到对待编辑音视频数据所对应的撤销或回退编辑指令时，从历史管理模块中调取相应的音视频状态管理数据对待编辑音视频数据编辑处理。
在本实施例中，历史管理模块可以为用于存储编辑处理过程中各个编辑处理操作所对应的数据的集合。撤销或回退编辑指令可以为一段预先编写的程序代码，该程序代码可以用于执行撤销或回退操作。在实际应用过程中，可以预先在音视频编辑界面中的任意区域设置撤销或回退控件，当检测到用户对撤销或回退控件的触发操作时，即可生成撤销或回退编辑指令，并发送至服务器，以使服务器在接收到撤销或回退编辑指令时，可以对其进行响应。
在具体实施中，在确定音视频状态管理数据之后，可以将音视频状态管理数据存储至历史管理模块中，并且，每当检测到音视频状态管理数据发生变化时，均可以将变化后的音视频状态管理数据存储至历史管理模块中，同时，不会将之前存储在历史管理模块中的音视频状态管理数据删除。
进一步的，当检测到用户对预习设置的撤销或回退控件的触发操作时，即可生成撤销或回退编辑指令，并发送至服务器中，当服务器接收到撤销或回退编辑指令时，即可从历史管理模块中调取相应的音视频状态管理数据，以基于调取得到的音视频状态管理数据对待编辑音视频数据进行再次编辑处理。这样设置的好处在于：可以实现历史编辑处理操作数据的存储，便于后续可以对其 进行随时调用，并且，当出现故障问题时，可以基于预先存储的音视频状态管理数据进行故障排查。
需要说明的是，由于每当音视频状态管理数据发生变化时，均要存储至历史管理模块中，以使历史管理模块中保存着多种状态下的音视频状态管理数据，并且，撤销或回退编辑操作是将当前时刻的编辑处理操作撤销，使待编辑音视频数据回退至编辑之前的状态，此时，若要在历史管理模块中调取音视频状态管理数据时，则可以在与待编辑数据相对应的多个音视频状态管理数据中确定与此次撤销或回退编辑操作相对应的音视频状态管理数据，以基于调取后的音视频状态管理数据对待编辑音视频数据进行编辑处理。
基于此，在上述各技术方案的基础上，还包括：当检测到撤销或回退控件时，从历史管理模块中获取距离当前时刻间距最小的音视频状态管理数据，并复用音视频状态管理数据。
其中，当前时刻可以为撤销或回退控件的触发时刻。
在实际应用中，在将音视频状态管理数据保存至历史管理模块的同时，生成相应的时间戳，以使音视频状态管理数据以时间戳显示的时间顺序存储在历史管理模块中，当检测到撤销或回退控件的触发操作时，即可确定当前时刻，当从历史管理模块中调取相应的音视频状态管理数据时，可以根据当前时刻以及与各音视频状态管理数据相对应的时间戳，确定与当前时刻间距最小的音视频状态管理数据，并将此音视频状态管理数据作为与撤销或回退操作相对应的音视频状态管理数据，并再次基于此音视频状态管理数据对待编辑音视频数据进行编辑处理，以使待编辑音视频数据可以回退至用户所需的状态。这样设置的好处在于：可以在检测到撤销或回退操作时，快速调取相应的音视频状态管 理数据，从而可以快速实现撤销或回退功能。
S230、当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件。
S240、根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件。
S250、基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据。
S260、基于目标音频路由播放所述目标音视频数据。
示例性的，可以结合图5对本实施例所提供的音视频编辑方法的具体执行流程进行说明：1、对音频片段1(Clip 1)进行裁剪操作，并调用状态对象(State模块)中的clip.move方法；2、基于状态对象(State模块)中的clip.move处理移动逻辑；3、基于State模块，调用音视频状态管理数据模块(Voice Set)，将移动后的结果更新至Voice Set中；4、获取更新后的Voice Set，保存数据快照，并保存至历史管理模块(History Manager)；5、当Voice Set内容发生变化时，通知音频管理模块(Audio Manager)；6、基于Audio Manager，对音视频状态管理数据进行遍历，重新创建数据源模块(Web audio Source Node)，到此完成Voice Set与Web audio映射关系。
本公开实施例的技术方案，通过接收上传的至少一个待处理音视频数据，以基于至少一个待处理音视频数据确定待编辑音视频数据，然后，获取音视频状态管理数据，以基于音视频状态管理数据对至少一个待编辑音视频数据进行编辑处理，当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件，根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插 件，确定目标音视频编辑插件，基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据，基于目标音频路由播放所述目标音视频数据，实现了基于浏览器对待编辑音视频数据进行编辑处理的效果，并且，通过对音视频状态管理数据进行处理，以实现相应的编辑处理功能，提高了多维度音视频数据表达能力，达到了基于数据表达复杂编辑处理过程的效果。
图6是本公开实施例所提供的一种音视频编辑装置结构示意图，如图6所示，所述装置包括：音视频编辑插件获取模块310、目标音视频编辑插件确定模块320、待编辑音视频数据处理模块330以及目标视频确定模块340。
其中，音视频编辑插件获取模块310，用于当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
目标音视频编辑插件确定模块320，用于根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
待编辑音视频数据处理模块330，用于基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
目标音视频数据播放模块340，用于基于目标音频路由播放所述目标音视频数据。
在上述各技术方案的基础上，所述装置还包括：待处理音视频数据接收模块和音视频状态管理数据获取模块。
待处理音视频数据接收模块，用于在所述检测到触发播放待编辑音视频数 据之前，接收上传的至少一个待处理音视频数据，以基于所述至少一个待处理音视频数据确定待编辑音视频数据；
音视频状态管理数据获取模块，用于获取音视频状态管理数据，以基于所述音视频状态管理数据对所述至少一个待编辑音视频数据进行编辑处理。
在上述各技术方案的基础上，音视频状态管理数据获取模块包括；音视频状态管理数据获取单元。
音视频状态管理数据获取单元，用于获取与状态对象所对应的至少一个音视频编辑特征数据，并基于所述至少一个音视频编辑特征数据更新所述音视频状态管理数据。
在上述各技术方案的基础上，所述装置还包括：音视频状态管理数据保存模块。
音视频状态管理数据保存模块，用于在确定所述音视频状态管理数据之后，将所述音视频状态管理数据保存至历史管理模块中，以在接收到对待编辑音视频数据所对应的撤销或回退编辑指令时，从所述历史管理模块中调取相应的音视频状态管理数据对所述待编辑音视频数据编辑处理。
在上述各技术方案的基础上，所述装置还包括：音视频状态管理数据复用模块。
音视频状态管理数据复用模块，用于当检测到撤销或回退控件时，从所述历史管理模块中获取距离当前时刻间距最小的音视频状态管理数据，并复用所述音视频状态管理数据。
在上述各技术方案的基础上，所述装置还包括：待编辑音视频数据遍历模块。
待编辑音视频数据遍历模块，用于当检测到音视频状态管理数据发生变化时，基于音频管理模块遍历所述待编辑音视频数据，以基于更新后的音视频状态管理数据对所述待编辑音视频数据编辑处理。
在上述各技术方案的基础上，所述待使用音视频编辑插件中包括多个钩子文件，所述钩子文件中包括对待编辑音视频数据进行编辑的功能文件。
在上述各技术方案的基础上，目标音视频编辑插件确定模块320包括：音轨数据调用单元、数据集合基于单元以及目标音视频编辑插件确定单元。
音轨数据调用单元，用于基于所述音视频状态管理数据确定音轨数量，并依次调用相应的音轨数据；
数据集合基于单元，用于基于所述音轨数据和所述音视频状态管理数据中至少一个音视频编辑特征数据所对应的数据集合；
目标音视频编辑插件确定单元，用于对于各待使用音视频编辑插件，若当前待使用音视频编辑插件中包括所述数据集合中的音视频编辑特征数据，则确定所述当前待使用音视频编辑插件为所述目标音视频编辑插件。
在上述各技术方案的基础上，所述装置还包括：录音模块创建模块。
录音模块创建模块，用于在确定所述目标音视频编辑插件，并基于所述目标音视频编辑插件对所述待编辑音视频数据编辑处理的过程中，创建录音模块以连接到目标音频路由。
在上述各技术方案的基础上，所述装置还包括：目标音频路由确定模块。
目标音频路由确定模块，用于将最后一个目标音视频编辑插件所对应的目标音频路由作为最终播放所述目标音视频数据的目标音频路由。
本公开实施例的技术方案，当检测到触发播放待编辑音视频数据时，获取 每个待使用音视频编辑插件，然后，根据预先接收到的音视频状态管理数据以及每个待使用音视频编辑插件，确定目标音视频编辑插件，进一步的，基于目标音视频编辑插件中所集成的功能模块对待编辑音视频数据进行编辑处理，以得到目标音视频数据，最后，基于目标音频路由播放目标音视频数据，解决了现有技术中编辑处理过程多需要不同的应用程序或者软件来完成，存在效率较低以及功能性较弱的问题，实现了基于浏览器对待编辑音视频数据进行插件化编辑的效果，简化了音视频编辑处理流程，并且，引入音视频编辑插件可以使目标音频路由实现可扩展化，进一步提升了用户体验。
本公开实施例所提供的视频处理装置可执行本公开任意实施例所提供的音视频编辑方法，具备执行方法相应的功能模块和有益效果。
值得注意的是，上述装置所包括的各个单元和模块只是按照功能逻辑进行划分的，但并不局限于上述的划分，只要能够实现相应的功能即可；另外，各功能单元的具体名称也只是为了便于相互区分，并不用于限制本公开实施例的保护范围。
图7是本公开实施例所提供的一种电子设备的结构示意图。下面参考图7，其示出了适于用来实现本公开实施例的电子设备(例如图7中的终端设备或服务器)500的结构示意图。本公开实施例中的终端设备可以包括但不限于诸如移动电话、笔记本电脑、数字广播接收器、PDA(个人数字助理)、PAD(平板电脑)、PMP(便携式多媒体播放器)、车载终端(例如车载导航终端)等等的移动终端以及诸如数字TV、台式计算机等等的固定终端。图7示出的电子设备仅仅是一个示例，不应对本公开实施例的功能和使用范围带来任何限制。
如图7所示，电子设备500可以包括处理装置(例如中央处理器、图形处理器等)501，其可以根据存储在只读存储器(ROM)502中的程序或者从存储装置508加载到随机访问存储器(RAM)503中的程序而执行各种适当的动作和处理。在RAM 503中，还存储有电子设备500操作所需的各种程序和数据。处理装置501、ROM 502以及RAM 503通过总线504彼此相连。编辑/输出(I/O)接口505也连接至总线504。
通常，以下装置可以连接至I/O接口505：包括例如触摸屏、触摸板、键盘、鼠标、摄像头、麦克风、加速度计、陀螺仪等的输入装置506；包括例如液晶显示器(LCD)、扬声器、振动器等的输出装置507；包括例如磁带、硬盘等的存储装置508；以及通信装置509。通信装置509可以允许电子设备500与其他设备进行无线或有线通信以交换数据。虽然图7示出了具有各种装置的电子设备500，但是应理解的是，并不要求实施或具备所有示出的装置。可以替代地实施或具备更多或更少的装置。
特别地，根据本公开的实施例，上文参考流程图描述的过程可以被实现为计算机软件程序。例如，本公开的实施例包括一种计算机程序产品，其包括承载在非暂态计算机可读介质上的计算机程序，该计算机程序包含用于执行流程图所示的方法的程序代码。在这样的实施例中，该计算机程序可以通过通信装置509从网络上被下载和安装，或者从存储装置508被安装，或者从ROM 502被安装。在该计算机程序被处理装置501执行时，执行本公开实施例的方法中限定的上述功能。
本公开实施方式中的多个装置之间所交互的消息或者信息的名称仅用于说明性的目的，而并不是用于对这些消息或信息的范围进行限制。
本公开实施例提供的电子设备与上述实施例提供的音视频编辑方法属于同一发明构思，未在本实施例中详尽描述的技术细节可参见上述实施例，并且本实施例与上述实施例具有相同的有益效果。
本公开实施例提供了一种计算机存储介质，其上存储有计算机程序，该程序被处理器执行时实现上述实施例所提供的音视频编辑方法。
需要说明的是，本公开上述的计算机可读介质可以是计算机可读信号介质或者计算机可读存储介质或者是上述两者的任意组合。计算机可读存储介质例如可以是——但不限于——电、磁、光、电磁、红外线、或半导体的***、装置或器件，或者任意以上的组合。计算机可读存储介质的更具体的例子可以包括但不限于：具有一个或多个导线的电连接、便携式计算机磁盘、硬盘、随机访问存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑磁盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。在本公开中，计算机可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行***、装置或者器件使用或者与其结合使用。而在本公开中，计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了计算机可读的程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。计算机可读信号介质还可以是计算机可读存储介质以外的任何计算机可读介质，该计算机可读信号介质可以发送、传播或者传输用于由指令执行***、装置或者器件使用或者与其结合使用的程序。计算机可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于：电线、光缆、 RF(射频)等等，或者上述的任意合适的组合。
在一些实施方式中，客户端、服务器可以利用诸如HTTP(HyperText Transfer Protocol，超文本传输协议)之类的任何当前已知或未来研发的网络协议进行通信，并且可以与任意形式或介质的数字数据通信(例如，通信网络)互连。通信网络的示例包括局域网(“LAN”)，广域网(“WAN”)，网际网(例如，互联网)以及端对端网络(例如，ad hoc端对端网络)，以及任何当前已知或未来研发的网络。
上述计算机可读介质可以是上述电子设备中所包含的；也可以是单独存在，而未装配入该电子设备中。
上述计算机可读介质承载有一个或者多个程序，当上述一个或者多个程序被该电子设备执行时，使得该电子设备：
当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
基于目标音频路由播放所述目标音视频数据。
可以以一种或多种程序设计语言或其组合来编写用于执行本公开的操作的计算机程序代码，上述程序设计语言包括但不限于面向对象的程序设计语言—诸如Java、Smalltalk、C++，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算机上执行、部分地在用户计算机上执行、作为一个独立的软件包执行、部分在用户计算机上部分在 远程计算机上执行、或者完全在远程计算机或服务器上执行。在涉及远程计算机的情形中，远程计算机可以通过任意种类的网络——包括局域网(LAN)或广域网(WAN)—连接到用户计算机，或者，可以连接到外部计算机(例如利用因特网服务提供商来通过因特网连接)。
附图中的流程图和框图，图示了按照本公开各种实施例的***、方法和计算机程序产品的可能实现的体系架构、功能和操作。在这点上，流程图或框图中的每个方框可以代表一个模块、程序段、或代码的一部分，该模块、程序段、或代码的一部分包含一个或多个用于实现规定的逻辑功能的可执行指令。也应当注意，在有些作为替换的实现中，方框中所标注的功能也可以以不同于附图中所标注的顺序发生。例如，两个接连地表示的方框实际上可以基本并行地执行，它们有时也可以按相反的顺序执行，这依所涉及的功能而定。也要注意的是，框图和/或流程图中的每个方框、以及框图和/或流程图中的方框的组合，可以用执行规定的功能或操作的专用的基于硬件的***来实现，或者可以用专用硬件与计算机指令的组合来实现。
描述于本公开实施例中所涉及到的单元可以通过软件的方式实现，也可以通过硬件的方式来实现。其中，单元的名称在某种情况下并不构成对该单元本身的限定，例如，第一获取单元还可以被描述为“获取至少两个网际协议地址的单元”。
本文中以上描述的功能可以至少部分地由一个或多个硬件逻辑部件来执行。例如，非限制性地，可以使用的示范类型的硬件逻辑部件包括：现场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、片上***(SOC)、复杂可编程逻辑设备(CPLD)等等。
在本公开的上下文中，机器可读介质可以是有形的介质，其可以包含或存储以供指令执行***、装置或设备使用或与指令执行***、装置或设备结合地使用的程序。机器可读介质可以是机器可读信号介质或机器可读储存介质。机器可读介质可以包括但不限于电子的、磁性的、光学的、电磁的、红外的、或半导体***、装置或设备，或者上述内容的任何合适组合。机器可读存储介质的更具体示例会包括基于一个或多个线的电气连接、便携式计算机盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或快闪存储器)、光纤、便捷式紧凑盘只读存储器(CD-ROM)、光学储存设备、磁储存设备、或上述内容的任何合适组合。
根据本公开的一个或多个实施例，【示例一】提供了一种音视频编辑方法，该方法包括：
当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
基于目标音频路由播放所述目标音视频数据。
根据本公开的一个或多个实施例，【示例二】提供了一种音视频编辑方法，该方法，还包括：
可选的，接收上传的至少一个待处理音视频数据，以基于所述至少一个待处理音视频数据确定待编辑音视频数据；
获取音视频状态管理数据，以基于所述音视频状态管理数据对所述至少一个待编辑音视频数据进行编辑处理。
根据本公开的一个或多个实施例，【示例三】提供了一种音视频编辑方法，该方法，还包括：
可选的，获取与状态对象所对应的至少一个音视频编辑特征数据，并基于所述至少一个音频编辑特征数据更新所述音视频状态管理数据。
根据本公开的一个或多个实施例，【示例四】提供了一种音视频编辑方法，该方法，还包括：
可选的，在确定所述音视频状态管理数据之后，将所述音视频状态管理数据保存至历史管理模块中，以在接收到对待编辑音视频数据所对应的撤销或回退编辑指令时，从所述历史管理模块中调取相应的音视频状态管理数据对所述待编辑音视频数据编辑处理。
根据本公开的一个或多个实施例，【示例五】提供了一种音视频编辑方法，该方法，还包括：
可选的，当检测到撤销或回退控件时，从所述历史管理模块中获取距离当前时刻间距最小的音视频状态管理数据，并复用所述音视频状态管理数据。
根据本公开的一个或多个实施例，【示例六】提供了一种音视频编辑方法，该方法，还包括：
可选的，当检测到音视频状态管理数据发生变化时，基于音频管理模块遍历所述待编辑音视频数据，以基于更新后的音视频状态管理数据对所述待编辑音视频数据编辑处理。
根据本公开的一个或多个实施例，【示例七】提供了一种音视频编辑方法， 该方法，还包括：
可选的，所述待使用音视频编辑插件中包括多个钩子文件，所述钩子文件中包括对待编辑音视频数据进行编辑的功能文件。
根据本公开的一个或多个实施例，【示例八】提供了一种音视频编辑方法，该方法，还包括：
可选的，基于所述音视频状态管理数据确定音轨数量，并依次调用相应的音轨数据；
基于所述音轨数据和所述音视频状态管理数据中至少一个音视频编辑特征数据所对应的数据集合；
对于各待使用音视频编辑插件，若当前待使用音视频编辑插件中包括所述数据集和中的音视频编辑特征数据，则确定所述当前待使用音视频编辑插件为所述目标音视频编辑插件。
根据本公开的一个或多个实施例，【示例九】提供了一种音视频编辑方法，该方法，还包括：
可选的，在确定所述目标音视频编辑插件，并基于所述目标音视频编辑插件对所述待编辑音视频数据编辑处理的过程中，创建录音模块以连接到目标音频路由。
根据本公开的一个或多个实施例，【示例十】提供了一种音视频编辑方法，该方法，还包括：
可选的，将最后一个目标音视频编辑插件所对应的目标音频路由作为最终播放所述目标音视频数据的目标音频路由。
根据本公开的一个或多个实施例，【示例十一】提供了一种音视频编辑装置， 该装置包括：
音视频编辑插件获取模块，用于当检测到触发播放待编辑音视频数据时，获取各待使用音视频编辑插件；
目标音视频编辑插件确定模块，用于根据预先接收到的音视频状态管理数据以及各所述待使用音视频编辑插件，确定目标音视频编辑插件；
待编辑音视频数据处理模块，用于基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
目标音视频数据播放模块，用于基于目标音频路由播放所述目标音视频数据。
以上描述仅为本公开的较佳实施例以及对所运用技术原理的说明。本领域技术人员应当理解，本公开中所涉及的公开范围，并不限于上述技术特征的特定组合而成的技术方案，同时也应涵盖在不脱离上述公开构思的情况下，由上述技术特征或其等同特征进行任意组合而形成的其它技术方案。例如上述特征与本公开中公开的(但不限于)具有类似功能的技术特征进行互相替换而形成的技术方案。
此外，虽然采用特定次序描绘了各操作，但是这不应当理解为要求这些操作以所示出的特定次序或以顺序次序执行来执行。在一定环境下，多任务和并行处理可能是有利的。同样地，虽然在上面论述中包含了若干具体实现细节，但是这些不应当被解释为对本公开的范围的限制。在单独的实施例的上下文中描述的某些特征还可以组合地实现在单个实施例中。相反地，在单个实施例的上下文中描述的各种特征也可以单独地或以任何合适的子组合的方式实现在多 个实施例中。
尽管已经采用特定于结构特征和/或方法逻辑动作的语言描述了本主题，但是应当理解所附权利要求书中所限定的主题未必局限于上面描述的特定特征或动作。相反，上面所描述的特定特征和动作仅仅是实现权利要求书的示例形式。

Claims (14)

  1. 一种音视频编辑方法，包括：
    当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
    根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
    基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
    基于目标音频路由播放所述目标音视频数据。
  2. 根据权利要求1所述的方法，在所述检测到触发播放待编辑音视频数据之前，还包括：
    接收上传的至少一个待处理音视频数据，以基于所述至少一个待处理音视频数据确定待编辑音视频数据；
    获取音视频状态管理数据，以基于所述音视频状态管理数据对所述至少一个待编辑音视频数据进行编辑处理。
  3. 根据权利要求2所述的方法，其中，所述获取音视频状态管理数据，包括：
    获取与状态对象所对应的至少一个音视频编辑特征数据，并基于所述至少一个音视频编辑特征数据更新所述音视频状态管理数据。
  4. 根据权利要求2或3所述的方法，在确定所述音视频状态管理数据之后，还包括：
    将所述音视频状态管理数据保存至历史管理模块中，以在接收到对待编辑音视频数据所对应的撤销或回退编辑指令时，从所述历史管理模块中调取相应 的音视频状态管理数据对所述待编辑音视频数据编辑处理。
  5. 根据权利要求4所述的方法，还包括：
    当检测到撤销或回退控件时，从所述历史管理模块中获取距离当前时刻间距最小的音视频状态管理数据，并复用所述音视频状态管理数据。
  6. 根据权利要求1所述的方法，还包括：
    当检测到音视频状态管理数据发生变化时，基于音频管理模块遍历所述待编辑音视频数据，以基于更新后的音视频状态管理数据对所述待编辑音视频数据编辑处理。
  7. 根据权利要求1所述的方法，其中，所述待使用音视频编辑插件中包括多个钩子文件，所述钩子文件中包括对待编辑音视频数据进行编辑的功能文件。
  8. 根据权利要求1所述的方法，其中，所述根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件，包括：
    基于所述音视频状态管理数据确定音轨数量，并依次调用相应的音轨数据；
    基于所述音轨数据和所述音视频状态管理数据中至少一个音视频编辑特征数据所对应的数据集合；
    对于各待使用音视频编辑插件，若当前待使用音视频编辑插件中包括所述数据集合中的音视频编辑特征数据，则确定所述当前待使用音视频编辑插件为所述目标音视频编辑插件。
  9. 根据权利要求1所述的方法，在确定所述目标音视频编辑插件，并基于所述目标音视频编辑插件对所述待编辑音视频数据编辑处理的过程中，还包括：
    创建录音模块以连接到目标音频路由。
  10. 根据权利要求1所述的方法，还包括：
    将最后一个目标音视频编辑插件所对应的目标音频路由作为最终播放所述目标音视频数据的目标音频路由。
  11. 一种音视频编辑装置，其特征在于，包括：
    音视频编辑插件获取模块，用于当检测到触发播放待编辑音视频数据时，获取每个待使用音视频编辑插件；
    目标音视频编辑插件确定模块，用于根据预先接收到的音视频状态管理数据以及每个所述待使用音视频编辑插件，确定目标音视频编辑插件；
    待编辑音视频数据处理模块，用于基于所述目标音视频编辑插件中所集成的功能模块对所述待编辑音视频数据进行编辑处理，以得到目标音视频数据；
    目标音视频数据播放模块，用于基于目标音频路由播放所述目标音视频数据。
  12. 一种电子设备，包括：
    一个或多个处理器；
    存储装置，用于存储一个或多个程序，
    当所述一个或多个程序被所述一个或多个处理器执行，使得所述一个或多个处理器实现如权利要求1-10中任一所述的音视频编辑方法。
  13. 一种包含计算机可执行指令的存储介质，所述计算机可执行指令在由计算机处理器执行时用于执行如权利要求1-10中任一所述的音视频编辑方法。
  14. 一种包含计算机可执行指令的计算机程序产品，所述计算机可执行指令在由计算机处理器执行时用于执行如权利要求1-10中任一所述的音视频编辑方法。
PCT/CN2023/129024 2022-11-01 2023-11-01 音视频编辑方法、装置、电子设备及存储介质 WO2024094052A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202211358778.0 2022-11-01
CN202211358778.0A CN115691571A (zh) 2022-11-01 2022-11-01 音视频编辑方法、装置、电子设备及存储介质

Publications (1)

Publication Number Publication Date
WO2024094052A1 true WO2024094052A1 (zh) 2024-05-10

Family

ID=85048448

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/129024 WO2024094052A1 (zh) 2022-11-01 2023-11-01 音视频编辑方法、装置、电子设备及存储介质

Country Status (3)

Country Link
US (1) US20240144975A1 (zh)
CN (1) CN115691571A (zh)
WO (1) WO2024094052A1 (zh)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115691571A (zh) * 2022-11-01 2023-02-03 抖音视界有限公司 音视频编辑方法、装置、电子设备及存储介质

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9270964B1 (en) * 2013-06-24 2016-02-23 Google Inc. Extracting audio components of a portion of video to facilitate editing audio of the video
CN105957542A (zh) * 2016-04-25 2016-09-21 青岛海信移动通信技术股份有限公司 一种音频文件编辑方法及装置
CN113407275A (zh) * 2021-06-17 2021-09-17 广州繁星互娱信息科技有限公司 音频编辑方法、装置、设备及可读存储介质
CN114115659A (zh) * 2021-11-30 2022-03-01 珠海金山数字网络科技有限公司 音频编辑方法及装置
CN114138256A (zh) * 2021-12-03 2022-03-04 广东亿迅科技有限公司 一种Web端可视化开发方法、***及存储介质
US20220130427A1 (en) * 2020-10-28 2022-04-28 Facebook Technologies, Llc Text-driven editor for audio and video assembly
CN115129211A (zh) * 2022-04-24 2022-09-30 北京达佳互联信息技术有限公司 生成多媒体文件的方法、装置、电子设备及存储介质
CN115691571A (zh) * 2022-11-01 2023-02-03 抖音视界有限公司 音视频编辑方法、装置、电子设备及存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9270964B1 (en) * 2013-06-24 2016-02-23 Google Inc. Extracting audio components of a portion of video to facilitate editing audio of the video
CN105957542A (zh) * 2016-04-25 2016-09-21 青岛海信移动通信技术股份有限公司 一种音频文件编辑方法及装置
US20220130427A1 (en) * 2020-10-28 2022-04-28 Facebook Technologies, Llc Text-driven editor for audio and video assembly
CN113407275A (zh) * 2021-06-17 2021-09-17 广州繁星互娱信息科技有限公司 音频编辑方法、装置、设备及可读存储介质
CN114115659A (zh) * 2021-11-30 2022-03-01 珠海金山数字网络科技有限公司 音频编辑方法及装置
CN114138256A (zh) * 2021-12-03 2022-03-04 广东亿迅科技有限公司 一种Web端可视化开发方法、***及存储介质
CN115129211A (zh) * 2022-04-24 2022-09-30 北京达佳互联信息技术有限公司 生成多媒体文件的方法、装置、电子设备及存储介质
CN115691571A (zh) * 2022-11-01 2023-02-03 抖音视界有限公司 音视频编辑方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
US20240144975A1 (en) 2024-05-02
CN115691571A (zh) 2023-02-03

Similar Documents

Publication Publication Date Title
WO2020119485A1 (zh) 一种页面显示方法、装置、设备及存储介质
CN109582310B (zh) 数据处理方法、装置、电子设备及计算机可读存储介质
WO2024094052A1 (zh) 音视频编辑方法、装置、电子设备及存储介质
CN113038234B (zh) 视频的处理方法、装置、电子设备和存储介质
WO2020220773A1 (zh) 图片预览信息的显示方法、装置、电子设备及计算机可读存储介质
US20210286839A1 (en) File synchronization system
WO2020168878A1 (zh) 数据缓存方法、装置、终端及存储介质
WO2023051293A1 (zh) 一种音频处理方法、装置、电子设备和存储介质
US20240152690A1 (en) Document processing method and apparatus, and device and medium
WO2022227859A1 (zh) 信息显示方法、装置、设备及存储介质
WO2022184077A1 (zh) 文档编辑的方法、装置、终端及非暂时性存储介质
WO2020147522A1 (zh) 用于处理音频的方法和装置
CN115510832A (zh) 信息同步处理方法、***、装置、电子设备和存储介质
WO2024099348A1 (zh) 音频特效的编辑方法、装置、设备及存储介质
CN113722326A (zh) 一种数据处理方法、装置、电子设备和介质
CN115996179A (zh) 业务节点的测试方法、装置、可读介质和电子设备
CN113050890A (zh) 一种数据迁移方法和装置
CN111290861A (zh) 消息处理方法、装置及电子设备
CN115470754A (zh) 数据分析方法、装置、计算机可读介质及电子设备
CN116360710B (zh) 应用于服务器集群的数据存储方法、电子设备和可读介质
CN118041813B (zh) 信号测试脚本数据构建方法、装置、电子设备与可读介质
CN112688793A (zh) 数据包获取方法、装置及电子设备
WO2023241283A1 (zh) 用于视频编辑的方法及设备
CN117555573B (zh) 芯片烧录信息同步方法、电子设备和计算机可读介质
WO2023143197A1 (zh) 组合图形控件的生成方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23884978

Country of ref document: EP

Kind code of ref document: A1