WO2020198793A1 - Media management system - Google Patents
Media management system Download PDFInfo
- Publication number
- WO2020198793A1 WO2020198793A1 PCT/AU2020/050322 AU2020050322W WO2020198793A1 WO 2020198793 A1 WO2020198793 A1 WO 2020198793A1 AU 2020050322 W AU2020050322 W AU 2020050322W WO 2020198793 A1 WO2020198793 A1 WO 2020198793A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- media
- elements
- media element
- timeline
- media elements
- Prior art date
Links
- 238000000034 method Methods 0.000 claims description 25
- 239000000470 constituent Substances 0.000 description 17
- 238000004891 communication Methods 0.000 description 9
- 238000007726 management method Methods 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 4
- 230000004044 response Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 238000005201 scrubbing Methods 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000009966 trimming Methods 0.000 description 2
- 239000000654 additive Substances 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000000717 retained effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
- G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
- G11B27/036—Insert-editing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/005—Reproducing at a different information rate from the information rate of recording
-
- G—PHYSICS
- G11—INFORMATION STORAGE
- G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
- G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
- G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
- G11B27/34—Indicating arrangements
Definitions
- the present invention relates generally to video editing software applications. More specifically, the present invention relates to a media management system for video editing software applications that, at least in preferred embodiments, provides users with a more efficient workflow environment.
- Film and/or video productions are created on video editing systems typically by assembling the project from a collection of constituent elements.
- Video editing systems allow these constituent elements-which include video clips, audiovisual clips, audio clips and associated metadata-to be separately imported and edited before being merged into the final production.
- Modern video editing systems (and particularly those used professionally in the film and television industry) include sophisticated video editing software applications.
- the Applicant’s video editing system known as DaVinci Resolve® is an example of a modern video editing system that is extensively used in the professional environment. The total functionality of DaVinci Resolve® is divided into a number of separate pages (each having their own graphical user interface) that are organized in the order of a typical workflow.
- the DaVinci Resolve® pages include: Media (for media management and clip organization); Edit (a non-linear video editor); Color (for color correction and grading); Sound (a digital audio workstation) and Delivery (for final rendering or output).
- the user interface of the Edit page of Davinci Resolve® includes a timeline that is a graphical representation of the project being edited.
- the timeline includes a plurality of linearly spaced timecode markings that extend typically in a horizontal direction along the length of the user interface window.
- the timeline allows the consistent elements of the project to be arranged into the desired temporal order by alignment with the timeline’s temporal markings.
- elements can be edited by launching editing tools to perform operations such as trimming, splitting, inserting, merging and moving of clips to a desired location.
- the present invention aims to provide a media management system for a video editing system that, at least in preferred embodiments, provides users with a more optimized video editing workflow environment
- a software product including a computer readable medium storing instructions which when executed by a processor: displays a graphical user interface for a video editing system, the user interface including: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; a timeline; and a concatenator element; and responsive to a user actuating the concatenator element, concatenates the media elements present in the media bin together into a single media element and loads the single media element into the viewing window.
- the speed of playback of the single media element is varied by reference to a property of the media elements comprising the single media element.
- the property may be the durations of the single media elements.
- the playback speed of media elements of a duration above a threshold value can be increased.
- the instructions responsive to a user input, inserts one of the media elements into the timeline.
- This inserted media element inserted is usually the media element that corresponds to the part of the single media element currently being viewed in the viewing window.
- the graphical user interface may further include a defining object that is configured, responsive to a user input, to: define a start point and an end point for a media element being viewed in the viewing window; create a media element from the defined start and end points; and insert the created media element into the timeline.
- a defining object that is configured, responsive to a user input, to: define a start point and an end point for a media element being viewed in the viewing window; create a media element from the defined start and end points; and insert the created media element into the timeline.
- a method for providing a graphical user interface for a video editing system comprising: displaying a graphical user interface including: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; a timeline; and a concatenator element; and responsive to a user actuating the concatenator element, concatenating the media elements present in the media bin together into a single media element and loading the single media element into the viewing window.
- the speed of playback of the single media element is varied by reference to a property of the individual media elements comprising the single media element. This can be the duration of the single media elements.
- the playback speed of media elements of a duration above a threshold value can be increased.
- the method includes, responsive to a user input, inserting one of the media elements into the timeline.
- This inserted media element can be the media element that corresponds to the part of the single media element currently being viewed in the viewing window.
- the graphical user interface can further include a defining object that is configured, responsive to a user input, to: define a start point and an end point for a media element being viewed in the viewing window; create a media element from the defined start and end points; and insert the created media element into the timeline.
- a method of playing a media file comprising a plurality of component files each having defined properties, the method including the step of varying the playback speed by reference to one or more of the properties of the component files.
- the property may be the durations of the component files.
- the playback speed of media elements of a duration above a threshold value is increased.
- Figure 1 is an illustration of a first view of a user interface according to an embodiment of the present invention.
- Figure 2 is a schematic illustration of a hardware environment suitable for implementing the graphical user interface in accordance with an embodiment of the present invention.
- a user interface 100 for a video editing software application is shown in Figure 1.
- the video editing software allows for the creation of projects from constituent media elements that are imported into the video editing software application and displayed in a media bin area 101.
- the user has imported twelve constituent media elements in the project, six of which are shown in Figure 1.
- the remaining media elements can be made viewable by operating the scroll bar located on the right hand side of the media bin area.
- the six visible constituent elements comprise an audio track 102A and five audio-visual clips 102B-102F (namely video clips each with a recorded audio track).
- the video editing software application also stores and manages metadata for each constituent element, as well as for the overall project.
- User interface 100 also includes a viewer window 1 10 for viewing a selected video or audio-visual clip, a first timeline 120 and second timeline 140 lying parallel and above first timeline 120.
- a viewer window 1 10 for viewing a selected video or audio-visual clip
- first timeline 120 and second timeline 140 lying parallel and above first timeline 120.
- Timelines 120 and 140 allows users to create projects by inserting constituent media elements into of the timelines and performing editing and arrangement operations.
- the individual source media elements 102B-102F can be dragged or otherwise inserted into one of the timelines 120 from media bin area 101 or viewer window 1 10.
- the constituent media elements can be suitably edited and arranged.
- User interface 100 is streamlined in only displaying a subset of the usual user interface elements that are displayed on the Edit page of DaVinci Resolve®. For example, user interface 100 does not include a separate viewer window for viewing video and audio-visual clips in the media bin area 101.
- the streamlined user interface displays the core tools that are needed for certain projects, for example to import media, edit, trim, add transitions and titles, automatically match colour and mix audio.
- user interface 100 further includes a concatenator object in the form of a button 150.
- Button 150 can be suitably actuated by a user, typically in a single action such as by clicking, or by entering a keyboard shortcut linked to the button.
- user interface 100 concatenates each of the media elements present in media bin area 101 into a single media element and loads the created media element into the viewer window 1 10.
- the user interface 100 displays the total number of media elements comprised in the single media element (in this case 12) and the name of the media bin that contains the media element currently being viewed in the viewer window 1 10 (in this case‘Master’).
- the total length of the single media element is also displayed in the user interface 100.
- the element number, media bin identifier and length are displayed in the area above the viewer window, however this data could readily be displayed in other locations of the user interface 100.
- the concatenation action can be performed to produce a single media element from the media elements present in a selected one of the bins, or from the content of multiple bins.
- a graphical display object 160 is located underneath viewer window 110.
- the entire single media element is depicted in graphical display object 160 as an audio waveform.
- users can easily identify particular clips, for example by inspecting the trough regions of the audio waveform, which indicate clips with low or zero volume.
- the constituent media elements are indicated in graphical display object by vertical lines of a contrasting colour (such as white).
- FIG. 160 Other depictions of the single media element can also be used, such as schematically illustrating the constituent media elements using simple geometric shapes such as rectangles.
- the constituent media elements can be distinguished in graphical display object 160 for example by using different colours for the schematic illustrations.
- Having a single media element comprised of all of the media elements present in the media bin area allows the user to scrub through the single media element (at high speed if necessary) and easily locate the required constituent media element.
- High speed scrubbing can be performed by manipulating a playhead 123, located in graphical display object 160.
- Other operations can be performed using viewer window controls 170 that are located below graphical display object 160.
- the required media element can readily be inserted into one of the timelines 120 and 140, such as by dragging and dropping from the viewer window 1 10 or from graphical display object 160.
- the user interface 1 10 is configured to only insert into the timeline the individual media element currently being viewed in the viewer window 1 10, rather than inserting the entire single media element.
- the order of the constituent media elements within the created single media elements corresponds with the ordering of the constituent media elements in the originating media bin.
- the ordering of the individual source media elements within the created single media element can also be defined by the user and needn’t follow the ordering of the elements within a media bin.
- Display object 160 is configured to receive user input (such as a keyboard input, mouse click or touch-screen display contact) and in response thereto, define start point and/or end points within the single media element while it is in the process of being played in the viewer window 1 10. Any new clips that are defined in this way (namely by the definition of a start point and a corresponding end point) are automatically loaded into one or both of the timelines 120 and 140.
- a plurality of start point and/or end points can be defined to add multiple clips defined by pairs of start and end points into the timeline 120 and 140.
- the boundaries thereof can be suitably edited, such as by trimming and/or extending.
- This functionality allows use of the display object 160 to create clips with approximate boundaries, which can then be refined using the editing tools of the timelines.
- the concatenation of a plurality of media elements into a single media element effectively removes the start and end points that the individual elements inherently defined prior to the concatenation operation. This opens up the possibility of creating new media elements (namely by defining start and end points in the created single media element) that contain content from more than one of the original source media elements. Transition effects can then be readily inserted between the newly-created media elements.
- Embodiments of the present invention are also concerned with an advantageous playback methodology that is performed on the created single media element.
- the playback speed of the single media element is varied by reference to the properties of the individual source media elements that comprise the single media elements.
- the methodology is implemented by retaining information about the properties of the source media elements (for example duration) after those elements have been concatenated into the single media element. The retained property information is then used to control the playback of the single media element.
- One example of the playback methodology involves playing source media elements of a duration below a threshold value at their normal speed and playing source media elements of a duration above the threshold value at an increased speed.
- the increased playback speed can be the same irrespective of the durations of the requisite source media elements or can be varied in accordance with the individual durations of those source media elements.
- playback-control methodologies can be defined using the present invention. For example, source media elements of a duration less than a threshold value can be ignored and the playback speed of the remaining elements varied. In other examples a playback speed of the created media object at a given point may be determined by a function of the length of the source media element corresponding to that given point.
- FIG. 2 provides a block diagram that illustrates one example of a computer system 1000 upon which embodiments of the invention may be implemented.
- Computer system 1000 includes a bus 1002 or other communication mechanism for communicating information, and a hardware processor 1004 coupled with bus 1002 for processing information.
- Flardware processor 1004 may be, for example, a general purpose microprocessor, a graphics processing unit, other type of processing unit or combinations thereof.
- Computer system 1000 also includes a main memory 1006, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1002 for storing information and instructions to be executed by processor 1004.
- Main memory 1006 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1004.
- Such instructions when stored in non-transitory storage media accessible to processor 1004, render computer system 1000 into a special-purpose machine that is customized to perform the operations specified in the instructions.
- Computer system 1000 further includes a read only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static information and instructions for processor 1004.
- ROM read only memory
- a storage device 1010 such as a magnetic disk or optical disk, is provided and coupled to bus 1002 for storing information and instructions incuding the video editing software application described above.
- the computer system 1000 may be coupled via bus 1002 to a display 1012 (such as an LCD, LED, touch screen display or other display), for displaying information to a computer user, such as the graphical user interface described and illustrated above.
- a display 1012 such as an LCD, LED, touch screen display or other display
- An input device 1014 may be coupled to the bus 1002 for communicating information and command selections to processor 1004.
- cursor control 1016 such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1004 and for controlling cursor movement on display 1012.
- the techniques herein are performed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006.
- Such instructions may be read into main memory 1006 from another storage medium, such as a remote database.
- Execution of the sequences of instructions contained in main memory 1006 causes processor 1004 to perform the process steps described herein.
- hard-wired circuitry may be used in place of or in combination with software instructions.
- storage media or“storage medium” as used herein refers to any non- transitory media that stores data and/or instructions that cause a machine to operate in a specific fashion.
- Such storage media may comprise non-volatile media and/or volatile media.
- Non-volatile media includes, for example, optical or magnetic disks, such as storage device 1010.
- Volatile media includes dynamic memory, such as main memory 1006.
- Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
- Computer system 1000 also includes a communication interface 1018 coupled to bus 1002.
- Communication interface 1018 provides a two-way data communication coupling to a network link 1020 that is connected to 1 communication network 1050.
- communication interface 1018 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, etc.
- ISDN integrated services digital network
- communication interface 1018 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN.
- LAN local area network
- Wireless links may also be implemented.
- communication interface 1018 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Television Signal Processing For Recording (AREA)
- Management Or Editing Of Information On Record Carriers (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
The present invention is concerned with a software product including a computer readable medium storing instructions which when executed by a processor: displays a graphical user interface for a video editing system, the user interface including: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; a timeline; and a concatenator element; and responsive to a user actuating the concatenator element, concatenates the media elements present in the media bin together into a single media element and loads the single media element into the viewing window.
Description
Media Management System
Field of the invention
The present invention relates generally to video editing software applications. More specifically, the present invention relates to a media management system for video editing software applications that, at least in preferred embodiments, provides users with a more efficient workflow environment.
Background of the invention
Film and/or video productions are created on video editing systems typically by assembling the project from a collection of constituent elements. Video editing systems allow these constituent elements-which include video clips, audiovisual clips, audio clips and associated metadata-to be separately imported and edited before being merged into the final production. Modern video editing systems (and particularly those used professionally in the film and television industry) include sophisticated video editing software applications. The Applicant’s video editing system known as DaVinci Resolve® is an example of a modern video editing system that is extensively used in the professional environment. The total functionality of DaVinci Resolve® is divided into a number of separate pages (each having their own graphical user interface) that are organized in the order of a typical workflow. The DaVinci Resolve® pages include: Media (for media management and clip organization); Edit (a non-linear video editor); Color (for color correction and grading); Sound (a digital audio workstation) and Delivery (for final rendering or output).
In common with other non-linear video editors, the user interface of the Edit page of Davinci Resolve® includes a timeline that is a graphical representation of the project being edited. The timeline includes a plurality of linearly spaced timecode markings that extend typically in a horizontal direction along the length of the user interface window. The timeline allows the consistent elements of the project to be arranged into the desired temporal order by alignment with the timeline’s temporal markings. Once placed in the timeline, elements can be edited by launching editing tools to perform operations such as trimming, splitting, inserting, merging and moving of clips to a desired location.
The present invention aims to provide a media management system for a video editing system that, at least in preferred embodiments, provides users with a more optimized video editing workflow environment
Summary of the invention
According to a first aspect of the present invention there is provided a software product including a computer readable medium storing instructions which when executed by a processor: displays a graphical user interface for a video editing system, the user interface including: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; a timeline; and a concatenator element; and responsive to a user actuating the concatenator element, concatenates the media elements present in the media bin together into a single media element and loads the single media element into the viewing window.
According to one embodiment, the speed of playback of the single media element is varied by reference to a property of the media elements comprising the single media element. For example, the property may be the durations of the single media elements. According to this embodiment, the playback speed of media elements of a duration above a threshold value can be increased.
Preferably, the instructions, responsive to a user input, inserts one of the media elements into the timeline. This inserted media element inserted is usually the media element that corresponds to the part of the single media element currently being viewed in the viewing window.
The graphical user interface may further include a defining object that is configured, responsive to a user input, to:
define a start point and an end point for a media element being viewed in the viewing window; create a media element from the defined start and end points; and insert the created media element into the timeline. According to a second aspect of the present invention, there is provided a method for providing a graphical user interface for a video editing system, the method comprising: displaying a graphical user interface including: a media bin displaying one or more media elements imported into the video editing system; a viewing window for viewing a selected one of the media elements; a timeline; and a concatenator element; and responsive to a user actuating the concatenator element, concatenating the media elements present in the media bin together into a single media element and loading the single media element into the viewing window.
According to one embodiment, the speed of playback of the single media element is varied by reference to a property of the individual media elements comprising the single media element. This can be the duration of the single media elements. In addition, the playback speed of media elements of a duration above a threshold value can be increased.
Preferably, the method includes, responsive to a user input, inserting one of the media elements into the timeline. This inserted media element can be the media element that corresponds to the part of the single media element currently being viewed in the viewing window.
The graphical user interface can further include a defining object that is configured, responsive to a user input, to:
define a start point and an end point for a media element being viewed in the viewing window; create a media element from the defined start and end points; and insert the created media element into the timeline. According to another aspect of the present invention, there is provided a method of playing a media file comprising a plurality of component files each having defined properties, the method including the step of varying the playback speed by reference to one or more of the properties of the component files.
The property may be the durations of the component files. Optionally, the playback speed of media elements of a duration above a threshold value is increased.
As used herein, except where the context requires otherwise, the term "comprise" and variations of the term, such as "comprising", "comprises" and "comprised", are not intended to exclude further additives, components, integers or steps. Brief description of the drawings
Further aspects of the present invention and further embodiments of the aspects described in the preceding paragraphs will become apparent from the following description, given by way of example and with reference to the accompanying drawings, in which: Figure 1 is an illustration of a first view of a user interface according to an embodiment of the present invention; and
Figure 2 is a schematic illustration of a hardware environment suitable for implementing the graphical user interface in accordance with an embodiment of the present invention.
Detailed description of the embodiments
A user interface 100 for a video editing software application is shown in Figure 1. The video editing software allows for the creation of projects from constituent media elements that are imported into the video editing software application and displayed in a
media bin area 101. In the illustrated embodiment, there is a single bin of media elements named‘Master’, however those skilled in the art will realise that any number of media bins can be created and media elements placed therein to provide a framework for organising the project.
In the illustrated embodiment, the user has imported twelve constituent media elements in the project, six of which are shown in Figure 1. The remaining media elements can be made viewable by operating the scroll bar located on the right hand side of the media bin area. The six visible constituent elements comprise an audio track 102A and five audio-visual clips 102B-102F (namely video clips each with a recorded audio track). As understood by skilled addressees, the video editing software application also stores and manages metadata for each constituent element, as well as for the overall project.
User interface 100 also includes a viewer window 1 10 for viewing a selected video or audio-visual clip, a first timeline 120 and second timeline 140 lying parallel and above first timeline 120. The operation of the two timelines is described in the Applicant’s co-pending PCT patent application filed on even date, the contents of which are incorporated herein.
Timelines 120 and 140 allows users to create projects by inserting constituent media elements into of the timelines and performing editing and arrangement operations. In this regard, the individual source media elements 102B-102F can be dragged or otherwise inserted into one of the timelines 120 from media bin area 101 or viewer window 1 10. Once in a timeline, the constituent media elements can be suitably edited and arranged.
User interface 100 is streamlined in only displaying a subset of the usual user interface elements that are displayed on the Edit page of DaVinci Resolve®. For example, user interface 100 does not include a separate viewer window for viewing video and audio-visual clips in the media bin area 101. The streamlined user interface displays the core tools that are needed for certain projects, for example to import media, edit, trim, add transitions and titles, automatically match colour and mix audio.
Although only six constituent media elements are illustrated, it is not unusual for dozens or even hundreds of constituent media elements to be imported for potential use
in a project. This can lead to difficulties in locating the desired clip from within all of the files present in the media bin area 101.
To address this issue, user interface 100 further includes a concatenator object in the form of a button 150. Button 150 can be suitably actuated by a user, typically in a single action such as by clicking, or by entering a keyboard shortcut linked to the button. In response to actuating the concatenator object, user interface 100 concatenates each of the media elements present in media bin area 101 into a single media element and loads the created media element into the viewer window 1 10. The user interface 100 displays the total number of media elements comprised in the single media element (in this case 12) and the name of the media bin that contains the media element currently being viewed in the viewer window 1 10 (in this case‘Master’). The total length of the single media element is also displayed in the user interface 100. In the illustrated embodiment, the element number, media bin identifier and length, are displayed in the area above the viewer window, however this data could readily be displayed in other locations of the user interface 100.
When there are multiple bins created and displayed in the media bin area 101 , the concatenation action can be performed to produce a single media element from the media elements present in a selected one of the bins, or from the content of multiple bins.
A graphical display object 160 is located underneath viewer window 110. In the illustrated embodiment, the entire single media element is depicted in graphical display object 160 as an audio waveform. In this depiction, users can easily identify particular clips, for example by inspecting the trough regions of the audio waveform, which indicate clips with low or zero volume.
The constituent media elements are indicated in graphical display object by vertical lines of a contrasting colour (such as white).
Other depictions of the single media element can also be used, such as schematically illustrating the constituent media elements using simple geometric shapes such as rectangles. The constituent media elements can be distinguished in graphical display object 160 for example by using different colours for the schematic illustrations.
Having a single media element comprised of all of the media elements present in the media bin area allows the user to scrub through the single media element (at high speed if necessary) and easily locate the required constituent media element. High speed scrubbing can be performed by manipulating a playhead 123, located in graphical display object 160. Other operations (including high-speed scrubbing) can be performed using viewer window controls 170 that are located below graphical display object 160.
Once located, the required media element can readily be inserted into one of the timelines 120 and 140, such as by dragging and dropping from the viewer window 1 10 or from graphical display object 160. The user interface 1 10 is configured to only insert into the timeline the individual media element currently being viewed in the viewer window 1 10, rather than inserting the entire single media element.
The order of the constituent media elements within the created single media elements corresponds with the ordering of the constituent media elements in the originating media bin. However, the ordering of the individual source media elements within the created single media element can also be defined by the user and needn’t follow the ordering of the elements within a media bin.
Display object 160 is configured to receive user input (such as a keyboard input, mouse click or touch-screen display contact) and in response thereto, define start point and/or end points within the single media element while it is in the process of being played in the viewer window 1 10. Any new clips that are defined in this way (namely by the definition of a start point and a corresponding end point) are automatically loaded into one or both of the timelines 120 and 140. In the graphical display object 160 a plurality of start point and/or end points can be defined to add multiple clips defined by pairs of start and end points into the timeline 120 and 140. By presenting a concatenation of all the constituent media objects into a single media element and allowing multiple clips to be thus defined, the user workflow can be improved as it is no longer necessary to load individual clips into the timeline.
Once the multiple clips are present in the timeline 120 and 140, the boundaries thereof can be suitably edited, such as by trimming and/or extending. This functionality allows use of the display object 160 to create clips with approximate boundaries, which can then be refined using the editing tools of the timelines.
The concatenation of a plurality of media elements into a single media element effectively removes the start and end points that the individual elements inherently defined prior to the concatenation operation. This opens up the possibility of creating new media elements (namely by defining start and end points in the created single media element) that contain content from more than one of the original source media elements. Transition effects can then be readily inserted between the newly-created media elements.
Embodiments of the present invention are also concerned with an advantageous playback methodology that is performed on the created single media element. According to the methodology, the playback speed of the single media element is varied by reference to the properties of the individual source media elements that comprise the single media elements. The methodology is implemented by retaining information about the properties of the source media elements (for example duration) after those elements have been concatenated into the single media element. The retained property information is then used to control the playback of the single media element.
One example of the playback methodology involves playing source media elements of a duration below a threshold value at their normal speed and playing source media elements of a duration above the threshold value at an increased speed. The increased playback speed can be the same irrespective of the durations of the requisite source media elements or can be varied in accordance with the individual durations of those source media elements.
Other playback-control methodologies can be defined using the present invention. For example, source media elements of a duration less than a threshold value can be ignored and the playback speed of the remaining elements varied. In other examples a playback speed of the created media object at a given point may be determined by a function of the length of the source media element corresponding to that given point.
Figure 2 provides a block diagram that illustrates one example of a computer system 1000 upon which embodiments of the invention may be implemented. Computer system 1000 includes a bus 1002 or other communication mechanism for communicating information, and a hardware processor 1004 coupled with bus 1002 for processing information. Flardware processor 1004 may be, for example, a general
purpose microprocessor, a graphics processing unit, other type of processing unit or combinations thereof.
Computer system 1000 also includes a main memory 1006, such as a random access memory (RAM) or other dynamic storage device, coupled to bus 1002 for storing information and instructions to be executed by processor 1004. Main memory 1006 also may be used for storing temporary variables or other intermediate information during execution of instructions to be executed by processor 1004. Such instructions, when stored in non-transitory storage media accessible to processor 1004, render computer system 1000 into a special-purpose machine that is customized to perform the operations specified in the instructions.
Computer system 1000 further includes a read only memory (ROM) 1008 or other static storage device coupled to bus 1002 for storing static information and instructions for processor 1004. A storage device 1010, such as a magnetic disk or optical disk, is provided and coupled to bus 1002 for storing information and instructions incuding the video editing software application described above.
The computer system 1000 may be coupled via bus 1002 to a display 1012 (such as an LCD, LED, touch screen display or other display), for displaying information to a computer user, such as the graphical user interface described and illustrated above. An input device 1014, including alphanumeric and other keys, may be coupled to the bus 1002 for communicating information and command selections to processor 1004. Another type of user input device is cursor control 1016, such as a mouse, a trackball, or cursor direction keys for communicating direction information and command selections to processor 1004 and for controlling cursor movement on display 1012.
According to one embodiment, the techniques herein are performed by computer system 1000 in response to processor 1004 executing one or more sequences of one or more instructions contained in main memory 1006. Such instructions may be read into main memory 1006 from another storage medium, such as a remote database. Execution of the sequences of instructions contained in main memory 1006 causes processor 1004 to perform the process steps described herein. In alternative embodiments, hard-wired circuitry may be used in place of or in combination with software instructions.
The terms“storage media” or“storage medium” as used herein refers to any non- transitory media that stores data and/or instructions that cause a machine to operate in a specific fashion. Such storage media may comprise non-volatile media and/or volatile media. Non-volatile media includes, for example, optical or magnetic disks, such as storage device 1010. Volatile media includes dynamic memory, such as main memory 1006. Common forms of storage media include, for example, a floppy disk, a flexible disk, hard disk, solid state drive, magnetic tape, or any other magnetic data storage medium, a CD-ROM, any other optical data storage medium, any physical medium with patterns of holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, NVRAM, any other memory chip or cartridge.
Computer system 1000 also includes a communication interface 1018 coupled to bus 1002. Communication interface 1018 provides a two-way data communication coupling to a network link 1020 that is connected to 1 communication network 1050. For example, communication interface 1018 may be an integrated services digital network (ISDN) card, cable modem, satellite modem, etc. As another example, communication interface 1018 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN. Wireless links may also be implemented. In any such implementation, communication interface 1018 sends and receives electrical, electromagnetic or optical signals that carry digital data streams representing various types of information.
It will be understood that the invention disclosed and defined in this specification extends to all alternative combinations of two or more of the individual features mentioned or evident from the text or drawings. All of these different combinations constitute various alternative aspects of the invention.
Claims
1. A software product including a computer readable medium storing instructions which when executed by a processor: displays a graphical user interface for a video editing system, the user interface including: a media bin displaying one or more media elements imported into the video editing system;
a viewing window for viewing a selected one of the media elements; a timeline; and
a concatenator element; and
responsive to a user actuating the concatenator element, concatenates the media elements present in the media bin together into a single media element and loads the single media element into the viewing window.
2. A software product according to claim 1 wherein speed of playback of the single media element is varied by reference to a property of the individual media elements comprising the single media element.
3. A software product according to claim 1 , wherein the property is the durations of the individual media elements.
4. A software product according to claim 3 wherein the playback speed of individual media elements of a duration above a threshold value is increased.
5. A software product according to any preceding claim, wherein the instructions, responsive to a user input, inserts one of the media elements into the timeline.
6. A software product according to claim 5, wherein the media element inserted into the timeline is the media element that corresponds to the part of the single media element currently being viewed in the viewing window.
7. A software product according to any preceding claim, wherein the graphical user interface further includes a defining object that is configured, responsive to a user input, to:
define a start point and an end point for a media element being viewed in the viewing window;
create a media element from the defined start and end points; and insert the created media element into the timeline.
8. A method for providing a graphical user interface for a video editing system, the method comprising:
displaying a graphical user interface including:
a media bin displaying one or more media elements imported into the video editing system;
a viewing window for viewing a selected one of the media elements;
a timeline; and
a concatenator element; and
responsive to a user actuating the concatenator element, concatenating the media elements present in the media bin together into a single media element and loading the single media element into the viewing window.
9. A method according to claim 8, wherein speed of playback of the single media element is varied by reference to a property of the individual media elements comprising the single media element.
10. A method according to claim 9, wherein the property is the durations of the single media elements.
1 1. A method according to claim 10 wherein the playback speed of media elements of a duration above a threshold value is increased.
12. A method according to any one of claims 8 to 1 1 , further including, responsive to a user input, inserting one of the media elements into the timeline.
13. A method according to claim 12, wherein the media element inserted into the timeline is the media element that corresponds to the part of the single media element currently being viewed in the viewing window.
14. A method according to any one of claims 8 to 13, wherein the graphical user interface further includes a defining object that is configured, responsive to a user input, to:
define a start point and an end point for a media element being viewed in the viewing window;
create a media element from the defined start and end points; and insert the created media element into the timeline.
15. A method of playing a media file comprising a plurality of component files each having defined properties, the method including the step of varying the playback speed by reference to one or more of the properties of the component files.
16. A method according to claim 15, wherein the property is the durations of the component files.
17. A method according to claim 16, wherein the playback speed of media elements of a duration above a threshold value is increased.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2021557985A JP2022528859A (en) | 2019-04-01 | 2020-04-01 | Media management system |
EP20781753.7A EP3948502A4 (en) | 2019-04-01 | 2020-04-01 | Media management system |
CN202080035245.1A CN113811843B (en) | 2019-04-01 | 2020-04-01 | Media management system |
US17/600,978 US11942117B2 (en) | 2019-04-01 | 2020-04-01 | Media management system |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2019901098A AU2019901098A0 (en) | 2019-04-01 | Media management system | |
AU2019901098 | 2019-04-01 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2020198793A1 true WO2020198793A1 (en) | 2020-10-08 |
Family
ID=72664342
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU2020/050322 WO2020198793A1 (en) | 2019-04-01 | 2020-04-01 | Media management system |
Country Status (5)
Country | Link |
---|---|
US (1) | US11942117B2 (en) |
EP (1) | EP3948502A4 (en) |
JP (1) | JP2022528859A (en) |
CN (1) | CN113811843B (en) |
WO (1) | WO2020198793A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3996092A1 (en) * | 2020-11-09 | 2022-05-11 | Blackmagic Design Pty Ltd | Video editing or media management system |
US11942117B2 (en) | 2019-04-01 | 2024-03-26 | Blackmagic Design Pty Ltd | Media management system |
US12057141B2 (en) | 2019-08-02 | 2024-08-06 | Blackmagic Design Pty Ltd | Video editing system, method and user interface |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8126312B2 (en) * | 2005-03-31 | 2012-02-28 | Apple Inc. | Use of multiple related timelines |
US8156176B2 (en) * | 2005-04-20 | 2012-04-10 | Say Media, Inc. | Browser based multi-clip video editing |
US20120210221A1 (en) * | 2010-07-15 | 2012-08-16 | Khan Itrat U | Media-Editing Application with Live Dragging and Live Editing Capabilities |
US8819557B2 (en) * | 2010-07-15 | 2014-08-26 | Apple Inc. | Media-editing application with a free-form space for organizing or compositing media clips |
US8966367B2 (en) * | 2011-02-16 | 2015-02-24 | Apple Inc. | Anchor override for a media-editing application with an anchored timeline |
Family Cites Families (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP0526064B1 (en) | 1991-08-02 | 1997-09-10 | The Grass Valley Group, Inc. | Video editing system operator interface for visualization and interactive control of video material |
US6628303B1 (en) * | 1996-07-29 | 2003-09-30 | Avid Technology, Inc. | Graphical user interface for a motion video planning and editing system for a computer |
US7231135B2 (en) * | 2001-05-18 | 2007-06-12 | Pentax Of American, Inc. | Computer-based video recording and management system for medical diagnostic equipment |
US7287222B2 (en) | 2002-01-31 | 2007-10-23 | Canon Kabushiki Kaisha | Information processing apparatus and method that determines effectiveness of metadata for editing information content |
US7805678B1 (en) | 2004-04-16 | 2010-09-28 | Apple Inc. | Editing within single timeline |
US7434155B2 (en) | 2005-04-04 | 2008-10-07 | Leitch Technology, Inc. | Icon bar display for video editing system |
WO2007082167A2 (en) * | 2006-01-05 | 2007-07-19 | Eyespot Corporation | System and methods for storing, editing, and sharing digital video |
US20070162857A1 (en) | 2006-01-06 | 2007-07-12 | Ralf Weber | Automated multimedia authoring |
US8170396B2 (en) * | 2007-04-16 | 2012-05-01 | Adobe Systems Incorporated | Changing video playback rate |
US8422550B2 (en) * | 2007-07-27 | 2013-04-16 | Lagavulin Limited | Apparatuses, methods, and systems for a portable, automated contractual image dealer and transmitter |
US8363055B1 (en) | 2008-11-18 | 2013-01-29 | Pixar | Multiple time scales in computer graphics |
US8881013B2 (en) | 2009-04-30 | 2014-11-04 | Apple Inc. | Tool for tracking versions of media sections in a composite presentation |
US8359537B2 (en) | 2009-04-30 | 2013-01-22 | Apple Inc. | Tool for navigating a composite presentation |
CN103384873A (en) * | 2010-12-22 | 2013-11-06 | 汤姆逊许可公司 | Method for generating media collections |
US8745499B2 (en) | 2011-01-28 | 2014-06-03 | Apple Inc. | Timeline search and index |
US9099161B2 (en) | 2011-01-28 | 2015-08-04 | Apple Inc. | Media-editing application with multiple resolution modes |
US8621355B2 (en) | 2011-02-02 | 2013-12-31 | Apple Inc. | Automatic synchronization of media clips |
US20130073964A1 (en) | 2011-09-20 | 2013-03-21 | Brian Meaney | Outputting media presentations using roles assigned to content |
US10079039B2 (en) | 2011-09-26 | 2018-09-18 | The University Of North Carolina At Charlotte | Multi-modal collaborative web-based video annotation system |
US9111579B2 (en) | 2011-11-14 | 2015-08-18 | Apple Inc. | Media editing with multi-camera media clips |
US9417756B2 (en) | 2012-10-19 | 2016-08-16 | Apple Inc. | Viewing and editing media content |
US20140143671A1 (en) | 2012-11-19 | 2014-05-22 | Avid Technology, Inc. | Dual format and dual screen editing environment |
US20150243325A1 (en) | 2014-02-24 | 2015-08-27 | Lyve Minds, Inc. | Automatic generation of compilation videos |
US9679605B2 (en) | 2015-01-29 | 2017-06-13 | Gopro, Inc. | Variable playback speed template for video editing application |
US10276213B2 (en) | 2017-05-22 | 2019-04-30 | Adobe Inc. | Automatic and intelligent video sorting |
US10705708B2 (en) | 2018-11-29 | 2020-07-07 | International Business Machines Corporation | Data expansion control |
WO2020198793A1 (en) | 2019-04-01 | 2020-10-08 | Blackmagic Design Pty Ltd | Media management system |
-
2020
- 2020-04-01 WO PCT/AU2020/050322 patent/WO2020198793A1/en unknown
- 2020-04-01 JP JP2021557985A patent/JP2022528859A/en active Pending
- 2020-04-01 CN CN202080035245.1A patent/CN113811843B/en active Active
- 2020-04-01 US US17/600,978 patent/US11942117B2/en active Active
- 2020-04-01 EP EP20781753.7A patent/EP3948502A4/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8126312B2 (en) * | 2005-03-31 | 2012-02-28 | Apple Inc. | Use of multiple related timelines |
US8156176B2 (en) * | 2005-04-20 | 2012-04-10 | Say Media, Inc. | Browser based multi-clip video editing |
US20120210221A1 (en) * | 2010-07-15 | 2012-08-16 | Khan Itrat U | Media-Editing Application with Live Dragging and Live Editing Capabilities |
US8819557B2 (en) * | 2010-07-15 | 2014-08-26 | Apple Inc. | Media-editing application with a free-form space for organizing or compositing media clips |
US8966367B2 (en) * | 2011-02-16 | 2015-02-24 | Apple Inc. | Anchor override for a media-editing application with an anchored timeline |
Non-Patent Citations (1)
Title |
---|
See also references of EP3948502A4 * |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11942117B2 (en) | 2019-04-01 | 2024-03-26 | Blackmagic Design Pty Ltd | Media management system |
US12057141B2 (en) | 2019-08-02 | 2024-08-06 | Blackmagic Design Pty Ltd | Video editing system, method and user interface |
EP3996092A1 (en) * | 2020-11-09 | 2022-05-11 | Blackmagic Design Pty Ltd | Video editing or media management system |
US11721365B2 (en) | 2020-11-09 | 2023-08-08 | Blackmagic Design Pty Ltd | Video editing or media management system |
Also Published As
Publication number | Publication date |
---|---|
CN113811843B (en) | 2024-05-03 |
EP3948502A1 (en) | 2022-02-09 |
CN113811843A (en) | 2021-12-17 |
US11942117B2 (en) | 2024-03-26 |
JP2022528859A (en) | 2022-06-16 |
US20220180902A1 (en) | 2022-06-09 |
EP3948502A4 (en) | 2022-12-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US5682326A (en) | Desktop digital video processing system | |
US11942117B2 (en) | Media management system | |
EP0625783B1 (en) | Method and apparatus for displaying available source material for editing | |
US7836389B2 (en) | Editing system for audiovisual works and corresponding text for television news | |
US11721365B2 (en) | Video editing or media management system | |
US7930418B2 (en) | Collaborative computer-based production system including annotation, versioning and remote interaction | |
US8555170B2 (en) | Tool for presenting and editing a storyboard representation of a composite presentation | |
US20050071736A1 (en) | Comprehensive and intuitive media collection and management tool | |
US20080010585A1 (en) | Binding interactive multichannel digital document system and authoring tool | |
CA2202106C (en) | A non-timeline, non-linear digital multimedia composition method and system | |
JPH0654469B2 (en) | Interactive multimedia presentation program creation assistance method | |
WO1993021635A1 (en) | Method for visually and audibly representing computer instructions for editing video | |
CN114450935A (en) | Video editing system, method and user interface | |
JPWO2010073695A1 (en) | Edit information presenting apparatus, edit information presenting method, program, and recording medium | |
US7694225B1 (en) | Method and apparatus for producing a packaged presentation | |
US20220189511A1 (en) | User interface for video editing system | |
US10692536B1 (en) | Generation and use of multiclips in video editing | |
CN103534695A (en) | Logging events in media files | |
JP4420454B2 (en) | Multimedia editing apparatus, multimedia editing method, program, and recording medium | |
WO2004081815A2 (en) | Media presentation system | |
Eagle | Getting Started with Vegas | |
KR20050013030A (en) | Multimedia processor of WYSIWYG base |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20781753 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2021557985 Country of ref document: JP Kind code of ref document: A |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2020781753 Country of ref document: EP Effective date: 20211102 |