WO2007072393A2

WO2007072393A2 - Method and apparatus for navigating audiovisual data

Info

Publication number: WO2007072393A2
Application number: PCT/IB2006/054914
Authority: WO
Inventors: Gerrit C. Langelaar
Original assignee: Koninklijke Philips Electronics N.V.
Priority date: 2005-12-22
Filing date: 2006-12-18
Publication date: 2007-06-28
Also published as: WO2007072393A3

Abstract

Navigation on today' s consumer electronics devices is cumbersome as fast forward and rewind operation cost a lot of time and are not very accurate. As the number of input means is usually limited - usually, no mouse is provided, nor desired to enhance the lean-back experience - the ways of implementing other ways of navigating are difficult to find. A method is disclosed requiring a limited amount of input means. In an advantageous embodiment, clear feedback is provided by means of navigation bars and visual indicators.

Description

Method and apparatus for navigating audiovisual data

The invention relates to a method of navigating a stream of audio visual data. The invention further relates to an apparatus for navigating a stream of audiovisual data.

Such apparatus is generally known as a video recorder or a video player. Such apparatuses are for example available as videocassette recorders, DVD players and DVD recorders. A user is enabled to navigate through a stream of audiovisual data - in analogue or digital form, on tape or on disc - using fast forward and fast rewind options. In some cases, audiovisual data on a DVD can also be browsed on a scene-by- scene basis from a menu.

The fast forward operation costs time, as the point of reproduction is not instantly moved from the current to a desired point. Furthermore, though the fast-forward operation may provide visual feedback on a screen, the speed is very high. This may result in overshoot, i.e. the user stops the fast-forward beyond the point of interest in the stream of audiovisual data.

Some video recorders with a hard disk drive have solved the time issue by providing a jump operation (also known as a 'skip' option). However, this jump operation relates to a jump of a fixed distance, usually of about 30 seconds.

Therefore, it is preferred to have a more convenient way of navigating through a stream of audio visual data. The invention provides in one aspect a method of navigating a stream of audiovisual data, comprising: reproducing the stream at a first point; entering a jump mode; receiving a jump distance; and reproducing the stream at a second point, the second point being located at substantially the jump distance from the first point.

By letting a user input the distance to the next point in the stream to reproduce and by providing the option to jump, a more convenient - faster and more accurate - method of navigating a stream of audiovisual data is provided. In an embodiment of the method according to the invention, the method further comprises: representing the audiovisual stream as a first line or a first bar; indicating the first point on the first bar or the first bar by a first visual indicator; allowing setting a second visual indicator, thus receiving the jump distance as the distance between the point indicated by the first visual indicator and the point indicated by the second visual indicator; and receiving a confirmation to reproduce the stream at a location indicated by the second visual indicator.

In this way, a user is provided with a clear user interface, via which the jump distance can be very easily provided to a system that has to perform the jump. In another embodiment of the method according to the invention, the method comprises visually indicating at least one event in the stream of audiovisual data on the first bar.

In a further embodiment of the method according to the invention, the method comprises allowing setting the second visual indicator at least near the location of the event; and when the second visual indicator is not set at the start of the nearest event, setting the second visual indicator to the start of the nearest event.

The advantage of this embodiment is that a user does not have to position the second visual indicator very accurately, improving user-friendliness

Another aspect of the invention provides an apparatus for navigating a stream of audiovisual data, comprising input means connected to reproduction means, the reproduction means being operatively connected to a memory for storing a stream of audiovisual data, the input means conceived to receive a command to let the apparatus enter a jump mode and to receive information on a jump distance and the reproduction means conceived to initially reproduce the stream of audiovisual data at a first point and after the apparatus has received the jump distance, reproduce the stream of audiovisual data at a second point, the second point being located at substantially the jump distance from the first point.

Yet another aspect of the invention provides a computer programme product for programming a computer to execute the method as claimed in claim 1. Again another aspect of the invention provides a record carrier having stored thereon the computer programme product as claimed in claim 9. The invention and these and other embodiments thereof will now be described in more detail by means of Figures, wherein:

Figure 1 shows an embodiment of the apparatus according to the invention; Figure 2 A shows a screen to elucidate an embodiment of the method according to the invention;

Figure 2 B shows a screen to elucidate an embodiment of the method according to the invention;

Figure 2 C shows a screen to elucidate an embodiment of the method according to the invention; and Figure 3 shows an embodiment of the record carrier according to the invention.

Figure 1 shows a consumer electronics system 100 comprising a video recorder 110 as an embodiment of the apparatus according to the invention, a TV-set 150 and a control device 160. The video recorder 110 is arranged to receive and record streams of audio-visual data and interactive applications associated with those streams of audio-visual data carried by a signal 170.

To this end, the video recorder 110 comprises a receiver 120 for receiving the signal 170, a de-multiplexer 122, an audio/video processor 124 as reproduction means (in combination with a storage device; local or remote), a central processing unit like a microprocessor 126 for controlling components comprised by the video recorder 110, a harddisk drive 128 as a storage device, a programme code memory 130, a user command receiver 132 for receiving signal from the control device 160 and a central bus 134 for connecting components comprised by the video recorder 110.

The video recorder further comprises a network interface unit 140 for connecting to a network like the internet or a LAN. The network interface unit 140 may be embodied as an analogue modem, an ISDN, DSL or cable modem or a UTP/ethernet network interface. The receiver 120 is arranged to tune in to a broadcast (audio or video) channel and derive data of that broadcast channel from the signal 170. The signal 170 can be received by any known method; cable, terrestrial; satellite, broadband network connection or any other method of distributing audiovisual data. The signal 170 can even be derived from the output of another consumer electronics apparatus. The receiver 120 outputs a baseband signal that carries at least one stream of audiovisual data.

The de-multiplexer 122 is arranged to de-multiplex audiovisual data from other data that may be comprised in the baseband signal outputted by the receiver 120. The video processor 124 is arranged to render audiovisual data outputted by the de-multiplexer 122 in a way that is can be rendered by the TV-set 150. The output can be provided in various analogue formats as SECAM and PAL or digital formats.

Data stored in the programme code memory 130 enables the microprocessor 126 to execute the method according to the invention. The programme code memory 130 may be embodied as a Flash EEPROM, a ROM, an optical disk or any other type of data carrying medium.

The storage device may also be embodied as an optical disk drive like a DVD or Blu-Ray drive and is adapted to store content that is received by either the receiver 120 or the network interface unit 140 for future reproduction on the TV-set 150 or for further dissemination via the network interface unit 140. The content may be processed prior to storage.

Figure 2 A shows a screen 201 with a bar 202 representing a stream of audiovisual data. On the bar, events in the stream of audiovisual data are indicated at a first location 210 and at a second location 212. The location of the events on the bar 202 can be derived in several ways. The simplest method is by analysing metadata indicating events in the stream of audiovisual data, when present. However, as adding meta-data exactly indicating events may be costly, in particular when manually. To facilitate creating of a bar representing a stream of audiovisual data, methods of automatically creating such bar are known in the art. One method is to determine the average colour of each frame in a stream and present this as a coloured slice in the bar 202. This can be done by simply taking the average of the colour of the pixels of a frame.

The word 'event' can in the context of the description be interpreted in various ways. It can be a scene, set by an author of the stream of audiovisual data (like done on for example a pre-recorded DVD). Also, it can be a part in the stream of audiovisual data having substantially the same average colour. It can also be a part in the stream of audiovisual data with a high level of sound, caused by e.g. an explosion. Furthermore, events can also be automatically detected scenes, the scene changes being detected by methods already known in the art. The stream of audiovisual data is being reproduced at a location indicated by a first visual indicator 204 along the bar 202. Being triggered by an event indicated at the first location 210, a user wants to start reproduction at the first location 210. Using ordinary means available on a television set or video recorder, the user has the option to reproduce the stream of audiovisual data in a fast forward mode, substantially up to the first location 210. When the distance from the point of reproduction indicated by the first visual indicator 204, this may take a while.

Therefore, according to this embodiment of the invention, the user can set a second visual indicator 206 to a location in the stream of audiovisual data to or close to the first event 210. Preferably, the setting of the location of the second visual indicator 206 is done using cursoring means 162 on control device 160 (Figure 1), i.e. a 'left' button 164 and 'right' button 166, like a available on virtually all modern day television and/or (DVD) video player/recorder remote control units like the user control device 160 (Figure 1). The movement of the marker can be moved in equal steps, for example 10 seconds by every push of a button, or in increasing steps. The latter can be done by doubling the step size every push of the button.

More in detail, when the user wants to execute the jump in reproduction from the location of reproduction (indicated by the first visual indicator 204) to the first location 210, he enters a jump mode by means of control means 160 (Figure 1). Subsequently, the user moves the second visual indicator 206 to an event indicated in the bar 202, for example the first location 210. The second visual indicator 206 does not necessarily have to be set at the exact point of the first location 210. This may even not be possible, depending on how the invention is embodied. The most important is that a user can in just seconds of time jump the point of reproduction of a stream of audiovisual data, with a desired jump distance, at least to a point closer to a desired point than the current point of reproduction.

Having entered the jump distance by moving and setting the second visual indicator 210 to an interesting point and the jump distance being the distance between the first visual indicator 210 and the second visual indicator, the user executes the jump by for example pushing an execution button on the control means 160 (Figure 1). After execution of the jump, the reproduction of the audiovisual data is continued at the location set by the second visual indicator 206.

In an embodiment of the invention, the second visual indicator 'snaps' to the first location 210, ensuring that after jump, the stream of audiovisual data is reproduced from the beginning of the indicated event. This 'snapping' means that when the second visual indicator is set in the neighbourhood of the first location 210 by the user, the second visual indicator 206 is subsequently set at the first location 210 indicating a first event. This is in particular useful when the second visual indicator 206 cannot be set in a fine way. To achieve the snapping, the micro-controller 126 (Figure 1) determines the distance between the position of the second visual indicator 206 and events close to the position of the second visual indicator, for example the event at the first location 210. Subsequently, the second visual indicator is placed at the start of the closest event.

Figure 2 B shows another embodiment of the invention. Figure 2 B shows a screen 221 with a first bar 222 representing a stream of audiovisual data on which bar in a first location 230 and a second location 232 two events are indicated. Under the first bar 222, a second bar 228 is located. The left end 224 of the second bar 228 serves as a first visual indicator to indicate the point in the stream of audiovisual data that is currently being reproduced. The right end 226 of the second bar 228 serves as a second visual indicator to indicate a point to jump the replication process to. As a user moves the right end 126 of the second bar 228 to the right and thus increasing the length of the second bar 228, the jump distance is increased. Moving the right end 126 may be done as explained in the previous embodiment or another way already known in the art.

Figure 2 C shows a further embodiment of the invention, almost identical to the previous embodiment. Figure 2 C shows a screen 241 with a first bar 242 representing a stream of audiovisual data on which bar in a first location 250 and a second location 252 two events are indicated. Under the first bar 242, a second bar 248 is located. The middle point of the second bar 248 serves as a first visual indicator 244 to indicate the point in the stream of audiovisual data that is currently being reproduced. The right end 246 of the second bar 248 serves as a second visual indicator to indicate a point to jump the replication process to.

The major difference with the previous embodiment is that when the second bar 248 is enlarged by moving the second visual indicator 246, also a third visual indicator 249, left from the first visual indicator 244 is moved. This is because according to the invention, the jump in reproduction of the stream of audiovisual data does not necessarily have to be in the forward direction of the stream of audiovisual data, but can also be in the backward direction of the stream of audio visual data.

The final direction of the jump can be indicated in the confirmation step, by providing two buttons (or other input means) on the control device 106 (Figure 1, not shown) for confirmation: one for confirming a backward jump and one for confirming a forward jump.

Also in the two previous embodiments a backward jump can be executed, by moving the second visual indicator left of the first visual indicator and after that confirming the jump. This moving can be executed using the cursoring means 162 (Figure 1). The 'left' button 164 can be used to decrease the forward jump distance or to increase the backward jump distance and the 'right' button 166 can be used to increase the forward jump distance or to decrease the backward jump distance. For these cases, the jump is confirmed (and executed) using single button. In the video recorder 110, the processing of user input provided by the user command receiver 132 and the calculation of the jump distance is preferably done by the micro-processor 126. Generating the user interface like the various bars and visual indicators is preferably done by micro-processor 126 as well. However, this task can also be performed by the video processor 124. Though the bar has been drawn as a straight bar, the invention can also be embodied using a straight line, a bended bar or line, a circle or any other geometric form representing the stream of audiovisual data. It is, however, preferred to present the stream of audiovisual data in a clear and intuitive way to the user.

The method can also be carried out on a general-purpose computer like the personal computer 300 as shown in Figure 3. Figure 3 also shows a record carrier 310 comprising a computer program product to program the personal computer 300 to perform the method according to the invention. To this, the record carrier 310 is inserted in a disk drive 302 comprised by the personal computer 300. The disk drive 302 retrieves data from the record carrier 310 and transfers it to the microprocessor 304 to program the microprocessor 304. The programmed microprocessor 304 controls a media processor 306 to perform the method according to the invention when retrieving data from the disk drive 302 when rendering audio-visual data at high speeds.

Though the record carrier 310 is depicted as a floppy disk, the record carrier 310 can also be embodied in any other way known to a person skilled in the art, including, without limitation, a Compact Disc®, a DVD, a solid state memory card or any other optical, magnetic, opto -magnetic, non- volatile or volatile memory, including a remote server-based memory from which the computer program product can be downloaded.

Expressions such as "comprise", "include", "incorporate", "contain", "is" and "have" are to be construed in a non-exclusive manner when interpreting the description and its associated claims, namely construed to allow for other items or components which are not explicitly defined also to be present. Reference to the singular is also to be construed in be a reference to the plural and vice versa. When data is being referred to as audiovisual data, it can represent audio only, video only or still pictures only or a combination thereof, unless specifically indicated otherwise in the description of the embodiments.

Furthermore, the invention may also be embodied with less components than provided in the embodiments described here, wherein one component carries out multiple functions. Just as well may the invention be embodied using more elements than depicted in Figure 1, wherein functions carried out by one component in the embodiment provided are distributed over multiple components.

A person skilled in the art will readily appreciate that various parameters disclosed in the description may be modified and that various embodiments disclosed and/or claimed may be combined without departing from the scope of the invention.

It is stipulated that the reference signs in the claims do not limit the scope of the claims, but are merely inserted to enhance the legibility of the claims. In summary, the invention relates to the following:

Navigation on today's consumer electronics devices is cumbersome as fast forward and rewind operation cost a lot of time and are not very accurate. As the number of input means is usually limited - usually, no mouse is provided, nor desired to enhance the lean-back experience - the ways of implementing other ways of navigating are difficult to find. However, the invention has provided a method requiring a limited amount of input means that is yet more accurate. In an advantageous embodiment, clear feedback is provided by means of navigation bars and visual indicators.

Related documents: US-20030184598 Al US-20020167540 A1

Claims

CLAIMS:

1. Method of navigating a stream of audiovisual data, comprising: a) Reproducing the stream at a first point; b) Entering a jump mode; c) Receiving a jump distance; d) Reproducing the stream at a second point, the second point being located at substantially the jump distance from the first point.

2. Method as claimed in claim 1, comprising a) representing the audiovisual stream as a first line or a first bar; b) indicating the first point on the first bar or the first bar by a first visual indicator; c) allowing setting a second visual indicator, thus receiving the jump distance as the distance between the point indicated by the first visual indicator and the point indicated by the second visual indicator; and d) receiving a confirmation to reproduce the stream at a location indicated by the second visual indicator.

3. Method as claimed in claim 2, comprising visually indicating at least one event in the stream of audiovisual data on the first bar.

4. Method as claimed in claim 3, comprising: a) Allowing setting the second visual indicator at least near the location of the event; and b) When the second visual indicator is not set at the start of the nearest event, setting the second visual indicator to the start of the nearest event.

5. Method as claimed in claim 2, wherein the second visual indicator is a first end of a second line or a second bar and the second end of the line or the bar is at the first point.

6. Method as claimed in claim 1, wherein the jump distance is received by means of cursoring means.

7. Method as claimed in claim 6, wherein the cursoring means comprise two buttons, a first button for increasing the jump distance and a second button for decreasing the jump distance.

8. Apparatus for navigating a stream of audio visual data, comprising input means connected to reproduction means, the reproduction means being operative Iy connected to a memory for storing a stream of audiovisual data, the input means conceived to receive a command to let the apparatus enter a jump mode and to receive information on a jump distance and the reproduction means conceived to initially reproduce the stream of audiovisual data at a first point and after the apparatus has received the jump distance, reproduce the stream of audiovisual data at a second point, the second point being located at substantially the jump distance from the first point.

9. Computer programme product for programming a computer to execute the method as claimed in claim 1.

10. Record carrier having stored thereon the computer programme product as claimed in claim 9.