CN103168297B - For generating the system and method for the visual summary of the content of multimedia of previously viewing - Google Patents

For generating the system and method for the visual summary of the content of multimedia of previously viewing Download PDF

Info

Publication number
CN103168297B
CN103168297B CN201080069709.7A CN201080069709A CN103168297B CN 103168297 B CN103168297 B CN 103168297B CN 201080069709 A CN201080069709 A CN 201080069709A CN 103168297 B CN103168297 B CN 103168297B
Authority
CN
China
Prior art keywords
content
multimedia
fragment
display
electronic installation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201080069709.7A
Other languages
Chinese (zh)
Other versions
CN103168297A (en
Inventor
大卫·德利昂
B·林德伯格
J·马腾森
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Mobile Communications Inc
Filing date
Publication date
Application filed by Sony Mobile Communications Inc filed Critical Sony Mobile Communications Inc
Priority claimed from PCT/IB2010/002672 external-priority patent/WO2012052790A1/en
Publication of CN103168297A publication Critical patent/CN103168297A/en
Application granted granted Critical
Publication of CN103168297B publication Critical patent/CN103168297B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

A kind of for restarting multimedia content playback to carry out the method (100) and the electronic installation (10) that show on the electronic device.The method includes: receiving from user input apparatus (20) and order to show content of multimedia, wherein, described content of multimedia includes the content of multimedia previously watched and the content of multimedia do not watched;Select one or more fragment of the previously content of multimedia of viewing;Display (18) at described electronic installation above shows the thumbnail corresponding with one or more selected fragment, to provide the visual summary of the content of described previous viewing;And the content of multimedia do not watched described in display after showing at least one of described visual summary on the display is at least some of.

Description

For generating the system and method for the visual summary of the content of multimedia of previously viewing
Technical field
The present invention relates to the system and method for showing content of multimedia.Specifically, it is desirable to provide weighing The visual summary of the content of multimedia of the previously viewing before newly starting the content of multimedia do not watched.
Background technology
Mobile phone is evolved to multi-functional electronic installation from the electronic installation of only voice.Such as, mobile phone is present Electronic notebook, digital camera, voice applications (such as, MP3 player), Video Applications can be served as (such as, Video player), video gaming terminal etc..And, mobile phone is applied not only to voice communication, and they are also used (such as, in instant message transrecieving application, shared picture, the information etc. accessed on the Internet in other forms various In).
It addition, consumer consumes the video content in their mobile device with the fastest speed.ExceptOn short video clipping beyond, people the most also watch in their mobile device longer film, TV performance and video podcast.Because the user of mobile device does not the most have the long continual period, so generally Longer content of multimedia is consumed in multiple separate time periods.Lattice in the mobile environment that the probability interrupted is the biggest Outer such.
Summary of the invention
When have no progeny in longer the playback restarting content of multimedia on the mobile device time user faced by ask Topic is to recall the content just occurred before interrupting.Such as, " in story, what there occurs?”;" in speech first Before what has been said?" etc..Problem that be correlated with and of equal importance is to obtain previously with appropriate emotion or mood The general survey of content does not watches part with viewing content of multimedia.
There are the strong needs for the system and method being dynamically generated visual summary, to interrupt user The user of electronic installation is helped to recall previously viewing when restarting to watch content of multimedia after (or spontaneous rest) Content.
One aspect of the present invention relates to restart multimedia content playback to show on the electronic device Method, the method includes: receive for presenting the order of content of multimedia from user input apparatus, wherein, many matchmakers Internal appearance includes the content of multimedia previously watched and the content of multimedia do not watched;In selecting the multimedia of previously viewing One or more fragment held;Display and one or more selected fragment phase on the display of electronic installation Corresponding thumbnail, to provide the visual summary of the content of previously viewing;And display is at least some of over the display Visual summary after show at least some of of the content of multimedia do not watched.
Another aspect of the present invention relates to selecting one or more fragment based on Piece Selection algorithm.
Another aspect of the present invention relates to based on the previous viewing that the content of multimedia previously watched is divided into fixed amount Fragment select one or more fragment.
Another aspect of the present invention relates to the part of the fragment by each previous viewing and carries out being polymerized being formed one or more Multiple fragments.
Another aspect of the present invention relates to presenting one or more selected sheet over the display with pasteup form The respective thumbnail of section.
Another aspect of the present invention relates to chronological order based on the previously content of viewing and presents selected in a sequential manner The respective thumbnail of one or more fragment selected.
Another aspect of the present invention relates at least one of display receiving user's input to walk around visual summary.
An aspect of of the present present invention relates to a kind of electronic installation, and this electronic installation includes: memorizer, and it is used for storing many matchmakers Internal appearance and content look back application;User input apparatus, for receiving in being currently stored on described electronic installation The order of content of multimedia, wherein, content of multimedia includes at least one multimedia application, at least one many matchmaker described Body application includes the content of multimedia previously watched and the content of multimedia do not watched;Processor, it is defeated that it is connected to user Entering device and memorizer, wherein, processor is looked back application according to content and is processed the content of multimedia of previously viewing, To select one or more fragment to form visual summary, described visual summary include with in the multimedia previously watched The corresponding thumbnail of one or more selected fragment held;And display, it is connected to described processor, Wherein, described display display do not watch content of multimedia at least some of before by visually summary be presented to close The electronic installation of connection.
Another aspect of the present invention relates to the electronic installation as mobile phone.
Another aspect of the present invention relates to the user input apparatus as keyboard.
Another aspect of the present invention relates to the user input apparatus as touch screen.
Another aspect of the present invention relates to content review application and processes many matchmakers of previously viewing based on Piece Selection algorithm Internal appearance.
Another aspect of the present invention relates to based on the previous viewing that the content of multimedia previously watched is divided into fixed amount Fragment come one or more fragment.
Another aspect of the present invention relates to carrying out the thumbnail of the fragment for each previous viewing accumulating to be formed visually Summary.
It is to present pasteup over the display that another aspect of the present invention relates to visually making a summary, and wherein, pasteup includes Each thumbnail being associated with one or more selected fragment.
Another aspect of the present invention relates at least one thumbnail and is associated with the video clipping of selected fragment.
Another aspect of the present invention relates to visually making a summary, and described visual summary includes the time based on the previously content of viewing Order presents the selected respective thumbnail of one or more fragment in a sequential manner.
Another aspect of the present invention relates to visually making a summary, and described visual summary includes be embedded in described visual summary one Individual or more advertisements.
Another aspect of the present invention relates to visually making a summary, and described visual summary includes be in described visual summary one Or more product space index.
After have studied following figure and detailed description, to those skilled in the art, other of the present invention is System, device, method, feature and advantage will be apparent from or will be apparent from.Be intended to by such additional system, Method, feature and advantage are included in this description, within the scope of the invention, and are protected by claims Protect.
It should be emphasized that, when using wording " to include " in this manual, be used to specify stated feature, important document, Step or the existence of assembly, but it is not excluded for one or more further feature, important document, step, assembly or their group Existence or interpolation.
Accompanying drawing explanation
Previously described embodiment of the invention and other embodiment are discussed referring to the drawings.Assembly in figure is the most necessarily It is drawn to scale, and focuses on the principle clearly illustrating the present invention.In like manner, the unit described in one drawing Part and feature can combine with the element described in other figure and feature.And, in the drawings, identical label passes through Wear the parts that the instruction of several figures is corresponding.
Fig. 1 is the schematic diagram of a kind of embodiment of the mobile phone as exemplary electronic device according to the present invention.
Fig. 2 is the schematic block diagram of the relevant portion of the mobile phone of Fig. 1.
Fig. 3 is the schematic diagram that the mobile phone of wherein Fig. 1 can carry out the communication system operated.
Fig. 5 to Fig. 7 is to represent one or more fragment of selection content of multimedia according to aspects of the present invention and show Show the flow chart of the illustrative methods of the visual summary of content of multimedia.
Fig. 8 is that exemplary collage according to aspects of the present invention is drawn.
Detailed description of the invention
In detailed description subsequently, similar assembly is provided identical label, regardless of whether in the present invention Different embodiments in be illustrated.In order to illustrate the present invention in the way of understanding and be succinct, these figures are the most necessarily It is drawn to scale, and specific feature can illustrate according to certain schematic form.Retouch now with reference to accompanying drawing Stating the present invention, wherein, identical label is used for representing similar element all the time.
Term " electronic installation " includes any kind of device utilizing electric component to perform communication task, and includes Such as mobile phone, pager, communication equipment, electronic notebook, PDA(Personal Digital Assistant), smart phone, Such armamentarium such as portable communication appts.Other exemplary electronic device can include but not limited to portable matchmaker Body player, media player, playback reproducer, media player, device for reproducing digital video disc etc..In this application, The mainly present invention described in the background of mobile phone.However, it will be appreciated that the present invention is not limited to mobile phone, And can be any kind of electronic installation.
The present invention relates to the system and method for showing content of multimedia, wherein, be suspended at viewing content of multimedia And/or by the content of multimedia previously watched after interrupting and before continuing the content of multimedia previously do not watched Visual summary presents to user.Such as, the user of electronic installation formed in an electronic and/or be connected to On the display of electronic installation, viewing has the TV programme of certain persistent period.When watching TV programme and reaching one section After between, user is interrupted and must suspend and/or stop to watch TV programme.After one hour, user wants to continue to see See the remainder of TV programme.
When restarting the playback of content of multimedia after the interruption, the problem faced by user is to recall generation before interruption What.Such as, " in story, what there occurs?”;" in speech, what was previously said?" etc..Relevant And problem of equal importance be make user return to appropriate emotion and/or mood with watch content of multimedia spy Determine part.
With reference to Fig. 1, it is shown that electronic installation 10 according to aspects of the present invention.Illustrated in the exemplary embodiment Electronic installation 10 be mobile phone, and mobile phone 10 will be referred to as.Mobile phone 10 is shown as having " brick Block " or the housing of form factors (form factor) of " block ", it will be appreciated that, it is possible to use other type Housing, such as " renovate " form factors (such as, " Concha Meretricis Seu Cyclinae " housing), sliding type form factors (such as, " sliding cover type " housing);Or the housing of such as type of touch screens.
With reference first to Fig. 1 and Fig. 2, it is shown that illustrative mobile phone 10.As will be discussed below, mobile phone 10 include the visual summary application 14 that can be stored in the memorizer (such as, memorizer 16) of mobile phone 10. Visual summary application 14 may be used for having no progeny in viewing content of multimedia occurs restarting returning of content of multimedia Put.In general, user inputs order to proceed the content of multimedia being presented to user the most completely to represent.Cause And, the content of multimedia generally including previously viewing (such as, has been presented in the multimedia of user by content of multimedia Hold) and the content of multimedia (content of multimedia that such as, user not yet watches) do not watched.Visual summary application 14 It is typically chosen one or more fragment of the previously content of multimedia of viewing, and shows on the display of electronic installation The thumbnail corresponding with one or more selected fragment is to provide the visual summary of the content of previously viewing.? After showing visual summary, the content of multimedia do not watched can be presented to user.Pin purpose of this disclosure, contracting Sketch map be for provide the image of the biggest version and/or the video clipping that is associated with thumbnail such other The image of the down-scaled version of the link of content.
Mobile phone 10 can include display 18.Display 18 can be integrated with mobile phone 10, or display Device may be coupled to mobile phone (such as, being similar to be connected to the DVD player of television set).Display 18 leads to The graphic user interface (GUI) crossing the various functions allowing users to utilize mobile phone 10 displays to the user that such as Such information such as duty, time, telephone number, associated person information, various navigation menus.Display 18 Can be also used for visually showing the content received by mobile phone 10 and/or from memorizer 16(Fig. 2) maybe can grasp It is connected to other memory element content retrieved of mobile phone 10 with making.Display 18 may be used for mobile electricity The user of words 10 presents content of multimedia.Content of multimedia can be any kind of content, and include such as image, Video and such as photo other figure such, internet content, status information, film, song, video, blog, By various menu navigations and/or the application etc. that is associated with mobile phone 10.
Mobile phone 10 can also include user input apparatus 20.Such user input apparatus can be keyboard, touch Touch screen (not shown), mike 22 and/or navigation key 24.User input apparatus 20 generally provides multiple user input Operation.Such as, user input apparatus 20 can include digital alphabet key, to allow to input such as telephone number, electricity Such alphanumeric information (such as, keyboard) such as words list, associated person information, note.It addition, user's input Device 20 can include special function keys 26, " calling sends " key such as called and use for initiation or response In " end of calling " key terminated or " hanging up " calls.Special function keys 26 can also include menu navigation and choosing Select key to contribute to by showing that menu on display 18 navigates.For example, it is possible to exist pointing device and/ Or navigation key inputs with the orientation accepted from user.Special function keys 26 can include audiovisual content playback keys, with Start, stop and suspending playback, skip or repeat track (track) etc..Other key being associated with mobile phone can To include volume key, mute key, ON/OFF power key, web browser launch key, camera key etc..Key or with key class As function can also be implemented as the touch screen being associated with display 18.It addition, display 18 and user are defeated Entering device 20 can be in combination with each other to realize soft key.
Mobile phone 10 includes that call circuit, call circuit make mobile phone 10 (can lead to called/calling device It is often another mobile phone or landline telephone) set up calling and/or exchange signal.But, called/calling device Being not required to is another phone, but can be such as Internet Explorer web browser, content providing server etc. such some its Its device.Can call to use any suitable form.Such as, calling can be via cellular circuit-switched network The regular call that network is set up, or the packet-switching performance or via such as WiFi(such as via cellular network, Network based on IEEE802.11 standard), WiMAX(such as, network based on IEEE802.16 standard) etc. The packet switching network of such alternative and voice (VoIP) calling in the Internet Protocol set up.Another example bag Include the calling that can carry out video set up via cellular network or the network of alternative.
Mobile phone 10 can be configured to such as text message that (such as, text message is referred to as by some people " SMS ", represents simple messenger service), instant message, email message, Multimedia Message (such as, many Media information is referred to as " MMS " by some people, represent multimedia information service), image file, video file, Audio file, tone, audio stream, video flowing, data feeding such data such as (including blog) are transmitted, Receive and/or process.Such data carry out process may include that and store data in the memory 16;Performing should In order to allow user to interact with data;Show video content associated with data and/or picture material;Output Sound etc. associated with data.
Fig. 2 shows the functional block diagram of mobile phone 10.In order to briefly, will not be described in detail mobile electricity here The general conventional function of words 10.Mobile phone 10 includes that main control circuit 30, main control circuit 30 are configured For the function of mobile phone 10 and operation are carried out overall control.Control circuit 30 can include such as CPU, micro- Controller or the such processing means of microprocessor 32.Processing means 32 performs to be stored in depositing in control circuit 30 In reservoir (not shown) and/or be stored in the code in the such single memorizer of such as memorizer 16, to hold The operation of row mobile phone 10.Memorizer 16 e.g. buffer, flash memory, hard disk drive, removable media, In volatile memory, nonvolatile memory, random access memory (RAM) or other suitable device one Or it is more.
Memorizer 16 can store the content of multimedia from any source.For example, it is possible to from server (such as, because of Special net,Deng) download content of multimedia, from storage device (such as, CD drive, Flash drive, SD,Deng) read content of multimedia.Content of multimedia can include locally Be stored in memorizer 16(Fig. 2 of mobile phone 10) in and/or remotely store (such as, from mobile phone 10 In remote storage, media server, remote personal computer etc.) audio frequency and/or video express.Permissible From such as including the multimedia file of audio frequency and/or video file, from the mobile radio received and/or TV signal Deng the such expression of acquisition.As a rule, video is expressed and is attended by audio representation.Such as, shown video Component can be TV programme and/or music video, and wherein, corresponding audio component can be intended to and video component The audio frequency of synchronised.As another example, shown video component can correspond to the mobile television signal received, And the audio component of correspondence can be intended to the voice Tong Bu with video component and/or music.
It is raw to contribute to that memorizer 16 can also store one or more application (such as, visual summary application 14) Become the most visual summary.Memorizer 16 is operably connected to processor 32 to perform institute in processor One or more application of storage.Processor 32 is programmed to carry out functionality described herein, such as, controls One or more software application, receive and store user input, generate visual summary etc..
Processing means 32 can perform to achieve the code of visual summary application 14.For computer programming field, tool Body ground is for the technical staff for the application programming field of mobile phone or other electronic installation, how to mobile electricity It will be obvious that words 10 program the logic function being associated to operate and to perform described herein and visual summary application 14 's.Therefore, in order to briefly, eliminate the details about concrete programming code.Although it addition, can be according to this Bright preferred implementation is performed visual summary application 14 by processing means 32, but without departing from the scope of the present invention In the case of, such function can also be performed by special hardware, firmware, software or combinations thereof.
With continued reference to Fig. 1 and Fig. 2, mobile phone 10 includes the antenna 34 being connected to radio circuit 36.Such as routine As, radio circuit 36 includes radiofrequency launcher and receptor for sending and receive signal via antenna 34. Radio circuit 36 can be configured to carry out in mobile communication system operating and may be used for send and receive data And/or audio-visual content.The receiver types interacted with mobile radio telephone network and/or radio network includes (but not Be limited to) GSM, CDMA, WCDMA, GPRS, WiFi, WiMax, DVB-H, ISDB-T etc. and The Advanced Edition of these standards.
Mobile phone 10 also include audio signal processing circuit 38, audio signal processing circuit 38 be used for locating reason without Line electricity circuit 36 send audio signal and from radio circuit 36 receive audio signal.It is connected to acoustic processing Circuit 38 is speaker 40 and mike 42, and as is conventional, speaker 40 and mike 42 make user Can listen to by mobile phone 10 and talk.
Radio circuit 36 and audio signal processing circuit 38 are connected respectively to control circuit 30 to perform overall operation. Voice data can be delivered to audio signal processing circuit 38 to play back audio frequency to user from control circuit 30.Audio frequency number According to such as can include from storage audio file in the memory 16 and by the audio frequency acquired in control circuit 30 Data, or such as from the voice data received that the voice data of mobile radio service is streamed.At sound Reason circuit 38 can include any suitable buffer, decoder, amplifier etc..
Display 18 can be connected to control circuit 30 by video processing circuits 44, and video processing circuits 44 will regard Frequency is according to being converted to the video signal for being driven display 18.Video processing circuits 44 can include any Suitable buffer, decoder, video data processor etc..Video data can generate by control circuit 30, by Visual summary application 14 generates, obtains from the video file stored in the memory 16, from by radio circuit 36 The Incoming video data stream received is obtained or is obtained by other suitable method any.
Mobile phone 10 can also include one or more I/O interface 46.I/O interface 46 can be general shifting The form of mobile phone I/O interface also can include one or more electric connector.Typically, I/O interface 46 is permissible For mobile phone 10 being connected to battery charger with the electricity to the power subsystem (PSU) 48 in mobile phone 10 Pond is charged.As supplement or alternatively, I/O interface 46 may be used for mobile phone 10 is connected to headphone set Part (such as, individual's hands-free (PHF) device), headset assembly has and the wireline interface of mobile phone 10.Additionally, I/O interface 46 may be used for via the data cable being used for data exchange, mobile phone 10 is connected to personal computer Or other device.When being connected to vehicle power adapter or power outlets power supply adaptor, mobile phone 10 can To receive operation electric power via I/O interface 46.
Mobile phone 10 can also include system clock 50, and system clock 50 is for such as control circuit 30 so The various assemblies of mobile phone 10 be timed.Control circuit 30 then timing function can be performed, such as to exhaling The persistent period cried is timed, generates the content etc. of timestamp and dater.
Mobile phone 10 can include the camera 52 for shooting digital picture and/or film.With picture and/or film Corresponding image and/or video file can store in the memory 16.Mobile phone 10 can also include position Data sink 54, such as global positioning system (GPS) receptor, Galileo satellite system receiver etc..
Mobile phone 10 can also include such as infrared transceiver and/or RF interface (such as, blue tooth interface, IEEE 802.11 compatibility interfaces) such local wireless interface 56, with adnexa, another mobile radio terminal, calculating Machine, another device, the remote source etc. of content of multimedia set up communication.Such as, local wireless interface 56 can be grasped Mobile phone 10 is connected to making remote server (such as, Internet server) and is stored in remotely clothes to download Content of multimedia on business device.
Referring additionally to Fig. 3, mobile phone 10 can be configured to the part as communication system 70 and operate. System 70 can include having server 74(or multiple server) communication network 72, server 74 is used for managing Reason mobile phone 10 initiate calling and go to mobile phone 10 calling, send to mobile phone 10 data with And perform other support function any.Communication network 72 can also include multimedia server 76.As made herein , " multimedia server " be have on it storage content of multimedia and/or can be accessed with from separately One server obtains the server of content of multimedia.Multimedia server 76 can provide content of multimedia with by moving Phone 10 or other electronic installation show.As explained above, such content of multimedia can include film, TV programme, blog, internet content etc..
Each assembly (such as, server 74 and multimedia server 76) of communication network 72 passes through one or more Plant different transmission mediums to communicate with mobile phone 10.Transmission medium can be any suitable device or assembly, It includes such as communication tower (such as, cell tower), another mobile phone, WAP, satellite etc..Part Network can include wireless propagation path.Network 72 can support that multiple mobile phone 10 and other type of terminal are used The communication activity of family device.As will be understood, server 74 and 76 can be configurable for performing server merit The general computer system of energy, and processor can be included, processor is configured to execution and comprises the service of achieving The software of the logical order of the function of device 74 and 76.
Referring additionally to Fig. 4, exemplified with realizing the logical operation of illustrative methods 100, illustrative methods 100 is for pin Display on the electronic device is restarted the playback of content of multimedia.Method 100 is typically used for when user watches Content of multimedia situation when being interrupted before content of multimedia terminates or experience long time-out.People in the art Member will readily appreciate that, the storehouse that method 100 can be also used for recording such as search music and/or video is such User is mutual.The various music and/or the video frequency abstract of video content watched exemplified with user can be provided.
At frame 102, the method includes receiving the order presenting content of multimedia from user input apparatus.For the disclosure Purpose, it will be assumed that content of multimedia includes the content of multimedia previously watched and the content of multimedia do not watched.
At frame 104, one or more fragment of the content of multimedia previously watched can be selected, for use as previously seeing The visual summary of the content of multimedia seen.One or more fragment can be selected by any suitable mechanism.Example As, with reference to Fig. 5, in one embodiment, by the part of the previously viewing of content of multimedia is further subdivided into solid Fixed amount selects one or more fragment.The person skilled in the art will easily understand, such as can be by user Being configured the number of fragment, the length of the part of viewing based on content of multimedia dynamically determines the number of fragment Mesh, is selected the number of fragment by the creator of content.
In Figure 5, content of multimedia is divided into two parts.Part I is the content (A) of previously viewing, and And Part II is the content (B) do not watched.For convenience, the content (A) of previously viewing be shown in solid and The content (B) do not watched is shown in broken lines.The content (A) of viewing extends to t from time t=0p=15 minutes, its Middle t=0 is the beginning of content of multimedia, and tpIt it is content of multimedia time of being stopped by user and/or suspending.t=0 To tpThis period corresponding to the elapsed-time standards of content of multimedia of viewing.From tpTo tFinallyPeriod corresponding to not seeing The content of multimedia seen.
As set forth above, it is possible to one or more fragment of the previously content of multimedia (A) of viewing is carried out subdivided. As it is shown in figure 5, there are eight (8) individual selected fragments (S1 to S8).Such as, by being experienced simply Time select these fragments divided by the number of fragment.Equally, the fragment started at each specified time slot can To be selected as visually making a summary.Such as, if TV programme have a persistent period of a length of 25 minutes, and User the most formerly have viewed 15 minutes before suspending and/or additionally stopping playback the TV programme on mobile phone 10, Then by content of multimedia and the content of multimedia do not seen of 10 minutes of the existence previously viewing of 15 minutes.15 minutes The content of multimedia of previously viewing can be divided into the number of selected fragment and (such as, illustrate in Figure 5 8 fragments).Thus, selected multimedia content segments was such as included within every 1/N* the time experienced The fragment (wherein, N is the number of fragment) occurred.
Another embodiment of the present invention illustrates in figure 6.In figure 6, according to algorithm carry out subdivided (such as, S1 to S9).Such as, algorithm can correspond to the standardized curve being mapped on the content of multimedia of previously viewing. More sample point is placed at the beginning of the sequence of the content that such algorithm can previously be watched and end, or Place more sample point in centre, or at end, place more sample point, to meet of human memory Or more model.Such as, the model of human memory is it has been shown that people is to the beginning fragment of content of multimedia and end Fragment has preferably memory.Alternatively, it is also possible to consider three acts of formula structures of playwright, screenwriter's type.As shown in Figure 6, pass through The mid portion making the content previously watched has more sheet than in the beginning of this content and/or latter end Section, it is possible to achieve such three acts of formula structures.Such as, Fig. 6 (is S1 exemplified with having two (2) individual fragments respectively To S2 and S8 to S9) beginning and latter end, mid portion has five (5) individual selected sheets simultaneously Section.
In another embodiment, as about described by Fig. 5 and Fig. 6, fragment can be calculated, except each fragment Beginning can posteriorly or anteriorly adjust with fall disappear as black after nearest fragment on (this most dramatically with field Change in scape is correlated with) beyond;The most posteriorly or anteriorly it is adjusted to the chapter construction of nearest hard coded;From a series of soon The scene changes of speed posteriorly or anteriorly adjusts;From the fragment comprising lasting dialogue and/or be attended by content of multimedia The strong fragment after track posteriorly or anteriorly adjusts.Furthermore it is possible to the one of content of multimedia based on previously viewing Individual or more characteristics are dynamically selected and/or adjust fragment.
In another illustrated in the figure 7 embodiment, sheet can be limited in advance for the part of whole content of multimedia Section.Such as, if at t1Suspending occurs in place, then fragment S1 and S2 will be selected to form visual summary.If t2Suspending occurs in place, then fragment S1 to S5 will be selected to form visual summary.In like manner, if at t3Suspending occurs in place, Fragment S1 to S7 will be selected to form visual summary.
There is provided be the purpose in order to illustrate for the above method selecting one or more multimedia content segments and It is not meant to limit scope of the following claims.
At frame 106, the display of electronic installation shows the contracting corresponding with one or more selected fragment Sketch map, to provide the visual summary of the content of previously viewing.The thumbnail that the fragment selected with each is associated is entered Row polymerization is to form visual summary.Visual summary can present according to any desired mode.At a kind of embodiment In, visual summary presents with the expression pattern of pasteup pattern.In another embodiment, visual summary is with order Expression pattern presents.
With reference to Fig. 8, in pasteup CSS expression patterns, can be by for one or more selected fragment The grid of tactic thumbnail realize the content of multimedia of previously viewing is extracted summary.Thumbnail can be The rest image of previous content of multimedia or the circulation of short video.As shown in Figure 8, contracting is shown in an orderly manner Sketch map 1 to 8, and video clipping constitutes last thumbnail.User can select one or more thumbnail. When selecting or perform visually to make a summary, each thumbnail can be exaggerated and occupy the screen of major part.Once with elder generation The thumbnail that the last fragment of the content of front viewing is corresponding is presented to user, then not the watching of content of multimedia Part can then be presented to user.
Exemplary collage illustrated in fig. 8 can be revised in many ways draw.Such as, exist and may be used for Illustrate the various thumbnails corresponding with selected fragment is permitted eurypalynous layout.Such as, for one Or the thumbnail of the fragment selected by more can be of different sizes.It is to say, thumbnail is not required to have phase With size, and layout can be similar to such as one or more comic strip layout.Can be for any stopping Point is dynamically generated pasteup grid illustrated in fig. 8.Such as, in example illustrated in fig. 8, if User have viewed the content of multimedia (such as, film " Wolverrine ") of more than 10 minute and then stops, then with Fragment and/or the thumbnail of the selection that selected fragment is corresponding can be different, such as can generate with in Fig. 8 The thumbnail that illustrated thumbnail is different.In another embodiment, can following any one or more show The visual summary of display in example disposition scape: when user selects the content of previously viewing from list;When visual summary is merged To full screen video library browse mode;As long as or video frequency abstract just can be shown when suspending content of multimedia.
In the expression pattern of order, visual summary can be to restart the content of multimedia at last halt The form of the short sequence before played back.Selected video segment can automatically be arranged as short video frequency abstract.Deposit Can be by such summary sequence editor many modes together.For example, it is possible to each selected fragment it Between carry out video transition.Such video transition effect can include that such as 3D rotates, assembles, ejects and end is taken the photograph Processed group of staff list move, be fade-in fade-out, decompose, rotate, scaled and bending transformation etc..Other effect can To include such as fast motion, slow motion, reverse faster slower action, brightness and contrast, electric current and illusion particle effect.
Can be in conjunction with in another embodiment of both pasteup expression pattern and sequential expression pattern, it is also possible to will Advertisement and/or product space index are incorporated in visual summary.Such as, visual summary can include by content of multimedia Publisher, the creator of content of multimedia and/or one or more advertisement selected by third party.Such extensively Announcement can correspond to that illustrate in content of multimedia and/or relevant with content of multimedia one or more of products Product and/or service.In one embodiment, advertisement can correspond to a series of products illustrated in content of multimedia Product and/or service.User can select one of product and/or service.When selecting, can in visual summary to Family show selected by product and/or one or more thumbnail of video and/or video clipping.
At frame 108, show what at least some of rear display of visual summary was not watched at least partially over the display Content of multimedia.In general, before displaying to the user that the content of multimedia do not watched, the most visually make a summary by Present to user.Mechanism (bypass mechanism) is got around to allow user to skip part however, it is possible to utilize Or whole visual summaries.The mechanism of getting around can be that user may indicate that and skips or get around part or all of visually plucking Any mechanism of the intention wanted.In general, can be operable to perform by user to user input equipment 20 Such get around mechanism, such as, by pressing key, navigate out from visual summary.
In a word, (such as, the content of multimedia partly watched is typically included the content of multimedia of previously viewing Present to the content of multimedia of user) and the content of multimedia (multimedia that such as, user not yet watches do not watched Content).Visual summary application 14 is typically chosen one or more fragment of the previously content of multimedia of viewing, and Thumbnail and/or the video clipping of one or more selected fragment is shown, to carry on the display of electronic installation Visual summary for the content of previously viewing.After having shown that visual summary, the multimedia that can will do not watch Content presents to user.
Illustrative methods can be performed by performing the embodiment of such as visual summary application 14.Therefore, it is possible to It is thought of as the flow chart of Fig. 4 describing by the step of the method performed by mobile phone 10.Hold although Fig. 4 shows The particular order of row functional logic blocks, but the order being carried out frame can change relative to shown order.It addition, Two or more frames illustrated continuously can perform simultaneously or partial concurrence performs.Specific frame can also be omitted. It addition, for the purpose strengthening effectiveness, final accounts (accounting), performance, measurement, failture evacuation etc., can be by Any number of function, logical operation, order, state variable, signal or message add logic flow to.It should be understood that , all such changes are within the scope of the invention.
Although with reference to specifically preferred embodiment illustrate and describing the present invention, it will be appreciated that, ability Field technique personnel can make equivalent and amendment after reading and understanding description.The present invention includes the most such Equivalent and amendment, and only limited by the scope of claim below.

Claims (7)

1. it is used for restarting multimedia content playback with the method carrying out showing on electronic installation (10), The method includes:
The order for presenting content of multimedia, wherein, described content of multimedia is received from user input apparatus (20) Including the content of multimedia previously watched and the content of multimedia do not watched, and wherein, described content of multimedia includes The fragment limited in advance for the part of whole described content of multimedia;
Select described previous viewing content of multimedia one or more described in the fragment that limits in advance;
Display (18) at described electronic installation above shows the contracting corresponding with one or more selected fragment Sketch map, to provide the visual summary of the content of described previous viewing;And
The multimedia do not watched described in display after showing at least one of described visual summary on the display Content at least some of;
Wherein, one or more characteristic of content of multimedia based on described previous viewing be dynamically selected and/or The fragment limited in advance described in adjustment.
Method the most according to claim 1, wherein, presents selected on the display with pasteup form The respective thumbnail of one or more fragment selected.
Method the most according to claim 2, wherein, the chronological order of content based on described previous viewing with The mode of order presents the selected respective thumbnail of one or more fragment.
Method the most as claimed in any of claims 1 to 3, the method also includes: receive user's input To get around at least one of display of described visual summary.
5. an electronic installation (10), this electronic installation includes:
Memorizer (16), is used for storing content of multimedia and content looks back application (14);
User input apparatus (20), for receiving in the content of multimedia being currently stored on described electronic installation Order, wherein, described content of multimedia includes at least one multimedia application, at least one multimedia application bag described The content of multimedia including previously viewing and the content of multimedia do not watched, and wherein, described content of multimedia includes pin The fragment that the part of whole described content of multimedia is limited in advance;
Processor (32), is connected to described user input apparatus and described memorizer, wherein, described processor according to Described content is looked back application and is processed, the content of multimedia of described previous viewing to select described previous viewing many The fragment limited in advance described in one or more of media content forms visual summary, described visual summary include with The thumbnail that one or more selected fragment of the content of multimedia of described previous viewing is corresponding;And
Display (18), is connected to described processor, and wherein, described display is the many matchmakers not watched described in display At least some of electronic installation that before described visual summary is presented to association of internal appearance;
Wherein, one or more characteristic of content of multimedia based on described previous viewing be dynamically selected and/or The fragment limited in advance described in adjustment.
Electronic installation the most according to claim 5, wherein, described electronic installation is mobile phone.
Electronic installation the most according to claim 5, wherein, described user input apparatus (20) be from by with Under every composition group in select at least one:
Keyboard and touch screen.
CN201080069709.7A 2010-10-19 For generating the system and method for the visual summary of the content of multimedia of previously viewing Expired - Fee Related CN103168297B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2010/002672 WO2012052790A1 (en) 2010-10-19 2010-10-19 System and method for generating a visual summary of previously viewed multimedia content

Publications (2)

Publication Number Publication Date
CN103168297A CN103168297A (en) 2013-06-19
CN103168297B true CN103168297B (en) 2016-11-30

Family

ID=

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818439A (en) * 1995-02-20 1998-10-06 Hitachi, Ltd. Video viewing assisting method and a video playback system therefor
CN101112090A (en) * 2004-12-03 2008-01-23 日本电气株式会社 Video content reproduction supporting method, video content reproduction supporting system, and information delivery program
CN101308501A (en) * 2008-06-30 2008-11-19 腾讯科技(深圳)有限公司 Method, system and device for generating video frequency abstract

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818439A (en) * 1995-02-20 1998-10-06 Hitachi, Ltd. Video viewing assisting method and a video playback system therefor
CN101112090A (en) * 2004-12-03 2008-01-23 日本电气株式会社 Video content reproduction supporting method, video content reproduction supporting system, and information delivery program
CN101308501A (en) * 2008-06-30 2008-11-19 腾讯科技(深圳)有限公司 Method, system and device for generating video frequency abstract

Similar Documents

Publication Publication Date Title
US8769571B2 (en) System and method for generating a visual summary of previously viewed multimedia content
US20220342519A1 (en) Content Presentation and Interaction Across Multiple Displays
US11621022B2 (en) Video file generation method and device, terminal and storage medium
CN112911379B (en) Video generation method, device, electronic equipment and storage medium
JP6065019B2 (en) REPRODUCTION CONTROL DEVICE, REPRODUCTION CONTROL METHOD, AND PROGRAM
JP5728624B2 (en) Music playback method, third party application and apparatus
US7920901B2 (en) System and method for providing visual indicators in a media application
CN109547841B (en) Short video data processing method and device and electronic equipment
EP2274683B1 (en) Method and apparatus for transferring digital content from a personal computer to a mobile handset
JP2010536077A (en) System and method for creating thumbnail images for audiovisual files
CN109597900A (en) The management of local and remote media item
CN101779245A (en) System and method of using music metadata to incorporate music into non-music applications
CN104636475B (en) Optimize the method and device of multimedia file memory space
CN108228776A (en) Data processing method, device, storage medium and electronic equipment
CA2623080C (en) A system and method for providing visual indicators in a media application
CN103168297B (en) For generating the system and method for the visual summary of the content of multimedia of previously viewing
US9020914B2 (en) Automatic song selection
US12033671B2 (en) Video generation method and apparatus, electronic device, and storage medium
CA2806485A1 (en) System and method for determining a location-based preferred media file
KR20160014820A (en) Terminal and method for providing alarm

Legal Events

Date Code Title Description
PB01 Publication
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: Longde, Sweden

Applicant after: SONY MOBILE COMMUNICATIONS Inc.

Address before: Longde, Sweden

Applicant before: SONY ERICSSON MOBILE COMMUNICATIONS AB

TA01 Transfer of patent application right

Effective date of registration: 20161102

Address after: Tokyo, Japan

Applicant after: SONY MOBILE COMMUNICATIONS Inc.

Address before: Longde, Sweden

Applicant before: SONY MOBILE COMMUNICATIONS Inc.

GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20161130

Termination date: 20211019