CN107613353A

CN107613353A - User interface for entertainment systems

Info

Publication number: CN107613353A
Application number: CN201710977995.0A
Authority: CN
Inventors: H·杨; S·哈奇; Y-K·琼; T·I·可文那米; T·A·托诺那; J·可维可; T·J·金那恩
Original assignee: Nuance Communications Inc
Current assignee: Nuance Communications Inc
Priority date: 2012-08-16
Filing date: 2013-08-16
Publication date: 2018-01-19
Anticipated expiration: 2033-08-16
Also published as: KR20150045404A; WO2014028797A1; EP2803004A1; CN104170397A; CN104170397B; CN107613353B

Abstract

Provide a kind of user interface for entertainment systems.For providing the method and apparatus (100) of the search interface for electronic equipment, the electronic equipment includes being configured as tuning the electronic equipment to receive the tuner of the programme content of arrangement (124) (112).Receiving includes the phonetic entry (104) of search inquiry, and being based at least partially on the search inquiry search includes one or more data sources (124) of the information on media content.The result of search is presented in the user interface (122) of electronic equipment.

Description

User interface for entertainment systems

The application is Application No. 201380014806.X, entitled " user interface for being used for entertainment systems ", state The border applying date is the divisional application of in August, 2013 patent application of 16 days, and entire contents are incorporated herein by reference.

Background technology

Some electronic equipments that can be used to access entertainment content (such as audio and/or video content) include or are connected to Tuner, tuner enable electronic equipment to receive and show the programme content of arrangement, such as TV, radio station or other media Program.In order to select specific program be used for check on an electronic device, user typically using remote control equipment with input with it is specific The numeral of the associated channel of program (such as broadcast).Some are tunable electronic equipment also allows the user to use remote control equipment so that Content is searched for and selected with electronic program guides (EPG), and EPG is to be shown with time-based grid format for the current of arrangement With the user interface of the arrangement information of future program content.User is generally passed through by the button pressed on remote control equipment to navigate The program content entity of the arrangement shown in the epg, remote control equipment use five to (left and right, the upper and lower and choosing of navigation command system Select).Once user highlights specific program on EPG, then can by pressing the select button on remote control equipment, Content corresponding to display on an electronic device, after this, electronic equipment are tuned to selected channel.

The content of the invention

One embodiment is for a kind of method that search result is presented on an electronic device, wherein the electronic equipment includes It is configured as tuning the electronic equipment to receive the tuner of the program of arrangement.Methods described includes：Reception includes search and looked into The phonetic entry of inquiry；The search inquiry is based at least partially on, at least one data source is searched for at least one processor；With The result of search is presented using time-based axle and the axle unrelated with the time.

In one aspect, the axle unrelated with the time based on the degree of correlation with one or more of search inquiry item come The result is ranked up.

On the other hand, searching at least one data source includes searching for the program content data source of at least one arrangement and extremely A few bundled services content-data source.

On the other hand, the result is included in the peace identified in the program content data source of at least one arrangement The programme content of row and the bundled services content identified at least one bundled services content-data source.

On the other hand, the result includes bundled services content, and when the bundled services content is chosen, display comes Multiple results from least one bundled services content-data source associated with selected bundled services content.

On the other hand, time-based axle distinguishes the first content that can be currently used for playback with currently cannot be used for playing back The second content.

On the other hand, the result presented along time-based axle only includes the programme content of arrangement.

Another embodiment is directed to a kind of electronic equipment, including：It is configured as tuning the electronic equipment to receive arrangement The tuner of program；With at least one processor, at least one processor is programmed to：Receiving includes the language of search inquiry Sound inputs；The search inquiry is based at least partially on, searches at least one data source；With using time-based axle and and when Between unrelated axle the result of search is presented.

On the other hand, the electronic equipment also includes：Speech input interface, it is configured as receiving the search inquiry work For phonetic entry.

On the other hand, time-based axle, which is distinguished, can currently be used for by the first content that the electronic equipment plays back with working as Before cannot be used for the second content for being played back by the electronic equipment.

Another embodiment is for a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer performs, a kind of method is performed, methods described includes：Receiving includes the phonetic entry of search inquiry；At least portion Divide ground to be based on the search inquiry, search at least one data source；Come with using time-based axle and the axle unrelated with the time The result of search is presented.

Another embodiment is set for a kind of in the digital tunable electronics for being configured as the programme content that display arranges The method that search result is presented on standby visual user interface, methods described include：Receive search inquiry；It is based at least partially on Natural language understanding analysis to the search inquiry, searches for the program content data source of at least one arrangement and at least one bundle Tie up service content data source；The result of search is presented on the user interface, wherein the result combination searched for corresponds to At least one first result of the programme content of arrangement and at least one second result corresponding to bundled services content.

In one aspect, at least one second result includes at least one bundled services result, when described at least one When individual bundled services result is chosen, the multiple results for carrying out self-corresponding bundled services data source are shown.

On the other hand, at least one bundled services data source includes the data source for the service based on web.

On the other hand, at least one bundled services data source includes the local number associated with the electronic equipment According to source.

On the other hand, at least one bundled services data source includes multiple data sources via network connection.

On the other hand, at least one bundled services data source includes the data source of on-demand content.

On the other hand, present search the result include present with search the result in it is at least one corresponding Image.

Another embodiment is for a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer performs, a kind of digital tunable electronic equipment in the programme content for being configured as display arrangement is performed Visual user interface on the method for search result is presented, methods described includes：Receive search inquiry；It is based at least partially on pair The natural language understanding analysis of the search inquiry, searches for the program content data source of at least one arrangement and at least one binding Service content data source；The result of search is presented on the user interface, wherein the result combination searched for corresponds to peace At least one first result of the programme content of row and at least one second result corresponding to bundled services content.

In one aspect, present search the result include present with search the result in it is at least one corresponding Image.

Another embodiment is directed to a kind of digital tunable electronic equipment for being configured as the programme content that display arranges, The electronic equipment includes：At least one processor, at least one processor are programmed to：Receive search inquiry；At least Be based in part on to the search inquiry natural language understanding analysis, search at least one arrangement program content data source and At least one bundled services content-data source；The result of search is presented on a user interface, wherein the result group searched for Close at least one first result of the programme content corresponding to arranging and at least one second knot corresponding to bundled services content Fruit.

Another embodiment is directed to a kind of method for providing the user interface for digital tunable electronic equipment, described Electronic equipment is configured as the programme content that display arranges, and methods described includes：Shown in the user interface it is multiple with it is interior Hold unrelated label, the multiple label unrelated with content includes first label unrelated with content, should be unrelated with content The first content unit that first tag identifier returns from search；Correspond to first label unrelated with content with response to receiving The first input, perform at least one action relevant with first content unit, wherein first inputs and includes the first phonetic entry, And the first wherein unrelated with content label is configured as responding the first phonetic entry.

In one aspect, methods described also includes：The second input is received, wherein in the multiple label unrelated with content Second label unrelated with content be configured as to second input respond；Wherein perform relevant with first content unit It is described it is at least one action include be based at least partially on the second input to perform at least one action.

On the other hand, the second input is the second phonetic entry, and the second wherein unrelated with content label is configured To be responded to the second phonetic entry.

On the other hand, it is defeated to be included in reception second before reception first inputs for the input of reception first and the input of reception second Enter.

On the other hand, methods described also includes：Based on the first input selection first content unit.

On the other hand, performing at least one action relevant with first content unit is included the tune electronic devices To channel to show the program of the arrangement for first content unit.

On the other hand, first content unit corresponds to the bundled services content element for including multiple search results, wherein Performing at least one action relevant with first content unit includes showing the multiple search result.

On the other hand, methods described also includes：Multiple voice commands are associated with the user interface, wherein described Multiple voice commands include the first voice command and the second voice command, wherein the first voice command calls the first action and the Two voice commands call the second action, and wherein the first voice command and the second voice command are identified by the electronic equipment, Without the specific screens for considering to show in the user interface.

Another embodiment is for a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer performs, a kind of method that the user interface for digital tunable electronic equipment is provided is performed, it is described Electronic equipment is configured as the programme content that display arranges, and methods described includes：Shown in the user interface it is multiple with it is interior Hold unrelated label, the multiple label unrelated with content includes first label unrelated with content, should be unrelated with content The first content unit that first tag identifier returns from search；Correspond to first label unrelated with content with response to receiving The first input, perform at least one action relevant with first content unit, wherein first to input be the first phonetic entry, and And the first wherein unrelated with content label is configured as responding the first phonetic entry.

Another embodiment is directed to a kind of digital tunable electronic equipment for being configured as the programme content that display arranges, The electronic equipment includes：At least one processor, at least one processor are programmed to：Show on a user interface more The individual label unrelated with content, the multiple label unrelated with content include first label unrelated with content, should and content The first content unit that the first unrelated tag identifier returns from search；Correspond to unrelated with content the with response to receiving First input of one label, performs at least one action relevant with first content unit, wherein the first input is the first voice Input, and the first wherein unrelated with content label is configured as responding the first phonetic entry.

In one aspect, at least one processor is also programmed to：Receive second input, wherein it is the multiple with it is interior Hold second label unrelated with content in unrelated label to be configured as responding the second input；Wherein perform and the The relevant at least one action of one content element is described at least one to perform including being based at least partially on the second input Action.

On the other hand, the execution at least one action relevant with first content unit is included the electronic equipment Be tuned to channel to show the program of the arrangement for first content unit.

Another embodiment is directed to a kind of digital tunable electronic equipment, including at least one processor, it is described at least One processor is programmed to：User interface is provided, the user interface enables the electronic equipment to receive search inquiry But regardless of when the search inquiry is received which of multiple screens be displayed in the user interface, wherein described Search inquiry is included to the search for the content to show and/or play back on the digital tunable electronic equipment；Receive Include the phonetic entry of the search inquiry；With in response to receiving the search inquiry, startup corresponds to the search inquiry The search to content.

In one aspect, starting the search to content includes that the inquiry of content will be sent to by one or more networks It is connected at least one data source of the electronic equipment.

On the other hand, at least one processor is also programmed to：One or more is shown in the user interface Individual icon, one or more of icon instruction users can be used for starting the input of the search to content.

On the other hand, at least one processor is also programmed to：By multiple voice commands and the user interface It is associated, wherein the multiple voice command includes the first voice command and the second voice command, wherein the first voice command is adjusted The second action is called with the first action and the second voice command.

On the other hand, the first action and/or the second action correspond to the search started to content.

Another embodiment is directed to a kind of computer implemented method, including：User interface is provided, the user interface causes Electronic equipment can receive search inquiry but regardless of when the search inquiry is received which of multiple screens it is shown In the user interface, wherein the search inquiry includes the content to show and/or play back on the electronic equipment Search；Receiving includes the phonetic entry of the search inquiry；With in response to receiving the search inquiry, startup corresponds to institute State the search to content of search inquiry.

On the other hand, the computer implemented method also includes：One or more is shown in the user interface Icon, one or more of icon instruction users can be used for starting the input of the search to content.

On the other hand, the computer implemented method also includes：By multiple voice commands and the user interface phase Association, wherein the multiple voice command includes the first voice command and the second voice command, wherein the first voice command calls First action and the second voice command call the second action.

Another embodiment is for a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer performs, a kind of method is performed, methods described includes：User interface is provided, the user interface causes electronics Equipment can receive search inquiry but regardless of when the search inquiry is received which of multiple screens be displayed on institute State in user interface, wherein the search inquiry is included to show and/or play back on digital tunable electronic equipment Content search；Receiving includes the phonetic entry of the search inquiry；With in response to receiving the search inquiry, start pair The search to content of search inquiry described in Ying Yu.

On the other hand, methods described also includes：One or more icons are shown in the user interface, it is one Or multiple icon instruction users can be used for starting the input of the search to content.

On the other hand, methods described also includes：Multiple voice commands are associated with the user interface, wherein described Multiple voice commands include the first voice command and the second voice command, wherein the first voice command calls the first action and the Two voice commands call the second action.

Another embodiment is directed to a kind of digital tunable electronic equipment, including at least one processor, it is described at least One processor is programmed to：Receive the first input；Enter listening mode in response to recognizing the first input；It is determined that working as State during electronic equipment is in special time amount when in the listening mode and whether receive the second input, wherein the first input And/or second input be phonetic entry；With in response to determining to be not received by during the special time amount the second input and Exit the listening mode.

In one aspect, the second input is the implicit commands for exiting the listening mode；And at least one processing Device is also programmed to exit the listening mode in response to receiving the second input.

On the other hand, at least one processor is also programmed in response to exiting the listening mode and to first Input is monitored.

On the other hand, the electronic equipment also includes at least one display, and at least one processor is also Be programmed at least one display display to the electronic equipment currently whether the instruction being in listening mode.

On the other hand, the instruction includes one or more selection labels and/or icon.

On the other hand, at least one processor is also programmed to：Determine the electronic equipment whether in monitoring In pattern；The multiple voice labels unrelated with content are shown with response to determining the electronic equipment to be in listening mode.

On the other hand, at least one processor is also programmed to：In response to determining that the electronic equipment is not at The multiple voice labels unrelated with content are hidden in the listening mode.

Another embodiment is directed to a kind of computer implemented method, including：Receive the first input；In response to recognizing first Input so that electronic equipment enters listening mode；It is determined that specific when the electronic equipment is in the listening mode Whether second input is received during time quantum, wherein the first input and/or the second input are phonetic entries；With in response to determine The second input is not received by during the special time amount and exits the listening mode.

On the other hand, the second input is the implicit commands for exiting the listening mode；And methods described also includes ringing Ying Yu receives the second input and exits the listening mode.

On the other hand, the electronic equipment includes at least one display, and methods described be additionally included in it is described extremely On a few display display to the electronic equipment currently whether the instruction being in listening mode.

On the other hand, methods described also includes：Determine whether the electronic equipment is in listening mode；In response to true The fixed electronic equipment is in listening mode and shows the multiple voice labels unrelated with content；With in response to determining the electricity Sub- equipment is not in the listening mode and hides the multiple voice labels unrelated with content.

Another embodiment is for a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer performs, a kind of method is performed, methods described includes：Receive the first input；In response to recognizing the first input, So that electronic equipment enters listening mode；It is determined that in the special time amount when the electronic equipment is in the listening mode Whether period receives the second input, wherein the first input and/or the second input are phonetic entries；With in response to determine described The second input is not received by during special time amount and exits the listening mode.

In one aspect, the electronic equipment includes at least one display, and methods described also includes：It is described extremely On a few display display to the electronic equipment currently whether the instruction being in listening mode.

Another embodiment is entered for a kind of content to show and/or play back on digital tunable electronic equipment The method of row search, the electronic equipment are configured as the programme content that display arranges.Methods described includes：Receive and wrap from user The phonetic entry of search inquiry is included, wherein the search inquiry is included to show and/or play back on the electronic equipment The search of the content；The action that user wishes to carry out is determined based on the search inquiry；User is based at least partially on to want The action performed, it is determined that to search for one or more data sources；Be based at least partially on the search inquiry, described The content to show and/or play back on the electronic equipment is searched in one or more data sources.

In one aspect, determine that the action that user wishes to carry out includes：Determine that user wants to listen to media content, and And determine that the one or more data sources to be searched for include：It is music data source to determine one or more of data sources.

On the other hand, determine that the action that user wishes to carry out includes：Determine that user wants viewing media content, and And determine that the one or more data sources to be searched for include：Determine the section that one or more of data sources are at least one arrangement Mesh content source.

On the other hand, methods described also includes：The one or more rules of storage, one or more of rules will be specific The input of type is associated with the particular order for searching for one or more of data sources；Wherein search for it is one or Multiple data sources include：One or more of data sources are searched for according to one or more of rules.

On the other hand, searching for one or more of data sources includes searching for all available data sources.

On the other hand, methods described also includes：From one or more of data sources search results；With in user The search result is presented on interface.

Another embodiment is for a kind of computer-readable recording medium encoded with multiple instruction, when the instruction is by least When one computer performs, perform a kind of content to show and/or play back on digital tunable electronic equipment and enter The method of row search, the electronic equipment are configured as the programme content that display arranges.Methods described includes：Receive and wrap from user The phonetic entry of search inquiry is included, wherein the search inquiry is included to show and/or play back on the electronic equipment The search of the content；The action that user wishes to carry out is determined based on the search inquiry；User is based at least partially on to want The action performed, it is determined that to search for one or more data sources；Be based at least partially on the search inquiry, described The content to show and/or play back on the electronic equipment is searched in one or more data sources.

On the other hand, methods described also includes：The one or more rules of storage, one or more of rules will be specific The input of type is associated with the particular order for searching for one or more of data sources；It is one or more of with searching for Data source includes：One or more of data sources are searched for according to one or more of rules.

Another embodiment is directed to a kind of digital tunable electronic equipment for being configured as the programme content that display arranges, The electronic equipment includes：At least one processor, at least one processor are programmed to：Being received from user includes search The phonetic entry of inquiry, wherein the search inquiry is including described interior to what is shown and/or play back on the electronic equipment The search of appearance；The action that user wishes to carry out is determined based on the search inquiry；It is based at least partially on what user wished to carry out The action, it is determined that to search for one or more data sources；Be based at least partially on the search inquiry, one or The content to show and/or play back on the electronic equipment is searched in multiple data sources.

On the other hand, at least one processor is also programmed to store one or more rules, it is one or Multiple rules are associated with the particular order for searching for one or more of data sources by certain types of input；And search One or more of data sources include：One or more of data sources are searched for according to one or more of rules.

It should be appreciated that all combinations for the aforementioned concepts and other concept being more thoroughly discussed below are (if such If concept is not mutually internally inconsistent) be considered as present subject matter disclosed herein a part.

Brief description of the drawings

Accompanying drawing is not intended to drawn to scale.In the accompanying drawings, each identical or intimate identical component shown in the various figures Represented with identical number designation.For clarity, may not be that each component is labeled in every accompanying drawing.In accompanying drawing In：

Fig. 1 is the example for the component relevant with the search interface for entertainment systems for including some embodiments of the present invention Sexual system；

Fig. 2 is for the place to the result of content search to be presented on a user interface according to some embodiments of the present invention Reason；

Fig. 3 is the part for being used to show the user interface to the result of content search according to some embodiments of the present invention Schematic diagram；

Fig. 4 is to be used for user interface of the display to the mixing resultant of content search according to some embodiments of the present invention Partial schematic diagram；

Fig. 5 is the voice label that input can be used according to the display user of some embodiments of the present invention and interact The schematic diagram of the part of user interface；

Fig. 6 is the exemplary process being used for using listening mode to Input Monitor Connector according to some embodiments of the present invention； With

Fig. 7 is the exemplary computer system that can be used for realizing some embodiments of the present invention.

Embodiment

The present inventors have realized that and understand, the search of the content to checking on an electronic device, the electricity can be improved Sub- equipment includes being used for the tuner for showing the programme content arranged.The electronic program guides (EPG) of the above-mentioned type is usually used in searching Rope simultaneously selects the programme content of arrangement to be checked on tunable electronic equipment, and can be used for using the programme content with arrangement The display format of time for checking corresponding mesh-like is configured.The grid format that EPG is shown is designed to make to receive to come from With five inputs to the remote control equipment of navigation command system to move a cursor to the different entries in grid.The present inventor has recognized Know, the use of the conventional EPG navigation shown is troublesome.In order that pass through regular grid to navigation command system to navigate with five The EPG of sample show in entry, it may be required that user provide a series of navigation command (for example, " under-under-under-right side-choosing Select "), this is experienced for the efficient of the user of selection specific program or intuitively without generation.

It has been recognised by the inventors that, the display of conventional EPG search systems is " user interface of vision the first ", wherein should The principal focal point at interface is the programme content arranged with visually consistent box display.The present inventor has understood that, is used for The other technologies of search content are feasible, and the strict vision that these technologies need not be arranged programme content is presented, because with Family be not limited to using five to navigation command system come shown entry of navigating.Therefore, some embodiments of the present invention pin To the method and apparatus for improved visual search interface.Especially, in some embodiments of the invention, visual user circle Face be designed to encourage " input of natural language the first " so that interface be configured as encourage user say or otherwise by Search system is provided input directly to according to natural mode.

Some embodiments encourage use phonetic entry as mainly input form, using the visual aspects of user interface as pair The supplement of phonetic entry.It is understood, however, that any input that can be said can be alternatively via another type of input shape State (for example, text input with keyboard) is provided.Therefore, although embodiment described below the use of voice is described as it is defeated Enter form, but user's offer and following implementations of the same type provided by voice can be allowed using other forms Input described in example.

Fig. 1 shows the example system 100 for being used according to some embodiments of the present invention.System 100 includes Electronic equipment 102, its can be TV, computer, portable electric appts (such as smart phone or be configured as receive and Show any other tunable electronic equipment of the programme content arranged).Electronic equipment 102 can be configured as receiving from user and search The input of rope and selection content to check on an electronic device, wherein receiving the input using one or more input form. In some embodiments, electronic equipment 102 includes speech input interface 104, such as microphone and is configured as receiving the one of input Other individual or multiple input interfaces 106.Other input interfaces 106 can include but is not limited to keyboard interface (such as QWERTY keys Disk), mouse interface, Remote Control Interface or allow users to search for content with checked on electronic equipment 102 any other conjunction Suitable interface.

The phonetic entry received via speech input interface 104 can be sent to automatic speech recognition (ASR) engine 108, for automatic speech recognition with identify received speech input content.Although ASR 108 be shown in Figure 1 for by Including the part as electronic equipment 102, but ASR 108 alternatively can be positioned remotely from electronic equipment 102, And any suitable communication media (such as one or more networks) can be used and communicated with electronic equipment 102.At some In embodiment, electronic equipment 102 can draw with one or more local ASRs 108 and one or more ASR being remotely located Hold up associated, thus at least some phonetic entries received are handled by one or more of local ASRs, at least some The phonetic entry received is handled by the ASR of one or more of long range positionings.The example of this distributed ASR system It is well known by persons skilled in the art.Using the communication media of one or more connection electronic equipments 102 and ASR (such as One or more networks) it is sent to the phonetic entries that one or more of long-range ASRs are used to identify and can uses phase With or different communication medias and return to electronic equipment 102 from the ASR of long range positioning.

In certain embodiments, ASR 108 can be with one or more voices of the one or more voice commands of storage Order data source 110 communicates.ASR 108 phonetic entry received can be matched be stored in it is one or more of One or more of voice commands in voice command data source 110, and the voice command for returning to one or more matchings arrives One or more processors 114, processor 114 are programmed to execute the voice command corresponding to one or more of matchings At least one action.In certain embodiments, the output of ASR 108 can be divided using natural language understanding (NLU) engine Analysis, NLU engines are suitably based on NLU technologies using any, and its example is known in the art.NLU outputs can be at least partly Ground is used for voice command is associated with the phonetic entry received.In certain embodiments, electronic equipment 102 can be configured For phonetic entry is interpreted as into voice command in response to following：The activation of input signal is (for example, user presses remote control or key Button on disk), or the phonetic entry corresponding to " wake-up " language is received, when corresponding to the phonetic entry of " wake-up " language Instruction follows the phonetic entry of the input signal to be interpreted as voice command when being received.Alternatively, phonetic entry can quilt Order is interpreted as without starting via the order of input signal (such as language is pressed or waken up to button), because the present invention Embodiment is unrestricted in this regard.

The set for the voice command that one or more voice command data sources 110 are stored can include being used to search for and select Any suitable order for selecting content to check on electronic equipment 102.In certain embodiments, the set of voice command can be with Including the order of the function of of control electronics 102 itself, its example is included in the order often found in conventional remote equipment, Such as " Jing Yin ", " turning on the power " and " volume ".Shown in following table 1 for the illustrative of control electronics 102 Electronic equipment order set, but it is to be understood that, there is provided these order only as an example, embodiment as described herein It is not limited to use these specific orders.

Table 1：Illustrative electronic equipment order

The programme content that the set of voice command can also include being used to search for and/or select to arrange is with electronic equipment The tuner command shown on 102, such as " shows<Channel designation>, " succeeding channel " and " show<Programm name>”.Below Table 2 in show the set of illustrative tuner command, but it is to be understood that, there is provided these orders only as an example, Embodiment as described herein is not limited to use these specific orders.

Table 2：Illustrative tuner command

The set of voice command can also include being used to interact with one or more client applications on electronic equipment 102 Utility command, the client application performs any function in many functions, including provides the access to many services.Example Such as, utility command can be used with using performing calling (such as Skype in user^TM) client application start audio call meeting Any action in words, search Weather information or many other actions of execution.Show that illustrative application is ordered in following table 3 The set of order.

Table 3：Illustrative utility command

Illustrative application order described in table 3 includes the order of control exemplary client application, these clients End application includes Twitter^TM、YouTube^TMAnd Skype^TM.It will be appreciated, however, that embodiments of the invention can include using It is without limitations in the voice command of any other client application, and in this respect.For example, it is also possible to including for including but It is not limited toGmail^TM、Hulu^TMAnd MySpace^TMClient application voice command. Some client applications (including many those listed above) otherwise can be can be with via the proprietary application on electronic equipment Via the accessed service or application based on web of the web browser in equipment, and embodiments of the invention do not limit The accessed mode of client application.

The set of voice command can also include action command, and each action command is used in execution and search result list The relevant action of one or more projects.Following table 4 describes the list of illustrative actions order.

Table 4：Illustrative action command

In certain embodiments, the set of voice command can also include being used to show the EPG orders interacted with EPG.With Using with remote control equipment be used together conventional five to navigation command system limiting user by the navigation of EPG entries on the contrary, The set of EPG orders can provide additional phonetic function to strengthen the viewing experience of user.Following table 5 describes explanation The set of the EPG orders of property.

Table 5：Illustrative EPG orders

In certain embodiments, electronic equipment 102 also includes tuner 112, and tuner 112 is configured so that electronic equipment 102 can be tuned to specific channel to show the programme content of arrangement on electronic equipment 102.For example, tuner 112 can be with The program content sources 124 that electronic equipment is arranged from the one or more that electronic equipment 102 is connected to via network 120 Receive the programme content arranged.The program content source 124 of arrangement can find for these arrangements of time media content come Source, the media content include but is not limited to content (such as TV programme and film) and the live media content stored.Storage And/or the programme content of arrangement is transmitted to the arrangement of electronic equipment (such as by such as wired or satellite network communication media) Program content source 124 be known.Some embodiments can include being configured as receiving the program arranged from multiple content sources The tuner of content, and/or multiple tuners can be included, each of which is configured as receiving from different content sources and arranged Programme content.

Electronic equipment 102 can also include network interface 118, and it is configured as via one or more networks 120 and one Individual or multiple storages and/or processing equipment communication.As described above, network interface 118 can be used for transmitting phonetic entry Voice identification result is received to one or more long-range ASRs and from one or more of ASRs.Electronic equipment 102 Single network interface 118 or more than one network interface 118 can be used, to cause electronic equipment 102 to be connectable to The network (such as to perform different functions) of more than one type.

A kind of example electronic device 102 is television system.Television system generally includes tuner, and it causes television system The programme content of the arrangement received by the set top box for being connected to TV can be shown.Set top box is the example of tuner 112, its The programme content arranged is received via network interface 118 and decodes received content to cause electronic equipment in display 122 Upper display content.The programme content of the arrangement received via network 120 or any other content can be connected to electronics Shown on the display 122 of equipment 102.In certain embodiments, display 122 can integrate the portion as electronic equipment 102 Point, and in other embodiments, display 122 can be connected to electronics and set via one or more wired or wireless connections Standby 102.Display 122 can also be that individual monitor or multiple displays, embodiments of the invention are unrestricted in this regard.

In certain embodiments, electronic equipment 102 can also be associated with local content data source 116, local content number According to source 116 can be configured as storing one or more TV programme, one or more films or any other be suitable in electronics The content played back in equipment.For example, in certain embodiments, local content data source 116 can be digital video recordings device (DVR), it is configured as the programme content for the arrangement that storage is recorded.Local content data source 116 can be configured as storage and The one or more local clients for being associated with electronic equipment 102 apply relevant content, the local client apply including But it is not limited to store and/or manages picture file, music file and/or the one or more of video file are applied.

, can be from local when searching for content to check and/or play back on electronic equipment 102 according to some embodiments Content-data source 116 and/or it is remotely located from electronic equipment 102 and is connected to one of electronic equipment 102 by network 120 Or multiple data source (such as the content-data source 124 of arrangement, bundled services content-data source 124) retrieval contents.Searched Particular source can depend, at least partially, on search inquiry.When from multiple source returning results, search result can be at least partly Source of the ground based on the content corresponding with search result and be sorted.In certain embodiments, user can be included based on expectation The source of content in search result and/or the type of content limit the search to content, as described in more detail below.

Some embodiments are directed to the controllable visual search interface of voice shown on display 122, and are configured as permitting Content is searched for be checked and/or be played back using electronic equipment 102 in family allowable.User can interact to search interface The programme content arranged is searched for, as described above.The programme content of arrangement includes but is not limited to such as TV and radio station section Purpose broadcasted content.

In addition, some embodiments can enable a user to search for bundled services content, bundled services content is for example by one The bundled services data source 124 of individual or multiple connection networks and/or local content data source 116 store.Different from that may only use In the programme content for the arrangement checked in special time (such as when the content is arranged for broadcast), bundled services content can For checking/playing back at any time.Bundled services content can include but is not limited to the content from the service based on web (such as), the content of Local or Remote data source from storage media content (such as DVR contents, from clothes Be engaged in on-demand content etc. of provider) and be associated with electronic equipment 102 one or more client applications (such as) associated content.As described in more detail below, can be with according to the search to content of some embodiments User is allowed to search for the programme content of arrangement, the programme content of bundled services content or arrangement and binding in single search Both service content.

Fig. 2 shows the illustrative methods for being used to handle search inquiry according to some embodiments of the present invention.In step In 210, electronic equipment 102 is received to search inquiry of the content search to check and/or play back on electronic equipment 102.For example, Search inquiry can include one or more voice commands, as described above.In order to which the phonetic entry received is interpreted For one or more voice commands, phonetic entry can be handled for knowing by one or more locally and/or remotely ASRs Not.In certain embodiments, the type that can be based at least partially on phonetic entry determines it is via local ASR or remote Journey ASR handles phonetic entry via both.For example, in one implementation, ordered corresponding to fixed form equipment Making the phonetic entry of (such as " Jing Yin ", " closing power supply ", " volume increase ") can be handled by local ASR, and including freely (such as " cloud ") ASR that the order of form input (such as " search ", " lookup " etc.) can be remotely located by one or more Processing.For example, because fixed form order can be associated with limited grammer, can be easier to identify them, local ASR draws Speech recognition can be sufficiently used for and be compared faster with input is sent into long-range ASR by holding up.However, free form is defeated Enter to be more difficult to identify, therefore for acceptable recognition performance, it may be necessary to input is sent to more robust ASR and drawn Hold up.Moreover, the language model associated with long-range ASR can be updated periodically to reflect the change of pop culture, electricity Shadow, performer, the title etc. of books, it is opposite these be probably what is be difficult to for local ASR.In certain embodiments, At least Part I of phonetic entry can be handled by local ASR, and at least Part II of phonetic entry can be by The ASR processing of long range positioning, and any combinations of local and remote ASR can be used for identifying received voice Input.

Processing is subsequently entered in step 220, is wherein at least based in part on the voice corresponding to search inquiry identified Input to search for one or more data sources.One or more of data sources can be searched in any order, and any Specific data source (including all or less than available data sources) can be searched.The result returned by search can be with any conjunction Suitable mode determines.In certain embodiments, specific action that user wishes to carry out can be based at least partially on to determine Which data source searched for.For example, if user, which says, " listens Bob Seger ", system can determine that user wants to listen music, therefore Only local music data source rather than the data source associated with EPG can be searched.Alternatively, if user says " viewing Modern Family ", then it can determine that user wants viewing TV show.Correspondingly, the data source associated with EPG and with The associated one or more data sources of the television content of recording can be searched, but local music data source may not be searched Rope.By be selectively searched for all or less than available data sources, some embodiments of the present invention can search by reducing return The time quantum of hitch fruit and return in a more efficient manner correlation search result.However, and not all embodiment limited Only to search for the subset of useful source, because may search for all useful sources for some search.

In certain embodiments, can be based at least partially on particular command (or identified user view) with being used for Search and/or the associated one or more rules of particular order of search result are presented to determine the searched order of data source And/or the order that search result is presented.For example, if user says that " viewing Modern Family ", " see to voice command See " identification (or expected action, if not using particular command, as discussed below) electronic equipment can be caused First from the data source search associated with EPG and returning result, secondly searched for simultaneously from the data source associated with local content Returning result, again from client application (such as YouTube^TM) associated data source is searched for and returning result.It should manage Solution, this particular order for being used to search for and return the search result associated with " viewing " order of description are only used for illustrating Property purpose, can alternatively use any other desired order.

In addition, some embodiments can not include fix command grammer, but can be in some other manner from being received Input determine the intention of user, such as determine the intention of user by monitoring the particular utterance in free form input, And perform action in response to determining the intention of user.For example, if user uses " broadcasting " to order in free form input Order uses " broadcasting " one word, then system can identify that the use of the play command or " broadcasting " one word can imply that user visits Ask the intention of always addressable content (or the program request being locally stored is available).It can use one or more preferential Level rule determines to play any media content.Work as example, can determine whether EPG has first with what phonetic entry matched The preceding any media content (such as broadcasted content, on-demand content etc.) that can be used for playing.If determined from EPG not currently available Content, then next it may be determined whether that the media content (such as DVR contents) of any recording matches with phonetic entry.Such as The more than one recording medium inclusive segment of fruit matches with phonetic entry, then one or more of priority rules can specify The content of all matchings is shown so that user can select wherein.Alternatively, in certain embodiments, electronic equipment can To play back selected one of matching content automatically, (such as the content of the oldest recording for not watching (or partially viewed) is chosen And play back on an electronic device), rather than show multiple search results to user.Although above-mentioned example is directed to use with specific preferential The set of level rule plays media content, but it is to be understood that these rules are merely exemplary, and it is any suitable to use Priority rule set for any phonetic entry because embodiments of the invention are not limited in this respect.

Fig. 2 processing is returned to, has been searched in a step 220 after one or more of data sources, processing enters Step 222, wherein in response to searching the content to match with search inquiry from one or more of data sources, with electronics One or more results are shown in the associated user interface of equipment 102.Search result can show in any suitable manner, Including the use of the search result interfaces of voice-enabled (voice-enabled), as will be described in more detail.Such as institute above Description, display result can include the inclusive segment to match with user's input is directly presented.

Fig. 3 shows the part at the visual search interface according to some embodiments of the present invention.Specifically, Fig. 3 is shown Illustrative result screen 300, for showing the searching to the content checking and/or play on an electronic device started from user The search result that rope returns.In certain embodiments, result screen 300 is configured as showing search knot along at least two axles Fruit.In an illustrative embodiment, an axle is in the prospect of search interface, and other one or more axles are on search circle In the background in face, but the prospect of search interface can be brought in response to order (such as voice command).It is still other its In his embodiment, the content shown on axle only in the foreground is fully focused (in focus), and the decoking of other shaft portions ground (out of focus) by the notice of user to be attracted to prospect axle.However, not all realities of prospect of the application and background axle Apply example and be limited in this context system, because some embodiments can be presented two or more axles and be fully focused.

In certain embodiments, for showing that the first axle of search result can be the axle 310 unrelated with the time.When corresponding When the content of search result can be used for checking and/or playing back, edge can be come using any measurement suitably unrelated with the time The axle 310 unrelated with the time and carry out sorted search result.For example, in a nonrestrictive example, can be at least in part Based on produce result search inquiry the degree of correlation come along the axle unrelated with the time come sorted search result.In some implementations In example, the content shown along the axle unrelated with the time can be restricted in the available content of current time, and in other realities Apply in example, it can include the content being currently unavailable.For based on the degree of correlation with search inquiry come the searching of being returned of sorting The embodiment of hitch fruit, can be in any suitable manner using any suitable algorithm (e.g., including to being currently available for looking into The content seen provides the higher degree of correlation) degree of correlation is determined, because embodiments of the invention are unrestricted in this regard.Should Understand, a kind of mode being ranked up with the degree of correlation of search inquiry only along the axle unrelated with the time to result, and And any other suitable measurement can be used to replace or in addition in using with the degree of correlation of search inquiry.For example, can be with The combination for being based at least partially on the type of content, the source of content or any other factor or factor to carry out search result Sequence.

In certain embodiments, search result can also be organized along the second axle, the second axle be it is time-based and It is configured as the search result that display can be used for checking in different time.It is used for for example, the prospect of result screen 300 can be shown The search result of currently available content, and only be may be displayed in the available content of future time in background 320, as shown in Figure 3.

Although result screen 300 includes being shown in the search result only on two axles, but it is to be understood that search result can To be shown on any number of axle, because embodiments of the invention are unrestricted in this regard.For example, in some embodiments In, for can use in current time but may need to pay the binding of subscription charge or some other expenses before content is checked The search result of service content can show along single axle (not shown), with indicate the content only paid it is applicable Payment after can just be checked.

Result screen 300 can also include description section 330, and it includes the information of the search result on currently selecting. Description section 330 can also include other information, and other information is allowed users to from the search shown in result screen 300 As a result the selection of wisdom is made in.For example, description section 330 can include in associated with currently selected search result The description of appearance, and the description can the selection based on the different search results to being shown in result screen 300 and change.

In certain embodiments, the search result fewer than the whole search results returned from search process may be displayed on knot So that the crowded minimum of display on fruit screen 300.In certain embodiments, user can hand over one or more voice labels Mutually (as described in more detail below), to check other search result.Result screen 300 can also include findings that field 340, It allows users to carry out additional search based on one or more of search result shown in result screen 300 Rope.For example, it was discovered that field 340 when being selected by user, can start pair and be associated with the interior of currently selected search result Hold the search of similar content.Similarity can suitably be determined with any using the method for any suitable algorithm, because Embodiments of the invention are unrestricted in this regard.For example, it is based at least partially on content source and content that content is retrieved from The associated one or more content tabs (such as parental ratings of film) of section, the type of content or these or other because Any combinations of element determine similarity.

In certain embodiments, result screen 300 can include tool bar 350, and it includes convenient and scouting screen 300 User mutual information.For example, tool bar 350 can include one or more icons, text or other indicators, it is described its His indicator explain that user can be used for interact with result screen 300 specific to screen or global input, (such as voice is ordered Make).

According to some embodiments of the present invention, search result can include the search result of mixing, and it includes different type Content.For example, as discussed above, search result can include relative with the programme content and bundled services content of arrangement The result answered.Fig. 4 shows illustrative result screen 400, wherein the search result shown in result screen 400 includes mixing The search result of conjunction, i.e. at least two in search result are associated with different types of content.The search result of mixing can be with Including the first result returned from the program content data sources that one or more arranges and from one or more bundled services contents The second result that data source returns.The search result shown in result screen 400 includes search result 410,412 and 414, it Can be the result returned from the program content data sources that one or more arranges, in addition to search result 420 and 422, it Can be from one or more bundled services content-data sources return result.

As shown in figure 4, the search result that is returned from the program content data source of arrangement and from bundled services content-data source The search result of return may be mixed together and suitable be measured or the combination of measurement is along unrelated with the time using any Axle sequence, these measurements include but is not limited to sources with the degree of correlation of search inquiry, the type of content and content.With result screen As curtain 300, result screen 400 can include description section 430, its search knot for including and being shown in result screen 400 The relevant information of one or more of fruit.

In certain embodiments, the search result shown in result screen 400 can be along including unrelated with the time At least two axles of axle and time-based axle are sorted.In certain embodiments, shown in the background parts of search interface Search result can only include arrange programme content without including bundled services content.For example, because some bundled services Content can be always addressable, in certain embodiments, can be total corresponding to the search result of such bundled services content It is shown in the foreground part of search interface, to indicate that it can be used for checking and/or playing immediately.It will be appreciated, however, that This is only an illustrative mode for carrying out organising content using two axles, and its hetero-organization of content is also possible.

As discussed above, some bundled services contents only can be just accessed immediately once payment expense.For example, From Online Music shop (such as) song only once buy the song can just be accessed immediately.One In a little embodiments, although being not shown in Fig. 4, with being needed before becoming available for checking and/or playing back on an electronic device The search result that the content of payment is corresponding may not mix with other search results, but can appear in search result interfaces Different piece in.

In certain embodiments, one or more selections can be included according to the search interface of some embodiments of the present invention Label, interacting between the convenient user of these labels and the one or more assemblies of search interface.Fig. 5 is shown including multiple Select the exemplary result screen 500 of label.As shown in figure 5, one or more of search result can be with selecting label 510 is associated, and its instruction user can provide (such as via spoken language input, keyboard or keypad etc.) to select specific search knot The input of fruit.In exemplary result screen 500, for the embodiment using speech interface, if user wants a selection left side The first search result in inferior horn, then user is it may be said that " selection 1 ".Alternatively, if user wants selection and is shown in the lower right corner On search result, then user it may be said that " selection 4 ".

Result screen 500 can also include other kinds of selection label, and such as one or more icons 520, it causes User can be acted using select command come relevant one or more of the content that performs be associated with the icon.For example, icon 520 can include but is not limited to indicate to the user that they can check certain content, record certain content or perform with being associated with The icon of the associated some other actions of the certain content of icon.User will can be acted with selecting the mark of label combined To perform the action to selected content.For example, user can by say " check 1 " come check with Fig. 5 lower left corner The associated content of search result.

Some using speech interface embodiments in, depending on voice command when be activation, with visual search circle The interactive voice in face can be classified as different types of voice command.For example, some voice commands can be classified as and shield The unrelated order of curtain, these orders independently of the content shown in any specific screens, and always activate but regardless of working as It is preceding that just presenting over the display is any specific screens.Some non-limiting examples of the order unrelated with screen are included but not It is limited to the order of such as volume control, channel control, screen intensity and menu access order.In certain embodiments, with screen The set of unrelated order and the feature conventionally controlled by remote control equipment are substantially overlapping.The order unrelated with screen can be with Associated with one or more marks, the mark is for being shown on search interface, so as to user reminding, these are ordered Existing selection label, or in certain embodiments, it is assumed that user knows these always available orders and can be by Call so that do not show selection label or icon.In certain embodiments, can in the tool bar shown on search interface screen With including the icon for one or more of global command and/or in response to trigger event (such as seek help, press it is defeated Enter the hot key in equipment or in a manner of some other) list of global command can be accessed.

Some interactive voices can be associated with the action related to screen, and the action related to screen allows users to only Action is performed in the specific screens of user interface.For example, in the result screen 500 shown in Fig. 5, select label 510 can be with User is allowed to select specific search result (as described above), and in response to have selected specific search result, with The description of the associated content of selected search result can be updated to provide a user information on search interface, the letter Breath can help a user decide whether a pair content associated with selected search result perform action (such as watch, buy, Record).

Other actions related to screen can be associated with one or more navigation features of search interface, navigation feature Allow users to navigate and/or update in specific result screen the content of result screen.For example, search interface can To show the mark of voice-enabled (voice-enabled), its allow user check be not currently in shown on search interface it is attached The search result added, such as update knot by saying the input of " next result " or some other order phrases or free form Fruit screen is with including additional result.

Search interface can be further configured with being associated with the integration of user interaction functionality of the action related to screen, to allow User switches between the search result that the varying level shown with multiaxis is presented.For example, search result along with the time without In the embodiment that the axle of pass and time-based axle are shown, user can switch edge using voice (or other forms) input Which result for time-based axle is currently focused and can be chosen.For example, user it may be said that " later " (or some Other language or phrase) with selection with shown in the background of user interface along the time-based axle of shown search result The associated content of search result.This can be useful, such as, it is allowed to user takes and in the available peace of later time Arrange the relevant action of programme content (such as recording).In order to perform the action, user's (or some other language it may be said that " later " Or phrase), this can switch search result shown in the foreground and search result shown in the background, so that handy Family can select content only in available project in the future.

Graphic icons 520 can represent the user mutual of another species, and these user mutuals allow users to perform spy Fixed action, such as record, check or play back the content associated with search result.In certain embodiments, graphic icons Additional increment action is can correspond to, these increments act the function of allowing users to perform other " secondary ", such as send out Model arrivesPerform Twitter^TMOn action or handed over another client application service or website Mutually.

Although illustrative above example discuss three kinds of different types of user mutuals (i.e. unrelated with screen order, The action related to screen and graphic icons action), but it should be clear that the user mutual of any destination type can be used, Because embodiments of the invention are unrestricted in this regard.

In the embodiment of some support speech interfaces, the selection label and/or other icons that are shown on search interface Existence or non-existence can be based at least partially on and whether activated interactive voice and determined for search interface.Determine language Whether sound interaction activates can be carried out in any suitable manner for search interface, including for example determine whether microphone swashs It is living, determine whether speech recognition software performs on an electronic device, determines user and whether have been sent from voice command to search for Voice label or other suitable modes are shown on interface.

In certain embodiments, electronic equipment can receive the input for causing electronic equipment to enter " listening mode ", in " prison Listen pattern " during electronic equipment expect the further input from user to perform action.On the contrary, when electronic equipment is not at supervising When listening pattern, the input received can not acquiescently be interpreted as representing the meaning of the execution specific action of user by electronic equipment Figure, but can monitor the input that triggering enters listening mode.Fig. 6 is shown according to some embodiments of the present invention Illustrative process for the electronic equipment including listening mode.In operation 610, it is determined whether electricity will be caused by having been received by Sub- equipment enters the first input of listening mode.For example, in the embodiment including speech interface, the first input can be with proof The voice command of the intention of the execution action of user or some other phonetic entries are corresponding, as described above.Alternatively, First input may be such that electronic equipment enters any other suitable input of listening mode, including but not limited to by lower key Specific keys on disk or keypad.

If determining to be not received by the first input in step 610, processing continues the first input that monitoring receives. Otherwise, if having been received by the first input, processing enters step 612, causes electronics wherein being inputted in response to identification first Equipment enters listening mode.When in listening mode, processing enters step 614, where it is determined whether it is defeated to have been received by second Enter.If it is determined that having been received by the second input in listening mode, then processing enters step 620, corresponds to the wherein performing One and/or second input one or more actions.After one or more actions are performed from step 620, if expected Additional input, then processing can alternatively return to step 612 with into listening mode.For example, the second input can be " modern What has on the HBO comedy inventories in evening", and the action performed in step 620 can be open the same day HBO comedies it is clear It is single.Because expecting additional input, all processing can enter step 612 into listening mode, to wait input (example to be appended It is such as next, previous, exit).If however, without additional after one or more actions are performed from step 620 Input be expected, then processing can terminate.

If in step 614 determine be not received by the second input, processing enters step 616, wherein determine since Specific time quantum (such as 5 seconds) whether is had already been through into listening mode.If determine to have not gone through in step 616 Specific time quantum, then processing continue the input of monitoring second.Otherwise, if it is determined that pass by specific time quantum, then located Reason enters step 618, wherein cause electronic equipment to exit listening mode, and handles that to return to step 610 defeated with monitoring first Enter.In embodiment described above, after listening mode is entered, electronic equipment is after specific time quantum has been pass by Exit listening mode.It will be apparent, however, that in certain embodiments, it otherwise can alternatively exit listening mode.Example Such as, some embodiments can enable a user to explicitly move back by providing the input for guiding electronic equipment to exit listening mode Go out listening mode.The explicit input can take any suitable form, including but not limited to voice command (or the use of determination Family is intended to) or by the button on lower keyboard or keypad.

In certain embodiments, when causing electronic equipment to enter listening mode, this can be shown by electronic equipment It is noted in some way in user interface.For example, once into listening mode, one or more selection labels and/or figure Mark can occur on a user interface to notify user to come into listening to pattern.It should be appreciated that it can perform in any way Reflect the user interface change of the mode state of electronic equipment, show or hide selects the example of label and/or icon to be only referred to Show a kind of mode of state, and other modes are also feasible.

In certain embodiments, bundled services content search results can be represented with hierarchical.If for example, specific bundle The service of tying up includes one or more inclusive segments to match with search inquiry, then can be initially by including bundle in search result The identifier rather than corresponding inclusive segment for tying up service represent them, and then select bundled services can from search result To cause corresponding inclusive segment to show on a user interface.For example, the application associated with bundled services content search results can To be shown as image or icon for application, the image or icon are recognized by the user to represent the application.For example, bundled services Search result can correspond to film stream process (streaming) service, such as(such as byFigure Indicate), and in response to for example, by say selection the second search result (such asSearch result) " selection 2 " and select film stream process service, can showSearch result in.

In the illustrated example, user may search for the content corresponding to " Yankees ", be returned in response to the search Search result can include the programme content of arrangement for New York Yankees baseball matches, from being used for and New The bundled services content of the film stream process service of film relevant York Yankees, " Damn Yankees " are relevant with band Music content and e-book " A Connecticut Yankee in King Arthur ' s for Mark Twain Court " electronic book contents.With showing included by bundled services, relevant with Yankees all films on the contrary, search As a result image for film stream process service can be initially shown, the film stream process services package includes and search terms " Yankees " relevant multiple films.Select to use once by using selection voice label for example associated with the image In the image of the film stream process service, can use from stream process service and corresponding to one or more of search terms " Yankees " Portion's film may be displayed in search result.The search result that hierarchical is presented can have any number of hierarchical water It is flat, because embodiments of the invention are unrestricted in this regard.

Another can be the song in music libraries with the illustrative example for the content that hierarchical represents.For example, user may Want broadcasting Metallica song, but the title of the song may be forgotten.In order to search for the song, user can start Search to " Metallica ", the search result returned can include being locally stored in the local associated with electronic equipment The special edition of multiple Metallica in data source, and/or one or more nets including the music from Metallica The music data source (such as database) of network connection.In certain embodiments, search result can be rendered as being used for Metallica The a series of images of the album cover of different special editions, and user can be prompted to select one in special edition from search result (such as by using selection voice label associated with each album image).It is one in one chosen special edition, selected Special edition can deploy to show for one in the song associated with special edition or how first search result, and user can To select one of song on special edition to be played back.Therefore, in this respect, search result can be presented in a manner of hierarchical, Alloing allows the sequential selection of search result user's navigation to want by search result with discriminating user in electronic equipment The content of upper playback.

In certain embodiments, the voice mark for guiding user's component interactions how different from user interface can be used Label.The voice label of content neutral is the mark unrelated with the content that voice label is identified.The voice label of content neutral Example is the selection voice label (1,2,3,4) shown in Fig. 5, and they allow user to select one of search result without saying The title of the content of identification search result.Therefore, the voice label of content neutral does not identify the content being associated in itself, But only identify neutral gear (slot) or the position of the search result that content is assigned to.By using the voice mark of content neutral Label, provided a user the set of voice label, they be advantageous to when with consistent user's body during visual search interface alternation Test.In addition, using to compare using the voice label permission user of content neutral the mark is at least partially based in voice label The identified content of label and less voice of needs is carried out into call instruction in the case of creating.Use the voice mark of content neutral Label also allow using fixed grammer (such as numeral, letter), and this can be directed to the content production may with unique title etc. Raw more accurate ASR.

In certain embodiments, user can provide the input of the activation of the order or the interaction that cause more than one type (such as via voice).For example, user is it may be said that " viewing 1 ".As response, two interactions occur：(1) in search result One project can be chosen be played with the project selected by (2).So, single input can cause multiple orders or interaction It is performed without user and must send out single order.This system is allowed users to using nature input (such as voice) With control electronics.

Described above is can be directed to the search that any kind of content performs, including to YouTube^TM、Hulu^TMOr appoint The what search of his video sharing web sites or the video clipping on web services.In addition, as described above, user may search for local It is stored in the music content that can be accessed in a music libraries or via network (such as internet).User, which can have, limits search It is formed on the ability of certain types of content (such as music, video or the programme content of arrangement) so that search result only includes use It is expected the certain types of content of search in family.Therefore, search interface can be associated with advanced searching capabilities, advanced searching capabilities Phonetic entry and/or other input forms can be used to be configured.

In certain embodiments, the inclusive segment shown in search result can include multiple labels (such as voice mark Label), one of tag identifier content, action that another label instruction is performed with content (such as viewing, record or buy in Hold).For search interface, the quantity of the label associated with search result is not the limitation of the embodiment of the present invention.

Fig. 7 shows the explanation for the computer system 700 that can be used in combination with any embodiment of invention described herein The realization of property.Computer system 700 can include one or more processors 710 and one or more is computer-readable non-volatile Property storage medium (such as memory 720 and one or more non-volatile memory mediums 730).Processor 710 can be with any Appropriate mode is controlled to writing data to memory 720 and non-volatile memory device 730 and reading data from them, Because each side of invention as described herein is not restricted by this.In order to perform any work(described herein Energy property, processor 710 can perform one be stored in one or more computer-readable recording mediums (such as memory 720) Individual or multiple instruction, one or more of computer-readable recording mediums may act as storing what is performed by processor 710 The non-volatile computer readable storage medium storing program for executing of instruction.

The above embodiment of the present invention can be realized with any one of various ways.For example, embodiment can make Realized with hardware, software or its combination.When implemented in software, software code can be in any suitable processor or processing Performed on device collection, no matter be provided in single computer and be also distributed across between multiple computers.It should be appreciated that perform above-mentioned Any component or component set of function can usually be considered to be the one or more controllers for controlling above-mentioned function.Described one Individual or multiple controllers can be realized in many ways, such as be programmed to perform above-mentioned function with using microcode or software Common hardware (such as one or more processors) or specialized hardware.

In this respect, it should be clear that a realization of embodiments of the invention includes at least one non-volatile computer Readable storage medium storing program for executing (such as computer storage, floppy disk, CD, tape etc.), it is compiled with computer program (i.e. multiple instruction) Code, when the computer program performs on a processor, performs the above-mentioned function of embodiments of the invention.It is computer-readable to deposit Storage media can be transmittable so that the program stored thereon can be loaded on any computer resource to realize herein The each aspect of the present invention discussed.Moreover, it will be appreciated that the referenced above-mentioned functional computer program of execution upon being performed It is not limited to the application program run on a host computer.On the contrary, herein using term computer program with general significance Upper finger can be used for programmed process device to realize any kind of computer code of the above-mentioned each side of the present invention (such as software Or microcode).

The various aspects of the present invention can be used alone, be applied in combination or not discuss specifically in the aforementioned embodiment It is diversified to arrange to use, therefore their application is not limited to institute in the above description by the various aspects of the present invention The arrangement and details of component illustrate or described in the accompanying drawings.For example, each side described in one embodiment can be with It is combined with each side described in other embodiment in any way.

Moreover, embodiments of the invention can be implemented as one or more methods, there has been provided its example.As method Part performed by action can sort in any suitable manner.Therefore, can construct wherein with it is shown suitable The different order of sequence performs the embodiment of action, and it may include to perform some actions simultaneously, even if in an illustrative embodiment It is shown as sequentially-operating.

Carry out modification right using the ordinal number of " first ", " second " " the 3rd " etc. in the claims and require element sheet Body is not meant to a claim elements relative to any order of another claim elements, precedence or preferential, The time sequencing that the action of method is performed is not meant that yet.These terms are used only as marking to distinguish one with a certain title Individual claim elements and another key element with same names (in addition to using ordinal number).

Wording as used herein and term for descriptive purposes, are not considered as limiting." comprising " as used herein, "comprising", " having " "comprising" " being related to " and its modification are intended to include items listed thereafter and other project.

Several embodiments of the present invention are described in detail, various modifications are readily appreciated in those skilled in the art And improvement.These modification and improvement are intended to belong to the spirit and scope of the present invention.Therefore, description above is merely exemplary , and be not intended to be limiting.As the present invention is limited only as claim and its equivalent limits.

Claims

A kind of 1. visual user interface in the digital tunable electronic equipment for being configured as the programme content that display arranges The upper method that search result is presented, methods described include：

Receive search inquiry；

The natural language understanding analysis to the search inquiry is based at least partially on, searches for the programme content of at least one arrangement Data source and at least one bundled services content-data source；With

The result of search is presented on the user interface, wherein the result combination searched for is corresponding to the programme content arranged At least one first result and at least one second result corresponding to bundled services content.
2. according to the method for claim 1, wherein at least one second result includes at least one bundled services knot Fruit, when at least one bundled services result is chosen, show the multiple results for carrying out self-corresponding bundled services data source.
3. according to the method for claim 1, wherein at least one bundled services data source includes being used for based on web's The data source of service.
4. according to the method for claim 1, wherein at least one bundled services data source includes setting with the electronics Standby associated local data source.
5. according to the method for claim 1, wherein at least one bundled services data source is included via network connection Multiple data sources.
6. according to the method for claim 1, wherein at least one bundled services data source includes the number of on-demand content According to source.
7. according to the method for claim 1, wherein the result that search is presented includes the result with search is presented In it is at least one corresponding to image.
A kind of 8. computer-readable recording medium encoded with multiple instruction, when the instruction is performed by least one computer When, perform a kind of visual user interface in the digital tunable electronic equipment for being configured as the programme content that display arranges The upper method that search result is presented, methods described include：

Receive search inquiry；

The natural language understanding analysis to the search inquiry is based at least partially on, searches for the programme content of at least one arrangement Data source and at least one bundled services content-data source；With

The result of search is presented on the user interface, wherein the result combination searched for is corresponding to the programme content arranged At least one first result and at least one second result corresponding to bundled services content.
9. computer-readable recording medium according to claim 8, wherein the result that search is presented include presenting with At least one corresponding image in the result of search.
10. a kind of digital tunable electronic equipment for being configured as the programme content that display arranges, the electronic equipment bag Include：

At least one processor, is programmed to：

Receive search inquiry；

The natural language understanding analysis to the search inquiry is based at least partially on, searches for the programme content of at least one arrangement Data source and at least one bundled services content-data source；With

The result of search is presented on a user interface, wherein the result combination searched for corresponds to the programme content arranged extremely Few first result and at least one second result corresponding to bundled services content.
11. digital tunable electronic equipment according to claim 10, wherein at least one second result bag At least one bundled services result is included, when at least one bundled services result is chosen, shows and carrys out self-corresponding binding Multiple results of service data source.
12. digital tunable electronic equipment according to claim 10, wherein at least one bundled services number Include the data source for the service based on web according to source.
13. digital tunable electronic equipment according to claim 10, wherein at least one bundled services number Include the local data source associated with the electronic equipment according to source.
14. digital tunable electronic equipment according to claim 10, wherein at least one bundled services number Include multiple data sources via network connection according to source.
15. digital tunable electronic equipment according to claim 10, wherein at least one bundled services number Include the data source of on-demand content according to source.
16. a kind of method for providing the user interface for digital tunable electronic equipment, the electronic equipment are configured The programme content arranged for display, methods described include：

Show multiple labels unrelated with content in the user interface, the multiple label unrelated with content include with it is interior Hold the first unrelated label, be somebody's turn to do the first content unit that first tag identifier unrelated with content returns from search；With

Correspond to the first input of first label unrelated with content in response to receiving, perform relevant with first content unit At least one action, wherein the first input includes the first phonetic entry, and the first wherein unrelated with content label is configured To be responded to the first phonetic entry.
17. the method according to claim 11, in addition to：

The second input is received, wherein second label unrelated with content in the multiple label unrelated with content is configured as Second input is responded；With

Wherein performing at least one action relevant with first content unit includes being based at least partially on the second input Perform at least one action.
18. according to the method for claim 17, wherein the second input is the second phonetic entry, and it is wherein unrelated with content The second label be configured as responding the second phonetic entry.
19. according to the method for claim 17, it is included in reception first wherein receiving first and inputting and receive the second input The second input is received before input.
20. the method according to claim 11, in addition to：

Based on the first input selection first content unit.
21. according to the method for claim 16, wherein performing at least one action relevant with first content unit includes By the tune electronic devices to channel to show the program of the arrangement for first content unit.
22. according to the method for claim 16, wherein first content unit corresponds to the binding for including multiple search results Service content unit, wherein performing at least one action relevant with first content unit includes showing the multiple search knot Fruit.
23. the method according to claim 11, in addition to：

Multiple voice commands are associated with the user interface, wherein the multiple voice command include the first voice command and Second voice command, wherein the first voice command calls the first action and the second voice command calls the second action, and its In the first voice command and the second voice command identified by the electronic equipment, without considering what is shown in the user interface Specific screens.
A kind of 24. computer-readable recording medium encoded with multiple instruction, when the instruction is performed by least one computer When, a kind of method that the user interface for digital tunable electronic equipment is provided is performed, the electronic equipment is configured The programme content arranged for display, methods described include：

Show multiple labels unrelated with content in the user interface, the multiple label unrelated with content include with it is interior Hold the first unrelated label, be somebody's turn to do the first content unit that first tag identifier unrelated with content returns from search；With

Correspond to the first input of first label unrelated with content in response to receiving, perform relevant with first content unit At least one action, wherein the first input is the first phonetic entry, and the first wherein unrelated with content label is configured as First phonetic entry is responded.
25. a kind of digital tunable electronic equipment for being configured as the programme content that display arranges, the electronic equipment bag Include：

At least one processor, is programmed to：

Show multiple labels unrelated with content on a user interface, the multiple label unrelated with content include with content without The first label closed, it is somebody's turn to do the first content unit that first tag identifier unrelated with content returns from search；With

Correspond to the first input of first label unrelated with content in response to receiving, perform relevant with first content unit At least one action, wherein the first input is the first phonetic entry, and the first wherein unrelated with content label is configured as First phonetic entry is responded.
26. digital tunable electronic equipment according to claim 25, wherein at least one processor also by It is programmed for：

The second input is received, wherein second label unrelated with content in the multiple label unrelated with content is configured as Second input is responded；With

Wherein performing at least one action relevant with first content unit includes being based at least partially on the second input Perform at least one action.
27. digital tunable electronic equipment according to claim 25, wherein the execution and first content unit Relevant at least one action is included the tune electronic devices to channel to show the arrangement for first content unit Program.
28. digital tunable electronic equipment according to claim 25, wherein first content unit correspond to and included The bundled services content element of multiple search results, wherein performing at least one action relevant with first content unit includes showing Show the multiple search result.
29. a kind of digital tunable electronic equipment, including：

At least one processor, is programmed to：

User interface is provided, the user interface enables the electronic equipment to receive search inquiry but regardless of when the search Which of multiple screens are displayed in the user interface when inquiry is received, wherein the search inquiry is included to wanting The search for the content for showing and/or playing back on the digital tunable electronic equipment；

Receiving includes the phonetic entry of the search inquiry；With

In response to receiving the search inquiry, start the search to content corresponding to the search inquiry.
30. digital tunable electronic equipment according to claim 29, wherein the search started to content includes inciting somebody to action Inquiry to content is sent at least one data source by one or more network connections to the electronic equipment.
31. digital tunable electronic equipment according to claim 29, wherein at least one processor also by It is programmed for：

Show one or more icons in the user interface, one or more of icon instruction users can be used for starting pair The input of the search of content.
32. digital tunable electronic equipment according to claim 29, wherein at least one processor also by It is programmed for：

Multiple voice commands are associated with the user interface, wherein the multiple voice command include the first voice command and Second voice command, wherein the first voice command calls the first action and the second voice command calls the second action.
33. digital tunable electronic equipment according to claim 32, wherein the first action and/or the second action pair Should be in search of the startup to content.
34. a kind of computer implemented method, including：

User interface is provided, the user interface enables electronic equipment to receive search inquiry but regardless of when the search inquiry Which of multiple screens are displayed in the user interface when being received, wherein the search inquiry is included to will be in institute State the search for the content for showing and/or playing back on electronic equipment；

Receiving includes the phonetic entry of the search inquiry；With

In response to receiving the search inquiry, start the search to content corresponding to the search inquiry.
35. computer implemented method according to claim 34, wherein include will be to content for the search started to content Inquiry be sent at least one data source by one or more network connections to the electronic equipment.
36. computer implemented method according to claim 34, in addition to：

Show one or more icons in the user interface, one or more of icon instruction users can be used for starting pair The input of the search of content.
37. computer implemented method according to claim 34, in addition to：

Multiple voice commands are associated with the user interface, wherein the multiple voice command include the first voice command and Second voice command, wherein the first voice command calls the first action and the second voice command calls the second action.
38. the computer implemented method according to claim 37, opened wherein the first action and/or the second action correspond to The dynamic search to content.
A kind of 39. computer-readable recording medium encoded with multiple instruction, when the instruction is performed by least one computer When, a kind of method is performed, methods described includes：

User interface is provided, the user interface enables electronic equipment to receive search inquiry but regardless of when the search inquiry Which of multiple screens are displayed in the user interface when being received, wherein the search inquiry is included to will be in number The search for the content for showing and/or playing back on the electronic equipment that word formula is tunable；

Receiving includes the phonetic entry of the search inquiry；With

In response to receiving the search inquiry, start the search to content corresponding to the search inquiry.
40. the computer-readable recording medium according to claim 39, wherein the search started to content is included internally The inquiry of appearance is sent at least one data source by one or more network connections to the electronic equipment.
41. the computer-readable recording medium according to claim 39, wherein methods described also include：

Show one or more icons in the user interface, one or more of icon instruction users can be used for starting pair The input of the search of content.
42. the computer-readable recording medium according to claim 39, wherein methods described also include：

Multiple voice commands are associated with the user interface, wherein the multiple voice command include the first voice command and Second voice command, wherein the first voice command calls the first action and the second voice command calls the second action.
43. computer-readable recording medium according to claim 42, wherein the first action and/or the second action correspond to Start the search to content.
44. a kind of digital tunable electronic equipment, including：

At least one processor, is programmed to：

Receive the first input；

Enter listening mode in response to recognizing the first input；

It is determined that it is defeated whether to receive second during the special time amount when the electronic equipment is in the listening mode Enter, wherein the first input and/or the second input are phonetic entries；With

The second input is not received by during the special time amount and exit the listening mode in response to determination.
45. digital tunable electronic equipment according to claim 44, wherein the second input is to exit the monitoring The implicit commands of pattern；And wherein described at least one processor is also programmed to：

The listening mode is exited in response to receiving the second input.
46. digital tunable electronic equipment according to claim 44, wherein at least one processor also by It is programmed for：

The first input is monitored in response to exiting the listening mode.
47. digital tunable electronic equipment according to claim 44, wherein the electronic equipment is also included at least One display, and wherein described at least one processor is also programmed to：

On at least one display display to the electronic equipment currently whether be in listening mode in instruction.
48. digital tunable electronic equipment according to claim 47, wherein the instruction includes one or more Select label and/or icon.
49. digital tunable electronic equipment according to claim 44, wherein at least one processor also by It is programmed for：

Determine whether the electronic equipment is in listening mode；With

The multiple voice labels unrelated with content are shown in response to determining the electronic equipment to be in listening mode.
50. digital tunable electronic equipment according to claim 49, wherein at least one processor also by It is programmed for：

The multiple voices unrelated with content are hidden in response to determining the electronic equipment to be not in the listening mode Label.
51. a kind of computer implemented method, including：

Receive the first input；

In response to recognizing the first input so that electronic equipment enters listening mode；

It is determined that it is defeated whether to receive second during the special time amount when the electronic equipment is in the listening mode Enter, wherein the first input and/or the second input are phonetic entries；With

The second input is not received by during the special time amount and exit the listening mode in response to determination.
52. computer implemented method according to claim 51, wherein the listening mode is exited in the second input Implicit commands；And wherein methods described also includes：

The listening mode is exited in response to receiving the second input.
53. computer implemented method according to claim 51, wherein the electronic equipment includes at least one display Device, and wherein methods described also includes：

On at least one display display to the electronic equipment currently whether be in listening mode in instruction.
54. computer implemented method according to claim 53, wherein the instruction includes one or more selection marks Label and/or icon.
55. computer implemented method according to claim 51, in addition to：

Determine whether the electronic equipment is in listening mode；

The multiple voice labels unrelated with content are shown in response to determining the electronic equipment to be in listening mode；With

The multiple voices unrelated with content are hidden in response to determining the electronic equipment to be not in the listening mode Label.
A kind of 56. computer-readable recording medium encoded with multiple instruction, when the instruction is performed by least one computer When, a kind of method is performed, methods described includes：

Receive the first input；

In response to recognizing the first input so that electronic equipment enters listening mode；

It is determined that it is defeated whether to receive second during the special time amount when the electronic equipment is in the listening mode Enter, wherein the first input and/or the second input are phonetic entries；With

The second input is not received by during the special time amount and exit the listening mode in response to determination.
57. computer-readable recording medium according to claim 56, wherein the electronic equipment includes at least one show Show device, and wherein methods described also includes：

On at least one display display to the electronic equipment currently whether be in listening mode in instruction.
58. computer-readable recording medium according to claim 57, wherein the instruction includes one or more selections Label and/or icon.
59. computer-readable recording medium according to claim 56, in addition to：

Determine whether the electronic equipment is in listening mode；

The multiple voice labels unrelated with content are shown in response to determining the electronic equipment to be in listening mode；With

The multiple voices unrelated with content are hidden in response to determining the electronic equipment to be not in the listening mode Label.
60. a kind of method scanned for the content to show and/or play back on digital tunable electronic equipment, institute State electronic equipment and be configured as the programme content that display arranges, methods described includes：

Being received from user includes the phonetic entry of search inquiry, wherein the search inquiry is including to will be on the electronic equipment The search of the content of display and/or playback；

The action that user wishes to carry out is determined based on the search inquiry；

The action that user wishes to carry out is based at least partially on, it is determined that to search for one or more data sources；With

The search inquiry is based at least partially on, search will be on the electronic equipment in one or more of data sources Display and/or the content of playback.
61. method according to claim 60, wherein determining that the action that user wishes to carry out includes：Determine that user thinks Media content is listened to, and wherein determines that the one or more data sources to be searched for include：Determine one or more of numbers It is music data source according to source.
62. method according to claim 60, wherein determining that the action that user wishes to carry out includes：Determine that user thinks Media content is watched, and wherein determines that the one or more data sources to be searched for include：Determine one or more of numbers According to the program content source that source is at least one arrangement.
63. according to the method for claim 60, in addition to：

The one or more rules of storage, one or more of rules by certain types of input with for search for it is one or The particular order of multiple data sources is associated；With

Wherein searching for one or more of data sources includes：Searched for according to one or more of rules one or more Individual data source.
64. method according to claim 60, wherein searching for one or more of data sources includes searching for all can use Data source.
65. method according to claim 60, in addition to：

From one or more of data sources search results；With

The search result is presented on a user interface.
A kind of 66. computer-readable recording medium encoded with multiple instruction, when the instruction is performed by least one computer When, perform a kind of method scanned for the content to show and/or play back on digital tunable electronic equipment, institute State electronic equipment and be configured as the programme content that display arranges, methods described includes：

Being received from user includes the phonetic entry of search inquiry, wherein the search inquiry is including to will be on the electronic equipment The search of the content of display and/or playback；

The action that user wishes to carry out is determined based on the search inquiry；

The action that user wishes to carry out is based at least partially on, it is determined that to search for one or more data sources；With

The search inquiry is based at least partially on, search will be on the electronic equipment in one or more of data sources Display and/or the content of playback.
67. computer-readable recording medium according to claim 66, wherein determining the action that user wishes to carry out Including：Determine that user wants to listen to media content, and wherein determine that the one or more data sources to be searched for include：Determine institute It is music data source to state one or more data sources.
68. computer-readable recording medium according to claim 66, wherein determining the action that user wishes to carry out Including：Determine that user wants viewing media content, and wherein determine that the one or more data sources to be searched for include：Determine institute State the program content source that one or more data sources are at least one arrangement.
69. computer-readable recording medium according to claim 66, wherein methods described also include：

The one or more rules of storage, one or more of rules by certain types of input with for search for it is one or The particular order of multiple data sources is associated；With

Wherein searching for one or more of data sources includes：Searched for according to one or more of rules one or more Individual data source.
70. a kind of digital tunable electronic equipment for being configured as the programme content that display arranges, the electronic equipment bag Include：

At least one processor, is programmed to：

Being received from user includes the phonetic entry of search inquiry, wherein the search inquiry is including to will be on the electronic equipment The search of the content of display and/or playback；

The action that user wishes to carry out is determined based on the search inquiry；

The action that user wishes to carry out is based at least partially on, it is determined that to search for one or more data sources；With

The search inquiry is based at least partially on, search will be on the electronic equipment in one or more of data sources Display and/or the content of playback.
71. digital tunable electronic equipment according to claim 70, wherein it is described to determine that user wishes to carry out Action includes：Determine that user wants to listen to media content, and wherein determine that the one or more data sources to be searched for include：Really Fixed one or more of data sources are music data source.
72. digital tunable electronic equipment according to claim 70, wherein it is described to determine that user wishes to carry out Action includes：Determine that user wants viewing media content, and wherein determine that the one or more data sources to be searched for include：Really Fixed one or more of data sources are the program content source of at least one arrangement.
73. digital tunable electronic equipment according to claim 70, wherein at least one processor also by It is programmed for：

The one or more rules of storage, one or more of rules by certain types of input with for search for it is one or The particular order of multiple data sources is associated；With

Wherein searching for one or more of data sources includes：Searched for according to one or more of rules one or more Individual data source.
74. digital tunable electronic equipment according to claim 70, wherein searching for one or more of data Source includes searching for all available data sources.