WO2014162756A1 - 情報処理装置、データ入力支援方法及びプログラム - Google Patents
情報処理装置、データ入力支援方法及びプログラム Download PDFInfo
- Publication number
- WO2014162756A1 WO2014162756A1 PCT/JP2014/050826 JP2014050826W WO2014162756A1 WO 2014162756 A1 WO2014162756 A1 WO 2014162756A1 JP 2014050826 W JP2014050826 W JP 2014050826W WO 2014162756 A1 WO2014162756 A1 WO 2014162756A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- information
- input
- data
- interest data
- interest
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/953—Querying, e.g. by the use of web search engines
- G06F16/9535—Search customisation based on user profiles and personalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
- G06F3/0237—Character input methods using prediction or retrieval techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/274—Converting codes to words; Guess-ahead of partial word inputs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/174—Form filling; Merging
Definitions
- This disclosure relates to an information processing apparatus, a data input support method, and a program.
- data input support systems that present candidates of information to be input to the user when the user inputs information are widespread.
- a data input support system for text input a system that predicts a next input word, character string, or the like based on an input character, word, character string, etc., and presents the candidate to the user It has been known.
- Patent Document 1 discloses a technique for correcting a recognition error in a character recognition system, in which character recognition is performed on text input as a recognition target based on the appearance frequency of words and the graphic similarity of characters.
- a technique for presenting word candidates for correcting the error is disclosed.
- Patent Document 2 discloses a technique for presenting a word candidate estimated to be input next based on a word included in a sentence preceding the sentence being input.
- the information presented as the input candidate is selected from the range related to the application to which the information is input.
- the word presented as a candidate is a dictionary in which text data input in the past in the system or text data managed in the system is comprehensively collected.
- the input candidates are not selected based on different types of applications that are not linked to each other or on different types of data.
- the present disclosure proposes a new and improved information processing apparatus, data input support method, and program capable of further improving user convenience.
- an update detection unit that detects an update of presentation information presented to a user during application execution, and at least information associated with the presentation information from which an update has been detected
- An interest data extraction unit that extracts interest data, which is information related to an object of interest
- an input context detection that detects an input context representing the processing status of the input information by the application for the input information that is about to be input during execution of the application
- an input information candidate presenting unit that performs control to present input information candidates that are candidates for the input information from the data of interest based on the input context.
- the update of the presentation information presented to the user during the execution of the application is detected, and includes at least information associated with the presentation information for which the update is detected, Extracting interest data, which is information relating to an object of interest, detecting an input context representing a processing status of the input information by the application for the input information about to be input during execution of the application, and the input context And a control for presenting input information candidates that are candidates for the input information from among the data of interest.
- the computer includes at least a function of detecting an update of the presentation information presented to the user during execution of the application, and information associated with the presentation information in which the update is detected, and the application is being executed
- the interest data is extracted with the presentation information being updated as a trigger, so that even if the data is between different applications or different data formats, the user can Interest data is extracted and shared in terms of whether it shows interest.
- the options for selecting input information candidates are wider and more in line with the user's intentions. Presentation of input information candidates is realized.
- FIG. 3 is a block diagram for explaining a hardware configuration of an information processing apparatus and a server according to an embodiment of the present disclosure.
- Configuration of data input support system In the present embodiment, an update of the presentation information presented to the user during the execution of the application is detected, and an interest that includes at least information associated with the presentation information from which the update has been detected and represents an object of interest of the user during the execution of the application Data is extracted. An input context representing the processing status of the input information by the application is detected for the input information that is about to be input during execution of the application, and based on the input context, the input information is a candidate of input information. Control for presenting input information candidates is performed. In the following description, the above series of processing is referred to as data input support processing.
- FIG. 1 is a functional block diagram illustrating a configuration example of a data input support system according to an embodiment of the present disclosure.
- a data input support system 1 includes an information processing apparatus 10 that is a terminal operated by a user, and a server 20 that manages interest data described later. It is assumed that the information processing apparatus 10 and the server 20 are connected to each other so that various types of information can be communicated with each other by an arbitrary communication format regardless of wired or wireless.
- the information processing apparatus 10 includes an input unit 110, an output unit 120, and a control unit 130.
- the input unit 110 is an input interface for the user to input various information and instructions regarding processing operations to the information processing apparatus 10.
- the input unit 110 is configured by an input device having operation means operated by a user, such as a mouse, a keyboard, and a touch panel.
- the user can input various data processed by the application during execution of the application from the input unit 110.
- mail software emailer
- the user inputs the text of the mail created by the mailer via the input unit 110, or data attached to the created mail Can be selected.
- photo browsing software photo browser
- the user can specify photo data displayed by the photo browser via the input unit 110.
- audio reproduction software media player
- the user can specify audio data to be reproduced by the media player via the input unit 110.
- various pieces of information input by the user from the input unit 110 during application execution are referred to as input information.
- the output unit 120 is an output interface for outputting various types of information processed in the information processing apparatus 10 visually or audibly to the user.
- the output unit 120 includes various output devices such as a display device that displays text data, photo data, and the like on a display screen, and an audio output device such as a speaker and headphones that outputs audio data as audio. .
- the output unit 120 outputs various data processed by the application to the user during execution of the application. For example, in the example given in the description of the input unit 110 described above, when a mailer is executed as an application, the output unit 120 generates text data included in the text of an email created by the mailer, The content of the data attached to the received mail is displayed on the display screen.
- the output unit 120 displays an image of photo data processed by the photo browser on the display screen. Further, for example, when a media player is executed as an application, the output unit 120 outputs the content of audio data reproduced by the media player as audio from a speaker or the like. Thus, it can be said that the information output from the output unit 120 during execution of the application is information visually or audibly presented to the user.
- information output to the user by the output unit 120 is referred to as presentation information.
- the present embodiment will be described by taking as an example a case where the presentation information is data visually displayed on the display screen of the output unit 120.
- the control unit 130 controls the information processing apparatus 10 in an integrated manner, and performs various types of information processing in the data input support process according to the present embodiment. Hereinafter, the function and configuration of the control unit 130 will be described in detail.
- the control unit 130 includes an application control unit 131, an update detection unit 132, an interest data extraction unit 133, an input context detection unit 134, and an input information candidate presentation unit 135.
- the application control unit 131 performs various types of information processing during application execution, and integrally controls operations of various types of applications in the information processing apparatus 10. Specifically, the application control unit 131 processes information output from the information processing apparatus 10 and information input to the information processing apparatus 10 during application execution. For example, the application control unit 131 controls driving of the output unit 120 and causes the output unit 120 to output presentation information presented to the user during application execution. Further, for example, the application control unit 131 reflects input information input from the input unit 110 during execution of the application in the application being executed.
- the application executed by the application control unit 131 may be any known application such as a mailer, a photo browser, a media player, a web browser, or a microblog (eg, Twitter (registered trademark)).
- the update detection unit 132 detects an update of the presentation information presented to the user during application execution. Specifically, the update detection unit 132 monitors the operation of the application control unit 131 and detects whether the presentation information has been updated. For example, if the application being executed is a mailer, the update detection unit 132 presents when the display of the character string in the text input area of the mail displayed on the display screen of the output unit 120 is changed by the application control unit 131. Detect that information has been updated. For example, if the application being executed is a photo browser, the update detection unit 132 may update the presentation information when the application control unit 131 changes a photo displayed on the display screen of the output unit 120. Detects that.
- the update detection unit 132 can detect that the presentation information has been updated by, for example, changing the display on the display screen of the output unit 120.
- the update detection unit 132 detects an update of the presentation information
- the update detection unit 132 transmits information to that effect (information indicating that the presentation information is updated) to the interest data extraction unit 133.
- the interest data extraction unit 133 receives the information indicating that the presentation information has been updated from the update detection unit 132, the update is detected from various information processed by the application control unit 131 during the execution of the application.
- Interest data is extracted that includes at least information associated with the presentation information and is information related to an object of interest of the user during execution of the application.
- the interest data may include the presentation information itself.
- the presentation information is information presented to the user during application execution. Therefore, the presentation information is information browsed by the user during execution of the application, and can be said to be information indicating the object of interest of the user.
- the interest data extraction unit 133 can extract the interest data that is information related to the user's interest by extracting the presentation information in which the update is detected and the information accompanying the presentation information.
- the interest data extraction unit 133 according to the present embodiment can extract the presentation information and the information accompanying the presentation information as the interest data by making an inquiry to the application control unit 131.
- the information accompanying the presentation information may include metadata associated with the presentation information.
- the presentation information that is actually visually presented to the user by the photo browser is image data included in the photo data.
- the photo data includes information such as the title (label) as file information.
- information such as the shooting date and time and the shooting location is included as, for example, Exif (Exchangeable Image File Format) information.
- the file information, Exif information, and the like of these photographic data are not presentation information itself, but are metadata associated with the presentation information, and can be said to be information indicating an object of interest of the user.
- the interest data extraction unit 133 can also extract metadata associated with such presentation information as interest data.
- the information accompanying the presentation information may include the processing status of the presentation information by the application, that is, the context information of the presentation information.
- the context information of the presentation information is information regarding how the presentation information has been processed by the application. For example, when the presentation information is a character string of a text input area that is being executed by the mailer, the context information of the presentation information is information that “the character string is displayed as a mail text in the mailer”. Good. Further, when the presentation information is a character string in an article in a blog (Blog (Weblog)) being executed by a Web browser, the context information of the presentation information is “the character string displayed as the text in the article in the blog.
- the interest data extraction unit 133 can also extract the context information of such presentation information as interest data.
- the information accompanying the presentation information may include original data to which the presentation information belongs.
- the presentation information is image data of photographic data
- the photographic data itself that is the original data to which the presentation information belongs is also information accompanying the presentation information. Therefore, the interest data extraction unit 133 can extract the photograph data itself, which is the original data to which the presentation information belongs, as interest data.
- the interest data extraction unit 133 may detect any information as interest data as long as it is information related to the object of interest of the user during execution of the application.
- the interest data extraction unit 133 transmits the extracted interest data to the interest data database (DB) 210 of the server 20 described later.
- the interest data extraction unit 133 may receive various types of information related to the interest data from the application control unit 131 when extracting the interest data, and transmit the various types of information together with the interest data to the interest data DB 210. it can.
- Various types of information related to the interest data include, for example, the time when the interest data was extracted (extraction time), the time used as input information (use time), the information source, the type of information, and the input information. It may be information such as the number of hits (number of hits).
- the extraction time and the use time are collectively referred to as acquisition time. Specific examples of the interest data and various types of information related to the interest data will be described later with reference to FIG. 2 when the function of the interest data DB 210 is described.
- the input context detection unit 134 detects, for input information about to be input during application execution, an input context representing the processing status of the input information by the application.
- the input context is information indicating what information is being input as input information.
- the input context includes information such as the data format of the input information, the type of input information, and the type of application to which the input information is to be input.
- the data format of the input information indicates a data format such as text data, photo data, or audio data.
- the type of input information means, for example, as input information information such as whether the input information is a character string, whether the character string represents a place name, a person name, or a general noun. Is shown.
- the input context means the background (broadly defined context) that the input information is about to be input, and information about the application being executed (for example, a data format that can be input in the application, The type of information that would be input in the application) and the input information. Therefore, the input context detection unit 134 according to the present embodiment can detect the context information of such input information by receiving necessary information from the application control unit 131.
- the function of the input context detection unit 134 will be specifically described with an example. For example, it is assumed that the letter “N” is input to the text input area for the mail body by the user via the input unit 110 while the mailer is being executed as an application.
- the application control unit 131 to which this information is input displays the character “N” on the display screen of the output unit 120 and detects that the above information is input from the input unit 110 as input context detection. To the unit 134.
- the application control unit 131 indicates that the application being executed is a mailer, that a character string (text data) is about to be input, and that the character “N” is actually input. Recognizes various types of information related to input information.
- the input context detection unit 134 makes an inquiry to the application control unit 131, for example, that the input information is a character string starting from “N” (a character string starting from “N” is about to be input), Information such as the fact that the data format of the input information is text data and that the application to which the input information is input is a mailer can be detected as the input context.
- the function of the input context detection unit 134 will be further described with another example.
- the application control unit 131 to which this information is input causes the display unit of the output unit 120 to display photographic data that is a candidate for attached data, and inputs information indicating that the above information has been input from the input unit 110. It transmits to the context detection unit 134.
- the application control unit 131 indicates that the application being executed is a mailer, that photo data is about to be input, and the location (path) of a folder in which photo data that is a candidate for attached data is stored. It recognizes various information related to the input information. Accordingly, the input context detection unit 134 makes an inquiry to the application control unit 131, for example, that the input information (data format of the input information) is photo data, and the location (path) of the folder in which the photo data is stored. , And information indicating that the application to which the input information is to be input is a mailer can be detected as the input context.
- the input context detection unit 134 may detect any information as input context as long as it is information related to input information.
- the input context detection unit 134 transmits the detected input context to the input information candidate presentation unit 135 and the server 20.
- the input context detection unit 134 can transmit information about the time when the input context is detected together with the detected input context to the input information candidate presentation unit 135 and the server 20.
- the server 20 performs processing for matching the detected input context with the interest data stored in the interest data DB 210.
- the matching process is a process of selecting interest data that matches the input context from the interest data DB 210. Details of the matching process will be described later when the configuration of the server 20 is described.
- the server 20 transmits the result of the matching process to the input information candidate presentation unit 135.
- the input information candidate presentation unit 135 presents a control for presenting input information candidates that are candidates for input information from the interest data extracted by the interest data extraction unit 133 based on the input context detected by the input context detection unit 134. I do. Specifically, the input information candidate presentation unit 135 selects an input information candidate to be presented to the user based on the input context detected by the input context detection unit 134, and the input information candidate is input via the application control unit 131. Control to be displayed on the display screen of the output unit 120. Here, the input information candidate presentation unit 135 receives a result of the matching process between the input context and the interest data performed by the server 20, and presents the input information candidate from the interest data based on the matching result. May be performed. Further, the input information candidate presenting unit 135 may prioritize the input information candidates when presenting the input information candidates, and may present the input information candidates according to the priorities.
- the server 20 includes an interest data DB 210 and a server control unit 220.
- the interest data DB 210 is an example of a storage medium for storing various types of information processed by the server 20 and processed results.
- the interest data DB 210 stores the interest data extracted by the interest data extraction unit 133 of the information processing apparatus 10.
- the interest data DB 210 can manage the history of the interest data by storing the interest data and various types of information related to the interest data in association with each other.
- FIG. 2 is an explanatory diagram for explaining an example of the interest data stored in the interest data DB 210 and various types of information related to the interest data.
- the interest data is stored in the interest data DB 210 in association with various types of information related to the interest data, for example, the acquisition time of the interest data, the information source, the type of information, and the number of hits. .
- the acquisition time indicates the time when the interest data is extracted by the interest data extraction unit 133 (extraction time) or the time when the interest data is used as input information (use time).
- the information source indicates the type of original data or metadata from which interest data is extracted.
- the type of information indicates the type (property) of interest data.
- the number of hits indicates the number of times the interest data is used as input information.
- FIG. 2 shows an example of interest data extracted in this series of operations.
- the character string “New York City” and the character string “John”, which are the presentation information itself, are extracted as interest data by the interest data extraction unit 133, and the interest data DB 210 Is remembered.
- the interest data “New York City” as the information related to the interest data, for example, the acquisition time “1:00”, the information source “comment text”, and the information type “place name” are stored in association with each other.
- the interest data “John” as the information related to the interest data, for example, the acquisition time “10:00”, the information source “comment text”, and the information type “person name” are associated and stored. .
- a DB in which words generally used as person names and place names are registered is prepared, and the interest data DB 210 is extracted. Information acquired by referring to the DB based on the interest data.
- the character string “New York”, which is information accompanying the presentation information, is extracted as the interest data, not the presentation information itself.
- the interest data “New York” is not the presentation information itself but information related to the position at the time of comment posting detected by GPS or the like. Therefore, as shown in FIG. 2, the interest data “New York” includes, for example, the acquisition time “10:00”, the information source “the position at the time of comment posting”, and the type of information as information related to the interest data.
- “Location (GPS)” is associated and stored in the interest data DB 210.
- information accompanying the presentation information is extracted as the interest data, not the picture image itself as the presentation information.
- “Nottingham” that is the place where the photograph was taken and “10/2” that is the date and time when the photograph was taken are extracted as interest data from the Exif information of the photograph data that is the presentation information.
- the character string “Nancy” included in the label of the photo data is extracted as the interest data from the file information of the photo data.
- the interest data “Nottingham”, “10/2”, and “Nancy” are also stored in the interest data DB 210 in association with various information related to the interest data.
- the interest data “Nottingham” includes, as information related to the interest data, for example, an acquisition time “2:00”, an information source “Exif information of photo data”, and an information type “ “Location (GPS)” is associated and stored in the interest data DB 210.
- the information related to the interest data for example, the acquisition time “2:00”, the information source “Exif information of the photo data”, and the information type “date and time” are associated with the interest data “10/2”.
- the interest data “Nancy” is associated with, for example, an acquisition time “2:00”, an information source “photo data label”, and an information type “person name” as information related to the interest data. It is stored in the data DB 210.
- the interest data DB 210 stores the interest data in association with various types of information related to the interest data. Further, the interest data DB 210 can store the information while updating the information whenever new information regarding the interest data is input. That is, the interest data DB 210 can manage the history of interest data.
- the hit number column the number of times that the interest data has been used as input information until then is input.
- the interest data “New York”, “John”, “New York City”, “Nottingham”, “10/2”, and “Nancy” are extracted as character strings or numeric strings. Yes.
- the server control unit 220 controls the server 20 in an integrated manner and performs various types of information processing in the data input support process according to the present embodiment.
- the server control unit 220 refers to the interest data DB 210 to perform a matching process between the input context and the interest data.
- the server control unit 220 includes an interest data matching unit 221.
- the interest data matching unit 221 performs a matching process of selecting interest data that matches the input context detected by the input context detection unit 134 from the interest data DB 210.
- the interest data matching unit 221 when the interest data matching unit 221 receives the input context of the input information from the input context detection unit 134, the interest data matching unit 221 selects the interest data stored in the interest data DB 210 that matches the input context. .
- the data of interest that matches the input context selected in the matching process is also referred to as a matching candidate.
- the function of the interest data matching unit 221 will be described by taking as an example a case where the input context detecting unit 134 detects that “a character string starting with“ N ”is about to be input” as the input context. This will be described in detail.
- the interest data matching unit 221 receives “a character string starting from“ N ”is about to be input” as the input context, first, the interest data matching unit 221 first selects the data format from the interest data stored in the interest data DB 210. Interest data that is text data (character string). Then, interest data whose initial is “N” is further selected from the interest data as interest data that matches the input context. For example, in the example illustrated in FIG. 2, the interest data matching unit 221 selects “New York”, “New York City”, “Nottingham”, and “Nancy” as interest data that matches the input context.
- interest data that matches the data format included in the input context may be selected.
- interest data that matches the type of information may be selected.
- various types of information included in the input context is compared with the interest data and the information related to the interest data, so that the interest data suitable for the input context is obtained. It may be selected.
- the interest data matching unit 221 can determine the priority order when presenting it as input information candidates based on a predetermined method when selecting interest data that matches the input context.
- the function of the interest data matching unit 221 is described in ⁇ 2. Specific examples of data input support processing> will be described in detail again.
- the interest data matching unit 221 transmits the matching processing result (matching result) to the input information candidate presenting unit 135 of the information processing apparatus 10. Based on the result of the matching process, the input information candidate presentation unit 135 can select interest data that matches the input context as an input information candidate, and can perform control for presenting it to the user.
- each component of the information processing apparatus 10 and the server 20 may be configured using general-purpose members or circuits, or may be configured by hardware specialized for the function of each component.
- a CPU Central Processing Unit
- the like may perform all the functions of each component. Therefore, it is possible to appropriately change the configuration to be used according to the technical level at the time of carrying out the present embodiment.
- the data input support system 1 includes the information processing apparatus 10 and the server 20 has been described.
- the present embodiment is not limited to such an example. All of the functions of each functional block shown in FIG. 1 may be performed by one device, or may be performed by being distributed to two or more devices.
- the information processing apparatus 10 may perform the functions of the interest data 210 and the interest data matching unit 221.
- the information processing apparatus 10 may be an interface device that has only the functions of the input unit 110, the output unit 120, and the application control unit 131, that is, only to execute an application. May be performed.
- the server 20 may be a server provided on the cloud, for example, and the information processing apparatus 10 and the server 20 may be connected to each other via a communication network (network).
- the update detection unit 132 detects the update of the presentation information presented to the user during the application execution, and the interest data extraction unit 133 updates the information.
- Interest data which is information related to the object of interest of the user during the execution of the application, is extracted including at least information accompanying the detected presentation information.
- the interest data is extracted by using the update of the presentation information as a trigger, so that the data is in different data formats even between different applications. Also, interest data is extracted and shared from the viewpoint of whether the user is interested.
- the input context that indicates the processing status of input information by the application is detected by the input context detection unit 134 for the input information that is about to be input during execution of the application.
- the input information candidate presenting unit performs control for presenting input information candidates that are candidates for input information from the data of interest based on the input context.
- interest data extracted in one application can be presented as input information candidates in another application.
- not only the presentation information but also the information accompanying the presentation information is extracted as the interest data, so that more data is accumulated as the interest data. Therefore, the options for selecting input information candidates are wider, and a data input support system that is more convenient for the user is realized.
- the input context detected by the input context detection unit 134 may include various types of information related to the input information such as the data format of the input information. Therefore, in the matching process between the input context and the interest data, matching candidates can be narrowed down based on more conditions, so that interest data that is more desirable as input information is presented to the user as input information candidates, User convenience is improved.
- FIGS. 3 and 5 are explanatory diagrams for describing an example of a matching process between an input context and interest data.
- FIG. 4 is an explanatory diagram illustrating an example of a display screen when input information candidates are presented to the user.
- FIG. 3 shows the same interest data described with reference to FIG. 2 as an example of the interest data stored in the interest data DB 210. That is, the interest data “New York”, “New York City”, and “John” are extracted at the time of posting a comment using the miniblog at time 1:00, and by the photo browser performed at time 2:00. The interest data “Nottingham”, “10/2”, and “Nancy” are extracted at the time of browsing the photo, and are stored in the interest data DB 210 in association with various information related to the interest data as shown in FIG. In addition, about these interest data, since it is easy, the frequency
- the input context detection unit 134 detects that “a character string starting with“ N ”is about to be input” as the input context.
- the interest data matching unit 221 that has received the input context performs a matching process between the interest data stored in the interest data DB 210 and the input context.
- interest data whose data format is text data (character string) is selected from the interest data stored in the interest data DB 210 as interest data that matches the input context.
- interest data whose initial is “N” is selected from these interest data as a matching candidate that is interest data that matches the input context.
- “John” and “10/2”, which are interest data that does not meet these conditions, are excluded from the matching candidates.
- the exclusion from the matching candidate is expressed by drawing a strikethrough.
- the interest data matching unit 221 can assign priorities as input information candidates to the matching candidates in the matching process.
- the prioritization is performed, for example, by assigning a score (score) calculated based on a predetermined calculation formula to matching candidates.
- a score score
- number of times the interest data is used as input information number of hits.
- the calculation formula is set so that the score becomes higher.
- Such a calculation formula is expressed by, for example, the following formula (1).
- Score (interesting data extraction time or interest data use time ⁇ input context detection time) + (number of interest data hits ⁇ 10) ...
- the interest data corresponding to the presentation information most recently presented to the user, and the interest data used most recently by the user are given higher scores.
- the priority as an information candidate becomes high. Therefore, it is possible to increase the priority of matching candidates that are more likely to be used as input information by the user.
- the score calculated by the above formula (1) is described. Referring to FIG. 3, it can be seen that the interest data “Nottingham” and “Nancy” have relatively high scores, and the interest data “New York” and “New York City” have relatively low scores. In FIG. 3, description of the score column is omitted for the interest data “John” and “10/2” excluded from the matching candidates. The score calculation for the interest data excluded from the matching candidates may or may not be performed.
- the interest data matching unit 221 transmits the result of these matching processes (matching result) to the input information candidate presenting unit 135.
- the matching result includes information about the selected interest data (that is, a matching candidate) and its score.
- the interest data matching unit 221 inputs the interest data “New York”, “New York City”, “Nottingham”, and “Nancy” as matching results, and input information of these interest data. It transmits to the candidate presentation part 135.
- the input information candidate presenting unit 135 that has received the matching result displays the input information candidates on the display screen of the output unit 120 based on the content.
- FIG. 4 shows an example of a display screen on which input information candidates are displayed.
- FIG. 4 shows a state of the display screen 310 when the user is about to input a character string starting from the letter N in the text input area of the mailer body.
- “Iwent to N ” which is text data input by the user, is displayed on the display screen 310.
- An underline attached to “ N ” indicates that an input cursor for performing data input exists on “N”, and a character string starting from “N” is about to be input.
- “Nottingham”, “Nancy”, “New York”, and “New York City” are displayed in a list form as input information candidates 320 at the bottom of the display screen 310. Further, the input information candidates 320 are displayed in order from the highest score calculated by the interest data matching unit 221.
- the user can input the character string by selecting the character string that the user wants to input from the displayed input information candidates 320.
- the input information candidates 320 are displayed in order from the highest score, candidates that are more likely to be used as input information by the user are displayed in a place that is easily noticed by the user, User convenience is improved.
- the interest data extraction unit 133 can acquire the latest information from the application control unit 131 as information related to the interest data when the character string “New York City” is extracted as the interest data again.
- the extraction time or use time of the interest data “New York City” and the number of hits are updated from the stage shown in FIG.
- FIG. 5 shows an example of the interest data stored in the interest data DB 210 after the user selects “New York City” from the input information candidates. Referring to FIG. 5, the acquisition time of the interest data “New York City” is updated to “3:00” and the hit count is updated to “1” as compared to FIG. 3.
- the interest data matching unit 221 performs the matching process between the interest data stored in the interest data DB 210 and the input context again.
- the interest data stored in the interest data DB 210 is, for example, in the state shown in FIG. Has been updated. Therefore, the score calculation result is also different from the example shown in FIG. 3, and in the example shown in FIG. 5, the score of the interest data “New York City” is higher than the score of other interest data. This is because the above equation (1) is set so that the score becomes higher as the acquisition time of the interest data is closest. Therefore, when the input information candidate is displayed again on the display screen based on the matching result, “New York City” among the input information candidates is displayed in a place that is most easily noticeable by the user. Convenience in selecting input information is improved.
- FIGS. 6, 7, 8, and 9 data input support processing when input information is photo data will be described.
- 6, 7, and 8 are explanatory diagrams for describing an example of a matching process between an input context and interest data.
- FIG. 9 is an explanatory diagram illustrating an example of a display screen when input information candidates are presented to the user.
- FIGS. 6, 7, and 8 in order to explain the data input support process when “the data format of the input information is photo data” is detected as the input context, Shows photograph data, and furthermore, interest data extracted as information accompanying the presentation information related to these photograph data is shown in association with each photograph data.
- FIG. 6 shows interest data stored in the interest data DB 210 after a photograph is viewed using a photo browser as an example of interest data.
- a photo with a photo ID “ID-A” is viewed at a time 1:00 by a photo browser
- a photo with a photo ID “ID-B” is viewed at a time 2:00
- a time 3 Assume that a photo with a photo ID “ID-C” is viewed at 00.
- the interest data extraction unit 133 simultaneously extracts not only the image data included in those photographs that are the presentation information but also information associated with the presentation information.
- the photo ID is “ID-A”, “New York” that is the shooting location of the photo from the Exif information of the photo, and “John” that is the name of the photo from the photo label, Extracted as interest data.
- the photo has a photo ID “ID-B”, “Paris”, which is the shooting location of the photo, from the Exif information of the photo, and “Nancy”, which is the name of the photo, from the photo label, Extracted as interest data.
- the photo ID-C “New York”, which is the shooting location of the photo, is extracted as interest data from the Exif information of the photo. Similar to the example shown in FIG.
- these interest data are associated with information such as an acquisition time, an information source, an information type, and the number of hits, which are information related to these interest data. Is remembered.
- photographic data is illustrated as the interest data, and further, the interest data extracted as information accompanying the presentation information related to these photographic data is displayed for each photographic data. Therefore, the interest data “New York”, “John”, “Paris”, and “Nancy” are illustrated in association with the photo ID of the photo data. For the interest data, the current hit count is set to “0” for simplicity.
- FIG. 7 also shows the result of the score calculation in the interest data matching unit 221 when “input data format is photo data” is detected as the input context at this stage. . Referring to the score column, the score of the photo data with the photo ID “ID-A” with the hit number “1” is higher than the score of the other photo data.
- the user uses the mailer and inputs the character string “New York” in the text input area. Then, the acquisition time of the interest data “New York” is updated to “5:00”, and the hit count is updated to “1”. Further, as shown in FIG. 8, the acquisition time of the photo ID “ID-A” and “ID-C”, which is the photo data associated with the interest data “New York”, is updated to 5:00. . In addition, the hit number of the photo data with the photo ID “ID-A” is updated to “2”, and the hit number of the photo data with the photo ID “ID-C” is updated to “1”. In this embodiment, as shown in FIGS. 6, 7, and 8, when other interest data is associated with the interest data (photo data in FIGS. 6, 7, and 8), the acquisition is performed. Information related to the data of interest such as time and the number of hits may be shared with each other by these data of interest.
- the input context detection unit 134 detects that the data format of the input information is photo data as the input context.
- the interest data matching unit 221 that has received the input context performs a matching process between the interest data stored in the interest data DB 210 and the input context. In the matching process, interest data whose data format is photograph data is selected from interest data stored in the interest data DB 210 as interest data that matches the input context. In the example shown in FIG.
- the interest data matching unit 221 selects photo data with photo IDs “ID-A”, “ID-B”, and “ID-C” as matching candidates, and the above formula (1) ) To calculate the score for these photo data. Then, the interest data matching unit 221 obtains, as a matching result, photo data with photo IDs “ID-A”, “ID-B”, “ID-C”, and scores of these photo data as input information candidate presenting units. 135.
- the input information candidate presenting unit 135 that has received the matching result displays the input information candidates on the display screen of the output unit 120 based on the content.
- FIG. 9 shows an example of a display screen 310 on which input information candidates are displayed.
- FIG. 9 shows a state of the display screen 310 when the photograph data to be attached to the mail is selected by the user.
- thumbnails of photo data with photo IDs “ID-A”, “ID-B”, and “ID-C” are displayed in a list as input information candidates.
- these input information candidates are displayed in order from the highest score calculated by the interest data matching unit 221.
- input information candidates are displayed in the order of “ID-A”, “ID-C”, and “ID-B” based on the score calculation result shown in FIG. ing.
- the display screen 310 may also display attachable photo data that is not stored in the interest data DB 210, such as photo data with a photo ID “ID-D”.
- the input priority may be lower than the input information candidate selected from the interest data. This is because the input information candidate selected from the interest data indicates the target of the user's interest more and is more likely to be selected as input information.
- the user can attach the photograph data to the mail by selecting the photograph data that the user wants to input from the input information candidates displayed on the display screen 310.
- the input information candidates are displayed in order from the highest score, the candidates that are more likely to be used as input information by the user are displayed in a place where the user can easily recognize them. The convenience is improved.
- the data input support processing according to the present embodiment has been described in detail with a specific example with reference to FIGS. 3, 4, 5, 6, 7, 8, and 9.
- the data input support process according to the present embodiment is not limited to the above example, and various other information may be used as the interest data, the input context, and the input information.
- the interest data matching unit 221 sets the “information type” to “person name” from the interest data stored in the interest data DB 210. May be selected as a matching candidate.
- interest data having different data formats are extracted between different applications, and input information candidates are selected from the interest data. Therefore, data input support processing linked to each other is realized even between different applications. For example, assume that a mailer creates and sends an email immediately after posting a comment via a miniblog. As described above, when the posting of the comment and the creation of the mail are continuously performed, there is a high possibility that the text of the comment and the content of the mail are related to each other. In the data input support processing according to the present embodiment, immediately after posting a comment in which a character string meaning a person's name and / or place name is entered in the text, an email is created and an attempt is made to attach photo data to the email.
- a photo related to a person name and / or place name input in the text of a comment is displayed with a higher priority.
- interest data is extracted across different applications and input information candidates are selected between different applications, a data input support process that is more convenient for the user is realized.
- FIG. 10 is a flowchart showing a processing procedure of the data input support method according to the present embodiment.
- the update detection unit 132 detects whether or not the presentation information presented to the user during the application execution has been updated (step S401). If no update is detected, the process proceeds to step S407 to be described later.
- the interest data extraction unit 133 extracts the interest data that includes at least information associated with the presentation information from which the update has been detected and is information on the target of the user's interest during the execution of the application. (Step S403).
- the interest data may be any information as long as it is information related to the user's interest, and the interest data extraction unit 133 may extract various types of information related to the user's interest as interest data. it can.
- the interest data extracted in step S403 is stored in the interest data DB 210 (step S405).
- the interest data may be stored in association with various information related to the interest data.
- the various information related to the interest data may be, for example, the acquisition time of the interest data, the information source, the type of information, the number of hits, and the like.
- the interest data extraction in step S403 and the interest data storage in step S405 are performed whenever the presentation information is updated. Accordingly, the interest data stored in the interest data DB 210 may be updated as needed, and the interest data DB 210 may manage the history of the interest data.
- the input context detection unit 134 detects an input context representing the processing status of the input information by the application for the input information that is about to be input during the execution of the application (step S409).
- the input context may be any information as long as it is information related to the input information, and the input context detection unit 134 can detect various types of information related to the input information as the input context.
- the interest data matching unit 221 When the input context is detected, the interest data matching unit 221 performs a matching process for selecting the interest data that matches the detected input context from the interest data DB (step S411). In the matching processing, various types of information included in the input context is compared with the interest data and information related to the interest data, so that interest data that matches the input context is selected as a matching candidate. Also.
- the interest data matching unit 221 may calculate a score for determining a priority order as an input information candidate for each matching candidate in the matching process.
- step S413 input information candidates that are candidates for input information are presented from the interest data. Specifically, based on the result of the matching process in step S411, the input information candidate is presented from the interest data under the control of the input information candidate presenting unit 135. The user can perform smooth data input by selecting desired input information from the presented input information candidates.
- step S401 After the data input by the user is performed, the process returns to step S401, and the series of processes shown in FIG. 10 is repeated. Also, if no update is detected in step S407, the process returns to step S401, and the series of processes shown in FIG. 10 is repeated.
- the processing procedure of the data input support method according to the present embodiment has been described above with reference to FIG. Note that the flow illustrated in FIG. 10 is an example of a processing procedure of the data input support method according to the present embodiment, and the processing illustrated in each step may not be performed in the order illustrated in FIG. For example, the series of processes shown in steps S401 to S405 is performed as needed during the processes in the other steps. That is, the interest data may be extracted and stored as needed even while the input context is detected or the input information candidate is presented. This is because input information and input information candidates themselves are also presentation information and can be a target from which interest data is extracted.
- FIG. 11 is a block diagram for explaining a hardware configuration of the information processing apparatus 10 and the server 20 according to the embodiment of the present disclosure.
- the information processing apparatus 10 and the server 20 mainly include a CPU 901, a ROM 903, and a RAM 905. Further, the information processing apparatus 10 and the server 20 further include a host bus 907, a bridge 909, an external bus 911, an interface 913, an input device 915, an output device 917, a storage device 919, and a communication device 921. A drive 923 and a connection port 925.
- the CPU 901 functions as an arithmetic processing unit and a control unit, and controls all or a part of the operations in the information processing apparatus 10 and the server 20 according to various programs recorded in the ROM 903, the RAM 905, the storage apparatus 919, or the removable recording medium 929. To do.
- the ROM 903 stores programs used by the CPU 901, calculation parameters, and the like.
- the RAM 905 temporarily stores programs used by the CPU 901, parameters that change as appropriate during execution of the programs, and the like. These are connected to each other by a host bus 907 constituted by an internal bus such as a CPU bus.
- the CPU 901, the ROM 903, and the RAM 905 correspond to, for example, the control unit 130 and the server control unit 220 illustrated in FIG.
- the host bus 907 is connected to an external bus 911 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 909.
- PCI Peripheral Component Interconnect / Interface
- the input device 915 is an operation means operated by the user, such as a mouse, a keyboard, a touch panel, a button, a switch, and a lever.
- the input device 915 may be, for example, remote control means (so-called remote control) using infrared rays or other radio waves, or may be a mobile phone or a PDA corresponding to the operation of the information processing device 10 and the server 20.
- An external connection device 931 may be used.
- the input device 915 includes an input control circuit that generates an input signal based on information input by a user using the above-described operation means and outputs the input signal to the CPU 901, for example.
- the user of the information processing device 10 and the server 20 can input various data and instruct processing operations to the information processing device 10 and the server 20 by operating the input device 915.
- the input device 915 corresponds to, for example, the input unit 110 illustrated in FIG.
- the output device 917 is a device that can notify the user of the acquired information visually or audibly. Examples of such devices include CRT display devices, liquid crystal display devices, plasma display devices, EL display devices, display devices such as lamps, audio output devices such as speakers and headphones, printer devices, and the like.
- the output device 917 outputs, for example, results obtained by various processes performed by the information processing device 10 and the server 20. Specifically, the display device visually displays results obtained by various processes performed by the information processing device 10 and the server 20 in various formats such as text, images, tables, and graphs.
- the audio output device converts an audio signal composed of reproduced audio data, acoustic data, and the like into an analog signal and outputs it aurally.
- the output device 917 corresponds to, for example, the output unit 120 illustrated in FIG.
- the storage device 919 is a data storage device configured as an example of a storage unit of the information processing device 10 and the server 20.
- the storage device 919 corresponds to, for example, the interest data DB 210 shown in FIG.
- the storage device 919 includes, for example, a magnetic storage device such as an HDD (Hard Disk Drive), a semiconductor storage device, an optical storage device, or a magneto-optical storage device.
- the storage device 919 stores various information processed in the data input support process according to the present embodiment, such as a program executed by the CPU 901 and various data.
- the storage device 919 stores a history of interest data extracted by the interest data extraction unit 133.
- the information processing apparatus 10 and the server 20 may further include the following components.
- the communication device 921 is a communication interface configured by a communication device for connecting to a communication network (network) 927, for example.
- the communication device 921 is, for example, a communication card for wired or wireless LAN (Local Area Network), Bluetooth (registered trademark), or WUSB (Wireless USB).
- the communication device 921 may be a router for optical communication, a router for ADSL (Asymmetric Digital Subscriber Line), a modem for various communication, or the like.
- the communication device 921 can transmit and receive signals and the like according to a predetermined protocol such as TCP / IP, for example, with the Internet or other communication devices.
- the network 927 connected to the communication device 921 is configured by a wired or wireless network, and may be, for example, the Internet, a home LAN, infrared communication, radio wave communication, satellite communication, or the like.
- the information processing apparatus 10 and the server 20 communicate with each other via the communication apparatus 921 and the network 927, thereby allowing various types of information such as interest data, input contexts, matching results, and the like. Transmission and reception may be performed. Further, the information processing apparatus 10 may install various applications or communicate various information processed by the applications via the communication apparatus 921.
- the drive 923 is a recording medium reader / writer, and is built in or externally attached to the information processing apparatus 10 and the server 20.
- the drive 923 reads information recorded on a removable recording medium 929 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 905.
- the drive 923 can also write a record to a removable recording medium 929 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory.
- the removable recording medium 929 is, for example, a DVD medium, an HD-DVD medium, a Blu-ray (registered trademark) medium, or the like.
- the removable recording medium 929 may be a compact flash (registered trademark) (CompactFlash: CF), a flash memory, an SD memory card (Secure Digital memory card), or the like. Further, the removable recording medium 929 may be, for example, an IC card (Integrated Circuit card) on which a non-contact IC chip is mounted, an electronic device, or the like.
- the drive 923 writes various information processed by various applications installed in the information processing apparatus 10 and various information processed in the data input support processing to the removable recording medium 929. And reading may be performed.
- the connection port 925 is a port for directly connecting a device to the information processing apparatus 10 and the server 20.
- Examples of the connection port 925 include a USB (Universal Serial Bus) port, an IEEE 1394 port, a SCSI (Small Computer System Interface) port, and the like.
- As another example of the connection port 925 there are an RS-232C port, an optical audio terminal, an HDMI (registered trademark) (High-Definition Multimedia Interface) port, and the like.
- the connection port 925 By connecting the external connection device 931 to the connection port 925, the information processing apparatus 10 and the server 20 directly acquire various data from the external connection device 931, or provide various data to the external connection device 931. To do.
- various information processed by various applications installed in the information processing apparatus 10 and various information processed in the data input support process are transmitted to the external connection device 931 by the connection port 925. Transmission / reception may be performed.
- each component described above may be configured using a general-purpose member, or may be configured by hardware specialized for the function of each component. Therefore, it is possible to change the hardware configuration to be used as appropriate according to the technical level at the time of carrying out this embodiment.
- a computer program for realizing the functions of the information processing apparatus 10 and the server 20 according to the present embodiment as described above can be produced and installed in a personal computer or the like.
- a computer-readable recording medium storing such a computer program can be provided.
- the recording medium is, for example, a magnetic disk, an optical disk, a magneto-optical disk, a flash memory, or the like.
- the above computer program may be distributed via a network, for example, without using a recording medium.
- the update detection unit 132 detects an update of the presentation information presented to the user during application execution, and the interest data extraction unit 133 includes at least information associated with the presentation information for which the update is detected.
- Interest data that is information related to the object of interest of the user during application execution is extracted.
- the interest data is extracted by using the update of the presentation information as a trigger, so that the data is in different data formats even between different applications. Also, interest data is extracted and shared from the viewpoint of whether the user is interested.
- the input context that indicates the processing status of input information by the application is detected by the input context detection unit 134 for the input information that is about to be input during the execution of the application. Based on the input context, control is performed to present input information candidates that are candidates for input information from the interest data.
- input information candidates are presented from interest data shared between different applications, for example, interest data extracted in one application can be presented as input information candidates in another application.
- interest data extracted in one application can be presented as input information candidates in another application.
- not only the presentation information but also the information accompanying the presentation information is extracted as the interest data, so that more data is accumulated as the interest data. Therefore, the options for selecting input information candidates are wider, and a data input support system that is more convenient for the user is realized.
- the input context detected by the input context detection unit 134 may include various types of information related to the input information, such as the data format of the input information and the type of the input information. Therefore, in the matching process between the input context and the interest data, matching candidates can be narrowed down based on more conditions, so that interest data that is more desirable as input information is presented to the user as input information candidates, User convenience is improved.
- interest data having different data formats is extracted between different applications, and input information candidates are selected from the interest data. Therefore, data input support processing linked to each other is realized even between different applications. For example, assume that a mailer creates and sends an email immediately after posting a comment via a miniblog. As described above, when the posting of the comment and the creation of the mail are continuously performed, there is a high possibility that the text of the comment and the content of the mail are related to each other. In the data input support processing according to the present embodiment, immediately after posting a comment in which a character string meaning a person's name and / or place name is entered in the text, an email is created and an attempt is made to attach photo data to the email.
- a photo related to a person name and / or place name input in the text of a comment is displayed with a higher priority.
- interest data is extracted across different applications and input information candidates are selected between different applications, a data input support process that is more convenient for the user is realized.
- the embodiment has been described in which the acquisition time and the number of hits are used to calculate the score for determining the priority order as the input information candidate in the matching process.
- the present embodiment is not limited to this example.
- a mathematical formula in which other elements are added may be used.
- different mathematical formulas may be used depending on the type of application that was executed when the input context was detected (that is, the application for which input information is about to be input).
- mathematical formulas that take into account application characteristics may be set.
- the interest data DB 210 may statistically manage the interest data, and the matching process may be performed using the statistical values. For example, if a user posts a comment using a mini-blog, the user can statistically manage information such as a position (GPS) where the user posts a comment, an acquisition time, etc. Character strings that frequently appear in comments posted at time and place can be identified.
- GPS position
- the user creates and transmits mail using a mailer information on a partner to whom the user transmits mail is extracted as various types of information regarding interest data, and statistically managed.
- the interest data matching unit 221 may perform a score calculation process so that such a character string has a high score in the matching process.
- the presentation information is data visually displayed on the display screen of the output unit 120.
- the presentation information may be audio data that is output from the audio output device of the output unit 120 and presented auditorily to the user.
- the interest data includes, for example, the singer, composer, songwriter, genre of the piece of music, date of publication (period) ) Or the like.
- the input context may be information indicating that music data to be played back by the media player is input, and the input information candidate is sent to the user by the matching process with the interest data. May be presented.
- An update detection unit that detects an update of presentation information presented to a user during application execution, and at least information associated with the presentation information from which an update has been detected, and an object of interest of the user during execution of the application
- An interest data extraction unit that extracts interest data that is information on
- an input context detection unit that detects an input context that represents the processing status of the input information by the application for input information that is about to be input during application execution
- An information processing apparatus comprising: an input information candidate presenting unit that performs control to present an input information candidate that is a candidate for the input information from the interest data based on the input context.
- An interest data matching unit that performs a matching process for selecting the interest data that matches the input context from the interest data DB in which the history of the extracted interest data is stored, and presents the input information candidate
- the information processing apparatus according to (1), wherein the unit presents the input information candidates based on a result of the matching process.
- the latest time when the interest data was extracted, the latest time when the interest data was used as the input information, and the interest data were used as the input information.
- the information processing apparatus according to (2) wherein the information includes at least one of the number of times.
- the said interest data matching part calculates the score for determining the priority at the time of presenting an input information candidate about each of the said input information candidate to select,
- the said (2) or (3) Information processing device .
- the information processing apparatus calculates the score of the interest data higher as the number of times the interest data is used as the input information increases.
- the interest data matching unit calculates the score of the interest data higher as the latest time when the interest data is used as the input information is closer to the time when the input context is detected.
- the information processing apparatus according to (4) or (5).
- the interest data matching unit calculates the score of the interest data higher as the latest time at which the interest data is extracted is closer to the time at which the input context is detected.
- the information processing apparatus according to any one of (6).
- (8) The information processing apparatus according to any one of (4) to (7), wherein the input information candidate presenting unit presents the input information candidates in the priority order based on the score.
- the information processing apparatus according to any one of (1) to (8), wherein the information accompanying the presentation information includes metadata associated with the presentation information.
- the information processing apparatus according to any one of (1) to (10), wherein the interest data includes the presentation information.
- the input context includes information related to a data format of the input information.
- the input context includes information related to a type of information of the input information.
- the information processing apparatus according to any one of (1) to (13), wherein the interest data includes a character string presented during execution of an application having a text data input function.
- the interest data is information accompanying a photo presented during execution of an application having a photo browsing function, the location where the photo was taken, the date and time when the photo was taken, and the photo
- the information processing apparatus according to any one of (1) to (14), including information on at least one of an arbitrary word or a character string representing a word group included in a label.
- the input context includes any information detected during execution of an application having a photo data input function to the effect that the photo data is to be input, according to any one of (1) to (16).
- the information processing apparatus described.
- Information related to an object of interest of the user during the execution of the application including at least information associated with the presentation information from which the update has been detected, which is detected when updating the presentation information presented to the user during the execution of the application Extracting the interest data, detecting an input context representing the processing status of the input information by the application for the input information about to be input during the execution of the application, and based on the input context, Performing a control of presenting input information candidates that are candidates for the input information from interest data.
- the computer includes at least a function of detecting an update of the presentation information presented to the user during the execution of the application, and information associated with the presentation information from which the update has been detected. Based on the input context, a function of extracting interest data that is information related to a target, a function of detecting an input context representing the processing status of the input information by the application, and the input information about to be input during application execution And a function of performing control to present input information candidates that are candidates for the input information from the interest data.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- Human Computer Interaction (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Artificial Intelligence (AREA)
- Data Mining & Analysis (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
1.データ入力支援システムの構成
1-1.情報処理装置の構成
1-2.サーバの構成
2.データ入力支援処理の具体例
2-1.入力情報がテキストデータである場合
2-2.入力情報が写真データである場合
3.データ入力支援方法の処理手順
4.ハードウェア構成
5.まとめ
本実施形態においては、アプリケーション実行中にユーザに提示される提示情報の更新が検出され、更新が検出された提示情報に付随する情報を少なくとも含み、アプリケーション実行中におけるユーザの興味の対象を表す関心データが抽出される。また、アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストが検出され、当該入力コンテキストに基づいて、関心データの中から入力情報の候補である入力情報候補を提示する制御が行われる。以下の説明では、上記の一連の処理のことを、データ入力支援処理と呼称することとする。
まず、情報処理装置10の概略構成について説明する。情報処理装置10は、入力部110、出力部120及び制御部130を備える。
次に、サーバ20の概略構成について説明する。サーバ20は、関心データDB210及びサーバ制御部220を備える。
次に、本実施形態に係るデータ入力支援処理について具体的に例を挙げて詳しく説明する。以下では、入力情報がテキストデータである場合及び入力情報が写真データである場合について説明する。
まず、図3、図4及び図5を参照して、入力情報がテキストデータである場合のデータ入力支援処理について説明する。図3及び図5は、入力コンテキストと関心データとのマッチング処理の一例について説明するための説明図である。図4は、入力情報候補がユーザに提示される際の表示画面の一例について説明する説明図である。
…(1)
次に、図6、図7、図8及び図9を参照して、入力情報が写真データである場合のデータ入力支援処理について説明する。図6、図7及び図8は、入力コンテキストと関心データとのマッチング処理の一例について説明するための説明図である。図9は、入力情報候補がユーザに提示される際の表示画面の一例について説明する説明図である。なお、図6、図7及び図8に示す例では、入力コンテキストとして、「入力情報のデータ形式が写真データであること」が検出された場合のデータ入力支援処理について説明するため、関心データとしては写真データを図示しており、更に、これらの写真データに係る提示情報に付随する情報として抽出された関心データを当該写真データごとに関連付けて図示している。
次に、図10を参照して、本実施形態に係るデータ入力支援方法の処理手順について説明する。図10は、本実施形態に係るデータ入力支援方法の処理手順を示すフロー図である。
次に、図11を参照しながら、本開示の実施形態に係る情報処理装置10及びサーバ20のハードウェア構成について、詳細に説明する。図11は、本開示の実施形態に係る情報処理装置10及びサーバ20のハードウェア構成を説明するためのブロック図である。
以上説明したように、本実施形態においては、以下の効果を得ることができる。
(1)アプリケーション実行中にユーザに提示される提示情報の更新を検出する更新検出部と、更新が検出された前記提示情報に付随する情報を少なくとも含み、前記アプリケーション実行中におけるユーザの興味の対象に関する情報である関心データを抽出する関心データ抽出部と、アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストを検出する入力コンテキスト検出部と、前記入力コンテキストに基づいて、前記関心データの中から前記入力情報の候補である入力情報候補を提示する制御を行う入力情報候補提示部と、を備える、情報処理装置。
(2)抽出された前記関心データの履歴が保存された関心データDBから、前記入力コンテキストに適合する前記関心データを選択するマッチング処理を行う関心データマッチング部、を更に備え、前記入力情報候補提示部は、前記マッチング処理の結果に基づいて、前記入力情報候補を提示させる、前記(1)に記載の情報処理装置。
(3)前記関心データの履歴には、前記関心データが抽出された最新の時刻と、前記関心データが前記入力情報として使用された最新の時刻と、前記関心データが前記入力情報として使用された回数と、の少なくともいずれかの情報が含まれる、前記(2)に記載の情報処理装置。
(4)前記関心データマッチング部は、選択する前記入力情報候補の各々について、入力情報候補を提示する際の優先順位を決定するための得点を算出する、前記(2)又は(3)に記載の情報処理装置。
(5)前記関心データマッチング部は、前記関心データが前記入力情報として使用された回数が多いほど、当該関心データの前記得点を高く算出する、前記(4)に記載の情報処理装置。
(6)前記関心データマッチング部は、前記関心データが前記入力情報として使用された最新の時刻が、前記入力コンテキストが検出された時刻に近いほど、当該関心データの前記得点を高く算出する、前記(4)又は(5)に記載の情報処理装置。
(7)前記関心データマッチング部は、前記関心データが抽出された最新の時刻が、前記入力コンテキストが検出された時刻に近いほど、当該関心データの前記得点を高く算出する、前記(4)~(6)のいずれか1項に記載の情報処理装置。
(8)前記入力情報候補提示部は、前記得点に基づく前記優先順位の順番で、前記入力情報候補を提示させる、前記(4)~(7)のいずれか1項に記載の情報処理装置。
(9)前記提示情報に付随する情報は、前記提示情報に関連付けられたメタデータを含む、前記(1)~(8)のいずれか1項に記載の情報処理装置。
(10)前記提示情報に付随する情報は、前記提示情報が提示されたアプリケーションにおける当該提示情報の処理状況に関する情報を含む、前記(1)~(9)のいずれか1項に記載の情報処理装置。
(11)前記関心データは、前記提示情報を含む、前記(1)~(10)のいずれか1項に記載の情報処理装置。
(12)前記入力コンテキストは、前記入力情報のデータ形式に関する情報を含む、前記(1)~(11)のいずれか1項に記載の情報処理装置。
(13)前記入力コンテキストは、前記入力情報の情報の種類に関する情報を含む、前記(1)~(12)のいずれか1項に記載の情報処理装置。
(14)前記関心データは、テキストデータの入力機能を有するアプリケーション実行中に提示された文字列を含む、前記(1)~(13)のいずれか1項に記載の情報処理装置。
(15)前記関心データは、写真の閲覧機能を有するアプリケーション実行中に提示された写真に付随する情報である、前記写真が撮影された場所と、前記写真が撮影された日時と、前記写真のラベルに含まれる任意の単語又は単語群を表す文字列と、の少なくともいずれかの情報を含む、前記(1)~(14)のいずれか1項に記載の情報処理装置。
(16)前記入力コンテキストは、テキストデータの入力機能を有するアプリケーション実行中に検出された、所定の頭文字から始まる単語が入力されようとしている旨の情報を含む、前記(1)~(15)のいずれか1項に記載の情報処理装置。
(17)前記入力コンテキストは、写真データの入力機能を有するアプリケーション実行中に検出された、写真データを入力しようとしている旨の情報を含む、前記(1)~(16)のいずれか1項に記載の情報処理装置。
(18)アプリケーション実行中にユーザに提示される提示情報の更新を検出することと、更新が検出された前記提示情報に付随する情報を少なくとも含み、前記アプリケーション実行中におけるユーザの興味の対象に関する情報である関心データを抽出することと、アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストを検出することと、前記入力コンテキストに基づいて、前記関心データの中から前記入力情報の候補である入力情報候補を提示する制御を行うことと、を含む、データ入力支援方法。
(19)コンピュータに、アプリケーション実行中にユーザに提示される提示情報の更新を検出する機能と、更新が検出された前記提示情報に付随する情報を少なくとも含み、前記アプリケーション実行中におけるユーザの興味の対象に関する情報である関心データを抽出する機能と、アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストを検出する機能と、前記入力コンテキストに基づいて、前記関心データの中から前記入力情報の候補である入力情報候補を提示する制御を行う機能と、を実現させるためのプログラム。
10 情報処理装置
20 サーバ
110 入力部
120 出力部
130 制御部
131 アプリケーション制御部
132 更新検出部
133 関心データ抽出部
134 入力コンテキスト検出部
135 入力情報候補提示部
210 関心データDB
220 サーバ制御部
221 関心データマッチング部
Claims (19)
- アプリケーション実行中にユーザに提示される提示情報の更新を検出する更新検出部と、
更新が検出された前記提示情報に付随する情報を少なくとも含み、前記アプリケーション実行中におけるユーザの興味の対象に関する情報である関心データを抽出する関心データ抽出部と、
アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストを検出する入力コンテキスト検出部と、
前記入力コンテキストに基づいて、前記関心データの中から前記入力情報の候補である入力情報候補を提示する制御を行う入力情報候補提示部と、
を備える、情報処理装置。 - 抽出された前記関心データの履歴が保存された関心データDBから、前記入力コンテキストに適合する前記関心データを選択するマッチング処理を行う関心データマッチング部、
を更に備え、
前記入力情報候補提示部は、前記マッチング処理の結果に基づいて、前記入力情報候補を提示させる、
請求項1に記載の情報処理装置。 - 前記関心データの履歴には、前記関心データが抽出された最新の時刻と、前記関心データが前記入力情報として使用された最新の時刻と、前記関心データが前記入力情報として使用された回数と、の少なくともいずれかの情報が含まれる、
請求項2に記載の情報処理装置。 - 前記関心データマッチング部は、選択する前記入力情報候補の各々について、入力情報候補を提示する際の優先順位を決定するための得点を算出する、
請求項2に記載の情報処理装置。 - 前記関心データマッチング部は、前記関心データが前記入力情報として使用された回数が多いほど、当該関心データの前記得点を高く算出する、
請求項4に記載の情報処理装置。 - 前記関心データマッチング部は、前記関心データが前記入力情報として使用された最新の時刻が、前記入力コンテキストが検出された時刻に近いほど、当該関心データの前記得点を高く算出する、
請求項4に記載の情報処理装置。 - 前記関心データマッチング部は、前記関心データが抽出された最新の時刻が、前記入力コンテキストが検出された時刻に近いほど、当該関心データの前記得点を高く算出する、
請求項4に記載の情報処理装置。 - 前記入力情報候補提示部は、前記得点に基づく前記優先順位の順番で、前記入力情報候補を提示させる、
請求項4に記載の情報処理装置。 - 前記提示情報に付随する情報は、前記提示情報に関連付けられたメタデータを含む、
請求項1に記載の情報処理装置。 - 前記提示情報に付随する情報は、前記提示情報が提示されたアプリケーションにおける当該提示情報の処理状況に関する情報を含む、
請求項1に記載の情報処理装置。 - 前記関心データは、前記提示情報を含む、
請求項1に記載の情報処理装置。 - 前記入力コンテキストは、前記入力情報のデータ形式に関する情報を含む、
請求項1に記載の情報処理装置。 - 前記入力コンテキストは、前記入力情報の情報の種類に関する情報を含む、
請求項1に記載の情報処理装置。 - 前記関心データは、テキストデータの入力機能を有するアプリケーション実行中に提示された文字列を含む、
請求項1に記載の情報処理装置。 - 前記関心データは、写真の閲覧機能を有するアプリケーション実行中に提示された写真に付随する情報である、前記写真が撮影された場所と、前記写真が撮影された日時と、前記写真のラベルに含まれる任意の単語又は単語群を表す文字列と、の少なくともいずれかの情報を含む、
請求項1に記載の情報処理装置。 - 前記入力コンテキストは、テキストデータの入力機能を有するアプリケーション実行中に検出された、所定の頭文字から始まる単語が入力されようとしている旨の情報を含む、
請求項1に記載の情報処理装置。 - 前記入力コンテキストは、写真データの入力機能を有するアプリケーション実行中に検出された、写真データを入力しようとしている旨の情報を含む、
請求項1に記載の情報処理装置。 - アプリケーション実行中にユーザに提示される提示情報の更新を検出することと、
更新が検出された前記提示情報に付随する情報を少なくとも含み、前記アプリケーション実行中におけるユーザの興味の対象に関する情報である関心データを抽出することと、
アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストを検出することと、
前記入力コンテキストに基づいて、前記関心データの中から前記入力情報の候補である入力情報候補を提示する制御を行うことと、
を含む、データ入力支援方法。 - コンピュータに、
アプリケーション実行中にユーザに提示される提示情報の更新を検出する機能と、
更新が検出された前記提示情報に付随する情報を少なくとも含み、前記アプリケーション実行中におけるユーザの興味の対象に関する情報である関心データを抽出する機能と、
アプリケーション実行中に入力されようとしている入力情報について、当該アプリケーションによる前記入力情報の処理状況を表す入力コンテキストを検出する機能と、
前記入力コンテキストに基づいて、前記関心データの中から前記入力情報の候補である入力情報候補を提示する制御を行う機能と、
を実現させるためのプログラム。
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201480018470.9A CN105051734B (zh) | 2013-04-04 | 2014-01-17 | 信息处理设备、数据输入辅助方法以及程序 |
US14/779,081 US9940316B2 (en) | 2013-04-04 | 2014-01-17 | Determining user interest data from different types of inputted context during execution of an application |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013-078462 | 2013-04-04 | ||
JP2013078462 | 2013-04-04 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014162756A1 true WO2014162756A1 (ja) | 2014-10-09 |
Family
ID=51658063
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/050826 WO2014162756A1 (ja) | 2013-04-04 | 2014-01-17 | 情報処理装置、データ入力支援方法及びプログラム |
Country Status (3)
Country | Link |
---|---|
US (1) | US9940316B2 (ja) |
CN (1) | CN105051734B (ja) |
WO (1) | WO2014162756A1 (ja) |
Families Citing this family (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11520412B2 (en) * | 2017-03-06 | 2022-12-06 | Microsoft Technology Licensing, Llc | Data input system/example generator |
WO2019138651A1 (ja) * | 2018-01-10 | 2019-07-18 | ソニー株式会社 | 情報処理装置、情報処理システム、および情報処理方法、並びにプログラム |
CN111984132B (zh) * | 2020-07-07 | 2021-07-27 | 北京语言大学 | 一种根据上下文环境进行信息输入的方法及*** |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001292394A (ja) * | 2000-02-21 | 2001-10-19 | Hewlett Packard Co <Hp> | 画像記録の組を強化する方法 |
WO2008152765A1 (ja) * | 2007-06-11 | 2008-12-18 | Mitsubishi Electric Corporation | ナビゲーション装置 |
Family Cites Families (21)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5805911A (en) * | 1995-02-01 | 1998-09-08 | Microsoft Corporation | Word prediction system |
JP4066507B2 (ja) | 1998-05-11 | 2008-03-26 | 日本電信電話株式会社 | 日本語文字認識誤り訂正方法及び装置、並びに、誤り訂正プログラムを記録した記録媒体 |
US7584120B1 (en) * | 1999-04-07 | 2009-09-01 | Cbs Interactive Inc. | Method and apparatus for defining data of interest |
JP3923803B2 (ja) * | 2002-01-11 | 2007-06-06 | 富士通株式会社 | 入力予測処理プログラム |
US7660779B2 (en) * | 2004-05-12 | 2010-02-09 | Microsoft Corporation | Intelligent autofill |
US7647312B2 (en) * | 2005-05-12 | 2010-01-12 | Microsoft Corporation | System and method for automatic generation of suggested inline search terms |
US20080126075A1 (en) * | 2006-11-27 | 2008-05-29 | Sony Ericsson Mobile Communications Ab | Input prediction |
FR2910143B1 (fr) * | 2006-12-19 | 2009-04-03 | Eastman Kodak Co | Procede pour predire automatiquement des mots dans un texte associe a un message multimedia |
US8078978B2 (en) * | 2007-10-19 | 2011-12-13 | Google Inc. | Method and system for predicting text |
JP5386806B2 (ja) * | 2007-08-17 | 2014-01-15 | 富士通株式会社 | 情報処理方法、情報処理装置、および、情報処理プログラム |
US8504488B2 (en) * | 2008-04-30 | 2013-08-06 | Cisco Technology, Inc. | Network data mining to determine user interest |
US8677236B2 (en) * | 2008-12-19 | 2014-03-18 | Microsoft Corporation | Contact-specific and location-aware lexicon prediction |
US8504437B1 (en) * | 2009-11-04 | 2013-08-06 | Google Inc. | Dynamically selecting and presenting content relevant to user input |
US9129012B2 (en) * | 2010-02-03 | 2015-09-08 | Google Inc. | Information search system with real-time feedback |
US8782556B2 (en) * | 2010-02-12 | 2014-07-15 | Microsoft Corporation | User-centric soft keyboard predictive technologies |
WO2012008167A1 (ja) * | 2010-07-13 | 2012-01-19 | オムロン株式会社 | 文字入力における候補の表示方法 |
JP5553037B2 (ja) | 2011-01-26 | 2014-07-16 | 富士ゼロックス株式会社 | 文章入力支援システム、文章入力支援装置、参照情報作成装置及びプログラム |
US9244905B2 (en) * | 2012-12-06 | 2016-01-26 | Microsoft Technology Licensing, Llc | Communication context based predictive-text suggestion |
US9578461B2 (en) * | 2012-12-17 | 2017-02-21 | Microsoft Technology Licensing, Llc | Location context, supplemental information, and suggestions for meeting locations |
US9235626B2 (en) * | 2013-03-13 | 2016-01-12 | Google Inc. | Automatic generation of snippets based on context and user interest |
US20160283458A1 (en) * | 2013-03-18 | 2016-09-29 | Nec Solution Innovators, Ltd. | Input assistance system, input assistance method, and input assistance program |
-
2014
- 2014-01-17 CN CN201480018470.9A patent/CN105051734B/zh not_active Expired - Fee Related
- 2014-01-17 US US14/779,081 patent/US9940316B2/en active Active
- 2014-01-17 WO PCT/JP2014/050826 patent/WO2014162756A1/ja active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001292394A (ja) * | 2000-02-21 | 2001-10-19 | Hewlett Packard Co <Hp> | 画像記録の組を強化する方法 |
WO2008152765A1 (ja) * | 2007-06-11 | 2008-12-18 | Mitsubishi Electric Corporation | ナビゲーション装置 |
Also Published As
Publication number | Publication date |
---|---|
CN105051734B (zh) | 2019-06-11 |
US20160048489A1 (en) | 2016-02-18 |
CN105051734A (zh) | 2015-11-11 |
US9940316B2 (en) | 2018-04-10 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11256865B2 (en) | Method and apparatus for sending sticker image during chat session | |
US8515984B2 (en) | Extensible search term suggestion engine | |
CN110457504B (zh) | 数字资产搜索技术 | |
US20190340252A1 (en) | Digital asset search user interface | |
JP5799621B2 (ja) | 情報処理装置、情報処理方法及びプログラム | |
WO2019144850A1 (zh) | 一种基于视频内容的视频搜索方法和视频搜索装置 | |
US9465802B2 (en) | Content storage processing system, content storage processing method, and semiconductor integrated circuit | |
US20120158730A1 (en) | Automatic discovery of metadata | |
US10049114B2 (en) | Electronic device, method and storage medium | |
WO2014154097A1 (en) | Automatic page content reading-aloud method and device thereof | |
WO2023078414A1 (zh) | 相关文章搜索方法、装置、电子设备和存储介质 | |
JP2011076566A (ja) | 情報処理装置、端末装置、サーバ装置、通信システム、表示制御方法、プログラム、およびコンピュータ読取り可能な記録媒体 | |
US20140278961A1 (en) | Information processing device and program | |
EP4254222A2 (en) | Visual menu | |
JP5779492B2 (ja) | 入力補助装置、入力補助システムおよび入力補助方法 | |
WO2014162756A1 (ja) | 情報処理装置、データ入力支援方法及びプログラム | |
US20130263276A1 (en) | Information processing apparatus, information processing method, information processing system, and program | |
US9600478B2 (en) | Display control apparatus, display control method, and program | |
CN114297143A (zh) | 一种搜索文件的方法、显示文件的方法、装置及移动终端 | |
CN113407775B (zh) | 视频搜索方法、装置及电子设备 | |
US20140297285A1 (en) | Automatic page content reading-aloud method and device thereof | |
JP5102883B2 (ja) | ユーザ発言抽出装置とその方法と、プログラム | |
WO2017071241A1 (zh) | 通信录中联系人的信息处理方法、装置和移动终端 | |
JP4331177B2 (ja) | 情報検索システム、情報検索方法及び情報検索プログラム | |
JP2011170743A (ja) | 通信装置、コンテンツ検索方法およびプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201480018470.9 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14778969 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14779081 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 14778969 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |