WO2014041851A1 - Information processor - Google Patents

Information processor Download PDF

Info

Publication number
WO2014041851A1
WO2014041851A1 PCT/JP2013/063648 JP2013063648W WO2014041851A1 WO 2014041851 A1 WO2014041851 A1 WO 2014041851A1 JP 2013063648 W JP2013063648 W JP 2013063648W WO 2014041851 A1 WO2014041851 A1 WO 2014041851A1
Authority
WO
WIPO (PCT)
Prior art keywords
unit
display
image data
image
information processing
Prior art date
Application number
PCT/JP2013/063648
Other languages
French (fr)
Japanese (ja)
Inventor
謙一 北谷
Original Assignee
Ｎｅｃカシオモバイルコミュニケーションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ｎｅｃカシオモバイルコミュニケーションズ株式会社 filed Critical Ｎｅｃカシオモバイルコミュニケーションズ株式会社
Publication of WO2014041851A1 publication Critical patent/WO2014041851A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/015—Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Definitions

  • the present invention relates to an information processing apparatus, an information processing method, and a program for processing information.
  • a plurality of icons for activating functions provided in the information processing apparatus are displayed on a menu screen displayed on the display of the information processing apparatus such as a portable terminal. By selecting an icon corresponding to a desired function from among the plurality of icons, the function is activated.
  • the display arrangement of icons displayed in this way is predetermined. Therefore, in order to perform a quick operation, the user needs to remember the display mode such as the arrangement of icons to be displayed.
  • Patent Document 1 it is possible to quickly select a function that is frequently used (activated), but it is not possible to quickly select a function that is not so. .
  • the icon display array is temporarily changed, the changed array becomes an unfamiliar array for the user, and as a result, the user selects a desired icon from the array. There is a problem that it takes time.
  • An object of the present invention is to provide an information processing apparatus, an information processing method, and a program that solve the above-described problems.
  • the information processing apparatus of the present invention A display unit; A measurement unit for measuring the electromagnetic characteristics of the user's brain; Analyzing the electromagnetic characteristics measured by the measurement unit, and based on the result of the analysis, an image generation unit that generates an image that the user thinks; A database storing multiple image data; A collation unit that collates an image generated by the image generation unit with image data stored in the database, and identifies a predetermined number of image data from the database having the highest similarity to the image; And a control unit that controls a display mode in the display unit based on the image data specified by the verification unit.
  • the information processing method of the present invention includes: Processing to display information, A process for measuring the electromagnetic properties of the user's brain; Processing for analyzing the measured electromagnetic properties; Based on the result of the analysis, processing to generate an image that the user thinks; A process of collating the generated image with image data stored in a database storing a plurality of image data; As a result of the collation, a process of specifying a predetermined number of image data from the database having the highest similarity to the image; Based on the specified image data, the display mode is controlled.
  • the program of the present invention is A program for causing a computer to execute, Steps to display information, Procedures for measuring the electromagnetic properties of the user's brain; Analyzing the measured electromagnetic properties; Based on the result of the analysis, a procedure for generating an image that the user imagines; A procedure for collating the generated image with image data stored in a database storing a plurality of image data; As a result of the collation, a procedure for identifying a predetermined number of image data from the database having the highest similarity with the image; Based on the specified image data, a procedure for controlling the display mode is executed.
  • the convenience of operation can be improved.
  • FIG. 1 shows the 1st example of the display mode in the display part shown in FIG.
  • FIG. 2nd example of the display mode in the display part shown in FIG. shows the 3rd example of the display mode in the display part shown in FIG.
  • FIG. 1 is a diagram showing an embodiment of an information processing apparatus according to the present invention.
  • the information processing apparatus 100 in this embodiment includes a display unit 110, a measurement unit 120, an image generation unit 130, a database 140, a collation unit 150, and a control unit 160.
  • the information processing apparatus 100 may be a mobile terminal such as a mobile phone or a smartphone, a game machine, a desktop type, a tablet type or a notebook type PC (Personal Computer), another communication device, or a medical device.
  • the display unit 110 displays information in accordance with an instruction from the control unit 160.
  • the measuring unit 120 measures electromagnetic characteristics such as visual association areas in the user's brain.
  • the electromagnetic characteristics are those that show electrical characteristics in an electric field and magnetic characteristics in a magnetic field (for example, electromagnetic waves). Further, the measurement unit 120 outputs the measurement result to the image generation unit 130.
  • the image generation unit 130 analyzes the measurement result output from the measurement unit 120, and generates (extracts) an image imagined by the user based on the analysis result.
  • the image generated by the image generation unit 130 is converted into data.
  • the processing of the measurement unit 120 and the image generation unit 130 is a generally disclosed technique for reproducing an image from the movement of the human brain (for example, Reference 1 (Neuron, Volume 60, Issue 5, 915-929, 10 Dec. 2008, “Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders”), and the technology to extract and reanimate the brain information of animals and reanimate them (for example, Reference 2 (Theodore W Berger, Robert E Hampson, Dong Song, Anushka Goonawardena, Vasilis Z Marmarelis and Sam A Deadwyler, Journal of Neural Engineering 8 (2011) 046017 (11pp) It may be performed using a technique as described.
  • Reference 1 Neuroon, Volume 60, Issue 5, 915-929, 10 Dec. 2008, “Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders”
  • Reference 2 Theodore W Berger, Robert E Hampson, Dong Song, Anushka Goonawardena
  • the database 140 stores a plurality of image data in advance.
  • This image data is, for example, an icon image, a menu image, an image at the time of reproduction of content (photo, moving image, e-mail, website, application, etc.), a character string indicating a function, a background image of a predetermined scene, and the like.
  • FIG. 2 is a diagram showing an example of image data stored in the database 140 shown in FIG.
  • the database 140 shown in FIG. 1 stores a plurality of image data as shown in FIG. FIG. 2 shows a case where the image data is an icon image (icon data).
  • the control unit 160 controls the display mode on the display unit 110 based on the image data specified by the verification unit 150.
  • the control unit 160 causes the display unit 110 to display the image data specified by the collation unit 150 in a display mode that is easy for the user to understand (the display position is changed to an easy-to-understand position and highlighted).
  • the control unit 160 causes the display unit 110 to display the image data specified by the verification unit 150 larger than the display size of other data, or causes the display unit 110 to blink the image data specified by the verification unit 150.
  • the image data specified by the collation unit 150 is displayed on the display unit 110 brighter than the display brightness of other data.
  • control unit 160 may cause the display unit 110 to display the display color of the image data specified by the collation unit 150 in a conspicuous color. Further, the control unit 160 may combine the image data specified by the collation unit 150 with a predetermined image and cause the display unit 110 to display the combined image data. Further, specific display modes will be described later.
  • the image generation unit 130, the database 140, and the collation unit 150 may be provided outside the information processing apparatus 100.
  • the information processing apparatus 100 may include a communication function, and may transmit and receive information to and from the external image generation unit 130, the database 140, and the collation unit 150 using the communication function. .
  • FIG. 3 is a flowchart for explaining an information processing method in the information processing apparatus 100 shown in FIG.
  • the image generation unit 130 analyzes the electromagnetic characteristics measured by the measurement unit 120 in step 2. In step 3, the image generation unit 130 generates an image that the user thinks based on the result of the analysis.
  • the collation unit 150 collates the image generated by the image generation unit 130 with the image data stored in the database 140 and calculates their similarity. Then, the collation unit 150 identifies a predetermined number (for example, only the highest one) of image data from the database 140 that has the highest degree of similarity with the image generated by the image generation unit 130.
  • control unit 160 controls the display mode on the display unit 110 based on the image data specified by the collation unit 150, and in step 5, the display unit 110 displays information according to the control.
  • FIG. 4 is a diagram showing a first example of a display mode in the display unit 110 shown in FIG.
  • icon images are displayed side by side on the display unit 110, and icons that cannot be arranged on one page (one screen) displayed by the display unit 110 are virtually continuous.
  • icons are arranged on the top, bottom, left, and right pages (screens) and icons are searched by switching the display of the pages (screens).
  • the image data stored in the database 140 may include icons, and the icon group may have a hierarchical structure.
  • the collation unit 150 identifies an icon that is not displayed while the screen shown in the left diagram of FIG. 4 is displayed on the display unit 110, as shown in the right diagram of FIG. Displays a page (screen) including the specified icon on the display unit 110, and highlights the icon so that it is more conspicuous than other icons (by decorating the surroundings).
  • the control unit 160 may display on the display unit 110 a display for reaching the page including the specified icon, for example, an arrow indicating a direction in which the page is turned.
  • FIG. 5 is a diagram showing a second example of the display mode in the display unit 110 shown in FIG.
  • icons displayed on the display unit 110 are displayed side by side, and icons that cannot be arranged on one page (one screen) displayed on the display unit 110 are displayed on virtually upper, lower, left, and right pages (screens).
  • icons are arranged and the icons are searched by switching the display of the page (screen).
  • the image data stored in the database 140 may include icons, and the icon group may have a hierarchical structure.
  • the collation unit 150 identifies an icon that is not displayed while the screen as shown in the left diagram of FIG. 5 is displayed on the display unit 110, as shown in the right diagram of FIG. Displays the identified icon instead of one of the icons displayed on the display unit 110 so that the icon stands out from the other icons (by decorating the surroundings). ) Highlight.
  • the control unit 160 may cause the display unit 110 to display (move) the identified icon at a position that is conspicuous to the user, such as the upper left corner. .
  • FIG. 6 is a diagram showing a third example of the display mode in the display unit 110 shown in FIG.
  • the icon group has a hierarchical structure, and the icon specified by the matching unit 150 is in a layer different from the layer currently displayed by the display unit 110.
  • the icon specified by the collation unit 150 is the folder indicated by the icon displayed in the upper right corner of the left diagram of FIG.
  • the control unit 160 makes the icon displayed in the upper right corner of the right diagram of FIG. And highlighting on the display unit 110. By displaying in this way, the user can be guided to a desired icon.
  • the above-described processing can be applied even if the target to be specified / displayed is not an icon but a menu image (hereinafter referred to as a menu).
  • the control unit 160 may cause the display unit 110 to display an icon or a menu page for reaching a menu screen including the menu.
  • the control unit 160 changes the display position of the icons and menus on the display unit 110, and gives the icons and menus for reaching the menu specified by the collation unit 150 to users such as the upper left corner, the upper right corner, and the center. On the other hand, it may be displayed at a conspicuous (intelligible) position.
  • control unit 160 may cause the display unit 110 to display the direction of turning the page with an arrow or the like in order to reach the menu page specified by the matching unit 150. Further, the control unit 160 may cause the display unit 110 to highlight the menu specified by the collation unit 150.
  • the database 140 may store a part of the image (image data) of the content, and the collation unit 150 may identify the content as a result of the collation of the image data.
  • the control unit 160 displays the presence of the content specified by the collation unit 150 on the display unit 110 in an easily understandable manner. For example, the control unit 160 may cause the display unit 110 to display an icon or a menu page for acquiring the content specified by the matching unit 150. In addition, the control unit 160 changes the display position of the icon or menu displayed by the display unit 110, and places the icon or menu for acquiring the content specified by the collation unit 150 at a conspicuous (intelligible) position on the display unit 110. It may be displayed.
  • control unit 160 when it is necessary to go through a plurality of hierarchies in order to acquire the content specified by the collation unit 150, when the control unit 160 displays each of the plurality of hierarchies on the display unit 110, the corresponding folder Such icons and menus may be highlighted. Further, the control unit 160 may cause the display unit 110 to display the direction in which the page is turned in order to reach the content with an arrow or the like.
  • the control unit 160 activates an application (for example, a browser or a net storage application) for browsing the content. Icons and menus for the purpose are displayed on the display unit 110.
  • an application for example, a browser or a net storage application
  • the image generation unit 130 analyzes the measurement result output from the measurement unit 120, and based on the analysis result, the user's intention (for example, whether to use the application (Yes) or not (No)). )) May be determined.
  • the control unit 160 selects an icon or menu to be displayed on the display unit 110 based on the determination result, and activates the application.
  • each component provided in the information processing apparatus 100 described above may be performed by a logic circuit produced according to the purpose.
  • a computer program (hereinafter referred to as a program) in which processing contents are described as a procedure is recorded on a recording medium readable by the information processing apparatus 100, and the program recorded on the recording medium is read by the information processing apparatus 100. , May be executed.
  • the recording medium readable by the information processing apparatus 100 includes a transfer medium such as a floppy (registered trademark) disk, a magneto-optical disk, a DVD, and a CD, as well as a ROM, a RAM, and the like built in the information processing apparatus 100. Memory, HDD, etc.
  • the program recorded on the recording medium is read by the control unit 160 which is a CPU provided in the information processing apparatus 100, and the same processing as described above is performed under the control of the control unit 160.
  • the control unit 160 operates as a computer that executes a program read from a recording medium on which the program is recorded.
  • (Appendix 1) a display unit; A measurement unit for measuring the electromagnetic characteristics of the user's brain; Analyzing the electromagnetic characteristics measured by the measurement unit, and based on the result of the analysis, an image generation unit that generates an image that the user thinks; A database storing multiple image data; A collation unit that collates an image generated by the image generation unit with image data stored in the database, and identifies a predetermined number of image data from the database having the highest similarity to the image; An information processing apparatus comprising: a control unit that controls a display mode in the display unit based on the image data specified by the verification unit.
  • the said control part makes the display part blink the image data which the said collation part specified,
  • the information processing apparatus of Additional remark 2 characterized by the above-mentioned.
  • the said control part displays the image data which the said collation part specified on the said display part brighter than the brightness of the display of other data,
  • the information processing apparatus of Additional remark 2 characterized by the above-mentioned.
  • the said control part displays the information for displaying the image data which the said collation part specified on the said display part on the said display part,
  • the information processing apparatus of Additional remark 1 characterized by the above-mentioned.
  • Steps to display information Procedures for measuring the electromagnetic properties of the user's brain; Analyzing the measured electromagnetic properties; Based on the result of the analysis, a procedure for generating an image that the user imagines; A procedure for collating the generated image with image data stored in a database storing a plurality of image data; As a result of the collation, a procedure for identifying a predetermined number of image data from the database having the highest similarity with the image; A program for executing a procedure for controlling the display mode based on the specified image data.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Library & Information Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Neurosurgery (AREA)
  • Neurology (AREA)
  • Health & Medical Sciences (AREA)
  • Dermatology (AREA)
  • Biomedical Technology (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A measuring unit (120) measures the electromagnetic characteristics of the brain of a user, and an image-forming unit (130) analyses the measured electromagnetic characteristics. An image visualized by the user is produced on the basis of the results of the analysis. A comparing unit (150) compares the image produced by the image-forming unit (130) and image data stored in a database (140). A predetermined amount of image data is specified from data bearing maximal resemblance to the image. A control unit (160) controls the mode of display of a display unit (110) on the basis of the image data specified by the comparing unit (150).

Description

情報処理装置Information processing device
　本発明は、情報を処理する情報処理装置、情報処理方法およびプログラムに関する。 The present invention relates to an information processing apparatus, an information processing method, and a program for processing information.
　近年、携帯端末等の情報処理装置のディスプレイに表示されるメニュー画面には、当該情報処理装置に具備された機能を起動するための複数のアイコンが表示される。この複数のアイコンのうち、所望の機能に対応するアイコンを選択することで、当該機能が起動する。 In recent years, a plurality of icons for activating functions provided in the information processing apparatus are displayed on a menu screen displayed on the display of the information processing apparatus such as a portable terminal. By selecting an icon corresponding to a desired function from among the plurality of icons, the function is activated.
　一般的に、このように表示されるアイコンの表示の配列は、あらかじめ決まっているものである。そのため、迅速な操作を行うためには、利用者は、表示されるアイコンの配列等、その表示態様を覚えておく必要がある。 Generally, the display arrangement of icons displayed in this way is predetermined. Therefore, in order to perform a quick operation, the user needs to remember the display mode such as the arrangement of icons to be displayed.
　そこで、機能の利用（起動）頻度に応じて、アイコンの表示配列を変更する技術が考えられている（例えば、特許文献１参照。）。この技術を用いれば、利用（起動）頻度の高い機能を示すアイコンを、利用者にとってわかり易い位置に表示することが可能となる。 Therefore, a technique for changing the display arrangement of icons in accordance with the frequency of use (activation) of functions has been considered (for example, see Patent Document 1). If this technique is used, it is possible to display an icon indicating a frequently used (activated) function at a position easy for the user to understand.
特開２０１１－１５９０７７号公報JP 2011-159077 A
　しかしながら、特許文献１に記載されたような技術においては、利用（起動）頻度が高い機能を迅速に選択することはできるが、そうではない機能を迅速に選択することはできないという問題点がある。また、アイコンの表示配列を一時的にでも変更してしまうと、変更後の配列は、利用者にとって見慣れない配列となり、その結果として、利用者がその配列の中から所望のアイコンを選択するのに時間がかかってしまうという問題点がある。 However, in the technique described in Patent Document 1, it is possible to quickly select a function that is frequently used (activated), but it is not possible to quickly select a function that is not so. . In addition, if the icon display array is temporarily changed, the changed array becomes an unfamiliar array for the user, and as a result, the user selects a desired icon from the array. There is a problem that it takes time.
　本発明の目的は、上述した課題を解決する情報処理装置、情報処理方法およびプログラムを提供することである。 An object of the present invention is to provide an information processing apparatus, an information processing method, and a program that solve the above-described problems.
　本発明の情報処理装置は、
　表示部と、
　利用者の脳の電磁気学的特性を測定する測定部と、
　前記測定部が測定した電磁気学的特性を解析し、該解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成するイメージ生成部と、
　複数のイメージデータを格納しているデータベースと、
　前記イメージ生成部が生成したイメージと、前記データベースに格納されているイメージデータとを照合し、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する照合部と、
　前記照合部が特定したイメージデータに基づいて、前記表示部における表示の態様を制御する制御部とを有する。 The information processing apparatus of the present invention
A display unit;
A measurement unit for measuring the electromagnetic characteristics of the user's brain;
Analyzing the electromagnetic characteristics measured by the measurement unit, and based on the result of the analysis, an image generation unit that generates an image that the user thinks;
A database storing multiple image data;
A collation unit that collates an image generated by the image generation unit with image data stored in the database, and identifies a predetermined number of image data from the database having the highest similarity to the image;
And a control unit that controls a display mode in the display unit based on the image data specified by the verification unit.
　また、本発明の情報処理方法は、
　情報を表示する処理と、
　利用者の脳の電磁気学的特性を測定する処理と、
　前記測定した電磁気学的特性を解析する処理と、
　前記解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成する処理と、
　前記生成したイメージと、複数のイメージデータを格納しているデータベースに格納されているイメージデータとを照合する処理と、
　前記照合の結果、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する処理と、
　前記特定したイメージデータに基づいて、前記表示の態様を制御する処理とを行う。 In addition, the information processing method of the present invention includes:
Processing to display information,
A process for measuring the electromagnetic properties of the user's brain;
Processing for analyzing the measured electromagnetic properties;
Based on the result of the analysis, processing to generate an image that the user thinks;
A process of collating the generated image with image data stored in a database storing a plurality of image data;
As a result of the collation, a process of specifying a predetermined number of image data from the database having the highest similarity to the image;
Based on the specified image data, the display mode is controlled.
　また、本発明のプログラムは、
　コンピュータに実行させるためのプログラムであって、
　情報を表示する手順と、
　利用者の脳の電磁気学的特性を測定する手順と、
　前記測定した電磁気学的特性を解析する手順と、
　前記解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成する手順と、
　前記生成したイメージと、複数のイメージデータを格納しているデータベースに格納されているイメージデータとを照合する手順と、
　前記照合の結果、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する手順と、
　前記特定したイメージデータに基づいて、前記表示の態様を制御する手順とを実行させる。 The program of the present invention is
A program for causing a computer to execute,
Steps to display information,
Procedures for measuring the electromagnetic properties of the user's brain;
Analyzing the measured electromagnetic properties;
Based on the result of the analysis, a procedure for generating an image that the user imagines;
A procedure for collating the generated image with image data stored in a database storing a plurality of image data;
As a result of the collation, a procedure for identifying a predetermined number of image data from the database having the highest similarity with the image;
Based on the specified image data, a procedure for controlling the display mode is executed.
　以上説明したように、本発明においては、操作の利便性の向上を図ることができる。 As described above, in the present invention, the convenience of operation can be improved.
本発明の情報処理装置の実施の一形態を示す図である。It is a figure which shows one Embodiment of the information processing apparatus of this invention. 図１に示したデータベースに格納されているイメージデータの一例を示す図である。It is a figure which shows an example of the image data stored in the database shown in FIG. 図１に示した情報処理装置における情報処理方法を説明するためのフローチャートである。3 is a flowchart for explaining an information processing method in the information processing apparatus shown in FIG. 1. 図１に示した表示部における表示態様の第１の例を示す図である。It is a figure which shows the 1st example of the display mode in the display part shown in FIG. 図１に示した表示部における表示態様の第２の例を示す図である。It is a figure which shows the 2nd example of the display mode in the display part shown in FIG. 図１に示した表示部における表示態様の第３の例を示す図である。It is a figure which shows the 3rd example of the display mode in the display part shown in FIG.
　以下に、本発明の実施の形態について図面を参照して説明する。 Hereinafter, embodiments of the present invention will be described with reference to the drawings.
　図１は、本発明の情報処理装置の実施の一形態を示す図である。 FIG. 1 is a diagram showing an embodiment of an information processing apparatus according to the present invention.
　本形態における情報処理装置１００には図１に示すように、表示部１１０と、測定部１２０と、イメージ生成部１３０と、データベース１４０と、照合部１５０と、制御部１６０とが設けられている。なお、情報処理装置１００は、携帯電話やスマートフォン等の携帯端末、ゲーム機、デスクトップ型、タブレット型やノート型のＰＣ（Ｐｅｒｓｏｎａｌ　Ｃｏｍｐｕｔｅｒ）、他の通信装置や医療機器であっても良い。 As shown in FIG. 1, the information processing apparatus 100 in this embodiment includes a display unit 110, a measurement unit 120, an image generation unit 130, a database 140, a collation unit 150, and a control unit 160. . The information processing apparatus 100 may be a mobile terminal such as a mobile phone or a smartphone, a game machine, a desktop type, a tablet type or a notebook type PC (Personal Computer), another communication device, or a medical device.
　表示部１１０は、制御部１６０の指示に従い、情報を表示する。 The display unit 110 displays information in accordance with an instruction from the control unit 160.
　測定部１２０は、利用者の脳内の視覚連合野等の電磁気学的特性を測定する。ここで、電磁気学的特性とは、電場における電気的特性および磁場における磁気的特性を示すもの（例えば、電磁波等）である。また、測定部１２０は、測定結果をイメージ生成部１３０へ出力する。 The measuring unit 120 measures electromagnetic characteristics such as visual association areas in the user's brain. Here, the electromagnetic characteristics are those that show electrical characteristics in an electric field and magnetic characteristics in a magnetic field (for example, electromagnetic waves). Further, the measurement unit 120 outputs the measurement result to the image generation unit 130.
　イメージ生成部１３０は、測定部１２０から出力されてきた測定結果を解析し、その解析の結果に基づいて、利用者が思い浮かべたイメージを生成（抽出）する。なお、イメージ生成部１３０が生成するイメージは、データ化されているものである。 The image generation unit 130 analyzes the measurement result output from the measurement unit 120, and generates (extracts) an image imagined by the user based on the analysis result. The image generated by the image generation unit 130 is converted into data.
　この測定部１２０およびイメージ生成部１３０の処理は、一般的に開示されている、人間の脳の動きから画像を再生する技術（例えば、文献１（Neuron,　Volume　60,　Issue　5,　915-929,　10　December　2008　"Visual　Image　Reconstruction　from　Human　Brain　Activity　using　a　Combination　of　Multiscale　Local　Image　Decoders"）に記載されているような技術）や、動物の脳を記憶情報を電子化して取り出し、蘇生させる技術（例えば、文献２（Theodore　W　Berger,　Robert　E　Hampson,　Dong　Song,　Anushka　Goonawardena,　Vasilis　Z　Marmarelis　and　Sam　A　Deadwyler,　Journal　of　Neural　Engineering　8　(2011)　046017　(11pp)　“A　cortical　neural　prosthesis　for　restoring　and　enhancing　memory”）に記載されているような技術）を用いて行うもので良い。 The processing of the measurement unit 120 and the image generation unit 130 is a generally disclosed technique for reproducing an image from the movement of the human brain (for example, Reference 1 (Neuron, Volume 60, Issue 5, 915-929, 10 Dec. 2008, “Visual Image Reconstruction from Human Brain Activity using a Combination of Multiscale Local Image Decoders”), and the technology to extract and reanimate the brain information of animals and reanimate them (for example, Reference 2 (Theodore W Berger, Robert E Hampson, Dong Song, Anushka Goonawardena, Vasilis Z Marmarelis and Sam A Deadwyler, Journal of Neural Engineering 8 (2011) 046017 (11pp) It may be performed using a technique as described.
　データベース１４０は、複数のイメージデータをあらかじめ格納する。このイメージデータは、例えば、アイコン画像、メニュー画像、コンテンツ（写真、動画、電子メール、ウェブサイト、アプリケーション等）の再生時の画像、機能等を示す文字列、所定シーンの背景画像等である。 The database 140 stores a plurality of image data in advance. This image data is, for example, an icon image, a menu image, an image at the time of reproduction of content (photo, moving image, e-mail, website, application, etc.), a character string indicating a function, a background image of a predetermined scene, and the like.
　図２は、図１に示したデータベース１４０に格納されているイメージデータの一例を示す図である。 FIG. 2 is a diagram showing an example of image data stored in the database 140 shown in FIG.
　図１に示したデータベース１４０には図２に示すように、複数のイメージデータが格納されている。図２では、イメージデータがアイコン画像（アイコンデータ）である場合を示している。 The database 140 shown in FIG. 1 stores a plurality of image data as shown in FIG. FIG. 2 shows a case where the image data is an icon image (icon data).
　照合部１５０は、イメージ生成部１３０が生成したイメージと、データベース１４０に格納されているイメージデータとを照合する。具体的には、照合部１５０は、イメージ生成部１３０が生成したイメージとデータベース１４０に格納されているイメージデータとの画像の類似度を算出する。また、照合部１５０は、イメージ生成部１３０が生成したイメージと類似度が最も高いものから所定の数のイメージデータをデータベース１４０から特定する。ここで、画像の類似度を算出し、データベース１４０の中から類似度の高いものを検索する技術は広く一般に知られている。 The collation unit 150 collates the image generated by the image generation unit 130 with the image data stored in the database 140. Specifically, the collation unit 150 calculates the image similarity between the image generated by the image generation unit 130 and the image data stored in the database 140. The collation unit 150 identifies a predetermined number of image data from the database 140 having the highest similarity to the image generated by the image generation unit 130. Here, a technique for calculating the similarity of images and searching for a high similarity from the database 140 is widely known.
　制御部１６０は、照合部１５０が特定したイメージデータに基づいて、表示部１１０における表示の態様を制御する。このとき、制御部１６０は、照合部１５０が特定したイメージデータを、利用者にわかり易い表示態様（表示位置をわかり易い位置へ変更、強調表示）で、表示部１１０に表示させる。例えば、制御部１６０は、照合部１５０が特定したイメージデータを表示部１１０に他のデータの表示の大きさよりも大きく表示させたり、照合部１５０が特定したイメージデータを表示部１１０に点滅表示させたり、照合部１５０が特定したイメージデータを表示部１１０に他のデータの表示の明るさよりも明るく表示させたりする。また、制御部１６０は、照合部１５０が特定したイメージデータの表示色を目立つ色で表示部１１０に表示させても良い。また、制御部１６０は、照合部１５０が特定したイメージデータを所定の画像と合成して表示部１１０に表示させても良い。さらに、具体的な表示の態様については、後述する。 The control unit 160 controls the display mode on the display unit 110 based on the image data specified by the verification unit 150. At this time, the control unit 160 causes the display unit 110 to display the image data specified by the collation unit 150 in a display mode that is easy for the user to understand (the display position is changed to an easy-to-understand position and highlighted). For example, the control unit 160 causes the display unit 110 to display the image data specified by the verification unit 150 larger than the display size of other data, or causes the display unit 110 to blink the image data specified by the verification unit 150. Or the image data specified by the collation unit 150 is displayed on the display unit 110 brighter than the display brightness of other data. Further, the control unit 160 may cause the display unit 110 to display the display color of the image data specified by the collation unit 150 in a conspicuous color. Further, the control unit 160 may combine the image data specified by the collation unit 150 with a predetermined image and cause the display unit 110 to display the combined image data. Further, specific display modes will be described later.
　なお、イメージ生成部１３０、データベース１４０および照合部１５０は、情報処理装置１００の外部に設けられているものであっても良い。この場合、情報処理装置１００は、通信機能を具備し、当該通信機能を用いて、外部のイメージ生成部１３０、データベース１４０および照合部１５０との間で情報の送受信を行うものであっても良い。 Note that the image generation unit 130, the database 140, and the collation unit 150 may be provided outside the information processing apparatus 100. In this case, the information processing apparatus 100 may include a communication function, and may transmit and receive information to and from the external image generation unit 130, the database 140, and the collation unit 150 using the communication function. .
　以下に、図１に示した情報処理装置１００における情報処理方法について説明する。 Hereinafter, an information processing method in the information processing apparatus 100 shown in FIG. 1 will be described.
　図３は、図１に示した情報処理装置１００における情報処理方法を説明するためのフローチャートである。 FIG. 3 is a flowchart for explaining an information processing method in the information processing apparatus 100 shown in FIG.
　まず、ステップ１にて、測定部１２０が利用者の脳の電磁気学的特性を測定すると、ステップ２にて、測定部１２０が測定した電磁気学的特性をイメージ生成部１３０が解析する。また、ステップ３にて、イメージ生成部１３０は、その解析の結果に基づいて、利用者が思い浮かべるイメージを生成する。 First, when the measurement unit 120 measures the electromagnetic characteristics of the user's brain in step 1, the image generation unit 130 analyzes the electromagnetic characteristics measured by the measurement unit 120 in step 2. In step 3, the image generation unit 130 generates an image that the user thinks based on the result of the analysis.
　続いて、ステップ４にて、照合部１５０が、イメージ生成部１３０が生成したイメージと、データベース１４０に格納されているイメージデータとを照合して、それらの類似度を算出する。そして、照合部１５０は、イメージ生成部１３０が生成したイメージと類似度が最も高いものから所定の数（例えば、最も高いもののみでも構わない）のイメージデータをデータベース１４０から特定する。 Subsequently, in step 4, the collation unit 150 collates the image generated by the image generation unit 130 with the image data stored in the database 140 and calculates their similarity. Then, the collation unit 150 identifies a predetermined number (for example, only the highest one) of image data from the database 140 that has the highest degree of similarity with the image generated by the image generation unit 130.
　すると、制御部１６０は、照合部１５０が特定したイメージデータに基づいて、表示部１１０における表示の態様を制御し、ステップ５にて、表示部１１０は、その制御に従って情報を表示する。 Then, the control unit 160 controls the display mode on the display unit 110 based on the image data specified by the collation unit 150, and in step 5, the display unit 110 displays information according to the control.
　以下に、表示部１１０における表示態様の例を挙げる。 Hereinafter, examples of display modes in the display unit 110 will be given.
　図４は、図１に示した表示部１１０における表示態様の第１の例を示す図である。 FIG. 4 is a diagram showing a first example of a display mode in the display unit 110 shown in FIG.
　第１の例では、表示部１１０にアイコン画像（以下、アイコンと称する）が並べられて表示され、表示部１１０が表示する１ページ（１画面）に並べきれないアイコンは、仮想的に連続する上下左右のページ（画面）に並べられ、ページ（画面）の表示を切り替えることでアイコンを探すような場合を想定する。また、データベース１４０に記憶されているイメージデータには、アイコンが含まれ、そのアイコン群は、階層構造になっていても良い。 In the first example, icon images (hereinafter referred to as icons) are displayed side by side on the display unit 110, and icons that cannot be arranged on one page (one screen) displayed by the display unit 110 are virtually continuous. A case is assumed in which icons are arranged on the top, bottom, left, and right pages (screens) and icons are searched by switching the display of the pages (screens). Further, the image data stored in the database 140 may include icons, and the icon group may have a hierarchical structure.
　表示部１１０に図４の左図に示したような画面が表示されている状態で、表示されていないアイコンを照合部１５０が特定した場合、図４の右図に示すように、制御部１６０は、その特定されたアイコンを含むページ（画面）を表示部１１０に表示させ、当該アイコンが他のアイコンよりも目立つように（周囲に装飾を施したりして）強調表示させる。また、制御部１６０は、その特定されたアイコンを含むページへたどり着くための表示、例えば、ページをめくる向きを示す矢印等を表示部１１０に表示させるものであっても良い。 When the collation unit 150 identifies an icon that is not displayed while the screen shown in the left diagram of FIG. 4 is displayed on the display unit 110, as shown in the right diagram of FIG. Displays a page (screen) including the specified icon on the display unit 110, and highlights the icon so that it is more conspicuous than other icons (by decorating the surroundings). In addition, the control unit 160 may display on the display unit 110 a display for reaching the page including the specified icon, for example, an arrow indicating a direction in which the page is turned.
　図５は、図１に示した表示部１１０における表示態様の第２の例を示す図である。 FIG. 5 is a diagram showing a second example of the display mode in the display unit 110 shown in FIG.
　第２の例では、表示部１１０にアイコンが並べられて表示され、表示部１１０が表示する１ページ（１画面）に並べきれないアイコンは、仮想的に連続する上下左右のページ（画面）に並べられ、ページ（画面）の表示を切り替えることでアイコンを探すような場合を想定する。また、データベース１４０に記憶されているイメージデータには、アイコンが含まれ、そのアイコン群は、階層構造になっていても良い。 In the second example, icons displayed on the display unit 110 are displayed side by side, and icons that cannot be arranged on one page (one screen) displayed on the display unit 110 are displayed on virtually upper, lower, left, and right pages (screens). A case is assumed where icons are arranged and the icons are searched by switching the display of the page (screen). Further, the image data stored in the database 140 may include icons, and the icon group may have a hierarchical structure.
　表示部１１０に図５の左図に示したような画面が表示されている状態で、表示されていないアイコンを照合部１５０が特定した場合、図５の右図に示すように、制御部１６０は、表示部１１０に表示されているアイコンのうちの１つのアイコンに代えて、その特定されたアイコンを表示させ、当該アイコンが他のアイコンよりも目立つように（周囲に装飾を施したりして）強調表示させる。このとき、例えば、図５の右図のように、制御部１６０は、表示部１１０に、特定したアイコンを左上隅のような利用者に対して目立ちやすい位置に表示（移動）させても良い。 When the collation unit 150 identifies an icon that is not displayed while the screen as shown in the left diagram of FIG. 5 is displayed on the display unit 110, as shown in the right diagram of FIG. Displays the identified icon instead of one of the icons displayed on the display unit 110 so that the icon stands out from the other icons (by decorating the surroundings). ) Highlight. At this time, for example, as shown in the right diagram of FIG. 5, the control unit 160 may cause the display unit 110 to display (move) the identified icon at a position that is conspicuous to the user, such as the upper left corner. .
　図６は、図１に示した表示部１１０における表示態様の第３の例を示す図である。 FIG. 6 is a diagram showing a third example of the display mode in the display unit 110 shown in FIG.
　第３の例では、アイコン群が階層構造を持っており、照合部１５０が特定したアイコンが、表示部１１０が現在表示している階層とは異なる階層にある場合を想定する。 In the third example, it is assumed that the icon group has a hierarchical structure, and the icon specified by the matching unit 150 is in a layer different from the layer currently displayed by the display unit 110.
　表示部１１０に図６の左図に示したような画面が表示されている状態で、照合部１５０が特定したアイコンが、図６の左図の右上隅に表示されているアイコンが示すフォルダの下層にある場合、図６の右図に示すように、制御部１６０は、図６の右図の右上隅に表示されているアイコンが他のアイコンよりも目立つように（周囲に装飾を施したりして）、表示部１１０に強調表示させる。このように表示することで、利用者を所望のアイコンへ誘導することができる。 In the state where the screen as shown in the left diagram of FIG. 6 is displayed on the display unit 110, the icon specified by the collation unit 150 is the folder indicated by the icon displayed in the upper right corner of the left diagram of FIG. In the lower layer, as shown in the right diagram of FIG. 6, the control unit 160 makes the icon displayed in the upper right corner of the right diagram of FIG. And highlighting on the display unit 110. By displaying in this way, the user can be guided to a desired icon.
　また、上述した処理は、特定・表示される対象がアイコンでなく、メニュー画像（以下、メニューと称する）であっても適用可能である。例えば、照合部１５０があるメニューを特定した場合、制御部１６０は、当該メニューが含まれるメニュー画面にたどり着くためのアイコンやメニューのページを表示部１１０に表示させても良い。また、制御部１６０は、アイコンやメニューの表示部１１０における表示位置を変更し、照合部１５０が特定したメニューにたどり着くためのアイコンやメニューを左上隅や右隅上、中央のような利用者に対して目立ちやすい（わかり易い）位置に表示させても良い。また、制御部１６０は、照合部１５０が特定したメニューのページにたどり着くためにページをめくる向きを矢印等で表示部１１０に表示させても良い。また、制御部１６０は、表示部１１０に、照合部１５０が特定したメニューを強調表示させても良い。 Further, the above-described processing can be applied even if the target to be specified / displayed is not an icon but a menu image (hereinafter referred to as a menu). For example, when a menu with a matching unit 150 is specified, the control unit 160 may cause the display unit 110 to display an icon or a menu page for reaching a menu screen including the menu. In addition, the control unit 160 changes the display position of the icons and menus on the display unit 110, and gives the icons and menus for reaching the menu specified by the collation unit 150 to users such as the upper left corner, the upper right corner, and the center. On the other hand, it may be displayed at a conspicuous (intelligible) position. Further, the control unit 160 may cause the display unit 110 to display the direction of turning the page with an arrow or the like in order to reach the menu page specified by the matching unit 150. Further, the control unit 160 may cause the display unit 110 to highlight the menu specified by the collation unit 150.
　また、データベース１４０には、コンテンツの一部の画像（イメージデータ）が記憶されており、照合部１５０がイメージデータの照合の結果、コンテンツを特定するものであっても良い。制御部１６０は、照合部１５０が特定したコンテンツの在りかを分かり易く表示部１１０に表示させる。例えば、制御部１６０は、照合部１５０が特定したコンテンツを取得するためのアイコンやメニューのページを表示部１１０に表示させても良い。また、制御部１６０は、表示部１１０が表示するアイコンやメニューの表示位置を変更し、照合部１５０が特定したコンテンツを取得するためのアイコンやメニューを表示部１１０の目立ちやすい（わかり易い）位置に表示させても良い。 The database 140 may store a part of the image (image data) of the content, and the collation unit 150 may identify the content as a result of the collation of the image data. The control unit 160 displays the presence of the content specified by the collation unit 150 on the display unit 110 in an easily understandable manner. For example, the control unit 160 may cause the display unit 110 to display an icon or a menu page for acquiring the content specified by the matching unit 150. In addition, the control unit 160 changes the display position of the icon or menu displayed by the display unit 110, and places the icon or menu for acquiring the content specified by the collation unit 150 at a conspicuous (intelligible) position on the display unit 110. It may be displayed.
　また、照合部１５０が特定したコンテンツを取得するために複数の階層をたどって行く必要がある場合は、制御部１６０は、その複数の階層それぞれを表示部１１０に表示させる際に、該当するフォルダ等のアイコンやメニューを強調表示させても良い。また、制御部１６０は、コンテンツにたどり着くためにページをめくる向きを矢印等で表示部１１０に表示させても良い。 In addition, when it is necessary to go through a plurality of hierarchies in order to acquire the content specified by the collation unit 150, when the control unit 160 displays each of the plurality of hierarchies on the display unit 110, the corresponding folder Such icons and menus may be highlighted. Further, the control unit 160 may cause the display unit 110 to display the direction in which the page is turned in order to reach the content with an arrow or the like.
　また、照合部１５０が特定したコンテンツが情報処理装置１００の外部の装置に格納されている場合、制御部１６０は、当該コンテンツを閲覧するためのアプリケーション（例えば、ブラウザやネットストレージアプリ等）を起動するためのアイコンやメニューを表示部１１０に表示させる。 When the content specified by the collation unit 150 is stored in a device external to the information processing apparatus 100, the control unit 160 activates an application (for example, a browser or a net storage application) for browsing the content. Icons and menus for the purpose are displayed on the display unit 110.
　また、イメージ生成部１３０は、測定部１２０から出力されてきた測定結果を解析し、その解析の結果に基づいて、利用者の意思（例えば、アプリケーションの使用をする（Ｙｅｓ）か否（Ｎｏ）か）を判定するものであっても良い。イメージ生成部１３０が利用者の意思を判定すると、制御部１６０は、その判定結果に基づいて、表示部１１０に表示させるアイコンやメニューを選択し、当該アプリケーションを起動する。 In addition, the image generation unit 130 analyzes the measurement result output from the measurement unit 120, and based on the analysis result, the user's intention (for example, whether to use the application (Yes) or not (No)). )) May be determined. When the image generation unit 130 determines the user's intention, the control unit 160 selects an icon or menu to be displayed on the display unit 110 based on the determination result, and activates the application.
　このように、利用者の思い浮かべるイメージを特定し、特定したイメージをわかり易く表示することで、利用者は、アイコン、メニューの位置や名称、コンテンツの在りかや名称、ＵＲＬ（Ｕｎｉｆｏｒｍ　Ｒｅｓｏｕｒｃｅ　Ｌｏｃａｔｏｒ）等を覚える必要がない。利用者が視覚的なイメージを覚えてさえいれば、それを入力する操作を行わずに、所望のアイコン、メニュー等を分かり易く表示することができる。 In this way, by identifying the image that the user thinks about and displaying the identified image in an easy-to-understand manner, the user can display the icon, menu position and name, content location and name, URL (Uniform Resource Locator), etc. There is no need to remember. As long as the user remembers the visual image, it is possible to display a desired icon, menu, etc. in an easy-to-understand manner without performing an operation to input it.
　なお、上述した情報処理装置１００に設けられた各構成要素が行う処理は、目的に応じてそれぞれ作製された論理回路で行うようにしても良い。また、処理内容を手順として記述したコンピュータプログラム（以下、プログラムと称する）を情報処理装置１００にて読取可能な記録媒体に記録し、この記録媒体に記録されたプログラムを情報処理装置１００に読み込ませ、実行するものであっても良い。情報処理装置１００にて読取可能な記録媒体とは、フロッピー（登録商標）ディスク、光磁気ディスク、ＤＶＤ、ＣＤなどの移設可能な記録媒体の他、情報処理装置１００に内蔵されたＲＯＭ、ＲＡＭ等のメモリやＨＤＤ等を指す。この記録媒体に記録されたプログラムは、情報処理装置１００に設けられたＣＰＵである制御部１６０にて読み込まれ、制御部１６０の制御にて、上述したものと同様の処理が行われる。ここで、制御部１６０は、プログラムが記録された記録媒体から読み込まれたプログラムを実行するコンピュータとして動作するものである。 It should be noted that the processing performed by each component provided in the information processing apparatus 100 described above may be performed by a logic circuit produced according to the purpose. In addition, a computer program (hereinafter referred to as a program) in which processing contents are described as a procedure is recorded on a recording medium readable by the information processing apparatus 100, and the program recorded on the recording medium is read by the information processing apparatus 100. , May be executed. The recording medium readable by the information processing apparatus 100 includes a transfer medium such as a floppy (registered trademark) disk, a magneto-optical disk, a DVD, and a CD, as well as a ROM, a RAM, and the like built in the information processing apparatus 100. Memory, HDD, etc. The program recorded on the recording medium is read by the control unit 160 which is a CPU provided in the information processing apparatus 100, and the same processing as described above is performed under the control of the control unit 160. Here, the control unit 160 operates as a computer that executes a program read from a recording medium on which the program is recorded.
　上記の実施の形態の一部または全部は、以下の付記のようにも記載され得るが、以下には限られない。 Some or all of the above embodiments may be described as in the following supplementary notes, but are not limited to the following.
（付記１）表示部と、
　利用者の脳の電磁気学的特性を測定する測定部と、
　前記測定部が測定した電磁気学的特性を解析し、該解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成するイメージ生成部と、
　複数のイメージデータを格納しているデータベースと、
　前記イメージ生成部が生成したイメージと、前記データベースに格納されているイメージデータとを照合し、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する照合部と、
　前記照合部が特定したイメージデータに基づいて、前記表示部における表示の態様を制御する制御部とを有する情報処理装置。 (Appendix 1) a display unit;
A measurement unit for measuring the electromagnetic characteristics of the user's brain;
Analyzing the electromagnetic characteristics measured by the measurement unit, and based on the result of the analysis, an image generation unit that generates an image that the user thinks;
A database storing multiple image data;
A collation unit that collates an image generated by the image generation unit with image data stored in the database, and identifies a predetermined number of image data from the database having the highest similarity to the image;
An information processing apparatus comprising: a control unit that controls a display mode in the display unit based on the image data specified by the verification unit.
（付記２）前記制御部は、前記照合部が特定したイメージデータを、前記表示部に強調表示させることを特徴とする、付記１に記載の情報処理装置。 (Additional remark 2) The said control part highlights the image data which the said collation part specified on the said display part, The information processing apparatus of Additional remark 1 characterized by the above-mentioned.
（付記３）前記制御部は、前記照合部が特定したイメージデータを、前記表示部に他のデータの表示の大きさよりも大きく表示させることを特徴とする、付記２に記載の情報処理装置。 (Additional remark 3) The said control part displays the image data which the said collation part specified larger than the magnitude | size of the display of other data on the said display part, The information processing apparatus of Additional remark 2 characterized by the above-mentioned.
（付記４）前記制御部は、前記照合部が特定したイメージデータを、前記表示部に点滅表示させることを特徴とする、付記２に記載の情報処理装置。 (Additional remark 4) The said control part makes the display part blink the image data which the said collation part specified, The information processing apparatus of Additional remark 2 characterized by the above-mentioned.
（付記５）前記制御部は、前記照合部が特定したイメージデータを、前記表示部に他のデータの表示の明るさよりも明るく表示させることを特徴とする、付記２に記載の情報処理装置。 (Additional remark 5) The said control part displays the image data which the said collation part specified on the said display part brighter than the brightness of the display of other data, The information processing apparatus of Additional remark 2 characterized by the above-mentioned.
（付記６）前記制御部は、前記照合部が特定したイメージデータを前記表示部に表示させるための情報を、前記表示部に表示させることを特徴とする、付記１に記載の情報処理装置。 (Additional remark 6) The said control part displays the information for displaying the image data which the said collation part specified on the said display part on the said display part, The information processing apparatus of Additional remark 1 characterized by the above-mentioned.
（付記７）情報を表示する処理と、
　利用者の脳の電磁気学的特性を測定する処理と、
　前記測定した電磁気学的特性を解析する処理と、
　前記解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成する処理と、
　前記生成したイメージと、複数のイメージデータを格納しているデータベースに格納されているイメージデータとを照合する処理と、
　前記照合の結果、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する処理と、
　前記特定したイメージデータに基づいて、前記表示の態様を制御する処理とを行う情報処理方法。 (Supplementary note 7) processing for displaying information;
A process for measuring the electromagnetic properties of the user's brain;
Processing for analyzing the measured electromagnetic properties;
Based on the result of the analysis, processing to generate an image that the user thinks;
A process of collating the generated image with image data stored in a database storing a plurality of image data;
As a result of the collation, a process of specifying a predetermined number of image data from the database having the highest similarity to the image;
An information processing method for performing processing for controlling the display mode based on the specified image data.
（付記８）コンピュータに、
　情報を表示する手順と、
　利用者の脳の電磁気学的特性を測定する手順と、
　前記測定した電磁気学的特性を解析する手順と、
　前記解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成する手順と、
　前記生成したイメージと、複数のイメージデータを格納しているデータベースに格納されているイメージデータとを照合する手順と、
　前記照合の結果、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する手順と、
　前記特定したイメージデータに基づいて、前記表示の態様を制御する手順とを実行させるためのプログラム。 (Appendix 8)
Steps to display information,
Procedures for measuring the electromagnetic properties of the user's brain;
Analyzing the measured electromagnetic properties;
Based on the result of the analysis, a procedure for generating an image that the user imagines;
A procedure for collating the generated image with image data stored in a database storing a plurality of image data;
As a result of the collation, a procedure for identifying a predetermined number of image data from the database having the highest similarity with the image;
A program for executing a procedure for controlling the display mode based on the specified image data.
　以上、実施の形態を参照して本願発明を説明したが、本願発明は上記実施の形態に限定されるものではない。本願発明の構成や詳細には、本願発明のスコープ内で当業者が理解し得る様々な変更をすることができる。 The present invention has been described above with reference to the embodiments, but the present invention is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the present invention.
　この出願は、２０１２年９月１３日に出願された日本出願特願２０１２－２０１８２８を基礎とする優先権を主張し、その開示の全てをここに取り込む。 This application claims priority based on Japanese Patent Application No. 2012-201828 filed on September 13, 2012, the entire disclosure of which is incorporated herein.

Claims (8)

  1. 　表示部と、
    　利用者の脳の電磁気学的特性を測定する測定部と、
    　前記測定部が測定した電磁気学的特性を解析し、該解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成するイメージ生成部と、
    　複数のイメージデータを格納しているデータベースと、
    　前記イメージ生成部が生成したイメージと、前記データベースに格納されているイメージデータとを照合し、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する照合部と、
    　前記照合部が特定したイメージデータに基づいて、前記表示部における表示の態様を制御する制御部とを有する情報処理装置。     A display unit;
    A measurement unit for measuring the electromagnetic characteristics of the user's brain;
    Analyzing the electromagnetic characteristics measured by the measurement unit, and based on the result of the analysis, an image generation unit that generates an image that the user thinks;
    A database storing multiple image data;
    A collation unit that collates an image generated by the image generation unit with image data stored in the database, and identifies a predetermined number of image data from the database having the highest similarity to the image;
    An information processing apparatus comprising: a control unit that controls a display mode in the display unit based on the image data specified by the verification unit.
  2. 　請求項１に記載の情報処理装置において、
    　前記制御部は、前記照合部が特定したイメージデータを、前記表示部に強調表示させることを特徴とする情報処理装置。     The information processing apparatus according to claim 1,
    The control unit causes the display unit to highlight the image data specified by the collation unit.
  3. 　請求項２に記載の情報処理装置において、
    　前記制御部は、前記照合部が特定したイメージデータを、前記表示部に他のデータの表示の大きさよりも大きく表示させることを特徴とする情報処理装置。     The information processing apparatus according to claim 2,
    The information processing apparatus, wherein the control unit causes the display unit to display the image data specified by the collation unit larger than the display size of other data.
  4. 　請求項２に記載の情報処理装置において、
    　前記制御部は、前記照合部が特定したイメージデータを、前記表示部に点滅表示させることを特徴とする情報処理装置。     The information processing apparatus according to claim 2,
    The control unit causes the image data specified by the collation unit to blink on the display unit.
  5. 　請求項２に記載の情報処理装置において、
    　前記制御部は、前記照合部が特定したイメージデータを、前記表示部に他のデータの表示の明るさよりも明るく表示させることを特徴とする情報処理装置。     The information processing apparatus according to claim 2,
    The control unit causes the display unit to display the image data specified by the collation unit brighter than the display brightness of other data.
  6. 　請求項１に記載の情報処理装置において、
    　前記制御部は、前記照合部が特定したイメージデータを前記表示部に表示させるための情報を、前記表示部に表示させることを特徴とする情報処理装置。     The information processing apparatus according to claim 1,
    The information processing apparatus, wherein the control unit causes the display unit to display information for causing the display unit to display the image data specified by the collation unit.
  7. 　情報を表示する処理と、
    　利用者の脳の電磁気学的特性を測定する処理と、
    　前記測定した電磁気学的特性を解析する処理と、
    　前記解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成する処理と、
    　前記生成したイメージと、複数のイメージデータを格納しているデータベースに格納されているイメージデータとを照合する処理と、
    　前記照合の結果、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する処理と、
    　前記特定したイメージデータに基づいて、前記表示の態様を制御する処理とを行う情報処理方法。     Processing to display information,
    A process for measuring the electromagnetic properties of the user's brain;
    Processing for analyzing the measured electromagnetic properties;
    Based on the result of the analysis, processing to generate an image that the user thinks;
    A process of collating the generated image with image data stored in a database storing a plurality of image data;
    As a result of the collation, a process of identifying a predetermined number of image data from the database having the highest similarity with the image;
    An information processing method for performing processing for controlling the display mode based on the specified image data.
  8. 　コンピュータに、
    　情報を表示する手順と、
    　利用者の脳の電磁気学的特性を測定する手順と、
    　前記測定した電磁気学的特性を解析する手順と、
    　前記解析の結果に基づいて、前記利用者が思い浮かべるイメージを生成する手順と、
    　前記生成したイメージと、複数のイメージデータを格納しているデータベースに格納されているイメージデータとを照合する手順と、
    　前記照合の結果、前記イメージと類似度が最も高いものから所定の数のイメージデータを前記データベースから特定する手順と、
    　前記特定したイメージデータに基づいて、前記表示の態様を制御する手順とを実行させるためのプログラム。     On the computer,
    Steps to display information,
    Procedures for measuring the electromagnetic properties of the user's brain;
    Analyzing the measured electromagnetic properties;
    Based on the result of the analysis, a procedure for generating an image that the user imagines;
    A procedure for collating the generated image with image data stored in a database storing a plurality of image data;
    As a result of the collation, a procedure for identifying a predetermined number of image data from the database having the highest similarity with the image;
    A program for executing a procedure for controlling the display mode based on the specified image data.
PCT/JP2013/063648 2012-09-13 2013-05-16 Information processor WO2014041851A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012201828 2012-09-13
JP2012-201828 2012-09-13

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/806,395 Continuation US10837051B2 (en) 2015-05-08 2017-11-08 Enzyme reaction reagent having dried form and method for preparing the same

Publications (1)

Publication Number Publication Date
WO2014041851A1 true WO2014041851A1 (en) 2014-03-20

Family

ID=50277986

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/063648 WO2014041851A1 (en) 2012-09-13 2013-05-16 Information processor

Country Status (1)

Country Link
WO (1) WO2014041851A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016067861A1 (en) * 2014-10-29 2016-05-06 三菱電機株式会社 Induction heat cooking apparatus

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6115229A (en) * 1984-06-30 1986-01-23 Toshiba Corp Image output device
JP2001084274A (en) * 1999-07-14 2001-03-30 Fuji Photo Film Co Ltd Image retrieval method and image processing method
JP2009301501A (en) * 2008-06-17 2009-12-24 Hitachi Kokusai Electric Inc Search result display method
JP2012073329A (en) * 2010-09-28 2012-04-12 National Institute Of Advanced Industrial & Technology Intention transmission support apparatus and method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS6115229A (en) * 1984-06-30 1986-01-23 Toshiba Corp Image output device
JP2001084274A (en) * 1999-07-14 2001-03-30 Fuji Photo Film Co Ltd Image retrieval method and image processing method
JP2009301501A (en) * 2008-06-17 2009-12-24 Hitachi Kokusai Electric Inc Search result display method
JP2012073329A (en) * 2010-09-28 2012-04-12 National Institute Of Advanced Industrial & Technology Intention transmission support apparatus and method

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016067861A1 (en) * 2014-10-29 2016-05-06 三菱電機株式会社 Induction heat cooking apparatus
JPWO2016067861A1 (en) * 2014-10-29 2017-04-27 三菱電機株式会社 Induction heating cooker

Similar Documents

Publication Publication Date Title
KR102345993B1 (en) Systems, devices, and methods for dynamically providing user interface controls at a touch-sensitive secondary display
JP6102588B2 (en) Information processing apparatus, information processing method, and program
US10838692B2 (en) Techniques to present a user interface for the visually impaired
US9202299B2 (en) Hint based spot healing techniques
RU2662632C2 (en) Presenting fixed format documents in reflowed format
CN106293074A (en) A kind of Emotion identification method and mobile terminal
CN109074375B (en) Content selection in web documents
WO2019212728A1 (en) Displaying a subset of menu items based on a prediction of the next user-actions
US11954536B2 (en) Data engine
US9235326B2 (en) Manipulation of user interface controls
WO2017139178A1 (en) Effecting multi-step operations in an application in response to direct manipulation of a selected object
CN112230909A (en) Data binding method, device and equipment of small program and storage medium
JP2019008772A (en) Method and device for inputting characters
CN107797750A (en) A kind of screen content identifying processing method, apparatus, terminal and medium
Sluÿters et al. Consistent, continuous, and customizable mid-air gesture interaction for browsing multimedia objects on large displays
TWI570593B (en) System, method, and computer program product for using eye movement tracking for retrieval of observed information and of related specific context
CN104898928A (en) Graphic and text information display method and terminal
EP3036614A1 (en) Navigating fixed format document in e-reader application
TW201502862A (en) Transforming visualized data through visual analytics based on interactivity
Garcia-Lopez et al. Comparing zooming methods in mobile devices: effectiveness, efficiency, and user satisfaction in touch and nontouch smartphones
US20180136904A1 (en) Electronic device and method for controlling electronic device using speech recognition
WO2016018682A1 (en) Processing image to identify object for insertion into document
CN104899287B (en) The display methods and device of webpage
WO2014041851A1 (en) Information processor
KR20170045101A (en) Electronic device and Method for sharing content thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13836657

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 13836657

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP