US20090295812A1 - Information display device - Google Patents

Information display device Download PDF

Info

Publication number
US20090295812A1
US20090295812A1 US12/297,355 US29735507A US2009295812A1 US 20090295812 A1 US20090295812 A1 US 20090295812A1 US 29735507 A US29735507 A US 29735507A US 2009295812 A1 US2009295812 A1 US 2009295812A1
Authority
US
United States
Prior art keywords
display
window
information
catalog
instruction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US12/297,355
Other languages
English (en)
Inventor
Kouichi Aoki
Takuya Kawasaki
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Interactive Entertainment Inc
Sony Network Entertainment Platform Inc
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Assigned to SONY COMPUTER ENTERTAINMENT INC. reassignment SONY COMPUTER ENTERTAINMENT INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: AOKI, KOUICHI, KAWASAKI, TAKUYA
Publication of US20090295812A1 publication Critical patent/US20090295812A1/en
Assigned to SONY NETWORK ENTERTAINMENT PLATFORM INC. reassignment SONY NETWORK ENTERTAINMENT PLATFORM INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: SONY COMPUTER ENTERTAINMENT INC.
Assigned to SONY COMPUTER ENTERTAINMENT INC. reassignment SONY COMPUTER ENTERTAINMENT INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SONY NETWORK ENTERTAINMENT PLATFORM INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/957—Browsing optimisation, e.g. caching or content distillation
    • G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing

Definitions

  • the present invention relates to an information display device for displaying display target information, such as content or the like, obtained from a web server, for example, in a screen element, such as a window or the like.
  • an information display device such as a personal computer (PC) or the like, displays respective kinds of information in independent screen elements each referred to as a window in order to display various kinds of information on a single display screen.
  • PC personal computer
  • many web browsers or the like which produce information to be displayed (display target information) based on web page data obtained via a network from a web server or the like and display the display target information produced based on the respective web pages, each in each window.
  • Such an information display device for displaying information in a plurality of windows may need to show notice information asking for user confirmation of their operation or input of a password or the like in connection with display target information shown in any window.
  • HTML (Hyper Text Markup Language) data describing a web page may contain a description about a program to be processed (a script) for controlling such that display of display target information is not carried out until a password is input.
  • a script for controlling such that display of display target information is not carried out until a password is input.
  • a conventional information display device displays notice information as well in an independent window, when it becomes necessary to display notice information while information items about a plurality of web pages are displayed in the respective windows, the user may not readily know that the notice information to be displayed appears in association with a web page in which window.
  • the present invention has been conceived in view of the above, and one object thereof is to provide an information display device for explicitly exhibiting the relationship between display target information shown in a screen element and notice information to be notified to the user.
  • an information display unit for displaying at least one item of display target information in a respective screen element; a catalog display unit for displaying the screen elements as a catalog; and an execution unit for receiving, while catalog display takes place, an instruction operation which is made utilizing display target information shown in the screen elements displayed as a catalog, and for executing a process based on the instruction operation.
  • FIG. 1 is a block diagram showing an example of a structure of an information display device according to an embodiment of the present invention
  • FIG. 2 is a diagram explaining an example of a virtual space realized in the information display device according to the embodiment of the present invention.
  • FIG. 3 is a diagram explaining an example of a screen image displayed in the information display device according to the embodiment of the present invention.
  • FIG. 4 is a functional block diagram related to an example of the information display device according to the embodiment of the present invention.
  • FIG. 5 is a flowchart related to an example of a process to display a focused window in the information display device according to the embodiment of the present invention
  • FIG. 6 is a diagram explaining an example of setting of a virtual space and an example of a corresponding display screen image when changing a focused window according to the embodiment of the present invention
  • FIG. 7 is a diagram explaining an example of content of an object database describing an example of setting of a virtual space in the information display device according to the embodiment of the present invention.
  • FIG. 8 is a diagram explaining an example of a method for forming an area for displaying a menu screen and/or notice information in the information display device according to the embodiment of the present invention.
  • FIG. 9 is a diagram explaining an example of a screen image with an area ensured for displaying a menu screen and/or notice information in the information display device according to the embodiment of the present invention.
  • FIG. 10 is a diagram explaining an example of a menu screen image displayed in the information display device according to the embodiment of the present invention.
  • FIG. 11 is a diagram explaining an example of setting a virtual space in the information display device according to the embodiment of the present invention.
  • FIG. 12 is a diagram explaining an example of notice information displayed in the information display device according to the embodiment of the present invention.
  • FIG. 13 is a diagram explaining another example of notice information displayed in the information display device according to the embodiment of the present invention.
  • FIG. 14 is a diagram explaining another example of notice information displayed in the information display device according to the embodiment of the present invention.
  • FIG. 15 is a diagram explaining still another example of notice information displayed in the information display device according to the embodiment of the present invention.
  • FIG. 16 is a diagram explaining an example of setting of a virtual space in performing catalog display in the information display device according to the embodiment of the present invention.
  • FIG. 17 is a diagram explaining an example of catalog display shown in the information display device according to the embodiment of the present invention.
  • FIG. 18 is a diagram explaining another example of setting of a virtual space in performing catalog display in the information display device according to the embodiment of the present invention.
  • FIG. 19 is a diagram explaining various examples of catalog display shown in the information display device according to the embodiment of the present invention.
  • FIG. 20 is a diagram explaining an example of a focused window shown in performing catalog display in the information display device according to the embodiment of the present invention.
  • FIG. 21 is a diagram explaining an example of a window other than the focused window, shown in performing catalog display in the information display device according to the embodiment of the present invention.
  • FIG. 22 is a diagram explaining an example of a screen image shown in the information display device according to the embodiment of the present invention.
  • FIG. 23 is a diagram explaining a window shown enlarged in the information display device according to the embodiment of the present invention.
  • FIG. 24 is a diagram explaining an example of a screen image with a window shown enlarged in the information display device according to the embodiment of the present invention.
  • FIG. 25 is a schematic diagram showing an example of a controller connected to the information display device according to the embodiment of the present invention.
  • FIG. 26 is a diagram explaining an example of an operation to incline the controller connected to the information display device according to the embodiment of the present invention.
  • FIG. 27 is a diagram explaining another example of an operation to incline the controller connected to the information display device according to the embodiment of the present invention.
  • FIG. 28 is a flowchart related to an example of a process based on an operation to incline the controller connected to the information display device according to the embodiment of the present invention.
  • FIG. 1 is a block diagram showing an example of a structure of an information display device 1 according to an embodiment of the present invention.
  • the information display device 1 comprises a CPU (Central Processing Unit) 11 , a ROM (Read Only Memory) 12 , a RAM (Random Access Memory) 13 , a network I/F 14 , a controller I/F 15 , a GPU (Graphics Processing Unit) 21 , a VRAM (Video Random Access Memory) 22 , and a drive 3 .
  • the CPU 11 , the ROM 12 , the RAM 13 , the network I/F 14 , the controller I/F 15 , the GPU 21 , and the drive 3 are mutually connected via a bus 16 .
  • the VRAM 22 is connected to the GPU 21
  • the controller I/F 15 is connected to a controller 4 .
  • the CPU 11 operates according to a program read from a ROM 12 or a recording medium set in the drive 3 into the RAM 13 .
  • the CPU 11 is responsible for overall control of the information display device 1 in this embodiment, and carries out a process to display a plurality of kinds of display target information in respective windows, or screen elements, and a process to display notice information to be displayed in connection with display target information.
  • the CPU 11 carries out a process to display windows in the form of a catalog (catalog display). These processes carried out by the CPU 11 will be specifically described later in detail.
  • the ROM 12 stores various data and a program to be executed by the CPU 11 .
  • the RAM 13 holds a program to be executed by the CPU 11 .
  • the RAM 13 also functions as a work memory of the CPU 11 .
  • the drive 3 reads data from a recording medium, such as a DVD-ROM, a CD-ROM, or the like, mounted therein, and outputs the read data to the CPU 11 .
  • the drive 3 may be a reader of a recording medium, such as a memory stick (trademark), an SD card (trademark), and so forth, not limited to those described above.
  • the controller 4 may be a controller of a home-use game machine, including, for example, a key board, a mouse, or the like, of a PC.
  • the controller 4 connected to the bus 16 via the controller I/F 15 , has a direction key, other operation key, and an analogue device or the like for outputting a signal in accordance with an inclination and/or movement amount, and outputs a signal indicative of the user's operation to the CPU 11 .
  • the network I/F 14 controls data exchange with respect to a web server connected thereto via a network. Specifically, the network I/F 14 sends information (a data acquisition request or the like) via a network according to an instruction input from the CPU 11 and outputs information (HTML data or the like) received via the network to the CPU 11 . In this embodiment, the CPU 11 receives HTML data from a web server on a network, such as the Internet or the like, via the network I/F 14 .
  • the GPU 21 carries out a calculation necessary to display graphics.
  • the VRAM 22 is a memory for holding content to be shown on the display and receives image data produced by the GPU 21 and written into the VRAM 22 .
  • a display control unit (not shown) produces an image signal based on the image data written into the VRAM 22 and outputs the produced image signal to a television image receiver, a display device, or the like where an image is shown based on the image signal.
  • the information display device 1 operates as a web browser controlled by the CPU 11 , the GPU 21 , or the like. However, this is not an exclusive example. Any information can be displayed as long as an information display process utilizing a plurality of screen elements (for example, a window) is employed.
  • the web browser realized by the information display device 1 here is a browser with tabbed interface, or so-called “tabbrowser,” and displays each web page in an independent pane (realized as a window here), or a tab.
  • the respective tabs are displayed and switched according to the user's operation.
  • the information display device 1 in this embodiment carries out an information display process using a plurality of screen elements (hereinafter referred to as a window).
  • the information display device 1 may render an image of each window into a two dimensional rendering space.
  • the information display device 1 disposes a panel object serving as a window in a three dimensional virtual space and render an image to be displayed in a window onto at least one surface of the panel object.
  • the information display device 1 pastes as a texture a two dimensional image expressing content to be displayed.
  • data produced by the information display device 1 in this embodiment expresses a plurality of windows 61 , 62 , 63 , 64 , and 65 (panel objects), each having display target information rendered on the surface thereof, placed in the virtual space 5 , as shown in FIG. 2 .
  • the information display device 1 additionally disposes a virtual camera 71 in the virtual space 5 and defines a focused area 7 , or a virtual image capturing area, of the virtual camera 5 .
  • FIG. 2 shows an example in which a window 65 is located at the center of the focused area 7 , or an image capturing object of the virtual camera 71 , with a part of a window 64 included on the left side in the focused area 7 .
  • the information display device 1 renders the image of a portion contained in the focused area 7 of the virtual camera 71 , based on the information about the virtual space 5 .
  • the rendered image is drawn into the VRAM 22 and displayed on an external display or the like ( FIG. 3 ).
  • the virtual camera 71 can be set at any position in the virtual space 5 .
  • the virtual camera 71 moves with the focused area 7 thereof accordingly changing, different images are resultantly rendered with accordingly different images shown on the display.
  • the information display device described as a web browser here comprises, in terms of functions, as shown in FIG. 4 , a descriptive information acquisition unit 31 , a descriptive information analysis unit 32 , a display target information production unit 33 , a program processing unit 34 , a display control unit 35 , a notice information display unit 36 , a virtual space setting unit 37 , a catalog display setting unit 38 , a two dimensional rendering processing unit 41 , a three dimensional rendering processing unit 42 , and a combining processing unit 43 .
  • These units are realized by the CPU 11 , the GPU 21 , or the like by means of software, for example, in this embodiment.
  • the information acquisition unit 31 receives a data acquisition request from the display control unit 35 and/or the display target information production unit 33 .
  • the data acquisition request contains a designation of such as an URL or the like.
  • the information acquisition unit 31 acquires the requested data from the designated URL or the like and outputs the acquired data to the display control unit 35 or the display target information production unit 33 having requested the data.
  • data specified by an URL may be a file stored in a recording medium or the like mounted in the drive 3 of the information display device 1 , not limited to data from a web server or the like on the network.
  • the descriptive information analysis unit 32 contains a parser (an analysis function) for HTML data, and receives from the display control unit 35 , HTML data and information (an identifier of a screen element, hereinafter referred to as “a window identifier”) identifying a screen element in which to display.
  • the descriptive information analysis unit 32 then analyzes the received HTML data according to a predetermined rule.
  • the HTML data contains a display instruction data portion instructing display of display target information and sometimes additionally contains a program data portion to be executed.
  • the descriptive information processing unit 32 extracts a display instruction data portion from the HTML data and outputs the extracted display instruction data portion and the window identifier to the display target information production unit 33 .
  • the descriptive information analysis unit 32 extracts the program data portion as well, and outputs to the program processing unit 34 together with the window identifier.
  • the display target information production unit 33 extracts information (an image data URL or the like) specifying character string information to be displayed and image data to be displayed, based on the display instruction data input from the descriptive information processing unit 32 , outputs the information specifying image data to the information acquisition unit 31 with a request for acquisition of the image data specified by information, and receives image data acquired by the information acquisition unit 31 in response to the request. Moreover, the display target information production unit 33 produces web page descriptive information in which character string information and image data are laid out, based on the display instruction data, and outputs the produced web page descriptive information to the two dimensional rendering processing unit 41 together with the window identifier.
  • information an image data URL or the like
  • the program processing unit 34 executes the program data input from the descriptive information processing unit 32 and holds data (a pointer indicative of the point being executed in the program and work data such as variable data and so forth) necessary in execution of the program data so as to be associated with the window identifier also input from the descriptive information processing unit 32 . That is, with a plurality of windows open (that is, a plurality of web pages on display), the program processing unit 34 may execute the plurality of program data in parallel. As a method for parallel execution, a widely known process such as multithreaded process or the like is available, with detailed explanation thereof omitted here.
  • the program processing unit 34 When any information need to be notified to the user (that is, notice information to be notified to the user in connection with any display target information) during execution of program data associated with any window identifier (hereinafter referred to as a “focused identifier” for distinction), the program processing unit 34 outputs the information to be notified to the user (hereinafter referred to as “notice information”) and the focused identifier to the notice information display unit 36 .
  • the display control unit 35 instructs the virtual space setting unit 37 to produce one window, or a screen element, at the time of activation, then receives information (window identifier) identifying the produced window from the virtual space setting unit 37 , and holds the received information.
  • the display control unit 35 instructs the information acquisition unit 31 to acquire data specified by the URL set in advance.
  • the data specified by the URL is determined here as HTML data.
  • the display control unit 35 outputs the window identifier received from the virtual space setting unit 37 and the HTML data acquired by the information acquisition unit 31 to the descriptive information processing unit 32 .
  • the display control unit 35 controls the three dimensional rendering processing unit 42 to render a three dimensional image based on a virtual space set by the virtual space setting unit 37 .
  • the display control unit 35 controls the respective units according to the user's instruction.
  • the user makes the following instructions:
  • an instruction (hereinafter referred to as a “new window instruction”) to produce a new window (which may be a tab for displaying another web page in a web browser); (2) an instruction (hereinafter referred to as a “catalog display instruction”) to display a plurality of windows in the form of a catalog; (3) an instruction (hereinafter referred to as a “focus instruction”) to designate one of the plurality of windows as an object to be displayed or operated; (4) an instruction (hereinafter referred to as a “content operation instruction”) to input a character string or the like into an input column shown in the selected window or to click a link shown in the selected window; (5) an instruction to close the window; and (6) an instruction (hereinafter referred to as an “end instruction”) to terminate the process carried out as a browser.
  • a new window instruction to produce a new window (which may be a tab for displaying another web page in a web browser);
  • an instruction hereinafter referred to as a “catalog display instruction” to
  • a tab switching operation (an operation to switch a window positioned directly opposed to the virtual camera 71 ) will be described as one example operation.
  • the tab switching operation is carried out by pressing the direction key formed on the controller 4 .
  • the direction keys are provided in four directions, namely, in the up, down, left, and right directions
  • the virtual camera 71 is moved to a position directly opposed to a window on the right side relative to the sight line direction of the virtual camera 71 when the right-side direction key is pressed.
  • the virtual camera 71 is moved to a position directly opposed to a window on the left side relative to the sight line direction thereof. This is similarly applied when the respective keys formed in the vertical directions are pressed.
  • an object click operation includes moving a pointer to a click position, and clicking, and is carried out as follows, for example. That is, moving the pointer (a mouse cursor) to designate a click position is carried out by inclining an analogue stick or the like provided in the controller 4 or the like, and pressing a key provided separately from the direction key may be defined as a click operation.
  • the display control unit 35 instructs the virtual space setting unit 37 to produce one window, or a screen element, then receives information (a window identifier) identifying the produced window from the virtual space setting unit 37 , and holds the information.
  • the display control unit 35 instructs the information acquisition unit 31 to acquire data specified by the URL set in advance.
  • the data specified by the URL is determined here as HTML data.
  • the display control unit 35 outputs the window identifier received from the virtual space setting unit 37 and the HTML data acquired by the information acquisition unit 31 to the descriptive information processing unit 32 .
  • the display control unit 35 instructs the catalog display setting unit 38 to display a window catalog.
  • the display control unit 35 begins the process shown in FIG. 5 .
  • a window selected in response to the instruction is referred to as a focused window.
  • the display control unit 35 determines whether or not catalog display takes place ( 101 ). When it is determined that catalog display does not take place, the display control unit 35 moves the virtual camera 71 to a position directly opposed to the focused window ( 102 ) before ending the process.
  • the process 102 when an instruction is made to designate the window 63 as a focused window (or an instruction to move to a window at the right, which is made by the user by clicking the window 63 at the right or pressing the right-side direction key on the controller 4 or the like) while the window 62 is shown (that is, the virtual camera 71 is located in the position A in FIG. 6 ), the virtual camera 71 is moved to a position directly opposed to the window 63 (the position B in FIG. 6 ), so that the window 63 , or the new focused window, is located at the center of the focused area 7 of the virtual camera 71 .
  • the display control unit 35 instructs the virtual space setting unit 37 to render the images of the focused window and other window in mutually distinctive manners ( 103 ) before ending the process.
  • the mutually distinctive manner may include, for example, superimposition of a gray image in a semi-transparent manner onto the image shown in the window.
  • a specific example of the process 103 will be described later as well as a catalog display process.
  • the display control unit 35 updates the content shown in the focused window or the like according to the content of the operation. For example, in response to an operation to input a character string into an input column shown in the focused window selected by the user, the input letter is displayed in the input column. Also, in response to a link, a button, or the like being clicked, a process is carried out with reference to the HTML data associated with the clicked link or button. This process is identical to a process carried out as a typical browser, with a detailed description thereof omitted here.
  • the display control unit 35 outputs an instruction to acquire data from the URL associated with the clicked link or the like to the information acquisition unit 31 together with the window identifier of the focused window.
  • the display control unit 35 controls so as not to display the window any longer which is specified as a focused window by the window identifier (an ending window) at that time.
  • the virtual space setting unit 37 may be instructed to eliminate the panel object of the ending window from the virtual space 5 .
  • the display control unit 35 When (6) an ending instruction is received, the display control unit 35 produces notice information to confirm the end of the process and outputs to the notice information display unit 36 .
  • the notice information display unit 36 receives, from the program processing unit 34 , the window identifier (the above-described focused identifier) of the window showing the display target information associated with the program data in execution and the notice information, and defines, as a focused window, the window specified by the focused identifier (for example, a screen element (or a window) showing the display target information associated with the notice information). Then, the notice information display unit 36 displays the focused window in a distinctive manner from another window, and also displays the notice information. This display manner will be described later in detail.
  • the notice information display unit 36 may receive an instruction to display notice information not related to any display target information (that is, having nothing to do with any window) from the display control unit 35 or the like. In this case, the notice information display unit 36 displays the notice information in a manner different from notice information related to display target information (that is, notice information related to any window). This display manner will be described later in detail.
  • the virtual space setting unit 37 adds or deletes a panel object serving as a window with respect to the virtual space. Specifically, the virtual space setting unit 37 manages the virtual space 5 , using an object database, such as is shown in FIG. 7 .
  • the object database holds, for every virtual object to be contained in the virtual space 5 , a unique identifier, the shape and attribute of the object, and the coordinates indicative of the position and posture of the object, all in the manner of being associated with one another.
  • the shape or the like of a virtual object may be determined, for example, in the case of a panel object, as a rectangular parallelepiped which can be defined by the attributes including the width, depth, and height thereof.
  • a virtual camera can be defined by information identifying a virtual camera and attributes thereof, including a sight line direction, a viewing angle, or the like (which define a focused area).
  • the position coordinates can be determined, for every shape, so as to include the central position coordinates and coordinates, such as the main axial direction, which indicate the posture, for example.
  • a unique identifier is newly produced (the identifier is usable as a window identifier), and a rectangular parallelepiped shape is added to the object database, such as is shown in FIG. 7 .
  • the virtual space setting unit 37 sets a shape having been determined in advance as the shape of a panel object serving as a window, in association with the information describing the newly added shape, then defines the position coordinates or the like of the panel-like rectangular parallelepiped in the virtual space, and records the position coordinates in the object database.
  • the virtual space setting unit 37 changes the relative positions of the virtual camera 71 and the panel object.
  • the change in the relative positions may be carried out as
  • the virtual space setting unit 37 can change the relative positions of the panel object and the virtual camera 71 in the virtual space 5 such that an area for showing a menu screen is ensured on the display screen.
  • a menu screen is a screen image or the like for use in instructing to open a new window or an URL, to close a window, and so forth.
  • the window 61 is displayed at the center of the focused area 7 of the virtual camera 71 before update as shown in FIG. 8 (see the upper drawing in FIG. 8 ).
  • the display control unit 35 responsive to an instruction to display a menu screen instructs the virtual space setting unit 37 to ensure a display area for displaying a menu screen, and the virtual space setting unit 37 updates the relative positions of the window 61 and the virtual camera 71 such that the window 61 is positioned in a peripheral portion in the focused area 7 of the virtual camera 71 (see the lower drawing in FIG. 8 ).
  • an area (R) for displaying a menu screen is ensured after the update, not overlapping the display area of the window 61 , as shown in FIG. 9 .
  • the display control unit 35 may control such that the menu screen (M) is shown partly overlapping the window 61 shown in the peripheral portion after the update, as shown in FIG. 10 .
  • Another example of setting the virtual space 5 by the virtual space setting unit 37 will be described later.
  • the virtual space setting unit 37 receives, from the display control unit 35 , a window identifier and an instruction to delete the panel object associated with the window specified by the window identifier. In the above, the virtual space setting unit 37 deletes the entry of the data concerning the input window identifier from the object database.
  • the catalog display setting unit 38 receives an instruction from the display control unit 35 to display a catalog of windows, then instructs the virtual space setting unit 37 to rearrange the plurality of windows in a predetermined manner, and changes the position of the virtual camera 71 . That is, the catalog display setting unit 38 instructs to move the virtual camera 71 to a position which allows catalog display of all windows. An operation of the catalog display setting unit 38 and the virtual space setting unit 37 in response to the catalog display instruction will be described later in detail.
  • the two dimensional rendering processing unit 41 produces a bit map image expressing the content of a web page, based on the web page descriptive information input from the display target information production unit 33 , and stores the produced bit map image in the RAM 13 in association with the window identifier input together with the web page descriptive information.
  • the three dimensional rendering processing unit 42 produces bit map data in which a three dimensional image is rendered, based on the setting of the virtual space 5 by the virtual space setting unit 37 .
  • the three dimensional rendering processing unit 42 carries out the following process with reference to the object database produced by the virtual space setting unit 37 . That is, the three dimensional rendering processing unit 42 renders an image obtained by projecting a panel object or the like into the field of view (the focused area 7 ) of the virtual camera 71 .
  • Such a rendering process can be made using many available methods, including a scan line algorithm, a ray tracing method, a radiosity method, and so forth, with detailed descriptions thereof omitted here.
  • the three dimensional rendering processing unit 42 sets the bit map image of a web page, stored in the RAM 13 in association with the identifier (identical to the window identifier here) of each panel object, as a texture of the surface of each panel object, opposed to the virtual camera 71 .
  • each panel object functions as an image element (a window) for displaying a web page.
  • the combining processing unit 43 receives a character string and/or an image to be superimposed, for display, onto an image rendered by the three dimensional rendering processing unit 42 , and superimposes the received character string and image onto the image rendered by the three dimensional rendering processing unit 42 to combine them (in the semi-transparent manner, for example).
  • One example of semi-transparent combination is a process to add the values of pixels corresponding the respective images to be combined to thereby produce a combined image.
  • a display manner for notice information in this embodiment will be described.
  • a notice asking for input of a password, or the user's confirmation on whether or not jump to another web page, and so forth may be shown (display of notice information) during execution of program data contained in the HTML data.
  • Such notice information based on HTML data is notified to the user in connection with the display target information based on the HTML data.
  • notice information to be notified to the user in connection with any display target information is displayed as follows.
  • which display target information the displayed notice information is connected with is determined based on the window identifier (a focused identifier) of the window showing the display target information associated with the program data in execution.
  • the notice information display unit 36 having received a focused identifier and notice information, determines the window associated with the focused identifier as a focused window, and instructs the virtual space setting unit 37 to move the focused window from the central portion of the focused area 7 of the virtual camera 71 .
  • the virtual space setting unit 37 changes the coordinates of the focused window or the virtual camera 71 in the object database such that the focused window is located in the peripheral portion of the focused area 7 of the virtual camera 71 , to thereby update the relative positions of the focused window and the virtual camera 71 . This is identical to the example of the menu screen shown in FIGS. 8 and 9 .
  • the focused window is located close to any side of the screen of the display or the like, similar to the example shown in FIG. 9 , so that an area (R) for displaying the notice information is ensured.
  • the notice information display unit 36 displays the notice information in the area (R).
  • the three dimensional rendering processing unit 42 may put a gray tone (a solid gray image) in a semitransparent manner on the texture of the display target information shown in a window other than the focused window, as a texture of the surface thereof opposed to the virtual camera 71 , so that the display target information appears relatively dark (so-called dim) ( FIG. 12 ).
  • the display target information shown in the focused window appears relatively bright, so that the user can clearly recognize the window with which the displayed notice information is associated.
  • the notice information display unit 36 may instruct the combining processing unit 43 to display the notice information overlapping the area (R) where the adjacent window 63 is shown.
  • the three dimensional rendering unit 42 may be instructed not to render the image of a window other than the focused window.
  • the screen element other than the focused window is concealed ( FIG. 13 ), and only the focused window and the notice information are thus displayed. This facilitates recognition of the focused window.
  • a distinctive manner of display may be attained using various other methods, such as showing the frame of the focused window in a different color, blinking the focused window, and so forth, not limited to those described above.
  • the focused window associated with that notice information is displayed in a distinctive manner from other windows. Therefore, even when a plurality of windows are shown, the displayed notice information is displayed in association with which window can be clearly recognized by viewing.
  • the notice information and the display target information shown in the focused window can both be recognized.
  • control is carried out such that the displayed content of the notice information is not moved through the user's operation by employing an arrangement, for example, in which the notice information is displayed overlapping the image rendered by the three dimensional rendering unit 42 and so forth.
  • the notice information display unit 36 receives the user's operation relative to the notice information, and outputs the content of a response operation to the program processing unit 34 . For example, when a character string “Accept cookies?” is shown together with the buttons “yes” and “no” serving as notice information, and either button is clicked, information identifying the clicked button is output to the program processing unit 34 .
  • the program processing unit 34 receives information based on the notice information and continues the program data processing.
  • the program processing unit 34 may continue execution of program data associated with other window.
  • the window identifier of that window and the notice information to be displayed are stored so as to be associated with each other in a storage area of a waiting queue for notice information, set up in the RAM 13 .
  • a request for notice information display can be made using a plurality of methods, such as alert, document (document.open), and so forth. Then, in storing into a waiting queue, the program processing unit 34 may determine a priority order (the order of time of generation in the case of the same priority) depending on the method used in requesting the notice information display, and register in the priority order in the queue.
  • a priority order the order of time of generation in the case of the same priority
  • the notice information display unit 36 may instruct the program processing unit 34 to suspend processing of program data while notice information is displayed.
  • the program processing unit 34 having received the instruction, suspends execution of the program data associated with each window on display.
  • the notice information display unit 36 instructs the program processing unit 34 to resume processing of the program data when display of notice information is completed, for example, by the user responding to the notice information or the like.
  • the above-described arrangement can avoid a complicated process that results in cases such as, while notice information is displayed, display of notice information in association with other window becomes necessary as program data associated with the other window is continuously processed.
  • the notice information display unit 36 may display a selection button X for use in instructing “suspension of program data execution of the window”, together with the notice information ( FIG. 14 ).
  • the notice information display unit 36 instructs the program processing unit 34 to suspend the ongoing execution of the program data, while giving the window identifier of the focused window.
  • the program processing unit 34 suspends subsequent execution of the designated program data by, for example, deleting the execution data of the program associated with the window identifier input. In this manner, the above described arrangement can address the deficiency of repetitive display of notice information due to a loop process or the like.
  • the notice information display unit 36 may receive an instruction to display notice information not related to any display target information from the display control unit 35 or the like. For example, when sufficient memory to process program data can be no longer set up, or when an exception (an error or the like) occurs while program data is processed, the program processing unit 34 or the like instructs the notice information display unit 36 to display notice information notifying to that effect.
  • Such notice information is regarded as notice information not related to display target information because it is associated with the entire operation, though sometimes associated with a particular window.
  • connection failure to the network production of no window due to failure in analyzing the acquired data, and confirmation as to whether or not to end the process as a browser or the like concern the whole operation as a browser, and notice information to be made in such cases is regarded as not related to display target information.
  • the notice information display unit 36 In displaying notice information not related to display target information, the notice information display unit 36 superimposes a gray tone, by means of semi-transparent manner, onto the texture of display target information set on the surface of each window, opposed to the virtual camera 71 , for example, so that the display target information shown in the window is displayed relatively dark (so-called dim). Then, the notice information display unit 36 instructs the combining processing unit 43 to combine the character string of notice information or the like and the rendered image (rendered result by the three dimensional rendering unit 42 ) shown relatively dark in a respective window.
  • the notice information display unit 36 may instruct the three dimensional rendering unit 42 to render the image of no window, and notice information may be displayed.
  • an arrangement in which notice information related to display target information and notice information not related to any display target information (but related to the whole browser) are displayed in different manners can facilitate recognition by the user as to whether or not the displayed notice information is related to display target information.
  • the catalog display setting unit 38 in this embodiment receives an instruction to display a window catalog from the display control unit 35 and instructs the virtual space setting unit 37 to move the virtual camera 71 to a position which enables display of a catalog covering all windows.
  • positional change of the virtual camera 71 will be described.
  • the respective windows are aligned on a plane, as shown in FIG. 16 , when receiving an instruction to apply catalog display.
  • the angle of the field of view of the virtual camera 71 at that time is determined as ⁇ , and the virtual camera 71 is located at the position A in FIG. 16 (or a position away by the distance rO from the plane with the windows aligned).
  • one window 63 is recognized at the center with parts of other windows 62 , 64 on the right and left sides thereof, respectively, as shown as an image in connection with the position A in FIG. 17 .
  • the catalog display setting unit 38 instructs the virtual space setting unit 37 to change the position of the virtual camera 71 .
  • the virtual space setting unit 37 in return instructs to move the virtual camera 71 to a position farther from the plane with the windows aligned (the position away by the distance r from the plane, or the position B in FIG. 16 ), so that a field of view (a focused area 7 ) of the virtual camera 71 , which is large enough to fully cover the range w larger than the area showing all windows 61 to 65 is ensured.
  • r can be calculated as
  • the positions or the like of the respective objects are moved in a stepwise manner from the initial state to the target state in which the windows are shown as a catalog, whereby the objects are displayed moving like an animation. This makes it possible for the user to know which window moves to which position. It should be noted that the position of the panel object in the initial state is separately stored in the RAM 13 as an initial position.
  • the catalog display setting unit 38 instructs to move the virtual camera 71 farther from the panel objects corresponding to the respective windows.
  • the catalog display setting unit 38 may instruct the virtual space setting unit 37 to rearrange the plurality of panel objects into a predetermined layout.
  • the catalog display setting unit 38 having received a catalog display instruction may rearrange the three panel objects into a triangular layout, then moves the whole of the gathered panel objects to the vicinity of a predetermined one point in the virtual space 5 (in a range within a predetermined distance from the point), and also moves the virtual camera 71 to a position remote from the plane where the panel objects serving as windows are arranged.
  • each window can be displayed in a relative large size, compared to a case in which the objects are displayed in a line with the virtual camera 71 simply moved.
  • the coordinates which define the positions of the respective panel objects in catalog display may be held in advance in the RAM 13 or the like in association with the number of windows (the panel objects).
  • the respective panel objects in a default size may be positioned so as not to overlap each other ( FIG. 19 ). It should be noted that a different manner of disposition may be employed depending on a window size.
  • the catalog display setting unit 38 having received an instruction to release the catalog display, instructs the virtual space setting unit 37 to move the respective panel objects to the original positions (or the positions before the catalog display) thereof, with reference to the initial positions stored in the RAM 13 .
  • the catalog display setting unit 38 also instructs the virtual space setting unit 37 to move the virtual camera 71 to a position directly opposed to the panel object corresponding to the focused window at that time to thereby return the distance to the panel object serving as a focused window to the distance before the catalog display takes place.
  • the virtual space setting unit 37 defines the target positions of the respective objects, and changes the positions of the respective objects according to time t, to thereby display the objects as an animation.
  • catalog display is realized by simply changing the positions of the respective objects in the virtual space 5 . This allows the respective windows to be operated in the same manner before and after the catalog display. Therefore, it is possible to click a link in a window or to input a character string into a character string input column in a window even while catalog display takes place.
  • the display control unit 35 can accept an instruction operation which is made utilizing display target information shown in any of the windows in catalog display and carry out a process based on the instruction operation even while the catalog display takes place.
  • the windows present in the virtual space 5 need not be all displayed.
  • the information display device 1 issues a unique group identifier to the set of mutually related windows and holds the group identifier in association with each of the windows.
  • the catalog display setting unit 38 may display a catalog of windows having common group identifiers and, in response to a display switching operation, may display a catalog of windows having other common group identifiers.
  • the information display device 1 in this embodiment may assign a group identifier to the target window, which is common to the base window.
  • the catalog display setting unit 38 may display the windows assigned with the common group identifiers in the form of a catalog. Also, in response to a display switching operation, the catalog display setting unit 38 may display the windows assigned with different common group identifiers in the form of a catalog.
  • the position of the virtual camera 71 (the distance from a panel object serving as a window) may be defined in advance in association with the number of windows in the virtual space 5 (the number of open tabs).
  • the catalog display setting unit 38 checks the number of windows present in the virtual space 5 in response to a catalog display instruction and moves the virtual camera 71 to the position defined in association with that number. In this case, the number of windows which can be displayed as a catalog in the field of view of the virtual camera 71 positioned as defined according to the number of windows (the number of tabs open) in the virtual space 5 are displayed.
  • the number of windows allowed to be displayed as a catalog is not necessarily the number of all windows present in the virtual space 5 .
  • this embodiment can achieve display of an individual window, catalog display of all windows, and catalog display of some windows, as well as animation display in shifting from one display style to another, that is, displaying in a different manner from that in screen switching. This enhances visible recognition of the relationship among windows between the respective displays.
  • an instruction operation which is made utilizing display target information shown in any screen element is defined separately from an operation (a tab switching operation) to select any of the screen elements in catalog display. That is, the display control unit 35 does not switch the focused window in response to a window clicking operation at least while catalog display takes place, and instead, receives a selection instruction (a tab switching instruction) instructing to select a focused window, which is made using a different key or the like, for example.
  • a window selection operation is defined separately from an operation relative to display target information, as described above, the display control unit 35 can receive an instruction operation which is made utilizing display target information shown in the window in catalog and carry out a process based on the instruction operation even while catalog display takes place.
  • gray tone is superimposed in a semi-transparent manner onto the texture of display target information shown in a window other than the focused window while catalog display takes place so that the display target information is shown relatively dark (so-called dim) ( FIG. 20 ). This facilitates visual recognition of the focused window.
  • a title (a text designated as a title by the HTML data), bit map image (icon images referred to also as so-called favicon, a short-cut icon, a website icon, and so forth) defined by a website, and so forth may be superimposed for display onto the window on dim display other than the focused window ( FIG. 21 ).
  • the program processing unit 34 can process program data even while catalog display takes place. This may raise a need for the program processing unit 34 to display notice information.
  • the setting of the virtual space 5 may be updated such that the catalog display shifts to the display in the state shown in FIG. 12 or 13 .
  • an image to be displayed is produced by being rendered by the three dimensional rendering unit 42 and then superimposed by a character string or the like, such as notice information or the like, by the combining processing unit 43 . Further, the CPU 11 superimposes a title bar (A) containing a title (a text designated as a title by HTML data) and an icon defined by a website (so-called favicon) or the like and an operation guidance bar (C) presenting information about an available operation onto the image to be displayed, as shown as an example in FIG. 22 . The resultant image may be drawn into the VRAM 22 . In FIG. 22 , the title bar and the operation guidance bar are shown above and below the image to be displayed, respectively, though this arrangement is not an exclusive example.
  • the information display device 1 in this embodiment specifies the window addressed by the enlarged display instruction and changes the size of the panel object corresponding to the specified window and placed in the virtual space 5 .
  • the width d 0 of the window 61 is changed to the width d (d>d 0 ). Accordingly, a window 61 wider than the window 61 before the size change is shown on the display, as shown in FIG. 24 .
  • display of an individual window (a tab), display of a window catalog, and display of notice information can be shifted from one to another like an animation. That is, the states of display can be changed by successively moving the virtual camera 71 and the panel objects serving as windows. With this arrangement, visible recognition as to which window is displayed in which position in the respective display states is improved.
  • an instruction to apply catalog display of a plurality of windows (a catalog display instruction), a focus instruction to designate one of the plurality of windows as a window to be displayed or operated, and an instruction to release the catalog display and to display the focused window at the center of the screen image, and so forth, are made by operating the key or the like formed on the controller 4 .
  • an operation to incline the controller 4 itself may be accepted as an instruction operation or the like.
  • such a controller 4 has direction keys, an analogue device, operation buttons, and other keys (denoted as “A” to “D” in the drawing) formed on the front surface thereof and an acceleration sensor 51 and a gyro sensor 52 incorporated therein, as shown in FIG. 25 , for example.
  • the acceleration sensor 51 incorporates an anchor, for example, supported by a beam and detects the amount of deflection of the beam due to the displacement of the anchor caused by the acceleration applied thereto to thereby determine the acceleration applied to the anchor.
  • the acceleration sensor 51 in the embodiment may be a triaxial acceleration sensor for detecting accelerations (acceleration due to gravity) in mutually substantially orthogonal triaxial directions. As shown in FIG.
  • the acceleration sensor 51 is fixedly mounted inside the enclosure of the controller 4 with three mutually orthogonal reference axes, namely the x, y, and z axes, set therefor.
  • the x axis may be defined corresponding to the longitudinal direction (the right-left direction) of the controller 4 ;
  • the y axis may be defined corresponding to the depth direction (the front-back direction) of the same;
  • the z axis may be defined corresponding to the width direction (the direction perpendicular to the paper surface of the drawing) of the same.
  • the acceleration sensor 51 detects accelerations in the respective three reference axes, and outputs three voltage values in accordance with the detected accelerations.
  • the acceleration sensor 51 outputs a voltage signal substantially proportional to the determined acceleration. That is, the acceleration sensor 51 outputs a reference voltage Vo with no acceleration detected, and acceleration is generated in which of the positive and negative directions as to each axis is determined depending on whether the output voltage value is larger or smaller than the reference voltage Vo.
  • the controller 4 outputs a digital value obtained by converting a voltage signal into a digital signal (A/D conversion) as information describing the inclination angle.
  • an output indicative of the acceleration in the x axis is changed according to inclination of the controller 4 with the y axis as a center.
  • the controller 4 remains inclined by ⁇ y 1 degrees ( ⁇ y 1 ⁇ 0) in the longitudinal direction relative to the horizontal surface, as shown in FIG. 26
  • the gyro sensor 52 determines the angular speed of the rotation of the controller 4 around the z axis, and outputs the determined angular speed.
  • the CPU 11 samples an output from the gyro sensor 52 for every constant period of time and calculates an integration to thereby determine a displaced amount of the rotation of the controller 4 relative to the z axis.
  • A. an instruction (a catalog display instruction) to apply catalog display of a plurality of window; B. a focus instruction to designate one of the plurality of windows as a window to be displayed or operated; and C. an instruction to release the catalog display and to display the focused window at the center of the screen image are defined as follows, for example.
  • An operation to incline the controller 4 farther from the user of the controller 4 with the x axis as a center can be defined as a catalog display instruction, or A above.
  • an operation to incline the controller 4 either leftward or rightward with the y axis as a center may be defined triggering sequential switching of a window to be displayed or operated whether for catalog display or not.
  • An operation to incline the controller 4 toward the user of the controller 4 with the x axis as the center can be defined as an operation to release the catalog display, or C above.
  • the CPU 11 receives information about an inclination angle of the controller 4 from the controller 4 and operates as follows.
  • information about at least an inclination angle ⁇ y in the x axial direction (the y axis serving as a rotational axis) and an inclination angle ⁇ x in the y axial direction (the x axis serving as a rotational axis) are received.
  • the CPU 11 checks whether or not the inclination angle ⁇ x in the y axial direction is smaller than a predetermined first angular threshold ⁇ xth 1 ( ⁇ xth 1 ⁇ 0) (process 201 ).
  • a predetermined first angular threshold ⁇ xth 1 ⁇ xth 1 ⁇ 0
  • the CPU 11 checks whether or not the inclination angle ⁇ x in the y axial direction exceeds a predetermined second angular threshold ⁇ xth 2 ( ⁇ xth 2 >0) (process 203 ).
  • a predetermined second angular threshold ⁇ xth 2 ⁇ xth 2 >0
  • the CPU 11 releases the current catalog display, if any, and moves the respective windows to their respective positions before the catalog display takes place, and moves the virtual camera 71 to a position opposed to the current focused window (the focused window) (process 204 ) before ending the process.
  • the CPU 11 checks whether or not the inclination angle ⁇ y in the X axial direction is smaller than the predetermined third angular threshold ⁇ yth 3 ( ⁇ yth 3 ⁇ 0) (process 205 ). When it is determined that the inclination angle ⁇ y is smaller than the third angular threshold ⁇ yth 3 , it is determined that the controller 4 is inclined leftward by an angle exceeding the predetermined angular threshold. Then, the CPU 11 carries out a process to select (a focused tab switching process) a window as a focused window in a predetermined selection order (process 206 ).
  • This process differs depending on whether or not catalog display currently takes place. Specifically, when catalog display does not take place and there is a window at the left of the current focused window in the field of view of the virtual camera 71 , that window is regarded as a new focused window and the virtual camera 71 is moved to a position directly opposed to the new focused window.
  • the CPU 11 determines whether or not the inclination angle ⁇ y in the X axial direction exceeds the predetermined fourth angular threshold ⁇ yth 4 ( ⁇ yth 4 >0) (process 207 ).
  • the CPU 11 carries out a process to select (a focused tab switching process) a window as a focused window in a predetermined selection order (process 208 ).
  • a different process is carried out depending on whether or not catalog display takes place. Specifically, when catalog display does not take place and there is a window at the right of the current focused window in the field of view of the virtual camera 71 , that window is regarded as a new focused window and the virtual camera 71 is moved to a position directly opposed to the new focused window.
  • the above-described controller 4 facilitates a display window (tab) switching operation, utilizing an inclining operation.
  • the first to fourth angular thresholds are not necessarily identical.
  • the absolute value ⁇ xth 1 of the first angular threshold concerning inclination of the controller 4 farther from the user may be defined smaller than the absolute value
  • the CPU 11 may wait for a predetermined period of time after the processes 206 and 208 , rather than simply ending the process, and repeat the process 201 and thereafter.
  • the waiting time may be defined in accordance with the inverse of the absolute value of a value obtained by subtracting an angular threshold (the third angular threshold ⁇ yth 3 in the process 206 and the fourth angular threshold ⁇ yth 4 in process 208 ) from the inclination angle ⁇ y (for example, the waiting time may be defined by multiplying the inverse by a predetermined constant).
  • the focused window switching speed (or, the tab switching speed) can be controlled according to the inclination angle. Specifically, the focused window is switched relatively slowly for a smaller inclination angle and relatively fast for a large inclination angle.
  • the virtual camera 71 may move in the virtual space 5 according to inclination of the controller 4 itself. For example, when the controller 4 is inclined rightward, the virtual camera 71 moves rightward relative to the sight line thereof. When the controller 4 is inclined closer to the user thereof, the virtual camera 71 moves upward relative to the sight line thereof.
  • the moving speed may change depending on the magnitude of the inclination (the angle). For example, the larger the inclination angle ⁇ becomes, the larger the amounts (that is, the moving speed) ⁇ x, ⁇ y by which the vertical camera 71 moves per unit time becomes.
  • the virtual camera 71 may move farther from the window to thereby enlarge the field of view thereof. With the upward direction key pressed, the virtual camera 71 may move closer to the window. According to the above-described operation method, the user may feel a sense of freedom as if floating in the virtual space 5 , compared to an operation method using a cross key in moving an object in the virtual space 5 , and thus can operate intuitively.
  • an operation carried out by inclining the controller 4 may be accepted only while the inclination instruction key is kept pressed.
  • the inclination instruction key may be any of the keys A to D and the direction keys shown in FIG. 25 , for example.
  • the respective keys on the controller 4 are assigned respective functions by the program executed by the information display device 1 (for example, application of click is admitted in response to the key B pressed), though the inclination instruction key may remain free from any other function.
  • the inclination instruction key may be assigned another function.
  • the key A is assigned a function for displaying a map (a map display function) showing the position of the virtual camera 71 in the virtual space 5 .
  • a map a map display function
  • it may be arranged such that virtual camera 71 can move in the virtual space 5 in response to inclination of the controller 4 while the key A is kept pressed.
  • the inclination instruction key may not always be a single key.
  • any other key for example, the key C
  • the key C may also be used exclusively as an inclination instruction key.
  • That side surface key may be used as an inclination instruction key.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Data Mining & Analysis (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
US12/297,355 2006-05-02 2007-01-10 Information display device Abandoned US20090295812A1 (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP2006128726 2006-05-02
JP2006128726 2006-05-02
JP2006167594A JP4688739B2 (ja) 2006-05-02 2006-06-16 情報表示装置
JP2006167594 2006-06-16
PCT/JP2007/050134 WO2007129481A1 (ja) 2006-05-02 2007-01-10 情報表示装置

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2007/050134 A-371-Of-International WO2007129481A1 (ja) 2006-05-02 2007-01-10 情報表示装置

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US13/277,297 Continuation US8773472B2 (en) 2006-05-02 2011-10-20 Information display device
US13/277,303 Continuation US9047389B2 (en) 2006-05-02 2011-10-20 Information display device

Publications (1)

Publication Number Publication Date
US20090295812A1 true US20090295812A1 (en) 2009-12-03

Family

ID=38667593

Family Applications (3)

Application Number Title Priority Date Filing Date
US12/297,355 Abandoned US20090295812A1 (en) 2006-05-02 2007-01-10 Information display device
US13/277,303 Active US9047389B2 (en) 2006-05-02 2011-10-20 Information display device
US13/277,297 Active US8773472B2 (en) 2006-05-02 2011-10-20 Information display device

Family Applications After (2)

Application Number Title Priority Date Filing Date
US13/277,303 Active US9047389B2 (en) 2006-05-02 2011-10-20 Information display device
US13/277,297 Active US8773472B2 (en) 2006-05-02 2011-10-20 Information display device

Country Status (5)

Country Link
US (3) US20090295812A1 (ja)
JP (1) JP4688739B2 (ja)
KR (1) KR20090004849A (ja)
CN (2) CN101341463B (ja)
WO (1) WO2007129481A1 (ja)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120086788A1 (en) * 2010-10-12 2012-04-12 Sony Corporation Image processing apparatus, image processing method and program
US20180284954A1 (en) * 2017-03-30 2018-10-04 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Identifying a target area to display a popup graphical element
US20180315336A1 (en) * 2017-04-27 2018-11-01 Cal-Comp Big Data, Inc. Lip gloss guide device and method thereof
US11256537B2 (en) * 2018-07-30 2022-02-22 Mitsubishi Electric Corporation Interrupt control apparatus, interrupt control method, and computer readable medium

Families Citing this family (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4971203B2 (ja) * 2008-01-07 2012-07-11 株式会社エヌ・ティ・ティ・ドコモ 情報処理装置及びプログラム
JP5253937B2 (ja) 2008-09-08 2013-07-31 株式会社エヌ・ティ・ティ・ドコモ 情報処理装置及びプログラム
WO2010108499A2 (en) * 2009-03-22 2010-09-30 Algreatly Cherif Atia 3d navigation method and system
US20140152628A1 (en) * 2009-10-06 2014-06-05 Cherif Atia Algreatly Computer input device for hand-held devices
JP5691333B2 (ja) * 2010-09-15 2015-04-01 日本電気株式会社 情報処理装置、情報処理システム、および情報処理装置のプログラム
JP5538483B2 (ja) 2012-06-29 2014-07-02 株式会社ソニー・コンピュータエンタテインメント 映像処理装置、映像処理方法、および映像処理システム
JP5696908B2 (ja) * 2013-02-15 2015-04-08 コニカミノルタ株式会社 操作表示システム
US10152540B2 (en) * 2014-10-10 2018-12-11 Qualcomm Incorporated Linking thumbnail of image to web page
CN106951139A (zh) * 2017-03-13 2017-07-14 海信集团有限公司 消息提示框显示方法及装置
EP3435250A1 (en) * 2017-07-27 2019-01-30 Vestel Elektronik Sanayi ve Ticaret A.S. Method, apparatus and computer program for overlaying a web page on a 3d object
JP7307568B2 (ja) 2019-03-20 2023-07-12 任天堂株式会社 画像表示システム、画像表示プログラム、表示制御装置、および画像表示方法
US11263766B1 (en) 2021-07-15 2022-03-01 Weta Digital Ltd. Smoothly changing a focus of a camera between multiple target objects

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020080182A1 (en) * 1997-02-04 2002-06-27 Fujitsu Limited Three-dimensional window displaying apparatus and mehtod thereof
US20040261038A1 (en) * 2003-06-20 2004-12-23 Apple Computer, Inc. Computer interface having a virtual single-layer mode for viewing overlapping objects
JP2006513485A (ja) * 2003-01-14 2006-04-20 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ コンピュータ・スクリーン上でのビューの再配置
US20070202949A1 (en) * 2006-02-27 2007-08-30 Nintendo Co., Ltd. Game apparatus and storage medium storing game program

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05224861A (ja) 1991-03-28 1993-09-03 Toshiba Syst Kaihatsu Kk マルチウインドウシステム
JP3705826B2 (ja) 1993-03-17 2005-10-12 株式会社日立製作所 仮想３次元ウインドウ表示制御方法
US5751283A (en) * 1996-07-17 1998-05-12 Microsoft Corporation Resizing a window and an object on a display screen
JP2000200131A (ja) 1999-01-05 2000-07-18 Canon Inc 三次元画像生成システムおよび三次元画像生成方法
JP2001175239A (ja) * 1999-12-21 2001-06-29 Canon Inc マルチ画面表示装置、マルチ画面表示システム、マルチ画面表示方法、及び記憶媒体
JP3494967B2 (ja) * 2000-09-12 2004-02-09 株式会社デジタル 制御システム、および、そのプログラムが記録された記録媒体
JP2002342377A (ja) * 2001-05-18 2002-11-29 Lexi:Kk ウェブページ閲覧プログラム
JP3955499B2 (ja) * 2001-08-07 2007-08-08 日本電産サンキョー株式会社 ハンドの位置合わせ方法およびその装置
JP3982288B2 (ja) 2002-03-12 2007-09-26 日本電気株式会社 三次元ウィンドウ表示装置、三次元ウィンドウ表示方法及び三次元ウィンドウ表示プログラム
US7589732B2 (en) * 2002-11-05 2009-09-15 Autodesk, Inc. System and method of integrated spatial and temporal navigation
DE60228456D1 (de) 2002-11-06 2008-10-02 Lp Holding Aps Herstellungsverfahren für ein Werbeplakat
US8237712B2 (en) 2004-03-18 2012-08-07 Apple Inc. Manipulation of image content using various image representations
JP4111518B2 (ja) * 2004-07-29 2008-07-02 キヤノン株式会社 画像表示装置及びその制御方法
US8418075B2 (en) 2004-11-16 2013-04-09 Open Text Inc. Spatially driven content presentation in a cellular environment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020080182A1 (en) * 1997-02-04 2002-06-27 Fujitsu Limited Three-dimensional window displaying apparatus and mehtod thereof
JP2006513485A (ja) * 2003-01-14 2006-04-20 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ コンピュータ・スクリーン上でのビューの再配置
US20060101352A1 (en) * 2003-01-14 2006-05-11 Koninklijke Philips Electronics N.V. Rearranging views on a computer screen
US20040261038A1 (en) * 2003-06-20 2004-12-23 Apple Computer, Inc. Computer interface having a virtual single-layer mode for viewing overlapping objects
US20070202949A1 (en) * 2006-02-27 2007-08-30 Nintendo Co., Ltd. Game apparatus and storage medium storing game program

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120086788A1 (en) * 2010-10-12 2012-04-12 Sony Corporation Image processing apparatus, image processing method and program
US9256069B2 (en) * 2010-10-12 2016-02-09 Sony Corporation Image processing apparatus image processing method and program using electrodes contacting a face to detect eye gaze direction
US20180284954A1 (en) * 2017-03-30 2018-10-04 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Identifying a target area to display a popup graphical element
US20180315336A1 (en) * 2017-04-27 2018-11-01 Cal-Comp Big Data, Inc. Lip gloss guide device and method thereof
US10783802B2 (en) * 2017-04-27 2020-09-22 Cal-Comp Big Data, Inc. Lip gloss guide device and method thereof
US11256537B2 (en) * 2018-07-30 2022-02-22 Mitsubishi Electric Corporation Interrupt control apparatus, interrupt control method, and computer readable medium

Also Published As

Publication number Publication date
US20120075295A1 (en) 2012-03-29
JP4688739B2 (ja) 2011-05-25
US8773472B2 (en) 2014-07-08
CN102306158B (zh) 2013-10-16
CN102306158A (zh) 2012-01-04
US20120075344A1 (en) 2012-03-29
CN101341463B (zh) 2011-09-07
CN101341463A (zh) 2009-01-07
JP2007323618A (ja) 2007-12-13
US9047389B2 (en) 2015-06-02
KR20090004849A (ko) 2009-01-12
WO2007129481A1 (ja) 2007-11-15

Similar Documents

Publication Publication Date Title
US9047389B2 (en) Information display device
Rohs et al. A conceptual framework for camera phone-based interaction techniques
US20180024719A1 (en) User interface systems and methods for manipulating and viewing digital documents
KR100274135B1 (ko) 원격제어를이용한하이퍼텍스트객체들간의네비게이션을제공하는웹브라우저
EP2284679B1 (en) User interface systems and methods for manipulating and viewing digital documents
US9552149B2 (en) Controlled interaction with heterogeneous data
EP1729204A1 (en) Information processor, information processing program, recording medium with information processing program stored therein and window control method
JP2006163948A (ja) 情報処理装置及びその方法
US20060197751A1 (en) Display control apparatus and control method thereof
JP2007047324A (ja) 情報処理装置及び情報処理方法並びにプログラム
US7107545B2 (en) System and method for providing a graphical user interface display with a conspicuous image element
JPH10177466A (ja) マルチウインドウ処理装置
KR101361410B1 (ko) 웹 관리 장치, 웹 관리 방법, 웹 관리 프로그램을 기록하는 컴퓨터 판독 가능한 기록 매체, 및 웹 시스템
JP4773671B2 (ja) ポインティングデバイスによる入力方法
JP6058900B2 (ja) 情報処理システム、制御装置、画像表示方法及び情報処理プログラム
JP2007299329A (ja) 情報表示装置
CN101424996B (zh) 人机装置
US10867445B1 (en) Content segmentation and navigation
JP5849003B2 (ja) 表示装置、携帯端末、表示方法および表示プログラム
JP4940265B2 (ja) ウェブページ情報表示制御装置および方法
JPH1115583A (ja) アイコン表示制御装置及びアイコン表示制御方法
JP6559280B2 (ja) 端末用プログラム、端末装置及び端末制御方法
JP2009015579A (ja) 情報処理装置及びウィンドウ表示方法
JP3721759B2 (ja) 画面操作指示方法および装置
JPH01291319A (ja) 表示装置

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY NETWORK ENTERTAINMENT PLATFORM INC., JAPAN

Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT INC.;REEL/FRAME:027448/0895

Effective date: 20100401

AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SONY NETWORK ENTERTAINMENT PLATFORM INC.;REEL/FRAME:027449/0469

Effective date: 20100401

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION