US8108789B2 - Information processing device, user interface method, and information storage medium - Google Patents

Information processing device, user interface method, and information storage medium Download PDF

Info

Publication number
US8108789B2
US8108789B2 US12/373,208 US37320807A US8108789B2 US 8108789 B2 US8108789 B2 US 8108789B2 US 37320807 A US37320807 A US 37320807A US 8108789 B2 US8108789 B2 US 8108789B2
Authority
US
United States
Prior art keywords
data
closed area
positions
space
metaball
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US12/373,208
Other languages
English (en)
Other versions
US20090293008A1 (en
Inventor
Takahiro Fujii
Ryuji Nakayama
Hiroki Kato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dropbox Inc
Original Assignee
Sony Computer Entertainment Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Computer Entertainment Inc filed Critical Sony Computer Entertainment Inc
Assigned to SONY COMPUTER ENTERTAINMENT INC. reassignment SONY COMPUTER ENTERTAINMENT INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KATO, HIROKI, FUJII, TAKAHIRO, NAKAYAMA, RYUJI
Publication of US20090293008A1 publication Critical patent/US20090293008A1/en
Assigned to SONY NETWORK ENTERTAINMENT PLATFORM INC. reassignment SONY NETWORK ENTERTAINMENT PLATFORM INC. CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: SONY COMPUTER ENTERTAINMENT INC.
Assigned to SONY COMPUTER ENTERTAINMENT INC. reassignment SONY COMPUTER ENTERTAINMENT INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SONY NETWORK ENTERTAINMENT PLATFORM INC.
Application granted granted Critical
Publication of US8108789B2 publication Critical patent/US8108789B2/en
Assigned to DROPBOX INC reassignment DROPBOX INC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: SONY ENTERTAINNMENT INC
Assigned to JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT reassignment JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT SECURITY INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DROPBOX, INC.
Assigned to JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT reassignment JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT PATENT SECURITY AGREEMENT Assignors: DROPBOX, INC.
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2219/00—Indexing scheme for manipulating 3D models or images for computer graphics
    • G06T2219/20—Indexing scheme for editing of 3D models
    • G06T2219/2016—Rotation, translation, scaling

Definitions

  • the present invention relates to an information processing device, a user interface method, and an information storage medium, and more particularly, to a user interface for grouping data.
  • GUI Graphic user interfaces
  • icons representative of various data items and a folder icon representative of a folder for holding one or more data items are shown on a monitor.
  • drag and drop operation By moving any data icon by means of a so-called drag and drop operation to the display position of a folder icon, it is possible to hold the data in the folder.
  • the user With an operation to hold a plurality of data items in a common holder, the user can group the data items.
  • the present invention has been conceived in view of the above, and aims to provide an information processing device, a user interface method, and an information storage medium for grouping a plurality of data items through an easy operation.
  • an information processing device comprising displaying means for displaying an image of a space where a plurality of data-related positions respectively associated with a plurality of data items are set and each data-related position is surrounded solely or together with other data-related position by a closed area, such that each closed area is distinctive; operation means for allowing a user to operate so as to arbitrarily move the data-related position in the space; closed area update means for updating each closed area in the space according to movement of the data-related position in the space; and grouping means for grouping, when the plurality of data-related positions are surrounded by a common closed area, data associated with the respective data-related positions.
  • a user interface method comprising a space image display step of displaying an image of a space where a plurality of data-related positions respectively associated with a plurality of data items are set and each data-related position is surrounded solely or together with other data-related position by a closed area, such that each respective closed area is distinctive; a movement operation receiving step of receiving an operation by a user to arbitrarily move the data-related position in the space; a closed area update step of updating each closed area in the space according to movement of the data-related position in the space; and a grouping step of grouping, when the plurality of data-related positions are surrounded by a common closed area, data associated with the respective data-related positions.
  • a computer readable information storage medium storing a program for causing a computer to function as displaying means for displaying an image of a space where a plurality of data-related positions respectively associated with a plurality of data items are set and each data-related position is surrounded solely or together with other data-related position by a closed area, such that each closed area is distinctive; operation means for allowing a user to operate so as to arbitrarily move the data-related position in the space; closed area update means for updating each closed area in the space according to movement of the data-related position in the space; and grouping means for grouping, when the plurality of data-related positions are surrounded by a common closed area, data associated with the respective data-related positions.
  • the computer may include, for example, a personal computer, a consumer game machine, a commercial game machine, a portable game machine, a portable phone, a personal digital assistant, and so forth.
  • the program may be stored in a computer readable information storage medium such as a CD-ROM, a DVD-ROM, and so forth.
  • a data-related position is set in association with each data item.
  • Each data-related position is surrounded by a closed area either solely or together with other one or more data-related position/positions. Then, the image of the space is displayed such that each closed area is distinctive.
  • the user can arbitrarily move the data-related position. Then, with the data-related position having been moved, each closed area is updated accordingly. With the closed area updated and a plurality of data-related positions surrounded by a common closed area, data associated with the data-related positions are grouped.
  • the “space” includes not only a three dimensional space but also two dimensional space, that is, a plane.
  • the grouping means may cause the data-related positions surrounded by the common closed area to move following each other in the space, according to an operation carried out by the operation means.
  • the closed area update means may set an area as the closed area in the space, the area being a set of positions where a sum of function values of distances to the respective data-related positions is equal to or larger than a predetermined threshold.
  • the value calculated according to the distance to the data-related position may be a value obtained by substituting the distance to the data-related position into a predetermined decreasing function.
  • the information processing device may further comprise threshold changing means for changing the predetermined threshold.
  • threshold changing means for changing the predetermined threshold.
  • the information processing device may further comprise data-related position approaching and separating means for calculating a degree of relevance between data items based on attribute information on the respective data items, and causing the data-related positions associated with the data items to approach or separate with respect to each other in the space.
  • the operation means may be means for enabling the user to arbitrarily move the closed area distinctively displayed by the image, and for moving, when moving the closed area, one or more data-related positions surrounded by the closed area.
  • FIG. 1 is a diagram showing a virtual space (before movement of a closed area) to be managed in an information processing device according to an embodiment of the present invention
  • FIG. 2 is a diagram showing one example of a metaball function
  • FIG. 3 is a diagram showing a space image shown on a display device
  • FIG. 4 is a diagram showing a virtual space (after movement of a closed area) to be managed in the information processing device according to an embodiment of the present invention
  • FIG. 5 is a diagram showing a space image shown on the display device
  • FIG. 6 is a diagram showing distribution of the sum of function values in the virtual space
  • FIG. 7 is a diagram showing a space image when displaying the space enlarged
  • FIG. 8 is a diagram showing a hardware structure of the information processing device
  • FIG. 9 is a functional block diagram of the information processing device
  • FIG. 10 is a diagram showing a structure of a data information database
  • FIG. 11 is a diagram showing a structure of a group database.
  • FIG. 12 is a diagram showing another example of a space image.
  • An information processing device comprises a computer, in which a virtual space is created in the memory device of the computer.
  • a virtual space In the virtual space, data-related positions of various data items stored in the computer or another computer connected to that computer via a network are set.
  • the data includes data on a static image, a motion image, music, and so forth (process target data), for example, data on a program for processing the data through reproduction, editing, and so forth.
  • An image (space image) of the virtual space is shown on a display device which constitutes the information processing device.
  • the space image constitutes a graphic user interface for use by the user in instructing data grouping and grouped data releasing, as well as processing of various process target data, using a program.
  • FIG. 1 is a diagram showing one example of the virtual space. As shown, a three dimensional virtual space 10 is created in the memory device of the computer, with data-related positions 12 a to 12 c associated with respective electronic data items set in the virtual space 10 . In FIG. 1 , the data-related positions 12 a to 12 c in the virtual space 10 are respectively surrounded by three dimensional closed areas 14 a to 14 c.
  • closed areas 14 a to 14 c are shown as area images to be described later on the display device by means of a computer graphics method referred to as a so-called metaball. That is, a metaball function is made associated with each data-related position 14 a to 14 c , and sets of the positions, or areas, in the virtual space 10 , where the sum of the function values thereof (the concentration value of the metaball) is equal to or larger than a predetermined threshold (a surface defining value) is determined as closed areas (areas occupied by the metaball) 14 a to 14 c .
  • FIG. 2 shows an example of a metaball function. As indicated by the solid line in FIG.
  • the metaball function is a decreasing function concerning the distance from each data-related position, with the metaball function value of a position away from the concerned data-related position by a distance equal to or longer than a predetermined distance LM being zero.
  • a predetermined distance LM a predetermined distance LM
  • the surface of a closed area which surrounds each data-related position is defined in positions where the function values of the metaballs associated with that data-related positions amount to a predetermined surface defining value, that is, positions away from that data-related position by a distance L 0 .
  • the surface of the sphere having the concerned data-related position as a center and a radius L 0 constitutes the surface of the closed area which surrounds the data-related position.
  • either one or two surfaces of a closed area/areas is/are defined in positions where the sum of the function values of the metaballs associated with the concerned data-related positions amount to a predetermined surface defining value. That is, when the surface of one closed area is defined, that closed area surrounds the two data-related positions. Meanwhile, when the surfaces of two closed areas are defined, the respective closed areas surround the two respective data-related positions.
  • FIG. 3 is a diagram showing one example of an image (a space image) of the virtual space 10 shown on the display device which constitutes the information processing device according to the embodiment.
  • the shown space image is visualization of the virtual space 10 shown in FIG. 1 , including an area image 18 a corresponding to the data-related position 12 a and the closed area 14 a surrounding the data-related position 12 a , an area image 18 b corresponding to the data-related position 12 b and the closed area 14 b surrounding the data-related position 12 b , and an area image 18 c corresponding to the data-related position 12 c and the closed area 14 c surrounding the data-related position 12 c .
  • This space image is an image of a picture obtained by viewing the virtual space 10 from a viewpoint in a viewing direction, which are set in the virtual space 10 .
  • the area image 18 includes an image representative of the data associated with the corresponding data-related position 12 . For example, either a thumbnail image representative of the data or the character string of the data name (a file name) may be shown in the area image 18 .
  • the space image includes a cursor image 16 , which moves in the space image according to an operation carried out to an input device, including a pointing device such as a mouse or the like and/or a coordinate input means such as a touch pad or the like, which constitute the information process device.
  • an input device including a pointing device such as a mouse or the like and/or a coordinate input means such as a touch pad or the like, which constitute the information process device.
  • the area image 18 can be moved in the space image.
  • the data-related position 12 corresponding to the area image 18 also moves in the virtual space 10 .
  • a camera image capturing means
  • FIG. 4 is a diagram showing the virtual space 10 after the data-related positions 12 b is operated so as to approach the data-related position 12 a .
  • the closed area 14 b corresponding to the data-related position 12 b is unified with the closed area 14 a corresponding to the data-related position 12 a and, consequently, a closed area 14 ab , which surrounds the data-related positions 12 a and 12 b , appears in the virtual space 10 .
  • FIG. 4 is a diagram showing the virtual space 10 after the data-related positions 12 b is operated so as to approach the data-related position 12 a .
  • the closed area 14 b corresponding to the data-related position 12 b is unified with the closed area 14 a corresponding to the data-related position 12 a and, consequently, a closed area 14 ab , which surrounds the data-related positions 12 a and 12 b , appears in the virtual space 10 .
  • FIG. 5 shows the space image obtained by visualizing the virtual space 10 shown in FIG. 4 .
  • the space image contains the area image 18 ab representative of the closed area 14 ab , or unified closed areas 14 a and 14 b .
  • the area image 18 ab contains thumbnail images or the like representative of the respective data items associated with the data-related positions 12 a and 12 b surrounded by the closed area 14 ab .
  • FIG. 6 shows distribution of the sums of the function values on the line 15 passing through the data-related positions 12 a to 12 c , shown in FIG. 5 .
  • the sum of the function values corresponding to the data-related positions 12 a , 12 b exceeds a surface defining value d at a position between the data-related positions 12 a and 12 b , as a result of which a unified closed area 14 ab is produced.
  • the cursor image 16 can be moved in the space image by using the input device so that a data-related position can be moved in the virtual space 10 according to the movement.
  • the closed areas surrounding the respective data-related positions are deformed to be unified.
  • these data items are grouped.
  • a thumbnail image or the like representative of the process target data related to the data-related position surrounded by the closed area is contained.
  • the process target data is processed using the program. That is, in response to the user's operation to move the closed area associated with a program and that with the process target data to each other, the closed areas are deformed to be unified. By thus unifying the closed areas, it is possible to instruct processing of the process target data using the program.
  • program processing of process target data begins, the interval between the data-related position associated with the program and that associated with the process target data is forcibly widened either immediately or after completion of the processing, whereby the unified closed areas are separated into the closed area associated with the program and that associated with the process target data.
  • a picture showing the data-related positions being separated by a repulsion force inversely proportional to the distance between the data-related positions or the power value thereof may be reproduced by means of physical simulation.
  • the unified closed areas may remain unified after completion of the program processing.
  • a texture describing a program processing history may be mapped onto the unified closed area.
  • a texture describing the processing history may include the image of liquid accumulated to an amount in accordance with the number of processed process target data items or an image obtained by combining thumbnail images of process target data in the closed area.
  • the user can arbitrarily change the above-described surface defining value.
  • the position of the surface of each closed area 14 is determined by the surface defining value, as described above.
  • the user can arbitrarily change the surface defining value, using the input device, so as to allow the user to change the position of the surface of each closed area 14 . That is, as shown in FIG. 7 ( a ), with the area image 18 ab representative of the closed area surrounding two data-related positions shown on the display device, for example, application of an operation to change the surface defining value to a larger value while designating the area image 18 ab , using the cursor image 16 (double clicking the mouse, or the like) can change the surface defining value to a larger value.
  • the area image 18 ab is separated into two area images 18 a and 18 b , as shown in FIG. 7 ( b ). That is, as shown in FIG. 6 , with the surface defining value d having been changed to a larger surface defining value d′, an area with the sum of the function values in excess of the surface defining value d′ is narrowed, and the area image 18 ab is accordingly separated into the area images 18 a and 18 b .
  • the space image is shown enlarged on the display device with the position indicated by the cursor image 16 in the virtual space 10 as a center.
  • the degree of relevance between data items is calculated based on the data attribute (data type, for example), and the data-related positions of the data items are made approaching or separated with respect to each other in the virtual space 10 according to the degree of relevance.
  • FIG. 8 is a diagram showing a hardware structure of the information processing device according to this embodiment.
  • the information processing device comprises a display device 20 , a computer 22 , and an input device 24 , with the display device 20 comprising a CRT, an LCD, or the like.
  • the computer is formed using a processor and a memory as main components, including a personal computer, a consumer game machine, a home server, and so forth, for example.
  • the input device 24 includes a pointing device such as a mouse or the like, a keyboard, a remote controller, and so forth.
  • FIG. 9 is a functional block diagram showing the information processing device according to this embodiment.
  • the computer 22 of this information processing device comprises, in terms of functions, a space image production unit 32 , a surface defining value change unit 34 , a data-related position update unit 38 , a data information database 40 , a group following unit 42 , a data-related position approaching and separating unit 44 , a group management unit 46 , a program execution unit 47 , and a group database 48 .
  • These functions are realized by executing a program according to this embodiment in the computer 22 .
  • the data information database 40 is provided in a strange device such as a hard disk or the like provided in the computer 22 , and stores a data ID, a pass, a data-related position, thumbnail data, attribute 1 and attribute 2 in association with one another, as shown in FIG. 10 .
  • the data ID is identification information of data stored in the computer 22 or another computer (not shown) connected for communication with the computer 22 .
  • the pass is data specifying the location of the data identified by the data ID.
  • the data-related position is position coordinates in the virtual space 10 , which are made associated with the data identified by the data ID.
  • the thumbnail data is data specifying the location of a thumbnail image representative of the data identified by the data ID.
  • the attribute 1 is data describing the attribute of data identified by the data ID, specifically, being one or more key word/words relating to the data here.
  • the attribute 2 is data, in the case of data identified by the data ID being process target data, which specifies a program for processing the process target data, and in the case of data identified by the data ID being a program, data (a data file extension, for example) which specifies the kind of data to be processed by the program.
  • the group database 48 is also provided in the memory device of the computer 22 , in which a group ID and a data ID are stored in association with each other, as shown in FIG. 11 .
  • a plurality of data items constitute a group, which is identified by a group ID.
  • the data ID identifies the data belonging to a group identified by the group ID.
  • the data-related position update unit 38 selects a data-related position to be operated, according to the position of the cursor image 16 operated by the input device 24 , and moves the data-related position in the virtual space 10 according to the movement of the cursor image 16 .
  • a data-related position For example, with the cursor image 16 having the tip end thereof located in any area image 18 , one of the positions in the space image 10 , corresponding to the data-related positions in the area image 18 , which is located closest to the tip end of the cursor image 17 is selected as a moving target. Then, the movement direction and distance of the cursor image 16 being moved through a drag and drop operation is obtained, and the data-related position selected as a moving target is moved accordingly.
  • the data-related position update unit 38 updates the data-related position selected as a moving target and stored in the data information database 40 to that after the movement. In moving any data-related position, the data-related position update unit 38 notifies the group following unit 42 of the data ID and movement direction and distance of the data associated with that data-related position. It should be noted that, when the cursor image 16 to be operated by the input device 24 is located in any area image 18 , all of the positions in the space image, corresponding to the data-related positions in that area image 18 may be selected as moving targets. In this case, the movement direction and distance of the cursor image 16 being moved through a drag and drop operation may be obtained, and the data-related positions selected as moving targets may be moved according to the obtained movement direction and distance, together with the area image 18 itself.
  • the group following unit 42 In moving the data-related position of data belonging to any group, the group following unit 42 additionally moves the data-related positions of other data items belonging to the same group, while referring to the group database 48 . That is, in updating any data-related position, the data ID and the movement direction and distance notified by the data-related position update unit 38 are obtained, and whether or not the obtained data ID is already stored in the group database 48 is determined. Then, when it is determined that the data ID is already stored in the group database 48 , other data ID stored in association with the same group ID is read. Then, the data-related position associated with the read data ID is read from the data information database 40 , and update the value thereof according to the movement direction and distance notified by the data-related position update unit 38 .
  • the data-related position approaching and separating unit 44 reads the data on the attribute 1 stored in the data information database 40 , then calculates the degree of relevance between the data items, and updates the data on the data-related position stored in the data information database 40 according to the degree of relevance. For example, in calculation of the degree of relevance between two data items, data on the attribute 1 of the data items is read from the data information database 40 , and the degree of relevance between the data items may be calculated based on the number of common keywords contained in the data items. Further, the data-related positions of the data items are read from the data information database 40 , and then made getting closer or farther with respect to each other according to the degree of relevance.
  • the distance between the data-related position P i and the data-related position P j is defined as a distance d ij and the degree of relevance calculated based on the data attribute associated with these data-related positions is defined as degree of relevance s ij .
  • the distance d ij becomes equal to or smaller than a constraint distance lc, which is determined based on an increasing function of the degree of relevance s ij such as k 1 ⁇ s ij , both of the data-related positions P i , P j are constrained by a virtual spring.
  • the natural length of the virtual spring is defined as a decreasing function of the degree of relevance s ij such as kl ⁇ (1/s ij ), and the spring constant k is defined as an increasing function of the degree of relevance s ij such as kd ⁇ s ij (kl, kd being constants).
  • the higher a degree of relevance s ij is, from the closer reference positions the data-related positions P i and P j get closer or farther with respect to each other.
  • the higher a degree of relevance s ij is, the more strongly (faster) the data-related positions P i and P j get closer or farther with respect to each other.
  • the higher the degree of relevance s ij is, the larger constraint distance lc becomes, as a result of which data-related positions P i , P j located farther from each other are subjected to spring constraint.
  • the data-related position associated with the program and that associated with the process target data are forcibly moved apart from each other to thereby release the unification of the closed areas.
  • the space image production unit 32 produces an image showing the virtual space 10 , or a space image, based on the information stored in the data information database 40 , which is then displayed by the display device 20 .
  • some or all of the data-related positions are read from the data information database 40 according to the viewpoint position and viewing direction set in the virtual space 10 , and the position of the surface of the closed area 14 in the virtual space 10 is determined according to the data-related positions and metaball functions. That is, a position where the sum of the function values of the metaballs associated with the respective data-related positions amounts to a predetermined surface defining value is determined as the position of the surface of a closed area which surrounds one or more of the data-related positions.
  • thumbnail data associated with the data-related position surrounded by the closed area 14 of which surface position is determined as described above is read from the data information database 40 , and a thumbnail image specified by the thumbnail data is placed on the surface of the concerned closed area 14 .
  • the image of the virtual space 10 where the thumbnail image is placed on the surface of the closed area 14 as described above is produced according to the viewpoint position and viewing direction, and then displayed by the display device 20 .
  • the group management unit 46 determines whether or not the surface of any closed area is newly unified with other closed area or whether or not any unification is released.
  • the sum of the function values of all metaballs associated with data-related positions in the virtual space 10 , at respective positions on lines connecting the respective data-related positions surrounded by a certain closed area and those surrounded by another closed area are calculated.
  • the value of the sum is smaller than a surface defining value
  • there is at least one position on any lines, where the value of the sum of the function values of the metaballs is smaller than the surface defining value it is determined that two closed areas associated with the two respective data-related positions selected are yet to be unified.
  • the group management unit 46 calculates the sum of the function values of all metaballs associated with the respective data-related positions in the virtual space 10 on the respective lines connecting one of the data-related positions surrounded by a certain closed area and the respective other data-related positions. When there is no position on any lines, where the value of the sum is smaller than a surface defining value, it is determined that these data-related positions remain still surrounded by a common closed area (the unification is maintained). Meanwhile, when there is at least one position where the sum of the function values of the metaballs is smaller than the surface defining value, it is determined that the unification is released, and that the one data-related position is surrounded by another closed area.
  • a bounding box formed using a polygon
  • a bounding box having a fixed size may be placed for every data-related position so as to surround that data-related position, and whether or not the bounding boxes interfere with each other is determined to make detailed determination on unification as explained only for the bounding boxes interfere with each other.
  • whether or not the bounding boxes interfere with each other may be determined to determine whether or not the closed areas are unified or any unification is released.
  • whether or not the distance between data-related positions is smaller than a predetermined distance may be determined to make detailed determination on unification only when the distance is smaller than the predetermined distance.
  • whether or not the distance between the data-related positions is smaller than a predetermined distance may be determined to determine whether or not the closed areas are unified or unification is released.
  • the group management unit 46 stores the data IDs of data associated with the data-related positions surrounded by the unified closed area in association with a common group ID in the group database 48 . In this manner, when the closed areas are unified, data is grouped accordingly. Also, when unification is released, the data IDs of the data items associated with the respective data-related positions surrounded by the respective separated closed areas are stored in the group database 48 in association with respective different group IDs. When one or each of the two separated closed areas surrounds only one data-related position, the data ID of the data associated with that data-related position is deleted from the group database 48 .
  • a closed area surrounding a data-related position associated with program data is newly unified with a closed area surrounding a data-related position associated with process target data for the program
  • one or all of the process target data items associated with the data-related positions surrounded by the latter closed area is/are processed using the program associated with the data-related position surrounded by the former closed area. That is, whether or not the data-related position associated with the program and that associated with the process target data are surrounded by a common closed area is determined while referring to the column of the attribute 2 in the data information database 40 , and when they are, the program is started with designation of the process target data as an argument thereof.
  • the number of data-related position associated with the process target data surrounded by the unified closed area is determined with reference to the group database 48 , and, when the number is one, the process data is immediately processed using the program. Meanwhile, when the number is two or more, a menu screen image is shown so that the user can designate one or all of the data-related positions before processing the designated data-related position/positions. Alternatively, all or some of the data-related positions selected in advance according to a predetermined criterion may be sequentially processed.
  • the program execution unit 47 instructs the data-related position approaching and separating unit 44 so as to put apart the data-related position associated with the program and that associated with the process target data.
  • the surface defining value change unit 34 changes the above-described surface defining value in response to an operation carried out to the input device 24 . With the above, the size of the closed area 12 is changed.
  • the space image may include a viewer image 17 so that, when the area image 18 is moved to the position of the viewer image 17 by means of a drag and drop operation, an image associated with the area image appears to be shown inside the viewer image 17 .
  • the area image 18 ab associated with two data items is moved to the position of the viewer image 17 by means of a drag and drop operation using the cursor image 16 , as shown in FIG. 12 ( a )
  • the thumbnail images representative of the two respective data items associated with the area image 18 ab may be shown apart from each other in the viewer image 17 , as shown in FIG. 12 ( b ).

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
US12/373,208 2006-07-25 2007-03-13 Information processing device, user interface method, and information storage medium Expired - Fee Related US8108789B2 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2006-202590 2006-07-25
JP2006202590A JP4675855B2 (ja) 2006-07-25 2006-07-25 情報処理装置、ユーザインタフェース方法及びプログラム
PCT/JP2007/054964 WO2008012965A1 (fr) 2006-07-25 2007-03-13 Dispositif de traitement d'informations, procédé d'interface utilisateur et support de stockage d'informations

Publications (2)

Publication Number Publication Date
US20090293008A1 US20090293008A1 (en) 2009-11-26
US8108789B2 true US8108789B2 (en) 2012-01-31

Family

ID=38981281

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/373,208 Expired - Fee Related US8108789B2 (en) 2006-07-25 2007-03-13 Information processing device, user interface method, and information storage medium

Country Status (3)

Country Link
US (1) US8108789B2 (ja)
JP (1) JP4675855B2 (ja)
WO (1) WO2008012965A1 (ja)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100229124A1 (en) * 2009-03-04 2010-09-09 Apple Inc. Graphical representation of elements based on multiple attributes
US20130332876A1 (en) * 2011-03-20 2013-12-12 William J. Johnson System and Method for Summoning User Interface Objects

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
USD609714S1 (en) * 2007-03-22 2010-02-09 Fujifilm Corporation Electronic camera
CN101378432B (zh) * 2007-08-31 2012-05-30 鹏智科技(深圳)有限公司 信息显示装置及方法
JP5171386B2 (ja) 2008-05-19 2013-03-27 キヤノン株式会社 コンテンツ管理装置、コンテンツ管理方法、プログラム及び記録媒体
KR101592298B1 (ko) * 2008-12-01 2016-02-05 엘지전자 주식회사 이동 단말기 및 이동 단말기의 유저 인터페이스 방법
DE202009018704U1 (de) 2008-12-01 2012-11-15 Lg Electronics Inc. Mobiles Endgerät
KR101854141B1 (ko) * 2009-01-19 2018-06-14 삼성전자주식회사 디스플레이 정보 제어 장치 및 방법
KR101663474B1 (ko) 2009-10-13 2016-10-10 삼성전자주식회사 휴대단말기, 휴대단말기의 바탕화면 표시 방법 및 저장 매체
KR101701492B1 (ko) * 2009-10-16 2017-02-14 삼성전자주식회사 데이터 표시 방법 및 그를 수행하는 단말기
US10895955B2 (en) 2009-10-13 2021-01-19 Samsung Electronics Co., Ltd. Apparatus and method for grouping and displaying icons on a screen
KR20120012541A (ko) * 2010-08-02 2012-02-10 삼성전자주식회사 터치 디바이스에서 폴더 운용 방법 및 장치
JP5831312B2 (ja) * 2012-03-15 2015-12-09 カシオ計算機株式会社 漢字表示装置およびプログラム
JP5566447B2 (ja) * 2012-12-26 2014-08-06 キヤノン株式会社 コンテンツ管理装置、コンテンツ管理装置の制御方法、プログラム及び記録媒体
JP6034878B2 (ja) * 2012-12-27 2016-11-30 グリー株式会社 オブジェクト選択方法、プログラムを記憶する記憶媒体及び情報処理装置
JP6188370B2 (ja) 2013-03-25 2017-08-30 インターナショナル・ビジネス・マシーンズ・コーポレーションＩｎｔｅｒｎａｔｉｏｎａｌ Ｂｕｓｉｎｅｓｓ Ｍａｃｈｉｎｅｓ Ｃｏｒｐｏｒａｔｉｏｎ オブジェクト分類方法、装置及びプログラム。

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040023717A1 (en) * 2002-07-30 2004-02-05 Jumpei Tsuda Program, recording medium, game character rendering method, and game apparatus
US20040021661A1 (en) * 2002-07-30 2004-02-05 Jumpei Tsuda Program, recording medium, rendering method and rendering apparatus
US20050010599A1 (en) * 2003-06-16 2005-01-13 Tomokazu Kake Method and apparatus for presenting information
US6968511B1 (en) * 2002-03-07 2005-11-22 Microsoft Corporation Graphical user interface, data structure and associated method for cluster-based document management
US20060126068A1 (en) * 2003-07-08 2006-06-15 Marine Biological Laboratory Retardance measurement system and method
US20070244870A1 (en) * 2004-06-23 2007-10-18 Franc Telecom Automatic Search for Similarities Between Images, Including a Human Intervention

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6968511B1 (en) * 2002-03-07 2005-11-22 Microsoft Corporation Graphical user interface, data structure and associated method for cluster-based document management
US20040023717A1 (en) * 2002-07-30 2004-02-05 Jumpei Tsuda Program, recording medium, game character rendering method, and game apparatus
US20040021661A1 (en) * 2002-07-30 2004-02-05 Jumpei Tsuda Program, recording medium, rendering method and rendering apparatus
US6894688B2 (en) * 2002-07-30 2005-05-17 Koei Co., Ltd. Program, recording medium, rendering method and rendering apparatus
US7104890B2 (en) * 2002-07-30 2006-09-12 Koei Co., Ltd. Program, recording medium, game character rendering method, and game apparatus
US20050010599A1 (en) * 2003-06-16 2005-01-13 Tomokazu Kake Method and apparatus for presenting information
US7587681B2 (en) * 2003-06-16 2009-09-08 Sony Computer Entertainment Inc. Method and apparatus for presenting information
US20060126068A1 (en) * 2003-07-08 2006-06-15 Marine Biological Laboratory Retardance measurement system and method
US20070244870A1 (en) * 2004-06-23 2007-10-18 Franc Telecom Automatic Search for Similarities Between Images, Including a Human Intervention

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
International Preliminary Report on Patentability for corresponding PCT application PCT/JP2007/054964, Jun. 27, 2009.
International Search Report for corresponding PCT application PCT/JP2007/054964, Apr. 10, 2007.
Nayuko Watanabe, et, al., "Bubble Clusters: Information Management Mechanism Using Spatial Clusters of Icons" The 13th Workshop on Interactive Systems and Software, Japan Society for Software Science and Technology, pp. 75-80, Dec. 7, 2005.
Nayuko Watanabe, Takeo Igarashi, Bubble Clusters : Icon no Kukanteki na Matomari o Riyo shita Joho Kanari Kiko, Dai 13 Kai Workshop on Interactive Systems and Software (WISS 2005) Ronbunshu, ISSN 1341-87OX No. 38, pp. 75 to 80, Dec. 7, 2005.
Office Action for Japanese Application JP-2006-202590, dated Oct. 19, 2010.

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100229124A1 (en) * 2009-03-04 2010-09-09 Apple Inc. Graphical representation of elements based on multiple attributes
US8739051B2 (en) * 2009-03-04 2014-05-27 Apple Inc. Graphical representation of elements based on multiple attributes
US20130332876A1 (en) * 2011-03-20 2013-12-12 William J. Johnson System and Method for Summoning User Interface Objects
US9134880B2 (en) * 2011-03-20 2015-09-15 William J. Johnson System and method for summoning user interface objects

Also Published As

Publication number Publication date
JP2008027397A (ja) 2008-02-07
JP4675855B2 (ja) 2011-04-27
US20090293008A1 (en) 2009-11-26
WO2008012965A1 (fr) 2008-01-31

Similar Documents

Publication Publication Date Title
US8108789B2 (en) Information processing device, user interface method, and information storage medium
US20100257468A1 (en) Method and system for an enhanced interactive visualization environment
US8264488B2 (en) Information processing apparatus, information processing method, and program
US9552129B2 (en) Interactive visual representation of points of interest data
US9465513B2 (en) Visual representation of map navigation history
US7420556B2 (en) Information processing method and information processing apparatus
JP5566632B2 (ja) 情報処理装置、情報処理方法、およびプログラム
US9015633B2 (en) Data management apparatus and method for organizing data elements into multiple categories for display
JP4701124B2 (ja) 情報処理装置、情報処理方法
US20100058213A1 (en) Display controlling apparatus and display controlling method
US9274686B2 (en) Navigation framework for visual analytic displays
KR20060052717A (ko) 가상 데스크 탑, 프로그램 예의 배열을 리콜링하는 방법, 애플리케이션 예를 관리하는 방법 및 애플리케이션을 관리하는 방법
US20120213416A1 (en) Methods and systems for browsing heterogeneous map data
US20150205840A1 (en) Dynamic Data Analytics in Multi-Dimensional Environments
US10712921B2 (en) Authoring a collection of images for an image gallery
US9405446B1 (en) Efficient and interactive presentation of item images
JP5477176B2 (ja) 部品情報閲覧プログラム、部品情報閲覧装置及び部品情報閲覧システム
US8250480B2 (en) Interactive navigation of a dataflow process image
JP4675856B2 (ja) 情報処理装置、ユーザインタフェース方法及びプログラム
TWI514319B (zh) 藉由虛擬物件編輯資料之方法及系統，及相關電腦程式產品
JP2010033184A (ja) 情報処理装置、情報処理方法、およびプログラム
CN117311567A (zh) 基于导航树的对象数据展示方法、装置、电子设备及介质
Mendoza et al. Implementation of a Touch Based Graphical User Interface for Semantic Information System
JP5615654B2 (ja) 情報処理装置、情報処理方法、およびプログラム
JP2004199130A (ja) 情報視覚化方法、装置、プログラム

Legal Events

Date Code Title Description
AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FUJII, TAKAHIRO;NAKAYAMA, RYUJI;KATO, HIROKI;REEL/FRAME:022251/0205;SIGNING DATES FROM 20090129 TO 20090130

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:FUJII, TAKAHIRO;NAKAYAMA, RYUJI;KATO, HIROKI;SIGNING DATES FROM 20090129 TO 20090130;REEL/FRAME:022251/0205

ZAAA Notice of allowance and fees due

Free format text: ORIGINAL CODE: NOA

ZAAB Notice of allowance mailed

Free format text: ORIGINAL CODE: MN/=.

AS Assignment

Owner name: SONY NETWORK ENTERTAINMENT PLATFORM INC., JAPAN

Free format text: CHANGE OF NAME;ASSIGNOR:SONY COMPUTER ENTERTAINMENT INC.;REEL/FRAME:027448/0895

Effective date: 20100401

AS Assignment

Owner name: SONY COMPUTER ENTERTAINMENT INC., JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SONY NETWORK ENTERTAINMENT PLATFORM INC.;REEL/FRAME:027449/0469

Effective date: 20100401

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: DROPBOX INC, CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:SONY ENTERTAINNMENT INC;REEL/FRAME:035532/0507

Effective date: 20140401

FPAY Fee payment

Year of fee payment: 4

AS Assignment

Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, NE

Free format text: SECURITY INTEREST;ASSIGNOR:DROPBOX, INC.;REEL/FRAME:042254/0001

Effective date: 20170403

Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, NEW YORK

Free format text: SECURITY INTEREST;ASSIGNOR:DROPBOX, INC.;REEL/FRAME:042254/0001

Effective date: 20170403

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 8

AS Assignment

Owner name: JPMORGAN CHASE BANK, N.A., AS COLLATERAL AGENT, NEW YORK

Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:DROPBOX, INC.;REEL/FRAME:055670/0219

Effective date: 20210305

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20240131