US20230325073A1 - Information processing apparatus, information processing method, and program - Google Patents
Information processing apparatus, information processing method, and program Download PDFInfo
- Publication number
- US20230325073A1 US20230325073A1 US18/204,706 US202318204706A US2023325073A1 US 20230325073 A1 US20230325073 A1 US 20230325073A1 US 202318204706 A US202318204706 A US 202318204706A US 2023325073 A1 US2023325073 A1 US 2023325073A1
- Authority
- US
- United States
- Prior art keywords
- state
- layout
- information processing
- processing apparatus
- operation input
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 62
- 238000003672 processing method Methods 0.000 title claims description 7
- 238000001514 detection method Methods 0.000 claims abstract description 38
- 230000008859 change Effects 0.000 claims description 93
- 230000033001 locomotion Effects 0.000 claims description 50
- 238000012545 processing Methods 0.000 description 40
- 238000010586 diagram Methods 0.000 description 35
- 230000003993 interaction Effects 0.000 description 21
- 230000001960 triggered effect Effects 0.000 description 12
- 238000004891 communication Methods 0.000 description 11
- 230000007704 transition Effects 0.000 description 9
- 230000006870 function Effects 0.000 description 8
- 238000000034 method Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000012217 deletion Methods 0.000 description 1
- 230000037430 deletion Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000002441 reversible effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0485—Scrolling or panning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/0486—Drag-and-drop
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/80—2D [Two Dimensional] animation, e.g. using sprites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/044—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by capacitive means
Definitions
- the present invention relates to an information processing apparatus, an information processing method, and a program, and more particularly to an information processing apparatus including a display section and a position detection sensor such as a touch panel, an information processing method, and a program.
- Pieces of data are grouped by content type and managed.
- the pieces of data are managed in a hierarchical structure of directories by an OS (Operating System) of a computer.
- the pieces of data classified into each directory is displayed in a form of a table within a window 11 using a GUI (Graphical User Interface), as shown in FIG. 7 for example, and hence, the user can intuitively operate the data.
- GUI Graphic User Interface
- GUI for changing the layout there is exemplified the following GUI as shown in FIG. 7 , in which each of the items such as the name, the size, the type, and the updated date of the pieces of data displayed in the title section 12 of the information displayed in the table is clicked by a pointer, and the pieces of data are sorted in terms of the selected item.
- a tab or the like below a music list, which is displayed in a media player that reproduces music data and the like, is also an example of the GUI's for changing layout.
- JP 2009-301579A a technique of realizing a seamless user interface by unifying a time-series direction, when displaying a representative image of a content file on a calendar having respective time-axial ranges of a year, months, and dates.
- an information processing apparatus which includes a display section which displays, as a first layout state, an object group including a plurality of objects arranged in a first direction, a detection section which detects an operation input that is input to the display section, and a control section which, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, changes the first layout state into a second layout state in which the respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.
- control section may move the respective objects constituting the object group in the second direction in a manner that an arrangement of the selected object group is misaligned.
- control section may determine a movement distance in the second direction of the respective objects constituting the object group based on information of variables which varies depending on a motion of the operation input.
- control section may return a display of the respective objects of the object group which have been moved in the second direction to the first layout state when the information of variables at a point of stopping the operation input is less than a predetermined threshold.
- control section may allow the display of the respective objects of the object group to become the second layout state when the information of variables at a point of stopping the operation input is equal to or more than the predetermined threshold.
- the information of variables can represent, for example, a movement distance or a movement speed of the operation input in the second direction.
- control section may move the respective objects constituting the object group in the second direction in a manner that the arrangement of the selected object group is misaligned when a predetermined state change condition is satisfied, and the control section may cause the object group displayed in the first layout state to be scrolled in the second direction when the state change condition is not satisfied.
- the state change condition may be that the respective objects constituting the object group are moved in the second direction in a manner that the arrangement of the selected object group is misaligned, by inputting at least once an operation input in the first direction.
- the state change condition may be that a motion of an operation input is not detected for a predetermined time period or longer in the first layout state.
- the control section may cause the second layout state to be displayed regarding, as a reference point, an object among the plurality of objects, which is displayed at an initial contact position which was touched first when there was the operation input in the first layout state.
- control section may return a display of the display section from the second layout state to the first layout state.
- an information processing method which includes the steps of detecting, by a detection section, an operation input that is input to a display section in which an object group including a plurality of objects arranged in a first direction is displayed as a first layout state, and changing, by a control section, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, the first layout state into a second layout state in which the respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.
- a program for causing a computer to function as an information processing apparatus which includes a detection control section which causes a detection section to detect an operation input that is input to a display section in which an object group including a plurality of objects arranged in a first direction is displayed as a first layout state, and a layout control section which, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, changes the first layout state into a second layout state in which the respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.
- a computer program is stored in a storage device included in a computer, and causes the computer to function as the information processing apparatus by being read and executed by a CPU included in the computer. Further, there is also provided a computer-readable recording medium in which the computer program is recorded.
- the recording medium is, for example, a magnetic disk or an optical disk.
- the information processing apparatus the information processing method, and the program, which are capable of naturally changing a layout by an interaction with a user.
- FIG. 1 is an explanatory diagram showing how an interaction provided by an information processing apparatus according to a first embodiment of the present invention goes on when selecting content in a media player;
- FIG. 2 is a block diagram showing a functional configuration of the information processing apparatus according to the embodiment
- FIG. 3 is a state transition diagram showing layout change processing performed by the information processing apparatus according to the embodiment.
- FIG. 4 is an explanatory diagram showing how an interaction goes on when selecting content according to a second embodiment of the present invention.
- FIG. 5 is an explanatory diagram showing how an interaction goes on when selecting content according to a third embodiment of the present invention.
- FIG. 6 is a block diagram showing an example of a hardware configuration of an information processing apparatus.
- FIG. 7 is an explanatory diagram showing an example of a GUI of the past for changing a layout.
- FIG. 1 is an explanatory diagram showing how an interaction goes on when selecting content in a media player which is provided by the information processing apparatus according to the present embodiment.
- the information processing apparatus is an apparatus which is provided to a device having an input display section including a touch panel and a display section.
- the information processing apparatus provides an operation system into which the following are integrated: navigation indicating to a user that a layout can be changed within a data group; and a display layout change of the data group.
- the information processing apparatus is applied to a media player which reproduces music, an image, video, and the like, for example.
- a display section 114 of the media player As shown in FIG. 1 (left diagram), there are displayed in lists, in rows (x-directions), thumbnail icons of pieces of content in different groups (A to E), respectively, such as music recently listened to and music recommended by a service.
- the group A includes thumbnail icons of pieces of content A 1 to A 4 and the like. Such a state in which the pieces of content in respective groups can be visually confirmed is referred to as “before layout change”.
- a thumbnail icon is an example of an object displayed in the display section 114 .
- an icon group displayed at a contact position is scrolled in the horizontal direction as shown in FIG. 1 (second diagram from the left).
- the information processing apparatus displays the icon group in a manner that individual icons in the icon group are misaligned in accordance with a minute movement distance of the finger in the vertical direction. In this way, a state indicating that the layout change can be triggered is referred to as “navigation state”.
- the user who realizes that the layout change can be triggered when the icon group is misaligned, drags the finger in the vertical direction as shown in FIG. 1 (third diagram from the left), and can trigger the layout change of the icon group in the row displayed at the contact position of the finger.
- the information processing apparatus triggers an animation that the icons are further misaligned from those in the navigation state and the layout of the icons is changed in the vertical direction.
- the state is referred to as “intermediate state”.
- the information processing apparatus realizes a reversible interaction by performing display processing for changing the layout or display processing for not changing the layout by a motion of the finger.
- FIG. 1 right diagram
- pieces of content A 1 to A 6 of the group A are displayed in tandem, and more detailed information such as an album title and an artist name of each of the pieces of content A 1 to A 6 can be provided to the user.
- the navigation indicates to the user that the layout change can be triggered, and, by gradually changing the display, it is possible to naturally cause the user to recognize the interaction for changing the layout. Accordingly, it becomes unnecessary to cause the screen to display the GUI button or the like for triggering the layout switching, and it becomes easier to understand the relationship with the data. Further, the user naturally notices the interaction for changing the layout while operating a data group and performs the operation, and hence, it is possible to remind the user of the relativity that the user is “looking at the same data group from another viewpoint”.
- FIG. 2 is a block diagram showing the functional configuration of the information processing apparatus 100 according to the present embodiment.
- the information processing apparatus 100 includes, as shown in FIG. 2 , an input display section 110 having a contact detection section 112 and a display section 114 , an operation control section 120 , a storage section 130 , and a display control section 140 .
- the input display section 110 is a functional section for displaying information and also inputting information.
- the contact detection section 112 of the input display section 110 there can be used an electrostatic touch panel, for example.
- the touch panel is provided in a stacking manner on a display surface of the display section 114 . That is, although it is the surface of the touch panel that an operating object touches, such a state may be described hereinafter as that the operating object touches the display surface of the display section 114 .
- the contact detection section 112 detects a capacitance value which varies depending on whether or not the operating object such as a finger touches the display surface of the display section 114 . Since the capacitance detected by the contact detection section 112 increases when the operating object touches the display surface, it can be determined that, when the capacitance value detected by the contact detection section 112 exceeds a predetermined value, the operating object touches the display surface. The contact detection section 112 outputs the detected capacitance value to the operation control section 120 as a detection result. Further, the display section 114 is an output device for displaying information, and displays information in accordance with the processing executed by the display control section 140 .
- the operation control section 120 specifies a motion of the operating object (that is, an operation input which is input by the operating object) based on the detection result of the contact detection section 112 , and performs display processing corresponding thereto.
- the operation control section 120 determines execution of the navigation state, the intermediate state, and the layout change processing based on whether or not the operating object touches the display surface and a contact position at the time of the contact, and notifies the display control section 140 of the determination.
- the storage section 130 stores information necessary for the navigation state, the intermediate state, and the layout change processing.
- the information stored in the storage section 130 there can be exemplified a state change condition for the state to be shifted to the navigation state or the intermediate state (predetermined time at which a scrollable state shifts to the navigation state, a first threshold, a second threshold, etc.), and the like.
- Those pieces of information may be stored in the storage section 130 in advance, or may be set by the user and recorded in the storage section 130 .
- the display control section 140 performs processing of changing the display of the display section 114 based on an instruction from the operation control section 120 .
- the display control section 140 changes display information based on the display state that is determined in accordance with the contact position and the motion of the operating object, which the display control section 140 is notified of by the operation control section 120 , and causes the display section 114 to display the changed display information.
- Such display control performed by the display control section 140 can be conducted by an existing technique.
- the layout change processing performed by the information processing apparatus 100 according to the present embodiment is executed by the state transition diagram shown in FIG. 3 .
- the state transition diagram of FIG. 3 corresponds to the interaction shown in FIG. 1 , and hereinafter, descriptions will be made assuming that the navigation is started by dragging an operating object in the lateral direction (x-direction) and that the layout change is triggered by dragging the operation object in the vertical direction (y-direction).
- a finger is used as the operating object here, and there may also be used a touch pen and the like.
- the following variables and constants are defined as below.
- a state where the finger is not in contact with the touch panel is referred to as “initial state” (S 0 ).
- the operation control section 120 stores the coordinate in y-direction at the instant at which finger is touched in a memory (not shown) as an initial position y0 based on the detection result of the contact detection section 112 (T 1 ). Note that the initial position y0 is reset every time the finger is released from the touch panel. After that, the state becomes a scrollable state (S 1 ). When it is detected by the detection result of the contact detection section 112 that the finger is released from the touch panel in the scrollable state (T 2 ), the state returns to the initial state (S 0 ).
- a display content of the display section 114 can be scrolled in accordance with a movement direction of the finger (T 3 ).
- the icon group displayed at the contact position of the finger is scrolled in the lateral direction in accordance with a movement distance of the finger
- an icon group is scrolled for each group in the vertical direction in accordance with a movement distance of the finger.
- the operation control section 120 displays an arranged icon group in a manner that the icon group is slightly misaligned, and determines the transition to the navigation state (S 2 ).
- the navigation state is a state where the movement distance of the finger from the initial position y0 in the vertical direction is smaller than the first threshold TH_A, that is, a state where
- the icon group is scrolled in the lateral direction in accordance with the movement distance of the finger in the lateral direction, and a navigation indicating that the layout can be changed is performed (T 5 ).
- the operation control section 120 displays icons arranged in the lateral direction (x-direction), which are displayed at the position with which the finger is in contact, in a manner that each of the icons is slightly moved in the vertical direction (y-direction).
- the operation control section 120 can cause the icon to slightly move in proportion to the movement distance of the finger from the initial position y0 in the vertical direction, and can also cause a display angle to be calculated.
- the predetermined operation such as long pressing operation is performed in the navigation, the state may return to the scrollable state (S 1 ).
- the state shifts to the intermediate state, in which processing up to the point at which the layout change is completed is performed.
- S 3 an intermediate state 1
- S 5 capable of shifting to the after-layout-change state.
- the intermediate state 1 (S 3 ) is a state where the movement distance of the finger in the vertical direction is equal to or more than the first threshold TH_A and less than the second threshold TH_B, that is, a state where TH_A ⁇
- the operation control section 120 displays a state of the layout change in progress (T 8 ) by moving the icon group in accordance with the movement distance of the finger in the vertical direction.
- T 8 the degree to which the icons are misaligned in the vertical direction becomes larger than that in the case of the navigation state, the user can recognize that the processing for the layout change is being performed.
- the state shifts from the intermediate state (S 3 ) to the navigation state (S 2 ).
- the operation control section 120 decides the state transition from the intermediate state 1 (S 3 ) to the intermediate state 2 (S 5 ).
- the icon group is moved in the vertical direction in accordance with the movement distance of the finger in the vertical direction and displays a state of the layout change in progress (T 14 ), in the same manner as the intermediate state 1 (S 3 ).
- the processing performed in the intermediate state 2 (S 5 ) when the finger is released from the touch panel differs from that in the case of the intermediate state 1 (S 3 ). That is, when the finger is released from the touch panel (T 15 ) in the intermediate state 2 (S 5 ), the icon group moved along with the movement of the finger in the vertical direction is kept moving in the vertical direction, and a layout change animation showing the completion of the layout change is displayed (S 6 ).
- the animation display processing is terminated (T 16 ), and the state change processing shown in FIG. 3 is terminated.
- the processing for returning to the state shown in the left diagram of FIG. 1 can be executed by pressing a “Home” button displayed in the right diagram of FIG. 1 , for example.
- the processing for returning to the layout before the change may be associated with operation of dragging the finger in the lateral direction after the layout change, and, when the drag operation in the lateral direction is detected, the processing for causing the layout to return to the state shown in the left diagram of FIG. 1 may be executed.
- the operation control section 120 returns to the intermediate state 2 (S 5 ), and again displays the icon group in a manner that the icon group moves in the vertical direction in accordance with the movement distance of the finger in the vertical direction.
- content displayed at the top (for example, content A 1 in the left diagram of FIG. 1 ) in the display state before layout change may be displayed at the top in the same manner, for example.
- content displayed at the initial position y0 may be displayed at the top in the display state after layout change. In this way, the content that the user wants to display on the display section 114 after the layout change can be reliably displayed on the display section 114 .
- the layout change processing performed by the information processing apparatus 100 has been described. According to the present embodiment, it is possible to navigate the user by the icon group that the layout of the icon group can be changed by the operation that is easily distinguished by the user, such as horizontal dragging and vertical dragging, and to cause the user to perform the layout change of the icon group.
- the information processing apparatus 100 gradually causes the layout change to take place in accordance with continuous operation of the user, and allows the user to understand in what way the layout change takes place in a stage before the operation is completed. In this way, the user can naturally recognize the interaction for changing the layout during the operation, and hence, the operability thereof can be enhanced.
- the user can cancel the layout change from being triggered when the user ceases the operation by releasing the finger from the touch panel before the operation amount becomes equal to or more than a predetermined threshold, for example.
- a predetermined threshold for example.
- the layout change is triggered even when the user ceases the operation thereafter. In this way, by allowing the interaction to have reversibility, whether or not to execute the layout change can be easily determined during the operation.
- the layout change processing as in the present embodiment, it becomes unnecessary to place the GUI button or the like on the screen for switching the layout which has been used in the past, the display region can be effectively used, and an operation burden imposed on the user can also be reduced.
- FIG. 4 is an explanatory diagram showing how an interaction goes on when selecting content according to the present embodiment.
- pieces of content that have semantically strong relation with each other are arranged in a column.
- Such a layout may be used for, for example, a photograph browser in which a photograph group taken on the same date is arranged in the vertical direction (y-direction), and the photograph groups are arranged in the lateral direction (x-direction) by date.
- the pieces of content A 1 to E 1 , A 2 to E 2 , A 3 to E 3 , and so on each represent a photograph group taken on the same date.
- the layout change of the thumbnail icon group of the pieces of content, which are arranged by date can be executed in the same manner as the layout change processing of the first embodiment shown in FIG. 3 performed by the information processing apparatus 100 having functions shown in FIG. 2 .
- descriptions will be made on the processing in the case of applying the layout change processing of the first embodiment to the layout shown in FIG. 4 , and the description of the device configuration identical to the first embodiment and specific processing contents will be omitted.
- the state shown in the left diagram of FIG. 4 represents a state before layout change.
- this state when the user places the finger on a thumbnail icon of content displayed on the display section 114 , it is detected by the contact detection section 112 that the finger touches the display surface. Based on the detection result, the operation control section 120 determines a transition to a scroll state.
- the circle drawn in a dashed line shown in FIG. 4 represents a contact position of the finger.
- FIG. 4 second diagram from the left
- the entire icon groups displayed on the display section 114 are moved in the lateral direction (x-direction) and in the vertical direction (y-direction) based on the movement direction of the finger.
- the operation control section 120 determines the transition to a navigation state which indicates that the layout of the icon group can be changed.
- a navigation state when the finger is moved in the vertical direction, which is perpendicular to the direction in which the icon group is arranged (lateral direction), a layout change is triggered which is for displaying only a detailed list of the icon group (for example, in the case of the photograph browser, a photograph group taken on a specific date) arranged in the vertical direction at the contact position of the finger, as shown in FIG. 4 (third diagram from the left).
- an icon group (also referred to as “another-icon group”) other than the icon group of which the detailed list is displayed is moved to the left or right so as to disappear from the display region of the display section 114 .
- the operation control section 120 starts displaying descriptions related to respective pieces of content B 4 to F 4 of the icon group arranged in the vertical direction at the contact position of the finger on the display section 114 .
- the operation control section 120 moves the another-icon group to the left or right in accordance with the movement distance of the finger in the vertical direction.
- the state shifts from the navigation state to the intermediate state towards the layout change.
- the processing which is performed when the user stops the operation differs in accordance with the movement distance of the finger in the vertical direction.
- the information processing apparatus 100 is capable of changing the layout, even in the case of the layout shown in FIG. 4 , in the same manner as in the first embodiment in accordance with the processing of FIG. 3 .
- the user can gradually understand the meaning of the layout change during the interaction. Further, owing to the reversibility of the interaction, the layout change can also be easily cancelled. In addition, it becomes unnecessary to place the GUI button or the like on the screen for switching the layout which has been used in the past, and hence, the display region can be effectively used and an operation burden imposed on the user can also be reduced.
- FIG. 5 is an explanatory diagram showing how an interaction goes on when selecting content according to the present embodiment.
- pieces of content that have semantically strong relation with each other are displayed in a stacking manner in the depth direction of a paper plane of FIG. 5 .
- the following usage in a photograph browser, photographs are grouped by shooting date and the photographs are displayed in a stacking manner.
- the pieces of content A 1 , B 1 , C 1 , and so on each represent a photograph group taken on the same date.
- the layout change of the thumbnail icon group of the pieces of content, which are arranged by date can be executed in the same manner as the layout change processing of the first embodiment shown in FIG. 3 performed by the information processing apparatus 100 having functions shown in FIG. 2 .
- descriptions will be made on the processing in the case of applying the layout change processing of the first embodiment to the layout shown in FIG. 5 , and the description of the device configuration identical to the first embodiment and specific processing contents will be omitted.
- the state shown in the left diagram of FIG. 5 represents a state before layout change.
- this state when the user places finger on a thumbnail icon of content displayed on the display section 114 , it is detected by the contact detection section 112 that the finger touches the display surface. Based on the detection result, the operation control section 120 determines a transition to a scroll state.
- the circle drawn in a dashed line shown in FIG. 5 also represents a contact position of the finger.
- FIG. 5 second diagram from the left
- the entire icon groups displayed on the display section 114 are moved in the lateral direction (x-direction) and in the vertical direction (y-direction) based on the movement direction of the finger.
- the operation control section 120 determines the transition to a navigation state which indicates that the layout of the icon group can be changed.
- the navigation state when the finger is moved in the vertical direction (y-direction), the icon group in a pile displayed at the contact position of the finger is displayed in a manner to slide in the vertical direction in accordance with the movement distance of the finger, as shown in FIG. 5 (third diagram from the left). In this way, the information processing apparatus 100 indicates to the user that the layout can be changed.
- an icon group (also referred to as “another-icon group”) other than the icon group displayed at the contact position of the finger is moved to the left or right so as to disappear from the display region of the display section 114 .
- the operation control section 120 starts displaying descriptions related to respective pieces of content (H 1 to Hn; n represents an integer) of the icon group displayed at the contact position of the finger on the display section 114 .
- the operation control section 120 moves the another-icon group to the left or right in accordance with the movement distance of the finger in the vertical direction.
- the state shifts from the navigation state to the intermediate state towards the layout change.
- the processing which is performed when the user stops the operation differs in accordance with the movement distance of the finger in the vertical direction.
- the layout change is continued.
- the layout change is completed, as shown in the right diagram of FIG. 5 , descriptions of the pieces of content associated with the icon groups H 1 to H 5 , respectively, come to be displayed on the display region of the display section 114 .
- the information processing apparatus 100 is capable of changing the layout, even in the case of the layout shown in FIG. 5 , in the same manner as in the first embodiment in accordance with the processing of FIG. 3 .
- the user can gradually understand the meaning of the layout change during the interaction. Further, owing to the reversibility of the interaction, the layout change can also be easily cancelled. In addition, it becomes unnecessary to place the GUI button or the like on the screen for switching the layout which has been used in the past, and hence, the display region can be effectively used and an operation burden imposed on the user can also be reduced.
- a part of processing performed by the information processing apparatus 100 according to the present embodiment may be executed by hardware or may be executed by software.
- the information processing apparatus 100 may be configured as a computer shown in FIG. 6 .
- FIG. 6 an example of a hardware configuration of the information processing apparatus 100 according to the present embodiment will be described.
- the information processing apparatus 100 can be realized by, as described above, a processing device such as a computer.
- the information processing apparatus 100 includes a CPU (Central Processing Unit) 101 , a ROM (Read Only Memory) 102 , a RAM (Random Access Memory) 103 , and a host bus 104 a .
- the information processing apparatus 100 includes a bridge 104 , an external bus 104 b , an interface 105 , an input device 106 , an output device 107 , a storage device (HDD) 108 , a drive 109 , a connection port 111 , and a communication device 113 .
- a processing device such as a computer.
- the information processing apparatus 100 includes a CPU (Central Processing Unit) 101 , a ROM (Read Only Memory) 102 , a RAM (Random Access Memory) 103 , and a host bus 104 a .
- the information processing apparatus 100 includes a bridge 104 , an external bus 104 b ,
- the CPU 101 functions as an arithmetic processing unit and a control unit, and controls entire operation of the information processing apparatus 100 in accordance with various programs. Further, the CPU 101 may be a microprocessor.
- the ROM 102 stores a program, a calculation parameter, and the like used by the CPU 101 .
- the RAM 103 temporarily stores a program used in execution of the CPU 101 , a parameter varying as appropriate during the execution, and the like. They are connected with each other via the host bus 104 a configured from a CPU bus or the like.
- the host bus 104 a is connected to the external bus 104 b such as a PCI (Peripheral Component Interconnect/Interface) bus via the bridge 104 .
- PCI Peripheral Component Interconnect/Interface
- the input device 106 is configured from, for example, input means for inputting information by a user, such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever, and an input control circuit which generates an input signal based on the input by the user and outputs the generated input signal to the CPU 101 .
- the output device 107 includes, for example, display devices such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp, and an audio output device such as a speaker.
- LCD liquid crystal display
- OLED Organic Light Emitting Diode
- the storage device 108 is an example of a storage section of the information processing apparatus 100 , and is a device for storing data.
- the storage device 108 may include a storage medium, a recording device for recording data in the storage medium, a reading device for reading out the data from the storage medium, and a deletion device for deleting the data recorded in the storage medium.
- the storage device 108 is configured from an HDD (Hard Disk Drive), for example.
- the storage device 108 drives a hard disk and stores a program and various data executed by the CPU 101 .
- the drive 109 is a reader/writer for the storage medium and is built in or externally attached to the information processing apparatus 100 .
- the drive 109 reads out information recorded in a removable recording medium which is mounted thereto, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to the RAM 103 .
- the connection port 111 is an interface connected to an external device, and is a connection port with an external device capable of transmitting data by a USB (Universal Serial Bus), for example.
- the communication device 113 is a communication interface which is configured from, for example, a communication device for establishing a connection with a communication network 10 .
- the communication device 113 may be a wireless LAN (Local Area Network) enabled communication device, a wireless USB enabled communication device, or a wired communication device for performing wired communication.
- the state in the layout change is determined based on the movement distance of the operating object, but the present invention is not limited thereto.
- the state may be determined depending on movement speed of the operating object.
- the state change condition from the scrollable state to the navigation state is to perform the long pressing operation, but the present invention is not limited thereto.
- the state change condition may be that there has already been a case, at least once, where the icons included in the icon group are displayed in a manner to be slightly misaligned by moving the finger in the lateral direction.
- the operation control section 120 causes the icons to be spread in the vertical direction when the finger is moved in the vertical direction.
- the display is caused to be scrolled in the vertical direction.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
- This application is a continuation of U.S. patent application Ser. No. 16/449,739 (filed on Jun. 24, 2019), which is a continuation of U.S. patent application Ser. No. 15/185,963 (filed on Jun. 17, 2016 and issued as U.S. Pat. No. 10,379,736 on Aug. 13, 2019), which is a continuation of U.S. patent application Ser. No. 13/076,063 (filed on Mar. 30, 2011 and issued as U.S. Pat. No. 9,383,898 on Jul. 5, 2016), which claims priority to Japanese Patent Application No. 2010-090289 (filed on Apr. 9, 2010), which are all hereby incorporated in their entirety.
- The present invention relates to an information processing apparatus, an information processing method, and a program, and more particularly to an information processing apparatus including a display section and a position detection sensor such as a touch panel, an information processing method, and a program.
- It is generally performed that various pieces of information are operated on an information terminal, the information ranging from document data, drawing data, and the like, to pieces of content such as an image, video, and music that are distributed from a server. With the enhancement of technology and the developments in communication environment, the kinds of data handled by a user have become diversified, and therefore, it is important to systematically manage data. In general, pieces of data are grouped by content type and managed. For example, the pieces of data are managed in a hierarchical structure of directories by an OS (Operating System) of a computer. The pieces of data classified into each directory is displayed in a form of a table within a
window 11 using a GUI (Graphical User Interface), as shown inFIG. 7 for example, and hence, the user can intuitively operate the data. - In such a data group, the way of showing the data (layout) has a great influence on the operability when searching for desired data. As a GUI for changing the layout, there is exemplified the following GUI as shown in
FIG. 7 , in which each of the items such as the name, the size, the type, and the updated date of the pieces of data displayed in thetitle section 12 of the information displayed in the table is clicked by a pointer, and the pieces of data are sorted in terms of the selected item. A tab or the like below a music list, which is displayed in a media player that reproduces music data and the like, is also an example of the GUI's for changing layout. Further, there is disclosed, in JP 2009-301579A, a technique of realizing a seamless user interface by unifying a time-series direction, when displaying a representative image of a content file on a calendar having respective time-axial ranges of a year, months, and dates. - However, in the layout changing technique of the past described above, since the layout change was triggered by a GUI button or the like other than the data group, there was an issue that it was difficult to understand the relationship with the data. Further, since the layout of the data group is suddenly switched when the layout change is triggered, there is also an issue that it is difficult to remind a user of a relativity that the user is “looking at the same data group from another viewpoint”.
- In light of the foregoing, it is desirable to provide an information processing apparatus, an information processing method, and a program, which are novel and improved, and which are capable of naturally changing a layout by an interaction with the user.
- According to an embodiment of the present invention, there is provided an information processing apparatus which includes a display section which displays, as a first layout state, an object group including a plurality of objects arranged in a first direction, a detection section which detects an operation input that is input to the display section, and a control section which, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, changes the first layout state into a second layout state in which the respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.
- When the operation input in the second direction is detected by the detection section in the first layout state, the control section may move the respective objects constituting the object group in the second direction in a manner that an arrangement of the selected object group is misaligned.
- Further, the control section may determine a movement distance in the second direction of the respective objects constituting the object group based on information of variables which varies depending on a motion of the operation input.
- When the operation input is stopped, the control section may return a display of the respective objects of the object group which have been moved in the second direction to the first layout state when the information of variables at a point of stopping the operation input is less than a predetermined threshold. On the other hand, the control section may allow the display of the respective objects of the object group to become the second layout state when the information of variables at a point of stopping the operation input is equal to or more than the predetermined threshold.
- The information of variables can represent, for example, a movement distance or a movement speed of the operation input in the second direction.
- Further, the control section may move the respective objects constituting the object group in the second direction in a manner that the arrangement of the selected object group is misaligned when a predetermined state change condition is satisfied, and the control section may cause the object group displayed in the first layout state to be scrolled in the second direction when the state change condition is not satisfied.
- Here, the state change condition may be that the respective objects constituting the object group are moved in the second direction in a manner that the arrangement of the selected object group is misaligned, by inputting at least once an operation input in the first direction.
- Alternatively, the state change condition may be that a motion of an operation input is not detected for a predetermined time period or longer in the first layout state.
- The control section may cause the second layout state to be displayed regarding, as a reference point, an object among the plurality of objects, which is displayed at an initial contact position which was touched first when there was the operation input in the first layout state.
- When an operation input in the first direction is detected by the detection section after a display is changed to the second layout state, the control section may return a display of the display section from the second layout state to the first layout state.
- Further, according to another embodiment of the present invention, there is provided an information processing method which includes the steps of detecting, by a detection section, an operation input that is input to a display section in which an object group including a plurality of objects arranged in a first direction is displayed as a first layout state, and changing, by a control section, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, the first layout state into a second layout state in which the respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.
- In addition, according to another embodiment of the present invention, there is provided a program for causing a computer to function as an information processing apparatus which includes a detection control section which causes a detection section to detect an operation input that is input to a display section in which an object group including a plurality of objects arranged in a first direction is displayed as a first layout state, and a layout control section which, when the detection section detects an operation input in a second direction that is perpendicular to the first direction, changes the first layout state into a second layout state in which the respective objects constituting the object group which has been selected are spread and pieces of information associated with the plurality of objects, respectively, are displayed.
- A computer program is stored in a storage device included in a computer, and causes the computer to function as the information processing apparatus by being read and executed by a CPU included in the computer. Further, there is also provided a computer-readable recording medium in which the computer program is recorded. The recording medium is, for example, a magnetic disk or an optical disk.
- According to the embodiments of the present invention described above, there can be provided the information processing apparatus, the information processing method, and the program, which are capable of naturally changing a layout by an interaction with a user.
-
FIG. 1 is an explanatory diagram showing how an interaction provided by an information processing apparatus according to a first embodiment of the present invention goes on when selecting content in a media player; -
FIG. 2 is a block diagram showing a functional configuration of the information processing apparatus according to the embodiment; -
FIG. 3 is a state transition diagram showing layout change processing performed by the information processing apparatus according to the embodiment; -
FIG. 4 is an explanatory diagram showing how an interaction goes on when selecting content according to a second embodiment of the present invention; -
FIG. 5 is an explanatory diagram showing how an interaction goes on when selecting content according to a third embodiment of the present invention; -
FIG. 6 is a block diagram showing an example of a hardware configuration of an information processing apparatus; and -
FIG. 7 is an explanatory diagram showing an example of a GUI of the past for changing a layout. - Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the appended drawings. Note that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation of these structural elements is omitted.
- Note that the description will be given in the following order.
-
- 1. First embodiment (case of arranging pieces of content that have semantically strong relation with each other in a row)
- 2. Second embodiment (case of arranging pieces of content that have semantically strong relation with each other in a column)
- 3. Third embodiment (case of arranging, in a stacking manner, pieces of content that have semantically strong relation with each other in a depth direction)
- 4. Example of hardware configuration
- [Interaction when Selecting Content in Media Player]
- First, with reference to
FIG. 1 , there will be described an interaction performed by an information processing apparatus according to a first embodiment of the present invention when selecting content in media player. Note thatFIG. 1 is an explanatory diagram showing how an interaction goes on when selecting content in a media player which is provided by the information processing apparatus according to the present embodiment. - The information processing apparatus according to the present embodiment is an apparatus which is provided to a device having an input display section including a touch panel and a display section. The information processing apparatus provides an operation system into which the following are integrated: navigation indicating to a user that a layout can be changed within a data group; and a display layout change of the data group.
- Let us assume that the information processing apparatus is applied to a media player which reproduces music, an image, video, and the like, for example. In a
display section 114 of the media player, as shown inFIG. 1 (left diagram), there are displayed in lists, in rows (x-directions), thumbnail icons of pieces of content in different groups (A to E), respectively, such as music recently listened to and music recommended by a service. The group A includes thumbnail icons of pieces of content A1 to A4 and the like. Such a state in which the pieces of content in respective groups can be visually confirmed is referred to as “before layout change”. A thumbnail icon is an example of an object displayed in thedisplay section 114. - When, in a state before layout change, dragging a finger in a horizontal direction (x-direction) while keeping the finger in contact with a touch panel, an icon group displayed at a contact position is scrolled in the horizontal direction as shown in
FIG. 1 (second diagram from the left). In this case, in order to allow the user to recognize that the layout change can be triggered by dragging the finger in a vertical direction (y-direction), the information processing apparatus displays the icon group in a manner that individual icons in the icon group are misaligned in accordance with a minute movement distance of the finger in the vertical direction. In this way, a state indicating that the layout change can be triggered is referred to as “navigation state”. - The user, who realizes that the layout change can be triggered when the icon group is misaligned, drags the finger in the vertical direction as shown in
FIG. 1 (third diagram from the left), and can trigger the layout change of the icon group in the row displayed at the contact position of the finger. At that time, the information processing apparatus triggers an animation that the icons are further misaligned from those in the navigation state and the layout of the icons is changed in the vertical direction. The state is referred to as “intermediate state”. In the intermediate state, the information processing apparatus realizes a reversible interaction by performing display processing for changing the layout or display processing for not changing the layout by a motion of the finger. - Then, when the layout change is completed, there is displayed a list of an icon group. For example, as shown in
FIG. 1 (right diagram), pieces of content A1 to A6 of the group A are displayed in tandem, and more detailed information such as an album title and an artist name of each of the pieces of content A1 to A6 can be provided to the user. - In this way, in the layout change from the left diagram to the right diagram of
FIG. 1 , the navigation indicates to the user that the layout change can be triggered, and, by gradually changing the display, it is possible to naturally cause the user to recognize the interaction for changing the layout. Accordingly, it becomes unnecessary to cause the screen to display the GUI button or the like for triggering the layout switching, and it becomes easier to understand the relationship with the data. Further, the user naturally notices the interaction for changing the layout while operating a data group and performs the operation, and hence, it is possible to remind the user of the relativity that the user is “looking at the same data group from another viewpoint”. - Hereinafter, detailed descriptions will be made on an information processing apparatus which functions for realizing the layout change, and layout change processing using the information processing apparatus.
- [Functional Configuration of Information Processing Apparatus]
- First, based on
FIG. 2 , a functional configuration of aninformation processing apparatus 100 according to the present embodiment will be described. Note thatFIG. 2 is a block diagram showing the functional configuration of theinformation processing apparatus 100 according to the present embodiment. - The
information processing apparatus 100 according to the present embodiment includes, as shown inFIG. 2 , aninput display section 110 having acontact detection section 112 and adisplay section 114, anoperation control section 120, astorage section 130, and adisplay control section 140. - The
input display section 110 is a functional section for displaying information and also inputting information. As for thecontact detection section 112 of theinput display section 110, there can be used an electrostatic touch panel, for example. The touch panel is provided in a stacking manner on a display surface of thedisplay section 114. That is, although it is the surface of the touch panel that an operating object touches, such a state may be described hereinafter as that the operating object touches the display surface of thedisplay section 114. - The
contact detection section 112 detects a capacitance value which varies depending on whether or not the operating object such as a finger touches the display surface of thedisplay section 114. Since the capacitance detected by thecontact detection section 112 increases when the operating object touches the display surface, it can be determined that, when the capacitance value detected by thecontact detection section 112 exceeds a predetermined value, the operating object touches the display surface. Thecontact detection section 112 outputs the detected capacitance value to theoperation control section 120 as a detection result. Further, thedisplay section 114 is an output device for displaying information, and displays information in accordance with the processing executed by thedisplay control section 140. - The
operation control section 120 specifies a motion of the operating object (that is, an operation input which is input by the operating object) based on the detection result of thecontact detection section 112, and performs display processing corresponding thereto. Theoperation control section 120 determines execution of the navigation state, the intermediate state, and the layout change processing based on whether or not the operating object touches the display surface and a contact position at the time of the contact, and notifies thedisplay control section 140 of the determination. - The
storage section 130 stores information necessary for the navigation state, the intermediate state, and the layout change processing. As the information stored in thestorage section 130, there can be exemplified a state change condition for the state to be shifted to the navigation state or the intermediate state (predetermined time at which a scrollable state shifts to the navigation state, a first threshold, a second threshold, etc.), and the like. Those pieces of information may be stored in thestorage section 130 in advance, or may be set by the user and recorded in thestorage section 130. - The
display control section 140 performs processing of changing the display of thedisplay section 114 based on an instruction from theoperation control section 120. Thedisplay control section 140 changes display information based on the display state that is determined in accordance with the contact position and the motion of the operating object, which thedisplay control section 140 is notified of by theoperation control section 120, and causes thedisplay section 114 to display the changed display information. Such display control performed by thedisplay control section 140 can be conducted by an existing technique. - [Layout Change Processing]
- The layout change processing performed by the
information processing apparatus 100 according to the present embodiment is executed by the state transition diagram shown inFIG. 3 . Note that the state transition diagram ofFIG. 3 corresponds to the interaction shown inFIG. 1 , and hereinafter, descriptions will be made assuming that the navigation is started by dragging an operating object in the lateral direction (x-direction) and that the layout change is triggered by dragging the operation object in the vertical direction (y-direction). A finger is used as the operating object here, and there may also be used a touch pen and the like. Further, in order to express state change conditions between respective states, the following variables and constants are defined as below. -
- y: Coordinate in y-direction when a finger is in contact with touch panel
- y0: Coordinate in y-direction at an instant at which finger is touched to touch panel (initial position)
- TH_A: Threshold for discontinuing navigation (first threshold)
- TH_B: Threshold for determining whether to cancel layout change or to complete layout change when finger is released from touch panel (second threshold)
- Provided that the relationship of 0<TH_A<TH_B is satisfied.
- A state where the finger is not in contact with the touch panel is referred to as “initial state” (S0). When the user causes his/her finger to touch the touch panel, the
operation control section 120 stores the coordinate in y-direction at the instant at which finger is touched in a memory (not shown) as an initial position y0 based on the detection result of the contact detection section 112 (T1). Note that the initial position y0 is reset every time the finger is released from the touch panel. After that, the state becomes a scrollable state (S1). When it is detected by the detection result of thecontact detection section 112 that the finger is released from the touch panel in the scrollable state (T2), the state returns to the initial state (S0). - In the scrollable state, a display content of the
display section 114 can be scrolled in accordance with a movement direction of the finger (T3). When the finger is moved in the lateral direction, the icon group displayed at the contact position of the finger is scrolled in the lateral direction in accordance with a movement distance of the finger, and when the finger is moved in the vertical direction, an icon group is scrolled for each group in the vertical direction in accordance with a movement distance of the finger. - When predetermined operation such as long pressing (keeping the finger in contact with the same position for a predetermined time period or longer) in the scrollable state (T4), the
operation control section 120 displays an arranged icon group in a manner that the icon group is slightly misaligned, and determines the transition to the navigation state (S2). The navigation state is a state where the movement distance of the finger from the initial position y0 in the vertical direction is smaller than the first threshold TH_A, that is, a state where |y−y0|<TH_A is satisfied. In the navigation state, the icon group is scrolled in the lateral direction in accordance with the movement distance of the finger in the lateral direction, and a navigation indicating that the layout can be changed is performed (T5). - For example, as shown in
FIG. 1 (second diagram from the left), theoperation control section 120 displays icons arranged in the lateral direction (x-direction), which are displayed at the position with which the finger is in contact, in a manner that each of the icons is slightly moved in the vertical direction (y-direction). For example, theoperation control section 120 can cause the icon to slightly move in proportion to the movement distance of the finger from the initial position y0 in the vertical direction, and can also cause a display angle to be calculated. In this way, by generating a motion in the vertical direction in the icon group, which has been arranged in the state where there has been no deviation in the vertical direction during scrolling, it allows the user to realize that the layout change can be triggered by dragging the finger in a vertical direction. Note that when the predetermined operation such as long pressing operation is performed in the navigation, the state may return to the scrollable state (S1). - When the movement distance of the finger from the initial position y0 in the vertical direction is equal to or larger than the first threshold THA in the navigation state, that is, in the case where |y−y0|≥TH_A is satisfied (T6), the state shifts to the intermediate state, in which processing up to the point at which the layout change is completed is performed. In the present embodiment, there are two states in the intermediate state in accordance with the movement distance of the finger from the initial position y0 in the vertical direction: an intermediate state 1 (S3) capable of shifting to the before-layout-change state; and an intermediate state 2 (S5) capable of shifting to the after-layout-change state. At the stage just after being shifted from the navigation state (S2), the state becomes the intermediate state 1 (S3) first.
- The intermediate state 1 (S3) is a state where the movement distance of the finger in the vertical direction is equal to or more than the first threshold TH_A and less than the second threshold TH_B, that is, a state where TH_A≤|y−y0|<TH_B is satisfied. In the
intermediate state 1, theoperation control section 120 displays a state of the layout change in progress (T8) by moving the icon group in accordance with the movement distance of the finger in the vertical direction. At that time, since the degree to which the icons are misaligned in the vertical direction becomes larger than that in the case of the navigation state, the user can recognize that the processing for the layout change is being performed. On the other hand, in the case where the movement distance of the finger in the vertical direction becomes less than the first threshold (T7), the state shifts from the intermediate state (S3) to the navigation state (S2). - Further, in the intermediate state 1 (S3), when the finger is released from the touch panel (T9), an animation display of the icon group which is displayed in a misaligned manner in accordance with the movement distance of the finger in the vertical direction is cancelled (S4). In this state, a cancel animation in which the misaligned icon group is gradually returned to the state before the layout change is displayed (T11), and finally, the state returns to the initial state (S0). On the other hand, in the case where the finger comes in contact again during displaying the cancel animation (T10), the
operation control section 120 returns to the intermediate state 1 (S3), and again displays the icon group in a manner that the icon group moves in the vertical direction in accordance with the movement distance of the finger in the vertical direction. - When the movement distance of the finger in the vertical direction becomes equal to or more than the second threshold TH_B, that is, when |y−y0|≥TH_B is satisfied (T12), the
operation control section 120 decides the state transition from the intermediate state 1 (S3) to the intermediate state 2 (S5). On the other hand, in the case where the movement distance of the finger in the vertical direction becomes less than the second threshold (T13), the state shifts from the intermediate state 2 (S5) to the intermediate state 1 (S3). In the intermediate state 2 (S5), the icon group is moved in the vertical direction in accordance with the movement distance of the finger in the vertical direction and displays a state of the layout change in progress (T14), in the same manner as the intermediate state 1 (S3). However, the processing performed in the intermediate state 2 (S5) when the finger is released from the touch panel differs from that in the case of the intermediate state 1 (S3). That is, when the finger is released from the touch panel (T15) in the intermediate state 2 (S5), the icon group moved along with the movement of the finger in the vertical direction is kept moving in the vertical direction, and a layout change animation showing the completion of the layout change is displayed (S6). - In other words, in such layout change processing, it is possible to change the layout by further moving the finger in the vertical direction from the navigation state (S2) indicating that the layout can be changed. At that time, when the movement distance of the finger in the vertical direction is less than the second threshold, a cancel animation is displayed when the finger is released from the touch panel in order that the layout change can be easily cancelled. On the other hand, when the movement distance of the finger in the vertical direction becomes equal to or more than the second threshold, the
operation control section 120 determines that the user performs the operation with intent to change the layout, performs the layout change even after the finger is released from the touch panel, and allows the state to become the layout state after the change. Owing to the reversibility of the interaction, the layout change can also be easily cancelled. - Then, when the layout change is completed as shown in the right diagram of
FIG. 1 , the animation display processing is terminated (T16), and the state change processing shown inFIG. 3 is terminated. In the case of returning to the display of before layout change after the layout change is completed, the processing for returning to the state shown in the left diagram ofFIG. 1 can be executed by pressing a “Home” button displayed in the right diagram ofFIG. 1 , for example. Alternatively, the processing for returning to the layout before the change may be associated with operation of dragging the finger in the lateral direction after the layout change, and, when the drag operation in the lateral direction is detected, the processing for causing the layout to return to the state shown in the left diagram ofFIG. 1 may be executed. On the other hand, in the case where the finger comes in contact with the touch panel again during the layout change animation (T17), theoperation control section 120 returns to the intermediate state 2 (S5), and again displays the icon group in a manner that the icon group moves in the vertical direction in accordance with the movement distance of the finger in the vertical direction. - In the display after layout change, content displayed at the top (for example, content A1 in the left diagram of
FIG. 1 ) in the display state before layout change may be displayed at the top in the same manner, for example. Alternatively, content displayed at the initial position y0 may be displayed at the top in the display state after layout change. In this way, the content that the user wants to display on thedisplay section 114 after the layout change can be reliably displayed on thedisplay section 114. - In the above, the layout change processing performed by the
information processing apparatus 100 according to the present embodiment has been described. According to the present embodiment, it is possible to navigate the user by the icon group that the layout of the icon group can be changed by the operation that is easily distinguished by the user, such as horizontal dragging and vertical dragging, and to cause the user to perform the layout change of the icon group. In this case, when the layout change is triggered, theinformation processing apparatus 100 gradually causes the layout change to take place in accordance with continuous operation of the user, and allows the user to understand in what way the layout change takes place in a stage before the operation is completed. In this way, the user can naturally recognize the interaction for changing the layout during the operation, and hence, the operability thereof can be enhanced. - Further, while the layout change is gradually carried out in accordance with the continuous operation of the user, the user can cancel the layout change from being triggered when the user ceases the operation by releasing the finger from the touch panel before the operation amount becomes equal to or more than a predetermined threshold, for example. On the other hand, in the case where the operation amount becomes equal to or more than the predetermined threshold, the layout change is triggered even when the user ceases the operation thereafter. In this way, by allowing the interaction to have reversibility, whether or not to execute the layout change can be easily determined during the operation.
- By performing the layout change processing as in the present embodiment, it becomes unnecessary to place the GUI button or the like on the screen for switching the layout which has been used in the past, the display region can be effectively used, and an operation burden imposed on the user can also be reduced.
- Next, based on
FIG. 4 , layout change processing according to a second embodiment of the present invention will be described.FIG. 4 is an explanatory diagram showing how an interaction goes on when selecting content according to the present embodiment. In an example of the present embodiment, pieces of content that have semantically strong relation with each other are arranged in a column. Such a layout may be used for, for example, a photograph browser in which a photograph group taken on the same date is arranged in the vertical direction (y-direction), and the photograph groups are arranged in the lateral direction (x-direction) by date. When applied toFIG. 4 , in the left diagram, the pieces of content A1 to E1, A2 to E2, A3 to E3, and so on each represent a photograph group taken on the same date. - In this way, the layout change of the thumbnail icon group of the pieces of content, which are arranged by date, can be executed in the same manner as the layout change processing of the first embodiment shown in
FIG. 3 performed by theinformation processing apparatus 100 having functions shown inFIG. 2 . Hereinafter, descriptions will be made on the processing in the case of applying the layout change processing of the first embodiment to the layout shown inFIG. 4 , and the description of the device configuration identical to the first embodiment and specific processing contents will be omitted. - First, the state shown in the left diagram of
FIG. 4 represents a state before layout change. In this state, when the user places the finger on a thumbnail icon of content displayed on thedisplay section 114, it is detected by thecontact detection section 112 that the finger touches the display surface. Based on the detection result, theoperation control section 120 determines a transition to a scroll state. Note that the circle drawn in a dashed line shown inFIG. 4 represents a contact position of the finger. As shown inFIG. 4 (second diagram from the left), when the state becomes the scroll state, the entire icon groups displayed on thedisplay section 114 are moved in the lateral direction (x-direction) and in the vertical direction (y-direction) based on the movement direction of the finger. - In the scroll state, when long pressing operation is performed for a predetermined time period or longer, for example, the
operation control section 120 determines the transition to a navigation state which indicates that the layout of the icon group can be changed. In the navigation state, when the finger is moved in the vertical direction, which is perpendicular to the direction in which the icon group is arranged (lateral direction), a layout change is triggered which is for displaying only a detailed list of the icon group (for example, in the case of the photograph browser, a photograph group taken on a specific date) arranged in the vertical direction at the contact position of the finger, as shown inFIG. 4 (third diagram from the left). At that time, an icon group (also referred to as “another-icon group”) other than the icon group of which the detailed list is displayed is moved to the left or right so as to disappear from the display region of thedisplay section 114. Then, theoperation control section 120 starts displaying descriptions related to respective pieces of content B4 to F4 of the icon group arranged in the vertical direction at the contact position of the finger on thedisplay section 114. - At that time, the
operation control section 120 moves the another-icon group to the left or right in accordance with the movement distance of the finger in the vertical direction. When the movement distance of the finger in the vertical direction is equal to or more than the first threshold, the state shifts from the navigation state to the intermediate state towards the layout change. Also in the intermediate state, the processing which is performed when the user stops the operation (for example, when the user releases the finger from the touch panel) differs in accordance with the movement distance of the finger in the vertical direction. - That is, in the case where the movement distance of the finger in the vertical direction is less than the second threshold (>first threshold), when the finger is released from the touch panel, the another-icon group which has been moved to the left or right is moved into the display region so that the another-icon group is displayed again. On the other hand, in the case where the movement distance of the finger in the vertical direction is equal to or more than the second threshold, when the finger is released from the touch panel, the another-icon group which has been moved to the left or right is moved in a manner to stay out of the display region, and the layout change is continued. At that time, as shown in the right diagram of
FIG. 4 , descriptions of the pieces of content associated with the icon groups C4 to G4, respectively, come to be displayed on the display region of thedisplay section 114. - In this way, the
information processing apparatus 100 is capable of changing the layout, even in the case of the layout shown inFIG. 4 , in the same manner as in the first embodiment in accordance with the processing ofFIG. 3 . Also in the present embodiment, the user can gradually understand the meaning of the layout change during the interaction. Further, owing to the reversibility of the interaction, the layout change can also be easily cancelled. In addition, it becomes unnecessary to place the GUI button or the like on the screen for switching the layout which has been used in the past, and hence, the display region can be effectively used and an operation burden imposed on the user can also be reduced. - Next, based on
FIG. 5 , layout change processing according to a third embodiment of the present invention will be described.FIG. 5 is an explanatory diagram showing how an interaction goes on when selecting content according to the present embodiment. In an example of the present embodiment, pieces of content that have semantically strong relation with each other are displayed in a stacking manner in the depth direction of a paper plane ofFIG. 5 . For example, there can be assumed the following usage: in a photograph browser, photographs are grouped by shooting date and the photographs are displayed in a stacking manner. When applied toFIG. 5 , in the left diagram, the pieces of content A1, B1, C1, and so on each represent a photograph group taken on the same date. - In this way, the layout change of the thumbnail icon group of the pieces of content, which are arranged by date, can be executed in the same manner as the layout change processing of the first embodiment shown in
FIG. 3 performed by theinformation processing apparatus 100 having functions shown inFIG. 2 . Hereinafter, descriptions will be made on the processing in the case of applying the layout change processing of the first embodiment to the layout shown inFIG. 5 , and the description of the device configuration identical to the first embodiment and specific processing contents will be omitted. - First, the state shown in the left diagram of
FIG. 5 represents a state before layout change. In this state, when the user places finger on a thumbnail icon of content displayed on thedisplay section 114, it is detected by thecontact detection section 112 that the finger touches the display surface. Based on the detection result, theoperation control section 120 determines a transition to a scroll state. Note that the circle drawn in a dashed line shown inFIG. 5 also represents a contact position of the finger. As shown inFIG. 5 (second diagram from the left), when the state becomes the scroll state, the entire icon groups displayed on thedisplay section 114 are moved in the lateral direction (x-direction) and in the vertical direction (y-direction) based on the movement direction of the finger. - In the scroll state, when long pressing operation is performed for a predetermined time period or longer, for example, the
operation control section 120 determines the transition to a navigation state which indicates that the layout of the icon group can be changed. In the navigation state, when the finger is moved in the vertical direction (y-direction), the icon group in a pile displayed at the contact position of the finger is displayed in a manner to slide in the vertical direction in accordance with the movement distance of the finger, as shown inFIG. 5 (third diagram from the left). In this way, theinformation processing apparatus 100 indicates to the user that the layout can be changed. At that time, an icon group (also referred to as “another-icon group”) other than the icon group displayed at the contact position of the finger is moved to the left or right so as to disappear from the display region of thedisplay section 114. Then, theoperation control section 120 starts displaying descriptions related to respective pieces of content (H1 to Hn; n represents an integer) of the icon group displayed at the contact position of the finger on thedisplay section 114. - The
operation control section 120 moves the another-icon group to the left or right in accordance with the movement distance of the finger in the vertical direction. When the movement distance of the finger in the vertical direction is equal to or more than the first threshold, the state shifts from the navigation state to the intermediate state towards the layout change. Also in the intermediate state, the processing which is performed when the user stops the operation (for example, when the user releases the finger from the touch panel) differs in accordance with the movement distance of the finger in the vertical direction. - That is, in the case where the movement distance of the finger in the vertical direction is less than the second threshold (>first threshold), when the finger is released from the touch panel, the another-icon group which has been moved to the left or right is moved into the display region so that the another-icon group is displayed again. On the other hand, in the case where the movement distance of the finger in the vertical direction is equal to or more than the second threshold, when the finger is released from the touch panel, the another-icon group which has been moved to the left or right is moved in a manner to stay out of the display region, and the layout change is continued. When the layout change is completed, as shown in the right diagram of
FIG. 5 , descriptions of the pieces of content associated with the icon groups H1 to H5, respectively, come to be displayed on the display region of thedisplay section 114. - In this way, the
information processing apparatus 100 is capable of changing the layout, even in the case of the layout shown inFIG. 5 , in the same manner as in the first embodiment in accordance with the processing ofFIG. 3 . Also in the present embodiment, the user can gradually understand the meaning of the layout change during the interaction. Further, owing to the reversibility of the interaction, the layout change can also be easily cancelled. In addition, it becomes unnecessary to place the GUI button or the like on the screen for switching the layout which has been used in the past, and hence, the display region can be effectively used and an operation burden imposed on the user can also be reduced. - <4. Example of Hardware Configuration>
- A part of processing performed by the
information processing apparatus 100 according to the present embodiment may be executed by hardware or may be executed by software. In this case, theinformation processing apparatus 100 may be configured as a computer shown inFIG. 6 . Hereinafter, based onFIG. 6 , an example of a hardware configuration of theinformation processing apparatus 100 according to the present embodiment will be described. - The
information processing apparatus 100 according to the present embodiment can be realized by, as described above, a processing device such as a computer. As shown inFIG. 6 , theinformation processing apparatus 100 includes a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, and ahost bus 104 a. Further, theinformation processing apparatus 100 includes abridge 104, anexternal bus 104 b, aninterface 105, aninput device 106, anoutput device 107, a storage device (HDD) 108, adrive 109, aconnection port 111, and acommunication device 113. - The
CPU 101 functions as an arithmetic processing unit and a control unit, and controls entire operation of theinformation processing apparatus 100 in accordance with various programs. Further, theCPU 101 may be a microprocessor. TheROM 102 stores a program, a calculation parameter, and the like used by theCPU 101. TheRAM 103 temporarily stores a program used in execution of theCPU 101, a parameter varying as appropriate during the execution, and the like. They are connected with each other via thehost bus 104 a configured from a CPU bus or the like. - The
host bus 104 a is connected to theexternal bus 104 b such as a PCI (Peripheral Component Interconnect/Interface) bus via thebridge 104. Note that it is not necessary that thehost bus 104 a, thebridge 104, and theexternal bus 104 b be configured separately, and the functions thereof may be implemented in one bus. - The
input device 106 is configured from, for example, input means for inputting information by a user, such as a mouse, a keyboard, a touch panel, a button, a microphone, a switch, and a lever, and an input control circuit which generates an input signal based on the input by the user and outputs the generated input signal to theCPU 101. Theoutput device 107 includes, for example, display devices such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp, and an audio output device such as a speaker. - The
storage device 108 is an example of a storage section of theinformation processing apparatus 100, and is a device for storing data. Thestorage device 108 may include a storage medium, a recording device for recording data in the storage medium, a reading device for reading out the data from the storage medium, and a deletion device for deleting the data recorded in the storage medium. Thestorage device 108 is configured from an HDD (Hard Disk Drive), for example. Thestorage device 108 drives a hard disk and stores a program and various data executed by theCPU 101. - The
drive 109 is a reader/writer for the storage medium and is built in or externally attached to theinformation processing apparatus 100. Thedrive 109 reads out information recorded in a removable recording medium which is mounted thereto, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and outputs the information to theRAM 103. - The
connection port 111 is an interface connected to an external device, and is a connection port with an external device capable of transmitting data by a USB (Universal Serial Bus), for example. Further, thecommunication device 113 is a communication interface which is configured from, for example, a communication device for establishing a connection with acommunication network 10. In addition, thecommunication device 113 may be a wireless LAN (Local Area Network) enabled communication device, a wireless USB enabled communication device, or a wired communication device for performing wired communication. - It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.
- For example, in the embodiments described above, the state in the layout change is determined based on the movement distance of the operating object, but the present invention is not limited thereto. For example, the state may be determined depending on movement speed of the operating object.
- Further, in the embodiments described above, the state change condition from the scrollable state to the navigation state (T4 in
FIG. 3 ) is to perform the long pressing operation, but the present invention is not limited thereto. For example, the state change condition may be that there has already been a case, at least once, where the icons included in the icon group are displayed in a manner to be slightly misaligned by moving the finger in the lateral direction. When the state change condition is satisfied, theoperation control section 120 causes the icons to be spread in the vertical direction when the finger is moved in the vertical direction. On the other hand, in the case where the state change condition is not satisfied, the display is caused to be scrolled in the vertical direction.
Claims (12)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/204,706 US20230325073A1 (en) | 2010-04-09 | 2023-06-01 | Information processing apparatus, information processing method, and program |
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010090289A JP5533165B2 (en) | 2010-04-09 | 2010-04-09 | Information processing apparatus, information processing method, and program |
JP2010-090289 | 2010-04-09 | ||
US13/076,063 US9383898B2 (en) | 2010-04-09 | 2011-03-30 | Information processing apparatus, information processing method, and program for changing layout of displayed objects |
US15/185,963 US10379736B2 (en) | 2010-04-09 | 2016-06-17 | Information processing apparatus, information processing method, and program for changing layout of displayed objects |
US16/449,739 US11714545B2 (en) | 2010-04-09 | 2019-06-24 | Information processing apparatus, information processing method, and program for changing layout of display objects |
US18/204,706 US20230325073A1 (en) | 2010-04-09 | 2023-06-01 | Information processing apparatus, information processing method, and program |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/449,739 Continuation US11714545B2 (en) | 2010-04-09 | 2019-06-24 | Information processing apparatus, information processing method, and program for changing layout of display objects |
Publications (1)
Publication Number | Publication Date |
---|---|
US20230325073A1 true US20230325073A1 (en) | 2023-10-12 |
Family
ID=44745390
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/076,063 Active 2032-09-08 US9383898B2 (en) | 2010-04-09 | 2011-03-30 | Information processing apparatus, information processing method, and program for changing layout of displayed objects |
US15/185,963 Active 2031-11-15 US10379736B2 (en) | 2010-04-09 | 2016-06-17 | Information processing apparatus, information processing method, and program for changing layout of displayed objects |
US16/449,739 Active US11714545B2 (en) | 2010-04-09 | 2019-06-24 | Information processing apparatus, information processing method, and program for changing layout of display objects |
US18/204,706 Pending US20230325073A1 (en) | 2010-04-09 | 2023-06-01 | Information processing apparatus, information processing method, and program |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/076,063 Active 2032-09-08 US9383898B2 (en) | 2010-04-09 | 2011-03-30 | Information processing apparatus, information processing method, and program for changing layout of displayed objects |
US15/185,963 Active 2031-11-15 US10379736B2 (en) | 2010-04-09 | 2016-06-17 | Information processing apparatus, information processing method, and program for changing layout of displayed objects |
US16/449,739 Active US11714545B2 (en) | 2010-04-09 | 2019-06-24 | Information processing apparatus, information processing method, and program for changing layout of display objects |
Country Status (3)
Country | Link |
---|---|
US (4) | US9383898B2 (en) |
JP (1) | JP5533165B2 (en) |
CN (1) | CN102214064A (en) |
Families Citing this family (62)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8600343B2 (en) | 2007-07-25 | 2013-12-03 | Yahoo! Inc. | Method and system for collecting and presenting historical communication data for a mobile device |
US9584343B2 (en) | 2008-01-03 | 2017-02-28 | Yahoo! Inc. | Presentation of organized personal and public data using communication mediums |
USD618248S1 (en) | 2008-09-23 | 2010-06-22 | Apple Inc. | Graphical user interface for a display screen or portion thereof |
EP2438571A4 (en) | 2009-06-02 | 2014-04-30 | Yahoo Inc | Self populating address book |
US7930430B2 (en) | 2009-07-08 | 2011-04-19 | Xobni Corporation | Systems and methods to provide assistance during address input |
US9721228B2 (en) | 2009-07-08 | 2017-08-01 | Yahoo! Inc. | Locally hosting a social network using social data stored on a user's computer |
US8984074B2 (en) | 2009-07-08 | 2015-03-17 | Yahoo! Inc. | Sender-based ranking of person profiles and multi-person automatic suggestions |
US8990323B2 (en) | 2009-07-08 | 2015-03-24 | Yahoo! Inc. | Defining a social network model implied by communications data |
US9087323B2 (en) | 2009-10-14 | 2015-07-21 | Yahoo! Inc. | Systems and methods to automatically generate a signature block |
US8423545B2 (en) | 2010-02-03 | 2013-04-16 | Xobni Corporation | Providing user input suggestions for conflicting data using rank determinations |
US8972257B2 (en) | 2010-06-02 | 2015-03-03 | Yahoo! Inc. | Systems and methods to present voice message information to a user of a computing device |
US8620935B2 (en) | 2011-06-24 | 2013-12-31 | Yahoo! Inc. | Personalizing an online service based on data collected for a user of a computing device |
USD668260S1 (en) * | 2011-01-31 | 2012-10-02 | Microsoft Corporation | Display screen with animated graphical user interface |
USD668261S1 (en) * | 2011-01-31 | 2012-10-02 | Microsoft Corporation | Display screen with animated graphical user interface |
US10078819B2 (en) * | 2011-06-21 | 2018-09-18 | Oath Inc. | Presenting favorite contacts information to a user of a computing device |
US9747583B2 (en) | 2011-06-30 | 2017-08-29 | Yahoo Holdings, Inc. | Presenting entity profile information to a user of a computing device |
KR20130041629A (en) * | 2011-10-17 | 2013-04-25 | 삼성전자주식회사 | Method and apparatus for displaying icons on mobile terminal |
USD710382S1 (en) | 2012-06-08 | 2014-08-05 | Apple Inc. | Display screen or portion thereof with icon |
GB2502957B (en) * | 2012-06-08 | 2014-09-24 | Samsung Electronics Co Ltd | Portable apparatus with a GUI |
JP5502943B2 (en) * | 2012-06-29 | 2014-05-28 | 楽天株式会社 | Information processing apparatus, authentication apparatus, information processing method, and information processing program |
CN103677498A (en) * | 2012-09-11 | 2014-03-26 | 华为终端有限公司 | Icon sorting and displaying method and terminal equipment |
CN103677507B (en) * | 2012-09-24 | 2020-01-14 | 腾讯科技(深圳)有限公司 | Display terminal and interface window display method |
US20140149884A1 (en) * | 2012-11-26 | 2014-05-29 | William Joseph Flynn, III | User-Based Interactive Elements |
US9965162B2 (en) * | 2012-11-29 | 2018-05-08 | Facebook, Inc. | Scrolling across boundaries in a structured document |
US10191643B2 (en) | 2012-11-29 | 2019-01-29 | Facebook, Inc. | Using clamping to modify scrolling |
US10192200B2 (en) | 2012-12-04 | 2019-01-29 | Oath Inc. | Classifying a portion of user contact data into local contacts |
WO2014100949A1 (en) * | 2012-12-24 | 2014-07-03 | Nokia Corporation | Apparatus for user interface and associated methods |
JP5882923B2 (en) * | 2013-01-31 | 2016-03-09 | Necパーソナルコンピュータ株式会社 | Portable information terminal, control method, and program |
CN104182150B (en) * | 2013-05-27 | 2020-02-14 | 中兴通讯股份有限公司 | Method and device for activating function corresponding to icon in toolbar |
USD741874S1 (en) | 2013-06-09 | 2015-10-27 | Apple Inc. | Display screen or portion thereof with animated graphical user interface |
JP2015026257A (en) * | 2013-07-26 | 2015-02-05 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
USD766253S1 (en) | 2013-09-25 | 2016-09-13 | Google Inc. | Display panel or portion thereof with a graphical user interface component |
CN104915087B (en) * | 2014-03-10 | 2019-05-31 | 联想(北京)有限公司 | The method and electronic equipment of information processing |
US9871991B2 (en) * | 2014-03-31 | 2018-01-16 | Jamdeo Canada Ltd. | System and method for display device configuration |
JP6139455B2 (en) * | 2014-04-17 | 2017-05-31 | 日本電信電話株式会社 | Information display device |
USD798900S1 (en) | 2014-06-01 | 2017-10-03 | Apple Inc. | Display screen or portion thereof with icon |
US20160041702A1 (en) * | 2014-07-08 | 2016-02-11 | Nan Wang | Pull and Swipe Navigation |
USD753711S1 (en) | 2014-09-01 | 2016-04-12 | Apple Inc. | Display screen or portion thereof with graphical user interface |
WO2016080363A1 (en) * | 2014-11-21 | 2016-05-26 | 京セラドキュメントソリューションズ株式会社 | Operating device and operating method |
CN104360817B (en) * | 2014-12-08 | 2019-05-31 | 联想(北京)有限公司 | A kind of information processing method and electronic equipment |
KR102314109B1 (en) | 2015-01-05 | 2021-10-18 | 삼성전자주식회사 | A display apparatus and a display method |
CN105988676B (en) * | 2015-02-12 | 2019-06-18 | Oppo广东移动通信有限公司 | A kind of method and device updating list of application |
JP2016224523A (en) * | 2015-05-27 | 2016-12-28 | 京セラ株式会社 | Portable terminal |
USD848458S1 (en) * | 2015-08-03 | 2019-05-14 | Google Llc | Display screen with animated graphical user interface |
USD888733S1 (en) | 2015-08-03 | 2020-06-30 | Google Llc | Display screen with animated graphical user interface |
USD849027S1 (en) * | 2015-08-03 | 2019-05-21 | Google Llc | Display screen with animated graphical user interface |
USD818037S1 (en) | 2017-01-11 | 2018-05-15 | Apple Inc. | Type font |
CN107015746B (en) * | 2017-03-06 | 2020-03-17 | 北京潘达互娱科技有限公司 | Interface element processing method and device |
USD877170S1 (en) | 2018-01-22 | 2020-03-03 | Apple Inc. | Electronic device with graphical user interface |
US10936163B2 (en) | 2018-07-17 | 2021-03-02 | Methodical Mind, Llc. | Graphical user interface system |
US11074053B2 (en) * | 2018-09-07 | 2021-07-27 | Boyd Cannon Multerer | User interface generation system |
USD898755S1 (en) | 2018-09-11 | 2020-10-13 | Apple Inc. | Electronic device with graphical user interface |
WO2020084834A1 (en) * | 2018-10-25 | 2020-04-30 | パナソニックIpマネジメント株式会社 | Display control method and display control system |
US11012750B2 (en) * | 2018-11-14 | 2021-05-18 | Rohde & Schwarz Gmbh & Co. Kg | Method for configuring a multiviewer as well as multiviewer |
USD902221S1 (en) | 2019-02-01 | 2020-11-17 | Apple Inc. | Electronic device with animated graphical user interface |
USD900925S1 (en) | 2019-02-01 | 2020-11-03 | Apple Inc. | Type font and electronic device with graphical user interface |
USD900871S1 (en) | 2019-02-04 | 2020-11-03 | Apple Inc. | Electronic device with animated graphical user interface |
USD912694S1 (en) * | 2019-06-01 | 2021-03-09 | Apple Inc. | Electronic device with graphical user interface |
JP6816798B2 (en) * | 2019-08-22 | 2021-01-20 | 富士ゼロックス株式会社 | Display device and program |
CN111857923B (en) * | 2020-07-17 | 2022-10-28 | 北京字节跳动网络技术有限公司 | Special effect display method and device, electronic equipment and computer readable medium |
US11194471B1 (en) | 2021-01-28 | 2021-12-07 | Honda Motor Co., Ltd. | Apparatus and method for display control based on touch interface |
USD1002643S1 (en) | 2021-06-04 | 2023-10-24 | Apple Inc. | Display or portion thereof with graphical user interface |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9513765B2 (en) * | 2007-12-07 | 2016-12-06 | Sony Corporation | Three-dimensional sliding object arrangement method and system |
Family Cites Families (32)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5499330A (en) * | 1993-09-17 | 1996-03-12 | Digital Equipment Corp. | Document display system for organizing and displaying documents as screen objects organized along strand paths |
DE69523543T2 (en) * | 1994-12-13 | 2002-04-04 | Microsoft Corp | Taskbar with start menu |
JP4325075B2 (en) * | 2000-04-21 | 2009-09-02 | ソニー株式会社 | Data object management device |
US7128760B2 (en) | 2001-03-27 | 2006-10-31 | Warsaw Orthopedic, Inc. | Radially expanding interbody spinal fusion implants, instrumentation, and methods of insertion |
US6957392B2 (en) * | 2002-01-16 | 2005-10-18 | Laszlo Systems, Inc. | Interface engine providing a continuous user interface |
TWI238348B (en) * | 2002-05-13 | 2005-08-21 | Kyocera Corp | Portable information terminal, display control device, display control method, and recording media |
US7117453B2 (en) * | 2003-01-21 | 2006-10-03 | Microsoft Corporation | Media frame object visualization system |
US7325196B1 (en) * | 2003-06-16 | 2008-01-29 | Microsoft Corporation | Method and system for manipulating page control content |
JP4325449B2 (en) * | 2004-03-19 | 2009-09-02 | ソニー株式会社 | Display control device, display control method, and recording medium |
CN101484869B (en) * | 2005-01-05 | 2014-11-26 | 希尔克瑞斯特实验室公司 | Scaling and layout methods and systems for handling one-to-many objects |
JP2007179351A (en) | 2005-12-28 | 2007-07-12 | Sony Corp | File management device and image display device |
US20070057951A1 (en) * | 2005-09-12 | 2007-03-15 | Microsoft Corporation | View animation for scaling and sorting |
US7730425B2 (en) * | 2005-11-30 | 2010-06-01 | De Los Reyes Isabelo | Function-oriented user interface |
US7509588B2 (en) * | 2005-12-30 | 2009-03-24 | Apple Inc. | Portable electronic device with interface reconfiguration mode |
US8564543B2 (en) * | 2006-09-11 | 2013-10-22 | Apple Inc. | Media player with imaged based browsing |
US7634733B2 (en) * | 2006-09-18 | 2009-12-15 | Agfa Inc. | Imaging history display system and method |
US8375302B2 (en) * | 2006-11-17 | 2013-02-12 | Microsoft Corporation | Example based video editing |
US8656308B2 (en) * | 2007-01-26 | 2014-02-18 | Beth Shimkin | System and method for electronic item management |
JP4952275B2 (en) * | 2007-02-05 | 2012-06-13 | ソニー株式会社 | Information processing apparatus, image display apparatus, information processing apparatus control method, and program |
US10063813B2 (en) * | 2007-07-26 | 2018-08-28 | The Directv Group, Inc. | Method and system for communicating and displaying broadband content availability using information received through a satellite |
JP4557058B2 (en) * | 2007-12-07 | 2010-10-06 | ソニー株式会社 | Information display terminal, information display method, and program |
JP4171770B1 (en) * | 2008-04-24 | 2008-10-29 | 任天堂株式会社 | Object display order changing program and apparatus |
US8276093B2 (en) * | 2008-04-24 | 2012-09-25 | Nintendo Co., Ltd. | Computer-readable storage medium having object display order changing program stored therein and apparatus |
KR101477743B1 (en) * | 2008-06-16 | 2014-12-31 | 삼성전자 주식회사 | Terminal and method for performing function thereof |
JP4632102B2 (en) * | 2008-07-17 | 2011-02-16 | ソニー株式会社 | Information processing apparatus, information processing method, and information processing program |
US9176620B2 (en) * | 2008-07-22 | 2015-11-03 | Lg Electronics Inc. | Mobile terminal and method for displaying information list thereof |
JP5060430B2 (en) * | 2008-08-28 | 2012-10-31 | 株式会社東芝 | Display control apparatus and method |
US20100070913A1 (en) * | 2008-09-15 | 2010-03-18 | Apple Inc. | Selecting an item of content in a graphical user interface for a portable computing device |
US8683390B2 (en) * | 2008-10-01 | 2014-03-25 | Microsoft Corporation | Manipulation of objects on multi-touch user interface |
US8762885B2 (en) * | 2008-12-15 | 2014-06-24 | Verizon Patent And Licensing Inc. | Three dimensional icon stacks |
JP4645759B2 (en) | 2009-09-24 | 2011-03-09 | ソニー株式会社 | File management device and image display device |
US9405449B2 (en) * | 2010-01-14 | 2016-08-02 | Microsoft Technology Licensing, Llc | Layout constraint manipulation via user gesture recognition |
-
2010
- 2010-04-09 JP JP2010090289A patent/JP5533165B2/en not_active Expired - Fee Related
-
2011
- 2011-03-30 US US13/076,063 patent/US9383898B2/en active Active
- 2011-04-01 CN CN2011100847635A patent/CN102214064A/en active Pending
-
2016
- 2016-06-17 US US15/185,963 patent/US10379736B2/en active Active
-
2019
- 2019-06-24 US US16/449,739 patent/US11714545B2/en active Active
-
2023
- 2023-06-01 US US18/204,706 patent/US20230325073A1/en active Pending
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9513765B2 (en) * | 2007-12-07 | 2016-12-06 | Sony Corporation | Three-dimensional sliding object arrangement method and system |
Also Published As
Publication number | Publication date |
---|---|
JP5533165B2 (en) | 2014-06-25 |
US9383898B2 (en) | 2016-07-05 |
JP2011221790A (en) | 2011-11-04 |
US11714545B2 (en) | 2023-08-01 |
CN102214064A (en) | 2011-10-12 |
US10379736B2 (en) | 2019-08-13 |
US20190310771A1 (en) | 2019-10-10 |
US20160299684A1 (en) | 2016-10-13 |
US20110252383A1 (en) | 2011-10-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20230325073A1 (en) | Information processing apparatus, information processing method, and program | |
KR102628385B1 (en) | Devices, methods, and graphical user interfaces for interacting with user interface objects corresponding to applications | |
US11204687B2 (en) | Visual thumbnail, scrubber for digital content | |
US10705707B2 (en) | User interface for editing a value in place | |
US10732825B2 (en) | Natural input for spreadsheet actions | |
US8525839B2 (en) | Device, method, and graphical user interface for providing digital content products | |
EP3008575B1 (en) | Natural quick function gestures | |
CN108334264B (en) | Method and apparatus for providing multi-touch interaction in portable terminal | |
US7962862B2 (en) | Method and data processing system for providing an improved graphics design tool | |
US20150067582A1 (en) | Content navigation structure and transition mechanism | |
JP5414764B2 (en) | INPUT CONTROL DEVICE, INPUT CONTROL METHOD, AND INPUT CONTROL PROGRAM | |
US20110283212A1 (en) | User Interface | |
US20100077333A1 (en) | Method and apparatus for non-hierarchical input of file attributes | |
JP2013089202A (en) | Input control unit, input control method and input control program | |
US20220326816A1 (en) | Systems, Methods, and User Interfaces for Interacting with Multiple Application Views | |
JP2010287121A (en) | Information processor, program, recording medium and display controller | |
JP2013089201A (en) | Input control unit, input control method and input control program | |
CN103885673B (en) | Object Selection equipment and object selection method | |
JP2013011981A (en) | Display control method, program, and display unit |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SONY CORPORATION, JAPAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MIYASHITA, KEN;REEL/FRAME:063831/0201 Effective date: 20160622 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |