WO2018186011A1 - Information processing device, information processing method, and program - Google Patents

Information processing device, information processing method, and program Download PDF

Info

Publication number
WO2018186011A1
WO2018186011A1 PCT/JP2018/003081 JP2018003081W WO2018186011A1 WO 2018186011 A1 WO2018186011 A1 WO 2018186011A1 JP 2018003081 W JP2018003081 W JP 2018003081W WO 2018186011 A1 WO2018186011 A1 WO 2018186011A1
Authority
WO
WIPO (PCT)
Prior art keywords
twist
information processing
display control
processing apparatus
swipe
Prior art date
Application number
PCT/JP2018/003081
Other languages
French (fr)
Japanese (ja)
Inventor
津田　崇基
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Publication of WO2018186011A1 publication Critical patent/WO2018186011A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures

Definitions

  • the present disclosure relates to an information processing apparatus, an information processing method, and a program.
  • Patent Document 1 discloses an information processing apparatus that can make the relationship between an image displayed on a display unit and a user's operation closer to an actual operation.
  • the present disclosure proposes an information processing apparatus, an information processing method, and a program capable of realizing a more intuitive gesture operation.
  • a determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information on the operation input screen, and an application according to the determined twist operation
  • an information processing apparatus including a display control unit that performs predetermined display control corresponding to the above.
  • the processor determines, as a twist operation, the twisting operation by the operating body with respect to the operation input screen based on the operation information by the operating body with respect to the operation input screen, and according to the determined twist operation. Proposing an information processing method including performing predetermined display control corresponding to an application.
  • the computer determines, based on the operation information by the operating body on the operation input screen, the twisting operation by the operating body on the operation input screen as a twist operation, and according to the determined twist operation
  • a program that functions as a display control unit that performs predetermined display control corresponding to an application is proposed.
  • the “Power Press” operation is an operation of pressing the belly of the finger as it is after touching the screen with the tip of the finger, and can be recognized based on a change in the contact area.
  • UI operation pushed on the existing touch panel is realizable, without adding a new (physical) structure.
  • the “Twist” operation enables analog control by rolling (twisting) a finger from the touched state to the right or left.
  • a UI operation for adjusting parameters according to the twisting condition.
  • the “Spiral” operation is an operation of rotating clockwise or counterclockwise with the fingertip as a fulcrum from the above-mentioned “Power Press” state, and can realize a UI operation such as a dial operation.
  • the “Power Swipe, Power Drag” operation is an operation for swiping or dragging the finger from the above-mentioned “Power Press” state, and can be used with a UI that moves the object.
  • gesture operations that can be used more intuitively and widely can be provided.
  • FIG. 1 is a diagram illustrating an example of the configuration of the information processing apparatus 1 according to the present embodiment.
  • the information processing apparatus 1 includes a control unit 10, an operation input unit 11, a display unit 12, and a storage unit 13.
  • the control unit 10 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 1 according to various programs.
  • the control unit 10 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor, for example.
  • the control unit 10 may include a ROM (Read Only Memory) that stores programs to be used, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
  • control unit 10 also functions as the determination unit 101 and the display control unit 102.
  • the determination unit 101 performs a user gesture determination on the touch panel based on the touch information detected by the operation input unit 11.
  • the determination unit 101 includes Power Press, Twist, Spiral, Power Swipe, and Power Drag. It is possible to determine a predetermined gesture to be called.
  • the determination unit 101 changes the contact area (also referred to as a ground plane) by the operating body to the operation input screen (touch panel), the change in the center position (also referred to as the center of gravity) of the contact area, and the changed contact area and before the change.
  • a large number of gesture determinations can be performed based on the relationship with the center position.
  • the display control unit 102 controls display on the display unit 12 and performs display control according to the gesture determined by the determination unit 101 or performs display control according to an instruction of an application executed by the information processing apparatus 1. .
  • the operation input unit 11 receives an operation instruction from the user and outputs the operation content to the control unit 10.
  • the operation input unit 11 may be a touch sensor, a pressure sensor, or a proximity sensor provided integrally with the display unit 12.
  • a touch sensor a pressure sensor
  • a proximity sensor provided integrally with the display unit 12.
  • the operation input unit 11 is realized by a touch panel and performs gesture determination using detected touch information.
  • the operation input information to be used is touch. It is not limited to information, For example, a pressure sensor value or a proximity sensor value may be sufficient.
  • the display unit 12 is a display device that outputs various operation input screens.
  • the display unit 12 may be a display device such as a liquid crystal display (LCD) or an organic EL (Electroluminescence) display.
  • the storage unit 13 is realized by a ROM (Read Only Memory) that stores programs and calculation parameters used for the processing of the control unit 10, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
  • ROM Read Only Memory
  • RAM Random Access Memory
  • the configuration of the information processing apparatus 1 has been specifically described above.
  • the information processing apparatus 1 can be realized by, for example, a smartphone, a mobile phone terminal, a tablet terminal, a wearable device (for example, a smart band, a smart watch), a PC (personal computer), or the like.
  • the configuration of the information processing apparatus 1 is not limited to the example illustrated in FIG. 1, and may be realized by an information processing system including a client terminal and a server, for example. In this case, for example, operation input information detected by the operation input unit 11 on the client terminal side is transmitted to a server on the network, gesture determination is performed on the server side, and a display control signal based on the determined gesture is transmitted to the client. Sent to the terminal.
  • FIG. 2 is a flowchart showing an operation process of the information processing apparatus according to the present embodiment.
  • the display control unit 102 of the information processing apparatus 1 displays a predetermined user interface (that is, an operation input screen) on the display unit 12 (step S103), and operation input information by the user for the user interface. (Here, touch information) is acquired from the operation input unit 11 (step S106).
  • a predetermined user interface that is, an operation input screen
  • the determination unit 101 of the information processing apparatus 1 performs a gesture determination based on the touch information (step S109). Details of the gesture determination will be described later. For example, the determination unit 101 acquires, as touch information, a change in the position, shape, area, or the like of the ground contact surface of the operation body (for example, the user's finger) with respect to the operation input screen, Perform gesture determination.
  • the determination unit 101 acquires, as touch information, a change in the position, shape, area, or the like of the ground contact surface of the operation body (for example, the user's finger) with respect to the operation input screen, Perform gesture determination.
  • the display control unit 102 of the information processing apparatus 1 performs predetermined display control according to the determined gesture (step S112).
  • Such information can be acquired by the operation input unit 11 realized by a touch panel or the like.
  • Sn for the first point (Start point) where the finger is placed with respect to the operation input unit 11 An for the area (area) in contact with the belly of the finger, and the area A symbol such as Cn is assigned to the center (centroid: Centroid point) of the.
  • Centroid point Centroid point
  • FIG. 4 is a diagram for explaining the determination conditions for the Tap operation according to the present embodiment.
  • the determination unit 101 has a time from when the finger is placed on the touch panel (operation input unit 11) to when it is released, for example, within approximately 1 second, and as shown in FIG. 4, the center of gravity C1 of the place where the finger is placed.
  • the center of gravity C2 of the place where the finger is released is the same, it is determined that the Tap operation is performed.
  • it may be added to the condition that the area A2 includes the start point S1.
  • FIG. 5 is a diagram illustrating the determination conditions for the long press operation according to the present embodiment.
  • the determination unit 101 keeps the finger placed on the touch panel (operation input unit 11) for about 1 second or more, and as shown in FIG. If the center of gravity C4 is the same, the Long press operation is determined. In addition, the case where there is no change in the area of area A3 and area A4 may be added as a condition.
  • FIG. 6 is a diagram illustrating determination conditions for a Swipe (Flick) or Drag operation according to the present embodiment.
  • the determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition a and condition b-1” or “condition a and condition b-2” If these conditions are satisfied, it is determined that the operation is Swipe (Flick) or Drag operation.
  • Condition a The finger is moved within, for example, approximately one second after the finger is placed.
  • Condition b-1 The shapes of the ground planes A5 and A6 are the same before and after the movement of the finger (or during the movement) (this condition is useful when the shape of the ground plane can be determined).
  • Condition b-2 The areas of the ground planes A5 and A6 are the same before and after the movement of the finger (or during the movement) (this condition is useful when the shape of the ground plane cannot be determined).
  • center of gravity C6 is away from C5 and the approximate point P6 is away from the starting point S5.
  • Swipe a quick sweep operation
  • Flick a sweeping operation
  • Drag a movement operation
  • FIG. 7 is a diagram for explaining the outline of the Power Press operation according to the present embodiment.
  • the power press operation is an operation in which the finger 2 (especially the fingertip) is placed on the touch panel (operation input unit 11) and then the finger 2 is laid down and pressed so that the belly of the finger 2 is brought into contact. is there.
  • a UI operation for pressing on an existing touch panel can be realized without adding a physical configuration.
  • FIG. 8 is a diagram for explaining the determination conditions for the Power Press operation according to the present embodiment.
  • the determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition c-1 and condition d and condition e” or “condition c-2 and condition d” And if condition e ”is met, it is determined that the operation is a Power Press operation.
  • Condition c-1 The shape of the ground plane A has changed characteristically (the ellipse has extended) (this condition is useful when the shape of the ground plane can be determined).
  • Condition c-2 The area of the ground plane A is increased by, for example, about 150% (this condition is useful when the shape of the ground plane cannot be determined).
  • Condition d The center of gravity C7 when the finger is placed is included in the ground contact surface A8 when the finger is pressed.
  • Condition e The location of the center of gravity C7 when the finger is placed and the location of the center of gravity C8 when the finger is pressed are different.
  • FIG. 9 is a diagram for explaining the outline of the Twist operation according to the present embodiment.
  • the Twist operation is an operation of rolling (twisting) the finger 2 on the touch panel in the right or left direction after placing the finger 2 (particularly the fingertip) on the touch panel (operation input unit 11). . More specifically, the finger 2 is rolled to the right or left side from the state in which the touch panel is touched with the finger 2, and the side surface of the finger 2 touches the touch panel (the state in which the belly of the finger 2 is perpendicular to the touch panel). It is an operation. With this two-stage operation, it is possible to realize a UI operation for adjusting parameters according to the twisting condition on an existing touch panel without adding a physical configuration.
  • FIG. 10 is a diagram for explaining the determination conditions for the Twist operation according to the present embodiment.
  • the determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition f-1 and condition g and condition h” or “condition f-2 and condition g” And the condition h ”are satisfied, the Twist operation is determined.
  • Condition f-1 The shape of the ground plane A has changed characteristically (becomes elongated) (this condition is useful when the shape of the ground plane can be determined).
  • Condition f-2 The area of the ground plane A is reduced by, for example, about 80% or more (this condition is useful when the shape of the ground plane cannot be determined).
  • Condition g The center of gravity C9 when the finger is placed is not included in the ground contact surface A10 after twisting.
  • Condition h The center-of-gravity point C9 before twisting the finger and the center-of-gravity point C10 after twisting (while twisting) are within a distance of one finger (for example, 1 cm). (Furthermore, the center of gravity C10 may be separated from the center of gravity C9 by one finger in the left-right direction (within ⁇ 45 °).)
  • FIG. 11 is a diagram for explaining the outline of the spiral operation according to the present embodiment.
  • the Spiral operation means that the finger 2 is placed on the touch panel (operation input unit 11), then the Power Press operation (see FIGS. 7 and 8) is performed, and the finger 2 is supported on the touch panel.
  • a UI operation such as a dial operation can be realized on an existing touch panel without adding a physical configuration.
  • FIG. 12 is a diagram illustrating the determination conditions for the spiral operation according to the present embodiment. After the finger is placed on the touch panel as shown in the left of FIG. 12 and then the power press operation is performed as shown in the center of FIG. 12 (the determination conditions for the power press operation are as described above). If the following conditions “condition i, condition j, condition k, and condition l” are satisfied (the state shown on the right in FIG. 12), it is determined that the operation is a spiral operation. .
  • Condition i The transition of the center of gravity from the center of gravity C11 immediately after the power press operation is performed is continuously detected, and the center of gravity when the finger is pressed against the center of gravity C11 immediately after the finger is placed (power press operation) The line L1 connecting the point C12 and the line connecting the current center of gravity C13 and the center of gravity C11 are compared, and the center L1 is rotated from the center of gravity C11.
  • Condition j The area of the ground plane A12 before being rotated and the area of the ground plane A13 after being rotated (or during rotation) are the same.
  • Condition k The center-of-gravity point C11 when the finger is placed is included in the ground contact surface A13 after the rotation (or during the rotation).
  • Condition 1 The distance between the center of gravity C11 when the finger is placed and the center of gravity C12 before the rotation and the center of gravity C11 when the finger is placed and the center of gravity C13 after the rotation (or during rotation) The distance is the same.
  • the Power Swipe (Flick) / Power Drag operation is an operation of moving a finger (Swipe, Flick, or Drag) from the state of the Power Press operation (see FIGS. 7 and 8).
  • FIG. 13 is a diagram for explaining determination conditions for the Power Swipe (Flick) / Power Drag operation according to the present embodiment. Immediately after the finger is placed on the touch panel as shown in the left of FIG. 13 and then the power press operation (the determination conditions for the power press operation are as described above) is performed as shown in the center of FIG. Continue to monitor the changes in the position, shape and area of the ground contact surface, and when the following “condition m and condition n” are satisfied (as shown in the right side of FIG. 13), it is determined as Power Swipe (Flick) / Power Drag operation To do.
  • Condition m The center-of-gravity point C15 before moving the finger is outside the current area of the ground contact surface A16.
  • Condition n The area of the ground plane A15 before being moved and the area of the ground plane A16 after being moved (or being moved) are the same.
  • Swipe a quick sweep operation
  • Flick a sweeping operation
  • Drag a movement operation
  • center of gravity C16 after movement is away from the center of gravity C15 before movement.
  • the determination unit 101 can determine that the finger 2 has moved from the direction in which the approximate point P16 of the ground contact surface A16 after movement is located.
  • the difference between the Twist operation and the Swipe / Drag operation may be determined based on the movement amount and the elapsed time (movement time). .
  • movement time elapsed time
  • FIG. 14 is a diagram for explaining operation determination conditions based on the movement amount and the elapsed time according to the present embodiment. As shown in FIG. 14, the threshold Th of the determination distance is changed according to the elapsed time. As a result, for example, a twist operation can be performed in a wider range by slowly moving a finger.
  • the Twist operation can be performed more widely by moving slowly (however, the threshold Th corresponding to the movement speed is set). Less travel distance).
  • the threshold value Th described above may be adjusted according to changes in physical movement and inclination of the terminal (information processing apparatus 1) during operation.
  • the movement and tilt of the information processing apparatus 1 can be detected by an acceleration sensor, a gyro sensor, a geomagnetic sensor, or the like (all not shown) provided in the information processing apparatus 1.
  • the information processing apparatus 1 may be moved to the right by the acceleration sensor. You may make it adjust a threshold value so that operation can be determined more easily.
  • the Twist operation is performed in the right direction
  • the hand holding the information processing apparatus 1 is twisted together, and the information processing apparatus 1 is moved in the right direction by the acceleration sensor on the assumption that the information processing apparatus 1 is slightly tilted.
  • the threshold value may be adjusted so that the Twist operation in the right direction can be more easily determined.
  • the Swipe operation performed in the horizontal direction on the touch UI has been able to control only one system parameter so far, but in this embodiment, another system parameter control can be performed by using the Twist operation. Further, by using the spiral operation, it is possible to control another parameter.
  • the operations of these systems may be independent (example of a camera application described with reference to FIG. 19) or related operations (example of a slider bar described with reference to FIG. 15). Or a series (an example of an Alphabetical index bar described with reference to FIG. 16).
  • the index finger is used as an operation body as an example, but the present embodiment is not limited to this, and continuous analog operations such as volume adjustment and angle adjustment can also be performed dynamically with the thumb. . Also, non-continuous operations such as character selection and mode switching can be finely operated with the index finger.
  • FIG. 15 is a diagram for explaining the Swipe operation and the Twist operation on the slider bar.
  • the volume adjustment slider bar 121 is displayed on the display unit 12 (touch panel display integrated with the operation input unit 11), for example, when the Swipe operation is performed with the finger 2, FIG.
  • the volume can be adjusted, and when the Twist operation is performed, the LR balance can be adjusted as shown on the right of FIG.
  • the display control unit 102 displays the LR balance adjustment screen 123 and can adjust the left / right balance according to the rotation in the left / right direction.
  • the bar knob on the balance adjustment screen 123 may be moved to the right in accordance with the degree of twisting in the right direction, and the bar knob on the balance adjustment screen 123 may be moved to the right while maintaining the twisted state. It may be moved in the direction.
  • FIG. 16 is a diagram for explaining the Swipe operation and the Twist operation on the alphabet index bar according to the present embodiment.
  • FIG. 16 when the alphabet index bar 125 of the address book is displayed on the display unit 12 (touch panel display integrated with the operation input unit 11), for example, when the Swipe operation is performed with the finger 2, FIG. Index search is possible in alphabetical order as shown at 16 left, and scrolling within the index is possible as shown at right of FIG. 16 when Twist operation is performed.
  • FIG. 17 is a diagram for explaining a Swipe operation and a Twist operation in viewpoint and line-of-sight movement according to the present embodiment.
  • a viewing screen capable of moving the viewpoint and the line of sight is displayed, as shown in the left of FIG. 17, the location (viewpoint) can be moved by the Swipe operation, as shown in the right of FIG.
  • the angle of view (line of sight) may be moved by a Twist operation.
  • the viewpoint and line-of-sight movement operations can be clearly performed by the Swipe operation and the Twist operation.
  • FIG. 18 is a diagram for explaining the shutter operation by the power press operation.
  • the finger 2 is placed on the through screen in the display unit 12 (touch panel display integrated with the operation input unit 11). In this state, it is determined that the Tap operation is performed, and focus lock is performed. 18 As shown on the right, the shutter can be released by the power press operation that presses the belly of the finger 2.
  • FIG. 19 is a diagram for explaining an example of a spiral operation and a twist operation in a camera application.
  • a brightness adjustment screen 127 is displayed in response to a spiral operation, and the brightness adjustment screen 127 moves like a dial operation that rotates clockwise or counterclockwise with a fingertip as a fulcrum. It is possible to adjust the brightness.
  • the aperture adjustment screen 129 is displayed according to the Twist operation, and the aperture value can be adjusted according to the twist.
  • the information display may be turned ON / OFF by a Tap operation, and detailed information may be displayed in an overlay by a Power press operation.
  • the filter can be switched by Twist operation, and zoom in / out may be performed by Spiral operation (after canceling the overlay display of detailed information).
  • the contact list screen When the contact list screen is displayed on the display unit 12 by the Contacts list application, for example, it is selected by Tap operation, the content Preview (email address, address, etc.) is displayed by Power press operation, and group registration is performed by Twist operation. It is also possible to execute a function (email creation, telephone call) by selecting an e-mail address, an address, etc. by a spiral operation.
  • a function electronic creation, telephone call
  • FIG. 20 is a diagram for explaining an example of the Power press operation and the Spiral operation in the Contacts list application. As shown on the left side of FIG. 20, when a contact list screen is displayed on the display unit 12, when a contact is selected by Tap operation and Power Press operation is performed as it is, a content preview screen 130 is displayed.
  • FIG. 21 is a diagram for explaining an example of the Twist operation in the Contacts list application. As shown in FIG. 21, when a Twist operation is performed in a state where a contact is selected and the content preview screen 130 is displayed, a group registration screen 132 is displayed. The user can register a group by moving the cursor to an arbitrary group. Note that the selection cursor moves sequentially according to the twist of the Twist operation.
  • the focus between character buttons can be moved by a Swipe operation, and the character type on the character button can be switched by a Twist operation.
  • a Swipe operation for example, the focus between character buttons can be moved by a Swipe operation, and the character type on the character button can be switched by a Twist operation.
  • FIG. 22 is a diagram for explaining an example of a Twist operation in text input. As shown in FIG. 22, when a Twist operation is performed on an arbitrary character button, a plurality of character types corresponding to the character button can be switched. The character type is switched according to, for example, the twist of the Twist operation.
  • the focus between character buttons is moved by the Swipe operation, and the character type can be switched by the Twist operation without releasing the finger 2 from the touch panel. Also, when you want to move to another character button after the Twist operation (the target character type is not found), move to the Swipe operation without moving the finger 2 from the touch panel and move the focus between the character buttons again. It is possible to make it.
  • Notification card display> Next, an operation example in displaying a notification card displayed on a home screen or a lock screen on a smartphone or a tablet terminal will be described.
  • the displayed notification card for example, open the notification card by Tap operation, display the context menu by Power press operation, switch the display restriction by Twist operation, and by Spiral operation (after canceling the context menu display) Perform Expand / Collapse of the notification card.
  • Dismiss (delete notification card) may be performed with Swipe operation, and context menu items may be selected with Power Drag operation.
  • Swipe operation may be performed with Swipe operation
  • context menu items may be selected with Power Drag operation.
  • Twist operation in the notification card display will be described with reference to FIG.
  • FIG. 23 is a diagram for explaining an example of the Twist operation in the notification card display according to the present embodiment.
  • the display restriction is set as shown in the right side of FIG.
  • a switching screen 137a is displayed.
  • the display restriction can be switched according to the type of the selected notification card.
  • any one of “sender only”, “title only”, “sender and title”, and “up to text” is selected as the notification card display restriction. Is possible.
  • the selection cursor on the switching screen 137a moves according to the twisting degree of the finger 2 performing the Twist operation.
  • a folder list of documents etc. is displayed by the file browser application, for example, a folder is selected by Tap operation, a context menu is displayed by Power press operation, and status (importance etc.) can be changed by Twist operation. May be.
  • FIG. 24 is a diagram for explaining an example of the Twist operation in the file browser.
  • a mark 140 indicating the status (for example, the importance level is displayed). (Star mark shown) can be given.
  • the status which can be provided is not limited to one type, For example, according to the twist condition of the finger
  • this technique can also take the following structures.
  • a determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
  • a display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
  • An information processing apparatus comprising: (2) The determination unit further determines a tap operation, a long press operation, a swipe operation, a flick operation, or a drag operation by the operation body on the operation input screen based on operation information by the operation body on the operation input screen, The information processing apparatus according to (1), wherein the display control unit performs display control different from the twist operation according to the determined tap operation, long press operation, swipe operation, flick operation, or drag operation.
  • the information processing apparatus displays a parameter adjustment screen in accordance with the twist operation and adjusts the parameter in accordance with a twisting degree in the twist operation.
  • the display control unit Scroll through the index search as you swipe, The information processing apparatus according to (1) or (2), wherein when the swipe operation is switched to the twist operation, display control is performed so that the list in the corresponding index is scrolled.
  • the display control unit Move the viewpoint of the display screen according to the swipe operation, Control to move the line of sight of the display screen according to a twist operation, The information processing apparatus according to (1) or (2).
  • the display control unit Move the focus between the text buttons on the software keyboard according to the swipe operation, Perform character type switching control of the corresponding character button according to the twist operation.
  • the information processing apparatus according to (1) or (2).
  • the determination unit Based on the change of the ground plane by the operating body to the operation input screen and the change of the center of gravity of the ground plane, the change of the ground plane and the positional relationship between the changed ground plane and the center of gravity before the change are The information processing apparatus according to any one of (1) to (6), wherein when the predetermined condition is satisfied, the twist operation is determined.
  • the determination unit changes the shape of the ground contact surface to a predetermined shape, the changed ground contact surface does not include the pre-change center point, and the distance between the pre-change center point and the post-change center point is a predetermined value.
  • the information processing apparatus according to (7), wherein when it is within the range, the twist operation is determined.
  • the area of the ground plane changes to a predetermined ratio, the ground plane after the change does not include the center of gravity before the change, and the distance between the center of gravity before the change and the center of gravity after the change is a predetermined
  • the information processing apparatus according to (7), wherein when it is within the range, the twist operation is determined.
  • Processor Determining the twisting operation by the operating body on the operation input screen as a twist operation based on the operation information by the operating body on the operation input screen; Performing predetermined display control corresponding to the application in accordance with the determined twist operation; Including an information processing method.
  • Computer A determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
  • a display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
  • a program that functions as

Abstract

[Problem] To provide an information processing device, information processing method, and program which are capable of achieving a more intuitive gesture control. [Solution] Provided is an information processing device comprising: an assessment unit which, on the basis of information on operations by an operating body on an operation input screen, assesses as a twist operation a twisting action by the operating body on the operation input screen; and a display control unit which, in response to the assessed twist operation, carries out a prescribed display control corresponding to the application.

Description

情報処理装置、情報処理方法、およびプログラムInformation processing apparatus, information processing method, and program
　本開示は、情報処理装置、情報処理方法、およびプログラムに関する。 The present disclosure relates to an information processing apparatus, an information processing method, and a program.
　現在、タッチパネル上の操作ジェスチャーとして、Tap、Swipe、Drag、Long pressなどが一般的に使用されている。 Currently, Tap, Swipe, Drag, Long press, etc. are generally used as operation gestures on the touch panel.
　ここで、例えば下記特許文献１では、表示部に表示される画像とユーザの操作の関係を現実の動作により近くすることが可能な情報処理装置が開示されている。 Here, for example, Patent Document 1 below discloses an information processing apparatus that can make the relationship between an image displayed on a display unit and a user's operation closer to an actual operation.
特開２０１０－３３１５８号公報JP 2010-33158 A
　しかしながら、タッチパネルデバイスの進化とともに、より詳細なタッチ情報が取得できるようになり、さらに直感的で幅広く活用できジェスチャー操作の実現が求められる。 However, with the evolution of touch panel devices, more detailed touch information can be acquired, and more intuitive and widespread use of gesture operations is required.
　そこで、本開示では、より直感的なジェスチャー操作を実現することが可能な情報処理装置、情報処理方法、およびプログラムを提案する。 Therefore, the present disclosure proposes an information processing apparatus, an information processing method, and a program capable of realizing a more intuitive gesture operation.
　本開示によれば、操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定する判定部と、前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行う表示制御部と、を備える、情報処理装置を提案する。 According to the present disclosure, a determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information on the operation input screen, and an application according to the determined twist operation And an information processing apparatus including a display control unit that performs predetermined display control corresponding to the above.
　本開示によれば、プロセッサが、操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定することと、前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行うことと、を含む、情報処理方法を提案する。 According to the present disclosure, the processor determines, as a twist operation, the twisting operation by the operating body with respect to the operation input screen based on the operation information by the operating body with respect to the operation input screen, and according to the determined twist operation. Proposing an information processing method including performing predetermined display control corresponding to an application.
　本開示によれば、コンピュータを、操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定する判定部と、前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行う表示制御部と、として機能させるプログラムを提案する。 According to the present disclosure, the computer determines, based on the operation information by the operating body on the operation input screen, the twisting operation by the operating body on the operation input screen as a twist operation, and according to the determined twist operation A program that functions as a display control unit that performs predetermined display control corresponding to an application is proposed.
　以上説明したように本開示によれば、より直感的なジェスチャー操作を実現することが可能となる。 As described above, according to the present disclosure, a more intuitive gesture operation can be realized.
　なお、上記の効果は必ずしも限定的なものではなく、上記の効果とともに、または上記の効果に代えて、本明細書に示されたいずれかの効果、または本明細書から把握され得る他の効果が奏されてもよい。 Note that the above effects are not necessarily limited, and any of the effects shown in the present specification, or other effects that can be grasped from the present specification, together with or in place of the above effects. May be played.
本開示の一実施形態による情報処理装置の構成の一例を示す図である。It is a figure showing an example of composition of an information processor by one embodiment of this indication. 本実施形態による情報処理装置の動作処理について説明する図である。It is a figure explaining the operation processing of the information processor by this embodiment. 本実施形態によるジェスチャー判定に用いる各種情報の定義について説明する図である。It is a figure explaining the definition of the various information used for gesture determination by this embodiment. 本実施形態によるTap操作の判定条件について説明する図である。It is a figure explaining the determination conditions of Tap operation by this embodiment. 本実施形態によるLong　press操作の判定条件について説明する図である。It is a figure explaining the judgment conditions of Long press operation by this embodiment. 本実施形態によるSwipe（Flick）またはDrag操作条件の判定について説明する図である。It is a figure explaining determination of Swipe (Flick) or Drag operation conditions by this embodiment. 本実施形態によるPower　Press操作の概要について説明する図である。It is a figure explaining the outline of Power Press operation by this embodiment. 本実施形態によるPower　Press操作の判定条件について説明する図である。It is a figure explaining the judgment conditions of Power Press operation by this embodiment. 本実施形態によるTwist操作の概要について説明する図である。It is a figure explaining the outline | summary of Twist operation by this embodiment. 本実施形態によるTwist操作の判定条件について説明する図である。It is a figure explaining the judgment conditions of Twist operation by this embodiment. 本実施形態によるSpiral操作の概要について説明する図である。It is a figure explaining the outline | summary of Spiral operation by this embodiment. 本実施形態によるSpiral操作の判定条件について説明する図である。It is a figure explaining the judgment conditions of Spiral operation by this embodiment. 本実施形態によるPower　Swipe（Flick）/Power　Drag操作の判定について説明する図である。It is a figure explaining determination of Power Swipe (Flick) / Power Drag operation by this embodiment. 本実施形態による移動量と経過時間に基づく操作判定条件について説明する図である。It is a figure explaining the operation determination conditions based on the movement amount and elapsed time by this embodiment. 本実施形態によるスライダーバーにおけるSwipe操作とTwist操作について説明する図である。It is a figure explaining the Swipe operation and Twist operation in the slider bar by this embodiment. 本実施形態によるアルファベットインデックスバーにおけるSwipe操作とTwist操作について説明する図である。It is a figure explaining Swipe operation and Twist operation in the alphabet index bar by this embodiment. 本実施形態による視点および視線移動におけるSwipe操作とTwist操作について説明する図である。It is a figure explaining the Swipe operation and Twist operation in a viewpoint and line-of-sight movement by this embodiment. 本実施形態によるPower　press操作によるシャッター動作について説明する図である。It is a figure explaining the shutter operation by Power press operation by this embodiment. 本実施形態によるカメラアプリケーションにおけるSpiral操作とTwist操作の一例について説明する図である。It is a figure explaining an example of Spiral operation and Twist operation in the camera application by this embodiment. 本実施形態によるContacts　listアプリケーションにおけるPower　press操作およびSpiral操作の一例について説明する図である。It is a figure explaining an example of Power press operation and Spiral operation in a Contacts list application by this embodiment. 本実施形態によるContacts　listアプリケーションにおけるTwist操作の一例について説明する図である。It is a figure explaining an example of Twist operation in the Contacts list application by this embodiment. 本実施形態によるテキスト入力におけるTwist操作の一例について説明する図である。It is a figure explaining an example of Twist operation in the text input by this embodiment. 本実施形態による通知カード表示におけるTwist操作の一例について説明する図である。It is a figure explaining an example of Twist operation in the notice card display by this embodiment. 本実施形態によるファイルブラウザにおけるTwist操作の一例について説明する図である。It is a figure explaining an example of Twist operation in the file browser by this embodiment.
　以下に添付図面を参照しながら、本開示の好適な実施の形態について詳細に説明する。なお、本明細書及び図面において、実質的に同一の機能構成を有する構成要素については、同一の符号を付することにより重複説明を省略する。 Hereinafter, preferred embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.
　また、説明は以下の順序で行うものとする。
　１．本開示の一実施形態による情報処理装置１の概要
　　１－１．構成
　　１－２．動作処理
　２．ジェスチャー判定
　　２－１．Tap操作
　　２－２．Long　press操作
　　２－３．Swipe（Flick）またはDrag操作
　　２－４．Power　Press操作
　　２－５．Twist操作
　　２－６．Spiral操作
　　２－７．Power　Swipe（Flick）/Power　Drag操作
　　２－８．補足
　３．実際のアプリケーションにおける操作例
　　３－１．スライダーバー
　　３－２．Alphabetical　index　bar
　　３－３．視点および視線移動の操作
　　３－４．カメラアプリケーション
　　３－５．Image　viewer
　　３－６．Contacts　list
　　３－７．テキスト入力
　　３－８．通知カードの表示
　　３－９．ファイルブラウザ
　４．まとめ The description will be made in the following order.
1. 1. Overview of information processing apparatus 1 according to an embodiment of the present disclosure 1-1. Configuration 1-2. Operation processing Gesture determination 2-1. Tap operation 2-2. Long press operation 2-3. Swipe (Flick) or Drag operation 2-4. Power Press operation 2-5. Twist operation 2-6. Spiral operation 2-7. Power Swipe (Flick) / Power Drag operation 2-8. Supplement 3. Example of operation in actual application 3-1. Slider bar 3-2. Alphabetical index bar
3-3. Operation of viewpoint and line-of-sight movement 3-4. Camera application 3-5. Image viewer
3-6. Contacts list
3-7. Text input 3-8. Notification card display 3-9. File browser Summary
　＜＜１．本開示の一実施形態による情報処理装置１の概要＞＞
　本実施形態では、タッチパネル等の操作入力画面への操作入力におけるジェスチャーとして、Tap、Swipe、Drag、Long　pressといった既存のジェスチャーに加えて、Power　Press、Twist、Spiral、Power　Swipe、およびPower　Dragと呼称する所定のジェスチャーを認識することを可能とする。 << 1. Overview of Information Processing Device 1 According to an Embodiment of the Present Disclosure >>
In this embodiment, in addition to existing gestures such as Tap, Swipe, Drag, Long press as gestures in operation input on an operation input screen such as a touch panel, they are called Power Press, Twist, Spiral, Power Swipe, and Power Drag. It is possible to recognize a predetermined gesture.
　詳細については後述するが、例えば「Power　Press」操作は、画面に対して指の先で触れた後にそのまま指の腹を押し付ける操作であって、接地面積の変化に基づいて認識され得る。これにより、新たな（物理的な）構成を追加することなく、既存のタッチパネル上で押し込むＵＩ操作を実現することができる。 Although details will be described later, for example, the “Power Press” operation is an operation of pressing the belly of the finger as it is after touching the screen with the tip of the finger, and can be recognized based on a change in the contact area. Thereby, UI operation pushed on the existing touch panel is realizable, without adding a new (physical) structure.
　また、「Twist」操作は、タッチした状態から指を右または左に転がす（捻る）ことで、アナログ的なコントロールを可能とする。例えば捻り具合に応じてパラメータ調整を行うＵＩ操作を実現することができる。 In addition, the “Twist” operation enables analog control by rolling (twisting) a finger from the touched state to the right or left. For example, it is possible to realize a UI operation for adjusting parameters according to the twisting condition.
　また、「Spiral」操作は、上述した「Power　Press」の状態から、指先を支点として右回りまたは左回りに回動させる操作であって、ダイヤル操作のようなＵＩ操作を実現することができる。 In addition, the “Spiral” operation is an operation of rotating clockwise or counterclockwise with the fingertip as a fulcrum from the above-mentioned “Power Press” state, and can realize a UI operation such as a dial operation.
　また、「Power　Swipe、Power　Drag」操作は、上述した「Power　Press」の状態から、指をSwipeまたはDragさせる操作であって、オブジェクトを移動させるようなＵＩで利用することが可能である。 Also, the “Power Swipe, Power Drag” operation is an operation for swiping or dragging the finger from the above-mentioned “Power Press” state, and can be used with a UI that moves the object.
　このように、本実施形態では、より直感的で幅広く活用できるジェスチャー操作を提供することができる。 Thus, in this embodiment, gesture operations that can be used more intuitively and widely can be provided.
　＜１－１．構成＞
　まず、本実施形態によるジェスチャー操作を認識する情報処理装置１の構成について図１を参照して説明する。図１は、本実施形態による情報処理装置１の構成の一例を示す図である。 <1-1. Configuration>
First, the configuration of the information processing apparatus 1 that recognizes a gesture operation according to the present embodiment will be described with reference to FIG. FIG. 1 is a diagram illustrating an example of the configuration of the information processing apparatus 1 according to the present embodiment.
　図１に示すように、情報処理装置１は、制御部１０、操作入力部１１、表示部１２、および記憶部１３を有する。 As shown in FIG. 1, the information processing apparatus 1 includes a control unit 10, an operation input unit 11, a display unit 12, and a storage unit 13.
　制御部１０は、演算処理装置および制御装置として機能し、各種プログラムに従って情報処理装置１内の動作全般を制御する。制御部１０は、例えばＣＰＵ（Central　Processing　Unit）、マイクロプロセッサ等の電子回路によって実現される。また、制御部１０は、使用するプログラムや演算パラメータ等を記憶するＲＯＭ（Read　Only　Memory）、及び適宜変化するパラメータ等を一時記憶するＲＡＭ（Random　Access　Memory）を含んでいてもよい。 The control unit 10 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 1 according to various programs. The control unit 10 is realized by an electronic circuit such as a CPU (Central Processing Unit) or a microprocessor, for example. The control unit 10 may include a ROM (Read Only Memory) that stores programs to be used, calculation parameters, and the like, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
　また、本実施形態による制御部１０は、判定部１０１および表示制御部１０２としても機能する。 Further, the control unit 10 according to the present embodiment also functions as the determination unit 101 and the display control unit 102.
　判定部１０１は、操作入力部１１により検出されたタッチ情報に基づいて、タッチパネルに対するユーザのジェスチャー判定を行う。具体的な判定方法については後述するが、本実施形態による判定部１０１は、Tap、Swipe、Drag、Long　pressといった既存のジェスチャーに加えて、Power　Press、Twist、Spiral、Power　Swipe、およびPower　Dragと呼称する所定のジェスチャーを判定することが可能である。例えば判定部１０１は、操作入力画面（タッチパネル）への操作体による接触エリア（接地面とも称す）の変化、接触エリアの中心位置（重心点とも称す）の変化、および変化した接触エリアと変化前の中心位置との関係等に基づいて、多数のジェスチャー判定を行うことが可能となる。 The determination unit 101 performs a user gesture determination on the touch panel based on the touch information detected by the operation input unit 11. Although the specific determination method will be described later, in addition to the existing gestures such as Tap, Swipe, Drag, and Long press, the determination unit 101 according to the present embodiment includes Power Press, Twist, Spiral, Power Swipe, and Power Drag. It is possible to determine a predetermined gesture to be called. For example, the determination unit 101 changes the contact area (also referred to as a ground plane) by the operating body to the operation input screen (touch panel), the change in the center position (also referred to as the center of gravity) of the contact area, and the changed contact area and before the change. A large number of gesture determinations can be performed based on the relationship with the center position.
　表示制御部１０２は、表示部１２への表示を制御し、判定部１０１により判定されたジェスチャーに応じて表示制御を行ったり、情報処理装置１で実行するアプリケーションの指示に従って表示制御を行ったりする。 The display control unit 102 controls display on the display unit 12 and performs display control according to the gesture determined by the determination unit 101 or performs display control according to an instruction of an application executed by the information processing apparatus 1. .
　操作入力部１１は、ユーザによる操作指示を受付け、その操作内容を制御部１０に出力する。操作入力部１１は、表示部１２と一体的に設けられるタッチセンサ、圧力センサ、若しくは近接センサであってもよい。ここでは一例として操作入力部１１がタッチパネルにより実現され、検出されるタッチ情報を用いてジェスチャー判定を行う例について説明するが、後述するジェスチャー判定の方法が可能であれば、用いる操作入力情報はタッチ情報に限定されず、例えば圧力センサ値、または近接センサ値であってもよい。 The operation input unit 11 receives an operation instruction from the user and outputs the operation content to the control unit 10. The operation input unit 11 may be a touch sensor, a pressure sensor, or a proximity sensor provided integrally with the display unit 12. Here, an example in which the operation input unit 11 is realized by a touch panel and performs gesture determination using detected touch information will be described as an example. However, if a gesture determination method described later is possible, the operation input information to be used is touch. It is not limited to information, For example, a pressure sensor value or a proximity sensor value may be sufficient.
　表示部１２は、各種操作入力画面を出力する表示装置である。この表示部１２は、例えば、液晶ディスプレイ（ＬＣＤ：Liquid Crystal Display）、有機ＥＬ（Electroluminescence）ディスプレイなどの表示装置であってもよい。 The display unit 12 is a display device that outputs various operation input screens. The display unit 12 may be a display device such as a liquid crystal display (LCD) or an organic EL (Electroluminescence) display.
　記憶部１３は、制御部１０の処理に用いられるプログラムや演算パラメータ等を記憶するＲＯＭ（Read　Only　Memory）、および適宜変化するパラメータ等を一時記憶するＲＡＭ（Random　Access　Memory）により実現される。 The storage unit 13 is realized by a ROM (Read Only Memory) that stores programs and calculation parameters used for the processing of the control unit 10, and a RAM (Random Access Memory) that temporarily stores parameters that change as appropriate.
　以上、本実施形態による情報処理装置１の構成について具体的に説明した。情報処理装置１は、例えばスマートフォン、携帯電話端末、タブレット端末、ウェアラブルデバイス（例えばスマートバンド、スマートウォッチ）、ＰＣ（パーソナルコンピュータ）等により実現され得る。なお情報処理装置１の構成は図１に示す例に限定されず、例えば、クライアント端末およびサーバから成る情報処理システムにより実現されてもよい。この場合、例えばクライアント端末側の操作入力部１１により検出された操作入力情報がネットワーク上のサーバに送信され、サーバ側において、ジェスチャー判定が行われ、さらに判定されたジェスチャーに基づく表示制御信号がクライアント端末に送信される。 The configuration of the information processing apparatus 1 according to the present embodiment has been specifically described above. The information processing apparatus 1 can be realized by, for example, a smartphone, a mobile phone terminal, a tablet terminal, a wearable device (for example, a smart band, a smart watch), a PC (personal computer), or the like. The configuration of the information processing apparatus 1 is not limited to the example illustrated in FIG. 1, and may be realized by an information processing system including a client terminal and a server, for example. In this case, for example, operation input information detected by the operation input unit 11 on the client terminal side is transmitted to a server on the network, gesture determination is performed on the server side, and a display control signal based on the determined gesture is transmitted to the client. Sent to the terminal.
　＜１－２．動作処理＞
　続いて、本実施形態による情報処理装置の動作処理について図２を参照して説明する。 <1-2. Operation processing>
Subsequently, an operation process of the information processing apparatus according to the present embodiment will be described with reference to FIG.
　　図２は、本実施形態による情報処理装置の動作処理を示すフローチャートである。図２に示すように、まず、情報処理装置１の表示制御部１０２は、所定のユーザインタフェース（すなわち操作入力画面）を表示部１２に表示し（ステップＳ１０３）、ユーザインタフェースに対するユーザによる操作入力情報（ここでは、タッチ情報）を操作入力部１１から取得する（ステップＳ１０６）。 FIG. 2 is a flowchart showing an operation process of the information processing apparatus according to the present embodiment. As shown in FIG. 2, first, the display control unit 102 of the information processing apparatus 1 displays a predetermined user interface (that is, an operation input screen) on the display unit 12 (step S103), and operation input information by the user for the user interface. (Here, touch information) is acquired from the operation input unit 11 (step S106).
　次に、情報処理装置１の判定部１０１は、タッチ情報に基づいて、ジェスチャー判定を行う（ステップＳ１０９）。ジェスチャー判定の詳細については後述するが、例えば判定部１０１は、タッチ情報として、操作入力画面に対する操作体（例えばユーザの指）の接地面の位置、形状、または面積等の変化等を取得し、ジェスチャー判定を行う。 Next, the determination unit 101 of the information processing apparatus 1 performs a gesture determination based on the touch information (step S109). Details of the gesture determination will be described later. For example, the determination unit 101 acquires, as touch information, a change in the position, shape, area, or the like of the ground contact surface of the operation body (for example, the user's finger) with respect to the operation input screen, Perform gesture determination.
　そして、情報処理装置１の表示制御部１０２は、判定されたジェスチャーに応じて所定の表示制御を行う（ステップＳ１１２）。 Then, the display control unit 102 of the information processing apparatus 1 performs predetermined display control according to the determined gesture (step S112).
　以上、本実施形態による動作処理について説明した。続いて、本実施形態による各種ジェスチャー判定について図面を参照して具体的に説明する。 The operation processing according to this embodiment has been described above. Next, various gesture determinations according to the present embodiment will be specifically described with reference to the drawings.
　＜＜２．ジェスチャー判定＞＞
　続いて、本実施形態によるジェスチャー判定の詳細について図面を参照して具体的に説明する。 << 2. Gesture determination >>
Next, details of gesture determination according to the present embodiment will be specifically described with reference to the drawings.
　まず、図３を参照して、本実施形態によるジェスチャー判定に用いる各種情報の定義について説明する。これらの情報は、タッチパネル等により実現される操作入力部１１により取得され得るものである。 First, with reference to FIG. 3, definitions of various information used for gesture determination according to the present embodiment will be described. Such information can be acquired by the operation input unit 11 realized by a touch panel or the like.
　図３に示すように、本実施形態では、操作入力部１１に対して、指を置いた最初の点（Start　point）にＳｎ、指の腹で接触しているエリア（面積）にＡｎ、エリアの中心（重心；Centroid　point）にＣｎといった符号を付与する。また、図３には示していないが、Ｓｎ（Start　point）がＡｎ（エリア）の外にあるときに、当該Ａｎの中で最もＳｎ（Start　point）に近い点（近似点；Proximity　point）に、Ｐｎの符号を付与する。近似点がエリア内のどの位置にあるかにより、指がどちらの方向から移動して来たかを認識することが可能となる。 As shown in FIG. 3, in the present embodiment, Sn for the first point (Start point) where the finger is placed with respect to the operation input unit 11, An for the area (area) in contact with the belly of the finger, and the area A symbol such as Cn is assigned to the center (centroid: Centroid point) of the. Although not shown in FIG. 3, when Sn (Start point) is outside An (area), the point closest to Sn (Start point) in the An (approximate point) is approximated. , Pn is given. From which position in the area the approximate point is located, it is possible to recognize from which direction the finger has moved.
　また、タッチパネル操作においては、操作の際に微妙にタッチした場所から（ユーザの意図に反して）指が動いたりすることが想定される。そのため、『指を置いた場所と指を離した場所の位置が全く同じ』ということは生じにくいが、微妙な位置のズレの発生を考慮し、これらは誤差として処理される。本明細書の以降の記載では、このような誤差の考慮については厳密には言及しないが、『位置（または形状）が同じ』といった記載においては、『誤差（ズレ）を含めて位置（または形状）が同じ』という意味を含むものとする。 Also, in the touch panel operation, it is assumed that the finger moves from a place touched delicately during the operation (as opposed to the user's intention). For this reason, it is unlikely that “the position where the finger is placed and the position where the finger is released is exactly the same”, but these are processed as errors in consideration of the occurrence of a slight positional deviation. In the following description of the present specification, consideration of such an error will not be strictly described. However, in the description “the position (or shape) is the same”, “the position (or shape) including the error (deviation)” is used. ) Is the same.
　＜２－１．Tap操作＞
　まず、Tap操作の判定について図４を参照して説明する。図４は、本実施形態によるTap操作の判定条件について説明する図である。 <2-1. Tap operation>
First, determination of the Tap operation will be described with reference to FIG. FIG. 4 is a diagram for explaining the determination conditions for the Tap operation according to the present embodiment.
　判定部１０１は、指がタッチパネル（操作入力部１１）に置かれてから離すまでの時間が例えば略１秒以内であって、かつ、図４に示すように、指を置いた場所の重心Ｃ１と、指を離した場所の重心Ｃ２が同じ場合、Tap操作と判定する。なお、さらにエリアＡ２に始点Ｓ１を含むことを条件に加えてもよい。 The determination unit 101 has a time from when the finger is placed on the touch panel (operation input unit 11) to when it is released, for example, within approximately 1 second, and as shown in FIG. 4, the center of gravity C1 of the place where the finger is placed. When the center of gravity C2 of the place where the finger is released is the same, it is determined that the Tap operation is performed. In addition, it may be added to the condition that the area A2 includes the start point S1.
　＜２－２．Long　press操作＞
　次に、Long　press操作の判定について図５を参照して説明する。図５は、本実施形態によるLong　press操作の判定条件について説明する図である。 <2-2. Long press operation>
Next, the determination of the long press operation will be described with reference to FIG. FIG. 5 is a diagram illustrating the determination conditions for the long press operation according to the present embodiment.
　判定部１０１は、指がタッチパネル（操作入力部１１）に例えば略１秒以上置かれ続けており、かつ、図５に示すように、指を置いた場所の重心Ｃ３と、指を置き続けている場所の重心Ｃ４が同じ場合、Long　press操作と判定する。なお、さらにエリアＡ３とエリアＡ４の面積に変化が無い場合を条件に加えてもよい。 For example, the determination unit 101 keeps the finger placed on the touch panel (operation input unit 11) for about 1 second or more, and as shown in FIG. If the center of gravity C4 is the same, the Long press operation is determined. In addition, the case where there is no change in the area of area A3 and area A4 may be added as a condition.
　＜２－３．Swipe（Flick）またはDrag操作＞
　次いで、Swipe（Flick）またはDrag操作の判定について図６を参照して説明する。図６は、本実施形態によるSwipe（Flick）またはDrag操作の判定条件について説明する図である。 <2-3. Swipe (Flick) or Drag operation>
Next, determination of Swipe (Flick) or Drag operation will be described with reference to FIG. FIG. 6 is a diagram illustrating determination conditions for a Swipe (Flick) or Drag operation according to the present embodiment.
　判定部１０１は、指がタッチパネルに置かれてから接地面の位置と形状と面積の変化を監視し、以下の「条件ａと条件ｂ－１」または「条件ａと条件ｂ－２」のいずれかを満たした場合に、Swipe（Flick）またはDrag操作と判定する。 The determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition a and condition b-1” or “condition a and condition b-2” If these conditions are satisfied, it is determined that the operation is Swipe (Flick) or Drag operation.
　条件ａ：指を置いてから例えば略１秒以内に指を移動させたこと。
　条件ｂ－１：指の移動前と移動後（または移動中）における接地面Ａ５、Ａ６の形状が同じであること（本条件は、接地面の形状判定が可能な場合に有用である）。
　条件ｂ－２：指の移動前と移動後（または移動中）における接地面Ａ５、Ａ６の面積が同じであること（本条件は、接地面の形状判定が出来ない場合に有用である）。 Condition a: The finger is moved within, for example, approximately one second after the finger is placed.
Condition b-1: The shapes of the ground planes A5 and A6 are the same before and after the movement of the finger (or during the movement) (this condition is useful when the shape of the ground plane can be determined).
Condition b-2: The areas of the ground planes A5 and A6 are the same before and after the movement of the finger (or during the movement) (this condition is useful when the shape of the ground plane cannot be determined).
　また、さらに、重心点Ｃ６がＣ５から離れていること、近似点Ｐ６が始点Ｓ５から離れていることを条件に加えてもよい。 Further, it may be added that the center of gravity C6 is away from C5 and the approximate point P6 is away from the starting point S5.
　また、上記条件を満たす場合に、さらにSwipe（さっと掃う操作）、Flick（なぞりながら掃く操作）、およびDrag（移動させる操作）のいずれであるかは、移動速度（指の移動の勢い）に応じて判定され得る。 In addition, when the above conditions are satisfied, whether it is Swipe (a quick sweep operation), Flick (a sweeping operation), or Drag (a movement operation) depends on the movement speed (finger movement momentum). Can be determined accordingly.
　なお、１秒以上経過してから指を動かした場合は、Long press操作と判定してもよい。 Note that if you move your finger after 1 second or more has elapsed, it may be determined to be a Long press operation.
　＜２－４．Power　Press操作＞
　続いて、Power　Press操作の判定について図７および図８を参照して説明する。図７は、本実施形態によるPower　Press操作の概要について説明する図である。 <2-4. Power Press Operation>
Next, determination of the power press operation will be described with reference to FIGS. FIG. 7 is a diagram for explaining the outline of the Power Press operation according to the present embodiment.
　図７に示すように、Power　Press操作とは、指２（特に指先）をタッチパネル（操作入力部１１）に置いてから、さらに指２の腹を接触させるように指２を寝かせて押し付ける操作である。かかる２段階の操作により、物理的な構成を追加することなく、既存のタッチパネル上で押し込むＵＩ操作を実現することができる。 As shown in FIG. 7, the power press operation is an operation in which the finger 2 (especially the fingertip) is placed on the touch panel (operation input unit 11) and then the finger 2 is laid down and pressed so that the belly of the finger 2 is brought into contact. is there. By such a two-stage operation, a UI operation for pressing on an existing touch panel can be realized without adding a physical configuration.
　図８は、本実施形態によるPower　Press操作の判定条件について説明する図である。判定部１０１は、指がタッチパネルに置かれてから接地面の位置と形状と面積の変化を監視し、以下の「条件ｃ－１と条件ｄと条件ｅ」または「条件ｃ－２と条件ｄと条件ｅ」のいずれかを満たした場合に、Power　Press操作と判定する。 FIG. 8 is a diagram for explaining the determination conditions for the Power Press operation according to the present embodiment. The determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition c-1 and condition d and condition e” or “condition c-2 and condition d” And if condition e ”is met, it is determined that the operation is a Power Press operation.
　条件ｃ－１：接地面Ａの形状が特徴的に変化した（楕円が延びた）こと（本条件は、接地面の形状判定が可能な場合に有用である）。
　条件ｃ－２：接地面Ａの面積が例えば150％程度大きくなったこと（本条件は、接地面の形状判定が出来ない場合に有用である）。
　条件ｄ：指を置いた時の重心Ｃ７が、指を押し付けた際の接地面Ａ８に含まれること。
　条件ｅ：指を置いた時の重心Ｃ７と、指を押し付けた際の重心点Ｃ８の場所が異なること。 Condition c-1: The shape of the ground plane A has changed characteristically (the ellipse has extended) (this condition is useful when the shape of the ground plane can be determined).
Condition c-2: The area of the ground plane A is increased by, for example, about 150% (this condition is useful when the shape of the ground plane cannot be determined).
Condition d: The center of gravity C7 when the finger is placed is included in the ground contact surface A8 when the finger is pressed.
Condition e: The location of the center of gravity C7 when the finger is placed and the location of the center of gravity C8 when the finger is pressed are different.
　また、さらに、重心点Ｃ８がＣ７から離れていることを条件に加えてもよい。 Furthermore, it may be added on condition that the center of gravity C8 is separated from C7.
　なお、重心点Ｃの移動方向によって操作者の位置を推測し、併せてテキストを読みやすい方向に（画面の向きをユーザの姿勢に合わせた方向に）回転させるといった表示制御も可能である。 Note that it is also possible to perform display control such as estimating the position of the operator based on the moving direction of the center of gravity C, and rotating the text in a direction in which the text is easy to read (the direction of the screen is adjusted to the user's posture).
　＜２－５．Twist操作＞
　次に、Twist操作の判定について図９および図１０を参照して説明する。図９は、本実施形態によるTwist操作の概要について説明する図である。 <2-5. Twist operation>
Next, determination of the Twist operation will be described with reference to FIGS. FIG. 9 is a diagram for explaining the outline of the Twist operation according to the present embodiment.
　図９に示すように、Twist操作とは、指２（特に指先）をタッチパネル（操作入力部１１）に置いてから、右または左の方向にタッチパネル上で指２を転がす（捻る）操作である。より具体的には、指２でタッチパネルに触れた状態から右側または左側に指２を転がして、指２の側面がタッチパネルに触れる状態（タッチパネルに対して指２の腹が垂直な状態）とする操作である。かかる２段階の操作により、物理的な構成を追加することなく、既存のタッチパネル上で、捻り具合に応じてパラメータ調整を行うＵＩ操作を実現することができる。 As shown in FIG. 9, the Twist operation is an operation of rolling (twisting) the finger 2 on the touch panel in the right or left direction after placing the finger 2 (particularly the fingertip) on the touch panel (operation input unit 11). . More specifically, the finger 2 is rolled to the right or left side from the state in which the touch panel is touched with the finger 2, and the side surface of the finger 2 touches the touch panel (the state in which the belly of the finger 2 is perpendicular to the touch panel). It is an operation. With this two-stage operation, it is possible to realize a UI operation for adjusting parameters according to the twisting condition on an existing touch panel without adding a physical configuration.
　図１０は、本実施形態によるTwist操作の判定条件について説明する図である。判定部１０１は、指がタッチパネルに置かれてから接地面の位置と形状と面積の変化を監視し、以下の「条件ｆ－１と条件ｇと条件ｈ」または「条件ｆ－２と条件ｇと条件ｈ」のいずれかを満たした場合に、Twist操作と判定する。 FIG. 10 is a diagram for explaining the determination conditions for the Twist operation according to the present embodiment. The determination unit 101 monitors changes in the position, shape, and area of the ground plane after the finger is placed on the touch panel, and the following “condition f-1 and condition g and condition h” or “condition f-2 and condition g” And the condition h ”are satisfied, the Twist operation is determined.
　条件ｆ－１：接地面Ａの形状が特徴的に変化した（細長くなった）こと（本条件は、接地面の形状判定が可能な場合に有用である）。
　条件ｆ－２：接地面Ａの面積が例えば略80％以上小さくなったこと（本条件は、接地面の形状判定が出来ない場合に有用である）。
　条件ｇ：指を置いた時の重心点Ｃ９が、捻った後の接地面Ａ１０に含まれないこと。
　条件ｈ：指を捻る前の重心点Ｃ９と、捻った後（捻っている途中）の重心点Ｃ１０が指１本分（例えば１ｃｍ）以内の距離にあること。（なお、さらに、重心点Ｃ１０が重心点Ｃ９に対して左右方向（±45°以内）に指１本分程離れていることを条件としてもよい。） Condition f-1: The shape of the ground plane A has changed characteristically (becomes elongated) (this condition is useful when the shape of the ground plane can be determined).
Condition f-2: The area of the ground plane A is reduced by, for example, about 80% or more (this condition is useful when the shape of the ground plane cannot be determined).
Condition g: The center of gravity C9 when the finger is placed is not included in the ground contact surface A10 after twisting.
Condition h: The center-of-gravity point C9 before twisting the finger and the center-of-gravity point C10 after twisting (while twisting) are within a distance of one finger (for example, 1 cm). (Furthermore, the center of gravity C10 may be separated from the center of gravity C9 by one finger in the left-right direction (within ± 45 °).)
　＜２－６．Spiral操作＞
　次いで、Spiral操作の判定について図１１および図１２を参照して説明する。図１１は、本実施形態によるSpiral操作の概要について説明する図である。 <2-6. Spiral operation>
Next, determination of the spiral operation will be described with reference to FIGS. 11 and 12. FIG. 11 is a diagram for explaining the outline of the spiral operation according to the present embodiment.
　図１１に示すように、Spiral操作とは、指２をタッチパネル（操作入力部１１）に置いてから、Power　Press操作（図７および図８参照）を行い、さらにタッチパネルに対して指２を支点として右または左方向に水平に回転させる操作である。かかる３段階の操作により、物理的な構成を追加することなく、既存のタッチパネル上で、ダイヤル操作のようなＵＩ操作を実現することができる。 As shown in FIG. 11, the Spiral operation means that the finger 2 is placed on the touch panel (operation input unit 11), then the Power Press operation (see FIGS. 7 and 8) is performed, and the finger 2 is supported on the touch panel. As an operation to rotate horizontally in the right or left direction. With these three-stage operations, a UI operation such as a dial operation can be realized on an existing touch panel without adding a physical configuration.
　図１２は、本実施形態によるSpiral操作の判定条件について説明する図である。判定部１０１は、図１２左に示すように指がタッチパネルに置かれて、次いで図１２中央に示すようにPower　Press操作が行われた後（Power　Press操作の判定条件は上述した通りである）、接地面の位置と形状と面積の変化を監視し続け、以下の「条件iと条件ｊと条件ｋと条件ｌ」を満たした場合に（図１２右に示す状態）、Spiral操作と判定する。 FIG. 12 is a diagram illustrating the determination conditions for the spiral operation according to the present embodiment. After the finger is placed on the touch panel as shown in the left of FIG. 12 and then the power press operation is performed as shown in the center of FIG. 12 (the determination conditions for the power press operation are as described above). If the following conditions “condition i, condition j, condition k, and condition l” are satisfied (the state shown on the right in FIG. 12), it is determined that the operation is a spiral operation. .
　条件ｉ：Power Press操作が行われた直後の重心点Ｃ１１からの重心点の推移を継続的に検出し、指を置いた直後の重心点Ｃ１１と指を押し付けた時（Power Press操作）の重心点Ｃ１２とを結ぶラインＬ１と、現在の重心点Ｃ１３と重心点Ｃ１１とを結ぶラインを比較し、重心点Ｃ１１を起点に回転した状態にあること。
　条件ｊ：回転させる前の接地面Ａ１２の面積と、回転させた後（または回転途中）の接地面Ａ１３の面積が同じであること。
　条件ｋ：指を置いた時の重心点Ｃ１１が、回転させた後（または回転途中）の接地面Ａ１３に含まれること。
　条件ｌ：指を置いた時の重心点Ｃ１１と回転させる前の重心点Ｃ１２との距離と、指を置いたときの重心点Ｃ１１と回転させた後（または回転途中）の重心点Ｃ１３との距離が同じであること。 Condition i: The transition of the center of gravity from the center of gravity C11 immediately after the power press operation is performed is continuously detected, and the center of gravity when the finger is pressed against the center of gravity C11 immediately after the finger is placed (power press operation) The line L1 connecting the point C12 and the line connecting the current center of gravity C13 and the center of gravity C11 are compared, and the center L1 is rotated from the center of gravity C11.
Condition j: The area of the ground plane A12 before being rotated and the area of the ground plane A13 after being rotated (or during rotation) are the same.
Condition k: The center-of-gravity point C11 when the finger is placed is included in the ground contact surface A13 after the rotation (or during the rotation).
Condition 1: The distance between the center of gravity C11 when the finger is placed and the center of gravity C12 before the rotation and the center of gravity C11 when the finger is placed and the center of gravity C13 after the rotation (or during rotation) The distance is the same.
　＜２－７．Power　Swipe（Flick）/Power　Drag操作＞
　次に、Power　Swipe（Flick）/Power　Drag操作の判定について図１３を参照して説明する。Power　Swipe（Flick）/Power　Drag操作は、Power　Press操作（図７および図８参照）の状態から指を移動（Swipe、Flick、またはDrag）させる操作である。 <2-7. Power Swipe (Flick) / Power Drag Operation>
Next, determination of the Power Swipe (Flick) / Power Drag operation will be described with reference to FIG. The Power Swipe (Flick) / Power Drag operation is an operation of moving a finger (Swipe, Flick, or Drag) from the state of the Power Press operation (see FIGS. 7 and 8).
　図１３は、本実施形態によるPower　Swipe（Flick）/Power　Drag操作の判定条件について説明する図である。判定部１０１は、図１３左に示すように指がタッチパネルに置かれて、次いで図１３中央に示すようにPower　Press操作（Power　Press操作の判定条件は上述した通りである）が行われた直後の接地面の位置と形状と面積の変化を監視し続け、以下の「条件ｍと条件ｎ」を満たした場合に（図１３右に示す状態）、Power　Swipe（Flick）/Power　Drag操作と判定する。 FIG. 13 is a diagram for explaining determination conditions for the Power Swipe (Flick) / Power Drag operation according to the present embodiment. Immediately after the finger is placed on the touch panel as shown in the left of FIG. 13 and then the power press operation (the determination conditions for the power press operation are as described above) is performed as shown in the center of FIG. Continue to monitor the changes in the position, shape and area of the ground contact surface, and when the following “condition m and condition n” are satisfied (as shown in the right side of FIG. 13), it is determined as Power Swipe (Flick) / Power Drag operation To do.
　条件ｍ：指を移動させる前の重心点Ｃ１５が、現在の接地面Ａ１６の領域外にあること。
　条件ｎ：移動させる前の接地面Ａ１５の面積と、移動させた後（または移動途中）の接地面Ａ１６の面積が同じであること。 Condition m: The center-of-gravity point C15 before moving the finger is outside the current area of the ground contact surface A16.
Condition n: The area of the ground plane A15 before being moved and the area of the ground plane A16 after being moved (or being moved) are the same.
　上記条件を満たす場合に、さらにSwipe（さっと掃う操作）、Flick（なぞりながら掃く操作）、およびDrag（移動させる操作）のいずれであるかを、移動速度（指の移動の勢い）に応じて判定し得る。 If the above conditions are met, whether it is Swipe (a quick sweep operation), Flick (a sweeping operation), or Drag (a movement operation), depending on the movement speed (moment of finger movement) It can be determined.
　また、移動後の重心点Ｃ１６が、移動前の重心点Ｃ１５から離れていることをさらに条件として加えてもよい。 Further, it may be added as a further condition that the center of gravity C16 after movement is away from the center of gravity C15 before movement.
　また、判定部１０１は、移動後の接地面Ａ１６の近似点Ｐ１６が位置する方向から指２が移動したことを判定し得る。 Also, the determination unit 101 can determine that the finger 2 has moved from the direction in which the approximate point P16 of the ground contact surface A16 after movement is located.
　＜２－８．補足＞
　以上、本実施形態によるジェスチャー判定について具体的に説明した。以下、いくつか補足説明を行う。 <2-8. Supplement>
The gesture determination according to the present embodiment has been specifically described above. Some supplementary explanations are given below.
　（２－８－１．詳細な情報が得られない場合）
　接地面Ａの形状や面積といった詳細な情報がタッチ情報から得られない場合、例えば移動量および経過時間（移動時間）に基づいてTwist操作とSwipe/Drag操作の違いを判断するようにしてもよい。以下、図１４を参照して説明する。 (2-8-1. Detailed information cannot be obtained)
When detailed information such as the shape and area of the ground plane A cannot be obtained from the touch information, for example, the difference between the Twist operation and the Swipe / Drag operation may be determined based on the movement amount and the elapsed time (movement time). . Hereinafter, a description will be given with reference to FIG.
　図１４は、本実施形態による移動量と経過時間に基づく操作判定条件について説明する図である。図１４に示すように、経過時間に応じて判定距離の閾値Ｔｈが変化するようにする。これにより、例えば指をゆっくり動かすことでより広い範囲でTwist操作が出来るようになる。 FIG. 14 is a diagram for explaining operation determination conditions based on the movement amount and the elapsed time according to the present embodiment. As shown in FIG. 14, the threshold Th of the determination distance is changed according to the elapsed time. As a result, for example, a twist operation can be performed in a wider range by slowly moving a finger.
　すなわち、Swipe/Drag操作は、経過時間（移動時間）が短い程、操作判定の距離が短くなるため、素早く動かすとこれまで通りのSwipe/Drag操作が可能であるが、遅く動かした場合は、対応する閾値Ｔｈを上回る距離を移動させることでSwipe/Drag操作と認識させることが可能となる。 In other words, the shorter the elapsed time (movement time), the shorter the distance for operation determination, the faster the Swipe / Drag operation, the faster the Swipe / Drag operation can be performed as soon as it is moved. It is possible to recognize a Swipe / Drag operation by moving a distance exceeding the corresponding threshold Th.
　また、Twist操作は、経過時間（移動時間）が長い程、操作判定の距離が長くなるため、ゆっくり動かすことで、より広くTwist操作が出来るようになる（ただし、移動速度に対応する閾値Ｔｈを下回る移動距離とする）。 Also, in the Twist operation, the longer the elapsed time (movement time), the longer the operation determination distance becomes. Therefore, the Twist operation can be performed more widely by moving slowly (however, the threshold Th corresponding to the movement speed is set). Less travel distance).
　（２－８－２．連続したジェスチャー操作）
　また、本実施形態では、上述した各ジェスチャー操作を連続して行うことが可能である。 (2-8-2. Continuous gesture operation)
Moreover, in this embodiment, it is possible to perform each gesture operation mentioned above continuously.
　例えば、Power　Press状態を一定時間保持した後、または即時に、Twist操作やSpiral操作を実行することが可能である。 For example, it is possible to execute a Twist operation or a Spiral operation after holding the Power Press state for a certain time or immediately.
　また、Twist状態を一定時間保持した後、または即時に、Spiral操作やSwipe/Drag操作を実行することが可能である。 Also, after holding the Twist state for a certain time or immediately, it is possible to execute Spiral operation or Swipe / Drag operation.
　また、Spiralの状態を一定時間保持した後、または即時に、Twist操作やSwipe/Drag操作を実行することが可能である。 Also, it is possible to execute Twist operation and Swipe / Drag operation after holding Spiral state for a certain period of time or immediately.
　また、Power　Press操作からPower　Drag操作、さらにSpiral操作と続けて実行することも可能である。 Also, it is possible to execute from Power Press operation to Power Drag operation and then Spiral operation.
　（２－８－３．調整処理）
　・画面の形状や場所による閾値の調整
　操作入力画面にCurved displayを用いる場合は湾曲した部分、または、画面の端のエリアでは、上述した閾値Ｔｈを調整し、よりTwist操作を行いやすくすることが可能である。一方、平坦部分や画面の中央などのエリアでは、よりSwipe操作やDrag操作を行いやすくするよう閾値Ｔｈを逆方向に調整するようにしてもよい。 (2-8-3. Adjustment processing)
・ Adjusting the threshold according to the shape and location of the screen When using a curved display for the operation input screen, it is possible to adjust the above-mentioned threshold Th in a curved part or the area at the edge of the screen to make the Twist operation easier. Is possible. On the other hand, in an area such as a flat portion or the center of the screen, the threshold Th may be adjusted in the reverse direction so that the Swipe operation or the Drag operation can be performed more easily.
　・端末の動きや傾きの変化による閾値の調整
　操作時の端末（情報処理装置１）の物理的な動きや傾きの変化に応じて、上述した閾値Ｔｈを調整してもよい。情報処理装置１の動きや傾きは、情報処理装置１に設けられた加速センサ、ジャイロセンサ、または地磁気センサ等（いずれも不図示）により検知され得る。 -Adjustment of threshold value due to changes in terminal movement and inclination The threshold value Th described above may be adjusted according to changes in physical movement and inclination of the terminal (information processing apparatus 1) during operation. The movement and tilt of the information processing apparatus 1 can be detected by an acceleration sensor, a gyro sensor, a geomagnetic sensor, or the like (all not shown) provided in the information processing apparatus 1.
　例えば、右方向にSwipe操作する際には情報処理装置１自体も多少右に動く場合もあるという仮定のもと、加速度センサによって情報処理装置１が右方向に動いた場合は、Swipe操作やDrag操作をより判定しやすくなるよう閾値を調整するようにしてもよい。 For example, if the information processing apparatus 1 itself moves to the right when the swipe operation is performed in the right direction, the information processing apparatus 1 may be moved to the right by the acceleration sensor. You may make it adjust a threshold value so that operation can be determined more easily.
　また、右方向にTwist操作を行う際には情報処理装置１を持っている手も併せて捻ってしまい情報処理装置１が多少傾くという仮定のもと、加速度センサによって情報処理装置１が右方向に傾いた場合は、右方向へのTwist操作をより判定しやすくなるよう閾値を調整するようにしてもよい。 Further, when the Twist operation is performed in the right direction, the hand holding the information processing apparatus 1 is twisted together, and the information processing apparatus 1 is moved in the right direction by the acceleration sensor on the assumption that the information processing apparatus 1 is slightly tilted. In the case of tilting to, the threshold value may be adjusted so that the Twist operation in the right direction can be more easily determined.
　＜＜３．実際のアプリケーションにおける操作例＞＞
　続いて、本実施形態により新たに判定することが可能となったジェスチャーの実際のアプリケーションにおける操作例について図面を参照して具体的に説明する。 << 3. Example of operation in actual application >>
Subsequently, an operation example in an actual application of a gesture that can be newly determined according to the present embodiment will be specifically described with reference to the drawings.
　タッチＵＩにおいて横方向に行われるSwipe操作は、これまで１系統のパラメータ制御しか出来なかったが、本実施形態では、Twist操作を用いることでもう１系統のパラメータ制御が可能となる。また、Spiral操作を用いることで、さらにもう１系統のパラメータ制御が可能となる。 The Swipe operation performed in the horizontal direction on the touch UI has been able to control only one system parameter so far, but in this embodiment, another system parameter control can be performed by using the Twist operation. Further, by using the spiral operation, it is possible to control another parameter.
　これらの各系統の操作は、独立したもの（図１９を参照して説明するカメラアプリケーションの例）でもよいし、関連したもの（図１５を参照して説明するスライダーバーの例など）でもよいし、一連のもの（図１６を参照して説明するAlphabetical　index　barの例）でもよい。 The operations of these systems may be independent (example of a camera application described with reference to FIG. 19) or related operations (example of a slider bar described with reference to FIG. 15). Or a series (an example of an Alphabetical index bar described with reference to FIG. 16).
　なお、本実施形態では一例として操作体に人差し指を用いているが、本実施形態はこれに限定されず、Volume調整や角度調整のような連続したアナログ操作は親指によるダイナミックな操作も可能である。また、文字選択やモード切替のような非連続操作は人差し指により細かに操作され得る。 In the present embodiment, the index finger is used as an operation body as an example, but the present embodiment is not limited to this, and continuous analog operations such as volume adjustment and angle adjustment can also be performed dynamically with the thumb. . Also, non-continuous operations such as character selection and mode switching can be finely operated with the index finger.
　＜３－１．スライダーバー＞
　図１５は、スライダーバーにおけるSwipe操作とTwist操作について説明する図である。図１５に示すように、表示部１２（操作入力部１１と一体化したタッチパネルディスプレイ）に音量調整のスライダーバー１２１が表示されている場合に、例えば指２でSwipe操作を行った場合は図１５左に示すように音量調整を可能とし、Twist操作を行った場合は図１５右に示すようにＬＲのバランス調整を可能とする。Twist操作が判定されると、表示制御部１０２は、ＬＲのバランス調整画面１２３を表示し、左右方向への回転に応じて左右のバランスを調整することが可能となる。例えば右方向への捻り具合に応じてバランス調整画面１２３のバーのつまみを右方向に動くようにしてもよいし、捻った状態を維持している間、バランス調整画面１２３のバーのつまみが右方向に動くようにしてもよい。 <3-1. Slider bar>
FIG. 15 is a diagram for explaining the Swipe operation and the Twist operation on the slider bar. As shown in FIG. 15, when the volume adjustment slider bar 121 is displayed on the display unit 12 (touch panel display integrated with the operation input unit 11), for example, when the Swipe operation is performed with the finger 2, FIG. As shown on the left, the volume can be adjusted, and when the Twist operation is performed, the LR balance can be adjusted as shown on the right of FIG. When the Twist operation is determined, the display control unit 102 displays the LR balance adjustment screen 123 and can adjust the left / right balance according to the rotation in the left / right direction. For example, the bar knob on the balance adjustment screen 123 may be moved to the right in accordance with the degree of twisting in the right direction, and the bar knob on the balance adjustment screen 123 may be moved to the right while maintaining the twisted state. It may be moved in the direction.
　このように、本実施形態によれば、指２をタッチパネルから離すことなく続けて操作可能なパラメータ制御を増やすことができ、また、より直感的なパラメータ調整が可能となる。 Thus, according to this embodiment, it is possible to increase the parameter control that can be operated continuously without releasing the finger 2 from the touch panel, and more intuitive parameter adjustment is possible.
　＜３－２．Alphabetical　index　bar＞
　図１６は、本実施形態によるアルファベットインデックスバーにおけるSwipe操作とTwist操作について説明する図である。 <3-2. Alphabetical index bar>
FIG. 16 is a diagram for explaining the Swipe operation and the Twist operation on the alphabet index bar according to the present embodiment.
　図１６に示すように、表示部１２（操作入力部１１と一体化したタッチパネルディスプレイ）にアドレス帳のアルファベットインデックスバー１２５が表示されている場合に、例えば指２でSwipe操作を行った場合は図１６左に示すようにアルファベット順にインデックス検索を可能とし、Twist操作を行った場合は図１６右に示すようにインデックス内におけるスクロールを可能とする。 As shown in FIG. 16, when the alphabet index bar 125 of the address book is displayed on the display unit 12 (touch panel display integrated with the operation input unit 11), for example, when the Swipe operation is performed with the finger 2, FIG. Index search is possible in alphabetical order as shown at 16 left, and scrolling within the index is possible as shown at right of FIG. 16 when Twist operation is performed.
　このように、本実施形態によれば、指２をタッチパネルから離すことなく続けて操作可能なパラメータ制御を増やすことができる。 Thus, according to the present embodiment, it is possible to increase the parameter control that can be operated continuously without releasing the finger 2 from the touch panel.
　＜３－３．視点および視線移動の操作＞
　図１７は、本実施形態による視点および視線移動におけるSwipe操作とTwist操作について説明する図である。例えば図１７に示すように視点および視線移動が可能な閲覧画面が表示されている際に、図１７左に示すように、Swipe操作によって場所（視点）移動を可能とし、図１７右に示すように、Twist操作によって画角（視線）移動を可能としてもよい。 <3-3. Operation of viewpoint and eye movement>
FIG. 17 is a diagram for explaining a Swipe operation and a Twist operation in viewpoint and line-of-sight movement according to the present embodiment. For example, as shown in FIG. 17, when a viewing screen capable of moving the viewpoint and the line of sight is displayed, as shown in the left of FIG. 17, the location (viewpoint) can be moved by the Swipe operation, as shown in the right of FIG. In addition, the angle of view (line of sight) may be moved by a Twist operation.
　このように、本実施形態によれば、Swipe操作とTwist操作により明確に視点および視線の移動操作を行うことができる。 Thus, according to the present embodiment, the viewpoint and line-of-sight movement operations can be clearly performed by the Swipe operation and the Twist operation.
　＜３－４．カメラアプリケーション＞
　続いて、カメラアプリケーションの場合の操作ＵＩについて図１８および図１９を参照して説明する。 <3-4. Camera application>
Next, an operation UI in the case of a camera application will be described with reference to FIGS.
　カメラアプリケーションによりスルー画面が表示部１２に表示されている際に、例えばTap操作によりフォーカスロック、Power　press操作でシャッター、Twist操作で絞り調整、Spiral操作で撮影後の画像に対する明るさ調整、Swipe操作でシーンセレクト、およびPower　Drag操作で連続撮影を行えるようにしてもよい。 When the through screen is displayed on the display unit 12 by the camera application, for example, focus is locked by Tap operation, shutter is pressed by Power press operation, aperture is adjusted by Twist operation, brightness adjustment for images after shooting is performed by Spiral operation, Swipe operation You can enable continuous shooting with scene selection and Power Drag operation.
　図１８は、Power　press操作によるシャッター動作について説明する図である。図１８左に示すように、表示部１２（操作入力部１１と一体化したタッチパネルディスプレイ）におけるスルー画面上に指２を置き、この状態ではTap操作と判定されてフォーカスロックが行われ、さらに図１８右に示すように指２の腹を押し付けるPower　press操作によりシャッターを切ることが可能となる。 FIG. 18 is a diagram for explaining the shutter operation by the power press operation. As shown on the left side of FIG. 18, the finger 2 is placed on the through screen in the display unit 12 (touch panel display integrated with the operation input unit 11). In this state, it is determined that the Tap operation is performed, and focus lock is performed. 18 As shown on the right, the shutter can be released by the power press operation that presses the belly of the finger 2.
　図１９は、カメラアプリケーションにおけるSpiral操作とTwist操作の一例について説明する図である。図１９に示すように、例えばSpiral操作に応じて明るさ調整画面１２７が表示されると共に、明るさ調整画面１２７において、指先を支点として右回りまたは左回りに回動させるダイヤル操作のような動きにより明るさ調整を行うことが可能である。また、Twist操作に応じて絞り調整画面１２９が表示されると共に、捻り具合に応じて絞り値調整を行うことが可能である。 FIG. 19 is a diagram for explaining an example of a spiral operation and a twist operation in a camera application. As shown in FIG. 19, for example, a brightness adjustment screen 127 is displayed in response to a spiral operation, and the brightness adjustment screen 127 moves like a dial operation that rotates clockwise or counterclockwise with a fingertip as a fulcrum. It is possible to adjust the brightness. In addition, the aperture adjustment screen 129 is displayed according to the Twist operation, and the aperture value can be adjusted according to the twist.
　このように、いずれもアナログ的なコントロールを可能とし、より直感的にパラメータ制御を行うことができる。 In this way, analog control is possible, and parameter control can be performed more intuitively.
　＜３－５．Image　viewer＞
　次いで、Image　viewerにおける操作例について説明する。 <3-5. Image viewer>
Next, an operation example in the image viewer will be described.
　Image　viewerアプリケーションにより画像が表示部１２に表示されている際に、例えばTap操作により情報表示のＯＮ／ＯＦＦを可能とし、Power　press操作で詳細情報をオーバーレイ表示させるようにしてもよい。 When an image is displayed on the display unit 12 by the Image viewer application, for example, the information display may be turned ON / OFF by a Tap operation, and detailed information may be displayed in an overlay by a Power press operation.
　また、Twist操作でフィルター切り替えを可能とし、Spiral操作で（詳細情報のオーバーレイ表示をキャンセルした上で）ズームイン／ズームアウトを行うようにしてもよい。 Also, the filter can be switched by Twist operation, and zoom in / out may be performed by Spiral operation (after canceling the overlay display of detailed information).
　また、Swipe操作で次／前の画像を表示させ、Power　Drag操作で詳細情報の切り替えを行うようにすることが可能である。 Also, it is possible to display the next / previous image with the Swipe operation and switch the detailed information with the Power Drag operation.
　＜３－６．Contacts　list＞
　次に、Contacts　list（連絡先一覧）における操作例について説明する。 <3-6. Contacts list>
Next, an operation example in the Contacts list will be described.
　Contacts　listアプリケーションにより連絡先一覧画面が表示部１２に表示されている際に、例えばTap操作により選択し、Power　press操作により内容Preview（メールアドレス、住所など）を表示させ、Twist操作によりグループ登録を行い、Spiral操作でメールアドレス、住所などを選択して機能実行（メール作成、電話発信）するようにしてもよい。以下、図２０および図２１を参照して具体的に説明する。 When the contact list screen is displayed on the display unit 12 by the Contacts list application, for example, it is selected by Tap operation, the content Preview (email address, address, etc.) is displayed by Power press operation, and group registration is performed by Twist operation. It is also possible to execute a function (email creation, telephone call) by selecting an e-mail address, an address, etc. by a spiral operation. Hereinafter, a specific description will be given with reference to FIGS.
　図２０は、Contacts　listアプリケーションにおけるPower　press操作およびSpiral操作の一例について説明する図である。図２０左に示すように、表示部１２に連絡先一覧画面が表示されている際に、Tap操作により連絡先を選択してそのままPower　press操作を行うと、内容Preview画面１３０が表示される。 FIG. 20 is a diagram for explaining an example of the Power press operation and the Spiral operation in the Contacts list application. As shown on the left side of FIG. 20, when a contact list screen is displayed on the display unit 12, when a contact is selected by Tap operation and Power Press operation is performed as it is, a content preview screen 130 is displayed.
　次いで、図２０右に示すように、表示部１２に内容Preview画面１３０が表示された状態でSpiral操作を行うと、内容Preview画面１３０に表示されている詳細情報の選択実行が可能となる。なお選択カーソルは、Spiral操作の回転具合に応じて順次移動する。 Next, as shown in the right side of FIG. 20, when the Spiral operation is performed in a state where the content preview screen 130 is displayed on the display unit 12, the detailed information displayed on the content preview screen 130 can be selected and executed. Note that the selection cursor moves sequentially according to the degree of rotation of the spiral operation.
　図２１は、Contacts　listアプリケーションにおけるTwist操作の一例について説明する図である。図２１に示すように、連絡先を選択して内容Preview画面１３０が表示された状態でTwist操作を行うと、グループ登録画面１３２が表示される。ユーザは任意のグループにカーソルを合わせてグループ登録することが可能である。なお選択カーソルは、Twist操作の捻り具合に応じて順次移動する。 FIG. 21 is a diagram for explaining an example of the Twist operation in the Contacts list application. As shown in FIG. 21, when a Twist operation is performed in a state where a contact is selected and the content preview screen 130 is displayed, a group registration screen 132 is displayed. The user can register a group by moving the cursor to an arbitrary group. Note that the selection cursor moves sequentially according to the twist of the Twist operation.
　＜３－７．テキスト入力＞
　次に、ソフトウェアキーボードが表示されてテキスト入力を行い際の操作例について説明する。 <3-7. Text input>
Next, an operation example when a software keyboard is displayed and text is input will be described.
　この場合、例えばSwipe操作で文字ボタン間のフォーカスを移動させ、また、Twist操作で文字ボタン上の文字種切り替えを行うことが可能である。以下、図２２を参照して具体的に説明する。 In this case, for example, the focus between character buttons can be moved by a Swipe operation, and the character type on the character button can be switched by a Twist operation. Hereinafter, a specific description will be given with reference to FIG.
　図２２は、テキスト入力におけるTwist操作の一例について説明する図である。図２２に示すように、任意の文字ボタン上でTwist操作を行うと、当該文字ボタンに対応する複数の文字種の切替が可能となる。文字種の切替は、例えばTwist操作の捻り具合に応じて切り替えられる。 FIG. 22 is a diagram for explaining an example of a Twist operation in text input. As shown in FIG. 22, when a Twist operation is performed on an arbitrary character button, a plurality of character types corresponding to the character button can be switched. The character type is switched according to, for example, the twist of the Twist operation.
　このように、本実施形態によれば、Swipe操作で文字ボタン間のフォーカスを移動させ、指２をタッチパネルから離すことなく続けてTwist操作により文字種の切替を行うことができる。また、Twist操作後に（目当ての文字種が見つからず）やはり他の文字ボタンに移りたいと思った際も、指２をタッチパネルから離すことなくそのままSwipe操作に移行して文字ボタン間のフォーカスを再度移動させることが可能である。 As described above, according to the present embodiment, the focus between character buttons is moved by the Swipe operation, and the character type can be switched by the Twist operation without releasing the finger 2 from the touch panel. Also, when you want to move to another character button after the Twist operation (the target character type is not found), move to the Swipe operation without moving the finger 2 from the touch panel and move the focus between the character buttons again. It is possible to make it.
　＜３－８．通知カードの表示＞
　続いて、スマートフォンやタブレット端末等において、ホーム画面やロック画面において表示される通知カードの表示における操作例について説明する。 <3-8. Notification card display>
Next, an operation example in displaying a notification card displayed on a home screen or a lock screen on a smartphone or a tablet terminal will be described.
　表示された通知カードに対し、例えばTap操作により通知カードを開き、Power　press操作でコンテキストメニューを表示させ、Twist操作で表示制限の切り替えを行い、Spiral操作で（コンテキストメニュー表示をキャンセルした上で）通知カードのExpand/Collapse（展開、折り畳み）を行う。 For the displayed notification card, for example, open the notification card by Tap operation, display the context menu by Power press operation, switch the display restriction by Twist operation, and by Spiral operation (after canceling the context menu display) Perform Expand / Collapse of the notification card.
　また、Swipe操作でDismiss（通知カードの削除）を行い、Power　Drag操作でコンテキストメニューの項目選択が行えるようにしてもよい。ここで、通知カード表示におけるTwist操作の一例について図２３を参照して説明する。 Also, Dismiss (delete notification card) may be performed with Swipe operation, and context menu items may be selected with Power Drag operation. Here, an example of the Twist operation in the notification card display will be described with reference to FIG.
　図２３は、本実施形態による通知カード表示におけるTwist操作の一例について説明する図である。図２３左に示すように、例えば通知カード１３６ａ～１３６ｂが表示されている際に、指２で任意の通知カード１３６ａに対してTwist操作を行うと、図２３右に示すように、表示制限の切替画面１３７ａが表示される。表示制限の切替画面１３７ａでは、選択した通知カードの種別に応じた表示制限の切替が可能である。図２３に示す例では、受信メールの通知カードであるため、切替画面１３７ａでは、通知カードの表示制限として、「差出人のみ」「タイトルのみ」「差出人とタイトル」「本文まで」のいずれかを選択することが可能である。切替画面１３７ａの選択カーソルは、Twist操作を行う指２の捻り具合に応じて移動する。 FIG. 23 is a diagram for explaining an example of the Twist operation in the notification card display according to the present embodiment. As shown in the left side of FIG. 23, for example, when notification cards 136a to 136b are displayed, if the Twist operation is performed with respect to any notification card 136a with the finger 2, the display restriction is set as shown in the right side of FIG. A switching screen 137a is displayed. On the display restriction switching screen 137a, the display restriction can be switched according to the type of the selected notification card. In the example shown in FIG. 23, since it is a notification card for received mail, on the switching screen 137a, any one of “sender only”, “title only”, “sender and title”, and “up to text” is selected as the notification card display restriction. Is possible. The selection cursor on the switching screen 137a moves according to the twisting degree of the finger 2 performing the Twist operation.
　＜３－９．ファイルブラウザ＞
　次に、ファイルブラウザが表示されている際における操作例について説明する。 <3-9. File Browser>
Next, an operation example when the file browser is displayed will be described.
　ファイルブラウザアプリケーションによりドキュメント等のフォルダ一覧が表示されている際に、例えばTap操作でフォルダを選択し、Power　press操作でコンテキストメニューを表示させ、Twist操作でステータス（重要度など）を変更できるようにしてもよい。 When a folder list of documents etc. is displayed by the file browser application, for example, a folder is selected by Tap operation, a context menu is displayed by Power press operation, and status (importance etc.) can be changed by Twist operation. May be.
　また、Spiral操作で（コンテキストメニュー表示をキャンセルした上で）アーカイブ先（保存先）の選択を行い、Power　Drag操作でコンテキストメニューの項目選択を行えるようにしてもよい。 Also, it is possible to select the archive destination (save destination) with the Spiral operation (after canceling the context menu display), and to select the context menu item with the Power Drag operation.
　以下、特にTwist操作の場合について図２４を参照して説明する。図２４は、ファイルブラウザにおけるTwist操作の一例について説明する図である。 Hereinafter, the case of the Twist operation will be described with reference to FIG. FIG. 24 is a diagram for explaining an example of the Twist operation in the file browser.
　図２４に示すように、表示部１２にドキュメント等のフォルダ一覧が表示されている際に、指２で任意のフォルダ表示に対してTwist操作を行うと、ステータスを示すマーク１４０（例えば重要度を示す星マーク）を付与することが可能となる。なお付与可能なステータスは１種類に限定されず、例えば指２の捻り具合に応じて任意のマークに切り替えることが可能である。 As shown in FIG. 24, when a Twist operation is performed with respect to an arbitrary folder display with the finger 2 while a list of folders such as documents is displayed on the display unit 12, a mark 140 indicating the status (for example, the importance level is displayed). (Star mark shown) can be given. In addition, the status which can be provided is not limited to one type, For example, according to the twist condition of the finger | toe 2, it can switch to arbitrary marks.
　＜＜４．まとめ＞＞
　上述したように、本開示の実施形態による情報処理装置１では、より直感的なジェスチャー操作を実現することが可能となる。 << 4. Summary >>
As described above, the information processing apparatus 1 according to the embodiment of the present disclosure can realize a more intuitive gesture operation.
　以上、添付図面を参照しながら本開示の好適な実施形態について詳細に説明したが、本技術はかかる例に限定されない。本開示の技術分野における通常の知識を有する者であれば、特許請求の範囲に記載された技術的思想の範疇内において、各種の変更例または修正例に想到し得ることは明らかであり、これらについても、当然に本開示の技術的範囲に属するものと了解される。 The preferred embodiments of the present disclosure have been described in detail above with reference to the accompanying drawings, but the present technology is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field of the present disclosure can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that it belongs to the technical scope of the present disclosure.
　例えば、上述した情報処理装置１に内蔵されるＣＰＵ、ＲＯＭ、およびＲＡＭ等のハードウェアに、情報処理装置１の機能を発揮させるためのコンピュータプログラムも作成可能である。また、当該コンピュータプログラムを記憶させたコンピュータ読み取り可能な記憶媒体も提供される。 For example, it is possible to create a computer program for causing hardware such as a CPU, ROM, and RAM incorporated in the information processing apparatus 1 described above to exhibit the functions of the information processing apparatus 1. A computer-readable storage medium storing the computer program is also provided.
　また、本明細書に記載された効果は、あくまで説明的または例示的なものであって限定的ではない。つまり、本開示に係る技術は、上記の効果とともに、または上記の効果に代えて、本明細書の記載から当業者には明らかな他の効果を奏しうる。 In addition, the effects described in this specification are merely illustrative or illustrative, and are not limited. That is, the technology according to the present disclosure can exhibit other effects that are apparent to those skilled in the art from the description of the present specification in addition to or instead of the above effects.
　なお、本技術は以下のような構成も取ることができる。
（１）
　操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定する判定部と、
　前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行う表示制御部と、
を備える、情報処理装置。
（２）
　前記判定部は、操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体によるタップ操作、ロングプレス操作、スワイプ操作、フリック操作、またはドラッグ操作をさらに判定し、
　前記表示制御部は、前記判定したタップ操作、ロングプレス操作、スワイプ操作、フリック操作、またはドラッグ操作に応じて、前記ツイスト操作と異なる表示制御を行う、前記（１）に記載の情報処理装置。
（３）
　前記表示制御部は、前記ツイスト操作に応じてパラメータ調整画面を表示し、前記ツイスト操作における捻り具合に応じてパラメータの調整を行う、前記（１）または（２）に記載の情報処理装置。
（４）
　前記表示制御部は、
　　スワイプ操作に応じてインデックスの検索をスクロール表示し、
　　前記スワイプ操作からツイスト操作に切り替えられた時点で、対応するインデックス内におけるリストをスクロールするよう表示制御する、前記（１）または（２）に記載の情報処理装置。
（５）
　前記表示制御部は、
　　スワイプ操作に応じて表示画面の視点移動を行い、
　　ツイスト操作に応じて前記表示画面の視線移動を行うよう制御する、
前記（１）または（２）に記載の情報処理装置。
（６）
　前記表示制御部は、
　　スワイプ操作に応じてソフトウェアキーボードの文字ボタン間のフォーカス移動を行い、
　　ツイスト操作に応じて対応する文字ボタンの文字種切り替え制御を行う、
前記（１）または（２）に記載の情報処理装置。
（７）
　前記判定部は、
　　前記操作入力画面への前記操作体による接地面の変化と、前記接地面の重心点の変化に基づいて、前記接地面の変化、および変化後の接地面と変化前の重心点の位置関係が所定の条件を満たす場合、ツイスト操作と判定する、前記（１）～（６）のいずれか１項に記載の情報処理装置。
（８）
　前記判定部は、前記接地面の形状が所定の形状に変化し、変化後の接地面が変化前の重心点を含まず、かつ変化前の重心点と変化後の重心点の距離が所定の範囲内にある場合、ツイスト操作と判定する、前記（７）に記載の情報処理装置。
（９）
　前記判定部は、前記接地面の面積が所定の割合に変化し、変化後の接地面が変化前の重心点を含まず、かつ変化前の重心点と変化後の重心点の距離が所定の範囲内にある場合、ツイスト操作と判定する、前記（７）に記載の情報処理装置。
（１０）
　プロセッサが、
　操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定することと、
　前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行うことと、
を含む、情報処理方法。
（１１）
　コンピュータを、
　操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定する判定部と、
　前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行う表示制御部と、
として機能させる、プログラム。 In addition, this technique can also take the following structures.
(1)
A determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
A display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
An information processing apparatus comprising:
(2)
The determination unit further determines a tap operation, a long press operation, a swipe operation, a flick operation, or a drag operation by the operation body on the operation input screen based on operation information by the operation body on the operation input screen,
The information processing apparatus according to (1), wherein the display control unit performs display control different from the twist operation according to the determined tap operation, long press operation, swipe operation, flick operation, or drag operation.
(3)
The information processing apparatus according to (1) or (2), wherein the display control unit displays a parameter adjustment screen in accordance with the twist operation and adjusts the parameter in accordance with a twisting degree in the twist operation.
(4)
The display control unit
Scroll through the index search as you swipe,
The information processing apparatus according to (1) or (2), wherein when the swipe operation is switched to the twist operation, display control is performed so that the list in the corresponding index is scrolled.
(5)
The display control unit
Move the viewpoint of the display screen according to the swipe operation,
Control to move the line of sight of the display screen according to a twist operation,
The information processing apparatus according to (1) or (2).
(6)
The display control unit
Move the focus between the text buttons on the software keyboard according to the swipe operation,
Perform character type switching control of the corresponding character button according to the twist operation.
The information processing apparatus according to (1) or (2).
(7)
The determination unit
Based on the change of the ground plane by the operating body to the operation input screen and the change of the center of gravity of the ground plane, the change of the ground plane and the positional relationship between the changed ground plane and the center of gravity before the change are The information processing apparatus according to any one of (1) to (6), wherein when the predetermined condition is satisfied, the twist operation is determined.
(8)
The determination unit changes the shape of the ground contact surface to a predetermined shape, the changed ground contact surface does not include the pre-change center point, and the distance between the pre-change center point and the post-change center point is a predetermined value. The information processing apparatus according to (7), wherein when it is within the range, the twist operation is determined.
(9)
In the determination unit, the area of the ground plane changes to a predetermined ratio, the ground plane after the change does not include the center of gravity before the change, and the distance between the center of gravity before the change and the center of gravity after the change is a predetermined The information processing apparatus according to (7), wherein when it is within the range, the twist operation is determined.
(10)
Processor
Determining the twisting operation by the operating body on the operation input screen as a twist operation based on the operation information by the operating body on the operation input screen;
Performing predetermined display control corresponding to the application in accordance with the determined twist operation;
Including an information processing method.
(11)
Computer
A determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
A display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
A program that functions as
　１　情報処理装置
　１０　制御部
　１１　操作入力部
　１２　表示部
　１３　記憶部
　１０１　判定部
　１０２　表示制御部 DESCRIPTION OF SYMBOLS 1 Information processing apparatus 10 Control part 11 Operation input part 12 Display part 13 Storage part 101 Judgment part 102 Display control part

Claims (11)

  1. 　操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定する判定部と、
    　前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行う表示制御部と、
    を備える、情報処理装置。     A determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
    A display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
    An information processing apparatus comprising:
  2. 　前記判定部は、操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体によるタップ操作、ロングプレス操作、スワイプ操作、フリック操作、またはドラッグ操作をさらに判定し、
    　前記表示制御部は、前記判定したタップ操作、ロングプレス操作、スワイプ操作、フリック操作、またはドラッグ操作に応じて、前記ツイスト操作と異なる表示制御を行う、請求項１に記載の情報処理装置。     The determination unit further determines a tap operation, a long press operation, a swipe operation, a flick operation, or a drag operation by the operation body on the operation input screen based on operation information by the operation body on the operation input screen,
    The information processing apparatus according to claim 1, wherein the display control unit performs display control different from the twist operation according to the determined tap operation, long press operation, swipe operation, flick operation, or drag operation.
  3. 　前記表示制御部は、前記ツイスト操作に応じてパラメータ調整画面を表示し、前記ツイスト操作における捻り具合に応じてパラメータの調整を行う、請求項１に記載の情報処理装置。 The information processing apparatus according to claim 1, wherein the display control unit displays a parameter adjustment screen according to the twist operation, and adjusts the parameter according to a twisting degree in the twist operation.
  4. 　前記表示制御部は、
    　　スワイプ操作に応じてインデックスの検索をスクロール表示し、
    　　前記スワイプ操作からツイスト操作に切り替えられた時点で、対応するインデックス内におけるリストをスクロールするよう表示制御する、請求項１に記載の情報処理装置。     The display control unit
    Scroll through the index search as you swipe,
    The information processing apparatus according to claim 1, wherein display control is performed so that a list in a corresponding index is scrolled when the swipe operation is switched to a twist operation.
  5. 　前記表示制御部は、
    　　スワイプ操作に応じて表示画面の視点移動を行い、
    　　ツイスト操作に応じて前記表示画面の視線移動を行うよう制御する、
    請求項１に記載の情報処理装置。     The display control unit
    Move the viewpoint of the display screen according to the swipe operation,
    Control to move the line of sight of the display screen according to a twist operation,
    The information processing apparatus according to claim 1.
  6. 　前記表示制御部は、
    　　スワイプ操作に応じてソフトウェアキーボードの文字ボタン間のフォーカス移動を行い、
    　　ツイスト操作に応じて対応する文字ボタンの文字種切り替え制御を行う、
    請求項１に記載の情報処理装置。     The display control unit
    Move the focus between the text buttons on the software keyboard according to the swipe operation,
    Perform character type switching control of the corresponding character button according to the twist operation.
    The information processing apparatus according to claim 1.
  7. 　前記判定部は、
    　　前記操作入力画面への前記操作体による接地面の変化と、前記接地面の重心点の変化に基づいて、前記接地面の変化、および変化後の接地面と変化前の重心点の位置関係が所定の条件を満たす場合、ツイスト操作と判定する、請求項１に記載の情報処理装置。     The determination unit
    Based on the change of the ground plane by the operating body to the operation input screen and the change of the center of gravity of the ground plane, the change of the ground plane and the positional relationship between the changed ground plane and the center of gravity before the change are The information processing apparatus according to claim 1, wherein when the predetermined condition is satisfied, the twist operation is determined.
  8. 　前記判定部は、前記接地面の形状が所定の形状に変化し、変化後の接地面が変化前の重心点を含まず、かつ変化前の重心点と変化後の重心点の距離が所定の範囲内にある場合、ツイスト操作と判定する、請求項７に記載の情報処理装置。 The determination unit changes the shape of the ground contact surface to a predetermined shape, the changed ground contact surface does not include the pre-change center point, and the distance between the pre-change center point and the post-change center point is a predetermined value. The information processing apparatus according to claim 7, wherein when it is within the range, the twist operation is determined.
  9. 　前記判定部は、前記接地面の面積が所定の割合に変化し、変化後の接地面が変化前の重心点を含まず、かつ変化前の重心点と変化後の重心点の距離が所定の範囲内にある場合、ツイスト操作と判定する、請求項７に記載の情報処理装置。 In the determination unit, the area of the ground plane changes to a predetermined ratio, the ground plane after the change does not include the center of gravity before the change, and the distance between the center of gravity before the change and the center of gravity after the change is a predetermined The information processing apparatus according to claim 7, wherein when it is within the range, the twist operation is determined.
  10. 　プロセッサが、
    　操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定することと、
    　前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行うことと、
    を含む、情報処理方法。     Processor
    Determining the twisting operation by the operating body on the operation input screen as a twist operation based on the operation information by the operating body on the operation input screen;
    Performing predetermined display control corresponding to the application in accordance with the determined twist operation;
    Including an information processing method.
  11. 　コンピュータを、
    　操作入力画面に対する操作体による操作情報に基づいて、当該操作入力画面に対する操作体による捻り動作をツイスト操作として判定する判定部と、
    　前記判定されたツイスト操作に応じて、アプリケーションに対応する所定の表示制御を行う表示制御部と、
    として機能させる、プログラム。     Computer
    A determination unit that determines, as a twist operation, a twisting operation by the operating body on the operation input screen based on operation information by the operating body on the operation input screen;
    A display control unit that performs predetermined display control corresponding to the application in accordance with the determined twist operation;
    A program that functions as
PCT/JP2018/003081 2017-04-03 2018-01-31 Information processing device, information processing method, and program WO2018186011A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017073904 2017-04-03
JP2017-073904 2017-04-03

Publications (1)

Publication Number Publication Date
WO2018186011A1 true WO2018186011A1 (en) 2018-10-11

Family

ID=63712473

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2018/003081 WO2018186011A1 (en) 2017-04-03 2018-01-31 Information processing device, information processing method, and program

Country Status (1)

Country Link
WO (1) WO2018186011A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010503130A (en) * 2006-09-11 2010-01-28 アップル インコーポレイテッド Media player with image-based browsing
JP2011014045A (en) * 2009-07-03 2011-01-20 Sony Corp Map information display device, map information display method, and program
US20120302291A1 (en) * 2011-05-24 2012-11-29 Microsoft Corporation User character input interface with modifier support
JP2013003962A (en) * 2011-06-20 2013-01-07 Konica Minolta Business Technologies Inc Information browsing-device, display control program, and display control method
US20130318482A1 (en) * 2012-05-24 2013-11-28 International Business Machines Corporation Gestural control for quantitative inputs

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010503130A (en) * 2006-09-11 2010-01-28 アップル インコーポレイテッド Media player with image-based browsing
JP2011014045A (en) * 2009-07-03 2011-01-20 Sony Corp Map information display device, map information display method, and program
US20120302291A1 (en) * 2011-05-24 2012-11-29 Microsoft Corporation User character input interface with modifier support
JP2013003962A (en) * 2011-06-20 2013-01-07 Konica Minolta Business Technologies Inc Information browsing-device, display control program, and display control method
US20130318482A1 (en) * 2012-05-24 2013-11-28 International Business Machines Corporation Gestural control for quantitative inputs

Similar Documents

Publication Publication Date Title
US10936153B2 (en) Method and apparatus for providing a user interface on a device enabling selection of operations to be performed in relation to content
US10698567B2 (en) Method and apparatus for providing a user interface on a device that indicates content operators
US9081498B2 (en) Method and apparatus for adjusting a user interface to reduce obscuration
CN110658972B (en) Information processing apparatus, information processing method, and computer readable medium
US20100211915A1 (en) Input apparatus, input method, and recording medium recording input program
EP2631762A1 (en) Method and apparatus for providing an option to enable multiple selections
US20130227413A1 (en) Method and Apparatus for Providing a Contextual User Interface on a Device
US20130239058A1 (en) Handheld devices and controlling methods using the same
US20130227454A1 (en) Method and Apparatus for Providing an Option to Undo a Delete Operation
US20190095068A1 (en) Portable terminal device
JP2013097563A (en) Input control device, input control method, and input control program
JP2011243157A (en) Electronic apparatus, button size control method, and program
KR20150025059A (en) Method and apparatus for display a scereen in electronic device having a touch device
JP6342297B2 (en) Display control apparatus and display control method
WO2018186011A1 (en) Information processing device, information processing method, and program
US10416870B2 (en) Display control device and non-transitory computer-readable storage medium having program recorded thereon
JP6034140B2 (en) Display device, display control method, and program
JP6213597B2 (en) Display control apparatus, display control method, and program
JP5955421B2 (en) Input device, input support method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18781727

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18781727

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP