WO2013168508A1 - 情報処理装置、情報処理方法、及びプログラム - Google Patents
情報処理装置、情報処理方法、及びプログラム Download PDFInfo
- Publication number
- WO2013168508A1 WO2013168508A1 PCT/JP2013/060839 JP2013060839W WO2013168508A1 WO 2013168508 A1 WO2013168508 A1 WO 2013168508A1 JP 2013060839 W JP2013060839 W JP 2013060839W WO 2013168508 A1 WO2013168508 A1 WO 2013168508A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- phalanx
- information processing
- finger
- input
- processing apparatus
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
- G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
- G06F3/0233—Character input methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
Definitions
- the present disclosure relates to an information processing apparatus, an information processing method, and a program.
- the information processing apparatus performs various processes based on an input operation (for example, key operation) by a user operation unit.
- an input operation for example, key operation
- various information input methods have been proposed as information processing apparatuses are used in various forms.
- Patent Document 1 discloses an input device in which a switch is attached to a fingertip of a glove and a sensor for knowing how the finger joint is bent is attached to the glove.
- Patent Document 2 discloses a technique for estimating a finger joint angle based on an input signal from an electrode attached to an arm.
- Patent Document 3 discloses a technique for pattern recognition of the posture of the hand region and inputting the recognition result.
- Patent Document 1 By the way, in the techniques of Patent Document 1 and Patent Document 2, it is necessary to attach sensors and electrodes to hands and arms, which requires troublesome work for the user.
- the technique disclosed in Patent Document 3 can recognize only a small number of patterns, and is not suitable for character input that requires a large number of input elements.
- the present disclosure proposes a method that enables a user to perform an input operation with a simple configuration.
- an identification unit for identifying an input element corresponding to the one phalanx contacted by the contact body, and an output unit for outputting an identification result by the identification unit to a processing device that performs an input process corresponding to the plurality of input elements
- An information processing apparatus is provided.
- the imaging unit captures an image of a state in which a contact body is in contact with one phalanx of at least one finger of the hand, and the imaging unit among a plurality of input elements. Identifying an input element corresponding to the one phalanx contacted by the contact body in the captured image and outputting an identification result by the identification unit to a processing device that performs input processing corresponding to the plurality of input elements And an information processing method is provided.
- the imaging unit captures an image of a state in which the contact body is in contact with one phalanx of at least one finger of the hand, and a plurality of input elements,
- the input unit corresponding to the one phalanx contacted by the contact body is identified, and the processing unit that performs input processing corresponding to the plurality of input units is identified by the identification unit
- a program is provided for outputting the results.
- an input operation intended for the user can be performed with a simple configuration.
- FIG. 1 is a diagram for describing an overview of an information processing system 1 according to an embodiment of the present disclosure.
- the information processing system 1 uses the processing device 150 (see FIG. 2) according to the position where the user U touches the finger of his / her hand H (specifically, any phalange segmented by a finger joint). Input. That is, the information processing system 1 enables input using the user's hand instead of the numeric keypad.
- the information processing system 1 includes an information processing apparatus 100 that identifies which phalanx of the user's finger U touches (presses).
- the information processing apparatus 100 is, for example, glasses or a head mounted display worn by the user U as shown in FIG.
- the information processing apparatus 100 is provided with an imaging unit such as a camera that can image the hand H of the user U at the same position as the user U's line of sight. Note that the position of the imaging unit may be a position different from the line of sight of the user U.
- the information processing apparatus 100 also includes a display unit 130 that can transparently display a user's hand being imaged by the imaging unit.
- the processing device 150 executes input processing corresponding to a plurality of input elements (for example, corresponding to pressing of a key) based on the identification result identified by the information processing device 100.
- the processing device 150 performs, for example, character input based on the identification result of the information processing device 100.
- the processing device 150 is a device such as a personal computer, a smartphone, a PDA, or a mobile phone.
- the user performs input using his / her hand by imaging the state of the hand with the imaging unit without using a sensor or the like for detecting finger movement in the hand. It becomes possible. As a result, for example, it is difficult for the user to wear a sensor or the like in his / her hand (for example, when cooking, driving, playing with a child, working with precision, such as processing) Character can be input easily.
- FIG. 2 is a diagram illustrating an example of a functional configuration of the information processing apparatus 100 according to an embodiment of the present disclosure.
- the information processing apparatus 100 includes an imaging unit 110, a learning unit 112, an identification unit 114, a communication unit 116 that is an example of an output unit, and a display control unit 118.
- the imaging unit 110 is a camera that can capture still images and moving images, and images the user U's hand as a subject.
- the imaging unit 110 can image a state in which the contact body presses one phalanx of at least one finger of the user U's hand.
- the contact body is the thumb of one hand of the user.
- the thumb F1 of one hand is the other finger (index finger F2, middle finger F3, ring finger F4, little finger F5). ) Can be imaged.
- the imaging unit 110 can capture an image of the finger of one hand of the user U pressing the phalanx of the other hand.
- the imaging unit 110 can capture an image of pressing a phalanx with a pen or the like instead of the thumb.
- the imaging unit 110 sequentially outputs captured images to the identification unit 114.
- the learning unit 112 acquires an image in which the user presses the phalanx in advance, and learns the correspondence between the numeric keypad (see FIG. 4) including a plurality of input elements and the phalanx.
- each phalanx of a finger other than the thumb index finger, middle finger, ring finger, little finger
- the learning unit 112 acquires an image as shown in FIG. 3, for example.
- the index finger, middle finger, ring finger, and little finger are each divided into three phalanxes by two joints.
- the three phalanxes are called the base, middle, and last clauses from the root of the finger.
- the thumb is divided into two phalanxes by one joint, and the two phalanxes are called the base and the end nodes from the base of the finger.
- FIG. 3 is a diagram for explaining the correspondence between the keys of the numeric keypad and the phalanx.
- FIG. 4 is a diagram illustrating an example of the numeric keypad 330.
- the states 301 to 310 in FIG. 3 indicate a state where the finger joints corresponding to the numbers “1”, “2”... “9”, “0” of the numeric keypad 330 are touched.
- the base clause of the index finger corresponds to the number “1”
- the middle clause of the index finger corresponds to the number “2”
- the last clause of the index finger corresponds to the number “3”.
- the middle clause of the middle finger corresponds to the number “4”
- the middle clause of the middle finger corresponds to the number “5”
- the last clause of the middle finger corresponds to the number “6”.
- a state 311 in FIG. 3 indicates a state in which the finger joint corresponding to the symbol “*” of the numeric keypad is touched
- a state 312 indicates a state in which the finger joint corresponding to the symbol “#” of the numeric keypad is touched.
- the learning unit 112 may acquire an image for identifying a state in which the thumb does not press any index finger, middle finger, ring finger, or little finger.
- a tape 140 which is an example of an identifier, is attached to an area corresponding to a predetermined phalanx so that the phalanx can be easily identified.
- the tape 140 is affixed in a zigzag manner to 12 phalanxes of the index finger, the middle finger, the ring finger, and the little finger.
- the present invention is not limited to this, and the tape may not be attached to the phalanx.
- the identification unit 114 is for identifying a key corresponding to one phalanx pressed by the thumb in the captured image of the imaging unit 110 among the numeric keys.
- the identification unit 114 identifies which phalanx of the other finger is pressed by the thumb in the captured image based on the captured image input from the imaging unit 110 and the correspondence relationship of the learning unit 112. As shown in FIG. 5, the identification unit 114 includes twelve identifiers 114a to 114l for identifying each key of the numeric keypad.
- FIG. 5 is a diagram for explaining an example of the discriminators 114a to 114l according to the embodiment.
- the discriminators 114a to 114c correspond to the proximal node F2a, the middle node F2b, and the last node F2c of the index finger F2 shown in FIG. 1, respectively.
- Corresponding to The discriminators 114g to 114i correspond to the proximal node F4a, the middle node F4b, and the last node F4c of the ring finger F4, respectively.
- the discriminators 114a to 114l each determine an evaluation value for the input captured image.
- the evaluation value is a value between 0 and 1, for example.
- FIG. 6 is a diagram illustrating an example of a captured image 340 captured by the imaging unit 110 according to an embodiment. That is, the imaging unit 110 images the tape 140 provided in an area corresponding to the phalanx of another finger together with the thumb F1 as a contact body. As shown in FIG. 6, since the user's thumb F1 presses the middle joint F3b of the middle finger F3 of the four fingers F2 to F5, the evaluation value of the identifier 114e is the highest among the identifiers 114a to 114l. high.
- the identifying unit 114 outputs the evaluation values (evaluation values shown in FIG. 5) of the classifiers 114a to 114l with respect to the input image to the communication unit 116.
- region of a hand may be performed, and the identification part 114 may identify with respect to the extracted image. In such a case, the processing load on the identification unit 114 is reduced, and the accuracy of the identification result can be increased.
- the communication unit 116 transmits (outputs) the identification results (evaluation values of the respective classifiers 114a to 114l) by the identification unit 114 for each captured image to the processing device 150. Note that the communication unit 116 sequentially transmits identification results to the processing device 150 at predetermined intervals.
- the processing device 150 determines which phalanx the user has pressed from the identification results sequentially received from the information processing device 100. For example, the processing device 150 determines that the key corresponding to the discriminator having the highest evaluation value has been input. Then, the processing device 150 executes processing corresponding to the input based on the determination result. Note that the processing device 150 may transmit the input processing result to the communication unit 116.
- the display control unit 118 causes the display unit 130 to display the result input by the processing device 150 based on the identification result input from the communication unit 116.
- the display unit 130 transparently displays the user's hand being imaged by the imaging unit 110. For this reason, the display unit 130 displays the result of the input processing performed by the processing device 150 while transparently displaying the user's hand.
- the processing device 150 determines that the key corresponding to the discriminator having the highest evaluation value has been input, but may be determined as follows. In other words, the processing device 150 may determine that the key corresponding to the discriminator having the highest number of evaluations within the predetermined time is input, and the number of times the evaluation value exceeds a predetermined threshold. It may be determined that the key corresponding to the most discriminator is input. Thereby, more accurate input using a hand is attained.
- the pressed phalanx is identified by imaging the finger with the tape 140 applied to the predetermined phalanx, but the present invention is not limited to this, and will be described below.
- the pressed phalanx may be identified.
- FIG. 7 is a diagram for explaining a first modified example of identification of a pressed phalanx.
- a seal 142 is attached to the finger instead of the tape 140.
- a seal 142 is attached to each phalanx of the index finger F2, the middle finger F3, the ring finger F4, and the little finger F5.
- the number of seals 142 affixed to the last node F4c of the ring finger F4 is two, which is different from other finger segments having one seal 142. In such a case, by identifying each phalanx based on the last node of the ring finger, it becomes easy to identify 12 phalanxes.
- a seal 142 may be attached to the thumb F1 (specifically, a thumb nail). This makes it easy to identify that the thumb F1 has pressed the phalanges of the other fingers F2 to F5.
- the sticker is directly attached to the finger.
- the present invention is not limited to this.
- the sticker may be attached to a position corresponding to each finger joint of the glove worn on the hand.
- FIG. 8 is a diagram for explaining a second modification of identifying a pressed phalanx.
- an identifiable code 162 is attached to a position corresponding to each finger joint of a glove 160 (an example of a wearing body) worn on the hand.
- the code 162 for example, an AR (Augmented Reality) code may be used.
- the code 162 includes information for specifying each phalanx. Accordingly, the identification unit 114 can easily identify the phalanx pressed by the thumb based on the captured image in which the code 162 is also captured.
- FIG. 9 is a diagram for explaining a third modified example of identification of a pressed phalanx.
- a code 164 is displayed on the glove 160 worn on the hand.
- the code 164 includes identification information indicating the pressed phalanx. For this reason, when the imaging unit 110 captures the state where the code 164 is displayed, the identification unit 114 can easily identify the phalanx pressed by the thumb.
- FIG. 10 is a diagram for explaining a fourth modification of identifying a pressed phalanx.
- the color of the tape 140 attached to the index finger F2, the middle finger F3, the ring finger F4, and the little finger F5 can be changed.
- the tape 140 can display a color corresponding to the phalanx pressed by the thumb F1.
- the thumb F1 presses the base F2a of the index finger F2 as in the state 501 of FIG. 11 the colors of the two tapes 140 of the index finger change from the default color to the first color.
- the color of the tape 140 of the middle finger F3, the ring finger F4, and the little finger F5 maintains the default color.
- the color of the tape 140 applied to each finger similarly changes.
- the base finger F3a, F4a, or F5a of the middle finger, ring finger, or little finger is pressed (states 504, 507, 510)
- only the color of the tape 140 attached to the pressed finger is the default color.
- the imaging unit 110 captures the color displayed on the tape according to the pressed phalanx, so that the identification unit 114 can easily identify the phalanx pressed by the thumb.
- the color of the tape 140 is changed from the first color to the third color.
- the present invention is not limited to this, and the color is changed to a different color (that is, 12 colors) for each finger joint.
- the luminance may be changed with one color.
- FIG. 11 is a diagram showing a first example of detection of the phalanx pressing timing.
- a finger sack 170 (an example of an indicating tool) whose color changes is attached to the thumb.
- the color of the finger sack 170 changes to a predetermined color (for example, red).
- the identification unit 114 can easily detect the timing at which the phalanx is pressed.
- the thumb touches the palm (state 421), the color of the finger sack 170 changes to a default color (for example, white).
- FIG. 12 is a diagram showing a second embodiment of detection of the phalanx pressing timing.
- a pen 172 which is an example of a contact body, presses the phalanx.
- the pen 172 is a member that can emit light, and the tip 172a of the pen 172 emits light when a finger joint is pressed. Then, when the state in which the pen emits light is imaged by the imaging unit 110, the identification unit 114 can easily detect the timing at which the pen presses the phalanx.
- the pen 172 emits light or the color of the tape 140 changes when the phalanx is pressed.
- the present invention is not limited to this.
- the information processing apparatus 100 may detect a finger motion vector and detect a timing at which a phalanx is pressed based on the detected motion vector.
- the relative motion vector Vp of one finger on which the phalanx is pressed is obtained as in the following equation.
- Vp V-Vh
- V represents a set of motion vectors for one finger
- Vh represents an average of the motion vectors of five fingers.
- the relative motion vector Vp is obtained for each of the index finger, the middle finger, the ring finger, and the little finger.
- FIG. 13 is a diagram for explaining the relative motion vector Vp. Since the relative motion vector Vp reverses the direction of the vector before and after pressing the phalanx, the pressing timing can be detected by monitoring the ratio of the reverse. By obtaining such a relative motion vector Vp, the timing at which the phalanx is pressed can be detected.
- the identification unit 114 monitors changes in the bulge of the phalanx, changes in the color of the phalanx, and changes in the shadow in the captured images input at predetermined intervals input from the imaging unit 110, and the phalanx is determined based on the change.
- the pressing timing may be detected.
- the pressing timing can be detected without using an indicator such as a pen or a finger sack.
- the identification unit 114 has the function of a detection unit that detects the pressing timing of the phalanx, but is not limited thereto. A component different from the identification unit 114 may detect the pressing timing of the phalanx.
- Example of operation of information processing apparatus 100 is realized by the CPU of the information processing apparatus 100 executing a program stored in the ROM.
- the program to be executed may be stored in a recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a memory card, or may be downloaded from a server or the like via the Internet.
- FIG. 14 is a flowchart for explaining a first operation example of the information processing apparatus 100 according to an embodiment.
- the flowchart of FIG. 14 is started when, for example, the imaging unit 110 is turned on.
- the imaging unit 110 captures an image of a user's hand for inputting characters or the like (step S102). That is, the imaging unit 110 outputs a captured image when the user presses a phalanx of any finger to the identification unit 114.
- the identification unit 114 identifies which phalanx of the user has been pressed based on the input captured image (step S104). For example, each of the identifiers 114a to 114l corresponding to the numeric keypad determines an evaluation value for the input captured image.
- the communication unit 116 outputs the identification result (for example, the evaluation value by the classifiers 114a to 114l) to the processing device 150 (step S106). Note that the communication unit 116 sequentially outputs the evaluation values to the processing device 150. Then, the processing device 150 determines which phalanx the user has pressed based on the input evaluation result. For example, the processing device 150 determines that the key corresponding to the discriminator having the highest evaluation value has been input, and executes processing corresponding to the input.
- the identification result for example, the evaluation value by the classifiers 114a to 114l
- step S108 Yes
- the processes of steps S102 to S106 described above are repeated.
- the operation of the information processing apparatus 100 is completed.
- the first operation example it is possible to identify an input intended by the user by pressing the user's own phalanx instead of the numeric keypad without providing a sensor or the like in the hand.
- FIG. 15 is a flowchart for explaining a second operation example of the information processing apparatus 100 according to an embodiment.
- the user's hand region in the captured image captured in step S102 is recognized, and an image of the recognized hand region is extracted (step S122). Then, the identification unit 114 identifies which phalanx the user has pressed on the extracted image (step S104).
- the area of the image to be identified by the identification unit 114 can be reduced, and the determination accuracy can be improved.
- the learning unit 112 may acquire an image corresponding to the hand region in advance.
- FIG. 16 is a flowchart for explaining a third operation example of the information processing apparatus 100 according to an embodiment.
- the identification unit 114 determines the phalanx pressing timing based on the captured image captured in step S102 (step S132). Specifically, the identification unit 114 determines the pressing timing of the phalanx from the captured image captured when an indicator (such as a pen) that presses the phalanx emits light. Next, the identification unit 114 identifies which phalanx the user has pressed at the pressing timing (step S104).
- the timing for performing the identification process by the identification unit 114 is limited, and the accuracy of the determination by the identification unit 114 can be improved. Moreover, since the power consumption resulting from the process of the identification part 114 can also be suppressed, it is effective when electric power is limited like portable terminals, such as a smart phone.
- FIG. 17 is a flowchart for explaining a fourth operation example of the information processing apparatus 100 according to an embodiment.
- the identification unit 114 extracts a region corresponding to each phalanx from the captured image captured in step S102 (step S142). For example, the identification unit 114 extracts 12 regions corresponding to the proximal, middle, and last clauses of the index finger, middle finger, ring finger, and little finger.
- the identification unit 114 detects a change in the color of the phalanx in each extracted region (step S144). Generally, the phalanx before being pressed is reddish, while the phalanx is yellowish when pressed. Therefore, the identification unit 114 detects whether the color of the phalanx varies between red and yellow. Specifically, the identification unit 114 determines the number of R component pixels in the region (specifically, the number of pixels having a relationship of R> G + 20) and the number of G component pixels (the relationship of G ⁇ 10 ⁇ R ⁇ G + 10). The color variation is detected by referring to the ratio of the number of pixels. And if the identification part 114 detects that there existed the fluctuation
- the fourth operation example by detecting a change in the color of the phalanx, it is possible to appropriately detect the pressing timing of the phalanx without using an indicator such as a pen or stylus, a finger sack, or the like.
- the display unit of the information processing apparatus 100 displays the user's hand being captured and input information.
- FIG. 18 is a diagram illustrating a display example of the display unit 130 of the information processing apparatus 100 according to an embodiment.
- the display unit 130 illustrated in FIG. 18 displays the user's hand being imaged by the imaging unit 110 and displays an input screen 132 for characters input corresponding to the phalanx pressed by the thumb F1.
- the user can check the characters input on the input screen 132 while pressing the phalanges of the index finger F2, the middle finger F3, the ring finger F4, and the little finger F5.
- FIG. 19 is a diagram illustrating a display example of the display unit of the information processing apparatus 100 according to an embodiment.
- the display unit 130 illustrated in FIG. 19 displays the user's hand being imaged by the imaging unit 110 in a transparent manner and displays the touch pad 134 in an area corresponding to the palm.
- the user can perform an input operation instead of a mouse by performing a touch operation on the displayed touch pad 134.
- FIG. 20 is a diagram illustrating an example in which both hands are used.
- the imaging unit 110 captures all five fingers. However, the present invention is not limited to this. For example, the imaging unit 110 captures at least a finger having a pressed phalanx. Also good. Furthermore, in the above description, the input process is performed by imaging the state in which the thumb or pen presses the phalanx. However, the present invention is not limited to this. For example, the state in which the thumb or pen touches the phalanx. It is good also as performing input processing by imaging.
- FIG. 21 is an explanatory diagram showing a hardware configuration of the information processing apparatus 100.
- the information processing apparatus 100 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, an input device 208, an output device 210, A storage device 211, a drive 212, an imaging device 213, and a communication device 215 are provided.
- a CPU Central Processing Unit
- ROM Read Only Memory
- RAM Random Access Memory
- the CPU 201 functions as an arithmetic processing unit and a control unit, and controls the overall operation in the information processing apparatus 100 according to various programs. Further, the CPU 201 may be a microprocessor.
- the ROM 202 stores programs used by the CPU 201, calculation parameters, and the like.
- the RAM 203 temporarily stores programs used in the execution of the CPU 201, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus including a CPU bus.
- the input device 208 includes input means for a user to input information, such as a mouse, keyboard, touch panel, button, microphone, switch, and lever, and an input control circuit that generates an input signal based on the input by the user and outputs the input signal to the CPU 201. Etc. A user of the information processing apparatus 20 can input various data and instruct a processing operation to the information processing apparatus 20 by operating the input device 208.
- the output device 210 includes a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp. Furthermore, the output device 210 includes an audio output device such as a speaker and headphones. For example, the display device displays a captured image or a generated image. On the other hand, the audio output device converts audio data or the like into audio and outputs it.
- a display device such as a liquid crystal display (LCD) device, an OLED (Organic Light Emitting Diode) device, and a lamp.
- the output device 210 includes an audio output device such as a speaker and headphones.
- the display device displays a captured image or a generated image.
- the audio output device converts audio data or the like into audio and outputs it.
- the storage apparatus 211 is a data storage apparatus configured as an example of a storage unit of the information processing apparatus 100 according to the present embodiment.
- the storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like.
- the storage device 211 stores programs executed by the CPU 201 and various data.
- the imaging device 213 includes an imaging optical system such as a photographing lens and a zoom lens that collects light, and a signal conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor).
- the imaging optical system collects light emitted from the subject and forms a subject image in the signal conversion unit, and the signal conversion element converts the formed subject image into an electrical image signal.
- the communication device 215 is a communication interface configured with, for example, a communication device for connecting to the network 12.
- the communication device 215 may be a wireless LAN (Local Area Network) compatible communication device, an LTE (Long Term Evolution) compatible communication device, or a wire communication device that performs wired communication.
- the network 12 is a wired or wireless transmission path for information transmitted from a device connected to the network 12.
- the network 12 may include a public line network such as the Internet, a telephone line network, and a satellite communication network, various LANs (Local Area Network) including the Ethernet (registered trademark), a WAN (Wide Area Network), and the like.
- the network 12 may include a dedicated line network such as an IP-VPN (Internet Protocol-Virtual Private Network).
- the information processing apparatus 100 has an input corresponding to one phalanx with which the thumb is in contact with a captured image of the imaging unit 110 among a plurality of input elements (for example, keys configuring a numeric keypad). Identify the child (key).
- the information processing apparatus 100 outputs the identification result by the identification unit 114 to the processing apparatus 150 that performs input processing corresponding to a plurality of input elements.
- the input process can be performed by imaging the state in which the user has touched the phalanx of his / her finger on the imaging unit 110, input can be performed with a simple configuration without attaching a sensor or an electrode. It can be performed.
- the phalanges of four fingers index finger, middle finger, ring finger, little finger
- the processing by the information processing apparatus described in this specification may be realized using any of software, hardware, and a combination of software and hardware.
- a program constituting the software is stored in advance in a storage medium provided inside or outside each device.
- Each program is read into a RAM (Random Access Memory) at the time of execution and executed by a processor such as a CPU.
- RAM Random Access Memory
- An imaging unit for imaging a state in which the contact body is in contact with one phalanx of at least one finger of the hand;
- An identification unit for identifying an input unit corresponding to the one phalanx in contact with the contact body in a captured image of the imaging unit among a plurality of input units;
- An output unit that outputs an identification result by the identification unit to a processing device that performs input processing corresponding to the plurality of input elements;
- An information processing apparatus comprising: (2) The index finger, middle finger, ring finger, and little finger of the hand respectively correspond to each input element of the plurality of input elements, The information processing apparatus according to (1).
- the plurality of inputs constitute a numeric keypad.
- the contact body is the thumb of the hand; The information processing apparatus according to any one of (1) to (3).
- the contact body emits light when contacting the phalanx,
- the information processing apparatus further includes a detection unit that detects a timing at which the contact body contacts the phalanx based on a light emission state of the contact body.
- the information processing apparatus according to any one of (1) to (3).
- the information processing apparatus further includes a detection unit that detects a timing at which the contact body contacts the phalanx based on a swelling or color change of the phalanx.
- the information processing apparatus according to any one of (1) to (4).
- the information processing apparatus further includes a detection unit that detects a timing at which the contact body contacts the phalanx based on a motion vector of the finger.
- the information processing apparatus according to any one of (1) to (4).
- the imaging unit images the identification body provided in an area corresponding to the phalanx of the finger together with the contact body.
- the information processing apparatus according to any one of (1) to (7).
- the identification body can display a color according to the phalanx contacted with the contact body,
- the imaging unit images a color displayed by the identifier.
- the information processing apparatus according to (8).
- the wearing body attached to the hand can display identification information indicating the phalanx when the contact body contacts the phalanx,
- the imaging unit images the identification information together with the contact body.
- the information processing apparatus further includes a display unit that transparently displays the finger that is being imaged by the imaging unit and that displays a result of input processing performed by the processing device based on the identification result input from the output unit.
- the information processing apparatus according to any one of (1) to (10).
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
- Position Input By Displaying (AREA)
Abstract
Description
1.情報処理システムの概要
2.情報処理装置の構成例
3.押圧された指節の識別の変形例
4.指節の押圧タイミングの検出例
5.情報処理装置の動作例
6.ハードウェア構成
7.まとめ
図1を参照しながら、本開示の一実施形態に係る情報処理システム1の概要について説明する。図1は、本開示の一実施形態に係る情報処理システム1の概要を説明するための図である。
図2を参照しながら、本開示の一実施形態に係る情報処理装置100の構成例について説明する。図2は、本開示の一実施形態に係る情報処理装置100の機能構成の一例を示す図である。
撮像部110は、静止画や動画を撮像可能なカメラであり、被写体としてユーザUの手を撮像する。例えば、撮像部110は、ユーザUの手の少なくとも1本以上の指のうちの一の指節を接触体が押圧した状態を撮像しうる。ここで、接触体は、ユーザの一方の手の親指であり、撮像部110は、図1に示すように一方の手の親指F1が他の指(人差し指F2、中指F3、薬指F4、小指F5)の指節を押圧する状態を撮像しうる。
学習部112は、予めユーザが指節を押圧している画像を取得して、複数の入力子で構成されるテンキー(図4参照)と指節との対応関係を学習する。ここでは、親指以外の指(人差し指、中指、薬指、小指)の各指節が、テンキーの各キー(入力子)に対応するものとする。学習部112は、例えば図3に示すような画像を取得する。
識別部114は、テンキーのうちの、撮像部110の撮像画像において親指が押圧した一の指節に対応するキーを識別するためのものである。識別部114は、撮像部110から入力された撮像画像と、学習部112の対応関係とに基づいて、撮像画像において親指が他の指の何れの指節を押圧したかを識別する。識別部114は、図5に示すように、テンキーの各キーを識別する12個の識別器114a~114lを有する。
通信部116は、撮像画像毎の識別部114による識別結果(各識別器114a~114lの評価値)を処理装置150に送信する(出力する)。なお、通信部116は、所定間隔で識別結果を処理装置150に順次送信する。
表示制御部118は、通信部116から入力された識別結果に基づき処理装置150が入力処理した結果を、表示部130に表示させる。なお、表示部130は、撮像部110により撮像中のユーザの手を透過表示する。このため、表示部130は、ユーザの手を透過表示すると共に、処理装置150が入力処理した結果を表示する。
上記では、図6に示すように所定の指節にテープ140が貼られた指を撮像することで、押圧された指節を識別することとしたが、これに限定されず、以下に説明するように押圧された指節を識別しても良い。
次に、指節が押圧される押圧タイミングの検出例について、いくつかの実施例を例に挙げて説明する。
Vp=V-Vh
ここで、Vは、一の指における動きベクトルの集合を示し、Vhは、5本の指の動きベクトルの平均を示す。そして、相対動きベクトルVpは、人指し指、中指、薬指、小指のそれぞれについて求められる。
次に、一実施形態に係る情報処理装置100の動作例について説明する。以下では、情報処理装置100の動作例として、第1動作例~第4動作例について説明する。情報処理装置100の動作は、情報処理装置100のCPUがROMに格納されているプログラムを実行することによって、実現される。なお、実行されるプログラムは、CD(Compact Disk)、DVD(Digital Versatile Disk)、メモリカード等の記録媒体に記憶されても良く、インターネットを介してサーバ等からダウンロードされても良い。
まず、図14を参照しながら、一実施形態に係る情報処理装置100の第1動作例を説明する。図14は、一実施形態に係る情報処理装置100の第1動作例を説明するためのフローチャートである。図14のフローチャートは、例えば撮像部110がONされたところから開始される。
図15は、一実施形態に係る情報処理装置100の第2動作例を説明するためのフローチャートである。
図16は、一実施形態に係る情報処理装置100の第3動作例を説明するためのフローチャートである。
図17は、一実施形態に係る情報処理装置100の第4動作例を説明するためのフローチャートである。
指節を押圧することにより入力を行う際に、情報処理装置100の表示部に、撮像中のユーザの手と入力情報とが表示される。
上述した情報処理装置100による表示制御動作は、情報処理装置100が備えるハードウェア構成とソフトウェアとが協働することにより実現される。そこで、以下では、情報処理装置100のハードウェア構成を説明する。
上述したように、本開示の情報処理装置100は、複数の入力子(例えば、テンキーを構成するキー)のうちの、撮像部110の撮像画像において親指が接触した一の指節に対応する入力子(キー)を識別する。また、情報処理装置100は、複数の入力子に対応する入力処理を行う処理装置150に、識別部114による識別結果を出力する。
(1)
手の少なくとも1本以上の指のうちの一の指節を接触体が接触した状態を撮像する撮像部と、
複数の入力子のうちの、前記撮像部の撮像画像において前記接触体が接触した前記一の指節に対応する入力子を識別する識別部と、
前記複数の入力子に対応する入力処理を行う処理装置に、前記識別部による識別結果を出力する出力部と、
を備える、情報処理装置。
(2)
前記手の人差し指、中指、薬指、及び小指の各指節が、前記複数の入力子の各入力子とそれぞれ対応する、
前記(1)に記載の情報処理装置。
(3)
前記複数の入力子は、テンキーを構成する、
前記(2)に記載の情報処理装置。
(4)
前記接触体は、前記手の親指である、
前記(1)~(3)のいずれか1項に記載の情報処理装置。
(5)
前記接触体は、前記指節に接触した際に発光し、
前記情報処理装置は、前記接触体の発光状態に基づいて、前記接触体が前記指節に接触したタイミングを検出する検出部を更に備える、
前記(1)~(3)のいずれか1項に記載の情報処理装置。
(6)
前記情報処理装置は、前記指節の膨らみや色の変化に基づいて、前記接触体が前記指節に接触したタイミングを検出する検出部を更に備える、
前記(1)~(4)のいずれか1項に記載の情報処理装置。
(7)
前記情報処理装置は、前記指の動きベクトルに基づいて、前記接触体が前記指節に接触したタイミングを検出する検出部を更に備える、
前記(1)~(4)のいずれか1項に記載の情報処理装置。
(8)
前記撮像部は、前記接触体と共に、前記指の指節に対応する領域に設けられた識別体を撮像する、
前記(1)~(7)のいずれか1項に記載の情報処理装置。
(9)
前記識別体は、前記接触体が接触した指節に応じた色を表示可能であり、
前記撮像部は、前記識別体が表示する色を撮像する、
前記(8)に記載の情報処理装置。
(10)
前記手に装着される装着体は、前記接触体が指節に接触した際に前記指節を示す識別情報を表示可能であり、
前記撮像部は、前記接触体と共に、前記識別情報を撮像する、
前記(1)~(7)のいずれか1項に記載の情報処理装置。
(11)
前記情報処理装置は、前記撮像部により撮像中の前記指を透過表示すると共に、前記出力部から入力された前記識別結果に基づき前記処理装置が入力処理した結果を表示する表示部を更に備える、
前記(1)~(10)のいずれか1項に記載の情報処理装置。
(12)
手の少なくとも1本以上の指のうちの一の指節を接触体が接触した状態を撮像部により撮像することと、
複数の入力子のうちの、前記撮像部の撮像画像において前記接触体が接触した前記一の指節に対応する入力子を識別することと、
前記複数の入力子に対応する入力処理を行う処理装置に、前記識別部による識別結果を出力することと、
を含む、情報処理方法。
(13)
コンピュータに、
手の少なくとも1本以上の指のうちの一の指節を接触体が接触した状態を撮像部により撮像することと、
複数の入力子のうちの、前記撮像部の撮像画像において前記接触体が接触した前記一の指節に対応する入力子を識別することと、
前記複数の入力子に対応する入力処理を行う処理装置に、前記識別部による識別結果を出力することと、
を実行させるための、プログラム。
100 情報処理装置
110 撮像部
112 学習部
114 識別部
116 通信部
118 表示制御部
130 表示部
140 テープ
142 シール
150 処理装置
160 手袋
162、164 コード
172 ペン
Claims (13)
- 手の少なくとも1本以上の指のうちの一の指節を接触体が接触した状態を撮像する撮像部と、
複数の入力子のうちの、前記撮像部の撮像画像において前記接触体が接触した前記一の指節に対応する入力子を識別する識別部と、
前記複数の入力子に対応する入力処理を行う処理装置に、前記識別部による識別結果を出力する出力部と、
を備える、情報処理装置。 - 前記手の人差し指、中指、薬指、及び小指の各指節が、前記複数の入力子の各入力子とそれぞれ対応する、
請求項1に記載の情報処理装置。 - 前記複数の入力子は、テンキーを構成する、
請求項2に記載の情報処理装置。 - 前記接触体は、前記手の親指である、
請求項1に記載の情報処理装置。 - 前記接触体は、前記指節に接触した際に発光し、
前記情報処理装置は、前記接触体の発光状態に基づいて、前記接触体が前記指節に接触したタイミングを検出する検出部を更に備える、
請求項1に記載の情報処理装置。 - 前記情報処理装置は、前記指節の膨らみや色の変化に基づいて、前記接触体が前記指節に接触したタイミングを検出する検出部を更に備える、
請求項1に記載の情報処理装置。 - 前記情報処理装置は、前記指の動きベクトルに基づいて、前記接触体が前記指節に接触したタイミングを検出する検出部を更に備える、
請求項1に記載の情報処理装置。 - 前記撮像部は、前記接触体と共に、前記指の指節に対応する領域に設けられた識別体を撮像する、
請求項1に記載の情報処理装置。 - 前記識別体は、前記接触体が接触した指節に応じた色を表示可能であり、
前記撮像部は、前記識別体が表示する色を撮像する、
請求項8に記載の情報処理装置。 - 前記手に装着される装着体は、前記接触体が指節に接触した際に前記指節を示す識別情報を表示可能であり、
前記撮像部は、前記接触体と共に、前記識別情報を撮像する、
請求項1に記載の情報処理装置。 - 前記情報処理装置は、前記撮像部により撮像中の前記指を透過表示すると共に、前記出力部から入力された前記識別結果に基づき前記処理装置が入力処理した結果を表示する表示部を更に備える、
請求項1に記載の情報処理装置。 - 手の少なくとも1本以上の指のうちの一の指節を接触体が接触した状態を撮像部により撮像することと、
複数の入力子のうちの、前記撮像部の撮像画像において前記接触体が接触した前記一の指節に対応する入力子を識別することと、
前記複数の入力子に対応する入力処理を行う処理装置に、前記識別部による識別結果を出力することと、
を含む、情報処理方法。 - コンピュータに、
手の少なくとも1本以上の指のうちの一の指節を接触体が接触した状態を撮像部により撮像することと、
複数の入力子のうちの、前記撮像部の撮像画像において前記接触体が接触した前記一の指節に対応する入力子を識別することと、
前記複数の入力子に対応する入力処理を行う処理装置に、前記識別部による識別結果を出力することと、
を実行させるための、プログラム。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014514411A JP6036817B2 (ja) | 2012-05-09 | 2013-04-10 | 情報処理装置、情報処理方法、及びプログラム |
EP13787902.9A EP2849035A4 (en) | 2012-05-09 | 2013-04-10 | INFORMATION PROCESSING DEVICE, INFORMATION PROCESSING PROCESS AND PROGRAM |
US14/398,546 US20150109197A1 (en) | 2012-05-09 | 2013-04-10 | Information processing apparatus, information processing method, and program |
CN201380023001.1A CN104272225B (zh) | 2012-05-09 | 2013-04-10 | 信息处理装置、信息处理方法 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012-107410 | 2012-05-09 | ||
JP2012107410 | 2012-05-09 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2013168508A1 true WO2013168508A1 (ja) | 2013-11-14 |
Family
ID=49550561
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/060839 WO2013168508A1 (ja) | 2012-05-09 | 2013-04-10 | 情報処理装置、情報処理方法、及びプログラム |
Country Status (5)
Country | Link |
---|---|
US (1) | US20150109197A1 (ja) |
EP (1) | EP2849035A4 (ja) |
JP (1) | JP6036817B2 (ja) |
CN (1) | CN104272225B (ja) |
WO (1) | WO2013168508A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20150104769A (ko) * | 2014-03-06 | 2015-09-16 | 엘지전자 주식회사 | 글래스 타입의 이동 단말기 |
WO2016017096A1 (ja) * | 2014-07-30 | 2016-02-04 | ソニー株式会社 | 情報処理装置、情報処理方法及びプログラム |
JPWO2016185845A1 (ja) * | 2015-05-21 | 2018-02-15 | 日本電気株式会社 | インタフェース制御システム、インタフェース制御装置、インタフェース制御方法、及びプログラム |
JP7472734B2 (ja) | 2020-09-17 | 2024-04-23 | サクサ株式会社 | 画像処理装置及びプログラム |
Families Citing this family (16)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2016017101A1 (ja) * | 2014-07-30 | 2016-02-04 | ソニー株式会社 | 情報処理装置、情報処理方法及びプログラム |
US10528138B2 (en) | 2015-11-06 | 2020-01-07 | Facebook Technologies, Llc | Virtual reality garment capable of jamming user movement |
US10572014B2 (en) * | 2015-11-09 | 2020-02-25 | Facebook Technologies, Llc | Virtual reality garment configured to restrict user movement by repositioning a rigid cuff relative to the user |
CN107632716B (zh) * | 2017-11-07 | 2024-03-08 | 王可攀 | 一种输入信息处理装置及其处理输入信息的方法 |
US11275453B1 (en) | 2019-09-30 | 2022-03-15 | Snap Inc. | Smart ring for manipulating virtual objects displayed by a wearable device |
CN111007942A (zh) * | 2019-12-25 | 2020-04-14 | 歌尔股份有限公司 | 一种可穿戴设备及其输入方法 |
US11798429B1 (en) | 2020-05-04 | 2023-10-24 | Snap Inc. | Virtual tutorials for musical instruments with finger tracking in augmented reality |
US11520399B2 (en) | 2020-05-26 | 2022-12-06 | Snap Inc. | Interactive augmented reality experiences using positional tracking |
CN111427458B (zh) * | 2020-06-11 | 2020-12-22 | 诺百爱(杭州)科技有限责任公司 | 一种基于手部动作虚拟输入字符的方法、装置和电子设备 |
US11925863B2 (en) | 2020-09-18 | 2024-03-12 | Snap Inc. | Tracking hand gestures for interactive game control in augmented reality |
US11546505B2 (en) | 2020-09-28 | 2023-01-03 | Snap Inc. | Touchless photo capture in response to detected hand gestures |
US11740313B2 (en) | 2020-12-30 | 2023-08-29 | Snap Inc. | Augmented reality precision tracking and display |
US11531402B1 (en) | 2021-02-25 | 2022-12-20 | Snap Inc. | Bimanual gestures for controlling virtual and graphical elements |
US12013985B1 (en) | 2021-02-25 | 2024-06-18 | Snap Inc. | Single-handed gestures for reviewing virtual content |
WO2022216784A1 (en) * | 2021-04-08 | 2022-10-13 | Snap Inc. | Bimanual interactions between mapped hand regions for controlling virtual and graphical elements |
EP4327185A1 (en) | 2021-04-19 | 2024-02-28 | Snap, Inc. | Hand gestures for animating and controlling virtual and graphical elements |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10207602A (ja) * | 1997-01-21 | 1998-08-07 | Canon Inc | 記号入力装置 |
JP2000298544A (ja) * | 1999-04-12 | 2000-10-24 | Matsushita Electric Ind Co Ltd | 入出力装置と入出力方法 |
JP2001242983A (ja) | 2000-02-25 | 2001-09-07 | Katsutoshi Muto | コンピュータ入力装置 |
JP2010086367A (ja) * | 2008-10-01 | 2010-04-15 | Sony Corp | 位置情報入力装置、位置情報入力方法、プログラム、情報処理システム、及び電子装置 |
JP2010125287A (ja) | 2008-12-01 | 2010-06-10 | Gifu Univ | 指関節角度推定装置 |
US20100177039A1 (en) * | 2009-01-10 | 2010-07-15 | Isaac Grant | Finger Indicia Input Device for Computer |
JP2011180843A (ja) * | 2010-03-01 | 2011-09-15 | Sony Corp | 情報処理装置、情報処理方法、およびプログラム |
JP2011221699A (ja) | 2010-04-07 | 2011-11-04 | Yaskawa Electric Corp | 操作指示認識装置及びロボット |
Family Cites Families (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2000112651A (ja) * | 1998-10-06 | 2000-04-21 | Olympus Optical Co Ltd | ポインティング機構 |
US6771294B1 (en) * | 1999-12-29 | 2004-08-03 | Petri Pulli | User interface |
US6763320B2 (en) * | 2002-08-15 | 2004-07-13 | International Business Machines Corporation | Data input device for individuals with limited hand function |
KR20060022984A (ko) * | 2004-09-08 | 2006-03-13 | 홍광석 | 키패드 글러브 장치 |
CN101142617B (zh) * | 2005-02-23 | 2012-06-20 | 杰龙公司 | 数据输入方法和装置 |
GB0622451D0 (en) * | 2006-11-10 | 2006-12-20 | Intelligent Earth Ltd | Object position and orientation detection device |
JP2009146333A (ja) * | 2007-12-18 | 2009-07-02 | Panasonic Corp | 空間入力動作表示装置 |
US20100060611A1 (en) * | 2008-09-05 | 2010-03-11 | Sony Ericsson Mobile Communication Ab | Touch display with switchable infrared illumination for touch position determination and methods thereof |
US8310464B2 (en) * | 2008-10-16 | 2012-11-13 | Texas Instruments Incorporated | Simultaneous multiple location touch systems |
US20120056805A1 (en) * | 2010-09-03 | 2012-03-08 | Intellectual Properties International, LLC | Hand mountable cursor control and input device |
US9030425B2 (en) * | 2011-04-19 | 2015-05-12 | Sony Computer Entertainment Inc. | Detection of interaction with virtual object from finger color change |
US8228315B1 (en) * | 2011-07-12 | 2012-07-24 | Google Inc. | Methods and systems for a virtual input device |
JP2013061848A (ja) * | 2011-09-14 | 2013-04-04 | Panasonic Corp | 非接触入力装置 |
WO2013086023A1 (en) * | 2011-12-05 | 2013-06-13 | Northeastern University | Customized, mechanically-assistive rehabilitation apparatus and method for distal extremities of the upper and lower regions |
-
2013
- 2013-04-10 US US14/398,546 patent/US20150109197A1/en not_active Abandoned
- 2013-04-10 CN CN201380023001.1A patent/CN104272225B/zh not_active Expired - Fee Related
- 2013-04-10 JP JP2014514411A patent/JP6036817B2/ja active Active
- 2013-04-10 WO PCT/JP2013/060839 patent/WO2013168508A1/ja active Application Filing
- 2013-04-10 EP EP13787902.9A patent/EP2849035A4/en not_active Withdrawn
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH10207602A (ja) * | 1997-01-21 | 1998-08-07 | Canon Inc | 記号入力装置 |
JP2000298544A (ja) * | 1999-04-12 | 2000-10-24 | Matsushita Electric Ind Co Ltd | 入出力装置と入出力方法 |
JP2001242983A (ja) | 2000-02-25 | 2001-09-07 | Katsutoshi Muto | コンピュータ入力装置 |
JP2010086367A (ja) * | 2008-10-01 | 2010-04-15 | Sony Corp | 位置情報入力装置、位置情報入力方法、プログラム、情報処理システム、及び電子装置 |
JP2010125287A (ja) | 2008-12-01 | 2010-06-10 | Gifu Univ | 指関節角度推定装置 |
US20100177039A1 (en) * | 2009-01-10 | 2010-07-15 | Isaac Grant | Finger Indicia Input Device for Computer |
JP2011180843A (ja) * | 2010-03-01 | 2011-09-15 | Sony Corp | 情報処理装置、情報処理方法、およびプログラム |
JP2011221699A (ja) | 2010-04-07 | 2011-11-04 | Yaskawa Electric Corp | 操作指示認識装置及びロボット |
Non-Patent Citations (1)
Title |
---|
See also references of EP2849035A4 |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20150104769A (ko) * | 2014-03-06 | 2015-09-16 | 엘지전자 주식회사 | 글래스 타입의 이동 단말기 |
KR102184402B1 (ko) * | 2014-03-06 | 2020-11-30 | 엘지전자 주식회사 | 글래스 타입의 이동 단말기 |
WO2016017096A1 (ja) * | 2014-07-30 | 2016-02-04 | ソニー株式会社 | 情報処理装置、情報処理方法及びプログラム |
CN106575184A (zh) * | 2014-07-30 | 2017-04-19 | 索尼公司 | 信息处理装置、信息处理方法及程序 |
JPWO2016017096A1 (ja) * | 2014-07-30 | 2017-04-27 | ソニー株式会社 | 情報処理装置、情報処理方法及びプログラム |
US10175825B2 (en) | 2014-07-30 | 2019-01-08 | Sony Corporation | Information processing apparatus, information processing method, and program for determining contact on the basis of a change in color of an image |
CN106575184B (zh) * | 2014-07-30 | 2020-05-19 | 索尼公司 | 信息处理装置、信息处理方法及计算机可读介质 |
JPWO2016185845A1 (ja) * | 2015-05-21 | 2018-02-15 | 日本電気株式会社 | インタフェース制御システム、インタフェース制御装置、インタフェース制御方法、及びプログラム |
US10698535B2 (en) | 2015-05-21 | 2020-06-30 | Nec Corporation | Interface control system, interface control apparatus, interface control method, and program |
JP7472734B2 (ja) | 2020-09-17 | 2024-04-23 | サクサ株式会社 | 画像処理装置及びプログラム |
Also Published As
Publication number | Publication date |
---|---|
US20150109197A1 (en) | 2015-04-23 |
EP2849035A1 (en) | 2015-03-18 |
EP2849035A4 (en) | 2016-05-11 |
JP6036817B2 (ja) | 2016-11-30 |
CN104272225A (zh) | 2015-01-07 |
CN104272225B (zh) | 2017-11-03 |
JPWO2013168508A1 (ja) | 2016-01-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6036817B2 (ja) | 情報処理装置、情報処理方法、及びプログラム | |
CN105487673B (zh) | 一种人机交互***、方法及装置 | |
WO2017092225A1 (zh) | 基于emg的可穿戴式文本输入***及方法 | |
US6965842B2 (en) | User input apparatus | |
JP5263833B2 (ja) | ウェアラブルコンピュータに用いるリング型インタフェース、インタフェース装置、およびインタフェース方法 | |
US20180284945A1 (en) | Always-available input through finger instrumentation | |
WO2019033386A1 (zh) | 获取指纹图像的方法、装置和终端设备 | |
JP2011180843A (ja) | 情報処理装置、情報処理方法、およびプログラム | |
TWI471755B (zh) | 能操控電氣設備作動模式的操控裝置 | |
JP2004078977A (ja) | インターフェイス装置 | |
WO2017047180A1 (ja) | 情報処理装置、情報処理方法、およびプログラム | |
CN105912119A (zh) | 用于字符输入的方法和可穿戴装置 | |
KR102526951B1 (ko) | 전자 장치에서 생체 정보 측정 방법 및 장치 | |
KR101958649B1 (ko) | 컬러 인식 문자 정보 전송 시스템 | |
CN109739349A (zh) | 一种手掌虚拟键盘输入方法、***及输入传感识别器 | |
JP2019016999A (ja) | 読取システム及びカメラ | |
WO2020039703A1 (ja) | 入力装置 | |
JP2000029619A (ja) | コンピュータ装置 | |
Pansare et al. | Gestuelle: A system to recognize dynamic hand gestures using hidden Markov model to control windows applications | |
US11449695B2 (en) | Reading system and camera | |
JP2016076103A (ja) | ジェスチャ入力時におけるノイズ除去方法 | |
CN103677313A (zh) | 电子设备以及控制方法 | |
Waghmare et al. | OptiRing: Low-Resolution Optical Sensing for Subtle Thumb-to-Index Micro-Interactions | |
CN219758790U (zh) | 一种增强现实交互手套*** | |
CN113838154B (zh) | 触控笔和取色方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13787902 Country of ref document: EP Kind code of ref document: A1 |
|
REEP | Request for entry into the european phase |
Ref document number: 2013787902 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2014514411 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14398546 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |