WO2020022254A1 - Operation instruction control device and method therefor - Google Patents

Operation instruction control device and method therefor Download PDF

Info

Publication number
WO2020022254A1
WO2020022254A1 PCT/JP2019/028627 JP2019028627W WO2020022254A1 WO 2020022254 A1 WO2020022254 A1 WO 2020022254A1 JP 2019028627 W JP2019028627 W JP 2019028627W WO 2020022254 A1 WO2020022254 A1 WO 2020022254A1
Authority
WO
WIPO (PCT)
Prior art keywords
predetermined
operation instruction
see
light
user
Prior art date
Application number
PCT/JP2019/028627
Other languages
French (fr)
Japanese (ja)
Inventor
翔 阮
智博 中川
太郎 綿末
健二 福田
Original Assignee
株式会社ｔｉｗａｋｉ
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2019129789A external-priority patent/JP2020021473A/en
Application filed by 株式会社ｔｉｗａｋｉ filed Critical 株式会社ｔｉｗａｋｉ
Priority to CN201980047550.XA priority Critical patent/CN112514412A/en
Publication of WO2020022254A1 publication Critical patent/WO2020022254A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Definitions

  • the present invention uses an irradiating means for irradiating a predetermined light, or by a user performing a predetermined operation using only a finger or a hand of a user, to an operation indicator such as a smart home appliance.
  • TECHNICAL FIELD The present invention relates to an operation instruction control device and an operation instruction method capable of instructing an operation content by using an instruction.
  • a calling process is executed in response to an input of a speaker's voice, and a voice recognition technique for starting communication (for example, see Patent Literature 1) and an operation of a subject included in a captured image are recognized.
  • a voice recognition technique for starting communication for example, see Patent Literature 1
  • an operation recognition technology for example, see Patent Document 2 capable of performing a process corresponding to the predetermined operation when the recognized operation is a predetermined operation set in advance.
  • an object of the present invention is to provide an operation instruction control device and a method thereof that can ensure privacy and reduce variation in recognition accuracy.
  • the operation instruction control device applies a predetermined object (for example, an imaging target W shown in FIG. 5A) imaged by an imaging unit (for example, the camera 3 shown in FIGS. 1 and 8).
  • position setting means for example, CPU 40 shown in FIGS. 1 and 8 and step S2 shown in FIG. 3 for setting a predetermined position (for example, positions Ra to Rc shown in FIG. 5B);
  • the predetermined position for example, positions Ra to Rc shown in FIG. 5B
  • the user uses the irradiation means (for example, the light irradiation device 2 shown in FIG.
  • the predetermined light for example, the light 2a shown in FIGS. 1 and 8
  • a predetermined light for example, light 2a shown in FIGS. 1 and 8
  • a predetermined operation is performed with the irradiated predetermined light (for example, light 2a shown in FIGS. 1 and 8)
  • the predetermined light is emitted.
  • the operation content item TB3 shown in FIG. 2, the operation content item TB3A shown in FIG. 9, and the operation content item TB3B shown in FIG. 10 are sent to a predetermined operation indicator.
  • the position setting means for example, the CPU 40 shown in FIGS.
  • the user performs a predetermined operation with respect to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B) set in step S2) using only the user's finger or hand.
  • the operation instruction contents corresponding to the predetermined operation for example, the operation content item TB3 shown in FIG. 2, the operation content item TB3A shown in FIG. 9, and the operation content item TB3B shown in FIG. 10.
  • Operation instructing means for example, CPU 40 shown in FIGS. 1 and 8, steps S10 to S13 shown in FIG. 4, and steps S20 to S13 shown in FIG. 11 for sending to the body. I have.
  • the operation instruction control device is provided for a predetermined object (for example, an imaging target W shown in FIG. 5A) imaged by an imaging unit (for example, the camera 3 shown in FIG. 12).
  • Position setting means for example, CPU 40 shown in FIG. 12, step S2 shown in FIG. 3 for setting a predetermined position (for example, positions Ra to Rc shown in FIG. 5B);
  • a predetermined light is applied to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B) set by the position setting means (for example, CPU 40 shown in FIG. 12, step S2 shown in FIG. 3).
  • the user irradiates the predetermined light (for example, light 2a shown in FIG.
  • a predetermined operation is performed by the irradiated predetermined light (for example, light 2a shown in FIG. 12)
  • a plurality of operation instruction contents for example, the operation contents shown in FIG. 13
  • TB3C to a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12), or is set by the position setting means (for example, the CPU 40 shown in FIG. 12 and step S2 shown in FIG. 3).
  • the predetermined position for example, as shown in FIG.
  • a plurality of operation instruction contents corresponding to the predetermined operation for example, FIG. Operation instruction means (for example, CPU 40 shown in FIG. 12, and steps S10 to S30 shown in FIG. 14) for sending out the item TB3C of the operation content shown to a predetermined operation instruction device (for example, operation instruction device 5 shown in FIG. 12).
  • the predetermined operation instruction device determines at least one operation instruction content from the plurality of operation instruction contents (for example, the operation content item TB3C shown in FIG. 13). It can be transmitted to the operation indicator.
  • An operation instruction control device is the operation instruction control device according to the first or second aspect, wherein the operation instruction means (for example, the CPU 40 shown in FIG. 8 and steps S20 to S13 shown in FIG. ) Even if the predetermined operation is the same for each user who uses the irradiation unit (for example, the light irradiation device 2A shown in FIG. 8), different operation instruction contents (for example, the operation contents item TB3A shown in FIG. 9). Is transmitted to a predetermined operation instruction body or a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12).
  • the operation instruction means for example, the CPU 40 shown in FIG. 8 and steps S20 to S13 shown in FIG.
  • the operation instruction means for example, the CPU 40 shown in FIG. 8 and steps S20 to S13 shown in FIG. 11.
  • the operation instruction means for example, the CPU 40 shown in FIG. 8 and steps S20 to S13 shown in FIG. 11.
  • the irradiating means for example, the light irradiating device 2A shown in FIG. 8
  • the same operation instruction content is transmitted to the predetermined operation instruction body or the predetermined operation instruction device (for example, the operation instruction shown in FIG. 12).
  • a different predetermined operation is performed (for example, an operation content item TB3B shown in FIG. 10).
  • an operation instruction control method provides a predetermined object (for example, an imaging target W shown in FIG. 5A) captured by an imaging unit (for example, the camera 3 shown in FIGS. 1 and 8).
  • a predetermined position for example, positions Ra to Rc shown in FIG. 5B
  • Irradiating means for example, for irradiating predetermined light (for example, light 2a shown in FIGS. 1 and 8) to the set predetermined position (for example, positions Ra to Rc shown in FIG. 5B)
  • the user irradiates the predetermined light (for example, light 2a shown in FIGS. 1 and 8) using the light irradiation device 2 shown in FIG.
  • the operation instruction content (for example, the operation content item TB3 shown in FIG. 2 and FIG. 9) corresponding to the predetermined operation is displayed.
  • the operation content item TB3A shown in FIG. 10 and the operation content item TB3B shown in FIG. 10 are transmitted to a predetermined operation indicator, or the set predetermined position (for example, the positions Ra to Rc shown in FIG. 5B).
  • the user performs a predetermined operation using only the user's finger or hand.
  • the operation instruction contents corresponding to the predetermined operation (for example, the operation content item TB3 shown in FIG. 2, the operation content item TB3A shown in FIG. 9, and the operation content item TB3B shown in FIG. 10) are changed to a predetermined operation indicator. (For example, steps S10 to S13 shown in FIG. 4 and steps S20 to S13 shown in FIG. 11).
  • a predetermined object for example, an imaging target W shown in FIG. 5A
  • an imaging unit for example, the camera 3 shown in FIG. 12
  • a step of setting a predetermined position for example, positions Ra to Rc shown in FIG. 5B
  • Irradiating means for example, as shown in FIG. 12
  • predetermined light for example, light 2a shown in FIG. 12
  • the user irradiates the predetermined light (for example, light 2a shown in FIG.
  • a plurality of operation instruction contents (for example, the operation content item TB3C shown in FIG. 13) corresponding to the predetermined operation are transferred to a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12).
  • the user performs a predetermined operation using only the user's finger or hand with respect to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B).
  • a plurality of operation instruction contents according to the predetermined operation for example, FIG. Item TB3C) operation contents shown in prescribed operation instruction device (e.g., including the step of transmitting an operation instruction device 5) shown in FIG.
  • the predetermined operation instruction device determines at least one operation instruction content from the plurality of operation instruction contents (for example, the operation content item TB3C shown in FIG. 13). It can be transmitted to the operation indicator.
  • the user can irradiate predetermined light (for example, the light 2a shown in FIGS. 1 and 8) with the irradiating means (for example, the light irradiating device 2 shown in FIG. 8 using the light irradiation device 2A shown in FIG. 8, a predetermined position (for example, positions Ra to Rc shown in FIG. 5B) of a predetermined object (for example, the imaging target W shown in FIG. 5A) is set. ) Is irradiated with the predetermined light (for example, light 2a shown in FIGS. 1 and 8), and a predetermined operation is performed by the irradiated predetermined light (for example, light 2a shown in FIGS. 1 and 8).
  • predetermined light for example, the light 2a shown in FIGS. 1 and 8
  • the irradiating means for example, the light irradiating device 2 shown in FIG. 8 using the light irradiation device 2A shown in FIG. 8
  • a predetermined position for example, positions Ra to
  • the user uses only the user's finger or hand to set a predetermined position (for example, FIG. 5A) of the predetermined object (for example, the imaging target W shown in FIG. 5A). Instructing a predetermined operation instruction to a predetermined operation by simply performing a predetermined operation for the positions Ra to Rc shown in (b). It can be.
  • the voice or the motion of the speaker or the person who is the subject unlike the voice recognition and the motion recognition, so that the privacy can be ensured.
  • the movement of predetermined light for example, light 2a shown in FIGS. 1 and 8) emitted from irradiation means (for example, light irradiation device 2 shown in FIG. 1 and light irradiation device 2A shown in FIG. 8), or Since it is only necessary to recognize the movement of the user's finger or hand, the system is not easily affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
  • the user uses the irradiating means (for example, the light irradiating device 2 shown in FIG. 12) for irradiating the predetermined light (for example, the light 2a shown in FIG. 12).
  • the predetermined light for example, the positions Ra to Rc shown in FIG. 5B
  • the predetermined object for example, the imaging target W shown in FIG.
  • a predetermined operation instruction device for example, FIG.
  • a plurality of predetermined operations are sent to the operation instruction device 5 shown in FIG. 5, or the user can set a predetermined position (for example, FIG. 5A) of a predetermined target (for example, the imaging target W shown in FIG. 5A).
  • a predetermined position for example, FIG. 5A
  • a predetermined target for example, the imaging target W shown in FIG. 5A
  • the user uses the user's finger or hand only
  • a plurality of predetermined operations can be transmitted to a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12), and accordingly, the predetermined operation instruction device (for example, FIG. 12, at least one predetermined operation can be instructed to a predetermined operation indicator.
  • the voice or motion of a speaker or a person who is a subject as in voice recognition or motion recognition, so that privacy can be ensured.
  • the movement of predetermined light for example, light 2a shown in FIG. 12
  • irradiation means for example, light irradiation device 2 shown in FIG. 12
  • the processing is simplified and the variation in recognition accuracy can be reduced.
  • the predetermined operation is the same for each user who uses the irradiation unit (for example, the light irradiation device 2A shown in FIG. 8)
  • different operation instruction contents for example, Since the operation content item TB3A shown in FIG. 9 is transmitted to a predetermined operation instruction body or a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12), customization for each user is possible.
  • a predetermined operation instruction body or a predetermined operation instruction device for example, the operation instruction device 5 shown in FIG. 12
  • the same operation instruction content is given to a predetermined operation instruction body or a predetermined operation instruction device for each user who uses the irradiation means (for example, the light irradiation device 2A shown in FIG. 8).
  • a predetermined operation for example, the operation content item TB3B shown in FIG. 10
  • a different predetermined operation is performed (for example, the operation content item TB3B shown in FIG. 10), so that customization for each user is possible.
  • it is possible to store data on when and which user used the irradiation means for example, the light irradiation device 2A shown in FIG. 8).
  • FIG. 1 is an overall view showing a first embodiment of an operation instruction control system according to the present invention.
  • FIG. 3 is a diagram showing a table stored in an operation instruction content related information registration database according to the embodiment. It is a flowchart figure which shows the control procedure at the time of storing information in the operation instruction content related information registration database concerning the embodiment.
  • FIG. 3 is a flowchart illustrating a control procedure of the operation instruction control system according to the embodiment.
  • FIG. 3A is a diagram illustrating an example of an imaging target imaged by the camera according to the embodiment
  • FIG. 2B is a diagram illustrating the imaging target object illustrated in FIG. It is a figure showing the example set.
  • 5A shows a case where a user irradiates a light to a position Ra set in FIG.
  • FIG. 5B using a light irradiation device, and a bright point generated by the irradiated light rotates clockwise.
  • FIG. 5B shows an example in which a circle is drawn twice
  • FIG. 5B shows a case where the user irradiates light to the position Ra set in FIG.
  • FIG. 5C shows an example in which a circle is drawn twice in a counterclockwise direction at a luminescent spot generated by the irradiated light
  • FIG. 5C shows the position Ra set in FIG.
  • FIG. 3 is a diagram illustrating an example in which light is irradiated using a light irradiation device, and triangles are drawn using bright spots generated by the irradiated light.
  • FIG. 5A illustrates a case where a user irradiates a light to a position Rb set in FIG. 5B using a light irradiation device, and a bright spot generated by the irradiated light rotates clockwise.
  • FIG. 5B shows an example in which a circle is drawn twice.
  • FIG. 5B shows a case where the user irradiates the position Rc set in FIG.
  • FIG. 9 is a diagram illustrating an example in which a circle is drawn twice counterclockwise at a luminescent spot generated by irradiated light.
  • FIG. 3 is a diagram showing a table stored in an operation instruction content related information registration database according to the embodiment.
  • FIG. 10 is a diagram illustrating a table different from FIG. 9.
  • FIG. 3 is a flowchart illustrating a control procedure of the operation instruction control system according to the embodiment. It is an overall view showing a third embodiment of the operation instruction control system according to the present invention.
  • FIG. 3 is a diagram showing a table stored in an operation instruction content related information registration database according to the embodiment.
  • FIG. 3 is a flowchart illustrating a control procedure of the operation instruction control system according to the embodiment.
  • 3A and 3B are screen examples showing screen transitions displayed on the display unit of the operation instruction device according to the embodiment.
  • the operation instruction control system 1 includes a light irradiation device 2, a camera 3, and a control device 4.
  • the symbol W indicates an object to be imaged by the camera 3.
  • the light irradiation device 2 is a device including a laser pointer, a ring light, a watch light, a glasses light, a pen light, a flashlight, and the like, and is imaged by the camera 3 as shown in FIG.
  • a user at a distance from the imaging target W can irradiate the imaging target W with the light 2a.
  • the luminescent spot 2b generated by the light 2a irradiated from the light irradiation device 2 is superimposed on the imaging target W.
  • the camera 3 can image the imaging target object W. More specifically, the camera 3 is fixedly arranged at a predetermined position, and can capture an image of an imaging target W which is a part of a room, for example, as shown in FIG. is there. Further, the camera 3 is a high-speed camera capable of continuously capturing more than 30 frames per second, and capable of capturing the movement of the bright spot 2b without blurring as shown in FIG. The image data captured by the camera 3 is output to the control device 4 as shown in FIG.
  • control device 4 can output predetermined data to the outside of the control device 4 and an input unit 41 that can externally input predetermined data to the control device 4 using a CPU 40, a mouse, a keyboard, a touch panel, or the like.
  • a communication unit 46 that can be connected to an operation indicator such as a smart home appliance (not shown) via a network by communication means such as a LAN (for example, Wifi (registered trademark)), a wired LAN, or a dial-up; Information required for the operation instruction content for the operation instruction body of The work instruction content-related information registration database 47, in is configured.
  • Examples of the operation indicator include smart home appliances such as an air conditioner, a rice cooker, and a microwave oven, information processing terminals such as a smartphone such as a PC and iphone (registered trademark), a smart vehicle such as a car, and a smart vehicle. Any device that can be connected via a network, such as a drone or a home robot, may be used.
  • the operation instruction content related information registration database 47 stores a table TBL shown in FIG. More specifically, the table TBL stores a set position (refer to TB1) with respect to the imaging target W imaged by the camera 3, and stores the set position (refer to TB1). On the other hand, the content of the operation performed by the user using the light irradiation device 2 (see TB2) is stored, and the operation content (see TB3) of an operation indicator such as a smart home appliance (not shown) corresponding to the operation content is stored. Have been.
  • an operator uses the input unit 41 of the control device 4 shown in FIG. 1 to instruct the activation of a program stored in the ROM 43 shown in FIG. Accordingly, the CPU 40 (see FIG. 1) of the control device 4 performs a process as shown in FIG.
  • the processing contents of the program shown in FIG. 3 are merely examples, and the present invention is not limited to this.
  • the CPU 40 acquires image data of the object W captured by the camera 3 (step S1).
  • the imaging target W an air conditioner operation panel Wa capable of adjusting the temperature of an indoor air conditioner is installed as shown in FIG. 5A, a wall clock Wb indicating the current time is installed, and a telephone Wc is installed.
  • a part of the room as described above is imaged by a camera 3 fixedly arranged at a predetermined location.
  • the camera 3 outputs the imaging data of the imaging target object W (see FIG. 5A) to the control device 4 (see FIG. 1).
  • the CPU 40 acquires the imaging data via the input unit 41 (see FIG. 1).
  • an air conditioner (not shown) whose temperature is adjusted by the air conditioner operation panel Wa can be connected to the communication unit 46 (see FIG. 1) via a network.
  • the wall clock Wb indicating the current time is connected to a speaker (not shown) capable of notifying, for example, today's schedule by voice, and the speaker (not shown) is connected to the communication unit 46 ( (See FIG. 1) and can be connected via a network.
  • the telephone Wc is connected to a speaker (not shown) capable of reproducing the contents of the answering machine, and the speaker (not shown) is connected to the communication unit 46 (see FIG. 1) and the network. Can be connected via
  • the CPU 40 causes the display unit 45 (see FIG. 1) to display, on the acquired image data, instruction content for causing the operator to set a predetermined position (step S2). More specifically, the CPU 40 (see FIG. 1) causes the display unit 45 to display the acquired imaging data (the imaging target object W) as shown in FIG. In response to this, the operator sets the position Ra of the air conditioner operation panel Wa using the input unit 41 (see FIG. 1), sets the position Rb of the wall clock Wb, and further sets the position of the telephone Wc. The position Rc is set. As a result, the CPU 40 (see FIG. 1) causes the display unit 45 (see FIG. 1) to display, on the acquired image data, instruction content for causing the operator to set a predetermined position (step S2). More specifically, the CPU 40 (see FIG. 1) causes the display unit 45 to display the acquired imaging data (the imaging target object W) as shown in FIG. In response to this, the operator sets the position Ra of the air conditioner operation panel Wa using the input unit 41 (see FIG. 1), sets the position Rb of the wall
  • the CPU 40 determines that the X, Y coordinate position of the upper left corner Pa1 of the position Ra is the origin O. Based on the reference, the coordinate position is calculated from the pixel value and the like (in FIG. 2, the X coordinate is 50 and the Y coordinate is 1000), and the X, Y coordinate position of the lower right corner Pa2 of the position Ra is the origin. Based on O, which coordinate position is calculated from the pixel value or the like (in FIG.
  • the X coordinate is 200 and the Y coordinate is 1200).
  • the data is stored as (50, 1000)-(200, 1200) in the item (see TB1) at the position of the table TBL (see FIG. 2).
  • the CPU 40 calculates, based on the pixel value or the like, which coordinate position the X, Y coordinate position of the upper left corner Pb1 of the position Rb shown in FIG. (In FIG. 2, the X coordinate is set to 1000 and the Y coordinate is set to 50.)
  • the X, Y coordinate position of the lower right corner Pb2 of the position Rb is based on the origin O, a pixel value etc.
  • the X coordinate is 1200 and the Y coordinate is 200).
  • the data is stored as (1000, 50)-(1200, 200) in the item (see TB1) at the position of the table TBL (see FIG. 2).
  • the CPU 40 determines which coordinate position of the X, Y coordinate position of the upper left corner Pc1 of the position Rc shown in FIG. Calculation (in FIG. 2, the X coordinate is set to 500 and the Y coordinate is set to 1800), and when the X, Y coordinate position of the lower right corner Pc2 of the position Rc is based on the origin O, a pixel value indicates (In FIG. 2, the X coordinate is 800 and the Y coordinate is 2000).
  • the data is stored as (500, 1800)-(800, 2000) in the item (see TB1) at the position of the table TBL (see FIG. 2).
  • the CPU 40 causes the display unit 45 (see FIG. 1) to display, at the position set by the worker, instruction contents for causing the worker to set predetermined operation contents and predetermined operation contents.
  • Step S3 the operator uses the input unit 41 (see FIG. 1) to perform any operation using the light irradiation device 2 with respect to the positions Ra to Rc.
  • the user inputs what operation content is to be instructed. Specifically, as shown in FIG. 6A, the user irradiates the position Ra with the light 2a (see FIG. 1) using the light irradiation device 2, and the position Ra is generated by the irradiated light 2a.
  • the operator uses the input unit 41 (see FIG. 1) to perform an input such as raising the temperature of the air conditioner.
  • the CPU 40 stores the drawing of the circle twice clockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and operates the table TBL (see FIG. 2).
  • the temperature of the air conditioner is increased in the item of the content (see TB3), it is stored.
  • the user irradiates the position Ra with the light 2a (see FIG. 1) using the light irradiating device 2, and the luminescent spot 2b generated by the irradiated light 2a.
  • the CPU 40 stores the drawing of the circle twice counterclockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and stores the table TBL (see FIG. 2).
  • the operation content item (see TB3) is stored.
  • the user irradiates the position Ra with the light 2a (see FIG. 1) using the light irradiation device 2, and the luminescent spot generated by the irradiated light 2a.
  • the operator performs an input such as turning off the air conditioner by using the input unit 41 (see FIG. 1) when the operation of drawing a triangle is performed in 2b.
  • the CPU 40 stores the drawing of the triangle in the operation content item (see TB2) of the table TBL (see FIG. 2), and stores the operation content item (TB3) of the table TBL (see FIG. 2).
  • the air conditioner is stored as OFF.
  • the user irradiates the position Rb with light 2a (see FIG. 1) using the light irradiation device 2, and a luminescent spot 2b generated by the irradiated light 2a.
  • Is performed using the input unit 41 (see FIG. 1) such as notifying of today's schedule when the user performs an operation of drawing a circle twice clockwise.
  • the CPU 40 stores the drawing of the circle twice clockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and operates the table TBL (see FIG. 2).
  • the schedule of today is notified in the item of the content (refer to TB3), it is stored.
  • the user irradiates the position Rc with light 2a (see FIG. 1) using the light irradiation device 2, and a luminescent spot generated by the irradiated light 2a.
  • the operator inputs using the input unit 41 (see FIG. 1) such as reproducing the answering machine.
  • the CPU 40 stores the drawing of the circle twice counterclockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and stores the table TBL (see FIG. 2).
  • the answering machine is reproduced, it is stored in the item of the operation content (see TB3).
  • the present invention is not limited to this, and an operation indicator such as a smart home appliance is provided.
  • a reference API Application ⁇ Programming ⁇ Interface
  • the CPU 40 acquires data externally input from the communication unit 46 of the control device 4 shown in FIG.
  • the above contents are stored in the table TBL (see FIG. 2) stored in the operation instruction content related information registration database 47 (see FIG. 1).
  • the CPU 40 obtains imaging data of the imaging target W captured by the camera 3, and checks a change in luminance between frames of the imaging data (step S10). That is, for example, when the user irradiates the position Ra shown in FIG. 6 with the light 2a (see FIG. 1) using the light irradiation device 2, the imaging data of the frame before the irradiation with the light 2a is obtained. Is compared with the imaging data of the frame after irradiation with the light 2a. Since the irradiation with the light 2a changes the luminance between the frames due to the bright spot 2b generated by the irradiation light 2a, The position of the luminescent spot 2b will be known.
  • the CPU 40 checks the change in luminance between frames.
  • the CPU 40 confirms the change in the luminance, thereby confirming the operation content of the bright spot 2b generated by the light 2a irradiated by using the light irradiation device 2 (step S11). Specifically, for example, the user irradiates the position Ra shown in FIG. 6A with the light 2a (see FIG. 1) using the light irradiating device 2 and shines due to the irradiated light 2a. When the point 2b is moved in such a manner that a circle is drawn twice clockwise, the CPU 40 (see FIG. 1) confirms a change in luminance between frames. When the Y coordinate position is based on the origin O shown in FIG.
  • the coordinate position can be calculated from the pixel value or the like, and the X and Y coordinates of the bright spot 2b for each frame can be calculated. By joining the positions, it can be confirmed that the luminescent spot 2b has performed an operation of drawing a circle twice clockwise in the position Ra shown in FIG. 6A.
  • the CPU 40 reads out the table TBL (see FIG. 2) stored in the operation instruction content related information registration database 47 (see FIG. 1), and confirms the table TBL in step S11. A portion corresponding to the content is searched, and the operation content is obtained from the operation content item (see TB3) (step S12). Specifically, the position Ra shown in FIG. 6A is irradiated with light 2a (see FIG. 1) using the light irradiation device 2, and the bright spot 2b generated by the irradiated light 2a is rotated clockwise.
  • the CPU 40 confirms that the user has performed the operation of drawing a circle twice, the CPU 40 (see FIG. 1) stores the table TBL (see FIG. 2) stored in the operation instruction content related information registration database 47 (see FIG. 1). ), The operation content such as raising the temperature of the air conditioner is acquired.
  • the CPU 40 transmits the acquired operation content to the outside via the communication unit 46 (see FIG. 1) (step S13).
  • an air conditioner (not shown) connected to the communication unit 46 (see FIG. 1) via the network performs an operation of increasing the temperature.
  • the user when the user wants to instruct a predetermined operation on an operation indicator such as a smart home appliance (not shown), the user can use the light irradiation device 2 to perform an operation on the imaging target W.
  • a predetermined operation can be instructed only by irradiating the light Ra onto the positions Ra to Rc and performing a predetermined operation on the luminescent spot 2b generated by the irradiated light 2a.
  • the voice recognition and the motion recognition unlike the voice recognition and the motion recognition, it is not necessary to use the voice or the motion of the speaker or the person who is the subject, so that the privacy can be ensured. Further, since it is only necessary to recognize the movement of the luminescent spot 2b generated by the light 2a, it is hardly affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
  • the difference between the first embodiment and the second embodiment is that, in the first embodiment, an example in which an unspecified user uses the light irradiation device 2 is shown, but in the second embodiment, a specific user is The difference is that the light irradiation device 2 is used.
  • this point will be described in detail.
  • the operation instruction control system 1A includes a light irradiation device 2A, a camera 3, and a control device 4.
  • a table TBLA shown in FIG. 9 is stored in the operation instruction content related information registration database 47 of the control device 4.
  • a user ID (see TB0A) using the light irradiation device 2A is stored, and an object to be imaged by the camera 3 (see FIG. 8) corresponding to the user ID (see TB0A)
  • a set position (see TB1A) is stored, and for the set position (see TB1A), the user corresponding to this user ID (see TB0A) operates the light irradiation device 2.
  • the operation contents (see TB2A) operated by using are stored, and the operation contents (see TB3A) for the operation indicator such as a smart home appliance (not shown) according to the operation contents are stored. More specifically, Mr. A (see TB0A) having the user ID “x0001” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B. (See TB1A) using the light irradiation device 2A to irradiate light 2a (see FIG. 8), and draw a bright spot 2b generated by the irradiated light 2a twice in a clockwise circle.
  • the operation content (see TB3A) for increasing the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Furthermore, Mr. A (see TB0A) having the user ID "x0001" is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B (see TB1A).
  • Mr. A (see TB0A) having the user ID "x0001" is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B (see TB1A).
  • was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise.
  • an operation content (see TB3A) for lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • the user A having the user ID “x0001” (see TB0A) is positioned Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B (see TB1A).
  • the operation content (see TB3A) of turning off the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • Mr. B (see TB0A) having the user ID "x0002" is located at the position Ra shown in FIG. 5B (in FIG. 9, the position is (50, 1000)-(200, 1200)) (see TB1A).
  • the light 2a (see FIG. 8) is irradiated using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is moved twice in a clockwise circle. (See TB2A), the operation content (see TB3A) of lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, Mr.
  • the user B having the user ID “x0002” (refer to TB0A) is positioned Ra ((50, 1000) ⁇ (200, 1200) in FIG. 9) illustrated in FIG. 5B (refer to TB1A).
  • Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2A).
  • the operation content (see TB3A) of turning on the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • control device 4 has a built-in RTC (real-time clock), it is possible to store in the ROM 43 when and which user used the light irradiation device 2A. This makes it possible to confirm when and which user used the light irradiation device 2.
  • the operation content may be different for each user. That is, the table TBLB shown in FIG. 10 is stored in the operation instruction content related information registration database 47 of the control device 4.
  • a user ID (see TB0B) using the light irradiation device 2A is stored, and an object to be imaged by the camera 3 (see FIG. 8) corresponding to the user ID (see TB0B)
  • a set position (see TB1B) is stored, and for the set position (see TB1B), the user corresponding to this user ID (see TB0B) operates the light irradiation device 2A.
  • the operation contents (see TB2B) used are stored, and the operation contents (see TB3B) for an operation indicator such as a smart home appliance (not shown) according to the operation contents are stored. More specifically, Mr. A (refer to TB0B) having the user ID "x0001" is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B. (See TB1B) using the light irradiation device 2A to irradiate the light 2a (see FIG. 8), and draw a bright spot 2b generated by the irradiated light 2a twice in a clockwise circle.
  • the operation content (see TB3B) of increasing the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, Mr. A (refer to TB0B) having the user ID “x0001” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B).
  • Mr. A (refer to TB0B) having the user ID “x0001” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B).
  • was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise.
  • an operation content (see TB3B) for lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • Mr. A (refer to TB0B) having the user ID "x0001" is positioned Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B).
  • Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2B).
  • the operation content (see TB3B) of turning off the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • Mr. B (see TB0B) having the user ID “x0002” is located at the position Ra shown in FIG. 5B ((50, 1000)-(200, 1200) in FIG. 10) (see TB1B).
  • Mr. B (see TB0B) having the user ID “x0002” is located at the position Ra shown in FIG. 5B ((50, 1000)-(200, 1200) in FIG. 10) (see TB1B).
  • was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise.
  • an operation content (see TB3B) for increasing the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • FIG. 5B (refer to TB1B) having the user ID “x0002” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) illustrated in FIG. 5B (refer to TB1B).
  • the light 2a (see FIG. 8) is irradiated using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is moved twice in a clockwise circle. (See TB2B), the operation content (see TB3B) of lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • the user B having the user ID "x0002" is positioned Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B).
  • Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a square (see TB2B).
  • the operation content (see TB3B) of turning off the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
  • control device 4 has a built-in RTC (real-time clock), it is possible to store in the ROM 43 when and which user used the light irradiation device 2A. This makes it possible to confirm when and which user used the light irradiation device 2.
  • the method of storing the contents stored in the table TBLA (see FIG. 9) and the table TBLB (see FIG. 10) described above may be performed for each user by performing the processing shown in FIG. It is omitted.
  • the user activates the program stored in the ROM 43 shown in FIG. 8 by using the input unit 41 of the control device 4 shown in FIG. To instruct.
  • the CPU 40 (see FIG. 8) of the control device 4 performs a process as shown in FIG.
  • FIG. 11 description will be made with reference to FIG. Note that the processing contents of the program shown in FIG. 11 are merely examples, and the present invention is not limited to this.
  • the CPU 40 acquires an identifier (for example, ID) of a user who uses the light irradiation device 2A from the light irradiation device 2A (step S20). More specifically, when using the light irradiation device 2A, the user (for example, Mr. A) reads out his / her own registered identifier (for example, ID), and reads the current user (for example, Mr. A). ) Is recognized by the light irradiation device 2A. Thus, if the CPU 40 (see FIG. 1) acquires an identifier (for example, ID) of a user who uses the light irradiation device 2A from the light irradiation device 2A (step S20). More specifically, when using the light irradiation device 2A, the user (for example, Mr. A) reads out his / her own registered identifier (for example, ID), and reads the current user (for example, Mr. A). ) Is recognized by the light irradiation device 2A. Thus
  • the light irradiation device 2A acquires the identifier (for example, ID) of the user who uses the light irradiation device 2A from the light irradiation device 2A, the light irradiation device 2A is used.
  • the current user for example, Mr. A
  • the current user can be determined.
  • the CPU 40 (see FIG. 1) performs the processing of step S10 and step S11 described above.
  • the CPU 40 reads the table TBLA (see FIG. 9) or the table TBLB (see FIG. 10) stored in the operation instruction content related information registration database 47 (see FIG. 1), and reads the table. From the TBLA or the table TBLB, a portion corresponding to the content confirmed in step S11 with respect to the acquired user identifier (for example, ID) is searched, and the operation is performed from the operation content item (see TB3A, TB3B). The contents are acquired (step S22). Specifically, Mr. A (see TB0A) having the user ID “x0001” irradiates the position Ra shown in FIG. 6A with the light 2a (see FIG. 8) using the light irradiation device 2.
  • the CPU 40 When the CPU 40 (see FIG. 1) confirms that the bright spot 2b generated by the irradiated light 2a has been operated to draw a circle twice in a clockwise direction, the CPU 40 (see FIG. 1) registers the operation instruction content related information registration database. From the table TBLA (see FIG. 9) or the table TBLB (see FIG. 10) stored in the table 47 (see FIG. 1), an operation content such as raising the temperature of the air conditioner is obtained.
  • the CPU 40 transmits the acquired operation content to the outside via the communication unit 46 (see FIG. 1) (step S13).
  • an air conditioner (not shown) connected to the communication unit 46 (see FIG. 1) via the network performs an operation of increasing the temperature.
  • the user when a specific user wants to instruct a predetermined operation on an operation indicator such as a smart home appliance (not shown), the user can use the light irradiation device 2 to perform an imaging object.
  • a predetermined operation can be instructed only by irradiating the light 2a to the positions Ra to Rc of W and causing the luminescent spot 2b generated by the irradiated light 2a to perform a predetermined operation.
  • the difference between the first embodiment and the third embodiment is that, in the first embodiment, the operation instruction content is transmitted to an operation indicator such as a smart home appliance (not shown).
  • an operation indicator such as a smart home appliance (not shown).
  • a plurality of operation instruction contents are transmitted to the operation instruction device.
  • the operation instruction control system 1 ⁇ / b> B includes a light irradiation device 2, a camera 3, a control device 4, and an operation instruction device 5.
  • the operation instruction device 5 includes a smartphone or a mobile phone such as iPhone (registered trademark), a wearable device, a PC, or the like, and can be connected to the communication unit 46 (see FIG. 12) via a network. And a display unit 50 capable of displaying various images.
  • the operation device 5 can be connected to an operation indicator such as a smart home appliance (not shown) via a network.
  • the operation instruction content related information registration database 47 of the control device 4 stores a table TBLC shown in FIG.
  • a set position (see TB1) is stored with respect to the imaging target W picked up by the camera 3, and the user sets light on the set position (see TB1).
  • Contents (see TB2) of operation using the irradiation device 2 are stored, and a plurality of operation contents (see TB3C) for an operation indicator such as a smart home appliance (not shown) corresponding to the operation contents are stored.
  • the light irradiation device 2 is used to light the position Ra (refer to (50, 1000)-(200, 1200) in FIG. 13) (see TB1) shown in FIG. 5B.
  • the operating device 5 and the network are connected.
  • the operation content for raising the temperature of the air conditioner connected via the CAM and the operation content for lowering the temperature of the air conditioner (see TB3C) are stored.
  • the light 2a (FIG. 12) is applied to the position Ra (shown as (50, 1000)-(200, 1200) in FIG. 13) (see TB1) shown in FIG. (See TB2), the bright spot 2b generated by the irradiated light 2a is connected to the operating device 5 via a network.
  • the operation content for raising the humidity of the air conditioner and the operation content for lowering the humidity of the air conditioner are stored. Further, the light 2a (FIG. 13) is applied to the position Ra (shown as (50, 1000)-(200, 1200) in FIG. 13) (see TB1) shown in FIG. 8), and the bright point 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2).
  • the air conditioner is connected to the operation device 5 via a network
  • the operation content of turning on the air conditioner and the operation content of turning off the air conditioner are stored.
  • a plurality of operation contents are stored for one operation content.
  • only two operation contents are illustrated, but of course, three or more operation contents may be stored for one operation content.
  • the method of storing the contents stored in the table TBLC (see FIG. 13) described above is the same as the processing of steps S1 and S2 in the processing shown in FIG. Only the difference is that the operation content is input, and the rest is the same.
  • the user uses the input unit 41 of the control device 4 shown in FIG. 12 to activate the program stored in the ROM 43 shown in FIG. To instruct. Accordingly, the CPU 40 (see FIG. 12) of the control device 4 performs a process as shown in FIG.
  • the processing contents of the program shown in FIG. 14 are only examples, and the present invention is not limited to this.
  • the CPU 40 (see FIG. 12) performs the above-described processing of steps S10 to S12.
  • the CPU 40 transmits the acquired operation content (for example, an operation content of raising the temperature of the air conditioner and decreasing the temperature of the air conditioner) via the communication unit 46 (see FIG. 12).
  • the operation instruction device 5 causes the display unit 50 to display the transmitted operation content, as shown in FIG. Specifically, when the acquired operation content is an operation content of raising the temperature of the air conditioner or lowering the temperature of the air conditioner, the display unit 50 displays the content of increasing the temperature of the air conditioner or decreasing the temperature of the air conditioner. Then, the user is caused to select one of the operations.
  • the user when the user wants to instruct a predetermined operation to an operation indicator such as a smart home appliance (not shown), the user can use the light irradiation device 2 to scan the imaging target W.
  • a plurality of operation contents can be transmitted to the operation instruction device 5 simply by irradiating the positions Ra to Rc with the light 2a and causing the luminescent spot 2b generated by the irradiated light 2a to perform a predetermined operation.
  • at least one predetermined operation can be instructed from the operation instruction device 5 to an operation indicator such as a smart home appliance (not shown).
  • a bright point 2b is drawn twice in a clockwise circle within a position Ra.
  • the error range is set in advance. If it is within the error range, the tables TBL (see FIG. 2), TBLA (see FIG. 9), and TBLB (see FIG. 9) stored in the operation instruction content related information registration database 47 (see FIGS.
  • step S11 a portion corresponding to the content confirmed in step S11 is searched, and the operation content is obtained from the operation content item (see TB3, TB3A, TB3B, TB3C). You may do it.
  • the method of setting the positions Ra to Rc shown in the first to third embodiments is merely an example, and the present invention is not limited to this.
  • the positions Ra to Rc may be set automatically.
  • FIG. 1 the tables TBL (see FIG. 2), TBLA (see FIG. 9), TBLB (see FIG. 10), and TBLC (see FIG. 10) stored in the operation instruction content related information registration database 47 (see FIGS. 1, 8, and 12).
  • FIG. 13 shows a pattern and / or image of the air conditioner operation panel Wa in the position Ra, a pattern and / or image of the wall clock Wb in the position Rb, and a pattern and / or image of the telephone Wc in the position Rc. May be stored.
  • the CPU 40 extracts a pattern and / or an image within the range in which the luminescent spot 2b operates from the imaging data of the imaging target W captured by the camera 3.
  • a table and / or image previously stored in a table TBL see FIG. 2), a TBLA (see FIG. 9), a TBLB (see FIG. 10), and a TBLC (see FIG. 13).
  • the operation content corresponding to the similar pattern and / or image is obtained from the operation content item (see TB3, TB3A, TB3B, TB3C). Will be done.
  • the positions Ra to Rc can be automatically set, and work efficiency can be improved.
  • a pattern and / or image corresponding to a position closest to the position of the range in which the luminescent spot 2b has moved may be selected.
  • the operation of drawing the bright point 2b twice in the clockwise direction or the operation of drawing the circle in the counterclockwise direction twice has been described.
  • the present invention is not limited to this, and a process in which the luminescent spot 2b is kept in the positions Ra to Rc for a certain period of time may be used.
  • the predetermined operation is performed using the light irradiation devices 2 and 2A.
  • the present invention is not limited to this, and only the user's finger or hand is used.
  • a predetermined operation may be used. For example, if the user performs an operation of touching the air conditioner operation panel Wa in the position Ra with a finger, the temperature of the air conditioner is raised, or the user touches the air conditioner operation panel Wa in the position Ra with the finger. Alternatively, the temperature may be reduced by performing an operation of drawing a circle using a hand.
  • the positions Ra to Rc are set with respect to a real object among the imaging objects W imaged by the camera 3, but using the projector, A predetermined image may be projected, and a position may be set for the projected image. In this way, a virtual touch panel can be realized even in a place where a touch panel cannot be installed.
  • control device 4 is constructed by one unit.
  • processing may be distributed and constructed by a plurality of units.
  • the camera 3 is constructed by one camera has been described, but a plurality of cameras may be used.
  • the configurations of the first embodiment to the third embodiment can be appropriately selected, or can be implemented in combination as appropriate.
  • the contents of the second embodiment can be combined with the contents of the third embodiment.
  • such an operation instruction control system can be applied to various uses. For example, it can be applied to presentations and inventory management. Further, the robot is provided with the light irradiation devices 2 and 2A, and can be applied to a traveling robot or the like. Further, if the light irradiation devices 2 and 2A are attached to the head of the doctor during the operation, it can be applied to medical practice.

Abstract

The purpose of the present invention is to provide an operation instruction control device and a method therefor which make it possible to ensure privacy and reduce variations in recognition accuracy. A predetermined position is set with respect to an object W to be imaged that has been imaged by a camera 3. When a user has irradiated the set predetermined position with predetermined light 2a using a light irradiation device 2 and performed a predetermined action by means of the irradiated predetermined light 2a, an operation instruction content corresponding to the predetermined action is delivered to a body to be given an operation instruction to, such as a smart household appliance.

Description

操作指示制御装置及びその方法Operation instruction control apparatus and method
　本発明は、所定の光を照射する照射手段を用いるか、又は、使用者が使用者の指、或いは、手だけを用いて所定の動作を行うことによって、スマート家電などの操作指示体に対して操作内容を指示することができる操作指示制御装置及びその方法に関する。 The present invention uses an irradiating means for irradiating a predetermined light, or by a user performing a predetermined operation using only a finger or a hand of a user, to an operation indicator such as a smart home appliance. TECHNICAL FIELD The present invention relates to an operation instruction control device and an operation instruction method capable of instructing an operation content by using an instruction.
　近年、発話者の音声での入力に応じて発呼処理を実行して、通信を開始する音声認識技術（例えば、特許文献１参照）や、撮像された画像に含まれる被写体の動作を認識し、認識した動作が予め設定された所定の動作であった場合に、その所定の動作に対応する処理を行うことが可能な動作認識技術（例えば、特許文献２参照）が知られている。 2. Description of the Related Art In recent years, a calling process is executed in response to an input of a speaker's voice, and a voice recognition technique for starting communication (for example, see Patent Literature 1) and an operation of a subject included in a captured image are recognized. Also, an operation recognition technology (for example, see Patent Document 2) capable of performing a process corresponding to the predetermined operation when the recognized operation is a predetermined operation set in advance.
特開平１１－６８９２０号公報JP-A-11-68920 特開２０１２－１３７９８９号公報JP 2012-137989 A
　しかしながら、発話者や被写体である人物の音声や動作を使用しなければならず、その人物のプライバシーが確保されていないという問題があった。また、上記のような音声認識や、動作認識では、使用する環境の影響を受け易いため、複雑な処理が必要となり、もって、認識精度にばらつきが生じる可能性があるという問題があった。 However, there is a problem that the voice and the motion of the person who is the speaker or the subject must be used, and the privacy of the person is not ensured. In addition, since the above-described speech recognition and motion recognition are easily affected by the environment in which they are used, complicated processing is required, and there is a problem that recognition accuracy may vary.
　そこで本発明は、上記問題に鑑み、プライバシーの確保をし、認識精度のばらつきを低減させることができる操作指示制御装置及びその方法を提供することを目的としている。 Therefore, in view of the above problems, an object of the present invention is to provide an operation instruction control device and a method thereof that can ensure privacy and reduce variation in recognition accuracy.
　上記課題を解決するための手段は、以下の手段によって達成される。なお、括弧内は、後述する実施形態の参照符号を付したものであるが、本発明はこれに限定されるものではない。 手段 The means for solving the above problems are achieved by the following means. Note that, in the parentheses, reference numerals of the embodiments described later are given, but the present invention is not limited to this.
　請求項１に係る操作指示制御装置は、撮像手段（例えば、図１，図８に示すカメラ３）にて撮像された所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）に対して、所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）を設定する位置設定手段（例えば、図１，図８に示すＣＰＵ４０，図３に示すステップＳ２）と、
　前記位置設定手段（例えば、図１，図８に示すＣＰＵ４０，図３に示すステップＳ２）にて設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、所定の光（例えば、図１，図８に示す光２ａ）を照射する照射手段（例えば、図１に示す光照射装置２，図８に示す光照射装置２Ａ）を用いて使用者が、該所定の光（例えば、図１，図８に示す光２ａ）を照射し、該照射した所定の光（例えば、図１，図８に示す光２ａ）にて所定の動作を実施すると、該所定の動作に応じた操作指示内容（例えば、図２に示す操作内容の項目ＴＢ３，図９に示す操作内容の項目ＴＢ３Ａ，図１０に示す操作内容の項目ＴＢ３Ｂ）を所定の操作指示体に送出、又は、前記位置設定手段（例えば、図１，図８に示すＣＰＵ４０，図３に示すステップＳ２）にて設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた操作指示内容（例えば、図２に示す操作内容の項目ＴＢ３，図９に示す操作内容の項目ＴＢ３Ａ，図１０に示す操作内容の項目ＴＢ３Ｂ）を所定の操作指示体に送出する操作指示手段（例えば、図１，図８に示すＣＰＵ４０，図４に示すステップＳ１０～ステップＳ１３，図１１に示すステップＳ２０～ステップＳ１３）と、を有してなることを特徴としている。 The operation instruction control device according to claim 1 applies a predetermined object (for example, an imaging target W shown in FIG. 5A) imaged by an imaging unit (for example, the camera 3 shown in FIGS. 1 and 8). On the other hand, position setting means (for example, CPU 40 shown in FIGS. 1 and 8 and step S2 shown in FIG. 3) for setting a predetermined position (for example, positions Ra to Rc shown in FIG. 5B);
With respect to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B) set by the position setting means (for example, CPU 40 shown in FIGS. 1 and 8 and step S2 shown in FIG. 3), The user uses the irradiation means (for example, the light irradiation device 2 shown in FIG. 1 and the light irradiation device 2A shown in FIG. 8) for irradiating a predetermined light (for example, the light 2a shown in FIGS. 1 and 8). When a predetermined light (for example, light 2a shown in FIGS. 1 and 8) is irradiated and a predetermined operation is performed with the irradiated predetermined light (for example, light 2a shown in FIGS. 1 and 8), the predetermined light is emitted. (For example, the operation content item TB3 shown in FIG. 2, the operation content item TB3A shown in FIG. 9, and the operation content item TB3B shown in FIG. 10) are sent to a predetermined operation indicator. Alternatively, the position setting means (for example, the CPU 40 shown in FIGS. The user performs a predetermined operation with respect to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B) set in step S2) using only the user's finger or hand. Then, the operation instruction contents corresponding to the predetermined operation (for example, the operation content item TB3 shown in FIG. 2, the operation content item TB3A shown in FIG. 9, and the operation content item TB3B shown in FIG. 10) are changed to the predetermined operation instruction. Operation instructing means (for example, CPU 40 shown in FIGS. 1 and 8, steps S10 to S13 shown in FIG. 4, and steps S20 to S13 shown in FIG. 11) for sending to the body. I have.
　一方、請求項２に係る操作指示制御装置は、撮像手段（例えば、図１２に示すカメラ３）にて撮像された所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）に対して、所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）を設定する位置設定手段（例えば、図１２に示すＣＰＵ４０，図３に示すステップＳ２）と、
　前記位置設定手段（例えば、図１２に示すＣＰＵ４０，図３に示すステップＳ２）にて設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、所定の光（例えば、図１２に示す光２ａ）を照射する照射手段（例えば、図１２に示す光照射装置２）を用いて使用者が、該所定の光（例えば、図１２に示す光２ａ）を照射し、該照射した所定の光（例えば、図１２に示す光２ａ）にて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容（例えば、図１３に示す操作内容の項目ＴＢ３Ｃ）を所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出、又は、前記位置設定手段（例えば、図１２に示すＣＰＵ４０，図３に示すステップＳ２）にて設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容（例えば、図１３に示す操作内容の項目ＴＢ３Ｃ）を所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出する操作指示手段（例えば、図１２に示すＣＰＵ４０，図１４に示すステップＳ１０～ステップＳ３０）と、を有し、
　前記所定の操作指示装置（例えば、図１２に示す操作指示装置５）は、前記複数の操作指示内容（例えば、図１３に示す操作内容の項目ＴＢ３Ｃ）の中から少なくとも一つの操作指示内容を所定の操作指示体に送出可能であることを特徴としている。 On the other hand, the operation instruction control device according to claim 2 is provided for a predetermined object (for example, an imaging target W shown in FIG. 5A) imaged by an imaging unit (for example, the camera 3 shown in FIG. 12). Position setting means (for example, CPU 40 shown in FIG. 12, step S2 shown in FIG. 3) for setting a predetermined position (for example, positions Ra to Rc shown in FIG. 5B);
A predetermined light is applied to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B) set by the position setting means (for example, CPU 40 shown in FIG. 12, step S2 shown in FIG. 3). The user irradiates the predetermined light (for example, light 2a shown in FIG. 12) by using an irradiation unit (for example, light irradiating device 2 shown in FIG. 12) that irradiates the light (for example, light 2a shown in FIG. 12). Then, when a predetermined operation is performed by the irradiated predetermined light (for example, light 2a shown in FIG. 12), a plurality of operation instruction contents (for example, the operation contents shown in FIG. 13) corresponding to the predetermined operation are performed. TB3C) to a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12), or is set by the position setting means (for example, the CPU 40 shown in FIG. 12 and step S2 shown in FIG. 3). The predetermined position (for example, as shown in FIG. When the user performs a predetermined operation with respect to the positions Ra to Rc) using only the user's finger or hand, a plurality of operation instruction contents corresponding to the predetermined operation (for example, FIG. Operation instruction means (for example, CPU 40 shown in FIG. 12, and steps S10 to S30 shown in FIG. 14) for sending out the item TB3C of the operation content shown to a predetermined operation instruction device (for example, operation instruction device 5 shown in FIG. 12). And having
The predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12) determines at least one operation instruction content from the plurality of operation instruction contents (for example, the operation content item TB3C shown in FIG. 13). It can be transmitted to the operation indicator.
　また、請求項３に係る操作指示制御装置は、上記請求項１又は２に記載の操作指示制御装置において、前記操作指示手段（例えば、図８に示すＣＰＵ４０，図１１に示すステップＳ２０～ステップＳ１３）は、
　前記照射手段（例えば、図８に示す光照射装置２Ａ）を用いる使用者毎に、前記所定の動作が同一であっても、異なる操作指示内容（例えば、図９に示す操作内容の項目ＴＢ３Ａ）を所定の操作指示体又は所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出してなることを特徴としている。 An operation instruction control device according to a third aspect of the present invention is the operation instruction control device according to the first or second aspect, wherein the operation instruction means (for example, the CPU 40 shown in FIG. 8 and steps S20 to S13 shown in FIG. )
Even if the predetermined operation is the same for each user who uses the irradiation unit (for example, the light irradiation device 2A shown in FIG. 8), different operation instruction contents (for example, the operation contents item TB3A shown in FIG. 9). Is transmitted to a predetermined operation instruction body or a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12).
　さらに、請求項４に係る操作指示制御装置は、上記請求項１又は２に記載の操作指示制御装置において、前記操作指示手段（例えば、図８に示すＣＰＵ４０，図１１に示すステップＳ２０～ステップＳ１３）は、
　前記照射手段（例えば、図８に示す光照射装置２Ａ）を用いる使用者毎に、同一の前記操作指示内容を前記所定の操作指示体又は所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出するにあたって、異なる所定の動作を実施する（例えば、図１０に示す動作内容の項目ＴＢ３Ｂ）ようにしてなることを特徴としている。 Further, according to a fourth aspect of the present invention, in the operation instruction control device according to the first or second aspect, the operation instruction means (for example, the CPU 40 shown in FIG. 8 and steps S20 to S13 shown in FIG. 11). )
For each user who uses the irradiating means (for example, the light irradiating device 2A shown in FIG. 8), the same operation instruction content is transmitted to the predetermined operation instruction body or the predetermined operation instruction device (for example, the operation instruction shown in FIG. 12). In transmitting the data to the device 5), a different predetermined operation is performed (for example, an operation content item TB3B shown in FIG. 10).
　一方、請求項５に係る操作指示制御方法は、撮像手段（例えば、図１，図８に示すカメラ３）にて撮像された所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）に対して、所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）を設定するステップ（例えば、図３に示すステップＳ２）と、
　前記設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、所定の光（例えば、図１，図８に示す光２ａ）を照射する照射手段（例えば、図１に示す光照射装置２，図８に示す光照射装置２Ａ）を用いて使用者が、該所定の光（例えば、図１，図８に示す光２ａ）を照射し、該照射した所定の光（例えば、図１，図８に示す光２ａ）にて所定の動作を実施すると、該所定の動作に応じた操作指示内容（例えば、図２に示す操作内容の項目ＴＢ３，図９に示す操作内容の項目ＴＢ３Ａ，図１０に示す操作内容の項目ＴＢ３Ｂ）を所定の操作指示体に送出、又は、前記設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた操作指示内容（例えば、図２に示す操作内容の項目ＴＢ３，図９に示す操作内容の項目ＴＢ３Ａ，図１０に示す操作内容の項目ＴＢ３Ｂ）を所定の操作指示体に送出するステップ（例えば、図４に示すステップＳ１０～ステップＳ１３，図１１に示すステップＳ２０～ステップＳ１３）と、を含んでなることを特徴としている。 On the other hand, an operation instruction control method according to a fifth aspect provides a predetermined object (for example, an imaging target W shown in FIG. 5A) captured by an imaging unit (for example, the camera 3 shown in FIGS. 1 and 8). ), A predetermined position (for example, positions Ra to Rc shown in FIG. 5B) is set (for example, step S2 shown in FIG. 3);
Irradiating means (for example, for irradiating predetermined light (for example, light 2a shown in FIGS. 1 and 8) to the set predetermined position (for example, positions Ra to Rc shown in FIG. 5B) The user irradiates the predetermined light (for example, light 2a shown in FIGS. 1 and 8) using the light irradiation device 2 shown in FIG. 1 and the light irradiation device 2A shown in FIG. 9 (for example, light 2a shown in FIGS. 1 and 8), the operation instruction content (for example, the operation content item TB3 shown in FIG. 2 and FIG. 9) corresponding to the predetermined operation is displayed. The operation content item TB3A shown in FIG. 10 and the operation content item TB3B shown in FIG. 10 are transmitted to a predetermined operation indicator, or the set predetermined position (for example, the positions Ra to Rc shown in FIG. 5B). , The user performs a predetermined operation using only the user's finger or hand. The operation instruction contents corresponding to the predetermined operation (for example, the operation content item TB3 shown in FIG. 2, the operation content item TB3A shown in FIG. 9, and the operation content item TB3B shown in FIG. 10) are changed to a predetermined operation indicator. (For example, steps S10 to S13 shown in FIG. 4 and steps S20 to S13 shown in FIG. 11).
　また一方、請求項６に係る操作指示制御方法は、撮像手段（例えば、図１２に示すカメラ３）にて撮像された所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）に対して、所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）を設定するステップ（例えば、図３に示すステップＳ２）と、
　前記設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、所定の光（例えば、図１２に示す光２ａ）を照射する照射手段（例えば、図１２に示す光照射装置２）を用いて使用者が、該所定の光（例えば、図１２に示す光２ａ）を照射し、該照射した所定の光（例えば、図１２に示す光２ａ）にて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容（例えば、図１３に示す操作内容の項目ＴＢ３Ｃ）を所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出、又は、前記設定された前記所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容（例えば、図１３に示す操作内容の項目ＴＢ３Ｃ）を所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出するステップ（例えば、図１４に示すステップＳ１０～ステップＳ３０）と、を含み、
　前記所定の操作指示装置（例えば、図１２に示す操作指示装置５）は、前記複数の操作指示内容（例えば、図１３に示す操作内容の項目ＴＢ３Ｃ）の中から少なくとも一つの操作指示内容を所定の操作指示体に送出可能であることを特徴としている。 On the other hand, in the operation instruction control method according to claim 6, a predetermined object (for example, an imaging target W shown in FIG. 5A) captured by an imaging unit (for example, the camera 3 shown in FIG. 12) is used. On the other hand, a step of setting a predetermined position (for example, positions Ra to Rc shown in FIG. 5B) (for example, step S2 shown in FIG. 3);
Irradiating means (for example, as shown in FIG. 12) for irradiating the set predetermined position (for example, positions Ra to Rc shown in FIG. 5B) with predetermined light (for example, light 2a shown in FIG. 12). The user irradiates the predetermined light (for example, light 2a shown in FIG. 12) using the light irradiation device 2) shown in FIG. When the operation is performed, a plurality of operation instruction contents (for example, the operation content item TB3C shown in FIG. 13) corresponding to the predetermined operation are transferred to a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12). The user performs a predetermined operation using only the user's finger or hand with respect to the predetermined position (for example, positions Ra to Rc shown in FIG. 5B). Then, a plurality of operation instruction contents according to the predetermined operation (for example, FIG. Item TB3C) operation contents shown in prescribed operation instruction device (e.g., including the step of transmitting an operation instruction device 5) shown in FIG. 12 (e.g., steps S10 ~ step S30 shown in FIG. 14), and
The predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12) determines at least one operation instruction content from the plurality of operation instruction contents (for example, the operation content item TB3C shown in FIG. 13). It can be transmitted to the operation indicator.
　次に、本発明の効果について、図面の参照符号を付して説明する。なお、括弧内は、後述する実施形態の参照符号を付したものであるが、本発明はこれに限定されるものではない。 Next, the effects of the present invention will be described with reference numerals in the drawings. Note that, in the parentheses, reference numerals of the embodiments described later are given, but the present invention is not limited to this.
　請求項１，５に係る発明によれば、使用者は、所定の光（例えば、図１，図８に示す光２ａ）を照射する照射手段（例えば、図１に示す光照射装置２，図８に示す光照射装置２Ａ）を用いて、所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）の設定された所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、該所定の光（例えば、図１，図８に示す光２ａ）を照射し、該照射した所定の光（例えば、図１，図８に示す光２ａ）にて所定の動作を実施、又は、使用者は使用者の指、或いは、手だけを用いて、所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）の設定された所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、所定の動作を実施するだけで、所定の操作指示体に所定の操作を指示することができる。 According to the first and fifth aspects of the present invention, the user can irradiate predetermined light (for example, the light 2a shown in FIGS. 1 and 8) with the irradiating means (for example, the light irradiating device 2 shown in FIG. 8 using the light irradiation device 2A shown in FIG. 8, a predetermined position (for example, positions Ra to Rc shown in FIG. 5B) of a predetermined object (for example, the imaging target W shown in FIG. 5A) is set. ) Is irradiated with the predetermined light (for example, light 2a shown in FIGS. 1 and 8), and a predetermined operation is performed by the irradiated predetermined light (for example, light 2a shown in FIGS. 1 and 8). Or the user uses only the user's finger or hand to set a predetermined position (for example, FIG. 5A) of the predetermined object (for example, the imaging target W shown in FIG. 5A). Instructing a predetermined operation instruction to a predetermined operation by simply performing a predetermined operation for the positions Ra to Rc shown in (b). It can be.
　しかして、本発明によれば、音声認識や、動作認識のように、発話者や被写体である人物の音声や動作を使用する必要がないため、プライバシーを確保することができる。さらには、照射手段（例えば、図１に示す光照射装置２，図８に示す光照射装置２Ａ）より照射される所定の光（例えば、図１，図８に示す光２ａ）の動き、又は、使用者の指、或いは、手の動きを認識するだけで良いため、使用する環境の影響を受けにくく、もって、処理が簡便となり、認識精度のばらつきを低減させることができる。 According to the present invention, however, it is not necessary to use the voice or the motion of the speaker or the person who is the subject, unlike the voice recognition and the motion recognition, so that the privacy can be ensured. Further, the movement of predetermined light (for example, light 2a shown in FIGS. 1 and 8) emitted from irradiation means (for example, light irradiation device 2 shown in FIG. 1 and light irradiation device 2A shown in FIG. 8), or Since it is only necessary to recognize the movement of the user's finger or hand, the system is not easily affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
　一方、請求項２，６に係る発明によれば、使用者は、所定の光（例えば、図１２に示す光２ａ）を照射する照射手段（例えば、図１２に示す光照射装置２）を用いて、所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）の設定された所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、該所定の光（例えば、図１２に示す光２ａ）を照射し、該照射した所定の光（例えば、図１２に示す光２ａ）にて所定の動作を実施するだけで、所定の操作指示装置（例えば、図１２に示す操作指示装置５）に複数の所定の操作を送出、又は、使用者は、所定対象物（例えば、図５（ａ）に示す撮像対象物Ｗ）の設定された所定位置（例えば、図５（ｂ）に示す位置Ｒａ～Ｒｃ）に対して、使用者が使用者の指、或いは、手だけを用いて、所定の動作を実施するだけで、所定の操作指示装置（例えば、図１２に示す操作指示装置５）に複数の所定の操作を送出することができ、もって、所定の操作指示装置（例えば、図１２に示す操作指示装置５）から、所定の操作指示体に少なくとも一つの所定の操作を指示することができる。 On the other hand, according to the second and sixth aspects of the present invention, the user uses the irradiating means (for example, the light irradiating device 2 shown in FIG. 12) for irradiating the predetermined light (for example, the light 2a shown in FIG. 12). Then, the predetermined light (for example, the positions Ra to Rc shown in FIG. 5B) of the predetermined object (for example, the imaging target W shown in FIG. For example, only by irradiating the light 2a shown in FIG. 12 and performing a predetermined operation with the irradiated predetermined light (for example, the light 2a shown in FIG. 12), a predetermined operation instruction device (for example, FIG. Or a plurality of predetermined operations are sent to the operation instruction device 5 shown in FIG. 5, or the user can set a predetermined position (for example, FIG. 5A) of a predetermined target (for example, the imaging target W shown in FIG. 5A). 5 (b), the user uses the user's finger or hand only By simply performing a predetermined operation, a plurality of predetermined operations can be transmitted to a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12), and accordingly, the predetermined operation instruction device (for example, FIG. 12, at least one predetermined operation can be instructed to a predetermined operation indicator.
　しかして、本発明においても、音声認識や、動作認識のように、発話者や被写体である人物の音声や動作を使用する必要がないため、プライバシーを確保することができる。さらには、照射手段（例えば、図１２に示す光照射装置２）より照射される所定の光（例えば、図１２に示す光２ａ）の動き、又は、使用者の指、或いは、手の動きを認識するだけで良いため、使用する環境の影響を受けにくく、もって、処理が簡便となり、認識精度のばらつきを低減させることができる。 However, according to the present invention, it is not necessary to use the voice or motion of a speaker or a person who is a subject as in voice recognition or motion recognition, so that privacy can be ensured. Further, the movement of predetermined light (for example, light 2a shown in FIG. 12) emitted from irradiation means (for example, light irradiation device 2 shown in FIG. 12) or the movement of the user's finger or hand is determined. Since it is only necessary to recognize, it is hardly affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
　また、請求項３に係る発明によれば、照射手段（例えば、図８に示す光照射装置２Ａ）を用いる使用者毎に、所定の動作が同一であっても、異なる操作指示内容（例えば、図９に示す操作内容の項目ＴＢ３Ａ）を所定の操作指示体又は所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出するようにしているから、使用者毎のカスタマイズが可能となる。また、何時どの使用者が、照射手段（例えば、図８に示す光照射装置２Ａ）を用いたかのデータを保存することが可能となる。 According to the third aspect of the present invention, even if the predetermined operation is the same for each user who uses the irradiation unit (for example, the light irradiation device 2A shown in FIG. 8), different operation instruction contents (for example, Since the operation content item TB3A shown in FIG. 9 is transmitted to a predetermined operation instruction body or a predetermined operation instruction device (for example, the operation instruction device 5 shown in FIG. 12), customization for each user is possible. Becomes Further, it is possible to store data on when and which user used the irradiation means (for example, the light irradiation device 2A shown in FIG. 8).
　さらに、請求項４に係る発明によれば、照射手段（例えば、図８に示す光照射装置２Ａ）を用いる使用者毎に、同一の操作指示内容を所定の操作指示体又は所定の操作指示装置（例えば、図１２に示す操作指示装置５）に送出するにあたって、異なる所定の動作を実施する（例えば、図１０に示す動作内容の項目ＴＢ３Ｂ）ようにしているから、使用者毎のカスタマイズが可能となる。また、何時どの使用者が、照射手段（例えば、図８に示す光照射装置２Ａ）を用いたかのデータを保存することが可能となる。 Furthermore, according to the invention according to claim 4, the same operation instruction content is given to a predetermined operation instruction body or a predetermined operation instruction device for each user who uses the irradiation means (for example, the light irradiation device 2A shown in FIG. 8). (E.g., the operation instruction device 5 shown in FIG. 12), a different predetermined operation is performed (for example, the operation content item TB3B shown in FIG. 10), so that customization for each user is possible. Becomes Further, it is possible to store data on when and which user used the irradiation means (for example, the light irradiation device 2A shown in FIG. 8).
本発明に係る操作指示制御システムの第１実施形態を示す全体図である。1 is an overall view showing a first embodiment of an operation instruction control system according to the present invention. 同実施形態に係る操作指示内容関連情報登録データベースに格納されているテーブルを示す図である。FIG. 3 is a diagram showing a table stored in an operation instruction content related information registration database according to the embodiment. 同実施形態に係る操作指示内容関連情報登録データベースに情報を格納する際の制御手順を示すフローチャート図である。It is a flowchart figure which shows the control procedure at the time of storing information in the operation instruction content related information registration database concerning the embodiment. 同実施形態に係る操作指示制御システムの制御手順を示すフローチャート図である。FIG. 3 is a flowchart illustrating a control procedure of the operation instruction control system according to the embodiment. （ａ）は、同実施形態に係るカメラにて撮像された撮像対象物の一例を示す図、（ｂ）は、（ａ）にて示す撮像対象物が表示部に表示され、所定の位置が設定されている例を示す図である。FIG. 3A is a diagram illustrating an example of an imaging target imaged by the camera according to the embodiment, and FIG. 2B is a diagram illustrating the imaging target object illustrated in FIG. It is a figure showing the example set. （ａ）は、図５（ｂ）にて設定された位置Ｒａに対して、使用者が光照射装置を用いて、光を照射し、その照射した光により生じた輝点にて、時計回りに円を２回描いている例を示す図、（ｂ）は、図５（ｂ）にて設定された位置Ｒａに対して、使用者が光照射装置を用いて、光を照射し、その照射した光により生じた輝点にて、反時計回りに円を２回描いている例を示す図、（ｃ）は、図５（ｂ）にて設定された位置Ｒａに対して、使用者が光照射装置を用いて、光を照射し、その照射した光により生じた輝点にて、三角形を描いている例を示す図である。5A shows a case where a user irradiates a light to a position Ra set in FIG. 5B using a light irradiation device, and a bright point generated by the irradiated light rotates clockwise. FIG. 5B shows an example in which a circle is drawn twice, and FIG. 5B shows a case where the user irradiates light to the position Ra set in FIG. FIG. 5C shows an example in which a circle is drawn twice in a counterclockwise direction at a luminescent spot generated by the irradiated light, and FIG. 5C shows the position Ra set in FIG. FIG. 3 is a diagram illustrating an example in which light is irradiated using a light irradiation device, and triangles are drawn using bright spots generated by the irradiated light. （ａ）は、図５（ｂ）にて設定された位置Ｒｂに対して、使用者が光照射装置を用いて、光を照射し、その照射した光により生じた輝点にて、時計回りに円を２回描いている例を示す図、（ｂ）は、図５（ｂ）にて設定された位置Ｒｃに対して、使用者が光照射装置を用いて、光を照射し、その照射した光により生じた輝点にて、反時計回りに円を２回描いている例を示す図である。5A illustrates a case where a user irradiates a light to a position Rb set in FIG. 5B using a light irradiation device, and a bright spot generated by the irradiated light rotates clockwise. FIG. 5B shows an example in which a circle is drawn twice. FIG. 5B shows a case where the user irradiates the position Rc set in FIG. FIG. 9 is a diagram illustrating an example in which a circle is drawn twice counterclockwise at a luminescent spot generated by irradiated light. 本発明に係る操作指示制御システムの第２実施形態を示す全体図である。It is an overall view showing a second embodiment of the operation instruction control system according to the present invention. 同実施形態に係る操作指示内容関連情報登録データベースに格納されているテーブルを示す図である。FIG. 3 is a diagram showing a table stored in an operation instruction content related information registration database according to the embodiment. 図９とは異なるテーブルを示す図である。FIG. 10 is a diagram illustrating a table different from FIG. 9. 同実施形態に係る操作指示制御システムの制御手順を示すフローチャート図である。FIG. 3 is a flowchart illustrating a control procedure of the operation instruction control system according to the embodiment. 本発明に係る操作指示制御システムの第３実施形態を示す全体図である。It is an overall view showing a third embodiment of the operation instruction control system according to the present invention. 同実施形態に係る操作指示内容関連情報登録データベースに格納されているテーブルを示す図である。FIG. 3 is a diagram showing a table stored in an operation instruction content related information registration database according to the embodiment. 同実施形態に係る操作指示制御システムの制御手順を示すフローチャート図である。FIG. 3 is a flowchart illustrating a control procedure of the operation instruction control system according to the embodiment. （ａ）～（ｂ）は、同実施形態に係る操作指示装置の表示部に表示される、画面遷移を示す画面例である。3A and 3B are screen examples showing screen transitions displayed on the display unit of the operation instruction device according to the embodiment.
＜第１実施形態＞
　以下、本発明に係る操作指示制御装置及びその方法に関する操作指示制御システムの第１実施形態について、図面を参照して具体的に説明する。なお、以下の説明において、上下左右の方向を示す場合は、図示正面から見た場合の上下左右をいうものとする。 <First embodiment>
Hereinafter, a first embodiment of an operation instruction control system relating to an operation instruction control device and a method thereof according to the present invention will be specifically described with reference to the drawings. In the following description, when indicating up, down, left and right directions, it means up, down, left, and right when viewed from the front in the figure.
＜操作指示制御システムの説明＞
　図１に示すように、操作指示制御システム１は、光照射装置２と、カメラ３と、制御装置４と、で構成されている。なお、符号Ｗは、カメラ３にて撮像される撮像対象物を示すものである。 <Description of operation instruction control system>
As shown in FIG. 1, the operation instruction control system 1 includes a light irradiation device 2, a camera 3, and a control device 4. The symbol W indicates an object to be imaged by the camera 3.
　光照射装置２は、レーザーポインタや、リング型ライト、腕時計型ライト、メガネ型ライト、ペン型ライト、懐中電灯などからなる装置であって、図１に示すように、カメラ３にて撮像される撮像対象物Ｗから離れた距離にいる使用者によって、撮像対象物Ｗに光２ａを照射できるものである。なお、この光照射装置２から照射された光２ａにより生じた輝点２ｂは、撮像対象物Ｗに重ね合わさることとなる。 The light irradiation device 2 is a device including a laser pointer, a ring light, a watch light, a glasses light, a pen light, a flashlight, and the like, and is imaged by the camera 3 as shown in FIG. A user at a distance from the imaging target W can irradiate the imaging target W with the light 2a. The luminescent spot 2b generated by the light 2a irradiated from the light irradiation device 2 is superimposed on the imaging target W.
　一方、カメラ３は、図１に示すように、撮像対象物Ｗを撮像できるものである。より詳しく説明すると、このカメラ３は、所定箇所に固定配置されているものであって、例えば、図５（ａ）に示すような、室内の一部である撮像対象物Ｗを撮像できるものである。そしてさらに、このカメラ３は、１秒間に３０フレームを超えるフレームを連続的に撮像できるハイスピードカメラであって、図５に示すような、輝点２ｂの動きをぶれなく撮像できるものである。なお、このカメラ３にて撮像された撮像データは、図１に示すように、制御装置４に出力される。 On the other hand, as shown in FIG. 1, the camera 3 can image the imaging target object W. More specifically, the camera 3 is fixedly arranged at a predetermined position, and can capture an image of an imaging target W which is a part of a room, for example, as shown in FIG. is there. Further, the camera 3 is a high-speed camera capable of continuously capturing more than 30 frames per second, and capable of capturing the movement of the bright spot 2b without blurring as shown in FIG. The image data captured by the camera 3 is output to the control device 4 as shown in FIG.
　他方、制御装置４は、ＣＰＵ４０と、マウスやキーボード、タッチパネル等にて外部から所定データを制御装置４に入力することができる入力部４１と、制御装置４外に所定データを出力することができる出力部４２と、所定のプログラム等を格納した書込み可能なフラッシュＲＯＭ等からなるＲＯＭ４３と、作業領域やバッファメモリ等として機能するＲＡＭ４４と、ＬＣＤ（Ｌｉｑｕｉｄ　Ｃｒｙｓｔａｌ　Ｄｉｓｐｌａｙ）等からなる表示部４５と、無線ＬＡＮ（例えばＷｉｆｉ（登録商標）），有線ＬＡＮ，ダイヤルアップ等の通信手段で、図示しないスマート家電などの操作指示体に、ネットワークを介して接続が可能な通信部４６と、図示しないスマート家電などの操作指示体への操作指示内容に必要な情報が格納されている操作指示内容関連情報登録データベース４７と、で構成されている。なお、この操作指示体としては、エアコン、炊飯器、電子レンジなどのスマート家電や、ＰＣやｉｐｈｏｎｅ（登録商標）等のスマートフォン等の情報処理端末や、自動車などのスマートビークル（Ｓｍａｒｔ　ｖｅｈｉｃｌｅ）や、ドローン（ｄｒｏｎｅ）、家庭用ロボットなど、ネットワークを介して接続が可能なものであれば、どのようなものでも良い。 On the other hand, the control device 4 can output predetermined data to the outside of the control device 4 and an input unit 41 that can externally input predetermined data to the control device 4 using a CPU 40, a mouse, a keyboard, a touch panel, or the like. An output unit 42, a ROM 43 such as a writable flash ROM storing a predetermined program or the like, a RAM 44 functioning as a work area or a buffer memory, a display unit 45 such as an LCD (Liquid Crystal Display), A communication unit 46 that can be connected to an operation indicator such as a smart home appliance (not shown) via a network by communication means such as a LAN (for example, Wifi (registered trademark)), a wired LAN, or a dial-up; Information required for the operation instruction content for the operation instruction body of The work instruction content-related information registration database 47, in is configured. Examples of the operation indicator include smart home appliances such as an air conditioner, a rice cooker, and a microwave oven, information processing terminals such as a smartphone such as a PC and iphone (registered trademark), a smart vehicle such as a car, and a smart vehicle. Any device that can be connected via a network, such as a drone or a home robot, may be used.
　ところで、操作指示内容関連情報登録データベース４７には、図２に示すテーブルＴＢＬが格納されている。より具体的に説明すると、このテーブルＴＢＬには、カメラ３にて撮像された撮像対象物Ｗに対して、設定された位置（ＴＢ１参照）が格納され、その設定された位置（ＴＢ１参照）に対して、使用者が光照射装置２を用いて動作する内容（ＴＢ２参照）が格納され、その動作内容に応じた、図示しないスマート家電などの操作指示体への操作内容（ＴＢ３参照）が格納されている。 By the way, the operation instruction content related information registration database 47 stores a table TBL shown in FIG. More specifically, the table TBL stores a set position (refer to TB1) with respect to the imaging target W imaged by the camera 3, and stores the set position (refer to TB1). On the other hand, the content of the operation performed by the user using the light irradiation device 2 (see TB2) is stored, and the operation content (see TB3) of an operation indicator such as a smart home appliance (not shown) corresponding to the operation content is stored. Have been.
＜操作指示内容関連情報登録データベースのテーブルの登録例の説明＞
　ここで、より詳しく上記内容（ＴＢ１～ＴＢ３参照）をテーブルＴＢＬ（図２参照）に格納する方法を、図３を主に参照して具体的に説明する。 <Description of registration example of table of operation instruction content related information registration database>
Here, a method of storing the above contents (see TB1 to TB3) in the table TBL (see FIG. 2) will be specifically described mainly with reference to FIG.
　上記のような方法を行うにあたっては、作業者が、図１に示す制御装置４の入力部４１を用いて、図１に示すＲＯＭ４３内に格納されているプログラムの起動を指示する。これにより、制御装置４のＣＰＵ４０（図１参照）は、図３に示すような処理を行う。以下、図３を参照して説明する。なお、図３に示すプログラムの処理内容はあくまで一例であり、これに限定されるものではない。 In performing the above-described method, an operator uses the input unit 41 of the control device 4 shown in FIG. 1 to instruct the activation of a program stored in the ROM 43 shown in FIG. Accordingly, the CPU 40 (see FIG. 1) of the control device 4 performs a process as shown in FIG. Hereinafter, description will be made with reference to FIG. Note that the processing contents of the program shown in FIG. 3 are merely examples, and the present invention is not limited to this.
　まず、ＣＰＵ４０（図１参照）は、カメラ３にて撮像された撮像対象物Ｗの撮像データを取得する（ステップＳ１）。例えば、撮像対象物Ｗとして、図５（ａ）に示すような、室内のエアコンの温度を調整できるエアコン操作盤Ｗａが設置され、現在の時刻を示す壁掛け時計Ｗｂが設置され、電話Ｗｃが設置されているような室内の一部を、所定箇所に固定配置されているカメラ３にて撮像される。これにより、カメラ３は、その撮像した撮像対象物Ｗ（図５（ａ）参照）の撮像データを制御装置４（図１参照）に出力する。これを受けて、ＣＰＵ４０（図１参照）は、入力部４１（図１参照）を介して、その撮像データを取得することとなる。なお、エアコン操作盤Ｗａにて温度調整等がされるエアコン（図示せず）は、通信部４６（図１参照）と、ネットワークを介して接続が可能なものである。また、現在の時刻を示す壁掛け時計Ｗｂは、今日の予定などを音声で通知する等が可能なスピーカ（図示せず）と接続されており、このスピーカ（図示せず）は、通信部４６（図１参照）と、ネットワークを介して接続可能なものである。またさらに、電話Ｗｃは、留守番電話の内容を再生等が可能なスピーカ（図示せず）と接続されており、このスピーカ（図示せず）は、通信部４６（図１参照）と、ネットワークを介して接続可能なものである。 First, the CPU 40 (see FIG. 1) acquires image data of the object W captured by the camera 3 (step S1). For example, as the imaging target W, an air conditioner operation panel Wa capable of adjusting the temperature of an indoor air conditioner is installed as shown in FIG. 5A, a wall clock Wb indicating the current time is installed, and a telephone Wc is installed. A part of the room as described above is imaged by a camera 3 fixedly arranged at a predetermined location. Thereby, the camera 3 outputs the imaging data of the imaging target object W (see FIG. 5A) to the control device 4 (see FIG. 1). In response to this, the CPU 40 (see FIG. 1) acquires the imaging data via the input unit 41 (see FIG. 1). Note that an air conditioner (not shown) whose temperature is adjusted by the air conditioner operation panel Wa can be connected to the communication unit 46 (see FIG. 1) via a network. Further, the wall clock Wb indicating the current time is connected to a speaker (not shown) capable of notifying, for example, today's schedule by voice, and the speaker (not shown) is connected to the communication unit 46 ( (See FIG. 1) and can be connected via a network. Further, the telephone Wc is connected to a speaker (not shown) capable of reproducing the contents of the answering machine, and the speaker (not shown) is connected to the communication unit 46 (see FIG. 1) and the network. Can be connected via
　次いで、ＣＰＵ４０（図１参照）は、取得した撮像データに対し、作業者に所定の位置を設定させるような指示内容を表示部４５（図１参照）に表示させる（ステップＳ２）。具体的に説明すると、ＣＰＵ４０（図１参照）は、図５（ｂ）に示すように、取得した撮像データ（撮像対象物Ｗ）を、表示部４５に表示させる。これを受けて、作業者は、入力部４１（図１参照）を用いて、エアコン操作盤Ｗａの位置Ｒａを設定し、さらに、壁掛け時計Ｗｂの位置Ｒｂを設定し、そしてさらに、電話Ｗｃの位置Ｒｃを設定することとなる。これにより、ＣＰＵ４０（図１参照）は、その設定された位置Ｒａ～Ｒｃの位置座標を算出し、その算出した位置座標を、テーブルＴＢＬ（図２参照）の位置の項目（ＴＢ１参照）に格納することとなる。この点、より具体的に説明すると、図５（ｂ）に示す左上隅を原点Ｏとした場合、ＣＰＵ４０（図１参照）は、位置Ｒａの左上隅Ｐａ１のＸ，Ｙ座標位置が原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出（図２では、Ｘ座標を５０，Ｙ座標を１０００としている）し、位置Ｒａの右下隅Ｐａ２のＸ，Ｙ座標位置が原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出（図２では、Ｘ座標を２００，Ｙ座標を１２００としている）する。これにより、テーブルＴＢＬ（図２参照）の位置の項目（ＴＢ１参照）に、（５０，１０００）－（２００，１２００）のように格納されることとなる。さらに、ＣＰＵ４０（図１参照）は、図５（ｂ）に示す位置Ｒｂの左上隅Ｐｂ１のＸ，Ｙ座標位置が原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出（図２では、Ｘ座標を１０００，Ｙ座標を５０としている）し、位置Ｒｂの右下隅Ｐｂ２のＸ，Ｙ座標位置が原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出（図２では、Ｘ座標を１２００，Ｙ座標を２００としている）する。これにより、テーブルＴＢＬ（図２参照）の位置の項目（ＴＢ１参照）に、（１０００，５０）－（１２００，２００）のように格納されることとなる。またさらに、ＣＰＵ４０（図１参照）は、図５（ｂ）に示す位置Ｒｃの左上隅Ｐｃ１のＸ，Ｙ座標位置が原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出（図２では、Ｘ座標を５００，Ｙ座標を１８００としている）し、位置Ｒｃの右下隅Ｐｃ２のＸ，Ｙ座標位置が原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出（図２では、Ｘ座標を８００，Ｙ座標を２０００としている）する。これにより、テーブルＴＢＬ（図２参照）の位置の項目（ＴＢ１参照）に、（５００，１８００）－（８００，２０００）のように格納されることとなる。 Next, the CPU 40 (see FIG. 1) causes the display unit 45 (see FIG. 1) to display, on the acquired image data, instruction content for causing the operator to set a predetermined position (step S2). More specifically, the CPU 40 (see FIG. 1) causes the display unit 45 to display the acquired imaging data (the imaging target object W) as shown in FIG. In response to this, the operator sets the position Ra of the air conditioner operation panel Wa using the input unit 41 (see FIG. 1), sets the position Rb of the wall clock Wb, and further sets the position of the telephone Wc. The position Rc is set. As a result, the CPU 40 (see FIG. 1) calculates the position coordinates of the set positions Ra to Rc, and stores the calculated position coordinates in the position item (see TB1) of the table TBL (see FIG. 2). Will be done. More specifically, when the upper left corner shown in FIG. 5B is set as the origin O, the CPU 40 (see FIG. 1) determines that the X, Y coordinate position of the upper left corner Pa1 of the position Ra is the origin O. Based on the reference, the coordinate position is calculated from the pixel value and the like (in FIG. 2, the X coordinate is 50 and the Y coordinate is 1000), and the X, Y coordinate position of the lower right corner Pa2 of the position Ra is the origin. Based on O, which coordinate position is calculated from the pixel value or the like (in FIG. 2, the X coordinate is 200 and the Y coordinate is 1200). As a result, the data is stored as (50, 1000)-(200, 1200) in the item (see TB1) at the position of the table TBL (see FIG. 2). Further, the CPU 40 (see FIG. 1) calculates, based on the pixel value or the like, which coordinate position the X, Y coordinate position of the upper left corner Pb1 of the position Rb shown in FIG. (In FIG. 2, the X coordinate is set to 1000 and the Y coordinate is set to 50.) When the X, Y coordinate position of the lower right corner Pb2 of the position Rb is based on the origin O, a pixel value etc. (In FIG. 2, the X coordinate is 1200 and the Y coordinate is 200). As a result, the data is stored as (1000, 50)-(1200, 200) in the item (see TB1) at the position of the table TBL (see FIG. 2). Further, the CPU 40 (see FIG. 1) determines which coordinate position of the X, Y coordinate position of the upper left corner Pc1 of the position Rc shown in FIG. Calculation (in FIG. 2, the X coordinate is set to 500 and the Y coordinate is set to 1800), and when the X, Y coordinate position of the lower right corner Pc2 of the position Rc is based on the origin O, a pixel value indicates (In FIG. 2, the X coordinate is 800 and the Y coordinate is 2000). As a result, the data is stored as (500, 1800)-(800, 2000) in the item (see TB1) at the position of the table TBL (see FIG. 2).
　次いで、ＣＰＵ４０（図１参照）は、作業者が設定した位置に対し、作業者に所定の動作内容及び所定の操作内容を設定させるような指示内容を表示部４５（図１参照）に表示させる（ステップＳ３）。これを受けて、作業者は、入力部４１（図１参照）を用いて、位置Ｒａ～Ｒｃに対し、使用者が光照射装置２を用いてどのような動作をすれば、エアコンやスピーカに対しどのような操作内容を指示するのかの入力を行う。具体的には、図６（ａ）に示すように、位置Ｒａに対し、使用者が光照射装置２を用いて、光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合に、エアコンの温度を上げるというような入力を、作業者は、入力部４１（図１参照）を用いて行う。これにより、ＣＰＵ４０（図１参照）は、テーブルＴＢＬ（図２参照）の動作内容の項目（ＴＢ２参照）に、時計回りに円を２回描くと格納し、テーブルＴＢＬ（図２参照）の操作内容の項目（ＴＢ３参照）に、エアコンの温度を上げると格納することとなる。さらに、図６（ｂ）に示すように、位置Ｒａに対し、使用者が光照射装置２を用いて、光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合に、エアコンの温度を下げるというような入力を、作業者は、入力部４１（図１参照）を用いて行う。これにより、ＣＰＵ４０（図１参照）は、テーブルＴＢＬ（図２参照）の動作内容の項目（ＴＢ２参照）に、反時計回りに円を２回描くと格納し、テーブルＴＢＬ（図２参照）の操作内容の項目（ＴＢ３参照）に、エアコンの温度を下げると格納することとなる。またさらに、図６（ｃ）に示すように、位置Ｒａに対し、使用者が光照射装置２を用いて、光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、三角形を描くような動作をさせた場合に、エアコンをＯＦＦするというような入力を、作業者は、入力部４１（図１参照）を用いて行う。これにより、ＣＰＵ４０（図１参照）は、テーブルＴＢＬ（図２参照）の動作内容の項目（ＴＢ２参照）に、三角形を描くと格納し、テーブルＴＢＬ（図２参照）の操作内容の項目（ＴＢ３参照）に、エアコンをＯＦＦと格納することとなる。 Next, the CPU 40 (see FIG. 1) causes the display unit 45 (see FIG. 1) to display, at the position set by the worker, instruction contents for causing the worker to set predetermined operation contents and predetermined operation contents. (Step S3). In response to this, the operator uses the input unit 41 (see FIG. 1) to perform any operation using the light irradiation device 2 with respect to the positions Ra to Rc. On the other hand, the user inputs what operation content is to be instructed. Specifically, as shown in FIG. 6A, the user irradiates the position Ra with the light 2a (see FIG. 1) using the light irradiation device 2, and the position Ra is generated by the irradiated light 2a. When the bright spot 2b is operated to draw a circle twice in a clockwise direction, the operator uses the input unit 41 (see FIG. 1) to perform an input such as raising the temperature of the air conditioner. Thereby, the CPU 40 (see FIG. 1) stores the drawing of the circle twice clockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and operates the table TBL (see FIG. 2). When the temperature of the air conditioner is increased in the item of the content (see TB3), it is stored. Further, as shown in FIG. 6B, the user irradiates the position Ra with the light 2a (see FIG. 1) using the light irradiating device 2, and the luminescent spot 2b generated by the irradiated light 2a. Is performed using the input unit 41 (see FIG. 1), such as lowering the temperature of the air conditioner when an operation of drawing a circle twice counterclockwise is performed. Thus, the CPU 40 (see FIG. 1) stores the drawing of the circle twice counterclockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and stores the table TBL (see FIG. 2). When the temperature of the air conditioner is lowered, the operation content item (see TB3) is stored. Further, as shown in FIG. 6C, the user irradiates the position Ra with the light 2a (see FIG. 1) using the light irradiation device 2, and the luminescent spot generated by the irradiated light 2a. The operator performs an input such as turning off the air conditioner by using the input unit 41 (see FIG. 1) when the operation of drawing a triangle is performed in 2b. Thereby, the CPU 40 (see FIG. 1) stores the drawing of the triangle in the operation content item (see TB2) of the table TBL (see FIG. 2), and stores the operation content item (TB3) of the table TBL (see FIG. 2). ), The air conditioner is stored as OFF.
　一方、図７（ａ）に示すように、位置Ｒｂに対し、使用者が光照射装置２を用いて、光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合に、今日の予定を通知するというような入力を、作業者は、入力部４１（図１参照）を用いて行う。これにより、ＣＰＵ４０（図１参照）は、テーブルＴＢＬ（図２参照）の動作内容の項目（ＴＢ２参照）に、時計回りに円を２回描くと格納し、テーブルＴＢＬ（図２参照）の操作内容の項目（ＴＢ３参照）に、今日の予定を通知すると格納することとなる。 On the other hand, as shown in FIG. 7A, the user irradiates the position Rb with light 2a (see FIG. 1) using the light irradiation device 2, and a luminescent spot 2b generated by the irradiated light 2a. Is performed using the input unit 41 (see FIG. 1), such as notifying of today's schedule when the user performs an operation of drawing a circle twice clockwise. Thereby, the CPU 40 (see FIG. 1) stores the drawing of the circle twice clockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and operates the table TBL (see FIG. 2). When the schedule of today is notified in the item of the content (refer to TB3), it is stored.
　また一方、図７（ｂ）に示すように、位置Ｒｃに対し、使用者が光照射装置２を用いて、光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合に、留守電を再生するというような入力を、作業者は、入力部４１（図１参照）を用いて行う。これにより、ＣＰＵ４０（図１参照）は、テーブルＴＢＬ（図２参照）の動作内容の項目（ＴＢ２参照）に、反時計回りに円を２回描くと格納し、テーブルＴＢＬ（図２参照）の操作内容の項目（ＴＢ３参照）に、留守電を再生すると格納することとなる。 On the other hand, as shown in FIG. 7B, the user irradiates the position Rc with light 2a (see FIG. 1) using the light irradiation device 2, and a luminescent spot generated by the irradiated light 2a. When the user performs an operation of drawing a circle two times in the counterclockwise direction in 2b, the operator inputs using the input unit 41 (see FIG. 1) such as reproducing the answering machine. Thus, the CPU 40 (see FIG. 1) stores the drawing of the circle twice counterclockwise in the item of the operation content (see TB2) of the table TBL (see FIG. 2), and stores the table TBL (see FIG. 2). When the answering machine is reproduced, it is stored in the item of the operation content (see TB3).
　かくして、このようにして、テーブルＴＢＬ（図２参照）に格納されている内容（ＴＢ１～ＴＢ３参照）が、テーブルＴＢＬ（図２参照）に格納されることとなる。 Thus, the contents (see TB1 to TB3) stored in the table TBL (see FIG. 2) are thus stored in the table TBL (see FIG. 2).
　なお、本実施形態においては、図１に示す制御装置４の入力部４１を用いて上記のようなデータを入力する例を示したが、それに限らず、スマート家電などの操作指示体を提供しているメーカ等に参照ＡＰＩ（Ａｐｐｌｉｃａｔｉｏｎ  Ｐｒｏｇｒａｍｍｉｎｇ  Ｉｎｔｅｒｆａｃｅ）を提供して、ネットワークを介して外部から入力できるようにしても良い。この際、ＣＰＵ４０（図１参照）は、図１に示す制御装置４の通信部４６より外部から入力されたデータを取得することとなる。これにより、操作指示内容関連情報登録データベース４７（図１参照）に格納されているテーブルＴＢＬ（図２参照）に、上記の内容（ＴＢ１～ＴＢ３参照）が格納されることとなる。 In the present embodiment, an example in which the above data is input using the input unit 41 of the control device 4 shown in FIG. 1 has been described. However, the present invention is not limited to this, and an operation indicator such as a smart home appliance is provided. A reference API (Application \ Programming \ Interface) may be provided to the maker or the like, and input may be made from outside via a network. At this time, the CPU 40 (see FIG. 1) acquires data externally input from the communication unit 46 of the control device 4 shown in FIG. Thus, the above contents (see TB1 to TB3) are stored in the table TBL (see FIG. 2) stored in the operation instruction content related information registration database 47 (see FIG. 1).
＜操作指示制御システムの一使用例の説明＞
　ここで、上記説明した操作指示制御システム１の一使用例を、図４を参照して説明する。なお、図４に示すプログラムの処理内容はあくまで一例であり、これに限定されるものではない。 <Description of an example of use of the operation instruction control system>
Here, an example of use of the above-described operation instruction control system 1 will be described with reference to FIG. Note that the processing contents of the program shown in FIG. 4 are merely examples, and the present invention is not limited to this.
　使用者は、この操作指示制御システム１を使用するにあたって、図１に示す制御装置４の入力部４１を用いて、図１に示すＲＯＭ４３内に格納されているプログラムの起動を指示する。これにより、制御装置４のＣＰＵ４０（図１参照）は、図４に示すような処理を行うこととなる。 (4) When using the operation instruction control system 1, the user uses the input unit 41 of the control device 4 shown in FIG. 1 to give an instruction to start a program stored in the ROM 43 shown in FIG. As a result, the CPU 40 (see FIG. 1) of the control device 4 performs the processing as shown in FIG.
　まず、ＣＰＵ４０（図１参照）は、カメラ３にて撮像された撮像対象物Ｗの撮像データを取得し、その撮像データのフレーム間の輝度の変化を確認する（ステップＳ１０）。すなわち、使用者が、例えば、図６に示す位置Ｒａに対し、光照射装置２を用いて、光２ａ（図１参照）を照射していた場合、光２ａを照射する前のフレームの撮像データと、光２ａを照射した後のフレームの撮像データとを比較すると、光２ａを照射したことにより、その照射した光２ａにより生じた輝点２ｂによって、フレーム間の輝度が変化しているため、輝点２ｂの位置が分かることとなる。さらには、その輝点２ｂの位置が変化すれば、輝点２ｂ変化前のフレームの撮像データと、輝点２ｂ変化後のフレームの撮像データとを比較すると、フレーム間の輝度が変化しているため、輝点２ｂの位置が変化したことが分かることとなる。それゆえ、ＣＰＵ４０（図１参照）は、その輝度の変化を、フレーム間で確認する。 First, the CPU 40 (see FIG. 1) obtains imaging data of the imaging target W captured by the camera 3, and checks a change in luminance between frames of the imaging data (step S10). That is, for example, when the user irradiates the position Ra shown in FIG. 6 with the light 2a (see FIG. 1) using the light irradiation device 2, the imaging data of the frame before the irradiation with the light 2a is obtained. Is compared with the imaging data of the frame after irradiation with the light 2a. Since the irradiation with the light 2a changes the luminance between the frames due to the bright spot 2b generated by the irradiation light 2a, The position of the luminescent spot 2b will be known. Furthermore, if the position of the luminescent spot 2b changes, comparing the image data of the frame before the change of the luminescent point 2b and the image data of the frame after the change of the luminescent point 2b, the brightness between the frames changes. Therefore, it can be seen that the position of the bright spot 2b has changed. Therefore, the CPU 40 (see FIG. 1) checks the change in luminance between frames.
　次いで、ＣＰＵ４０（図１参照）は、その輝度の変化を確認することで、光照射装置２を用いて照射した光２ａにより生じた輝点２ｂの動作内容を確認する（ステップＳ１１）。具体的には、使用者が、例えば、図６（ａ）に示す位置Ｒａに対し、光照射装置２を用いて光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合、ＣＰＵ４０（図１参照）は、フレーム間で輝度の変化を確認しているから、フレーム毎の輝点２ｂのＸ，Ｙ座標位置を、図５（ｂ）に示す原点Ｏを基準とした際、どの座標位置にあるかをピクセル値等から算出することができ、もって、フレーム毎の輝点２ｂのＸ，Ｙ座標位置を繋ぎ合わせることで、輝点２ｂが、図６（ａ）に示す位置Ｒａ内で、時計回りに円を２回描くような動作をしたことが確認できることとなる。 Next, the CPU 40 (see FIG. 1) confirms the change in the luminance, thereby confirming the operation content of the bright spot 2b generated by the light 2a irradiated by using the light irradiation device 2 (step S11). Specifically, for example, the user irradiates the position Ra shown in FIG. 6A with the light 2a (see FIG. 1) using the light irradiating device 2 and shines due to the irradiated light 2a. When the point 2b is moved in such a manner that a circle is drawn twice clockwise, the CPU 40 (see FIG. 1) confirms a change in luminance between frames. When the Y coordinate position is based on the origin O shown in FIG. 5B, the coordinate position can be calculated from the pixel value or the like, and the X and Y coordinates of the bright spot 2b for each frame can be calculated. By joining the positions, it can be confirmed that the luminescent spot 2b has performed an operation of drawing a circle twice clockwise in the position Ra shown in FIG. 6A.
　次いで、ＣＰＵ４０（図１参照）は、操作指示内容関連情報登録データベース４７（図１参照）に格納されているテーブルＴＢＬ（図２参照）を読み出し、そのテーブルＴＢＬから、上記ステップＳ１１にて確認した内容に該当する箇所を検索し、操作内容の項目（ＴＢ３参照）より、操作内容を取得する（ステップＳ１２）。具体的には、図６（ａ）に示す位置Ｒａに対し、光照射装置２を用いて光２ａ（図１参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせたことが確認された場合、ＣＰＵ４０（図１参照）は、操作指示内容関連情報登録データベース４７（図１参照）に格納されているテーブルＴＢＬ（図２参照）より、エアコンの温度を上げるというような操作内容を取得することとなる。 Next, the CPU 40 (see FIG. 1) reads out the table TBL (see FIG. 2) stored in the operation instruction content related information registration database 47 (see FIG. 1), and confirms the table TBL in step S11. A portion corresponding to the content is searched, and the operation content is obtained from the operation content item (see TB3) (step S12). Specifically, the position Ra shown in FIG. 6A is irradiated with light 2a (see FIG. 1) using the light irradiation device 2, and the bright spot 2b generated by the irradiated light 2a is rotated clockwise. When the CPU 40 (see FIG. 1) confirms that the user has performed the operation of drawing a circle twice, the CPU 40 (see FIG. 1) stores the table TBL (see FIG. 2) stored in the operation instruction content related information registration database 47 (see FIG. 1). ), The operation content such as raising the temperature of the air conditioner is acquired.
　次いで、ＣＰＵ４０（図１参照）は、その取得した操作内容を、通信部４６（図１参照）を介して外部に送信する（ステップＳ１３）。これにより、ネットワークを介して通信部４６（図１参照）と接続されている、例えば、エアコン（図示せず）は、温度を上げる操作をすることとなる。 Next, the CPU 40 (see FIG. 1) transmits the acquired operation content to the outside via the communication unit 46 (see FIG. 1) (step S13). Accordingly, for example, an air conditioner (not shown) connected to the communication unit 46 (see FIG. 1) via the network performs an operation of increasing the temperature.
　しかして、以上説明した本実施形態によれば、使用者は、図示しないスマート家電などの操作指示体に対して、所定の操作を指示したい場合、光照射装置２を用いて、撮像対象物Ｗの位置Ｒａ～Ｒｃに対して、光２ａを照射し、その照射した光２ａにて生じた輝点２ｂに所定の動作をさせるだけで、所定の操作を指示することができることなる。 Thus, according to the present embodiment described above, when the user wants to instruct a predetermined operation on an operation indicator such as a smart home appliance (not shown), the user can use the light irradiation device 2 to perform an operation on the imaging target W. A predetermined operation can be instructed only by irradiating the light Ra onto the positions Ra to Rc and performing a predetermined operation on the luminescent spot 2b generated by the irradiated light 2a.
　しかして、本実施形態によれば、音声認識や、動作認識のように、発話者や被写体である人物の音声や動作を使用する必要がないため、プライバシーを確保することができる。さらには、光２ａにて生じた輝点２ｂの動きを認識するだけで良いため、使用する環境の影響を受けにくく、もって、処理が簡便となり、認識精度のばらつきを低減させることができる。 However, according to the present embodiment, unlike the voice recognition and the motion recognition, it is not necessary to use the voice or the motion of the speaker or the person who is the subject, so that the privacy can be ensured. Further, since it is only necessary to recognize the movement of the luminescent spot 2b generated by the light 2a, it is hardly affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
＜第２実施形態＞
　次に、本発明に係る操作指示制御装置及びその方法に関する操作指示制御システムの第２実施形態について、図面を参照して具体的に説明する。なお、第１実施形態と同一構成については、同一の符号を付し、説明は省略する。 <Second embodiment>
Next, a second embodiment of the operation instruction control system relating to the operation instruction control device and the method thereof according to the present invention will be specifically described with reference to the drawings. The same components as those in the first embodiment are denoted by the same reference numerals, and description thereof is omitted.
　第１実施形態と第２実施形態とで異なる点は、第１実施形態では、不特定の使用者が光照射装置２を用いる例を示したが、第２実施形態では、特定の使用者が光照射装置２を用いるという点が相違している。以下、この点につき、詳述することとする。 The difference between the first embodiment and the second embodiment is that, in the first embodiment, an example in which an unspecified user uses the light irradiation device 2 is shown, but in the second embodiment, a specific user is The difference is that the light irradiation device 2 is used. Hereinafter, this point will be described in detail.
＜操作指示制御システムの説明＞
　図８に示すように、操作指示制御システム１Ａは、光照射装置２Ａと、カメラ３と、制御装置４と、で構成されている。 <Description of operation instruction control system>
As shown in FIG. 8, the operation instruction control system 1A includes a light irradiation device 2A, a camera 3, and a control device 4.
　光照射装置２Ａは、レーザーポインタや、リング型ライト、腕時計型ライト、メガネ型ライト、ペン型ライト、懐中電灯などからなる装置であって、光照射装置２Ａを使用する複数の使用者毎の識別子（例えば、ＩＤ）を登録できるものである。そして、これら使用者の識別子（例えば、ＩＤ）は、制御装置４からの指示に応じて、制御装置４に出力できるようになっている。 The light irradiation device 2A is a device including a laser pointer, a ring light, a watch light, a glasses light, a pen light, a flashlight, and the like, and is an identifier for each of a plurality of users who use the light irradiation device 2A. (For example, ID). These user identifiers (for example, IDs) can be output to the control device 4 in response to an instruction from the control device 4.
　一方、制御装置４の操作指示内容関連情報登録データベース４７には、図９に示すテーブルＴＢＬＡが格納されている。このテーブルＴＢＬＡには、光照射装置２Ａを使用する使用者ＩＤ（ＴＢ０Ａ参照）が格納され、この使用者ＩＤ（ＴＢ０Ａ参照）に対応する、カメラ３（図８参照）にて撮像された撮像対象物Ｗに対して、設定された位置（ＴＢ１Ａ参照）が格納され、その設定された位置（ＴＢ１Ａ参照）に対して、この使用者ＩＤ（ＴＢ０Ａ参照）に対応する使用者が光照射装置２を用いて動作する動作内容（ＴＢ２Ａ参照）が格納され、その動作内容に応じた、図示しないスマート家電などの操作指示体への操作内容（ＴＢ３Ａ参照）が格納されている。具体的に説明すると、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ａ参照）が、図５（ｂ）に示す位置Ｒａ（図９では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ａ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ａ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を上げるという操作内容（ＴＢ３Ａ参照）が格納されている。さらに、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ａ参照）が、図５（ｂ）に示す位置Ｒａ（図９では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ａ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ａ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を下げるという操作内容（ＴＢ３Ａ参照）が格納されている。そしてさらに、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ａ参照）が、図５（ｂ）に示す位置Ｒａ（図９では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ａ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、三角形を描くような動作をさせた場合（ＴＢ２Ａ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンをＯＦＦするという操作内容（ＴＢ３Ａ参照）が格納されている。 On the other hand, a table TBLA shown in FIG. 9 is stored in the operation instruction content related information registration database 47 of the control device 4. In this table TBLA, a user ID (see TB0A) using the light irradiation device 2A is stored, and an object to be imaged by the camera 3 (see FIG. 8) corresponding to the user ID (see TB0A) For the object W, a set position (see TB1A) is stored, and for the set position (see TB1A), the user corresponding to this user ID (see TB0A) operates the light irradiation device 2. The operation contents (see TB2A) operated by using are stored, and the operation contents (see TB3A) for the operation indicator such as a smart home appliance (not shown) according to the operation contents are stored. More specifically, Mr. A (see TB0A) having the user ID “x0001” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B. (See TB1A) using the light irradiation device 2A to irradiate light 2a (see FIG. 8), and draw a bright spot 2b generated by the irradiated light 2a twice in a clockwise circle. (See TB2A), the operation content (see TB3A) for increasing the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Furthermore, Mr. A (see TB0A) having the user ID "x0001" is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B (see TB1A). Was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise. In the case (see TB2A), an operation content (see TB3A) for lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, the user A having the user ID “x0001” (see TB0A) is positioned Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B (see TB1A). ) Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2A). The operation content (see TB3A) of turning off the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
　一方、使用者ＩＤ「ｘ０００２」であるＢさん（ＴＢ０Ａ参照）が、図５（ｂ）に示す位置Ｒａ（図９では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ａ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ａ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を下げるという操作内容（ＴＢ３Ａ参照）が格納されている。さらに、使用者ＩＤ「ｘ０００２」であるＢさん（ＴＢ０Ａ参照）が、図５（ｂ）に示す位置Ｒａ（図９では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ａ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ａ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を上げるという操作内容（ＴＢ３Ａ参照）が格納されている。そしてさらに、使用者ＩＤ「ｘ０００２」であるＢさん（ＴＢ０Ａ参照）が、図５（ｂ）に示す位置Ｒａ（図９では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ａ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、三角形を描くような動作をさせた場合（ＴＢ２Ａ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンをＯＮするという操作内容（ＴＢ３Ａ参照）が格納されている。 On the other hand, Mr. B (see TB0A) having the user ID "x0002" is located at the position Ra shown in FIG. 5B (in FIG. 9, the position is (50, 1000)-(200, 1200)) (see TB1A). In the case where the light 2a (see FIG. 8) is irradiated using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is moved twice in a clockwise circle. (See TB2A), the operation content (see TB3A) of lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, Mr. B (refer to TB0A) having the user ID "x0002" is positioned Ra ((50, 1000)-(200, 1200) in FIG. 9) shown in FIG. 5B (see TB1A). Was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise. In the case (see TB2A), an operation content (see TB3A) for raising the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, the user B having the user ID “x0002” (refer to TB0A) is positioned Ra ((50, 1000) − (200, 1200) in FIG. 9) illustrated in FIG. 5B (refer to TB1A). ) Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2A). The operation content (see TB3A) of turning on the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
　しかして、このように、動作内容が同一であっても、使用者毎に、操作内容を異なるようにしておけば、使用者毎のカスタマイズが可能となる。また、制御装置４にＲＴＣ（リアルタイムクロック）を内蔵させておけば、何時どの使用者が、光照射装置２Ａを用いたかをＲＯＭ４３内に記憶させておくことが可能となる。これにより、何時どの使用者が、光照射装置２を用いたかを確認することが可能となる。 Thus, even if the operation content is the same, if the operation content is different for each user, customization for each user is possible. If the control device 4 has a built-in RTC (real-time clock), it is possible to store in the ROM 43 when and which user used the light irradiation device 2A. This makes it possible to confirm when and which user used the light irradiation device 2.
　また一方、同一の操作内容であっても、使用者毎に、動作内容を異なるようにしておくこともできる。すなわち、制御装置４の操作指示内容関連情報登録データベース４７に、図１０に示すテーブルＴＢＬＢを格納する。このテーブルＴＢＬＢには、光照射装置２Ａを使用する使用者ＩＤ（ＴＢ０Ｂ参照）が格納され、この使用者ＩＤ（ＴＢ０Ｂ参照）に対応する、カメラ３（図８参照）にて撮像された撮像対象物Ｗに対して、設定された位置（ＴＢ１Ｂ参照）が格納され、その設定された位置（ＴＢ１Ｂ参照）に対して、この使用者ＩＤ（ＴＢ０Ｂ参照）に対応する使用者が光照射装置２Ａを用いて動作する内容（ＴＢ２Ｂ参照）が格納され、その動作内容に応じた、図示しないスマート家電などの操作指示体への操作内容（ＴＢ３Ｂ参照）が格納されている。具体的に説明すると、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ｂ参照）が、図５（ｂ）に示す位置Ｒａ（図１０では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ｂ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ｂ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を上げるという操作内容（ＴＢ３Ｂ参照）が格納されている。さらに、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ｂ参照）が、図５（ｂ）に示す位置Ｒａ（図１０では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ｂ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ｂ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を下げるという操作内容（ＴＢ３Ｂ参照）が格納されている。そしてさらに、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ｂ参照）が、図５（ｂ）に示す位置Ｒａ（図１０では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ｂ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、三角形を描くような動作をさせた場合（ＴＢ２Ｂ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンをＯＦＦするという操作内容（ＴＢ３Ｂ参照）が格納されている。 On the other hand, even with the same operation content, the operation content may be different for each user. That is, the table TBLB shown in FIG. 10 is stored in the operation instruction content related information registration database 47 of the control device 4. In this table TBLB, a user ID (see TB0B) using the light irradiation device 2A is stored, and an object to be imaged by the camera 3 (see FIG. 8) corresponding to the user ID (see TB0B) For the object W, a set position (see TB1B) is stored, and for the set position (see TB1B), the user corresponding to this user ID (see TB0B) operates the light irradiation device 2A. The operation contents (see TB2B) used are stored, and the operation contents (see TB3B) for an operation indicator such as a smart home appliance (not shown) according to the operation contents are stored. More specifically, Mr. A (refer to TB0B) having the user ID "x0001" is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B. (See TB1B) using the light irradiation device 2A to irradiate the light 2a (see FIG. 8), and draw a bright spot 2b generated by the irradiated light 2a twice in a clockwise circle. (See TB2B), the operation content (see TB3B) of increasing the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, Mr. A (refer to TB0B) having the user ID “x0001” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B). Was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise. In the case (see TB2B), an operation content (see TB3B) for lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, Mr. A (refer to TB0B) having the user ID "x0001" is positioned Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B). ) Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2B). The operation content (see TB3B) of turning off the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
　一方、使用者ＩＤ「ｘ０００２」であるＢさん（ＴＢ０Ｂ参照）が、図５（ｂ）に示す位置Ｒａ（図１０では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ｂ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ｂ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を上げるという操作内容（ＴＢ３Ｂ参照）が格納されている。さらに、使用者ＩＤ「ｘ０００２」であるＢさん（ＴＢ０Ｂ参照）が、図５（ｂ）に示す位置Ｒａ（図１０では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ｂ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合（ＴＢ２Ｂ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度を下げるという操作内容（ＴＢ３Ｂ参照）が格納されている。そしてさらに、使用者ＩＤ「ｘ０００２」であるＢさん（ＴＢ０Ｂ参照）が、図５（ｂ）に示す位置Ｒａ（図１０では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１Ｂ参照）に対し、光照射装置２Ａを用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、四角形描くような動作をさせた場合（ＴＢ２Ｂ参照）、ネットワークを介して通信部４６（図８参照）と接続されているエアコンの温度をＯＦＦという操作内容（ＴＢ３Ｂ参照）が格納されている。 On the other hand, Mr. B (see TB0B) having the user ID “x0002” is located at the position Ra shown in FIG. 5B ((50, 1000)-(200, 1200) in FIG. 10) (see TB1B). Was irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a was operated to draw a circle twice counterclockwise. In the case (see TB2B), an operation content (see TB3B) for increasing the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, Mr. B (refer to TB0B) having the user ID “x0002” is located at the position Ra ((50, 1000)-(200, 1200) in FIG. 10) illustrated in FIG. 5B (refer to TB1B). In the case where the light 2a (see FIG. 8) is irradiated using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is moved twice in a clockwise circle. (See TB2B), the operation content (see TB3B) of lowering the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored. Further, the user B having the user ID "x0002" (see TB0B) is positioned Ra ((50, 1000)-(200, 1200) in FIG. 10) shown in FIG. 5B (see TB1B). ) Is irradiated with light 2a (see FIG. 8) using the light irradiation device 2A, and the bright spot 2b generated by the irradiated light 2a is operated to draw a square (see TB2B). The operation content (see TB3B) of turning off the temperature of the air conditioner connected to the communication unit 46 (see FIG. 8) via the network is stored.
　しかして、このように、同一の操作内容であっても、使用者毎に、動作内容を異なるようにしておけば、使用者毎のカスタマイズが可能となる。また、制御装置４にＲＴＣ（リアルタイムクロック）を内蔵させておけば、何時どの使用者が、光照射装置２Ａを用いたかをＲＯＭ４３内に記憶させておくことが可能となる。これにより、何時どの使用者が、光照射装置２を用いたかを確認することが可能となる。 Thus, even if the operation content is the same, if the operation content is different for each user, customization for each user is possible. If the control device 4 has a built-in RTC (real-time clock), it is possible to store in the ROM 43 when and which user used the light irradiation device 2A. This makes it possible to confirm when and which user used the light irradiation device 2.
　なお、上記説明したテーブルＴＢＬＡ（図９参照），テーブルＴＢＬＢ（図１０参照）に格納されている内容を格納する方法は、使用者毎に、図３に示す処理を行えばよいため、説明は省略することとする。 The method of storing the contents stored in the table TBLA (see FIG. 9) and the table TBLB (see FIG. 10) described above may be performed for each user by performing the processing shown in FIG. It is omitted.
　かくして、上記説明した操作指示制御システム１Ａを使用するにあたっては、使用者が、図８に示す制御装置４の入力部４１を用いて、図８に示すＲＯＭ４３内に格納されているプログラムの起動を指示する。これにより、制御装置４のＣＰＵ４０（図８参照）は、図１１に示すような処理を行う。以下、図１１を参照して説明する。なお、図１１に示すプログラムの処理内容はあくまで一例であり、これに限定されるものではない。 Thus, when using the operation instruction control system 1A described above, the user activates the program stored in the ROM 43 shown in FIG. 8 by using the input unit 41 of the control device 4 shown in FIG. To instruct. As a result, the CPU 40 (see FIG. 8) of the control device 4 performs a process as shown in FIG. Hereinafter, description will be made with reference to FIG. Note that the processing contents of the program shown in FIG. 11 are merely examples, and the present invention is not limited to this.
　まず、ＣＰＵ４０（図１参照）は、光照射装置２Ａより、光照射装置２Ａを使用する使用者の識別子（例えば、ＩＤ）を取得する（ステップＳ２０）。具体的に説明すると、使用者（例えば、Ａさん）は、光照射装置２Ａを使用するにあたって、登録しておいた自身の識別子（例えば、ＩＤ）を読み出し、現在の使用者（例えば、Ａさん）を光照射装置２Ａに認識させておく。これにより、ＣＰＵ４０（図１参照）が、光照射装置２Ａより、光照射装置２Ａを使用する使用者の識別子（例えば、ＩＤ）を取得するようにすれば、光照射装置２Ａを使用している現在の使用者（例えば、Ａさん）が判別できることとなる。 First, the CPU 40 (see FIG. 1) acquires an identifier (for example, ID) of a user who uses the light irradiation device 2A from the light irradiation device 2A (step S20). More specifically, when using the light irradiation device 2A, the user (for example, Mr. A) reads out his / her own registered identifier (for example, ID), and reads the current user (for example, Mr. A). ) Is recognized by the light irradiation device 2A. Thus, if the CPU 40 (see FIG. 1) acquires the identifier (for example, ID) of the user who uses the light irradiation device 2A from the light irradiation device 2A, the light irradiation device 2A is used. The current user (for example, Mr. A) can be determined.
　次いで、ＣＰＵ４０（図１参照）は、上述したステップＳ１０及びステップＳ１１の処理を行う。 Next, the CPU 40 (see FIG. 1) performs the processing of step S10 and step S11 described above.
　次いで、ＣＰＵ４０（図１参照）は、操作指示内容関連情報登録データベース４７（図１参照）に格納されているテーブルＴＢＬＡ（図９参照）、又は、テーブルＴＢＬＢ（図１０参照）を読み出し、そのテーブルＴＢＬＡ、又は、テーブルＴＢＬＢから、取得した使用者の識別子（例えば、ＩＤ）に対する、上記ステップＳ１１にて確認した内容に該当する箇所を検索し、操作内容の項目（ＴＢ３Ａ，ＴＢ３Ｂ参照）より、操作内容を取得する（ステップＳ２２）。具体的には、使用者ＩＤ「ｘ０００１」であるＡさん（ＴＢ０Ａ参照）が、図６（ａ）に示す位置Ｒａに対し、光照射装置２を用いて光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせたことが確認された場合、ＣＰＵ４０（図１参照）は、操作指示内容関連情報登録データベース４７（図１参照）に格納されているテーブルＴＢＬＡ（図９参照）又は、テーブルＴＢＬＢ（図１０参照）より、エアコンの温度を上げるというような操作内容を取得することとなる。 Next, the CPU 40 (see FIG. 1) reads the table TBLA (see FIG. 9) or the table TBLB (see FIG. 10) stored in the operation instruction content related information registration database 47 (see FIG. 1), and reads the table. From the TBLA or the table TBLB, a portion corresponding to the content confirmed in step S11 with respect to the acquired user identifier (for example, ID) is searched, and the operation is performed from the operation content item (see TB3A, TB3B). The contents are acquired (step S22). Specifically, Mr. A (see TB0A) having the user ID “x0001” irradiates the position Ra shown in FIG. 6A with the light 2a (see FIG. 8) using the light irradiation device 2. When the CPU 40 (see FIG. 1) confirms that the bright spot 2b generated by the irradiated light 2a has been operated to draw a circle twice in a clockwise direction, the CPU 40 (see FIG. 1) registers the operation instruction content related information registration database. From the table TBLA (see FIG. 9) or the table TBLB (see FIG. 10) stored in the table 47 (see FIG. 1), an operation content such as raising the temperature of the air conditioner is obtained.
　次いで、ＣＰＵ４０（図１参照）は、その取得した操作内容を、通信部４６（図１参照）を介して外部に送信する（ステップＳ１３）。これにより、ネットワークを介して通信部４６（図１参照）と接続されている、例えば、エアコン（図示せず）は、温度を上げる操作をすることとなる。 Next, the CPU 40 (see FIG. 1) transmits the acquired operation content to the outside via the communication unit 46 (see FIG. 1) (step S13). Accordingly, for example, an air conditioner (not shown) connected to the communication unit 46 (see FIG. 1) via the network performs an operation of increasing the temperature.
　しかして、以上説明した本実施形態においても、特定の使用者は、図示しないスマート家電などの操作指示体に対して、所定の操作を指示したい場合、光照射装置２を用いて、撮像対象物Ｗの位置Ｒａ～Ｒｃに対して、光２ａを照射し、その照射した光２ａにて生じた輝点２ｂに所定の動作をさせるだけで、所定の操作を指示することができる。 Thus, also in the above-described embodiment, when a specific user wants to instruct a predetermined operation on an operation indicator such as a smart home appliance (not shown), the user can use the light irradiation device 2 to perform an imaging object. A predetermined operation can be instructed only by irradiating the light 2a to the positions Ra to Rc of W and causing the luminescent spot 2b generated by the irradiated light 2a to perform a predetermined operation.
　しかして、本実施形態においても、音声認識や、動作認識のように、発話者や被写体である人物の音声や動作を使用する必要がないため、プライバシーを確保することができる。さらには、光２ａにて生じた輝点２ｂの動きを認識するだけで良いため、使用する環境の影響を受けにくく、もって、処理が簡便となり、認識精度のばらつきを低減させることができる。 However, also in the present embodiment, it is not necessary to use the voice or the motion of the speaker or the person who is the subject as in the voice recognition or the motion recognition, so that the privacy can be ensured. Further, since it is only necessary to recognize the movement of the luminescent spot 2b generated by the light 2a, it is hardly affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
＜第３実施形態＞
　次に、本発明に係る操作指示制御装置及びその方法に関する操作指示制御システムの第３実施形態について、図面を参照して具体的に説明する。なお、第１実施形態と同一構成については、同一の符号を付し、説明は省略する。 <Third embodiment>
Next, a third embodiment of the operation instruction control system relating to the operation instruction control device and the method thereof according to the present invention will be specifically described with reference to the drawings. The same components as those in the first embodiment are denoted by the same reference numerals, and description thereof is omitted.
　第１実施形態と第３実施形態とで異なる点は、第１実施形態では、図示しないスマート家電などの操作指示体に対して、操作指示内容を送信するようにしていたが、第３実施形態では、複数の操作指示内容を操作指示装置に送信するという点が相違している。以下、この点につき、詳述することとする。 The difference between the first embodiment and the third embodiment is that, in the first embodiment, the operation instruction content is transmitted to an operation indicator such as a smart home appliance (not shown). Are different in that a plurality of operation instruction contents are transmitted to the operation instruction device. Hereinafter, this point will be described in detail.
＜操作指示制御システムの説明＞
　図１２に示すように、操作指示制御システム１Ｂは、光照射装置２と、カメラ３と、制御装置４と、操作指示装置５とで構成されている。 <Description of operation instruction control system>
As shown in FIG. 12, the operation instruction control system 1 </ b> B includes a light irradiation device 2, a camera 3, a control device 4, and an operation instruction device 5.
　操作指示装置５は、ｉｐｈｏｎｅ（登録商標）等のスマートフォンや携帯電話、あるいは、ウェアラブルデバイスや、ＰＣ等からなるもので、通信部４６（図１２参照）と、ネットワークを介して接続可能なものであり、種々の画像を表示できる表示部５０を備えているものである。そして、この操作装置装置５は、ネットワークを介して、図示しないスマート家電などの操作指示体と接続可能なものである。 The operation instruction device 5 includes a smartphone or a mobile phone such as iPhone (registered trademark), a wearable device, a PC, or the like, and can be connected to the communication unit 46 (see FIG. 12) via a network. And a display unit 50 capable of displaying various images. The operation device 5 can be connected to an operation indicator such as a smart home appliance (not shown) via a network.
　一方、制御装置４の操作指示内容関連情報登録データベース４７には、図１３に示すテーブルＴＢＬＣが格納されている。このテーブルＴＢＬＣには、カメラ３にて撮像された撮像対象物Ｗに対して、設定された位置（ＴＢ１参照）が格納され、その設定された位置（ＴＢ１参照）に対して、使用者が光照射装置２を用いて動作する内容（ＴＢ２参照）が格納され、その動作内容に応じた、図示しないスマート家電などの操作指示体への複数の操作内容（ＴＢ３Ｃ参照）が格納されている。具体的に説明すると、図５（ｂ）に示す位置Ｒａ（図１３では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１参照）に対し、光照射装置２を用いて、光２ａ（図１２参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、時計回りに円を２回描くような動作をさせた場合（ＴＢ２参照）、操作装置装置５とネットワークを介して接続されているエアコンの温度を上げるという操作内容、エアコンの温度を下げるという操作内容（ＴＢ３Ｃ参照）が格納されている。さらに、図５（ｂ）に示す位置Ｒａ（図１３では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１参照）に対し、光照射装置２を用いて、光２ａ（図１２参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、反時計回りに円を２回描くような動作をさせた場合（ＴＢ２参照）、操作装置装置５とネットワークを介して接続されているエアコンの湿度を上げるという操作内容、エアコンの湿度を下げるという操作内容（ＴＢ３Ｃ参照）が格納されている。そしてさらに、図５（ｂ）に示す位置Ｒａ（図１３では、（５０，１０００）－（２００，１２００）としている）（ＴＢ１参照）に対し、光照射装置２を用いて、光２ａ（図８参照）を照射し、その照射した光２ａにより生じた輝点２ｂを、三角形を描くような動作をさせた場合（ＴＢ２参照）、操作装置装置５とネットワークを介して接続されているエアコンをＯＮするという操作内容、エアコンをＯＦＦするという操作内容（ＴＢ３Ｃ参照）が格納されている。 On the other hand, the operation instruction content related information registration database 47 of the control device 4 stores a table TBLC shown in FIG. In the table TBLC, a set position (see TB1) is stored with respect to the imaging target W picked up by the camera 3, and the user sets light on the set position (see TB1). Contents (see TB2) of operation using the irradiation device 2 are stored, and a plurality of operation contents (see TB3C) for an operation indicator such as a smart home appliance (not shown) corresponding to the operation contents are stored. More specifically, the light irradiation device 2 is used to light the position Ra (refer to (50, 1000)-(200, 1200) in FIG. 13) (see TB1) shown in FIG. 5B. 2a (see FIG. 12), and when a bright spot 2b generated by the irradiated light 2a is operated to draw a circle twice clockwise (see TB2), the operating device 5 and the network are connected. The operation content for raising the temperature of the air conditioner connected via the CAM and the operation content for lowering the temperature of the air conditioner (see TB3C) are stored. Further, the light 2a (FIG. 12) is applied to the position Ra (shown as (50, 1000)-(200, 1200) in FIG. 13) (see TB1) shown in FIG. (See TB2), the bright spot 2b generated by the irradiated light 2a is connected to the operating device 5 via a network. The operation content for raising the humidity of the air conditioner and the operation content for lowering the humidity of the air conditioner (see TB3C) are stored. Further, the light 2a (FIG. 13) is applied to the position Ra (shown as (50, 1000)-(200, 1200) in FIG. 13) (see TB1) shown in FIG. 8), and the bright point 2b generated by the irradiated light 2a is operated to draw a triangle (see TB2). When the air conditioner is connected to the operation device 5 via a network, The operation content of turning on the air conditioner and the operation content of turning off the air conditioner (see TB3C) are stored.
　しかして、このように、第３実施形態においては、一つの動作内容に対して、複数の操作内容が格納されている。なお、本実施形態においては、２つの操作内容しか例示していないが、勿論、一つの動作内容に対して、３つ以上の操作内容が格納されていても良い。 Thus, in the third embodiment, a plurality of operation contents are stored for one operation content. In the present embodiment, only two operation contents are illustrated, but of course, three or more operation contents may be stored for one operation content.
　ところで、上記説明したテーブルＴＢＬＣ（図１３参照）に格納されている内容を格納する方法は、図３に示す処理のうち、ステップＳ１～ステップＳ２の処理は同一であり、ステップＳ３にて複数の操作内容を入力する点が相違するだけでそれ以外は同一であるため、説明は省略することとする。 Incidentally, the method of storing the contents stored in the table TBLC (see FIG. 13) described above is the same as the processing of steps S1 and S2 in the processing shown in FIG. Only the difference is that the operation content is input, and the rest is the same.
　かくして、上記説明した操作指示制御システム１Ｂを使用するにあたっては、使用者が、図１２に示す制御装置４の入力部４１を用いて、図１２に示すＲＯＭ４３内に格納されているプログラムの起動を指示する。これにより、制御装置４のＣＰＵ４０（図１２参照）は、図１４に示すような処理を行う。以下、図１４を参照して説明する。なお、図１４に示すプログラムの処理内容はあくまで一例であり、これに限定されるものではない。 Thus, when using the above-described operation instruction control system 1B, the user uses the input unit 41 of the control device 4 shown in FIG. 12 to activate the program stored in the ROM 43 shown in FIG. To instruct. Accordingly, the CPU 40 (see FIG. 12) of the control device 4 performs a process as shown in FIG. Hereinafter, description will be made with reference to FIG. Note that the processing contents of the program shown in FIG. 14 are only examples, and the present invention is not limited to this.
　図１４に示すように、ＣＰＵ４０（図１２参照）、上記説明したステップＳ１０～ステップＳ１２の処理を行う。 ＣＰＵAs shown in FIG. 14, the CPU 40 (see FIG. 12) performs the above-described processing of steps S10 to S12.
　次いで、ＣＰＵ４０（図１２参照）は、その取得した操作内容（例えば、エアコンの温度を上げる、エアコンの温度を下げるという操作内容）を、通信部４６（図１２参照）を介して操作指示装置５に送信する（ステップＳ３０）。これを受けて、操作指示装置５は、図１５（ａ）に示すように、表示部５０に、送信されてきた操作内容を表示させる。具体的には、取得した操作内容が、エアコンの温度を上げる、エアコンの温度を下げるという操作内容であった場合、表示部５０に、エアコンの温度を上げる、エアコンの温度を下げるという内容が表示され、何れかの操作を使用者に選択させることとなる。これを受けて、使用者が、エアコンの温度を下げるという内容を操作指示装置５のタッチパネル等の入力部（図示せず）を用いて選択すると、図１５（ｂ）に示すように、表示部５０に、エアコンの温度を下げるが選択されましたと表示され、もって、操作指示装置５とネットワークを介して接続されているエアコンにエアコンの温度を下げるという操作内容が送信されることとなる。これにより、ネットワークを介して操作指示装置５と接続されている、エアコンは、温度を下げる操作をすることとなる。 Next, the CPU 40 (see FIG. 12) transmits the acquired operation content (for example, an operation content of raising the temperature of the air conditioner and decreasing the temperature of the air conditioner) via the communication unit 46 (see FIG. 12). (Step S30). In response to this, the operation instruction device 5 causes the display unit 50 to display the transmitted operation content, as shown in FIG. Specifically, when the acquired operation content is an operation content of raising the temperature of the air conditioner or lowering the temperature of the air conditioner, the display unit 50 displays the content of increasing the temperature of the air conditioner or decreasing the temperature of the air conditioner. Then, the user is caused to select one of the operations. In response to this, when the user selects the content of lowering the temperature of the air conditioner using an input unit (not shown) such as a touch panel of the operation instruction device 5, as shown in FIG. At 50, it is displayed that the lowering of the temperature of the air conditioner has been selected, and the operation content of lowering the temperature of the air conditioner is transmitted to the air conditioner connected to the operation instructing device 5 via the network. Accordingly, the air conditioner connected to the operation instruction device 5 via the network performs an operation of lowering the temperature.
　なお、本実施形態においては、一つの操作内容を選択できる例を示したが、二つ以上の操作内容を選択できるようにしても良い。 In the present embodiment, an example in which one operation content can be selected has been described, but two or more operation contents may be selected.
　しかして、以上説明した本実施形態においても、使用者は、図示しないスマート家電などの操作指示体に対して、所定の操作を指示したい場合、光照射装置２を用いて、撮像対象物Ｗの位置Ｒａ～Ｒｃに対して、光２ａを照射し、その照射した光２ａにて生じた輝点２ｂに所定の動作をさせるだけで、操作指示装置５に複数の操作内容を送信することができ、もって、操作指示装置５から、図示しないスマート家電などの操作指示体に対して、少なくとも一つの所定の操作を指示することができる。 Thus, also in the above-described embodiment, when the user wants to instruct a predetermined operation to an operation indicator such as a smart home appliance (not shown), the user can use the light irradiation device 2 to scan the imaging target W. A plurality of operation contents can be transmitted to the operation instruction device 5 simply by irradiating the positions Ra to Rc with the light 2a and causing the luminescent spot 2b generated by the irradiated light 2a to perform a predetermined operation. Thus, at least one predetermined operation can be instructed from the operation instruction device 5 to an operation indicator such as a smart home appliance (not shown).
　しかして、本実施形態においても、音声認識や、動作認識のように、発話者や被写体である人物の音声や動作を使用する必要がないため、プライバシーを確保することができる。さらには、光２ａにて生じた輝点２ｂの動きを認識するだけで良いため、使用する環境の影響を受けにくく、もって、処理が簡便となり、認識精度のばらつきを低減させることができる。 However, also in the present embodiment, it is not necessary to use the voice or the motion of the speaker or the person who is the subject as in the voice recognition or the motion recognition, so that the privacy can be ensured. Further, since it is only necessary to recognize the movement of the luminescent spot 2b generated by the light 2a, it is hardly affected by the environment in which it is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
　なお、第１実施形態～第３実施形態において示した形状等はあくまで一例であり、特許請求の範囲に記載された本発明の要旨の範囲内において、種々の変形・変更が可能である。例えば、第１実施形態～第３実施形態においては、理解を容易にするために、図６（ａ）に示すように、位置Ｒａ内で、輝点２ｂを、時計回りに円を２回描くような動作をさせた例を示したが、予め誤差範囲を設定しておき、位置Ｒａ外で、輝点２ｂを、時計回りに円を２回描くような動作をさせたとしても、予め設定された誤差範囲内であれば、操作指示内容関連情報登録データベース４７（図１，図８，図１２参照）に格納されているテーブルＴＢＬ（図２参照）、ＴＢＬＡ（図９参照）、ＴＢＬＢ（図１０参照）、ＴＢＬＣ（図１３参照）から、上記ステップＳ１１にて確認した内容に該当する箇所を検索し、操作内容の項目（ＴＢ３、ＴＢ３Ａ、ＴＢ３Ｂ、ＴＢ３Ｃ参照）より、操作内容を取得するようにしても良い。 The shapes and the like shown in the first to third embodiments are merely examples, and various modifications and changes can be made within the scope of the present invention described in the appended claims. For example, in the first to third embodiments, in order to facilitate understanding, as shown in FIG. 6A, a bright point 2b is drawn twice in a clockwise circle within a position Ra. Although an example of such an operation is shown, even if an error range is set in advance, and the bright spot 2b is drawn twice in a clockwise circle outside the position Ra, the error range is set in advance. If it is within the error range, the tables TBL (see FIG. 2), TBLA (see FIG. 9), and TBLB (see FIG. 9) stored in the operation instruction content related information registration database 47 (see FIGS. 1, 8, and 12). From FIG. 10) and TBLC (see FIG. 13), a portion corresponding to the content confirmed in step S11 is searched, and the operation content is obtained from the operation content item (see TB3, TB3A, TB3B, TB3C). You may do it.
　一方、第１実施形態～第３実施形態において示した位置Ｒａ～Ｒｃの設定方法は、あくまで一例であり、これに限定されるものではない。例えば、第１実施形態～第３実施形態においては、位置Ｒａ～Ｒｃを手動で設定する例を示したが、自動で設定するようにしても良い。例えば、操作指示内容関連情報登録データベース４７（図１，図８，図１２参照）に格納されているテーブルＴＢＬ（図２参照）、ＴＢＬＡ（図９参照）、ＴＢＬＢ（図１０参照）、ＴＢＬＣ（図１３参照）に、位置Ｒａ内にあるエアコン操作盤Ｗａの模様及び／又は画像、位置Ｒｂ内にある壁掛け時計Ｗｂの模様及び／又は画像、位置Ｒｃ内にある電話Ｗｃの模様及び／又は画像を格納しておいても良い。この際、ＣＰＵ４０（図１，図８，図１２参照）は、カメラ３にて撮像された撮像対象物Ｗの撮像データから、輝点２ｂが動作した範囲にある模様及び／又は画像を抽出し、テーブルＴＢＬ（図２参照）、ＴＢＬＡ（図９参照）、ＴＢＬＢ（図１０参照）、ＴＢＬＣ（図１３参照）に予め格納されている模様及び／又は画像に、その抽出した模様及び／又は画像に近似するものがあるかを検索し、近似するものがあれば、操作内容の項目（ＴＢ３、ＴＢ３Ａ、ＴＢ３Ｂ、ＴＢ３Ｃ参照）より、その近似する模様及び／又は画像に対応する操作内容を取得するようにすることとなる。このようにすれば、エアコン操作盤Ｗａや、壁掛け時計Ｗｂなどが移動しても、位置Ｒａ～Ｒｃを自動で設定することができ、作業効率を図ることができる。なお、近似する模様及び／又は画像が複数存在した場合は、輝点２ｂが動作した範囲の位置に最も近似する位置に対応する模様及び／又は画像を選択するようにすれば良い。 On the other hand, the method of setting the positions Ra to Rc shown in the first to third embodiments is merely an example, and the present invention is not limited to this. For example, in the first to third embodiments, the example in which the positions Ra to Rc are set manually has been described, but the positions Ra to Rc may be set automatically. For example, the tables TBL (see FIG. 2), TBLA (see FIG. 9), TBLB (see FIG. 10), and TBLC (see FIG. 10) stored in the operation instruction content related information registration database 47 (see FIGS. 1, 8, and 12). FIG. 13) shows a pattern and / or image of the air conditioner operation panel Wa in the position Ra, a pattern and / or image of the wall clock Wb in the position Rb, and a pattern and / or image of the telephone Wc in the position Rc. May be stored. At this time, the CPU 40 (see FIG. 1, FIG. 8, and FIG. 12) extracts a pattern and / or an image within the range in which the luminescent spot 2b operates from the imaging data of the imaging target W captured by the camera 3. , A table and / or image previously stored in a table TBL (see FIG. 2), a TBLA (see FIG. 9), a TBLB (see FIG. 10), and a TBLC (see FIG. 13). Is searched for, and if there is an approximation, the operation content corresponding to the similar pattern and / or image is obtained from the operation content item (see TB3, TB3A, TB3B, TB3C). Will be done. With this configuration, even when the air conditioner operation panel Wa, the wall clock Wb, and the like move, the positions Ra to Rc can be automatically set, and work efficiency can be improved. When there are a plurality of similar patterns and / or images, a pattern and / or image corresponding to a position closest to the position of the range in which the luminescent spot 2b has moved may be selected.
　一方、第１実施形態～第３実施形態においては、輝点２ｂを、時計回りに円を２回描くような動作、又は、反時計回りに円を２回描くような動作等を例示したが、それに限らず、一定時間、位置Ｒａ～Ｒｃ内に輝点２ｂを待機させておくような処理でも良い。 On the other hand, in the first to third embodiments, the operation of drawing the bright point 2b twice in the clockwise direction or the operation of drawing the circle in the counterclockwise direction twice has been described. However, the present invention is not limited to this, and a process in which the luminescent spot 2b is kept in the positions Ra to Rc for a certain period of time may be used.
　他方、第１実施形態～第３実施形態においては、光照射装置２，２Ａを用いて所定の動作を行う例を示したが、それに限らず、使用者の指、或いは、手だけを用いた所定の動作によるものでも良い。例えば、使用者が、位置Ｒａ内にあるエアコン操作盤Ｗａを指でタッチする動作をすれば、エアコンの温度を上げたり、使用者が、位置Ｒａ内にあるエアコン操作盤Ｗａに対して、指、或いは、手を用いて、円を描く動作をすれば、温度を下げたり等するようにすれば良い。そのため、第１実施形態～第３実施形態において説明した光照射装置２，２Ａを用いた認識を、使用者の指、或いは、手だけを用いた所定の動作の認識に変更するだけで良い。具体的には、カメラ３にて撮像された撮像対象物Ｗの撮像データを取得し、その撮像データのフレーム間の使用者の指、或いは、手の変化を確認するようにすれば、使用者の指、或いは、手の動作を認識できることとなる。しかして、このようにすれば、使用者の顔を認識する必要がないため、プライバシーを確保することができる。さらには、使用者の指、或いは、手の動きを認識するだけで良いため、使用する環境の影響を受けにくく、もって、処理が簡便となり、認識精度のばらつきを低減させることができる。 On the other hand, in the first to third embodiments, an example has been described in which the predetermined operation is performed using the light irradiation devices 2 and 2A. However, the present invention is not limited to this, and only the user's finger or hand is used. A predetermined operation may be used. For example, if the user performs an operation of touching the air conditioner operation panel Wa in the position Ra with a finger, the temperature of the air conditioner is raised, or the user touches the air conditioner operation panel Wa in the position Ra with the finger. Alternatively, the temperature may be reduced by performing an operation of drawing a circle using a hand. Therefore, it is only necessary to change recognition using the light irradiation devices 2 and 2A described in the first to third embodiments to recognition of a predetermined operation using only the user's finger or hand. Specifically, by acquiring image data of the imaging object W captured by the camera 3 and confirming a change in the user's finger or hand between frames of the image data, the user Of the finger or hand can be recognized. In this way, since it is not necessary to recognize the user's face, privacy can be ensured. Further, since it is only necessary to recognize the movement of the user's finger or hand, it is hardly affected by the environment in which the user is used, so that the processing is simplified and the variation in recognition accuracy can be reduced.
　一方、第１実施形態～第３実施形態においては、カメラ３にて撮像された撮像対象物Ｗのうち実在するものを対象として位置Ｒａ～Ｒｃを設定するようにしたが、プロジェクターを用いて、所定の画像を投影させ、その投影させた画像に対して位置を設定するようにしても良い。このようにすれば、タッチパネルを設置できない場所でも、バーチャルなタッチパネルを実現することができる。 On the other hand, in the first embodiment to the third embodiment, the positions Ra to Rc are set with respect to a real object among the imaging objects W imaged by the camera 3, but using the projector, A predetermined image may be projected, and a position may be set for the projected image. In this way, a virtual touch panel can be realized even in a place where a touch panel cannot be installed.
　また一方、第１実施形態～第３実施形態においては、制御装置４を一台で構築する例を示したが、勿論、処理を分散させ複数台で構築しても良い。 On the other hand, in the first to third embodiments, an example is described in which the control device 4 is constructed by one unit. However, it is needless to say that the processing may be distributed and constructed by a plurality of units.
　また、第１実施形態～第３実施形態においては、カメラ３を一台で構築する例を示したが、勿論、複数台用いても良い。 Also, in the first to third embodiments, an example in which the camera 3 is constructed by one camera has been described, but a plurality of cameras may be used.
　さらに、第１実施形態～第３実施形態の構成を適宜選択して、又は、適宜組み合わせて実施することも可能である。例えば、第２実施形態の内容を第３実施形態に組み合わせることも可能である。 Furthermore, the configurations of the first embodiment to the third embodiment can be appropriately selected, or can be implemented in combination as appropriate. For example, the contents of the second embodiment can be combined with the contents of the third embodiment.
　ところで、このような操作指示制御システムは、様々な用途に適用することができる。例えば、プレゼンテーションや、在庫管理に適用することができる。また、ロボットに光照射装置２，２Ａを備えさせ、巡回ロボット等に適用することができる。さらには、手術中の医師の頭に光照射装置２，２Ａを装着させれば、医療行為にも適用することが可能である。 By the way, such an operation instruction control system can be applied to various uses. For example, it can be applied to presentations and inventory management. Further, the robot is provided with the light irradiation devices 2 and 2A, and can be applied to a traveling robot or the like. Further, if the light irradiation devices 2 and 2A are attached to the head of the doctor during the operation, it can be applied to medical practice.
１，１Ａ，１Ｂ　操作指示制御システム
２，２Ａ　　　　光照射装置（照射手段）
２ａ　　　　　　光
２ｂ　　　　　　輝点
３　　　　　　　カメラ（撮像手段）
４　　　　　　　制御装置
５　　　　　　　操作指示装置
４０　　　　　　ＣＰＵ（位置設定手段、操作指示手段）
Ｗ　　　　　　　撮像対象物（所定対象物）
ＴＢＬ，ＴＢＬＡ，ＴＢＬＢ，ＴＢＬＣ　テーブル
Ｒａ～Ｒｃ　　　位置
  1, 1A, 1B operation instruction control system 2, 2A Light irradiation device (irradiation means)
2a light 2b bright spot 3 camera (imaging means)
4 control device 5 operation instruction device 40 CPU (position setting means, operation instruction means)
W Imaging target (predetermined target)
TBL, TBLA, TBLB, TBLC Table Ra to Rc Position

Claims (6)

  1. 　撮像手段にて撮像された所定対象物に対して、所定位置を設定する位置設定手段と、
    　前記位置設定手段にて設定された前記所定位置に対して、所定の光を照射する照射手段を用いて使用者が、該所定の光を照射し、該照射した所定の光にて所定の動作を実施すると、該所定の動作に応じた操作指示内容を所定の操作指示体に送出、又は、前記位置設定手段にて設定された前記所定位置に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた操作指示内容を所定の操作指示体に送出する操作指示手段と、を有してなる操作指示制御装置。     Position setting means for setting a predetermined position for a predetermined target imaged by the imaging means,
    The user irradiates the predetermined position set by the position setting unit with the predetermined light using an irradiating unit that irradiates a predetermined light, and performs a predetermined operation with the predetermined light. When the operation is performed, the content of the operation instruction corresponding to the predetermined operation is transmitted to a predetermined operation indicator, or the user moves his / her finger to the predetermined position set by the position setting unit, or An operation instructing unit that, when a predetermined operation is performed using only the hand, sends operation instruction contents corresponding to the predetermined operation to a predetermined operation instruction body.
  2. 　撮像手段にて撮像された所定対象物に対して、所定位置を設定する位置設定手段と、
    　前記位置設定手段にて設定された前記所定位置に対して、所定の光を照射する照射手段を用いて使用者が、該所定の光を照射し、該照射した所定の光にて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容を所定の操作指示装置に送出、又は、前記位置設定手段にて設定された前記所定位置に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容を所定の操作指示装置に送出する操作指示手段と、を有し、
    　前記所定の操作指示装置は、前記複数の操作指示内容の中から少なくとも一つの操作指示内容を所定の操作指示体に送出可能である操作指示制御装置。     Position setting means for setting a predetermined position for a predetermined target imaged by the imaging means,
    The user irradiates the predetermined position set by the position setting unit with the predetermined light using an irradiating unit that irradiates a predetermined light, and performs a predetermined operation with the predetermined light. Is performed, a plurality of operation instruction contents corresponding to the predetermined operation are transmitted to a predetermined operation instruction device, or the user moves his / her finger to the predetermined position set by the position setting means. Or, when a predetermined operation is performed using only the hand, an operation instruction unit that sends a plurality of operation instruction contents corresponding to the predetermined operation to a predetermined operation instruction device,
    The operation instruction control device, wherein the predetermined operation instruction device is capable of transmitting at least one operation instruction content from the plurality of operation instruction contents to a predetermined operation instruction body.
  3. 　前記操作指示手段は、
    　前記照射手段を用いる使用者毎に、前記所定の動作が同一であっても、異なる操作指示内容を所定の操作指示体又は所定の操作指示装置に送出してなる請求項１又は２に記載の操作指示制御装置。     The operation instruction means includes:
    3. The method according to claim 1, wherein different operation instruction contents are transmitted to a predetermined operation instruction body or a predetermined operation instruction device for each user who uses the irradiation unit, even if the predetermined operation is the same. Operation instruction control device.
  4. 　前記操作指示手段は、
    　前記照射手段を用いる使用者毎に、同一の前記操作指示内容を前記所定の操作指示体又は前記所定の操作指示装置に送出するにあたって、異なる所定の動作を実施するようにしてなる請求項１又は２に記載の操作指示制御装置。     The operation instruction means includes:
    A different predetermined operation is performed for each user who uses the irradiating means, when transmitting the same operation instruction content to the predetermined operation instruction body or the predetermined operation instruction device. 3. The operation instruction control device according to 2.
  5. 　撮像手段にて撮像された所定対象物に対して、所定位置を設定するステップと、
    　前記設定された前記所定位置に対して、所定の光を照射する照射手段を用いて使用者が、該所定の光を照射し、該照射した所定の光にて所定の動作を実施すると、該所定の動作に応じた操作指示内容を所定の操作指示体に送出、又は、前記設定された前記所定位置に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた操作指示内容を所定の操作指示体に送出するステップと、を含んでなる操作指示制御方法。     Setting a predetermined position for a predetermined target imaged by the imaging means;
    When the user irradiates the predetermined light to the set predetermined position using irradiation means for irradiating the predetermined light, and performs a predetermined operation with the irradiated predetermined light, An operation instruction content corresponding to a predetermined operation is transmitted to a predetermined operation instruction body, or a user performs a predetermined operation with only the user's finger or hand with respect to the set predetermined position. Transmitting the operation instruction content corresponding to the predetermined operation to a predetermined operation instruction body when executed.
  6. 　撮像手段にて撮像された所定対象物に対して、所定位置を設定するステップと、
    　前記設定された前記所定位置に対して、所定の光を照射する照射手段を用いて使用者が、該所定の光を照射し、該照射した所定の光にて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容を所定の操作指示装置に送出、又は、前記設定された前記所定位置に対して、使用者が使用者の指、或いは、手だけを用いて所定の動作を実施すると、該所定の動作に応じた複数の操作指示内容を所定の操作指示装置に送出するステップと、を含み、
    　前記所定の操作指示装置は、前記複数の操作指示内容の中から少なくとも一つの操作指示内容を所定の操作指示体に送出可能である操作指示制御方法。
          Setting a predetermined position for a predetermined target imaged by the imaging means;
    When the user irradiates the predetermined light to the set predetermined position using irradiation means for irradiating the predetermined light, and performs a predetermined operation with the irradiated predetermined light, A plurality of operation instruction contents corresponding to a predetermined operation are transmitted to a predetermined operation instruction device, or a user performs a predetermined operation using the user's finger or only the hand with respect to the set predetermined position. Executing the operation, sending a plurality of operation instruction contents corresponding to the predetermined operation to a predetermined operation instruction device,
    An operation instruction control method, wherein the predetermined operation instruction device can transmit at least one operation instruction content from the plurality of operation instruction contents to a predetermined operation instruction body.
PCT/JP2019/028627 2018-07-24 2019-07-22 Operation instruction control device and method therefor WO2020022254A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201980047550.XA CN112514412A (en) 2018-07-24 2019-07-22 Operation instruction control device and method thereof

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2018-138215 2018-07-24
JP2018138215 2018-07-24
JP2019129789A JP2020021473A (en) 2018-07-24 2019-07-12 Operation instruction control device and operation instruction control method
JP2019-129789 2019-07-12

Publications (1)

Publication Number Publication Date
WO2020022254A1 true WO2020022254A1 (en) 2020-01-30

Family

ID=69181670

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/028627 WO2020022254A1 (en) 2018-07-24 2019-07-22 Operation instruction control device and method therefor

Country Status (1)

Country Link
WO (1) WO2020022254A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018672A (en) * 2001-07-03 2003-01-17 Hitachi Ltd Network system
JP2003283865A (en) * 2002-03-26 2003-10-03 Matsushita Electric Ind Co Ltd Apparatus controller
JP2004166193A (en) * 2002-09-27 2004-06-10 Matsushita Electric Ind Co Ltd Remote control device
JP2007088835A (en) * 2005-09-22 2007-04-05 Victor Co Of Japan Ltd Apparatus control unit
JP2009037434A (en) * 2007-08-02 2009-02-19 Tokyo Metropolitan Univ Control equipment operation gesture recognition device; control equipment operation gesture recognition system, and control equipment operation gesture recognition program
JP2015080265A (en) * 2014-12-24 2015-04-23 株式会社東芝 Apparatus selection system, apparatus selection device, and apparatus selection program
JP2016076061A (en) * 2014-10-06 2016-05-12 三菱電機株式会社 Operation input device

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2003018672A (en) * 2001-07-03 2003-01-17 Hitachi Ltd Network system
JP2003283865A (en) * 2002-03-26 2003-10-03 Matsushita Electric Ind Co Ltd Apparatus controller
JP2004166193A (en) * 2002-09-27 2004-06-10 Matsushita Electric Ind Co Ltd Remote control device
JP2007088835A (en) * 2005-09-22 2007-04-05 Victor Co Of Japan Ltd Apparatus control unit
JP2009037434A (en) * 2007-08-02 2009-02-19 Tokyo Metropolitan Univ Control equipment operation gesture recognition device; control equipment operation gesture recognition system, and control equipment operation gesture recognition program
JP2016076061A (en) * 2014-10-06 2016-05-12 三菱電機株式会社 Operation input device
JP2015080265A (en) * 2014-12-24 2015-04-23 株式会社東芝 Apparatus selection system, apparatus selection device, and apparatus selection program

Similar Documents

Publication Publication Date Title
US20190129607A1 (en) Method and device for performing remote control
JP6372487B2 (en) Information processing apparatus, control method, program, and storage medium
JP2016048541A (en) Information processing system, information processing device, and program
KR20140088768A (en) Method for operating for camera an electronic device thereof
JP6307889B2 (en) Display device, display system, and display method
JP6770502B2 (en) Communication devices, display devices, their control methods, programs and display systems
JP2011192081A (en) Information processing apparatus and method of controlling the same
KR20190024228A (en) Home automation system using real-time indoor image
US20170003769A1 (en) Image display device, image display control method, and image display system
TW201426401A (en) Somatosensory household electrical products control equipment and its system
JP2011054162A (en) Interactive information control system and program
WO2020022254A1 (en) Operation instruction control device and method therefor
JP4296607B2 (en) Information input / output device and information input / output method
US20200184222A1 (en) Augmented reality tools for lighting design
JP2020021473A (en) Operation instruction control device and operation instruction control method
JP2018129764A (en) Funeral content image projection system, funeral content image projection method, and program for use therein
US20220244788A1 (en) Head-mounted display
WO2013097556A1 (en) Method for controlling visual light sources, terminals and video conference system
JP2015052895A (en) Information processor and method of processing information
JP2013218423A (en) Directional video control device and method
JP2016225875A (en) Travel apparatus operation terminal, travel apparatus operation method and travel apparatus operation program
CN107924272B (en) Information processing apparatus, information processing method, and program
JP6646843B2 (en) Lighting management terminal and lighting management method
JP2019117322A (en) Projection type display unit, method of controlling the same, and program
CN108174171A (en) A kind of projecting apparatus with speaker

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19842245

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19842245

Country of ref document: EP

Kind code of ref document: A1