WO2022075134A1 - Information processing device, information processing method, and information processing program - Google Patents

Information processing device, information processing method, and information processing program Download PDF

Info

Publication number
WO2022075134A1
WO2022075134A1 PCT/JP2021/035785 JP2021035785W WO2022075134A1 WO 2022075134 A1 WO2022075134 A1 WO 2022075134A1 JP 2021035785 W JP2021035785 W JP 2021035785W WO 2022075134 A1 WO2022075134 A1 WO 2022075134A1
Authority
WO
WIPO (PCT)
Prior art keywords
state
setting
subject
information processing
image pickup
Prior art date
Application number
PCT/JP2021/035785
Other languages
French (fr)
Japanese (ja)
Inventor
一也 仙頭
明 竹尾
Original Assignee
ソニーグループ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーグループ株式会社 filed Critical ソニーグループ株式会社
Priority to JP2022555390A priority Critical patent/JPWO2022075134A1/ja
Publication of WO2022075134A1 publication Critical patent/WO2022075134A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/38—Releasing-devices separate from shutter
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B7/00—Control of exposure by setting shutters, diaphragms or filters, separately or conjointly
    • G03B7/08—Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
    • G03B7/091—Digital circuits
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules

Definitions

  • This technology relates to information processing devices, information processing methods, and information processing programs.
  • Patent Document 1 When shooting with a camera, there is a demand to change the shooting method and camera settings to appropriate ones according to the movement and condition of the subject. Therefore, a technique has been proposed that can realize continuous shooting linked to the movement of a target person (Patent Document 1).
  • Patent Document 1 it is necessary to recognize the subject to be photographed by face recognition in advance, and the camera setting that can be changed is only whether or not continuous shooting is performed. It cannot be applied to various shooting applications.
  • This technology was made in view of these points, and is an information processing device, an information processing method, and an information processing device that enables the setting of an image pickup device to be changed according to the state of the subject by generating a trigger according to the state of the subject.
  • the purpose is to provide an information processing program.
  • the first technique is that a state determination unit that determines whether or not the state of the subject has reached a predetermined pre-state, and a state determination unit that the state of the subject has reached the pre-state.
  • a state determination unit that determines whether or not the state of the subject has reached a predetermined pre-state
  • a state determination unit that the state of the subject has reached the pre-state.
  • it is an information processing device including a trigger processing unit that generates a trigger for changing the setting of the image pickup device.
  • the second technique determines whether or not the state of the subject has reached a predetermined pre-state, and when it is determined that the state of the subject has reached the pre-state, a trigger for changing the setting of the image pickup apparatus is generated. It is an information processing method.
  • the third technique determines whether or not the state of the subject has reached a predetermined pre-state, and when it is determined that the state of the subject has reached the pre-state, a trigger for changing the setting of the image pickup apparatus is generated. It is an information processing program that causes a computer to execute an information processing method.
  • Embodiment> [1-1. Configuration of image pickup device 100] [1-2. Configuration of information processing device 200] [1-3. Processing by information processing device 200] [1-3-1. Example of generating a trigger once] [1-3-2. Example of generating a trigger multiple times] [1-3-3. User interface] ⁇ 2. Modification example>
  • the configuration of the image pickup apparatus 100 will be described with reference to FIG.
  • the image pickup device 100 includes a lens block 110, an image sensor block 120, an image processing circuit 130, an image compression / decompression circuit 140, an image data bus 150, an image RAM (Random Access Memory) 160, a storage block 170, a display block 180, and a control unit. It is configured to include 190, a lens information discrimination circuit 191, an input unit 192, an interface 193, a speaker 194, a microphone 195, and an information processing device 200.
  • the lens block 110 controls a lens 111 including an optical lens for concentrating light from a subject on an image sensor 121 and a focus lens for focusing, a lens drive driver 112 for moving the lens 111, and a focus lens. It is configured to include a focus lens control circuit 113, an optical lens control circuit 114 for controlling an optical lens, and an optical lens storage device 115.
  • the optical lens storage device 115 stores individual information of the lens, for example, parameters such as the relationship between the zoom position and the focal length, and the relationship between the focus position and the shooting distance.
  • the optical image of the subject obtained through the lens block 110 is imaged on the image sensor 121 of the image sensor block 120.
  • the image sensor 121 included in the image sensor block 120 photoelectrically converts the incident light from the subject obtained through the lens 111 into an electric charge amount and outputs an image pickup signal. Then, the image sensor 121 outputs the pixel signal to the image processing circuit 130.
  • a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like is used as the image sensor 121.
  • the image sensor block 120 may include an image sensor driver 122 that physically drives the image sensor 121 and also serves as a camera shake correction unit, and an image sensor control circuit 123 for controlling the image sensor 121.
  • the image processing circuit 130 converts the image signal output from the image sensor 121 into digital data (RGB creation / bit conversion, etc.), various detection processes from the digitized image data, and image quality for the image data. Performs correction processing (gain correction, white balance, etc.), aspect conversion processing, etc.
  • the image pickup apparatus 100 may be provided with a plurality of image processing circuits 130 in order to improve the processing speed.
  • the image compression / decompression circuit 140 receives the image data output from the image processing circuit 130 via the image RAM 160, compresses and encodes it, and then outputs it to the storage unit 171 as a moving image or still image data file.
  • MPEG Motion Picture Experts Group
  • JPEG Joint Photographic Experts Group
  • the image pickup apparatus 100 may include a plurality of image compression / decompression circuits 140 in order to improve the processing speed.
  • the image data bus 150 is a bus for transmitting and receiving image data.
  • the image RAM 160 is for supplying image data to the image processing circuit 130, the image compression / decompression circuit 140, and the information processing apparatus 200 connected via the image data bus 150.
  • a plurality of image RAMs 160 may be provided in order to improve the processing speed.
  • the storage block 170 is composed of a storage unit 171 and a storage unit control circuit 172.
  • the storage unit 171 stores the image data finally generated through each processing circuit, and the storage device control circuit stores and reads out the image data in the storage unit 171.
  • the storage unit 171 is composed of a drive device for a portable recording medium such as a magnetic tape or an optical disk, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like.
  • the storage unit 171 may be built in the image pickup apparatus 100, or may be externally connected by wire or wirelessly.
  • the image pickup apparatus 100 may include a plurality of storage units 171 in order to store different formats for in-line / offline processing and to improve processing speed and reliability.
  • the display block 180 is composed of a display unit 181 and a display unit control circuit 182.
  • the display unit 181 displays image data, a through image, a GUI (Graphical User Interface), etc. finally generated through each processing circuit, and the display unit control circuit 182 controls the display. ..
  • the display unit 181 is realized by, for example, a monitor display composed of an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro Luminescence) panel, or an EVF (Electronic View Finder). To. There may be a plurality of different settings so that a through image without aspect conversion and a completed image after aspect conversion processing can be confirmed at the same time.
  • the display unit 181 may be an external device externally attached to the image pickup device 100 by a wired or wireless connection.
  • the control unit 190 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like.
  • the CPU executes various processes according to the program stored in the ROM and issues commands to control the entire image pickup apparatus 100 and each part thereof. In addition, based on the detection information, autofocus, correction control of auto-exposure processing, calculation of correction processing control value, and the like are also performed.
  • the lens information discrimination circuit 191 is a circuit for discriminating and determining the mounted lens, assuming an interchangeable lens camera.
  • the lens information discrimination circuit 191 is not an essential configuration.
  • the input unit 192 is for the photographer (user) to input various instructions to the image pickup apparatus 100.
  • a control signal corresponding to the input is generated and supplied to the control unit 190.
  • the control unit 190 performs various processes corresponding to the control signal.
  • the input unit 192 includes a release button for instructing a release, a physical button for various operations, a touch panel, a touch screen integrally configured with the display unit 181 and the like.
  • Interface 193 is an interface between other devices and the Internet.
  • Interface 193 may include a wired or wireless communication interface. More specifically, the wired or wireless communication interface is cellular communication such as 3TTE, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), Wi-Fi, Bluetooth (registered trademark). ), NFC (Near Field Communication), Ethernet (registered trademark), HDMI (registered trademark) (High-Definition Multimedia Interface), USB (Universal Serial Bus) and the like.
  • the interface 193 may include a connection terminal between the devices, a bus in the device, and the like.
  • the interface 193 may include different types of interfaces for each device.
  • interface 193 may include both a communication interface and an in-device interface.
  • the speaker 194 is a voice output device used for voice notification to the photographer.
  • the microphone 195 is a sound collecting device for recording the sound at the time of shooting.
  • the image pickup device 100 is configured as described above.
  • the image pickup apparatus 100 includes a digital camera, a single-lens reflex camera, a camcorder, a professional camera, a professional photography device, and the like.
  • the information processing apparatus 200 includes a state determination unit 201, a trigger processing unit 202, a setting change processing unit 203, and a notification processing unit 204.
  • the state determination unit 201 recognizes the current state of the subject to be photographed from the image generated by the image pickup apparatus 100, and determines whether or not the state of the subject has reached the pre-state.
  • the state determination unit 201 determines whether or not the current state of the subject has reached the prior state depending on whether or not the determination value indicating the degree of coincidence between the current state of the subject and the prior state exceeds the threshold value. Details of the prior state and the state determination will be described later.
  • As the subject recognition technology a method by machine learning or deep learning, a method by template matching, a matching method based on the brightness distribution information of the subject, a method based on the color contained in the image, the feature amount of the human face, etc., and artificial intelligence are used. A method or the like may be used. Further, these methods may be combined to improve the recognition accuracy.
  • the state determination unit 201 may be configured by an AI dedicated circuit for advanced image determination.
  • the trigger processing unit 202 generates a trigger that triggers the setting change of the image pickup apparatus 100 by the setting change processing unit 203 based on the determination result of the state determination unit 201.
  • the setting change processing unit 203 performs a process of changing the setting of the image pickup apparatus 100.
  • the setting change processing unit 203 performs a process of changing the setting of the image pickup apparatus 100 after a predetermined time (adjustment time) elapses from the occurrence of the trigger to the process of changing the setting of the image pickup apparatus 100.
  • a predetermined time elapses from the occurrence of the trigger to the process of changing the setting of the image pickup apparatus 100.
  • the details of the adjustment time will be described later.
  • the setting change processing unit 203 performs the setting change processing by, for example, transmitting a control signal instructing the setting change to the image pickup apparatus 100 together with information indicating the type of the parameter to be changed to the image pickup apparatus 100 and the value after the change.
  • the settings to be changed include, for example, F value, shutter speed, ISO, white balance, activation of continuous shooting mode, continuous shooting speed, AF frame position, focus position, etc., but other settings can be changed in the image pickup device 100. Any parameter can be used.
  • the photographer needs to set in advance the setting contents (which parameter is changed to what value) of the image pickup apparatus 100 to be changed by the processing of the setting change processing unit 203.
  • the setting contents may be set by the photographer by inputting specific parameters and their values, or the information processing apparatus 200 may set the information processing device 200 based on a predetermined template or algorithm corresponding to the shooting target or the type of subject. It may be set automatically.
  • the notification processing unit 204 uses the display unit 181 and the like provided in the image pickup device 100 to perform various notification processes for changing the settings of the image pickup device 100 to the photographer.
  • the information processing device 200 is configured as described above.
  • the information processing device 200 may be configured as a dedicated device by hardware having the function. Further, the information processing device 200 is not only configured as a dedicated device but also configured by a program, and the image pickup device 100 may be provided with a function as the information processing device 200 by executing the program.
  • the program may be installed in the image pickup apparatus 100 in advance, or may be distributed by download or storage medium so that the photographer can install the program in the image pickup apparatus 100 by himself / herself.
  • the period during which the subject runs a short distance is divided into time 0 to time 6.
  • the subject who is the runner takes a start posture with his / her hand on the ground at the start position as shown in time 1.
  • the posture gradually rises as shown in time 3.
  • the sprinter continues to run in the state of standing up as shown in time 4, reaches the goal as shown in time 5, and the sprint ends in time 6.
  • the period from time 0 to time 6 is defined as the shooting period.
  • the setting of the image pickup apparatus 100 is set to the setting A from the state of the time 0 to the state of the time 3, and the state of the subject (the state to be photographed) at the time 4 is set to the setting B for shooting. Therefore, the information processing device 200 changes the image pickup device 100 to the setting B before the subject is in the shooting target state at time 4.
  • FIG. 3 is an example in which the trigger is generated once during the shooting period and the setting of the image pickup apparatus 100 is changed once.
  • the state determination unit 201 determines whether or not the state of the subject has reached the state before the shooting target state of time 4 (preliminary state), and trigger processing when the current state of the subject has reached the pre-state.
  • the unit 202 generates a trigger that triggers a setting change.
  • the setting change processing unit 203 changes the image pickup apparatus 100 from the setting A to the setting B after the adjustment time has elapsed since the trigger was generated and before the subject is in the shooting target state at the time 4.
  • the photographer can shoot the shooting target state of the subject in the setting B. Therefore, it is necessary to specify in advance which state of the subject the prior state is.
  • the pre-state is the state of the subject before the state to be photographed, which is the state to be photographed using the image pickup apparatus 100.
  • the prior state can be specified by using an image of a specific subject taken in the past or using it. In the case of sprinting, for example, it is advisable to take a picture of a state of practice in advance or a short-distance running of a runner other than the subject to obtain an image in which the state is set in advance.
  • the information processing apparatus 200 holds a plurality of images and information indicating the prior state in advance as templates, and the photographer specifies the type of the subject and the type of the scene to specify the prior state from the templates. You may do so.
  • the prior state is a numerical value such as the moving speed of the subject, the photographer can specify the prior state by inputting a specific numerical value.
  • the adjustment time is the time from the occurrence of the trigger to the process of changing the setting of the image pickup apparatus 100, and is set in advance. It can be said that the adjustment time is the time for adjusting the length from the setting of the image pickup apparatus 100 to the shooting timing (the subject is in the shooting target state).
  • the adjustment time is 0 seconds or more, and the photographer can set it to an arbitrary length.
  • an assist mode a mode in which the information processing device 200 automatically changes the setting of the image pickup device 100 in order to shoot the state to be photographed is referred to as an assist mode.
  • shooting is performed with setting A from the state of time 0 to before time 4, but this changes the setting of the image pickup apparatus 100 from setting X to setting A at the timing when the assist mode is turned on. Just leave it.
  • step S101 the assist mode in which the information processing apparatus 200 operates in response to an input from the photographer is turned on.
  • the setting is set to A by the image pickup apparatus 100.
  • step S102 the state determination unit 201 starts the state determination of the subject.
  • the state determination unit 201 continues to determine the state while the assist mode is on.
  • the setting change processing unit 203 needs to change the setting of the image pickup apparatus 100 to the setting B before the subject becomes the shooting target state at time 4. For that purpose, it is necessary to set the state before the state of the subject becomes the shooting target state of time 4 (the state of time 3 in the present embodiment) as the pre-state, and determine whether or not the subject has been in the pre-state. ..
  • the state determination unit 201 recognizes the current state of the subject to be photographed from the image generated by the image pickup apparatus 100, and compares the current state of the subject with the prior state. Then, when the determination value indicating the degree of coincidence between the current state of the subject and the prior state exceeds the threshold value, it is determined that the current state of the subject has reached the prior state. Then, when it is determined that the current state of the subject has reached the prior state, the state determination unit 201 supplies the determination result to the trigger processing unit 202.
  • the comparison between the current motion of the subject and the motion as the prior state is performed based on the posture of the subject, the speed of the motion, the acceleration of the motion, the trajectory of the motion, the voice, the vibration, and the like. be able to.
  • the determination value in the state determination indicates the degree of matching between the current posture of the subject and the posture in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current operation of the subject is the operation in the prior state.
  • the degree of coincidence between the current posture of the subject and the posture in the pre-state is, for example, a known image comparison method using machine learning, deep learning, etc., for an image of the current posture of the subject and an image showing the posture of the pre-state. Can be obtained more.
  • the judgment value in the state judgment indicates the degree of coincidence between the current speed of the subject and the speed in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current operation of the subject is the operation in the prior state.
  • the degree of agreement between the current speed of the subject and the speed in the prior state can be obtained by, for example, calculating the moving speed based on the frame rate of shooting and the moving distance of the subject between a plurality of frames, and comparing them. can.
  • the determination value in the state determination indicates the degree of coincidence between the trajectory of the current motion of the subject and the trajectory of the motion in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the locus of the current operation of the subject matches the locus of the operation in the prior state.
  • the degree of coincidence of motion trajectories can be obtained, for example, by comparing or tracing a line segment showing the motion trajectory of a specific part of the body of the subject.
  • the judgment value in the state judgment indicates the degree of coincidence between the current sound of the subject and the sound in the prior state.
  • the degree of coincidence of sounds can be determined, for example, by comparing the frequency, loudness (dB), and voice waveforms.
  • the sound at the time of shooting can be acquired by the microphone 195.
  • the judgment value in the state judgment indicates the degree of agreement between the current vibration of the subject and the vibration in the prior state.
  • the degree of coincidence of vibrations can be determined, for example, by comparing the frequency, amplitude, and period of vibrations.
  • the state may be determined by combining a plurality of the above-mentioned postures, speeds, accelerations, loci, voices, and vibrations and comparing the movements of the subject with the movements as the prior state.
  • the threshold can be set arbitrarily.
  • the photographer may input a specific value to set a threshold value, or the photographer inputs a reference such as upper / middle / lower, and the information processing apparatus 200 sets the threshold value according to the input reference.
  • the threshold value may be set automatically.
  • the information processing apparatus 200 may set a threshold value based on an algorithm or the like.
  • the threshold value may be set by inputting an image or a video corresponding to the threshold value in addition to the input of the value or the reference.
  • the judgment value increases as the subject reaches the start position of the sprint, starts running, and the posture rises, and the movement of the subject gradually approaches the movement in the pre-state of time 3. .
  • the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the operation of the subject is the operation in the prior state of the time 3.
  • the prior state is not limited to the state immediately before the shooting target state.
  • the state of the time 1 before the time 3 can be set as the pre-state.
  • the time from the trigger generation to the shooting target state becomes longer. Therefore, for example, a notification to the photographer that "change the setting" is made during that time.
  • the photographer can calmly take a picture by knowing that the setting is changed. Since any state can be set to the pre-state as long as the time is before the state to be photographed, the state of time 2 can be set to the pre-state.
  • the state of the subject has become the pre-state is not limited to an exact match, but may be a similar state including a deviation.
  • the degree of deviation allowed in the state determination can be adjusted by setting the threshold value. If the threshold value is increased, it is determined that the current state of the subject has become the prior state with less deviation than when the threshold value is low. On the other hand, if the threshold value is lowered, it is determined that the current state of the subject has become the prior state in a state including a large amount of deviation as compared with the case where the threshold value is high.
  • step S104 if a certain time has not elapsed since the assist mode was turned on in step S103, the process proceeds to step S104 (No in step S103).
  • step S104 determines in step S104 that the determination value is equal to or greater than the threshold value
  • the process proceeds to step S105 (Yes in step S104).
  • step S105 the trigger processing unit 202 generates a trigger.
  • step S106 when the adjustment time has elapsed after the trigger is generated, the process proceeds to step S107 (Yes in step S106). Then, in step S107, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 from the setting A to the setting B.
  • the adjustment time can be set to any length with 0 seconds or more. It is generally desirable to adjust the adjustment time according to the shooting technique of the photographer.
  • the margin time which is the time from the change of the setting of the image pickup apparatus 100 to the state to be shot.
  • the setting is not changed until just before the subject is in the shooting target state, and shooting can be performed with the setting A until just before the subject is in the shooting target state. Since the shooting technique is high, it is considered that shooting can be performed even if the setting of the image pickup apparatus 100 is changed immediately before the shooting target state.
  • the length of the adjustment time may be determined according to the type of the setting before the change and the setting after the change. For example, it is assumed that the setting B is a mode in which the power consumption is larger than that of the setting A because the image sensor 121, the lens 111, and the like are continuously driven for autofocus. In this case, it is possible to suppress the power consumption by lengthening the adjustment time and lengthening the time in which the image pickup apparatus 100 is in the state of the setting A (shortening the time in the setting B).
  • the adjustment time can be set to 0 seconds.
  • the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting B at the same time as the timing when the trigger processing unit 202 generates the trigger.
  • the length of the adjustment time is determined in advance and set in the information processing apparatus 200 by referring to the practice performed in advance and the past short-distance run.
  • a table corresponding to a plurality of criteria such as large, medium, and small and a plurality of adjustment time lengths is held in advance in the information processing apparatus 200, and the criteria are presented to the photographer to select one.
  • the length of the adjustment time may be determined based on the selected criteria. This is mainly effective for amateur photographers who do not have high shooting skills.
  • step S108 when a certain time has elapsed after changing the setting of the image pickup apparatus 100, the process proceeds to step S109 (Yes in step S108).
  • step S109 the setting of the image pickup apparatus 100 is returned to the setting X which is the setting before changing in the assist mode.
  • the process of returning to the setting before the change in the assist mode in step S109 is not an essential process, and the setting may or may not be returned.
  • step S110 the assist mode is turned off and the process ends.
  • step S103 If a certain period of time has passed in step S103, the process proceeds to step S108, the assist mode is turned off, and the process ends. This terminates the assist mode on the assumption that if a certain period of time elapses after the state determination is started and before the determination value becomes equal to or higher than the threshold value, the desired state that the photographer wants to shoot is not reached.
  • the movement of the subject is regarded as the state of the subject, but in addition, the posture of the subject, the speed and position of the subject, the position of a specific part of the body, and the like can be processed as the state of the subject. Further, it is also possible to process the combination as the state of the subject.
  • the posture of the subject by setting the posture of the subject to the posture of the subject, it is possible to change the setting of the image pickup apparatus 100 by generating a trigger at the timing when the posture of the subject is in the pre-state before the posture of the subject is in the shooting target state. can.
  • the photographer can shoot a state in which the subject is in the posture of the shooting target state with the setting of the specific imaging device 100.
  • the judgment value in the state determination indicates the degree of coincidence between the current posture of the subject and the posture in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current posture of the subject has become the posture in the prior state.
  • the degree of agreement between the current posture of the subject and the posture in the prior state can be obtained by a known image comparison method using machine learning, deep learning, or the like.
  • the judgment value in the state determination indicates the degree of coincidence between the current speed of the subject and the speed in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current speed of the subject has reached the speed in the prior state.
  • the degree of agreement between the current speed of the subject and the speed in the prior state can be obtained by, for example, calculating the speeds based on the frame rate of shooting and the moving distance of the subject between a plurality of frames and comparing them.
  • the setting of the image pickup apparatus 100 can be changed at the timing when the position of the pre-state before the subject reaches the position of the shooting target state.
  • the photographer can take a picture of the state in which the subject has reached the position of the picture target state with the setting of the specific image pickup device 100.
  • the determination value in the state determination indicates, for example, the degree of coincidence between the current position of the subject and the position of the prior state within the angle of view. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current position of the subject has reached the position in the prior state.
  • the degree of coincidence between the current position of the subject and the position in the prior state can be obtained, for example, by comparing the current coordinates of the subject within the angle of view with the coordinates in the prior state.
  • the image pickup apparatus 100 reaches the position of the pre-state before the part of the body of the subject reaches the position of the shooting target state. You can change the settings. As a result, the photographer can take a picture of the state in which the body part of the subject reaches the position of the picture target state with the setting of the specific image pickup device 100.
  • the judgment value in the state determination indicates the degree of agreement between the current head height and the head height in the prior state. Is. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current head height of the subject has reached the head height in the prior state.
  • the degree of agreement between the height of the head of the subject and the height of the head in the prior state can be obtained, for example, by comparing the coordinates of the current head position within the angle of view with the coordinates of the head position in the prior state.
  • the movement immediately after the start of the subject at time 2 is shot at setting B as the shooting target state B, and the movement of the subject at time 4 rising up and running is shot.
  • An example is a case where the setting of the image pickup apparatus 100 is changed so that the operation after the goal of the time 6 is taken with the setting C as the target state C and the operation after the goal of the time 6 is taken with the setting D as the shooting target state D.
  • the trigger processing unit 202 generates the trigger B when the state of the subject becomes the pre-state B in order to change the image pickup apparatus 100 to the setting B for the shooting of the shooting target state B at the time 2. After that, in order to change the image pickup apparatus 100 to the setting C for the shooting of the shooting target state C at time 4, the trigger processing unit 202 generates the trigger C when the state of the subject becomes the prior state C. After that, in order to change the image pickup apparatus 100 to the setting D for shooting in the shooting target state D at time 6, the trigger processing unit 202 generates a trigger D when the state of the subject becomes the prior state D.
  • the setting of the image pickup apparatus 100 is changed three times after the trigger is generated three times, but the number of times is merely an example, and the number of times the trigger is generated and the number of times the setting is changed is one or more. It may be times.
  • the state determination unit 201 uses the determination value for each pre-state and the threshold value for each pre-state to determine whether or not the current state of the subject has reached each pre-state for the generation of each trigger. To judge. In order to change the setting of the image pickup apparatus 100 multiple times within the shooting period, it is necessary to specify a plurality of pre-states, but it is also necessary to specify the order of the plurality of pre-states.
  • the determination method by the state determination unit 201 is the same as the case where the above-mentioned setting is changed once.
  • the determination value indicating the degree of agreement between the current state of the subject and the prior state B is defined as the determination value B
  • the threshold value for determining that the current state of the subject has reached the prior state B is defined as the threshold value B.
  • the determination value indicating the degree of coincidence between the current state of the subject and the prior state C is defined as the determination value C
  • the threshold value for determining that the current state of the subject has reached the prior state C is defined as the threshold value C.
  • the determination value indicating the degree of coincidence between the current state of the subject and the prior state D is set as the determination value D
  • the threshold value for determining that the current state of the subject is in the prior state D is set as the threshold value D.
  • the method of specifying the prior state is the same as the method described in the above-mentioned example of generating the trigger once.
  • step S201 the assist mode in which the information processing apparatus 200 operates according to the input from the photographer is turned on. At the same time when this assist mode is turned on, the setting is set to A by the image pickup apparatus 100.
  • step S202 the state determination unit 201 starts the state determination of the subject.
  • step S203 it is confirmed whether or not the latest pre-state is the pre-state B. If the latest pre-state is the pre-state B, the process proceeds to step S204 (Yes in step S203).
  • step S204 if a certain time has not elapsed since the assist mode was turned on, the process proceeds to step S205 (No in step S204).
  • step S204 If a certain period of time has elapsed in step S204, the setting of the image pickup apparatus 100 is changed to the setting X before the change in step S210 without generating the trigger B, and the assist mode is turned off in step S211. And the process ends.
  • step S205 determines in step S205 that the determination value is equal to or greater than the threshold value B
  • the process proceeds to step S206 (Yes in step S205).
  • step S206 the trigger processing unit 202 generates the trigger B.
  • step S207 if the adjustment time has elapsed after the occurrence of trigger B, the process proceeds to step S208 (Yes in step S207). Then, in step S208, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting B.
  • step S209 if all the settings have not been changed yet, the process proceeds to step S203 (No in step S209).
  • step S203 Since the state of the subject became the pre-state B and the trigger B was generated to change the image pickup apparatus 100 to the setting B, the next pre-state is the pre-state C. Therefore, the process proceeds from step S203 to step S213 (No in step S203).
  • step S213 it is confirmed whether or not the latest pre-state is the pre-state C.
  • the process proceeds to step S214 (Yes in step S213).
  • step S214 if a certain time has not elapsed since the assist mode was turned on, the process proceeds to step S215 (No in step S214).
  • step S214 If a certain period of time has elapsed in step S214, the setting of the image pickup apparatus 100 is changed to the setting X before the change in step S219 without generating the trigger C, and the assist mode is turned off in step S220. And the process ends.
  • step S215 determines in step S215 that the determination value is equal to or higher than the threshold value C
  • the process proceeds to step S216 (Yes in step S215).
  • step S216 the trigger processing unit 202 generates the trigger C.
  • step S217 if the adjustment time has elapsed after the occurrence of trigger B, the process proceeds to step S218 (Yes in step S207). Then, in step S218, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting C.
  • step S209 if all the settings have not been changed yet, the process proceeds to step S203 (No in step S209).
  • step S203 proceeds from step S213 (No in step S203), and proceeds from step S213 to step S221 (No in step S213).
  • step S221 if a certain time has not elapsed since the assist mode was turned on, the process proceeds to step S222 (No in step S221).
  • step S221 If a certain period of time has elapsed in step S221, the setting of the image pickup apparatus 100 is changed to the setting X before the change in step S226 without generating the trigger D, and the assist mode is turned off in step S227. And the process ends.
  • step S222 determines in step S222 that the determination value is equal to or greater than the threshold value D
  • the process proceeds to step S223 (Yes in step S222).
  • step S223 the trigger processing unit 202 generates the trigger D.
  • step S224 if the adjustment time has elapsed after the trigger D has occurred, the process proceeds to step S225 (Yes in step S224). Then, in step S225, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting D.
  • step S209 if all the settings have been changed in step S209, the process proceeds to step S228 (Yes in step S209).
  • step S2208 After that, when a certain time has elapsed after the last setting change in step S228, the process proceeds to step S229 (Yes in step S228).
  • step S229 return to the setting X, which is the setting before changing in the assist mode. Then, in step S230, the assist mode is turned off and the process ends.
  • step S210 the process of returning to the setting before the change in the assist mode in step S210, step S219, step S226 and step S229 is not an essential process, and the setting may or may not be returned.
  • the setting of the image pickup apparatus 100 was set to the setting A at the timing when the assist mode was turned on, and the setting of the image pickup apparatus 100 was changed from the setting A to the setting B after the trigger was generated.
  • the release instruction for shooting is performed based on the input of the photographer to the input unit 192 of the image pickup apparatus 100. It may be done automatically or it may be done automatically.
  • the release may be automatically performed based on the subject recognition result, or the release may be automatically performed at the timing when a predetermined time has elapsed after the trigger is generated or the setting of the image pickup apparatus 100 is changed. Further, the release may be a remote input from an external device instead of the image pickup device 100 itself.
  • shooting is automatically performed, if the image pickup device 100 has an automatic shooting function, it may be used, or a control signal instructing the image pickup device 100 to shoot is transmitted from the information processing device 200.
  • the information processing apparatus 200 may perform the automatic shooting process.
  • the content of the notification includes the type of setting of the image pickup device 100, the current setting status of the image pickup device 100, the notice that the setting change of the image pickup device 100 is performed, and the like.
  • FIG. 13 As a notification method, for example, as shown in FIG. 13, there is a method of superimposing the frame 301 on the through image displayed on the display unit 181 of the image pickup apparatus 100.
  • the color of the frame 301 may be different for each setting type as shown in FIGS. 13A to 13D.
  • FIG. 13A shows the setting A
  • FIG. 13A shows the setting B
  • FIG. 13A shows the setting C
  • FIG. 13D shows the setting D.
  • the frame 301 by continuing the lighting state of the frame 301, it is notified that the image pickup apparatus 100 is currently operating with the setting represented by the above-mentioned color. This notification may be given from the time when the setting of the image pickup apparatus 100 is changed, and may be continuously given while the image pickup apparatus 100 is operating with the changed setting. Further, by blinking the frame 301, a notice is given to the effect that the setting of the image pickup apparatus 100 is changed. This notice may be given at any timing between the trigger generation and the setting change process of the image pickup apparatus 100.
  • FIG. 14 there is also a notification method in which the icon 302 is superimposed and displayed on the through image displayed on the display unit 181 of the image pickup apparatus 100.
  • the type of setting is notified by the characters and symbols included in the icon 302, and the imaging device 100 is currently operating with the settings represented by the characters and symbols of the icon 302 by keeping the lighting state of the icon 302. Notify and notify that the setting of the image pickup apparatus 100 is changed by blinking the icon 302.
  • the notification may be not only the display on the display unit 181 but also the voice notification using the voice output of the speaker 194 by the image pickup apparatus 100. Further, when the image pickup apparatus 100 has a vibration function, a notification using vibration may be used. Further, when the image pickup apparatus 100 includes a light emitting body such as an LED, notification using the light emission may be used. When changing the settings multiple times, the type of sound, the type of vibration, and the type of light emission should be different for each setting.
  • the photographer may be notified of the timing when the setting of the image pickup apparatus 100 should be changed.
  • the photographer who confirms the notification changes the setting of the image pickup apparatus 100 by inputting an input instructing the image pickup apparatus 100 to change the setting.
  • This notification may be the same method as the above-mentioned notice notification that the setting of the image pickup apparatus 100 is changed, or may be a different method.
  • the icon is not superimposed on the live view display 401 or the operation panel display 402. 302 may be displayed. As a result, a part of the display is not hidden by the icon 302.
  • 16 and 17 are examples of a user interface for specifying a prior state, which is displayed on the display unit 181 for specifying the prior state.
  • the user interface for specifying the prior state has a hierarchical structure composed of a shooting target and a type of subject.
  • the photographer inputs the setting parameters of the image pickup apparatus 100 (shutter speed, ISO, F value, focus position, white balance, etc. in FIG. 16A) to be changed when it is determined that the state of the subject has reached the pre-state.
  • the setting parameters of the image pickup apparatus 100 shutter speed, ISO, F value, focus position, white balance, etc. in FIG. 16A
  • the sports type and scene and the settings of the image pickup device 100 are combined in advance as shown in FIG. 16B, and the settings are combined in advance.
  • the photographer may be able to specify an arbitrary prior state by presenting it on the state specifying user interface.
  • the image pickup apparatus 100 and the information processing apparatus 200 may recognize the state of a characteristic subject in the sport and specify the pre-state.
  • the image pickup device 100 and information processing are performed.
  • the device 200 may recognize the state of a characteristic subject in the shooting target and specify the pre-state.
  • the image pickup device can be automatically changed to the setting suitable for the shooting before the subject is in the shooting target state, regardless of the photographer's ability such as dynamic visual acuity, motor ability, and shooting technique. , It is possible to shoot with the optimum settings.
  • the setting of the image pickup device 100 that can be changed is not limited to a specific one, the setting of the image pickup device 100 can be widely changed according to various shooting conditions such as the type of subject.
  • the information processing device 200 is not limited to the image pickup device 100, and can be used in any device having a camera function such as a smartphone, a personal computer, a tablet terminal, a portable game machine, and a wearable device.
  • the information processing device 200 may operate in a server or a cloud. In that case, the information processing device 200 determines the state using the captured image received from the image pickup device 100 via the network, and transmits the control information instructing the setting change to the image pickup device 100 via the network to change the setting. Perform processing.
  • the state determination unit 201 may perform state determination based on the state of the subject in a part of the angle of view of the image pickup apparatus 100. For example, if the subject changes its behavior but is located on the right side of the angle of view without changing its position, the angle of view is divided into left and right areas from the center, and the state is judged only by the captured image in the right area. And so on. As a result, it is possible to make the processing lighter than performing the state determination on the captured image of the entire angle of view.
  • the setting change processing unit 203 performs a process of changing the setting of the image pickup apparatus 100 after the trigger is generated. However, when the photographer gives an instruction to change the setting regardless of whether or not the trigger is generated, the setting change processing unit 203 performs the process of changing the setting of the image pickup apparatus 100.
  • the setting change processing unit 203 may change the setting of the image pickup apparatus 100 by giving priority to the instruction input from the photographer.
  • an input operation to the input unit 192 provided in the image pickup apparatus 100 such as a button, a voice input, and the like.
  • the plurality of settings When changing the settings a plurality of times during the shooting period, it is preferable to assign the plurality of settings to different buttons of the imaging device 100 or the like.
  • voice input it is advisable to assign a plurality of settings to different voices. For example, setting A is assigned to the voice pronounced "A”, setting B is assigned to the voice pronounced "B”, and so on.
  • the information processing device 200 may change the setting according to the acceleration of the movement of the image pickup device 100. For example, when the acceleration of the movement of the image pickup apparatus 100 is equal to or higher than a predetermined value, the setting of the image pickup apparatus 100 is changed, the assist mode is turned off, and the like. Further, when changing to a plurality of settings within the shooting period, it is advisable to assign the plurality of settings to different accelerations. For example, if the acceleration of the image pickup device 100 is equal to or higher than the predetermined acceleration A, the setting is changed to A, and if the acceleration of the image pickup device 100 is equal to or less than the predetermined acceleration C, the setting is changed to C, and the acceleration of the image pickup device 100 is predetermined.
  • the image pickup device 100 is provided with an acceleration sensor, and it is necessary to supply the sensor information detected by the acceleration sensor to the information processing device 200.
  • the information processing device 200 may change the setting of the image pickup device 100 according to framing and gestures.
  • framing include changing the setting of the image pickup apparatus 100 when it is detected that the lens of the image pickup apparatus 100 faces the ground (downward), turning off the assist mode, and the like. Whether or not the lens of the image pickup apparatus 100 faces the ground can be detected by subject recognition in an image or a posture detection method using a gyro sensor or an acceleration sensor.
  • the image pickup device 100 is provided with a gyro sensor and an acceleration sensor, and it is necessary to supply the sensor information to the information processing device 200.
  • gestures include changing the setting of the image pickup apparatus 100 and turning off the assist mode when the photographer detects a predetermined gesture such as holding a hand in front of the lens.
  • the gesture of the photographer can be detected by recognizing the subject in the image, and can be detected by providing the image pickup apparatus 100 with an infrared sensor or the like that detects the movement of the non-contact hand.
  • the image pickup device 100 is provided with a gyro sensor and an acceleration sensor, and it is necessary to supply the sensor information to the information processing device 200.
  • a state determination unit that determines whether or not the state of the subject has reached a predetermined pre-state
  • An information processing device including a trigger processing unit that generates a trigger for changing a setting of an image pickup device when the state determination unit determines that the state of the subject has reached the prior state.
  • the information processing apparatus according to (1) wherein the prior state is a state of the subject before the state to be photographed, which is a state to be photographed by the image pickup apparatus.
  • the information processing apparatus according to (2) comprising a setting change processing unit that performs a process of changing the setting of the image pickup apparatus after a predetermined time has elapsed from the occurrence of the trigger.
  • the predetermined time is an adjustment time for adjusting the length until the shooting target state is reached after the setting change processing of the imaging device is completed.
  • the information processing apparatus according to (4), wherein the adjustment time can be set by the user.
  • the state determination unit when the determination value indicating the degree of agreement between the current state of the subject and the prior state in the image generated by the image pickup device exceeds the threshold value, the current state of the subject is the prior.
  • the information processing apparatus according to any one of (1) to (6), which determines that the state has been reached.
  • the information processing apparatus according to any one of (1) to (7), wherein the state of the subject is any or a combination of the movement, posture, position, and speed of the subject.
  • the trigger processing unit generates a plurality of the triggers according to a plurality of states of the subject.
  • the information processing apparatus comprising a notification processing unit that processes a notification to the photographer after the trigger is generated.
  • the notification processing unit performs notification processing to change the setting of the image pickup device to the photographer after the trigger is generated.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Studio Devices (AREA)

Abstract

Provided are an information processing device, an information processing method, and an information processing program which enable a setting change for an imaging device according to a state of a subject by generating a trigger according to the state of the subject.　The information processing device comprises: a state determination unit which determines the state of the subject; and a trigger processing unit which generates a trigger for a setting change of the imaging device when the state determination unit has determined the state of the subject to be a predetermined state.

Description

情報処理装置、情報処理方法、情報処理プログラムInformation processing equipment, information processing method, information processing program
　本技術は、情報処理装置、情報処理方法、情報処理プログラムに関する。 This technology relates to information processing devices, information processing methods, and information processing programs.
　カメラにおける撮影では被写体の動作や状態などに応じて、撮影方法やカメラの設定を適切なものに変更して撮影したいという要求がある。そこで、目的とする人物の動きに連動した連写を実現することができる技術が提案されている（特許文献１）。 When shooting with a camera, there is a demand to change the shooting method and camera settings to appropriate ones according to the movement and condition of the subject. Therefore, a technique has been proposed that can realize continuous shooting linked to the movement of a target person (Patent Document 1).
特開２００９－０６０３５５号公報Japanese Unexamined Patent Publication No. 2009-060355
　しかし、特許文献１に記載の技術においては予め顔認識により撮影対象である被写体を認識しておく必要があり、また、変更できるカメラの設定は連射撮影を行うか否かだけであるため、様々な撮影用途に応用することができない。 However, in the technique described in Patent Document 1, it is necessary to recognize the subject to be photographed by face recognition in advance, and the camera setting that can be changed is only whether or not continuous shooting is performed. It cannot be applied to various shooting applications.
　本技術はこのような点に鑑みなされたものであり、被写体の状態に応じてトリガを発生させることにより被写体の状態に応じた撮像装置の設定変更を可能とする情報処理装置、情報処理方法、情報処理プログラムを提供することを目的とする。 This technology was made in view of these points, and is an information processing device, an information processing method, and an information processing device that enables the setting of an image pickup device to be changed according to the state of the subject by generating a trigger according to the state of the subject. The purpose is to provide an information processing program.
　上述した課題を解決するために、第１の技術は、被写体の状態が予め定めた事前状態になったか否かを判定する状態判定部と、状態判定部が被写体の状態が事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させるトリガ処理部とを備える情報処理装置である。 In order to solve the above-mentioned problems, the first technique is that a state determination unit that determines whether or not the state of the subject has reached a predetermined pre-state, and a state determination unit that the state of the subject has reached the pre-state. When it is determined, it is an information processing device including a trigger processing unit that generates a trigger for changing the setting of the image pickup device.
　また、第２の技術は、被写体の状態が予め定めた事前状態になったか否かを判定し、被写体の状態が事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させる情報処理方法である。 Further, the second technique determines whether or not the state of the subject has reached a predetermined pre-state, and when it is determined that the state of the subject has reached the pre-state, a trigger for changing the setting of the image pickup apparatus is generated. It is an information processing method.
　さらに、第３の技術は、被写体の状態が予め定めた事前状態になったか否かを判定し、被写体の状態が事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させる情報処理方法をコンピュータに実行させる情報処理プログラムである。 Further, the third technique determines whether or not the state of the subject has reached a predetermined pre-state, and when it is determined that the state of the subject has reached the pre-state, a trigger for changing the setting of the image pickup apparatus is generated. It is an information processing program that causes a computer to execute an information processing method.
撮像装置１００の構成を示すブロック図である。It is a block diagram which shows the structure of the image pickup apparatus 100. 情報処理装置２００の構成を示すブロック図である。It is a block diagram which shows the structure of an information processing apparatus 200. トリガを一回発生させる場合の情報処理装置２００による処理の概要を示す図である。It is a figure which shows the outline of the processing by the information processing apparatus 200 when the trigger is generated once. トリガを一回発生させる場合の情報処理装置２００による処理を示すフローチャートである。It is a flowchart which shows the process by the information processing apparatus 200 when the trigger is generated once. トリガを一回発生させる場合の状態判定の説明図である。It is explanatory drawing of the state determination at the time of generating a trigger once. トリガを一回発生させる場合の状態判定の説明図である。It is explanatory drawing of the state determination at the time of generating a trigger once. 調整時間の長さの説明図である。It is explanatory drawing of the length of adjustment time. トリガを複数回発生させる場合の情報処理装置２００による処理の概要を示す図である。It is a figure which shows the outline of the processing by the information processing apparatus 200 when the trigger is generated a plurality of times. トリガを複数回発生させる場合の状態判定の説明図である。It is explanatory drawing of the state determination at the time of generating a trigger a plurality of times. トリガを複数回発生させる場合の情報処理装置２００による処理を示すフローチャートである。It is a flowchart which shows the process by the information processing apparatus 200 when the trigger is generated a plurality of times. トリガを複数回発生させる場合の情報処理装置２００による処理を示すフローチャートである。It is a flowchart which shows the process by the information processing apparatus 200 when the trigger is generated a plurality of times. アシストモードをオンにする際に撮像装置１００の設定を変更しない例の説明図である。It is explanatory drawing of the example which does not change the setting of the image pickup apparatus 100 when the assist mode is turned on. ユーザインターフェースにおける通知の第１の例を示す図である。It is a figure which shows the 1st example of the notification in a user interface. ユーザインターフェースにおける通知の第２の例を示す図である。It is a figure which shows the 2nd example of the notification in a user interface. ユーザインターフェースにおける通知の第３の例を示す図である。It is a figure which shows the 3rd example of the notification in a user interface. 事前状態と設定変更内容を決定するためのユーザインターフェースの例を示す図である。It is a figure which shows the example of the user interface for deciding the advance state and the setting change content. 事前状態と設定変更内容を決定するためのユーザインターフェースの例を示す図である。It is a figure which shows the example of the user interface for deciding the advance state and the setting change content.
　以下、本技術の実施の形態について図面を参照しながら説明する。なお、説明は以下の順序で行う。
＜１．実施の形態＞
［１－１．撮像装置１００の構成］
［１－２．情報処理装置２００の構成］
［１－３．情報処理装置２００による処理］
［１－３－１．トリガを一回発生させる例］
［１－３－２．トリガを複数回発生させる例］
［１－３－３．ユーザインターフェース］
＜２．変形例＞ Hereinafter, embodiments of the present technology will be described with reference to the drawings. The explanation will be given in the following order.
<1. Embodiment>
[1-1. Configuration of image pickup device 100]
[1-2. Configuration of information processing device 200]
[1-3. Processing by information processing device 200]
[1-3-1. Example of generating a trigger once]
[1-3-2. Example of generating a trigger multiple times]
[1-3-3. User interface]
<2. Modification example>
＜１．実施の形態＞
［１－１．撮像装置１００の構成］
　図１を参照して撮像装置１００の構成について説明する。撮像装置１００は、レンズブロック１１０、イメージセンサブロック１２０、画像処理回路１３０、画像圧縮・伸長回路１４０、画像データバス１５０、画像ＲＡＭ（Random Access Memory）１６０、記憶ブロック１７０、表示ブロック１８０、制御部１９０、レンズ情報判別回路１９１、入力部１９２、インターフェース１９３、スピーカ１９４、マイクロホン１９５、情報処理装置２００を備えて構成されている。 <1. Embodiment>
[1-1. Configuration of image pickup device 100]
The configuration of the image pickup apparatus 100 will be described with reference to FIG. The image pickup device 100 includes a lens block 110, an image sensor block 120, an image processing circuit 130, an image compression / decompression circuit 140, an image data bus 150, an image RAM (Random Access Memory) 160, a storage block 170, a display block 180, and a control unit. It is configured to include 190, a lens information discrimination circuit 191, an input unit 192, an interface 193, a speaker 194, a microphone 195, and an information processing device 200.
　レンズブロック１１０は、被写体からの光をイメージセンサ１２１に集光するための光学レンズやフォーカスを合わせるためのフォーカスレンズを含むレンズ１１１、レンズ１１１を動かすためのレンズ駆動ドライバ１１２、フォーカスレンズを制御するフォーカスレンズ制御回路１１３、光学レンズを制御する光学レンズ制御回路１１４、光学レンズ記憶装置１１５を備えて構成されている。光学レンズ記憶装置１１５にはレンズの個体情報、例えば、ズームポジションと焦点距離の関係、フォーカスポジションと撮影距離の関係等パラメータなどが格納されている。レンズブロック１１０は複数(複眼)存在してもよい。レンズブロック１１０を介して得られた被写体の光画像は、イメージセンサブロック１２０のイメージセンサ１２１上に結像される。 The lens block 110 controls a lens 111 including an optical lens for concentrating light from a subject on an image sensor 121 and a focus lens for focusing, a lens drive driver 112 for moving the lens 111, and a focus lens. It is configured to include a focus lens control circuit 113, an optical lens control circuit 114 for controlling an optical lens, and an optical lens storage device 115. The optical lens storage device 115 stores individual information of the lens, for example, parameters such as the relationship between the zoom position and the focal length, and the relationship between the focus position and the shooting distance. There may be a plurality of (compound eyes) lens blocks 110. The optical image of the subject obtained through the lens block 110 is imaged on the image sensor 121 of the image sensor block 120.
　イメージセンサブロック１２０に含まれるイメージセンサ１２１は、レンズ１１１を通して得られた被写体からの入射光を光電変換して電荷量に変換して撮像信号を出力する。そして、イメージセンサ１２１は画素信号を画像処理回路１３０に出力する。イメージセンサ１２１としては、ＣＣＤ（Charge Coupled Device）、ＣＭＯＳ（Complementary Metal Oxide Semiconductor）などが用いられる。イメージセンサ１２１は、複数（３板プリズムや複眼）存在してもよい。また、像面位相差ＡＦ（Auto Focus）用のフォトダイオードを具備していてもよい。また、イメージセンサブロック１２０は、イメージセンサ１２１を物理的に駆動させて手振れ補正ユニットを兼ねるイメージセンサドライバ１２２、イメージセンサ１２１を制御するためのイメージセンサ制御回路１２３を備えていてもよい。 The image sensor 121 included in the image sensor block 120 photoelectrically converts the incident light from the subject obtained through the lens 111 into an electric charge amount and outputs an image pickup signal. Then, the image sensor 121 outputs the pixel signal to the image processing circuit 130. As the image sensor 121, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor), or the like is used. There may be a plurality of image sensors 121 (three-plate prism or compound eye). Further, a photodiode for image plane phase difference AF (Auto Focus) may be provided. Further, the image sensor block 120 may include an image sensor driver 122 that physically drives the image sensor 121 and also serves as a camera shake correction unit, and an image sensor control circuit 123 for controlling the image sensor 121.
　画像処理回路１３０は、イメージセンサ１２１から出力された画像信号に対して、デジタルデータ(ＲＧＢ作成/bit変換等)に変換する処理、デジタル化された画像データからの各種検波処理、画像データに対する画質補正処理(ゲイン補正、ホワイトバランスなど)、アスペクト変換処理などを行う。処理速度向上のために撮像装置１００は画像処理回路１３０を複数備えていてもよい。 The image processing circuit 130 converts the image signal output from the image sensor 121 into digital data (RGB creation / bit conversion, etc.), various detection processes from the digitized image data, and image quality for the image data. Performs correction processing (gain correction, white balance, etc.), aspect conversion processing, etc. The image pickup apparatus 100 may be provided with a plurality of image processing circuits 130 in order to improve the processing speed.
　画像圧縮・伸長回路１４０は、画像処理回路１３０から出力された画像データを画像ＲＡＭ１６０を介して受け取り、圧縮符号化した後、動画あるいは静止画のデータファイルとして記憶部１７１に出力する。符号化方式としてはＭＰＥＧ（Moving Picture Experts Group）、ＪＰＥＧ（Joint Photographic Experts Group）などが適用される。非圧縮ＲＡＷのまま保存する場合は、使われなくてもよい。撮像装置１００は処理速度向上のために画像圧縮・伸長回路１４０を複数備えていてもよい。 The image compression / decompression circuit 140 receives the image data output from the image processing circuit 130 via the image RAM 160, compresses and encodes it, and then outputs it to the storage unit 171 as a moving image or still image data file. As the coding method, MPEG (Moving Picture Experts Group), JPEG (Joint Photographic Experts Group) and the like are applied. When saving as uncompressed RAW, it does not have to be used. The image pickup apparatus 100 may include a plurality of image compression / decompression circuits 140 in order to improve the processing speed.
　画像データバス１５０は画像データを送受信するためのバスである。画像ＲＡＭ１６０は画像データバス１５０を介して接続された画像処理回路１３０、画像圧縮・伸長回路１４０、情報処理装置２００に対して画像データを供給するためのものである。画像ＲＡＭ１６０は処理速度向上のために複数設けられていてもよい。 The image data bus 150 is a bus for transmitting and receiving image data. The image RAM 160 is for supplying image data to the image processing circuit 130, the image compression / decompression circuit 140, and the information processing apparatus 200 connected via the image data bus 150. A plurality of image RAMs 160 may be provided in order to improve the processing speed.
　記憶ブロック１７０は、記憶部１７１と記憶部制御回路１７２から構成されている。記憶部１７１は、各処理回路を通り最終的に生成された画像データを記憶するものであり、記憶装置制御回路は記憶部１７１における画像データの保存、読み出し制御などを行うものである。記憶部１７１は、磁気テープ、光ディスクなどの可搬型記録媒体のドライブ装置、ＨＤＤ（Hard Disk Drive）、ＳＳＤ（Solid State Drive）等などにより構成されている。記憶部１７１は撮像装置１００に内蔵してもよいし、有線または無線の外付けでもよい。インライン／オフライン処理用向けに異なるフォーマットを保存するためや、処理速度・信頼性向上のために撮像装置１００は記憶部１７１を複数備えていてもよい。 The storage block 170 is composed of a storage unit 171 and a storage unit control circuit 172. The storage unit 171 stores the image data finally generated through each processing circuit, and the storage device control circuit stores and reads out the image data in the storage unit 171. The storage unit 171 is composed of a drive device for a portable recording medium such as a magnetic tape or an optical disk, an HDD (Hard Disk Drive), an SSD (Solid State Drive), or the like. The storage unit 171 may be built in the image pickup apparatus 100, or may be externally connected by wire or wirelessly. The image pickup apparatus 100 may include a plurality of storage units 171 in order to store different formats for in-line / offline processing and to improve processing speed and reliability.
　表示ブロック１８０は、表示部１８１と表示部制御回路１８２から構成されている。表示部１８１は、各処理回路を通り最終的に生成された画像データ、スルー画、ＧＵＩ（Graphical User Interface）などを表示するものであり、表示部制御回路１８２はその表示制御を行うものである。表示部１８１は、例えば、ＬＣＤ（Liquid Crystal Display）、ＰＤＰ(Plasma Display Panel)、有機ＥＬ(Electro Luminescence)パネルなどにより構成されるモニタディスプレイや、ＥＶＦ（Electronic View Finder：電子ビューファインダー）で実現される。アスペクト変換を行っていない状態のスルー画や、アスペクト変換処理後の完成画像を同時に確認できるように、異なる設定が複数存在してもよい。なお、表示部１８１は有線または無線接続により撮像装置１００に外付けされる外部装置でもよい。 The display block 180 is composed of a display unit 181 and a display unit control circuit 182. The display unit 181 displays image data, a through image, a GUI (Graphical User Interface), etc. finally generated through each processing circuit, and the display unit control circuit 182 controls the display. .. The display unit 181 is realized by, for example, a monitor display composed of an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro Luminescence) panel, or an EVF (Electronic View Finder). To. There may be a plurality of different settings so that a through image without aspect conversion and a completed image after aspect conversion processing can be confirmed at the same time. The display unit 181 may be an external device externally attached to the image pickup device 100 by a wired or wireless connection.
　制御部１９０は、ＣＰＵ（Central Processing Unit）、ＲＡＭ（Random Access Memory）およびＲＯＭ（Read Only Memory）などから構成されている。ＣＰＵがＲＯＭに記憶されたプログラムに従い様々な処理を実行してコマンドの発行を行うことによって撮像装置１００の全体および各部の制御を行う。また、検波情報を元にオートフォーカス、オートエクスポージャ処理の補正制御、補正処理制御値の演算なども行う。 The control unit 190 is composed of a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), and the like. The CPU executes various processes according to the program stored in the ROM and issues commands to control the entire image pickup apparatus 100 and each part thereof. In addition, based on the detection information, autofocus, correction control of auto-exposure processing, calculation of correction processing control value, and the like are also performed.
　レンズ情報判別回路１９１は、交換レンズカメラを想定した、装着レンズを識別判定する回路である。レンズ情報判別回路１９１は必須の構成ではない。 The lens information discrimination circuit 191 is a circuit for discriminating and determining the mounted lens, assuming an interchangeable lens camera. The lens information discrimination circuit 191 is not an essential configuration.
　入力部１９２は、撮像装置１００に対して撮影者（ユーザ）が各種指示などの入力を行うためのものである。入力部１９２に対して撮影者から入力がなされると、その入力に応じた制御信号が生成されて制御部１９０に供給される。そして、制御部１９０はその制御信号に対応した各種処理を行う。入力部１９２としてはレリーズ指示のためのレリーズボタン、各種操作のための物理ボタンの他、タッチパネル、表示部１８１と一体に構成されたタッチスクリーンなどがある。 The input unit 192 is for the photographer (user) to input various instructions to the image pickup apparatus 100. When an input is made to the input unit 192 by the photographer, a control signal corresponding to the input is generated and supplied to the control unit 190. Then, the control unit 190 performs various processes corresponding to the control signal. The input unit 192 includes a release button for instructing a release, a physical button for various operations, a touch panel, a touch screen integrally configured with the display unit 181 and the like.
　インターフェース１９３は他の装置やインターネットなどとの間のインターフェースである。インターフェース１９３は、有線または無線の通信インターフェースを含みうる。また、より具体的には、有線または無線の通信インターフェースは、３ＴＴＥなどのセルラー通信、４Ｇ（第４世代移動通信システム）、５Ｇ（第５世代移動通信システム）、Ｗｉ－Ｆｉ、Bluetooth（登録商標）、ＮＦＣ（Near Field Communication）、イーサネット（登録商標）、ＨＤＭＩ（登録商標）（High-Definition Multimedia Interface）、ＵＳＢ（Universal Serial Bus）などを含みうる。また、撮像装置１００と情報処理装置２００がハードウェア的に接続される場合、インターフェース１９３は装置間の接続端子や、装置内のバスなどを含みうる。また、撮像装置１００と情報処理装置２００が複数の装置に分散して実現される場合、インターフェース１９３はそれぞれの装置のための異なる種類のインターフェースを含みうる。例えば、インターフェース１９３は通信インターフェースと装置内のインターフェースとの両方を含んでもよい。 Interface 193 is an interface between other devices and the Internet. Interface 193 may include a wired or wireless communication interface. More specifically, the wired or wireless communication interface is cellular communication such as 3TTE, 4G (4th generation mobile communication system), 5G (5th generation mobile communication system), Wi-Fi, Bluetooth (registered trademark). ), NFC (Near Field Communication), Ethernet (registered trademark), HDMI (registered trademark) (High-Definition Multimedia Interface), USB (Universal Serial Bus) and the like. When the image pickup device 100 and the information processing device 200 are connected by hardware, the interface 193 may include a connection terminal between the devices, a bus in the device, and the like. Further, when the image pickup device 100 and the information processing device 200 are distributed and realized in a plurality of devices, the interface 193 may include different types of interfaces for each device. For example, interface 193 may include both a communication interface and an in-device interface.
　スピーカ１９４は、撮影者への音声による通知などに用いられる音声出力デバイスである。 The speaker 194 is a voice output device used for voice notification to the photographer.
　マイクロホン１９５は、撮影時の音声を収録するための集音デバイスである。 The microphone 195 is a sound collecting device for recording the sound at the time of shooting.
　撮像装置１００は以上のようにして構成されている。撮像装置１００としてはデジタルカメラ、一眼レフカメラ、カムコーダー、業務用カメラ、プロ仕様撮影機器などがある。 The image pickup device 100 is configured as described above. The image pickup apparatus 100 includes a digital camera, a single-lens reflex camera, a camcorder, a professional camera, a professional photography device, and the like.
［１－２．情報処理装置２００の構成］
　次に図２を参照して情報処理装置２００の構成について説明する。情報処理装置２００は、状態判定部２０１、トリガ処理部２０２、設定変更処理部２０３、通知処理部２０４を備えて構成されている。 [1-2. Configuration of information processing device 200]
Next, the configuration of the information processing apparatus 200 will be described with reference to FIG. The information processing apparatus 200 includes a state determination unit 201, a trigger processing unit 202, a setting change processing unit 203, and a notification processing unit 204.
　状態判定部２０１は、撮像装置１００により生成された画像から撮影対象である被写体の現在の状態を認識し、被写体の状態が事前状態になったか否かを判定する。状態判定部２０１は、被写体の現在の状態と事前状態の一致度を示す判定値が閾値を超えたか否かにより被写体の現在の状態が事前状態になったか否かを判定する。事前状態および状態判定の詳細は後述する。被写体認識技術としては、機械学習やディープラーニングによる方法、テンプレートマッチングによる方法、被写体の輝度分布情報に基づくマッチング方法、画像に含まれる色や人間の顔の特徴量等に基づく方法、人工知能を用いる方法などを用いてもよい。また、これらの手法を組み合わせて認識精度を高めるようにしてもよい。状態判定部２０１は、高度な画像判定向けＡＩ専用回路で構成されてもよい。 The state determination unit 201 recognizes the current state of the subject to be photographed from the image generated by the image pickup apparatus 100, and determines whether or not the state of the subject has reached the pre-state. The state determination unit 201 determines whether or not the current state of the subject has reached the prior state depending on whether or not the determination value indicating the degree of coincidence between the current state of the subject and the prior state exceeds the threshold value. Details of the prior state and the state determination will be described later. As the subject recognition technology, a method by machine learning or deep learning, a method by template matching, a matching method based on the brightness distribution information of the subject, a method based on the color contained in the image, the feature amount of the human face, etc., and artificial intelligence are used. A method or the like may be used. Further, these methods may be combined to improve the recognition accuracy. The state determination unit 201 may be configured by an AI dedicated circuit for advanced image determination.
　トリガ処理部２０２は、状態判定部２０１の判定結果に基づいて設定変更処理部２０３による撮像装置１００の設定変更のきっかけとなるトリガを発生させるものである。 The trigger processing unit 202 generates a trigger that triggers the setting change of the image pickup apparatus 100 by the setting change processing unit 203 based on the determination result of the state determination unit 201.
　設定変更処理部２０３は、撮像装置１００の設定を変更する処理を行うものである。設定変更処理部２０３は、トリガの発生後から撮像装置１００の設定を変更する処理を行うまでの所定時間（調整時間）の経過後に撮像装置１００の設定を変更する処理を行う。調整時間の詳細については後述する。 The setting change processing unit 203 performs a process of changing the setting of the image pickup apparatus 100. The setting change processing unit 203 performs a process of changing the setting of the image pickup apparatus 100 after a predetermined time (adjustment time) elapses from the occurrence of the trigger to the process of changing the setting of the image pickup apparatus 100. The details of the adjustment time will be described later.
　設定変更処理部２０３は、例えば、撮像装置１００に変更するパラメータの種別と変更後の値を示す情報とともに設定変更を指示する制御信号を撮像装置１００に送信することで設定変更処理を行う。変更する設定としては、例えば、Ｆ値、シャッタスピード、ＩＳＯ、ホワイトバランス、連射撮影モードの起動、連射撮影の速度、ＡＦ枠の位置、ピント位置などがあるが、その他撮像装置１００において設定変更可能なパラメータであればどのようなものでもよい。撮影者は設定変更処理部２０３の処理により変更する撮像装置１００の設定内容（どのパラメータをどのような値に変更するか）を予め設定しておく必要がある。設定内容は撮影者が具体的なパラメータとその値を入力することで設定してもよいし、撮影の対象や被写体の種類などに対応した所定のテンプレートやアルゴリズムなどに基づいて情報処理装置２００が自動で設定してもよい。 The setting change processing unit 203 performs the setting change processing by, for example, transmitting a control signal instructing the setting change to the image pickup apparatus 100 together with information indicating the type of the parameter to be changed to the image pickup apparatus 100 and the value after the change. The settings to be changed include, for example, F value, shutter speed, ISO, white balance, activation of continuous shooting mode, continuous shooting speed, AF frame position, focus position, etc., but other settings can be changed in the image pickup device 100. Any parameter can be used. The photographer needs to set in advance the setting contents (which parameter is changed to what value) of the image pickup apparatus 100 to be changed by the processing of the setting change processing unit 203. The setting contents may be set by the photographer by inputting specific parameters and their values, or the information processing apparatus 200 may set the information processing device 200 based on a predetermined template or algorithm corresponding to the shooting target or the type of subject. It may be set automatically.
　通知処理部２０４は、撮像装置１００が備える表示部１８１など利用して撮影者に対して撮像装置１００の設定変更についての各種通知処理を行うものである。 The notification processing unit 204 uses the display unit 181 and the like provided in the image pickup device 100 to perform various notification processes for changing the settings of the image pickup device 100 to the photographer.
　情報処理装置２００は以上のようにして構成されている。情報処理装置２００はその機能を有するハードウェアによる専用の装置として構成されてもよい。また、情報処理装置２００は専用の装置として構成されるのみでなく、プログラムにより構成され、そのプログラムの実行により撮像装置１００が情報処理装置２００として機能を備えるようにしてもよい。そのプログラムは予め撮像装置１００にインストールされていてもよいし、ダウンロードや記憶媒体などで配布されて、撮影者が自ら撮像装置１００にインストールするようにしてもよい。 The information processing device 200 is configured as described above. The information processing device 200 may be configured as a dedicated device by hardware having the function. Further, the information processing device 200 is not only configured as a dedicated device but also configured by a program, and the image pickup device 100 may be provided with a function as the information processing device 200 by executing the program. The program may be installed in the image pickup apparatus 100 in advance, or may be distributed by download or storage medium so that the photographer can install the program in the image pickup apparatus 100 by himself / herself.
［１－３．情報処理装置２００による制御］
［１－３－１．トリガを一回発生させる例］
　次に情報処理装置２００による処理について説明する。まず、本技術により実現される処理の概要について説明する。本実施の形態では人物を被写体とし、その人物が陸上競技の短距離走を行う様子を撮影する場合を例にして説明を行う。 [1-3. Control by information processing device 200]
[1-3-1. Example of generating a trigger once]
Next, the processing by the information processing apparatus 200 will be described. First, the outline of the processing realized by this technology will be described. In the present embodiment, a case where a person is taken as a subject and the person is photographed for a short-distance run in athletics will be described as an example.
　図３に示すように、説明の便宜上、被写体が短距離走を行う期間を時間０乃至時間６に分ける。短距離走においては、まず、走者である被写体は時間１に示すように、スタート位置で手を地面に付けたスタートの姿勢をとる。そして時間２に示すようにスタートして走り出すと時間３に示すように徐々に姿勢が起き上がっていく。そして、時間４に示すように起き上がった姿勢の状態で走り続け、時間５に示すようにゴールに到達して時間６で短距離走は終了となる。この時間０から時間６までの期間を撮影期間とする。 As shown in FIG. 3, for convenience of explanation, the period during which the subject runs a short distance is divided into time 0 to time 6. In sprinting, first, the subject who is the runner takes a start posture with his / her hand on the ground at the start position as shown in time 1. Then, when the vehicle starts and starts running as shown in time 2, the posture gradually rises as shown in time 3. Then, the sprinter continues to run in the state of standing up as shown in time 4, reaches the goal as shown in time 5, and the sprint ends in time 6. The period from time 0 to time 6 is defined as the shooting period.
　図３の例では、時間０から時間３の状態までは撮像装置１００の設定を設定Ａとし、時間４における被写体の状態（撮影対象状態）を設定Ｂで撮影する。そのために情報処理装置２００は、被写体が時間４の撮影対象状態になる前に撮像装置１００を設定Ｂに変更する。このように、図３は撮影期間内においてトリガを一回発生させて撮像装置１００の設定を一回変更する例である。 In the example of FIG. 3, the setting of the image pickup apparatus 100 is set to the setting A from the state of the time 0 to the state of the time 3, and the state of the subject (the state to be photographed) at the time 4 is set to the setting B for shooting. Therefore, the information processing device 200 changes the image pickup device 100 to the setting B before the subject is in the shooting target state at time 4. As described above, FIG. 3 is an example in which the trigger is generated once during the shooting period and the setting of the image pickup apparatus 100 is changed once.
　時間４の撮影対象状態を設定Ｂで撮影するためには、被写体が時間４の撮影対象状態になる前に撮像装置１００を設定Ａから設定Ｂに変更する必要がある。被写体が時間４の撮影対象状態になったタイミングで撮像装置１００を設定Ａから設定Ｂに変更したのでは撮影が間に合わない、または間に合ったとしても撮影は困難なものとなるからである。 In order to shoot with the shooting target state of time 4 in setting B, it is necessary to change the image pickup device 100 from setting A to setting B before the subject becomes the shooting target state of time 4. This is because if the image pickup apparatus 100 is changed from the setting A to the setting B at the timing when the subject is in the shooting target state at the time 4, the shooting will not be in time, or even if the shooting is in time, the shooting will be difficult.
　そこで、状態判定部２０１が被写体の状態が時間４の撮影対象状態になる前の状態（事前状態）になったか否かを判定し、被写体の現在の状態が事前状態になった場合にトリガ処理部２０２は設定変更のきっかけとなるトリガを発生させる。そして、トリガ発生後から調整時間経過後であり、被写体が時間４の撮影対象状態になる前に設定変更処理部２０３が撮像装置１００を設定Ａから設定Ｂに変更する。これにより、撮影者は設定Ｂで被写体の撮影対象状態を撮影することができる。そのために事前状態が被写体のどの状態であるかを予め特定する必要がある。 Therefore, the state determination unit 201 determines whether or not the state of the subject has reached the state before the shooting target state of time 4 (preliminary state), and trigger processing when the current state of the subject has reached the pre-state. The unit 202 generates a trigger that triggers a setting change. Then, the setting change processing unit 203 changes the image pickup apparatus 100 from the setting A to the setting B after the adjustment time has elapsed since the trigger was generated and before the subject is in the shooting target state at the time 4. As a result, the photographer can shoot the shooting target state of the subject in the setting B. Therefore, it is necessary to specify in advance which state of the subject the prior state is.
　事前状態は、撮像装置１００を用いた撮影の対象とする状態である撮影対象状態になる前の被写体の状態である。事前状態は過去に撮影した具体的な被写体の画像や用いて特定することができる。短距離走であれば、例えば、事前の練習の様子や、被写体以外の他の走者の短距離走を撮影して事前状態とする画像を取得しておくとよい。また、情報処理装置２００が予め事前状態を示す複数の画像や情報をテンプレートとして保持しておき、撮影者が被写体の種別やシーンの種別を指定することでそれらテンプレートの中から事前状態を特定するようにしてもよい。さらに、事前状態が被写体の移動速度などの数値である場合には撮影者が具体的な数値を入力することにより事前状態を特定することができる。 The pre-state is the state of the subject before the state to be photographed, which is the state to be photographed using the image pickup apparatus 100. The prior state can be specified by using an image of a specific subject taken in the past or using it. In the case of sprinting, for example, it is advisable to take a picture of a state of practice in advance or a short-distance running of a runner other than the subject to obtain an image in which the state is set in advance. Further, the information processing apparatus 200 holds a plurality of images and information indicating the prior state in advance as templates, and the photographer specifies the type of the subject and the type of the scene to specify the prior state from the templates. You may do so. Further, when the prior state is a numerical value such as the moving speed of the subject, the photographer can specify the prior state by inputting a specific numerical value.
　調整時間とは、トリガの発生後から撮像装置１００の設定を変更する処理を行うまでの時間であり、予め設定しておくものである。調整時間は、撮像装置１００の設定が変更された後、撮影タイミング（被写体が撮影対象状態になる）までの長さを調整するための時間であるといえる。調整時間は０秒以上で撮影者が任意の長さに設定することが可能である。 The adjustment time is the time from the occurrence of the trigger to the process of changing the setting of the image pickup apparatus 100, and is set in advance. It can be said that the adjustment time is the time for adjusting the length from the setting of the image pickup apparatus 100 to the shooting timing (the subject is in the shooting target state). The adjustment time is 0 seconds or more, and the photographer can set it to an arbitrary length.
　本実施の形態は、撮影対象状態を撮影するために情報処理装置２００が撮像装置１００の設定を自動で変更するモードをアシストモードと称する。図３の例では時間０の状態から時間４になる前までは設定Ａで撮影を行うが、これはアシストモードをオンにしたタイミングで撮像装置１００の設定を設定Ｘから設定Ａに変更しておけばよい。 In this embodiment, a mode in which the information processing device 200 automatically changes the setting of the image pickup device 100 in order to shoot the state to be photographed is referred to as an assist mode. In the example of FIG. 3, shooting is performed with setting A from the state of time 0 to before time 4, but this changes the setting of the image pickup apparatus 100 from setting X to setting A at the timing when the assist mode is turned on. Just leave it.
　情報処理装置２００による処理を図４のフローチャートを参照して説明する。まず、ステップＳ１０１で、撮影者からの入力に応じて情報処理装置２００が動作するアシストモードをオンにする。このアシストモードをオンにするのと同時に撮像装置１００により設定が設定Ａにされる。 The processing by the information processing apparatus 200 will be described with reference to the flowchart of FIG. First, in step S101, the assist mode in which the information processing apparatus 200 operates in response to an input from the photographer is turned on. At the same time when this assist mode is turned on, the setting is set to A by the image pickup apparatus 100.
　次にステップＳ１０２で、状態判定部２０１が被写体の状態判定を開始する。状態判定部２０１はアシストモードがオンである間は状態判定を継続して行う。 Next, in step S102, the state determination unit 201 starts the state determination of the subject. The state determination unit 201 continues to determine the state while the assist mode is on.
　ここで図５および図６を参照して、状態判定部２０１による状態判定について説明する。この説明では被写体の動作を被写体の状態とする。設定変更処理部２０３は、被写体が時間４の撮影対象状態になる前に撮像装置１００の設定を設定Ｂに変更する必要がある。そのためには、被写体の状態が時間４の撮影対象状態になる前の状態（本実施の形態では時間３の状態）を事前状態とし、被写体が事前状態になったか否かを判定する必要がある。 Here, the state determination by the state determination unit 201 will be described with reference to FIGS. 5 and 6. In this explanation, the movement of the subject is defined as the state of the subject. The setting change processing unit 203 needs to change the setting of the image pickup apparatus 100 to the setting B before the subject becomes the shooting target state at time 4. For that purpose, it is necessary to set the state before the state of the subject becomes the shooting target state of time 4 (the state of time 3 in the present embodiment) as the pre-state, and determine whether or not the subject has been in the pre-state. ..
　そこで状態判定部２０１は、撮像装置１００により生成された画像から撮影対象である被写体の現在の状態を認識し、被写体の現在の状態と事前状態とを比較する。そして、被写体の現在の状態と事前状態との一致度を示す判定値が閾値を超えた場合に被写体の現在の状態が事前状態になったと判定する。そして、被写体の現在の状態が事前状態になったと判定した場合、状態判定部２０１はその判定結果をトリガ処理部２０２に供給する。 Therefore, the state determination unit 201 recognizes the current state of the subject to be photographed from the image generated by the image pickup apparatus 100, and compares the current state of the subject with the prior state. Then, when the determination value indicating the degree of coincidence between the current state of the subject and the prior state exceeds the threshold value, it is determined that the current state of the subject has reached the prior state. Then, when it is determined that the current state of the subject has reached the prior state, the state determination unit 201 supplies the determination result to the trigger processing unit 202.
　被写体の動作を被写体の状態とする場合、被写体の現在の動作と事前状態としての動作の比較は、被写体の姿勢、動作の速度、動作の加速度、動作の軌跡、音声、振動などに基づいて行うことができる。 When the motion of the subject is the state of the subject, the comparison between the current motion of the subject and the motion as the prior state is performed based on the posture of the subject, the speed of the motion, the acceleration of the motion, the trajectory of the motion, the voice, the vibration, and the like. be able to.
　被写体の姿勢に基づいて動作の状態判定を行う場合、状態判定における判定値は被写体の現在の姿勢と事前状態における姿勢の一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在の動作が事前状態の動作になったとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。被写体の現在の姿勢と事前状態の姿勢の一致度は、例えば、被写体の現在の姿勢を撮影した画像と、事前状態の姿勢を示す画像を機械学習、ディープラーニングなどを用いた公知の画像比較方法より得ることができる。 When the state of motion is determined based on the posture of the subject, the determination value in the state determination indicates the degree of matching between the current posture of the subject and the posture in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current operation of the subject is the operation in the prior state. The degree of coincidence between the current posture of the subject and the posture in the pre-state is, for example, a known image comparison method using machine learning, deep learning, etc., for an image of the current posture of the subject and an image showing the posture of the pre-state. Can be obtained more.
　また、被写体の速度に基づいて動作の状態判定を行う場合、状態判定における判定値は被写体の現在の速度と事前状態における速度の一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在の動作が事前状態の動作になったとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。被写体の現在の速度と事前状態の速度の一致度は、例えば、撮影のフレームレートと複数のフレーム間における被写体の移動距離に基づいて移動速度をそれぞれ算出し、それらを比較することで得ることができる。 Further, when the state judgment of the operation is performed based on the speed of the subject, the judgment value in the state judgment indicates the degree of coincidence between the current speed of the subject and the speed in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current operation of the subject is the operation in the prior state. The degree of agreement between the current speed of the subject and the speed in the prior state can be obtained by, for example, calculating the moving speed based on the frame rate of shooting and the moving distance of the subject between a plurality of frames, and comparing them. can.
　また、被写体の動作の軌跡に基づいて動作の状態判定を行う場合、状態判定における判定値は被写体の現在の動作の軌跡と事前状態における動作の軌跡の一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在の動作の軌跡が事前状態の動作の軌跡と一致したとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。動作の軌跡の一致度は例えば被写体の体の特定の部位の動作の軌跡を示す線分の比較やトレースを行うことで得ることができる。 Further, when the state of motion is determined based on the trajectory of the motion of the subject, the determination value in the state determination indicates the degree of coincidence between the trajectory of the current motion of the subject and the trajectory of the motion in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the locus of the current operation of the subject matches the locus of the operation in the prior state. The degree of coincidence of motion trajectories can be obtained, for example, by comparing or tracing a line segment showing the motion trajectory of a specific part of the body of the subject.
　また、被写体が発する音に基づいて動作の状態判定を行う場合、状態判定における判定値は被写体の現在の音と事前状態における音の一致度を示すものである。音の一致度は例えば周波数や音の大きさ（ｄＢ）や音声波形の比較などにより行うことができる。撮影時の音声はマイクロホン１９５で取得することができる。 Further, when the state judgment of the operation is performed based on the sound emitted by the subject, the judgment value in the state judgment indicates the degree of coincidence between the current sound of the subject and the sound in the prior state. The degree of coincidence of sounds can be determined, for example, by comparing the frequency, loudness (dB), and voice waveforms. The sound at the time of shooting can be acquired by the microphone 195.
　さらに被写体が発する振動に基づいて動作の状態判定を行う場合、状態判定における判定値は被写体の現在の振動と事前状態における振動の一致度を示すものである。振動の一致度は例えば振動の周波数、振幅、周期の比較などにより行うことができる。 Furthermore, when the state of operation is judged based on the vibration generated by the subject, the judgment value in the state judgment indicates the degree of agreement between the current vibration of the subject and the vibration in the prior state. The degree of coincidence of vibrations can be determined, for example, by comparing the frequency, amplitude, and period of vibrations.
　なお、上述した姿勢、速度、加速度、軌跡、音声、振動を複数組み合わせて被写体の動作と事前状態としての動作を比較して状態判定を行ってもよい。 Note that the state may be determined by combining a plurality of the above-mentioned postures, speeds, accelerations, loci, voices, and vibrations and comparing the movements of the subject with the movements as the prior state.
　閾値は任意に設定可能である。例えば、撮影者が具体的な値を入力して閾値を設定してもよいし、上・中・下などの基準を撮影者が入力して、入力された基準に応じて情報処理装置２００が自動で閾値を設定するようにしてもよい。また、情報処理装置２００がアルゴリズムなどに基づいて閾値を設定してもよい。さらに、値や基準の入力以外に閾値に相当にする画像、映像を入力することで閾値を設定してもよい。 The threshold can be set arbitrarily. For example, the photographer may input a specific value to set a threshold value, or the photographer inputs a reference such as upper / middle / lower, and the information processing apparatus 200 sets the threshold value according to the input reference. The threshold value may be set automatically. Further, the information processing apparatus 200 may set a threshold value based on an algorithm or the like. Further, the threshold value may be set by inputting an image or a video corresponding to the threshold value in addition to the input of the value or the reference.
　図５の例では、被写体が短距離走のスタート位置につき、走り出し、姿勢が起き上がっていき、徐々に被写体の動作が時間３の事前状態の動作に近づいていくと、判定値が上昇していく。そして判定値が閾値を超えると被写体の動作が時間３の事前状態の動作になったとして、状態判定部２０１はその判定結果をトリガ処理部２０２に供給する。 In the example of FIG. 5, the judgment value increases as the subject reaches the start position of the sprint, starts running, and the posture rises, and the movement of the subject gradually approaches the movement in the pre-state of time 3. .. When the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the operation of the subject is the operation in the prior state of the time 3.
　なお、事前状態は撮影対象状態の直前の状態に限られない。図６に示すように、時間４が撮影対象状態である場合、時間３より前の時間１の状態を事前状態とすることもできる。時間３よりも前の時間１の状態を事前状態とすることにより、トリガ発生から撮影対象状態までの時間が長くなるため、例えばその間に撮影者に対して「設定を変更する」旨の通知などを行うことができ、撮影者は設定変更がなされることを把握して落ち着いて撮影を行うことができる。なお、撮影対象状態よりも時間が前の状態であればどの状態も事前状態とすることができるので時間２の状態を事前状態とすることもできる。 The prior state is not limited to the state immediately before the shooting target state. As shown in FIG. 6, when the time 4 is the shooting target state, the state of the time 1 before the time 3 can be set as the pre-state. By setting the state of time 1 before time 3 to the pre-state, the time from the trigger generation to the shooting target state becomes longer. Therefore, for example, a notification to the photographer that "change the setting" is made during that time. The photographer can calmly take a picture by knowing that the setting is changed. Since any state can be set to the pre-state as long as the time is before the state to be photographed, the state of time 2 can be set to the pre-state.
　なお、「被写体の状態が事前状態になった」とは、完全一致に限られず、ズレを含んだ類似の状態でもよい。状態判定においてどの程度のズレを許容するかは閾値の設定により調整することができる。閾値を高くすれば、閾値が低い場合に比べてズレが少ない状態で被写体の現在の状態が事前状態になったと判定する。一方、閾値を低くすれば、閾値が高い場合に比べて多くのズレを含んだ状態で被写体の現在の状態が事前状態になったと判定する。 Note that "the state of the subject has become the pre-state" is not limited to an exact match, but may be a similar state including a deviation. The degree of deviation allowed in the state determination can be adjusted by setting the threshold value. If the threshold value is increased, it is determined that the current state of the subject has become the prior state with less deviation than when the threshold value is low. On the other hand, if the threshold value is lowered, it is determined that the current state of the subject has become the prior state in a state including a large amount of deviation as compared with the case where the threshold value is high.
　フローチャートの説明に戻る。次にステップＳ１０３でアシストモードがオンになってから一定時間が経過していない場合、処理はステップＳ１０４に進む（ステップＳ１０３のＮｏ）。 Return to the explanation of the flowchart. Next, if a certain time has not elapsed since the assist mode was turned on in step S103, the process proceeds to step S104 (No in step S103).
　次にステップＳ１０４で、状態判定部２０１が、判定値が閾値以上であると判定した場合、処理はステップＳ１０５に進む（ステップＳ１０４のＹｅｓ）。そしてステップＳ１０５でトリガ処理部２０２はトリガを発生させる。 Next, if the state determination unit 201 determines in step S104 that the determination value is equal to or greater than the threshold value, the process proceeds to step S105 (Yes in step S104). Then, in step S105, the trigger processing unit 202 generates a trigger.
　次にステップＳ１０６で、トリガ発生後調整時間が経過した場合処理はステップＳ１０７に進む（ステップＳ１０６のＹｅｓ）。そしてステップＳ１０７で、設定変更処理部２０３は撮像装置１００の設定を設定Ａから設定Ｂに変更する。 Next, in step S106, when the adjustment time has elapsed after the trigger is generated, the process proceeds to step S107 (Yes in step S106). Then, in step S107, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 from the setting A to the setting B.
　調整時間は、０秒以上で任意の長さに設定することが可能である。調整時間は一般的に撮影者の撮影技術に応じて調整するのが望ましい。 The adjustment time can be set to any length with 0 seconds or more. It is generally desirable to adjust the adjustment time according to the shooting technique of the photographer.
　例えば、高い撮影技術を有するプロのカメラマンにおいては図７に示すように調整時間を長くすることにより、撮像装置１００の設定が変更されてから撮影対象状態になるまでの時間である余裕時間を短くすることができる。これにより、被写体が撮影対象状態になる直前まで設定は変更されないことになり、被写体が撮影対象状態になる直前まで設定Ａで撮影を行うことができる。なお、撮影技術が高いので撮影対象状態の直前に撮像装置１００の設定が変更しても撮影を行うことができると考えられる。 For example, in a professional photographer having high shooting technology, by lengthening the adjustment time as shown in FIG. 7, the margin time, which is the time from the change of the setting of the image pickup apparatus 100 to the state to be shot, is shortened. can do. As a result, the setting is not changed until just before the subject is in the shooting target state, and shooting can be performed with the setting A until just before the subject is in the shooting target state. Since the shooting technique is high, it is considered that shooting can be performed even if the setting of the image pickup apparatus 100 is changed immediately before the shooting target state.
　一方、撮影技術が高くないアマチュアのカメラマンにおいては図７に示すように調整時間を短くすることにより撮像装置１００の設定が変更されてから撮影対象状態になるまでの余裕時間を長くすることができる。すなわち、調整時間が長い場合に比べて、早めに撮像装置１００の設定を変更することになる。これにより、撮像装置１００の設定が変更されてから被写体が撮影対象状態になるまでの時間が長くなるため、撮影者は余裕を持って落ち着いて撮影を行うことができる。 On the other hand, for an amateur cameraman who is not very skilled in shooting, by shortening the adjustment time as shown in FIG. 7, it is possible to increase the margin time from the change of the setting of the image pickup apparatus 100 to the state to be photographed. .. That is, the setting of the image pickup apparatus 100 is changed earlier than in the case where the adjustment time is long. As a result, it takes a long time for the subject to be in the shooting target state after the setting of the image pickup apparatus 100 is changed, so that the photographer can calmly shoot with a margin.
　また、変更前の設定と変更後の設定の種類に応じて調整時間の長さを決定してもよい。例えば、設定Ｂがオートフォーカスのためにイメージセンサ１２１やレンズ１１１などを連続的に駆動させるため設定Ａよりも消費電力が大きいモードであるとする。この場合、調整時間を長くして撮像装置１００が設定Ａの状態である時間を長くする（設定Ｂである時間を短くする）ことにより消費電力を抑制することが可能となる。 Further, the length of the adjustment time may be determined according to the type of the setting before the change and the setting after the change. For example, it is assumed that the setting B is a mode in which the power consumption is larger than that of the setting A because the image sensor 121, the lens 111, and the like are continuously driven for autofocus. In this case, it is possible to suppress the power consumption by lengthening the adjustment time and lengthening the time in which the image pickup apparatus 100 is in the state of the setting A (shortening the time in the setting B).
　なお、調整時間は０秒に設定することも可能である。調整時間を０秒に設定した場合、トリガ処理部２０２がトリガを発生させたタイミングと同時に設定変更処理部２０３は撮像装置１００の設定を設定Ｂに変更する。 The adjustment time can be set to 0 seconds. When the adjustment time is set to 0 seconds, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting B at the same time as the timing when the trigger processing unit 202 generates the trigger.
　このように調整時間の長さは撮影者の撮影技術や、撮像装置の性能などに合わせて設定するのが好ましい。よって、撮影者は調整時間をどのくらいの長さにするのが最適であるかを事前に確認して決定しておく必要がある。短距離走の撮影であれば、事前行われる練習や、過去の短距離走などを参考にして調整時間の長さを予め決定して情報処理装置２００に設定しておく。 In this way, it is preferable to set the length of the adjustment time according to the shooting technique of the photographer and the performance of the image pickup device. Therefore, it is necessary for the photographer to confirm and determine in advance how long the adjustment time is optimal. In the case of shooting a short-distance run, the length of the adjustment time is determined in advance and set in the information processing apparatus 200 by referring to the practice performed in advance and the past short-distance run.
　また、大、中、小など複数の基準と複数の調整時間の長さを対応させたテーブルを予め情報処理装置２００に保持させておき、その基準を撮影者に提示していずれかを選択させて、選択された基準に基づいて調整時間の長さを決定するようにしてもよい。これは主に撮影技術が高くないアマチュアのカメラマンに対して有効である。 Further, a table corresponding to a plurality of criteria such as large, medium, and small and a plurality of adjustment time lengths is held in advance in the information processing apparatus 200, and the criteria are presented to the photographer to select one. The length of the adjustment time may be determined based on the selected criteria. This is mainly effective for amateur photographers who do not have high shooting skills.
　フローチャートの説明に戻る。次にステップＳ１０８で、撮像装置１００の設定変更後、一定時間が経過した場合処理はステップＳ１０９に進む（ステップＳ１０８のＹｅｓ）。 Return to the explanation of the flowchart. Next, in step S108, when a certain time has elapsed after changing the setting of the image pickup apparatus 100, the process proceeds to step S109 (Yes in step S108).
　次にステップＳ１０９で、撮像装置１００の設定をアシストモードで変更する前の設定である設定Ｘに戻す。なお、ステップＳ１０９におけるアシストモードで変更する前の設定に戻す処理は必須の処理ではなく、設定を戻してもいいし、戻さなくてもよい。そしてステップＳ１１０でアシストモードをオフにして処理は終了となる。 Next, in step S109, the setting of the image pickup apparatus 100 is returned to the setting X which is the setting before changing in the assist mode. The process of returning to the setting before the change in the assist mode in step S109 is not an essential process, and the setting may or may not be returned. Then, in step S110, the assist mode is turned off and the process ends.
　なお、ステップＳ１０３で一定時間が経過している場合、処理はステップＳ１０８に進み、アシストモードをオフにして処理は終了となる。これは、状態判定を開始した後に判定値が閾値以上となる前に一定時間が経過した場合には撮影者が撮影したい所望状態にはならないとしてアシストモードを終了させる。 If a certain period of time has passed in step S103, the process proceeds to step S108, the assist mode is turned off, and the process ends. This terminates the assist mode on the assumption that if a certain period of time elapses after the state determination is started and before the determination value becomes equal to or higher than the threshold value, the desired state that the photographer wants to shoot is not reached.
　上述の説明では被写体の動作を被写体の状態としたが、他にも、被写体の姿勢、被写体の速度、位置、体の特定の部位の位置などを被写体の状態として処理を行うこともできる。また、それらの組み合わせを被写体の状態として処理を行うこともできる。 In the above explanation, the movement of the subject is regarded as the state of the subject, but in addition, the posture of the subject, the speed and position of the subject, the position of a specific part of the body, and the like can be processed as the state of the subject. Further, it is also possible to process the combination as the state of the subject.
　例えば、被写体の姿勢を被写体の状態にすることにより、被写体が撮影対象状態である姿勢になる前に事前状態の姿勢になったタイミングでトリガを発生させて撮像装置１００の設定を変更することができる。これにより、撮影者は被写体が撮影対象状態の姿勢になった状態を特定の撮像装置１００の設定で撮影することができる。 For example, by setting the posture of the subject to the posture of the subject, it is possible to change the setting of the image pickup apparatus 100 by generating a trigger at the timing when the posture of the subject is in the pre-state before the posture of the subject is in the shooting target state. can. As a result, the photographer can shoot a state in which the subject is in the posture of the shooting target state with the setting of the specific imaging device 100.
　被写体の姿勢を被写体の状態にする場合、状態判定における判定値は被写体の現在の姿勢と事前状態における姿勢の一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在の姿勢が事前状態の姿勢になったとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。被写体の現在の姿勢と事前状態の姿勢の一致度は、機械学習、Deep Learningなどを用いた公知の画像比較方法より得ることができる。 When the posture of the subject is set to the state of the subject, the judgment value in the state determination indicates the degree of coincidence between the current posture of the subject and the posture in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current posture of the subject has become the posture in the prior state. The degree of agreement between the current posture of the subject and the posture in the prior state can be obtained by a known image comparison method using machine learning, deep learning, or the like.
　また、被写体の速度を被写体の状態にすることにより、被写体が撮影対象状態である速度になる前に事前状態の速度になったタイミングでトリガを発生させて撮像装置１００の設定を変更することができる。これにより、撮影者は被写体が撮影対象状態の速度になった状態を特定の撮像装置１００の設定で撮影することができる。これは被写体の加速度においても同様である。 Further, by setting the speed of the subject to the state of the subject, it is possible to change the setting of the image pickup apparatus 100 by generating a trigger at the timing when the speed reaches the pre-state before the subject reaches the speed of the shooting target state. can. As a result, the photographer can shoot a state in which the subject has reached the speed of the shooting target state with the setting of the specific imaging device 100. This also applies to the acceleration of the subject.
　被写体の速度を被写体の状態にする場合、状態判定における判定値は被写体の現在の速度と事前状態における速度の一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在の速度が事前状態の速度になったとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。被写体の現在の速度と事前状態の速度の一致度は、例えば撮影のフレームレートと複数のフレーム間における被写体の移動距離に基づいて速度をそれぞれ算出し、それらを比較することで得ることができる。 When the speed of the subject is set to the state of the subject, the judgment value in the state determination indicates the degree of coincidence between the current speed of the subject and the speed in the prior state. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current speed of the subject has reached the speed in the prior state. The degree of agreement between the current speed of the subject and the speed in the prior state can be obtained by, for example, calculating the speeds based on the frame rate of shooting and the moving distance of the subject between a plurality of frames and comparing them.
　また、被写体の位置を被写体の状態にすることにより、被写体が撮影対象状態である位置に到達する前の事前状態の位置に到達したタイミングで撮像装置１００の設定を変更することができる。これにより、撮影者は被写体が撮影対象状態の位置に到達した状態を特定の撮像装置１００の設定で撮影することができる。 Further, by setting the position of the subject to the state of the subject, the setting of the image pickup apparatus 100 can be changed at the timing when the position of the pre-state before the subject reaches the position of the shooting target state. As a result, the photographer can take a picture of the state in which the subject has reached the position of the picture target state with the setting of the specific image pickup device 100.
　被写体の位置を被写体の状態にする場合、状態判定における判定値は例えば画角内における被写体の現在位置と事前状態の位置の一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在位置が事前状態の位置に到達したとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。被写体の現在の位置と事前状態の位置の一致度は、例えば画角内における被写体の現在の座標と事前状態における座標との比較で得ることができる。 When the position of the subject is set to the state of the subject, the determination value in the state determination indicates, for example, the degree of coincidence between the current position of the subject and the position of the prior state within the angle of view. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current position of the subject has reached the position in the prior state. The degree of coincidence between the current position of the subject and the position in the prior state can be obtained, for example, by comparing the current coordinates of the subject within the angle of view with the coordinates in the prior state.
　また、被写体の体の特定の部位の位置を被写体の状態にすることにより、被写体の体の部位が撮影対象状態である位置に到達する前の事前状態の位置に到達したタイミングで撮像装置１００の設定を変更することができる。これにより、撮影者は被写体の体の部位が撮影対象状態の位置に到達した状態を特定の撮像装置１００の設定で撮影することができる。 Further, by setting the position of a specific part of the body of the subject to the state of the subject, the image pickup apparatus 100 reaches the position of the pre-state before the part of the body of the subject reaches the position of the shooting target state. You can change the settings. As a result, the photographer can take a picture of the state in which the body part of the subject reaches the position of the picture target state with the setting of the specific image pickup device 100.
　例えば、被写体の頭の地面からの高さという特定の部位の位置を被写体の状態にする場合、状態判定における判定値は現在の頭の高さと事前状態における頭の高さの一致度を示すものである。そして、判定値が閾値を超えた場合、被写体の現在の頭の高さが事前状態の頭の高さになったとして、状態判定部２０１は判定結果をトリガ処理部２０２に供給する。被写体の頭の高さと事前状態の頭の高さの一致度は、例えば画角内における現在の頭の位置の座標と事前状態における頭の位置の座標との比較で得ることができる。 For example, when the position of a specific part such as the height of the head of the subject from the ground is set to the state of the subject, the judgment value in the state determination indicates the degree of agreement between the current head height and the head height in the prior state. Is. Then, when the determination value exceeds the threshold value, the state determination unit 201 supplies the determination result to the trigger processing unit 202, assuming that the current head height of the subject has reached the head height in the prior state. The degree of agreement between the height of the head of the subject and the height of the head in the prior state can be obtained, for example, by comparing the coordinates of the current head position within the angle of view with the coordinates of the head position in the prior state.
［１－３－２．トリガを複数回発生させる例］
　次に撮影期間内にトリガを複数回発生させて、撮像装置１００の設定を複数回変更する例について説明する。上述した図３の例では撮影期間内にトリガを一回発生させて撮像装置１００の設定を一回変更したが、撮影期間内にトリガを複数回発生させて、撮像装置１００の設定を複数回変更することも可能である。 [1-3-2. Example of generating a trigger multiple times]
Next, an example in which the trigger is generated a plurality of times during the shooting period and the setting of the image pickup apparatus 100 is changed a plurality of times will be described. In the example of FIG. 3 described above, the trigger is generated once during the shooting period and the setting of the image pickup apparatus 100 is changed once. However, the trigger is generated multiple times during the shooting period and the setting of the image pickup apparatus 100 is set multiple times. It is also possible to change it.
　図８に示すように陸上競技の短距離走の撮影において、時間２における被写体のスタート直後の動作を撮影対象状態Ｂとして設定Ｂで撮影し、時間４の被写体が起き上がって走っている動作を撮影対象状態Ｃとして設定Ｃで撮影し、時間６のゴールした後の動作を撮影対象状態Ｄとして設定Ｄで撮影するように、撮像装置１００の設定を変更する場合を例にする。 As shown in FIG. 8, in shooting a sprint in athletics, the movement immediately after the start of the subject at time 2 is shot at setting B as the shooting target state B, and the movement of the subject at time 4 rising up and running is shot. An example is a case where the setting of the image pickup apparatus 100 is changed so that the operation after the goal of the time 6 is taken with the setting C as the target state C and the operation after the goal of the time 6 is taken with the setting D as the shooting target state D.
　時間２の撮影対象状態Ｂの撮影用に撮像装置１００を設定Ｂに変更するためにトリガ処理部２０２は被写体の状態が事前状態ＢになるとトリガＢを発生させる。その後、時間４の撮影対象状態Ｃの撮影用に撮像装置１００を設定Ｃに変更するためにトリガ処理部２０２は被写体の状態が事前状態ＣになるとトリガＣを発生させる。さらにその後、時間６の撮影対象状態Ｄの撮影用に撮像装置１００を設定Ｄに変更するためにトリガ処理部２０２は被写体の状態が事前状態ＤになるとトリガＤを発生させる。図８ではトリガを３回発生させてから撮像装置１００の設定を３回変更しているが、その回数はあくまで例示であり、トリガの発生回数および設定の変更回数は１回以上であれば何回でもよい。 The trigger processing unit 202 generates the trigger B when the state of the subject becomes the pre-state B in order to change the image pickup apparatus 100 to the setting B for the shooting of the shooting target state B at the time 2. After that, in order to change the image pickup apparatus 100 to the setting C for the shooting of the shooting target state C at time 4, the trigger processing unit 202 generates the trigger C when the state of the subject becomes the prior state C. After that, in order to change the image pickup apparatus 100 to the setting D for shooting in the shooting target state D at time 6, the trigger processing unit 202 generates a trigger D when the state of the subject becomes the prior state D. In FIG. 8, the setting of the image pickup apparatus 100 is changed three times after the trigger is generated three times, but the number of times is merely an example, and the number of times the trigger is generated and the number of times the setting is changed is one or more. It may be times.
　その各トリガの発生のために、図９に示すように状態判定部２０１は被写体の現在の状態が各事前状態になったか否かを事前状態ごとの判定値と、事前状態ごとの閾値を用いて判定する。なお、撮影期間内に複数回撮像装置１００の設定を変更するためには複数の事前状態を特定する必要があるが、その複数の事前状態の順序も特定しておく必要がある。状態判定部２０１による判定方法は上述した設定を一回変更する場合と同様である。 As shown in FIG. 9, the state determination unit 201 uses the determination value for each pre-state and the threshold value for each pre-state to determine whether or not the current state of the subject has reached each pre-state for the generation of each trigger. To judge. In order to change the setting of the image pickup apparatus 100 multiple times within the shooting period, it is necessary to specify a plurality of pre-states, but it is also necessary to specify the order of the plurality of pre-states. The determination method by the state determination unit 201 is the same as the case where the above-mentioned setting is changed once.
　被写体の現在の状態と事前状態Ｂの一致度を示す判定値を判定値Ｂとし、被写体の現在の状態が事前状態Ｂになったと判定する閾値を閾値Ｂとする。また、被写体の現在の状態と事前状態Ｃの一致度を示す判定値を判定値Ｃとし、被写体の現在の状態が事前状態Ｃになったと判定する閾値を閾値Ｃとする。さらに、被写体の現在の状態と事前状態Ｄの一致度を示す判定値を判定値Ｄとし、被写体の現在の状態が事前状態Ｄになったと判定する閾値を閾値Ｄとする。なお、事前状態の特定方法は上述したトリガを一回発生させる例において説明した方法と同様である。 The determination value indicating the degree of agreement between the current state of the subject and the prior state B is defined as the determination value B, and the threshold value for determining that the current state of the subject has reached the prior state B is defined as the threshold value B. Further, the determination value indicating the degree of coincidence between the current state of the subject and the prior state C is defined as the determination value C, and the threshold value for determining that the current state of the subject has reached the prior state C is defined as the threshold value C. Further, the determination value indicating the degree of coincidence between the current state of the subject and the prior state D is set as the determination value D, and the threshold value for determining that the current state of the subject is in the prior state D is set as the threshold value D. The method of specifying the prior state is the same as the method described in the above-mentioned example of generating the trigger once.
　図１０および図１１のフローチャートを参照して、情報処理装置２００によるトリガを複数回発生させて撮像装置１００の設定を複数回変更する処理について説明する。 With reference to the flowcharts of FIGS. 10 and 11, a process of generating a trigger by the information processing apparatus 200 a plurality of times to change the setting of the image pickup apparatus 100 a plurality of times will be described.
　まずステップＳ２０１で、撮影者からの入力に応じて情報処理装置２００が動作するアシストモードをオンにする。このアシストモードをオンにするのと同時に撮像装置１００により設定が設定Ａにされる。次にステップＳ２０２で状態判定部２０１が被写体の状態判定を開始する。 First, in step S201, the assist mode in which the information processing apparatus 200 operates according to the input from the photographer is turned on. At the same time when this assist mode is turned on, the setting is set to A by the image pickup apparatus 100. Next, in step S202, the state determination unit 201 starts the state determination of the subject.
　次にステップＳ２０３で、直近の事前状態は事前状態Ｂであるか否かを確認する。直近の事前状態が事前状態Ｂである場合、処理はステップＳ２０４に進む（ステップＳ２０３のＹｅｓ）。 Next, in step S203, it is confirmed whether or not the latest pre-state is the pre-state B. If the latest pre-state is the pre-state B, the process proceeds to step S204 (Yes in step S203).
　次にステップＳ２０４で、アシストモードがオンになってから一定時間が経過していない場合処理はステップＳ２０５に進む（ステップＳ２０４のＮｏ）。 Next, in step S204, if a certain time has not elapsed since the assist mode was turned on, the process proceeds to step S205 (No in step S204).
　なお、ステップＳ２０４で一定時間が経過している場合、トリガＢを発生させることなく、ステップＳ２１０で撮像装置１００の設定を変更前の設定である設定Ｘに変更し、ステップＳ２１１でアシストモードをオフにして処理は終了となる。 If a certain period of time has elapsed in step S204, the setting of the image pickup apparatus 100 is changed to the setting X before the change in step S210 without generating the trigger B, and the assist mode is turned off in step S211. And the process ends.
　次にステップＳ２０５で、状態判定部２０１が判定値は閾値Ｂ以上であると判定した場合、処理はステップＳ２０６に進む（ステップＳ２０５のＹｅｓ）。そしてステップＳ２０６でトリガ処理部２０２はトリガＢを発生させる。 Next, if the state determination unit 201 determines in step S205 that the determination value is equal to or greater than the threshold value B, the process proceeds to step S206 (Yes in step S205). Then, in step S206, the trigger processing unit 202 generates the trigger B.
　次にステップＳ２０７で、トリガＢの発生後、調整時間が経過した場合、処理はステップＳ２０８に進む（ステップＳ２０７のＹｅｓ）。そしてステップＳ２０８で、設定変更処理部２０３は撮像装置１００の設定を設定Ｂに変更する。 Next, in step S207, if the adjustment time has elapsed after the occurrence of trigger B, the process proceeds to step S208 (Yes in step S207). Then, in step S208, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting B.
　次にステップＳ２０９で、まだ全ての設定変更を行っていない場合、処理はステップＳ２０３に進む（ステップＳ２０９のＮｏ）。 Next, in step S209, if all the settings have not been changed yet, the process proceeds to step S203 (No in step S209).
　被写体の状態が事前状態ＢになってトリガＢを発生させて撮像装置１００を設定Ｂに変更したため、次の事前状態は事前状態Ｃである。よって、処理はステップＳ２０３からステップＳ２１３に進む（ステップＳ２０３のＮｏ）。 Since the state of the subject became the pre-state B and the trigger B was generated to change the image pickup apparatus 100 to the setting B, the next pre-state is the pre-state C. Therefore, the process proceeds from step S203 to step S213 (No in step S203).
　次にステップＳ２１３で、直近の事前状態が事前状態Ｃであるか否かを確認する。直近の事前状態が事前状態Ｃである場合、処理はステップＳ２１４に進む（ステップＳ２１３のＹｅｓ）。 Next, in step S213, it is confirmed whether or not the latest pre-state is the pre-state C. When the latest pre-state is the pre-state C, the process proceeds to step S214 (Yes in step S213).
　次にステップＳ２１４で、アシストモードがオンになってから一定時間が経過していない場合、処理はステップＳ２１５に進む（ステップＳ２１４のＮｏ）。 Next, in step S214, if a certain time has not elapsed since the assist mode was turned on, the process proceeds to step S215 (No in step S214).
　なお、ステップＳ２１４で一定時間が経過している場合、トリガＣを発生させることなく、ステップＳ２１９で撮像装置１００の設定を変更前の設定である設定Ｘに変更し、ステップＳ２２０でアシストモードをオフにして処理は終了となる。 If a certain period of time has elapsed in step S214, the setting of the image pickup apparatus 100 is changed to the setting X before the change in step S219 without generating the trigger C, and the assist mode is turned off in step S220. And the process ends.
　次にステップＳ２１５で、状態判定部２０１が判定値は閾値Ｃ以上であると判定した場合、処理はステップＳ２１６に進む（ステップＳ２１５のＹｅｓ）。そしてステップＳ２１６でトリガ処理部２０２はトリガＣを発生させる。 Next, if the state determination unit 201 determines in step S215 that the determination value is equal to or higher than the threshold value C, the process proceeds to step S216 (Yes in step S215). Then, in step S216, the trigger processing unit 202 generates the trigger C.
　次にステップＳ２１７で、トリガＢの発生後調整時間が経過した場合、処理はステップＳ２１８に進む（ステップＳ２０７のＹｅｓ）。そしてステップＳ２１８で、設定変更処理部２０３は撮像装置１００の設定を設定Ｃに変更する。 Next, in step S217, if the adjustment time has elapsed after the occurrence of trigger B, the process proceeds to step S218 (Yes in step S207). Then, in step S218, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting C.
　次にステップＳ２０９で、まだ全ての設定変更を行っていない場合、処理はステップＳ２０３に進む（ステップＳ２０９のＮｏ）。 Next, in step S209, if all the settings have not been changed yet, the process proceeds to step S203 (No in step S209).
　トリガＣを発生させて撮像装置１００の設定を設定Ｃに変更したため、次のトリガはトリガＤである。よって、処理はステップＳ２０３からステップＳ２１３に進み（ステップＳ２０３のＮｏ）、ステップＳ２１３からステップＳ２２１に進む（ステップＳ２１３のＮｏ）。 Since the trigger C was generated and the setting of the image pickup apparatus 100 was changed to the setting C, the next trigger is the trigger D. Therefore, the process proceeds from step S203 to step S213 (No in step S203), and proceeds from step S213 to step S221 (No in step S213).
　次にステップＳ２２１で、アシストモードがオンになってから一定時間が経過していない場合処理はステップＳ２２２に進む（ステップＳ２２１のＮｏ）。 Next, in step S221, if a certain time has not elapsed since the assist mode was turned on, the process proceeds to step S222 (No in step S221).
　なお、ステップＳ２２１で一定時間が経過している場合、トリガＤを発生させることなく、ステップＳ２２６で撮像装置１００の設定を変更前の設定である設定Ｘに変更し、ステップＳ２２７でアシストモードをオフにして処理は終了となる。 If a certain period of time has elapsed in step S221, the setting of the image pickup apparatus 100 is changed to the setting X before the change in step S226 without generating the trigger D, and the assist mode is turned off in step S227. And the process ends.
　次にステップＳ２２２で、状態判定部２０１が判定値は閾値Ｄ以上であると判定した場合、処理はステップＳ２２３に進む（ステップＳ２２２のＹｅｓ）。そしてステップＳ２２３でトリガ処理部２０２はトリガＤを発生させる。 Next, if the state determination unit 201 determines in step S222 that the determination value is equal to or greater than the threshold value D, the process proceeds to step S223 (Yes in step S222). Then, in step S223, the trigger processing unit 202 generates the trigger D.
　次にステップＳ２２４で、トリガＤの発生後調整時間が経過した場合、処理はステップＳ２２５に進む（ステップＳ２２４のＹｅｓ）。そしてステップＳ２２５で、設定変更処理部２０３は撮像装置１００の設定を設定Ｄに変更する。 Next, in step S224, if the adjustment time has elapsed after the trigger D has occurred, the process proceeds to step S225 (Yes in step S224). Then, in step S225, the setting change processing unit 203 changes the setting of the image pickup apparatus 100 to the setting D.
　次にステップＳ２０９で、全ての設定変更を行った場合、処理はステップＳ２２８に進む（ステップＳ２０９のＹｅｓ）。 Next, if all the settings have been changed in step S209, the process proceeds to step S228 (Yes in step S209).
その後、ステップＳ２２８で最後の設定変更後一定時間が経過した場合、処理はステップＳ２２９に進む（ステップＳ２２８のＹｅｓ）。 After that, when a certain time has elapsed after the last setting change in step S228, the process proceeds to step S229 (Yes in step S228).
　次にステップＳ２２９で、アシストモードで変更する前の設定である設定Ｘに戻す。そしてステップＳ２３０でアシストモードをオフにして処理は終了となる。 Next, in step S229, return to the setting X, which is the setting before changing in the assist mode. Then, in step S230, the assist mode is turned off and the process ends.
　なお、ステップＳ２１０、ステップＳ２１９、ステップＳ２２６およびステップＳ２２９におけるアシストモードで変更する前の設定に戻す処理は必須の処理ではなく、設定を戻してもいいし、戻さなくてもよい。 Note that the process of returning to the setting before the change in the assist mode in step S210, step S219, step S226 and step S229 is not an essential process, and the setting may or may not be returned.
　なお、図３、図８、どちらの例においてもアシストモードをオンにしたタイミングで撮像装置１００の設定を設定Ａとし、トリガ発生後に撮像装置１００の設定を設定Ａから設定Ｂに変更した。しかし、アシストモードをオンにしたタイミングで撮像装置１００の設定を変更するのは必須ではなく、図１２に示すようにアシストモードをオンにする前からの設定である設定Ｘをそのまま継続し、トリガ発生後に設定Ｘから設定Ｂに変更するようにしてもよい。 In both the examples of FIGS. 3 and 8, the setting of the image pickup apparatus 100 was set to the setting A at the timing when the assist mode was turned on, and the setting of the image pickup apparatus 100 was changed from the setting A to the setting B after the trigger was generated. However, it is not essential to change the setting of the image pickup apparatus 100 at the timing when the assist mode is turned on, and as shown in FIG. 12, the setting X which is the setting before the assist mode is turned on is continued as it is, and a trigger is obtained. You may change from setting X to setting B after the occurrence.
　なお、上述した撮影期間においてトリガを一回発生させる場合と、トリガを複数回発生させる場合のどちらにおいても、撮影指示であるレリーズは撮像装置１００の入力部１９２に対する撮影者の入力に基づいて行ってもよいし、自動で行ってもよい。例えば、被写体認識結果に基づいて自動でレリーズを行ってもよいし、トリガ発生後または撮像装置１００の設定変更後所定の時間が経過したタイミングでレリーズを自動で行うようにしてもよい。また、レリーズは撮像装置１００自体ではなく、外部装置からの遠隔入力でもよい。撮影を自動で行う場合、撮像装置１００が自動撮影機能を有している場合にはそれを用いてもよいし、情報処理装置２００から撮像装置１００に対して撮影を指示する制御信号を送信する自動撮影処理を情報処理装置２００が行うようにしてもよい。 In both the case where the trigger is generated once during the above-mentioned shooting period and the case where the trigger is generated a plurality of times, the release instruction for shooting is performed based on the input of the photographer to the input unit 192 of the image pickup apparatus 100. It may be done automatically or it may be done automatically. For example, the release may be automatically performed based on the subject recognition result, or the release may be automatically performed at the timing when a predetermined time has elapsed after the trigger is generated or the setting of the image pickup apparatus 100 is changed. Further, the release may be a remote input from an external device instead of the image pickup device 100 itself. When shooting is automatically performed, if the image pickup device 100 has an automatic shooting function, it may be used, or a control signal instructing the image pickup device 100 to shoot is transmitted from the information processing device 200. The information processing apparatus 200 may perform the automatic shooting process.
［１－３－３．ユーザインターフェース］
　次に通知処理部２０４による通知のためのユーザインターフェースについて説明する。通知内容には、撮像装置１００の設定の種類、撮像装置１００の現在の設定状況、撮像装置１００の設定変更が行われる予告などがある。 [1-3-3. User interface]
Next, a user interface for notification by the notification processing unit 204 will be described. The content of the notification includes the type of setting of the image pickup device 100, the current setting status of the image pickup device 100, the notice that the setting change of the image pickup device 100 is performed, and the like.
　通知方法としては、例えば、図１３に示すように撮像装置１００の表示部１８１に表示されるスルー画に枠３０１を重畳表示するという方法がある。撮影期間内に撮像装置１００の設定を複数回変更する場合には、例えば、図１３Ａ乃至図１３Ｄに示すように枠３０１の色を設定の種類ごとに異なる色にするとよい。図１３では枠の色を異なる色にすることで図１３Ａが設定Ａ、図１３Ａが設定Ｂ、図１３Ａが設定Ｃ、図１３Ｄが設定Ｄを示している。 As a notification method, for example, as shown in FIG. 13, there is a method of superimposing the frame 301 on the through image displayed on the display unit 181 of the image pickup apparatus 100. When the setting of the image pickup apparatus 100 is changed a plurality of times within the shooting period, for example, the color of the frame 301 may be different for each setting type as shown in FIGS. 13A to 13D. In FIG. 13, by changing the color of the frame to a different color, FIG. 13A shows the setting A, FIG. 13A shows the setting B, FIG. 13A shows the setting C, and FIG. 13D shows the setting D.
　また、枠３０１の点灯状態を継続させることで撮像装置１００が現在、上述の色で表す設定で動作していることを通知する。この通知は撮像装置１００の設定が変更された時点から行い、撮像装置１００がその変更された設定で動作している間中継続して行うとよい。さらに、枠３０１を点滅させることで、撮像装置１００の設定変更が行われる旨の予告通知を行う。この予告通知はトリガ発生から撮像装置１００の設定変更処理までの間であればどのタイミングで行ってもよい。 Further, by continuing the lighting state of the frame 301, it is notified that the image pickup apparatus 100 is currently operating with the setting represented by the above-mentioned color. This notification may be given from the time when the setting of the image pickup apparatus 100 is changed, and may be continuously given while the image pickup apparatus 100 is operating with the changed setting. Further, by blinking the frame 301, a notice is given to the effect that the setting of the image pickup apparatus 100 is changed. This notice may be given at any timing between the trigger generation and the setting change process of the image pickup apparatus 100.
　他にも、図１４に示すように撮像装置１００の表示部１８１に表示されるスルー画にアイコン３０２を重畳表示するという通知方法もある。この場合、アイコン３０２に含める文字や記号などで設定の種類を通知し、アイコン３０２の点灯状態を継続させることで撮像装置１００が現在アイコン３０２の文字や記号で表す設定で動作していることを通知し、アイコン３０２を点滅させることで撮像装置１００の設定変更が行われる旨を通知する。 In addition, as shown in FIG. 14, there is also a notification method in which the icon 302 is superimposed and displayed on the through image displayed on the display unit 181 of the image pickup apparatus 100. In this case, the type of setting is notified by the characters and symbols included in the icon 302, and the imaging device 100 is currently operating with the settings represented by the characters and symbols of the icon 302 by keeping the lighting state of the icon 302. Notify and notify that the setting of the image pickup apparatus 100 is changed by blinking the icon 302.
　通知は表示部１８１における表示だけでなく、撮像装置１００がスピーカ１９４における音声出力を利用した音声通知でもよい。また、撮像装置１００が振動機能を備える場合には振動を利用した通知でもよい。さらに、撮像装置１００がＬＥＤなどの発光体を備える場合にはその発光を利用した通知でもよい。複数回の設定変更を行う場合には音声の種類、振動の種類、発光の種類を設定ごとに異なるものにするとよい。 The notification may be not only the display on the display unit 181 but also the voice notification using the voice output of the speaker 194 by the image pickup apparatus 100. Further, when the image pickup apparatus 100 has a vibration function, a notification using vibration may be used. Further, when the image pickup apparatus 100 includes a light emitting body such as an LED, notification using the light emission may be used. When changing the settings multiple times, the type of sound, the type of vibration, and the type of light emission should be different for each setting.
　また、撮像装置１００の設定を変更すべきタイミングを撮影者に通知してもよい。その通知を確認した撮影者は撮像装置１００に対して設定変更を指示する入力を行うことで撮像装置１００の設定を変更する。この通知は、上述した撮像装置１００の設定変更が行われる旨の予告通知と同じ方法でもよいし、異なる方法でもよい。 Further, the photographer may be notified of the timing when the setting of the image pickup apparatus 100 should be changed. The photographer who confirms the notification changes the setting of the image pickup apparatus 100 by inputting an input instructing the image pickup apparatus 100 to change the setting. This notification may be the same method as the above-mentioned notice notification that the setting of the image pickup apparatus 100 is changed, or may be a different method.
　図１５に示すように、撮像装置１００以外の装置、例えばパーソナルコンピュータやタブレット端末などのサイズが大きい表示部４００を有する装置における表示では、ライブビュー表示４０１や操作パネル表示４０２に重畳させずにアイコン３０２を表示してもよい。これによりアイコン３０２により表示の一部が隠れてしまうことがない。 As shown in FIG. 15, in the display on a device other than the image pickup device 100, for example, a device having a large display unit 400 such as a personal computer or a tablet terminal, the icon is not superimposed on the live view display 401 or the operation panel display 402. 302 may be displayed. As a result, a part of the display is not hidden by the icon 302.
　図１６および図１７は、表示部１８１に表示される、事前状態を特定するための事前状態特定用ユーザインターフェースの例である。図１６Ａに示すように、事前状態特定用ユーザインターフェースは撮影の対象や被写体の種類から構成される階層構造となっている。 16 and 17 are examples of a user interface for specifying a prior state, which is displayed on the display unit 181 for specifying the prior state. As shown in FIG. 16A, the user interface for specifying the prior state has a hierarchical structure composed of a shooting target and a type of subject.
　例えば図１６の例では、撮影対象としてスポーツを選択すると、スポーツの種類として予め用意しているサッカー、野球、バレーボールなどの候補を提示する。そこで、例えばサッカーが選択されると、予め用意しているサッカーにおけるシーンの種類としてシュート、パス、スローイング、キャッチング／パンチングなどを提示する。そこで例えばシュートが選択されると、予め用意しているシュートに関連するシーンとしてテイクバック、インパクト、フォロースルーなどを提示する。通常、サッカーのシュートのインパクトの前にはテイクバックがあるため、撮影対象状態がインパクトである場合、撮影者はテイクバックを事前状態として選択する。これにより、テイクバックの動作が事前状態として特定される。 For example, in the example of FIG. 16, when a sport is selected as a shooting target, candidates such as soccer, baseball, and volleyball prepared in advance as the type of sport are presented. Therefore, for example, when soccer is selected, shoot, pass, throwing, catching / punching, and the like are presented as the types of scenes in soccer prepared in advance. Therefore, for example, when a shoot is selected, takeback, impact, follow-through, etc. are presented as scenes related to the shoot prepared in advance. Normally, there is a takeback before the impact of a soccer shot, so if the shooting target state is an impact, the photographer selects the takeback as the pre-state. As a result, the takeback operation is specified as a pre-state.
　さらに被写体の状態がその事前状態になったと判定された場合に変更する撮像装置１００の設定パラメータ（図１６Ａではシャッタスピード、ＩＳＯ、Ｆ値、フォーカス位置、ホワイトバランスなど）を撮影者の入力や、所定のテンプレート、アルゴリズムなどに基づいて設定する。 Further, the photographer inputs the setting parameters of the image pickup apparatus 100 (shutter speed, ISO, F value, focus position, white balance, etc. in FIG. 16A) to be changed when it is determined that the state of the subject has reached the pre-state. Set based on a predetermined template, algorithm, etc.
　高い撮影技術を有するプロのカメラマンに対しては、例えば撮影対象がスポーツである場合には、図１６Ｂに示すようにスポーツの種別とシーンと撮像装置１００の設定を予め組み合わせておき、それを事前状態特定用ユーザインターフェースで提示することで撮影者が任意の事前状態を特定できるようにしてもよい。 For professional photographers with high shooting skills, for example, when the shooting target is sports, the sports type and scene and the settings of the image pickup device 100 are combined in advance as shown in FIG. 16B, and the settings are combined in advance. The photographer may be able to specify an arbitrary prior state by presenting it on the state specifying user interface.
　また、撮影技術が高くないアマチュアのカメラマンに対しては、例えば撮影対象がスポーツである場合には、図１７Ａに示すようにスポーツの種別だけをユーザインターフェースで提示し、撮影者がそのいずれかを選択すれば撮像装置１００と情報処理装置２００がそのスポーツにおける特徴的な被写体の状態を認識して事前状態を特定するようにしてもよい。 For amateur photographers who do not have high shooting skills, for example, when the shooting target is sports, only the type of sports is presented on the user interface as shown in FIG. 17A, and the photographer indicates one of them. If selected, the image pickup apparatus 100 and the information processing apparatus 200 may recognize the state of a characteristic subject in the sport and specify the pre-state.
　さらに、撮影技術が高くないアマチュアのカメラマンに対しては、図１７Ｂに示すように、撮影対象の種類だけをユーザインターフェースで提示し、撮影者がそのいずれかを選択すれば撮像装置１００と情報処理装置２００がその撮影対象における特徴的な被写体の状態を認識して事前状態を特定するようにしてもよい。 Further, for amateur photographers who do not have high shooting skills, as shown in FIG. 17B, only the type of shooting target is presented on the user interface, and if the photographer selects one of them, the image pickup device 100 and information processing are performed. The device 200 may recognize the state of a characteristic subject in the shooting target and specify the pre-state.
　以上のようにして本技術における処理が行われる。本技術によれば、被写体が撮影対象状態になる前に撮像装置をその撮影に適した設定に自動で変更することができるため、動体視力や運動能力や撮影技術など撮影者の能力に関わらず、最適な設定で撮影を行うことが可能となる。 The processing in this technology is performed as described above. According to this technology, the image pickup device can be automatically changed to the setting suitable for the shooting before the subject is in the shooting target state, regardless of the photographer's ability such as dynamic visual acuity, motor ability, and shooting technique. , It is possible to shoot with the optimum settings.
　撮影者の個人の能力差によって撮像装置１００の設定の変更に要する時間がばらついてしまうことを抑制できるため、適切な設定でシャッターチャンスを逃さずに撮影できるという効果を撮影者に提供することができる。 Since it is possible to prevent the time required to change the settings of the image pickup apparatus 100 from being varied due to differences in the individual abilities of the photographer, it is possible to provide the photographer with the effect of being able to shoot without missing a photo opportunity with appropriate settings. can.
　また、変更できる撮像装置１００の設定は特定のものに限られないため、被写体の種類など様々な撮影条件に合わせて幅広く撮像装置１００の設定を変更することができる。 Further, since the setting of the image pickup device 100 that can be changed is not limited to a specific one, the setting of the image pickup device 100 can be widely changed according to various shooting conditions such as the type of subject.
＜２．変形例＞
　以上、本技術の実施の形態について具体的に説明したが、本技術は上述の実施の形態に限定されるものではなく、本技術の技術的思想に基づく各種の変形が可能である。 <2. Modification example>
Although the embodiment of the present technology has been specifically described above, the present technology is not limited to the above-described embodiment, and various modifications based on the technical idea of the present technology are possible.
　情報処理装置２００は、撮像装置１００に限らず、スマートフォン、パーソナルコンピュータ、タブレット端末、携帯ゲーム機、ウェアラブルデバイスなどカメラ機能を備える装置であればどのような装置においても用いることが可能である。 The information processing device 200 is not limited to the image pickup device 100, and can be used in any device having a camera function such as a smartphone, a personal computer, a tablet terminal, a portable game machine, and a wearable device.
　また、情報処理装置２００はサーバ、クラウドにおいて動作してもよい。その場合、情報処理装置２００はネットワークを介して撮像装置１００から受信した撮影画像を用いて状態判定を行い、設定変更を指示する制御情報をネットワークを介して撮像装置１００に送信することで設定変更処理を行う。 Further, the information processing device 200 may operate in a server or a cloud. In that case, the information processing device 200 determines the state using the captured image received from the image pickup device 100 via the network, and transmits the control information instructing the setting change to the image pickup device 100 via the network to change the setting. Perform processing.
　状態判定部２０１は撮像装置１００の画角内の一部の領域における被写体の状態に基づいて状態判定を行ってもよい。例えば、被写体が動作は変わるが、位置は変わらずに画角内の右側に位置している場合、画角を中央から左右の領域に分け、右側の領域の撮影画像のみで状態判定を行う、などである。これにより画角全体の撮影画像で状態判定を行うよりも処理を軽くすることができる。 The state determination unit 201 may perform state determination based on the state of the subject in a part of the angle of view of the image pickup apparatus 100. For example, if the subject changes its behavior but is located on the right side of the angle of view without changing its position, the angle of view is divided into left and right areas from the center, and the state is judged only by the captured image in the right area. And so on. As a result, it is possible to make the processing lighter than performing the state determination on the captured image of the entire angle of view.
　実施の形態ではトリガの発生後に設定変更処理部２０３が撮像装置１００の設定を変更する処理を行うが、トリガの発生の有無に関わらず、撮影者から設定を変更する指示入力があった場合、設定変更処理部２０３はその撮影者からの指示入力を優先して撮像装置１００の設定を変更してもよい。 In the embodiment, the setting change processing unit 203 performs a process of changing the setting of the image pickup apparatus 100 after the trigger is generated. However, when the photographer gives an instruction to change the setting regardless of whether or not the trigger is generated, the setting change processing unit 203 performs the process of changing the setting of the image pickup apparatus 100. The setting change processing unit 203 may change the setting of the image pickup apparatus 100 by giving priority to the instruction input from the photographer.
　撮影者からの指示入力方法としては、ボタンなどの撮像装置１００が備える入力部１９２への入力操作、音声入力などがある。撮影期間内に複数回設定を変更する場合には、複数の設定をそれぞれ異なる撮像装置１００のボタンなどに割り当てるとよい。また、音声入力の場合には、複数の設定をそれぞれ異なる音声に割り当てるとよい。例えば設定Ａは「エー」と発音する音声に割り当て、設定Ｂは「ビー」と発音する音声に割り当てるなどである。 As an instruction input method from the photographer, there are an input operation to the input unit 192 provided in the image pickup apparatus 100 such as a button, a voice input, and the like. When changing the settings a plurality of times during the shooting period, it is preferable to assign the plurality of settings to different buttons of the imaging device 100 or the like. In the case of voice input, it is advisable to assign a plurality of settings to different voices. For example, setting A is assigned to the voice pronounced "A", setting B is assigned to the voice pronounced "B", and so on.
　また、情報処理装置２００は撮像装置１００の動きの加速度に応じて設定を変更するようにしてもよい。例えば、撮像装置１００の動きの加速度が所定値以上の場合に撮像装置１００の設定を変更する、アシストモードをオフにする、などである。また、撮影期間内に複数の設定に変更する場合には、複数の設定をそれぞれ異なる加速度に割り当てるとよい。例えば、撮像装置１００の加速度が所定の加速度Ａ以上の場合は設定Ａに変更し、撮像装置１００の加速度が所定の加速度Ｃ以下の場合は設定Ｃに変更し、撮像装置１００の加速度が所定の加速度Ａ未満であり、かつ、加速度Ｃ超過の場合は設定Ｂに変更する、などである。撮像装置１００の動きの加速度に応じて設定変更処理を行うためには撮像装置１００が加速度センサを備え、加速度センサが検出したセンサ情報を情報処理装置２００に供給する必要がある。 Further, the information processing device 200 may change the setting according to the acceleration of the movement of the image pickup device 100. For example, when the acceleration of the movement of the image pickup apparatus 100 is equal to or higher than a predetermined value, the setting of the image pickup apparatus 100 is changed, the assist mode is turned off, and the like. Further, when changing to a plurality of settings within the shooting period, it is advisable to assign the plurality of settings to different accelerations. For example, if the acceleration of the image pickup device 100 is equal to or higher than the predetermined acceleration A, the setting is changed to A, and if the acceleration of the image pickup device 100 is equal to or less than the predetermined acceleration C, the setting is changed to C, and the acceleration of the image pickup device 100 is predetermined. If the acceleration is less than A and the acceleration C is exceeded, the setting is changed to B, and so on. In order to perform the setting change process according to the acceleration of the movement of the image pickup device 100, the image pickup device 100 is provided with an acceleration sensor, and it is necessary to supply the sensor information detected by the acceleration sensor to the information processing device 200.
　さらに、情報処理装置２００はフレーミングやジェスチャーに応じて撮像装置１００の設定変更するようにしてもよい。フレーミングの例としては、撮像装置１００のレンズが地面（下方向）を向いたことを検出した場合に撮像装置１００の設定を変更する、アシストモードをオフにする、などである。撮像装置１００のレンズが地面を向いたか否かは画像における被写体認識や、ジャイロセンサや加速度センサを用いた姿勢検出方法によって検出することができる。フレーミングに応じて設定変更処理を行うためには撮像装置１００がジャイロセンサや加速度センサを備え、センサ情報を情報処理装置２００に供給する必要がある。 Further, the information processing device 200 may change the setting of the image pickup device 100 according to framing and gestures. Examples of framing include changing the setting of the image pickup apparatus 100 when it is detected that the lens of the image pickup apparatus 100 faces the ground (downward), turning off the assist mode, and the like. Whether or not the lens of the image pickup apparatus 100 faces the ground can be detected by subject recognition in an image or a posture detection method using a gyro sensor or an acceleration sensor. In order to perform the setting change processing according to the framing, the image pickup device 100 is provided with a gyro sensor and an acceleration sensor, and it is necessary to supply the sensor information to the information processing device 200.
　ジェスチャーの例としては、撮影者がレンズの前に手をかざすなどの所定のジェスチャーを検出した場合に撮像装置１００の設定を変更する、アシストモードをオフにする、などである。撮影者のジェスチャーは、画像における被写体認識により検出できるし、非接触の手の動きを検出する赤外線センサなどを撮像装置１００に設けることで検出できる。ジェスチャーに応じて設定変更処理を行うためには撮像装置１００がジャイロセンサや加速度センサを備え、センサ情報を情報処理装置２００に供給する必要がある。 Examples of gestures include changing the setting of the image pickup apparatus 100 and turning off the assist mode when the photographer detects a predetermined gesture such as holding a hand in front of the lens. The gesture of the photographer can be detected by recognizing the subject in the image, and can be detected by providing the image pickup apparatus 100 with an infrared sensor or the like that detects the movement of the non-contact hand. In order to perform the setting change process according to the gesture, the image pickup device 100 is provided with a gyro sensor and an acceleration sensor, and it is necessary to supply the sensor information to the information processing device 200.
　本技術は以下のような構成も取ることができる。
（１）
　被写体の状態が予め定めた事前状態になったか否かを判定する状態判定部と、
　前記状態判定部が前記被写体の状態が前記事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させるトリガ処理部と
を備える情報処理装置。
（２）
　前記事前状態は、前記撮像装置を用いた撮影の対象とする状態である撮影対象状態になる前の前記被写体の状態である（１）に記載の情報処理装置。
（３）
　前記トリガの発生後から所定時間経過後に前記撮像装置の設定を変更する処理を行う
設定変更処理部を備える（２）に記載の情報処理装置。
（４）
　前記所定時間は、前記撮像装置の設定変更処理完了後、前記撮影対象状態に至るまでの長さを調整するための調整時間である（３）に記載の情報処理装置。
（５）
　前記調整時間はユーザが設定可能である（４）に記載の情報処理装置。
（６）
　前記調整時間は０秒以上の長さで任意の長さに設定可能である（４）または（５）に記載の情報処理装置。
（７）
　前記状態判定部は、前記撮像装置により生成された画像における前記被写体の現在の状態と前記事前状態の一致度を示す判定値が閾値を超えた場合に前記被写体の現在の状態が前記事前状態になったと判定する（１）から（６）のいずれかに記載の情報処理装置。
（８）
　前記被写体の状態は、前記被写体の動作、姿勢、位置、速度のいずれかまたは組み合わせである（１）から（７）のいずれかに記載の情報処理装置。
（９）
　前記トリガ処理部は、前記被写体の複数の状態に応じて複数の前記トリガを発生させる（１）から（８）のいずれかに記載の情報処理装置。
（１０）
　前記トリガの発生後に撮影者に対する通知の処理を行う通知処理部を備える（１）から（９）のいずれかに記載の情報処理装置。
（１１）
　前記通知処理部は、前記トリガの発生後、前記撮影者に対して前記撮像装置の設定を変更する旨の通知処理を行う（１０）に記載の情報処理装置。
（１２）
　前記通知処理部は、前記撮影者に対して前記撮像装置の現在の設定を通知する処理を行う（１０）または（１１）に記載の情報処理装置。
（１３）
　前記通知処理部は、前記トリガの発生後、前記撮影者に対して前記撮像装置の設定を変更するタイミングである旨の通知処理を行う（１０）から（１２）のいずれかに記載の情報処理装置。
（１４）
　前記設定変更処理部によって前記撮像装置の設定が変更された後に前記撮像装置の自動撮影処理を行う（３）に記載の情報処理装置。
（１５）
　前記設定変更処理部は、前記トリガの発生の有無に関わらず、撮影者からの入力応じて前記撮像装置の設定を変更する処理を行う（３）に記載の情報処理装置。
（１６）
　被写体の状態が予め定めた事前状態になったか否かを判定し、
　前記被写体の状態が前記事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させる情報処理方法。
（１７）
　被写体の状態が予め定めた事前状態になったか否かを判定し、
　前記被写体の状態が前記事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させる情報処理方法をコンピュータに実行させる情報処理プログラム。 This technology can also take the following configurations.
(1)
A state determination unit that determines whether or not the state of the subject has reached a predetermined pre-state,
An information processing device including a trigger processing unit that generates a trigger for changing a setting of an image pickup device when the state determination unit determines that the state of the subject has reached the prior state.
(2)
The information processing apparatus according to (1), wherein the prior state is a state of the subject before the state to be photographed, which is a state to be photographed by the image pickup apparatus.
(3)
The information processing apparatus according to (2), comprising a setting change processing unit that performs a process of changing the setting of the image pickup apparatus after a predetermined time has elapsed from the occurrence of the trigger.
(4)
The information processing apparatus according to (3), wherein the predetermined time is an adjustment time for adjusting the length until the shooting target state is reached after the setting change processing of the imaging device is completed.
(5)
The information processing apparatus according to (4), wherein the adjustment time can be set by the user.
(6)
The information processing apparatus according to (4) or (5), wherein the adjustment time has a length of 0 seconds or more and can be set to an arbitrary length.
(7)
In the state determination unit, when the determination value indicating the degree of agreement between the current state of the subject and the prior state in the image generated by the image pickup device exceeds the threshold value, the current state of the subject is the prior. The information processing apparatus according to any one of (1) to (6), which determines that the state has been reached.
(8)
The information processing apparatus according to any one of (1) to (7), wherein the state of the subject is any or a combination of the movement, posture, position, and speed of the subject.
(9)
The information processing apparatus according to any one of (1) to (8), wherein the trigger processing unit generates a plurality of the triggers according to a plurality of states of the subject.
(10)
The information processing apparatus according to any one of (1) to (9), comprising a notification processing unit that processes a notification to the photographer after the trigger is generated.
(11)
The information processing device according to (10), wherein the notification processing unit performs notification processing to change the setting of the image pickup device to the photographer after the trigger is generated.
(12)
The information processing device according to (10) or (11), wherein the notification processing unit performs a process of notifying the photographer of the current setting of the image pickup device.
(13)
The information processing according to any one of (10) to (12), wherein the notification processing unit performs notification processing to the photographer that it is time to change the setting of the image pickup device after the trigger is generated. Device.
(14)
The information processing apparatus according to (3), wherein the automatic photographing process of the image pickup apparatus is performed after the setting of the image pickup apparatus is changed by the setting change processing unit.
(15)
The information processing device according to (3), wherein the setting change processing unit performs a process of changing the setting of the image pickup device according to an input from the photographer regardless of whether or not the trigger is generated.
(16)
It is determined whether or not the state of the subject has reached a predetermined pre-state, and
An information processing method that generates a trigger for changing the setting of an image pickup apparatus when it is determined that the state of the subject has reached the prior state.
(17)
It is determined whether or not the state of the subject has reached a predetermined pre-state, and
An information processing program that causes a computer to execute an information processing method for generating a trigger for changing a setting of an image pickup apparatus when it is determined that the state of the subject has reached the prior state.
２００・・・情報処理装置
２０１・・・状態判定部
２０２・・・トリガ処理部
２０３・・・設定変更処理部
２０４・・・通知処理部 200 ... Information processing device 201 ... Status determination unit 202 ... Trigger processing unit 203 ... Setting change processing unit 204 ... Notification processing unit

Claims (17)

  1. 　被写体の状態が予め定めた事前状態になったか否かを判定する状態判定部と、
    　前記状態判定部が前記被写体の状態が前記事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させるトリガ処理部と
    を備える
    情報処理装置。     A state determination unit that determines whether or not the state of the subject has reached a predetermined pre-state,
    An information processing device including a trigger processing unit that generates a trigger for changing a setting of an image pickup device when the state determination unit determines that the state of the subject has reached the prior state.
  2. 　前記事前状態は、前記撮像装置を用いた撮影の対象とする状態である撮影対象状態になる前の前記被写体の状態である
    請求項１に記載の情報処理装置。     The information processing apparatus according to claim 1, wherein the prior state is a state of the subject before the state to be photographed by the image pickup apparatus.
  3. 　前記トリガの発生後から所定時間経過後に前記撮像装置の設定を変更する処理を行う
    設定変更処理部を備える
    請求項２に記載の情報処理装置。     The information processing apparatus according to claim 2, further comprising a setting change processing unit that performs a process of changing the setting of the image pickup apparatus after a predetermined time has elapsed from the occurrence of the trigger.
  4. 　前記所定時間は、前記撮像装置の設定変更処理完了後、前記撮影対象状態に至るまでの長さを調整するための調整時間である
    請求項３に記載の情報処理装置。     The information processing apparatus according to claim 3, wherein the predetermined time is an adjustment time for adjusting the length until the shooting target state is reached after the setting change processing of the imaging device is completed.
  5. 　前記調整時間はユーザが設定可能である
    請求項４に記載の情報処理装置。     The information processing apparatus according to claim 4, wherein the adjustment time can be set by the user.
  6. 　前記調整時間は０秒以上の長さで任意の長さに設定可能である
    請求項４に記載の情報処理装置。     The information processing apparatus according to claim 4, wherein the adjustment time has a length of 0 seconds or more and can be set to an arbitrary length.
  7. 　前記状態判定部は、前記撮像装置により生成された画像における前記被写体の現在の状態と前記事前状態の一致度を示す判定値が閾値を超えた場合に前記被写体の現在の状態が前記事前状態になったと判定する
    請求項１に記載の情報処理装置。     In the state determination unit, when the determination value indicating the degree of agreement between the current state of the subject and the prior state in the image generated by the image pickup device exceeds the threshold value, the current state of the subject is the prior. The information processing apparatus according to claim 1, wherein it is determined that the state has been reached.
  8. 　前記被写体の状態は、前記被写体の動作、姿勢、位置、速度のいずれかまたは組み合わせである
    請求項１に記載の情報処理装置。     The information processing apparatus according to claim 1, wherein the state of the subject is any or a combination of the movement, posture, position, and speed of the subject.
  9. 　前記トリガ処理部は、前記被写体の複数の状態に応じて複数の前記トリガを発生させる
    請求項１に記載の情報処理装置。     The information processing device according to claim 1, wherein the trigger processing unit generates a plurality of the triggers according to a plurality of states of the subject.
  10. 　前記トリガの発生後に撮影者に対する通知の処理を行う通知処理部を備える
    請求項１に記載の情報処理装置。     The information processing apparatus according to claim 1, further comprising a notification processing unit that processes a notification to the photographer after the trigger is generated.
  11. 　前記通知処理部は、前記トリガの発生後、前記撮影者に対して前記撮像装置の設定を変更する旨の通知処理を行う
    請求項１０に記載の情報処理装置。     The information processing device according to claim 10, wherein the notification processing unit performs notification processing to the photographer to change the setting of the image pickup device after the trigger is generated.
  12. 　前記通知処理部は、前記撮影者に対して前記撮像装置の現在の設定を通知する処理を行う
    請求項１０に記載の情報処理装置。     The information processing device according to claim 10, wherein the notification processing unit performs a process of notifying the photographer of the current setting of the image pickup device.
  13. 　前記通知処理部は、前記トリガの発生後、前記撮影者に対して前記撮像装置の設定を変更するタイミングである旨の通知処理を行う
    請求項１０に記載の情報処理装置。     The information processing device according to claim 10, wherein the notification processing unit performs notification processing to the photographer that it is time to change the setting of the image pickup device after the trigger is generated.
  14. 　前記設定変更処理部によって前記撮像装置の設定が変更された後に前記撮像装置の自動撮影処理を行う
    請求項３に記載の情報処理装置。     The information processing device according to claim 3, wherein the setting change processing unit changes the setting of the image pickup device, and then the automatic photographing process of the image pickup device is performed.
  15. 　前記設定変更処理部は、前記トリガの発生の有無に関わらず、撮影者からの入力応じて前記撮像装置の設定を変更する処理を行う
    請求項３に記載の情報処理装置。     The information processing device according to claim 3, wherein the setting change processing unit performs a process of changing the setting of the image pickup device in response to an input from the photographer regardless of whether or not the trigger is generated.
  16. 　被写体の状態が予め定めた事前状態になったか否かを判定し、
    　前記被写体の状態が前記事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させる
    情報処理方法。     It is determined whether or not the state of the subject has reached a predetermined pre-state, and
    An information processing method that generates a trigger for changing the setting of an image pickup apparatus when it is determined that the state of the subject has reached the prior state.
  17. 　被写体の状態が予め定めた事前状態になったか否かを判定し、
    　前記被写体の状態が前記事前状態になったと判定した場合、撮像装置の設定変更用のトリガを発生させる
    情報処理方法をコンピュータに実行させる情報処理プログラム。     It is determined whether or not the state of the subject has reached a predetermined pre-state, and
    An information processing program that causes a computer to execute an information processing method for generating a trigger for changing a setting of an image pickup apparatus when it is determined that the state of the subject has reached the prior state.
PCT/JP2021/035785 2020-10-09 2021-09-29 Information processing device, information processing method, and information processing program WO2022075134A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2022555390A JPWO2022075134A1 (en) 2020-10-09 2021-09-29

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020-171151 2020-10-09
JP2020171151 2020-10-09

Publications (1)

Publication Number Publication Date
WO2022075134A1 true WO2022075134A1 (en) 2022-04-14

Family

ID=81125951

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/035785 WO2022075134A1 (en) 2020-10-09 2021-09-29 Information processing device, information processing method, and information processing program

Country Status (2)

Country Link
JP (1) JPWO2022075134A1 (en)
WO (1) WO2022075134A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004297197A (en) * 2003-03-25 2004-10-21 Fuji Photo Film Co Ltd Photographing control method
JP2010239169A (en) * 2007-08-08 2010-10-21 Panasonic Corp Imaging device
JP2016213548A (en) * 2015-04-30 2016-12-15 カシオ計算機株式会社 Imaging system, imaging method, detector and imaging device
WO2020195925A1 (en) * 2019-03-27 2020-10-01 ソニー株式会社 Video processing device and video processing method

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004297197A (en) * 2003-03-25 2004-10-21 Fuji Photo Film Co Ltd Photographing control method
JP2010239169A (en) * 2007-08-08 2010-10-21 Panasonic Corp Imaging device
JP2016213548A (en) * 2015-04-30 2016-12-15 カシオ計算機株式会社 Imaging system, imaging method, detector and imaging device
WO2020195925A1 (en) * 2019-03-27 2020-10-01 ソニー株式会社 Video processing device and video processing method

Also Published As

Publication number Publication date
JPWO2022075134A1 (en) 2022-04-14

Similar Documents

Publication Publication Date Title
US20240069412A1 (en) Image pickup device and method of tracking subject thereof
US11696016B2 (en) Imaging apparatus and display control method thereof
US20060098104A1 (en) Image capturing apparatus
US10194074B2 (en) Imaging system, warning generation device and method, imaging device and method, and program
JP6244062B2 (en) Imaging apparatus, imaging apparatus main body, and imaging apparatus control method
JP2015005799A (en) Subject detection device, control method of the same, imaging apparatus, control program of subject detection device, and storage medium
JP2014075635A (en) Imaging system, imaging method, light-emitting device, imaging apparatus, and program
KR101817659B1 (en) Digital photographing apparatus and method of controlling the same
JP2008028747A (en) Imaging device and program thereof
US20120008923A1 (en) Shooting apparatus
US20230131361A1 (en) Imaging apparatus, method of controlling imaging apparatus, and program
WO2022075134A1 (en) Information processing device, information processing method, and information processing program
JP2011151482A (en) Imaging apparatus and method for controlling the same
JP7342883B2 (en) Imaging control device, imaging device, imaging control method
JP2006246355A (en) Imaging unit, control method and program
US10027922B2 (en) Imaging apparatus for displaying a specific scene while continuously photographing, image playback method, and non-transitory computer-readable storage medium
JP2014006286A (en) Image projection device and image projection method
US20230186449A1 (en) Image processing apparatus, image processing method, imaging apparatus, and storage medium
JP2010193254A (en) Imaging apparatus and group photographing support program
JP6727975B2 (en) Imaging device, control method thereof, and program
WO2020066316A1 (en) Photographing apparatus, photographing method, and program
JP5372285B2 (en) IMAGING DEVICE AND METHOD, PROGRAM, AND STORAGE MEDIUM
JP5323245B2 (en) Imaging device
KR101474304B1 (en) Method for controlling the digital image processing apparatus and the digital image processing apparatus of operating by the method
JP5142978B2 (en) Imaging apparatus, control method therefor, program, and recording medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21877435

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022555390

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21877435

Country of ref document: EP

Kind code of ref document: A1