WO2016178267A1 - Image-capturing instructing device, image capturing system, image capturing method, and program - Google Patents

Image-capturing instructing device, image capturing system, image capturing method, and program Download PDF

Info

Publication number
WO2016178267A1
WO2016178267A1 PCT/JP2015/063074 JP2015063074W WO2016178267A1 WO 2016178267 A1 WO2016178267 A1 WO 2016178267A1 JP 2015063074 W JP2015063074 W JP 2015063074W WO 2016178267 A1 WO2016178267 A1 WO 2016178267A1
Authority
WO
WIPO (PCT)
Prior art keywords
imaging
shooting
image
unit
instruction
Prior art date
Application number
PCT/JP2015/063074
Other languages
French (fr)
Japanese (ja)
Inventor
石井　謙介
さおり 松本
新 篠崎
渡辺　伸之
由貴 佐藤
Original Assignee
オリンパス株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by オリンパス株式会社 filed Critical オリンパス株式会社
Priority to PCT/JP2015/063074 priority Critical patent/WO2016178267A1/en
Publication of WO2016178267A1 publication Critical patent/WO2016178267A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B15/00—Special procedures for taking photographs; Apparatus therefor
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00—Details of cameras or camera bodies; Accessories therefor
    • G03B17/38—Releasing-devices separate from shutter
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing

Definitions

  • the present invention relates to an imaging instruction apparatus, an imaging system, an imaging method, and a program.
  • Self-portrait There is an imaging method called “self-portrait” (hereinafter referred to as “self-portrait”) in which an image including itself is captured with the camera facing the camera.
  • Self-shooting includes, for example, a method of setting a shutter release by a self-timer and moving to a place where the subject is photographed during that time, and a method of taking an image from a remote position by taking an imaging instruction by remote control operation .
  • Patent Document 1 describes a camera in which an imaging unit is activated after a predetermined time has elapsed when a shooting instruction is issued by a remote release unit.
  • the present invention has been made to solve the above-described problem, and is an imaging instruction apparatus, imaging system, imaging method, and program capable of realizing a more natural self-taking by shooting after preparation for shooting is completed.
  • the purpose is to provide.
  • the imaging instruction device is based on at least one information of information indicating the magnitude of shaking of the imaging device and information on the state of the subject in the image being captured by the imaging device.
  • a shooting condition determination unit that determines whether or not a shooting condition is satisfied, and when the shooting condition determination unit determines that the shooting condition is satisfied, the imaging apparatus performs shooting for still image recording after a predetermined time has elapsed since the determination was made.
  • the shooting instruction unit that issues a shooting instruction to perform image shooting and the shooting condition determination unit satisfies the shooting condition, at least one of the vibration module and the audio output module is operated, and the user determines
  • a notification control unit that controls to notify the result.
  • the information related to the state of the subject in the first aspect is the number of subjects appearing in the image being photographed, and the photographing condition determination unit
  • the number of subjects may be recognized based on the number of face images of the subject in the image, and it may be determined that the shooting condition is satisfied if the number of recognized subjects is a predetermined number.
  • the information relating to the state of the subject in the first aspect or the second aspect is the position of one or more subjects in the image being photographed
  • the shooting condition determination unit recognizes the position of the subject based on the position indicated by the face image of the subject in the image being shot, and sets the shooting condition if the recognized position of the one or more subjects is within a predetermined range. You may determine with satisfy
  • the imaging condition determination unit is a magnitude of shaking of the imaging device.
  • the magnitude of shaking of the imaging device may be determined based on the information shown, and if the magnitude of shaking of the imaging device is within a predetermined threshold, it may be determined that the imaging condition is satisfied.
  • the imaging condition determination unit uses the imaging condition for determination, An input of a condition for designating at least one of a time from when it is determined that the shooting condition is satisfied to when shooting is performed, the number of subjects included in the image being shot, or the position of the subject is received.
  • An input unit may be further provided.
  • the imaging condition determination unit is configured to instruct the user to stop imaging.
  • the stop of shooting may be determined based on information indicating the magnitude of shaking of the imaging device or information on the state of the subject in the image being captured by the imaging device.
  • the imaging system further includes a first communication unit that communicates with the imaging device, according to any one of the first to sixth aspects.
  • An imaging instruction device an imaging unit, a second communication unit that communicates with the imaging instruction device, a vibration detection unit that detects shaking of the own device, and a state of a subject that is captured in an image being captured by the imaging unit
  • an image processing unit for recognizing.
  • the imaging method is based on at least one of information indicating information indicating the magnitude of shaking of the imaging device and information relating to the state of the subject in the image being captured by the imaging device. If it is determined whether or not the shooting condition is satisfied, and it is determined that the shooting condition is satisfied, imaging is performed so that the imaging apparatus executes shooting of a still image recording shot image after a lapse of a predetermined time since the determination is made. An instruction is given, and at least one of the vibration module and the audio output module is operated, and control is performed to notify the user of the determination result.
  • the program causes the computer of the imaging instruction apparatus to perform information on information indicating a magnitude of shaking of the imaging apparatus and information on a state of a subject that is captured in an image being captured by the imaging apparatus.
  • Means for instructing photographing to execute photographing means for controlling to operate at least one of the vibration module and the audio output module when notifying that the photographing condition is satisfied, and to notify the user of the judgment result Make it work.
  • the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging.
  • the imaging instruction device instructs the imaging device to take an image.
  • the user can photograph himself / herself after preparation for photographing is completed.
  • the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
  • 1 is a functional block diagram illustrating a configuration of an imaging system according to a first embodiment of the present invention.
  • 1 is an external view illustrating a specific configuration example of an imaging system according to a first embodiment of the present invention. It is a figure which shows the usage example of the imaging system in the 1st Embodiment of this invention. It is the 1st figure showing the example of a screen of the imaging directions device in a 1st embodiment of the present invention. It is the 2nd figure which showed the example of a screen of the imaging instruction
  • 3 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention. It is a 1st flowchart which shows an example of the flow of a process of the imaging instruction
  • FIG. 1 is a functional block diagram showing the configuration of the imaging system according to the first embodiment of the present invention.
  • An imaging system 1 illustrated in FIG. 1 includes an imaging instruction device 10 and an imaging device 20.
  • the imaging instruction device 10 issues an imaging instruction to the imaging device 20, and the imaging device 20 performs imaging based on the imaging instruction.
  • the imaging instruction device 10 includes an input / output unit 11, a condition setting unit 12, an imaging condition determination unit 13, a notification control unit 14, an imaging instruction unit 15, a memory 16, a first communication unit 17, and a first communication unit 17. 1 timer unit 18.
  • the imaging instruction device 10 may be a dedicated operation terminal that controls the imaging device 20.
  • indication apparatus 10 may be the form which incorporated the application software which controls the imaging device 20 in portable communication terminals, such as a smart phone and a tablet terminal, for example. In this case, various other application software may be incorporated in the mobile communication terminal in addition to the application software for controlling the imaging device 20.
  • the input / output unit 11 includes an input device such as a button and a touch panel, and a display device such as a liquid crystal display.
  • the input / output unit 11 displays various images such as an image of an operation screen necessary for performing self-portrait.
  • the input / output unit 11 receives an input operation from the user. For example, the input / output unit 11 receives an input of a selfie start instruction operation by the user. In addition, the input / output unit 11 receives an input of a shooting condition setting operation related to self-photographing by the user. In addition, the input / output unit 11 receives an input of a user's self-shooting process cancel operation.
  • the condition setting unit 12 records the shooting condition indicated by the setting operation received by the input / output unit 11 in the memory 16.
  • the imaging condition is, for example, that the magnitude of shaking of the imaging device 20 is within a predetermined range.
  • the imaging condition is, for example, designation with respect to the number of subjects that appear in the image being captured by the imaging device 20.
  • the imaging condition is, for example, designation with respect to the position of the subject that appears in the image being captured by the imaging device 20.
  • the shooting condition determination unit 13 determines whether or not preparation for shooting (self-portrait) is completed based on the shooting conditions recorded by the condition setting unit 12.
  • the notification control unit 14 notifies the user who performs self-shooting that the preparation for shooting has been completed. For example, the notification control unit 14 notifies the user by operating the audio output module to output sound from a speaker included in the own apparatus, or operating the vibration module included in the own apparatus to vibrate the own apparatus. . Further, the notification control unit 14 may perform a notification for notifying the user that shooting has been performed at the timing of shooting.
  • the shooting instruction unit 15 issues a shooting instruction to the imaging device 20. Specifically, the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17.
  • the memory 16 is a non-volatile recording medium such as a memory built in the imaging instruction apparatus 10 and stores various information such as an image generated by the imaging apparatus 20 and imaging conditions.
  • the first communication unit 17 performs wireless communication with the imaging device 20.
  • the first timer unit 18 measures the time that has elapsed since the shooting condition determination unit 13 determined that preparation for self-taking was completed.
  • the imaging condition determination unit 13 outputs information notifying that the predetermined time has elapsed to the above-described imaging instruction unit 15 when a predetermined time has elapsed since the determination.
  • the display control unit 19 generates a screen image displayed by the input / output unit 11.
  • the condition setting unit 12, the imaging condition determination unit 13, the notification control unit 14, and the imaging instruction unit 15 are read out and executed by an arithmetic unit such as a CPU (Central Processing Unit) provided in the imaging instruction device 10. It can be realized as a software function.
  • an arithmetic unit such as a CPU (Central Processing Unit) provided in the imaging instruction device 10. It can be realized as a software function.
  • the imaging device 20 includes an imaging unit 21, a vibration detection unit 22, an image processing unit 23, a control unit 24, and a second communication unit 25.
  • the imaging unit 21 generates an image obtained by photographing the subject.
  • the imaging unit 21 outputs the generated image to the image processing unit 23 and the second communication unit 25. It should be noted that an image obtained by capturing and outputting a subject by the imaging unit 21 is a “sensor output image”, an image transmitted to the imaging instruction apparatus 10 for confirmation by the user, and the image processing unit 23 performs image processing on the “sensor output image”.
  • the image with the reduced resolution is the “low-resolution temporary image”
  • the display control unit 19 reads the “low-resolution temporary image” and the image displayed on the input / output unit 11 is the “live image”
  • the still image captured by the imaging unit 21 An image to be recorded as “still image recording photographic image” may be referred to as “still image recording photographic image”, and an image displayed on the display screen by the display control unit 19 reading “still image recording photographic image” may be referred to as “rec view image”.
  • the vibration detection unit 22 detects the magnitude of shaking of the imaging device 20.
  • the vibration detection unit 22 is, for example, a two-axis digital level. Alternatively, the vibration detection unit 22 may be an acceleration sensor or a gyro sensor.
  • the vibration detection unit 22 outputs information indicating the magnitude of the detected shake to the second communication unit 25.
  • the image processing unit 23 detects a subject from the sensor output image acquired from the imaging unit 21 by a face recognition technique. When the image processing unit 23 detects the subject, the image processing unit 23 calculates coordinate information of an area in which the face of the subject appears in the sensor output image. The image processing unit 23 performs image processing such as automatic trimming processing and filter processing on the sensor output image.
  • the control unit 24 controls the operation of the imaging device 20. For example, the control unit 24 transmits the image generated by the imaging unit 21, the information on the shake detected by the vibration detection unit 22, the coordinate information of the subject reflected in the image calculated by the image processing unit 23, and the like via the second communication unit 25. Control to transmit to the imaging instruction apparatus 10. In addition, when receiving the imaging instruction information via the second communication unit 25, the control unit 24 controls the imaging unit 21 to start imaging.
  • the second communication unit 25 performs wireless communication with the imaging instruction device 10.
  • the image processing unit 23 and the control unit 24 can be realized as a software function when a calculation unit such as a CPU (Central Processing Unit) provided in the imaging apparatus 20 reads and executes a program.
  • the image processing unit 23 and the control unit 24 may be realized using hardware such as ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field-Programmable Gate Array).
  • FIG. 2 is an external view showing a specific configuration example of the imaging system according to the first embodiment of the present invention.
  • the imaging system 1 illustrated in FIG. 2 includes an imaging instruction device 10, an imaging device 20, and an optical module 30.
  • the imaging instruction device 10 and the imaging device 20 are connected by wireless communication.
  • An optical module 30 is mounted on the front surface of the imaging device 20.
  • the optical module 30 can be attached to and detached from the imaging device 20.
  • the imaging device 20 and the optical module 30 may be configured integrally.
  • the imaging instruction device 10 is provided with, for example, a shooting button for instructing the start of self-shooting.
  • a shooting button for instructing the start of self-shooting.
  • the imaging device 20 performs shooting of a subject in cooperation with the imaging instruction device 10.
  • the optical module 30 is an optical unit that includes a lens and a lens control device that controls zoom, focus, aperture, and the like to form a subject image.
  • the imaging device 20 forms an image of subject light incident via the optical module 30 and photoelectrically converts an optical image of the subject, and captures an image corresponding to the pixel signal output from the imaging device by wireless communication. Transmit to the instruction device 10.
  • FIG. 3 is a diagram illustrating a usage example of the imaging system according to the first embodiment of the present invention.
  • FIG. 3 shows how the user takes a selfie using the imaging system of the present embodiment.
  • the user takes a self-portrait by directing the lens of the optical module 30 configured integrally with the imaging device 20 to himself and pressing the shooting button of the imaging instruction device 10.
  • the user holds the imaging device 20, but the user may install the imaging device 20 and take a selfie.
  • the smartphone or the like instead of the imaging device 20 of FIG. Timer shooting is performed while checking the live image displayed on the screen.
  • the user performs a self-portrait by using a self-shooting stick (selfie stick) to instruct remote shooting by wireless communication such as Bluetooth (registered trademark).
  • a self-shooting stick selfie stick
  • wireless communication such as Bluetooth (registered trademark).
  • the user can do multiple things, such as giving imaging instructions, thinking about the composition by looking at the display screen, holding the inside camera in an appropriate position, and creating facial expressions.
  • the operation is complicated. Further, for example, in the case of these methods, there is a possibility that natural shooting cannot be performed because of an image on the display screen. In addition, there is a possibility that the display screen is small and the appearance of himself / herself on the display screen cannot be confirmed well, or the position of the lens of the inside camera and the display screen is shifted and the line of sight is shifted.
  • the imaging system 1 determines whether or not preparation for shooting is completed and performs shooting after a predetermined time has elapsed. That is, in this embodiment, not the user but the imaging system 1 determines the start timing of the shooting timer and the shooting timing associated therewith.
  • the imaging instruction device 10 determines whether or not the imaging preparation is ready in accordance with the degree of shaking of the imaging device 20 and the state of the subject shown in the sensor output image. And the user is notified of the timing of shooting.
  • the user who takes a self-portrait can leave the imaging system 1 to see whether he / she can take it well, it is not necessary to look at the display screen in order to check the live image.
  • the timing of shooting is notified to the user, the user can make a facial expression in accordance with the timing or take a natural posture for shooting.
  • FIG. 4A is a first diagram illustrating a screen example of the imaging instruction apparatus according to the first embodiment of the present invention.
  • FIG. 4B is a second diagram illustrating a screen example of the imaging instruction device according to the first embodiment of the present invention.
  • FIG. 4A shows an example of an image of the selfie setting screen.
  • the screen image displayed on the input / output unit 11 may be simply referred to as a screen.
  • the imaging instruction device 10 includes an input / output unit 11 and a hard button 120.
  • the input / output unit 11 is configured integrally with a touch panel and a display device, and the input / output unit 11 displays a self-portrait setting screen and accepts an input operation from a user.
  • the display control unit 19 generates an image of the selfie setting screen and outputs it to the input / output unit 11.
  • the hard button 120 is an example of an input unit used when a user performs an instruction operation on the imaging instruction device 10.
  • the self-portrait setting screen includes, for example, a completion button 100, a cancel button 101, a timer setting field 102, a sound setting field 103, a composition setting field 104, an image processing setting field 105, and a rec view setting field 106.
  • the completion button 100 is an image of a button that the user presses when saving the setting content set by the user on the selfie setting screen.
  • the cancel button 101 is an image of a button that the user presses when discarding the setting contents.
  • the timer setting field 102 is an item for setting a time (shooting waiting time) from when it is determined that the preparation for shooting is completed until shooting is performed. For example, the user sets 3 seconds in the timer setting field 102.
  • the sound setting column 103 is an item for designating a voice to be notified to the user when the countdown until the shooting is started when it is determined that the shooting preparation is completed, and a voice at the time of shooting.
  • the composition setting column 104 is an item for setting the composition of an image to be shot. For example, it is possible to select from a composition centered on the face of the subject, a configuration in which the background on the left side of the subject is captured, and a configuration in which the background on the right side of the subject is captured.
  • the image processing setting column 105 is an item for setting correction processing / processing processing performed on an image generated by the imaging apparatus 20. For example, it may be possible to set whether to perform automatic trimming and to set the type of filter processing (for example, portrait).
  • the REC view setting field 106 is an item for setting whether to display a captured image (REC view image).
  • the condition setting unit 12 records the setting contents in the memory 16.
  • the cancel button 101 the setting contents are not changed, and the setting contents already recorded in the memory 16 are used.
  • the display control unit 19 may be configured to output the self-portrait instruction image shown in FIG. 4B to the input / output unit 11.
  • FIG. 4B shows an example of a self-shooting instruction screen.
  • the display control unit 19 when the user inputs an instruction operation for taking a selfie from a menu screen or the like, the display control unit 19 generates an image of the selfie instruction screen and outputs it to the input / output unit 11.
  • the self-portrait setting screen includes, for example, a setting screen calling button 110 and self-portrait execution instruction buttons 111 to 114.
  • the display control unit 19 When the user presses the setting screen call button 110, the display control unit 19 generates an image of the selfie setting screen shown in FIG. 4A and outputs it to the input / output unit 11.
  • the self-taking execution instruction button 111 is a button to be pressed when performing self-taking for one person.
  • the self-portrait execution instruction button 112 is for two persons
  • the self-capture execution instruction button 113 is for three persons
  • the self-execution execution instruction button 114 is a button to be pressed when performing self-taking for four or more persons. .
  • the user selects and presses an appropriate button from the self-shoot execution instruction buttons 111 to 114 according to the number of persons to be photographed.
  • the self-portrait process by the imaging system 1 of the present embodiment is executed.
  • Self-portrait processing according to the present embodiment will be described later with reference to FIGS.
  • FIG. 5 is a first diagram illustrating the photographing condition determination process according to the first embodiment of the present invention.
  • the imaging system 1 determines whether or not the preparation for shooting is complete, and determines the shooting timing. This determination is performed by the imaging condition determination unit 13 of the imaging instruction apparatus 10 based on predetermined imaging conditions.
  • the predetermined condition is, for example, the magnitude of shaking of the imaging device 20.
  • the shooting condition determination unit 13 determines that shooting preparation is not complete because only blurred images can be shot even if shooting is performed in that state.
  • FIG. 5 is a diagram for explaining determination based on the magnitude of shaking of the imaging apparatus 20 among the imaging conditions used for the determination by the imaging condition determination unit 13.
  • FIG. 5 is a graph showing changes in the magnitude of shaking detected by the vibration detection unit 22 included in the imaging device 20.
  • the vertical axis represents the magnitude of shaking
  • the horizontal axis represents time.
  • the vibration detection unit 22 detects shaking in the X-axis direction and the Y-axis direction of the horizontal plane.
  • the information on the shaking in the X-axis direction and the Y-axis direction detected by the vibration detection unit 22 is transmitted to the imaging instruction apparatus 10 at a predetermined time interval in combination with the information on the detection time of each shaking.
  • the first communication unit 17 receives the shake information and records it in the memory 16.
  • a graph 3X is a graph showing the transition of the fluctuation in the X-axis direction recorded in this way.
  • the graph 3Y is a graph showing the transition of fluctuation in the Y-axis direction.
  • the imaging condition determination unit 13 sets the magnitude of the shake of the imaging device 20 within an allowable range over a predetermined period.
  • the magnitude of the shaking of the imaging device 20 is determined to satisfy the imaging condition. For example, the imaging condition determination unit 13 determines that the shaking of the imaging device 20 has subsided at time t when the magnitude of shaking in the X-axis and Y-axis directions at a certain time t satisfies the following equation (1).
  • X (t) and Y (t) are the magnitude of the shake in the X-axis direction and the magnitude of the shake in the Y-axis direction, respectively, at time t.
  • X (t-1) and Y (t-1) are, for example, magnitudes of shaking in the X-axis and Y-axis directions at time t-1 one second before.
  • the imaging condition determination unit 13 shifts t over a predetermined time, and determines that the magnitude of shaking of the imaging device 20 satisfies the imaging condition when Expression (1) is satisfied for each t.
  • FIG. 6 is a second diagram illustrating the photographing condition determination process in the first embodiment of the present invention.
  • FIG. 6 is a diagram illustrating determination based on the state of the subject appearing in the sensor output image among predetermined shooting conditions used for determining whether or not the shooting condition determination unit 13 is ready for shooting.
  • FIG. 6 shows an outline of a composition setting set by the user on the selfie setting screen and a method for recognizing the subject for each number of shooting targets selected on the selfie instruction screen.
  • FIG. 6 shows twelve sensor output images K11, K12, K13, K21, K22, K23, K31, K32, K33, K41, K42, and K43 corresponding to the composition and the number of people.
  • the sensor output image K11 is a diagram illustrating an outline of a method for recognizing a subject when the configuration is “face center” and the number of subjects is “one person”.
  • the composition guide area G11 is an area in which the center coordinates of the face should be included when the composition is “face center” and the number of subjects is “one person”.
  • the composition guide area is determined in advance according to the composition setting and the number of subjects to be photographed, and the coordinate information of each vertex that defines the area of each composition guide area is recorded in the memory 16.
  • the composition guide area G11 is set near the center of the sensor output image because the composition is set to “face center”.
  • the center point P11 is the position of the center of the face image of the subject in the sensor output image K11 calculated as a result of the image processing unit 23 of the imaging device 20 performing image processing on the sensor output image K11 using the face recognition technology.
  • the image processing unit 23 specifies, as subjects, subjects corresponding to the number of subjects designated by the user in order from the largest in the face image candidates indicated by, for example, a rectangular region detected by the face recognition technology at this time. May be calculated.
  • the coordinate information of the face image calculated by the image processing unit 23 is transmitted to the imaging instruction device 10.
  • the imaging condition determination unit 13 determines whether the imaging state of the subject is appropriate based on the coordinate information of the composition guide area recorded in the memory 16 and the coordinate information of the face image received from the imaging apparatus 20. To do. For example, in the case of the sensor output image K11, the center point P11 is included in the composition guide area G11. As described above, when the center point P11 is included in the composition guide area G11 corresponding to the composition and the number of subjects to be photographed, the photographing condition determination unit 13 determines that the state of the subject satisfies the photographing condition.
  • the sensor output image K12 is a diagram illustrating an outline of a method for recognizing a subject when the configuration setting is “left landscape” and the target number of people is “one person”.
  • the configuration guide area G12 is set to the left of the sensor output image K12.
  • the sensor output image K13 is a diagram for explaining an outline of a method for recognizing a subject when the configuration setting is “right landscape” and the target number of people is “one person”. In this case, the configuration guide area G13 is set to the right of the sensor output image K13.
  • the configuration guide area G12 of the sensor output image K21 has a “face center” configuration
  • the target number of people is set in the vicinity of the center of the sensor output image K21 with a size corresponding to “2 people”.
  • the shooting condition determination unit 13 determines that the state of the subject satisfies the shooting condition.
  • the configuration guide area G22 of the sensor output image K22 is set to the left with the same size as the configuration guide area G21, and the configuration guide area G23 of the sensor output image K23 is set to the right with the same size as the configuration guide area G21. Yes.
  • the configuration guide area G31 of the sensor output image K31 is set with a size corresponding to the number of subjects “3” near the center of the image. If the center points P31A, P31B, and 31C are all included in the configuration guide area G31, the shooting condition determination unit 13 determines that the shooting state of the subject is appropriate.
  • the configuration guide area G32 corresponding to the “left landscape” is set to the left, and the configuration guide area G33 corresponding to the “right landscape” is set to the right.
  • the configuration guide areas G41, G42, and G43 may be set to the size of the entire surface of each sensor output image as shown in the drawing according to the number of subjects.
  • the position and size of the composition guide area are determined according to the composition setting and the number of subjects to be photographed.
  • the size of the composition guide area can be roughly determined by the specifications of the lens of the optical module 30 and the distance (arm length) when the image pickup apparatus 20 is held in hand and pointed at itself.
  • the distance between the image pickup apparatus 20 and the subject is displayed on the self-portrait setting screen illustrated in FIG. 4A.
  • An item to be set may be provided, and the size of the composition guide area may be changed according to the distance set by the item.
  • FIG. 7 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention.
  • processing of the imaging apparatus 20 when performing a self-portrait using the imaging system 1 of the present embodiment will be described.
  • the user turns on the power of the imaging device 20.
  • the imaging device 20 is activated and performs initial processing necessary to exhibit the imaging function.
  • the 2nd communication part 25 of the imaging device 20 starts communication with respect to the imaging instruction
  • the control device of the optical module 30 drives the zoom to the wide side for the convenience of zoom adjustment at the time of shooting (step S12).
  • the imaging device 20 waits for a self-portrait shooting instruction from the imaging instruction device 10 (step S13).
  • the second communication unit 25 of the imaging device 20 determines which selfie execution instruction.
  • Information indicating whether the button has been pressed, self-shooting start instruction information for instructing the start of self-portrait processing, and setting contents in the image processing setting field 105 are received from the image pickup instruction device 10 (step S14).
  • the second communication unit 25 outputs the received information to the control unit 24.
  • the vibration detection unit 22 detects information on the shaking of the imaging device 20 (for example, the magnitude of shaking in the X-axis and Y-axis directions described in FIG. 5) (step S15).
  • the vibration detection unit 22 sets the detected shake information and the information on the time when the shake is detected as a set and outputs the set to the second communication unit 25.
  • control unit 24 when the control unit 24 acquires information instructing the start of the self-portrait process, the control unit 24 instructs the image processing unit 23 to detect a face image. Further, the control unit 24 outputs information on the number of persons to be detected to the image processing unit 23 based on information indicating which self-shot execution instruction button has been pressed.
  • the image processing unit 23 acquires a sensor output image obtained by photographing the target from the imaging unit 21, and recognizes a face image that appears in the sensor output image by image recognition.
  • the image processing unit 23 identifies, for example, a rectangular area recognized as having a face image.
  • the image processing unit 23 calculates coordinate information in the sensor output image at the center position of the identified area (the center of the face image) (step S16).
  • the image processing unit 23 may select information corresponding to the number of people in descending order of the area of the rectangular area specified for each face image, and calculate the coordinate information of the center position of the selected area.
  • the image processing unit 23 may select a face image in which the area of the rectangular area specified for each face image is equal to or larger than a predetermined size, and calculate coordinate information of the center position of the selected area.
  • the image processing unit 23 outputs the calculated coordinate information of the face image (the coordinate information of the center of the face image and the coordinate information of the vertex of the rectangular area corresponding to each face) to the second communication unit 25.
  • the control unit 24 sends the shake information (the magnitude of the shake in the X-axis and Y-axis directions and the time when the shake is detected) and the coordinate information of the face image to the imaging instruction apparatus 10 via the second communication unit 25. Control to send.
  • the second communication unit 25 transmits the shake information and the coordinate information of the face image to the imaging instruction device 10 (step S17).
  • the imaging device 20 detects the coordinate information of the vertices of the rectangular area corresponding to the face and transmits it to the imaging instruction device 10.
  • the coordinate information of the center of the image may be calculated.
  • the imaging instruction device 10 determines whether or not the imaging preparation is ready based on the received shake information and the coordinate information of the face image, and captures the imaging instruction information when a predetermined time elapses after determining that the imaging preparation is ready. Transmit to device 20.
  • the imaging instruction apparatus 10 transmits stop instruction information to the imaging apparatus 20.
  • the control unit 24 receives shooting instruction information or stop instruction information from the imaging instruction device 10 via the second communication unit 25 (step S18).
  • the control unit 24 instructs the imaging unit 21 to perform imaging, and the imaging unit 21 performs imaging (step S192).
  • the imaging unit 21 outputs the captured sensor output image to the image processing unit 23.
  • the image processing unit 23 generates a still image recording captured image from the sensor output image.
  • the control unit 24 determines whether or not to transmit a captured image (still image recording captured image) (step S193).
  • the control unit 24 determines whether to transmit the still image recording captured image according to the setting of whether to transmit the still image recording captured image after capturing.
  • the setting as to whether or not to send a still image recording shot image after shooting is, for example, a setting in the REC view setting field 106. When “ON” is set in the REC view setting field 106, the control unit 24 determines to transmit a captured image.
  • step S193 When it is determined to transmit the captured image (step S193; Yes), the control unit 24 controls to transmit the captured image (still image recording captured image) to the imaging instruction apparatus 10 via the second communication unit 25. To do.
  • the second communication unit 25 transmits the shot image (still image recording shot image) to the imaging instruction device 10. If it is determined that the captured image is not transmitted (step S193; No), this processing flow ends.
  • the control unit 24 determines whether or not shooting is stopped (step S191). Specifically, when the cancel instruction information is received, the control unit 24 determines to cancel the self-portrait process and ends the present process flow.
  • the image processing unit 23 may generate a low-resolution temporary image from the sensor output image and the imaging device 20 may transmit the low-resolution temporary image to the imaging instruction device 10 by a predetermined instruction operation by the user.
  • the display control unit 19 may generate a live image from the received low-resolution primary image, and the input / output unit 11 may display the live image. This allows the user to take a selfie while checking the live image.
  • FIG. 8 is a first flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
  • processing of the imaging instruction apparatus 10 when taking a self-portrait using the imaging system 1 of the present embodiment will be described.
  • the self-portrait instruction screen illustrated in FIG. 4B is displayed on the input / output unit 11 of the image-capturing instruction apparatus 10 and the user presses one of the self-portrait execution instruction buttons 111 to 114.
  • the input / output unit 11 outputs information indicating which button has been pressed to the imaging condition determination unit 13.
  • the first communication unit 17 transmits information indicating which self-shoot execution instruction button has been pressed to the imaging device 20.
  • the imaging device 20 transmits shake information and face image coordinate information to the imaging instruction device 10.
  • the first communication unit 17 of the imaging instruction apparatus 10 detects shaking information (the magnitude of the shaking in the X-axis and Y-axis directions and the time when the shaking is detected) and the coordinate information (face image) of the face image. At least one of the coordinate information of the center of the face and the coordinate information of the rectangular area of the face image is received (step S20). The first communication unit 17 records the received shake information and face image coordinate information in the memory 16.
  • the shooting condition determination unit 13 reads the shake information and the coordinate information of the face image from the memory 16 and determines the shooting condition (step S21). First, the imaging condition determination unit 13 determines whether or not the shaking is settled at time t according to Equation (1) for the shaking information. Then, when the shooting condition determination unit 13 determines that the shaking has been continuously stopped for a predetermined time, the shooting condition determination unit 13 determines that the shooting condition regarding the magnitude of the shaking is satisfied in the imaging device 20.
  • the shooting condition determination unit 13 reads the composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the memory 16.
  • the photographing condition determination unit 13 corresponds to the composition setting information and the number of persons based on the read composition setting information and the number of subjects to be photographed corresponding to the information indicating which button acquired from the input / output unit 11 is pressed.
  • Coordinate information defining the composition guide area is read from the memory 16.
  • the shooting condition determination unit 13 compares the number of coordinate information of the acquired face image with the number of shooting targets. When the number of coordinate information is equal to the number of subjects to be photographed, the photographing condition determination unit 13 determines that the first condition regarding the state of the subject is satisfied.
  • the photographing condition determination unit 13 determines whether or not all of the acquired coordinate information of the face image is included in the composition guide area read from the memory 16. When all the coordinate information of the acquired face image is included in the composition guide area, the imaging condition determination unit 13 determines that the second condition relating to the state of the subject is satisfied. When these two conditions are satisfied, the shooting condition determination unit 13 determines that the shooting conditions for the state of the subject are satisfied. The imaging condition determination unit 13 determines that the imaging condition is satisfied when the imaging apparatus 20 satisfies both the imaging condition related to the magnitude of shaking and the imaging condition for the subject state. Alternatively, the imaging condition determination unit 13 may determine that the imaging condition is satisfied when the imaging device 20 satisfies either the imaging condition regarding the magnitude of shaking or the imaging condition for the state of the subject.
  • step S21 When it is determined in step S21 that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the shooting preparation is complete to the notification control unit 14 and the first timer unit 18.
  • the notification control unit 14 notifies the user that the preparation for photographing has been completed (step S23).
  • the notification control unit 14 operates a vibration module such as a vibration motor provided in the imaging instruction device 10 to vibrate the housing of the imaging instruction device 10, and the user who holds the imaging instruction device 10 prepares for shooting. Notify that it is ready.
  • the notification control unit 14 operates a voice output module provided in the imaging instruction device 10 to output a predetermined sound from the speaker, and notifies the user who holds the imaging instruction device 10 that preparation for shooting is completed.
  • the predetermined voice is a voice set in “when countdown starts” in the sound setting field 103 of the selfie setting screen illustrated in FIG. 4A.
  • the first timer unit 18 starts a shooting timer (step S24).
  • the first timer unit 18 measures the time until the time set in the timer setting field 102 of the selfie setting screen has elapsed.
  • the first timer unit 18 stops the shooting timer (step S25).
  • the first timer unit 18 outputs information indicating that the set time has elapsed to the notification control unit 14 and the imaging instruction unit 15.
  • the notification control unit 14 notifies the user at the shooting timing (step S26).
  • the notification control unit 14 vibrates the imaging instruction device 10 or outputs a sound.
  • the sound to be output is the sound set in “during shooting” of the sound setting field 103 in FIG. 4A.
  • the processing in step S26 may be skipped.
  • the shooting instruction unit 15 transmits shooting instruction information to the imaging device 20 via the first communication unit 17 (step S27).
  • the second communication unit 25 receives the imaging instruction information and outputs it to the control unit 24.
  • the control unit 24 instructs the imaging unit 21 to perform shooting, and the imaging unit 21 executes shooting.
  • the imaging unit 21 outputs the captured sensor output image to the image processing unit 23.
  • the image processing unit 23 performs image processing corresponding to the setting contents of the image processing setting field 105 on the sensor output image, and generates a captured image for still image recording after image processing. As described with reference to FIG.
  • the image processing unit 23 captures the captured image for still image recording. Is output to the second communication unit 25.
  • the second communication unit 25 transmits the captured image for still image recording to the imaging instruction device 10.
  • the first communication unit 17 receives a captured image (still image recording captured image) (step S ⁇ b> 271) and records it in the memory 16.
  • the display control unit 19 reads out the still image recording captured image from the memory 16 to generate a REC view image, and the REC view image is input to the input / output unit 11. Output.
  • the input / output unit 11 displays a captured image (rec view image) (step S272).
  • step S21 determines whether or not a self-shooting stop operation is performed by the user (step S28). For example, when the user presses the hard button 120, the input / output unit 11 determines that a self-shooting instruction operation has been performed. When the input / output unit 11 detects a self-shooting stop instruction operation (step S ⁇ b> 28; Yes), the input / output unit 11 outputs stop instruction information to the imaging condition determination unit 13. The shooting condition determination unit 13 instructs the first timer unit 18 to stop the timer, and ends the self-portrait process. At this time, the notification control unit 14 may make a notification to stop shooting. When the input / output unit 11 does not detect the self-shooting stop instruction operation (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
  • the shooting condition determination in step S21 it may be determined whether the shooting conditions are satisfied only by the determination based on the magnitude of the shaking of the imaging device 20. Alternatively, it may be determined whether or not the shooting conditions are satisfied only by determination based on the state of the subject.
  • the image processing unit 23 may detect the smiling face of the subject by the face recognition process, and in addition to the shooting condition determination in step S22, when the smiling face of the subject is detected, the shooting timer may be started to execute shooting. More specifically, the image processing unit 23 outputs to the second communication unit 25 information indicating whether the subject of the face image is a smile in association with the coordinate information of the face image. The second communication unit 25 transmits the information to the imaging instruction device 10.
  • the imaging condition determination unit 13 acquires information indicating whether or not the subject is smiling via the first communication unit 17. In addition to the determination condition in step S21, the shooting condition determination unit 13 determines that the shooting condition is satisfied, for example, when all subjects are smiling. In addition, when adding whether it is a smile to a determination, it is good also as a structure which shortens imaging
  • FIG. 9 is a second flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
  • the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20).
  • the imaging condition determination unit 13 acquires shake information and face image coordinate information from the first communication unit 17.
  • the shooting condition determination unit 13 determines shooting conditions (step S21). When it is determined that the shooting conditions are satisfied (step S22; Yes), the notification control unit 14 notifies the user of the completion of shooting preparation (step S23). Further, the first timer unit 18 starts a shooting timer (step S24).
  • the imaging condition determination unit 13 receives the shake information and the coordinate information of the face image from the imaging device 20 (step S201).
  • the process of step S201 is the same as that of step S20.
  • the shooting condition determination unit 13 determines shooting cancellation conditions (step S211).
  • the shooting cancellation condition may be determined based on the magnitude of shaking of the imaging device 20 and the state of the subject, as in step S21. For example, if the imaging condition determination unit 13 determines that the shaking of the imaging device 20 is not within a predetermined range using Expression (1), the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20. . Alternatively, the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20 when the number of times that the shaking in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
  • the shooting condition determination unit 13 determines that the shooting cancel condition regarding the state of the subject is satisfied when the subject to be shot moves and even one of the coordinate information of the face image of the subject leaves the composition guide area. judge.
  • the image processing unit 23 in the imaging device 20 selects a face image having an area of a predetermined size or larger and transmits coordinate information of the center point of the selected face image
  • the shooting condition determination unit 13 when the number of subjects to be photographed increases or decreases and differs from the number of subjects to be photographed designated by the user, it is determined that a photographing cancellation condition regarding the state of the subject is satisfied.
  • the imaging condition determination unit 13 may determine that the imaging cancellation condition is satisfied only by satisfying the imaging cancellation condition for either one of the magnitude of the shaking of the imaging device 20 and the state of the subject, It may be determined that the shooting cancel condition is satisfied when both the shooting cancel condition regarding the size and the shooting cancel condition regarding the state of the subject are satisfied. In addition, when the subject's smile is added to the determination condition in step S21, for example, it may be determined that the shooting cancellation condition is satisfied when one of the subjects is no longer smiling. When the shooting cancellation condition is satisfied, the shooting condition determination unit 13 determines to stop shooting.
  • the shooting condition determination unit 13 instructs the first timer unit 18 to stop the shooting timer, and ends the self-portrait process.
  • the first timer unit 18 stops the shooting timer (step S25), and the notification control unit 14 notifies the user of the shooting timing.
  • the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17 (step S27), and in the imaging device 20, the imaging unit 21 performs imaging.
  • the imaging device 20 transmits a captured image (a still image recording captured image).
  • the first communication unit 17 receives the captured image (step S ⁇ b> 271) and records it in the memory 16.
  • the display control unit 19 reads a captured image (still image recording captured image) from the memory 16, generates a rec view image, and outputs it to the input / output unit 11.
  • the input / output unit 11 displays a captured image (rec view image) (step S272).
  • step S22 If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. At this time, the notification control unit 14 may perform notification notifying that the shooting is stopped by vibration or sound output. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
  • the imaging instruction device 10 can determine whether or not the photographing preparation is complete, so the user can take a self-portrait without worrying about unnecessary things. It can be performed.
  • the imaging instruction apparatus 10 since the imaging instruction apparatus 10 notifies that the preparation for shooting is ready and it is known that shooting is performed after the time set by the user, the user can make a desired facial expression in accordance with the timing of shooting. You can start shooting in a safe state. Also, by leaving the determination of shooting preparation to the imaging instruction device 10, the user is freed from complicated operations and does not have to make fine adjustments while watching the live screen, so that the user can take a self-photograph without being noticeable quickly. Can do.
  • the imaging device 20 transmits a still image recording image in accordance with the setting of the REC view setting field 106 and the like, and the imaging instruction device 10 illustrates an operation of displaying the REC view image as an example.
  • the imaging device 20 always transmits the still image recording image to the imaging instruction device 10, and the imaging instruction device 10 receives and records the still image recording image in the memory 16, and displays / not displays the REC view image. Only display may be controlled according to the setting.
  • FIG. 10 is a functional block diagram showing the configuration of the imaging system in the second embodiment of the present invention.
  • the imaging device 20 includes a second timer unit 26.
  • the imaging instruction device 10 may not include the first timer unit 18.
  • the second timer unit 26 measures the lapse of time set by the user, and the imaging device 20 itself determines the shooting timing.
  • Other configurations and operations are the same as those in the first embodiment.
  • FIG. 11 is a flowchart illustrating an example of a processing flow of the imaging system according to the second embodiment of the present invention.
  • a description will be given of processing in the case where a self-portrait is performed using the imaging system 1 of the present embodiment.
  • a process similar to that of the first embodiment will be briefly described.
  • the imaging device 20 transmits information about the shaking of the device itself and coordinate information of the face image to be photographed to the imaging instruction device 10. It shall be.
  • the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20).
  • the shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15. The notification control unit 14 notifies the user of completion of shooting preparation (step S23). In addition, the shooting instruction unit 15 transmits timer shooting instruction information to the imaging device 20 via the first communication unit 17 (step S29).
  • the timer shooting instruction information is shooting instruction information including shooting waiting time information that specifies how many seconds the shooting should be performed.
  • the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24.
  • the control unit 24 instructs the second timer unit 26 to start the shooting timer.
  • the second timer unit 26 starts a shooting timer (step S31).
  • the second timer unit 26 stops the imaging timer (step S32).
  • the second timer unit 26 outputs information indicating that the set time has elapsed to the control unit 24.
  • the control unit 24 issues a shooting instruction to the imaging unit 21, and the imaging unit 21 performs shooting (step S33). In addition, the control unit 24 performs control so that the shooting completion information is transmitted to the imaging instruction apparatus 10 via the second communication unit 25.
  • the second communication unit 25 transmits shooting completion information indicating that shooting has been completed to the imaging instruction apparatus 10 (step S34).
  • the imaging unit 21 outputs a sensor output image to the image processing unit 23, and the image processing unit 23 performs image processing.
  • the second communication unit 25 transmits the captured image (photographed image for still image recording) after the image processing to the imaging instruction device 10 (step S35).
  • the first communication unit 17 receives the imaging completion information and outputs it to the notification control unit 14.
  • the notification control unit 14 notifies the user at the time of shooting by vibrating the imaging instruction device 10 or outputting a sound (step S26).
  • step S22 When it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), the processing is the same as in the first embodiment.
  • step S28; Yes When the input / output unit 11 detects a selfie stop instruction operation by the user (step S28; Yes), the selfie process is terminated.
  • step S28; No When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
  • the imaging timer 20 may be started by the imaging device 20 to execute a self-portrait.
  • the case where a captured image is transmitted to the imaging instruction apparatus 10 after step S33 has been described as an example.
  • the imaging apparatus is set according to whether or not a captured image is transmitted. 20 may transmit a still image recording image, and the imaging instruction apparatus 10 may display a rec view image.
  • FIG. 12 is a functional block diagram showing the configuration of the imaging system in the third embodiment of the present invention.
  • the imaging apparatus 20 includes a shooting stop condition determination unit 27.
  • the shooting stop condition determination unit 27 determines the shooting stop condition from when the imaging device 20 receives the shooting instruction until the second timer unit 26 determines the shooting timing. Then, when the shooting stop condition is satisfied, the imaging device 20 stops shooting.
  • Other configurations and operations are the same as those in the second embodiment.
  • FIG. 13 is a flowchart illustrating an example of a processing flow of the imaging system according to the third embodiment of the present invention. Processing of the imaging system in the second embodiment will be described with reference to FIG. The same processing as that described in FIG. 11 will be briefly described.
  • the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20).
  • the shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15.
  • the notification control unit 14 notifies the user of completion of shooting preparation (step S23).
  • the imaging instruction unit 15 transmits timer imaging instruction information to the imaging device 20 via the first communication unit 17 (step S29).
  • the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24.
  • the control unit 24 instructs the second timer unit 26 to start the shooting timer.
  • the second timer unit 26 starts a shooting timer (step S31).
  • the shooting stop condition determination unit 27 determines the shooting stop condition (step S36). For example, the imaging stop condition determination unit 27 acquires the shake information detected by the vibration detection unit 22 and the information on the detection time of the shake from the vibration detection unit 22. If it is determined that the shaking of the imaging device 20 is not within the predetermined range using the equation (1), the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied. Alternatively, the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied when the number of times that the fluctuation in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
  • the shooting stop condition determination unit 27 may acquire the coordinate information of the face image from the image processing unit 23 and determine the shooting stop condition regarding the state of the subject.
  • the imaging apparatus 20 has received composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the imaging instruction apparatus 10 and stored in a storage unit (not shown) of the imaging apparatus 20. , It is assumed that the composition setting information and the composition guide area corresponding to the target number of persons are recorded.
  • the shooting stop condition determination unit 27 is different from the number of shooting targets specified by the user because one of the coordinate information of the face image of the subject is out of the composition guide area or the number of shooting targets is increased or decreased. Or the like, it is determined that the shooting stop condition is satisfied.
  • the shooting stop condition determination unit 27 may determine that the shooting stop condition is satisfied only when the shooting stop condition for either one of the magnitude of shaking of the imaging device 20 and the state of the subject is satisfied. Alternatively, it may be determined that the shooting stop condition is satisfied when both the shooting stop condition regarding the magnitude of the shaking of the imaging device 20 and the shooting stop condition regarding the state of the subject are satisfied.
  • the shooting stop condition determination unit 27 outputs the determination result to the control unit 24.
  • the control unit 24 transmits shooting stop information indicating the stop of shooting to the imaging instruction apparatus 10 via the second communication unit 25 (step S38).
  • the control unit 24 instructs the second timer unit 26 to stop the timer, and the self-portrait process ends.
  • step S37 When it is not determined to stop shooting (step S37; No), when the set shooting wait time elapses, the second timer unit 26 stops the shooting timer (step S32), and the imaging unit 21 executes shooting (step S32). Step S33). Further, the second communication unit 25 transmits shooting completion information to the imaging instruction device 10 (step S34). When the photographing is completed, the second communication unit 25 transmits a photographed image (still image recording photographed image) to the imaging instruction device 10 (step S35). In the imaging instruction device 10, the first communication unit 17 receives the imaging completion information, and the notification control unit 14 notifies the user at the time of imaging (step S26).
  • step S22 If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
  • the imaging device 20 transmits the still image recording image according to the setting of whether to transmit the captured image, and the imaging instruction device 10 A view image may be displayed.
  • the captured image generated by the imaging device 20 is captured. Although it is transmitted to the instruction device 10, it may be stored in a storage unit (not shown) included in the imaging device 20. In the third embodiment, the imaging condition may be determined by the imaging device 20.
  • the input / output unit 11 is an example of an input unit.
  • the imaging instruction device 10 and the imaging device 20 are recorded on a computer-readable recording medium, and this recording is performed.
  • the “computer system” includes an OS and hardware such as peripheral devices.
  • the “computer-readable recording medium” means a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case.
  • the program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
  • the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging.
  • the imaging instruction device instructs the imaging device to take an image.
  • the user can photograph himself / herself after preparation for photographing is completed.
  • the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Studio Devices (AREA)

Abstract

An image-capturing instructing device according to the present invention is provided with: an image-capturing condition determining unit that determines whether or not an image-capturing condition is satisfied on the basis of at least information indicating the magnitude of shaking of an image capturing device, or information relating to the state of an object in an image captured by the image capturing device; an image-capturing instructing unit that gives an image-capturing instruction, when the image-capturing condition determining unit has determined that an image-capturing condition is satisfied, to the image capturing device to capture an image after a prescribed time has elapsed from the determination; and a notification controlling unit that performs controlling so as to actuate at least a vibration module or a sound output module, when the image-capturing condition determining unit has determined that the image-capturing condition is satisfied, to notify a user of the determination result.

Description

撮像指示装置、撮像システム、撮影方法およびプログラムImaging instruction apparatus, imaging system, imaging method, and program
　本発明は、撮像指示装置、撮像システム、撮影方法およびプログラムに関する。 The present invention relates to an imaging instruction apparatus, an imaging system, an imaging method, and a program.
　カメラを自分に向け自分自身を含む画像を撮像するいわゆる「自撮り」（以下、自分撮りと呼ぶ）と呼ばれる撮像方法が存在する。自分撮りには、例えば、セルフタイマによるシャッタレリーズを設定し、その間に被写体が写る場所に移動する方法や、リモートコントロール操作によって離れた位置から撮像指示を行って自分自身を撮像する方法が存在する。また、近年ではスマートフォン等に搭載されたカメラ機能を利用して、どこでも手軽に自分撮りを行うことができる。
　なお、特許文献１には、遠隔レリーズ手段によって撮影指示を行うと、所定の時間経過後に撮像手段が起動するカメラについて記載されている。 There is an imaging method called “self-portrait” (hereinafter referred to as “self-portrait”) in which an image including itself is captured with the camera facing the camera. Self-shooting includes, for example, a method of setting a shutter release by a self-timer and moving to a place where the subject is photographed during that time, and a method of taking an image from a remote position by taking an imaging instruction by remote control operation . In recent years, it is possible to easily take a selfie anywhere using a camera function mounted on a smartphone or the like.
Note that Patent Document 1 describes a camera in which an imaging unit is activated after a predetermined time has elapsed when a shooting instruction is issued by a remote release unit.
特公平８－７３７０号公報Japanese Patent Publication No. 8-7370
　これらの自分撮りの方法の問題点として、実際の撮像時に自分の撮影準備が整っているとは限らないことが挙げられる。例えば、セルフタイマによる方法では、準備が整う前に撮像されてしまう可能性がある。また、特許文献１の方法でも、遠隔レリーズ手段による撮像指示からシャッタの開閉までに時間が設けられているとはいえ、やはり撮像のタイミングで準備が整っているかどうかの補償はない。 The problem with these self-shooting methods is that they are not always ready for shooting at the time of actual shooting. For example, in the method using the self-timer, there is a possibility that an image is captured before the preparation is completed. Even in the method of Patent Document 1, although there is a time from the imaging instruction by the remote release means to the opening and closing of the shutter, there is no compensation for whether the preparation is ready at the timing of imaging.
　本発明は、上記課題を解決するためになされたものであり、撮影準備が整ってから撮影を行うことでより自然な自分撮りを実現することができる撮像指示装置、撮像システム、撮影方法およびプログラムを提供することを目的とする。 The present invention has been made to solve the above-described problem, and is an imaging instruction apparatus, imaging system, imaging method, and program capable of realizing a more natural self-taking by shooting after preparation for shooting is completed. The purpose is to provide.
　本発明の第１の態様に係る撮像指示装置は、撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する撮影条件判定部と、前記撮影条件判定部が撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う撮影指示部と、前記撮影条件判定部が撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する通知制御部と、を備える。 The imaging instruction device according to the first aspect of the present invention is based on at least one information of information indicating the magnitude of shaking of the imaging device and information on the state of the subject in the image being captured by the imaging device. A shooting condition determination unit that determines whether or not a shooting condition is satisfied, and when the shooting condition determination unit determines that the shooting condition is satisfied, the imaging apparatus performs shooting for still image recording after a predetermined time has elapsed since the determination was made. When it is determined that the shooting instruction unit that issues a shooting instruction to perform image shooting and the shooting condition determination unit satisfies the shooting condition, at least one of the vibration module and the audio output module is operated, and the user determines A notification control unit that controls to notify the result.
　本発明の第２の態様によれば、上記第１の態様における前記被写体の状態に関する情報は、前記撮影中の画像に写る被写体の数であって、前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像の数によって前記被写体の数を認識し、認識した被写体の数が所定の数であれば、撮影条件を満たすと判定してもよい。 According to the second aspect of the present invention, the information related to the state of the subject in the first aspect is the number of subjects appearing in the image being photographed, and the photographing condition determination unit The number of subjects may be recognized based on the number of face images of the subject in the image, and it may be determined that the shooting condition is satisfied if the number of recognized subjects is a predetermined number.
　本発明の第３の態様によれば、上記第１の態様または上記第２の態様における前記被写体の状態に関する情報は、前記撮影中の画像に写る一人又は複数の被写体の位置であって、前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像が示す位置によって前記被写体の位置を認識し、認識した一人又は複数の被写体の位置が所定の範囲内にあれば、撮影条件を満たすと判定してもよい。 According to a third aspect of the present invention, the information relating to the state of the subject in the first aspect or the second aspect is the position of one or more subjects in the image being photographed, The shooting condition determination unit recognizes the position of the subject based on the position indicated by the face image of the subject in the image being shot, and sets the shooting condition if the recognized position of the one or more subjects is within a predetermined range. You may determine with satisfy | filling.
　本発明の第４の態様によれば、上記第１の態様から上記第３の態様のいずれか一態様に記載の撮像指示装置において、前記撮影条件判定部は、前記撮像装置の揺れの大きさ示す情報に基づいて前記撮像装置の揺れの大きさを判定し、前記撮像装置の揺れの大きさが所定の閾値以内であれば、撮影条件を満たすと判定してもよい。 According to a fourth aspect of the present invention, in the imaging instruction device according to any one of the first aspect to the third aspect, the imaging condition determination unit is a magnitude of shaking of the imaging device. The magnitude of shaking of the imaging device may be determined based on the information shown, and if the magnitude of shaking of the imaging device is within a predetermined threshold, it may be determined that the imaging condition is satisfied.
　本発明の第５の態様によれば、上記第１の態様から上記第４の態様のいずれか一態様に記載の撮像指示装置において、前記撮影条件判定部が判定に用いる撮影条件であって、前記撮影条件を満たすと判定してから撮影を実行するまでの時間、または、前記撮影中の画像に含まれる被写体の数、または、被写体の位置のうち少なくとも１つを指定する条件の入力を受け付ける入力部、をさらに備えていてもよい。 According to a fifth aspect of the present invention, in the imaging instruction device according to any one of the first aspect to the fourth aspect, the imaging condition determination unit uses the imaging condition for determination, An input of a condition for designating at least one of a time from when it is determined that the shooting condition is satisfied to when shooting is performed, the number of subjects included in the image being shot, or the position of the subject is received. An input unit may be further provided.
　本発明の第６の態様によれば、上記第１の態様から上記第５の態様のいずれか一態様に記載の撮像指示装置において、前記撮影条件判定部は、ユーザによる撮影を中止する指示操作、または、前記撮像装置の揺れの大きさ示す情報、または、前記撮像装置が撮影中の画像に写る被写体の状態に関する情報、に基づいて撮影の中止を決定してもよい。 According to a sixth aspect of the present invention, in the imaging instruction device according to any one of the first to fifth aspects, the imaging condition determination unit is configured to instruct the user to stop imaging. Alternatively, the stop of shooting may be determined based on information indicating the magnitude of shaking of the imaging device or information on the state of the subject in the image being captured by the imaging device.
　本発明の第７の態様によれば、撮像システムは、前記撮像装置と通信を行う第１の通信部、をさらに備える上記第１の態様から上記第６の態様のいずれか一態様に記載の撮像指示装置と、撮像部と、前記撮像指示装置と通信を行う第２の通信部と、自装置の揺れを検出する振動検出部と、前記撮像部が撮影中の画像に写る被写体の状態を認識する画像処理部と、を備える撮像装置と、を備える。 According to a seventh aspect of the present invention, the imaging system further includes a first communication unit that communicates with the imaging device, according to any one of the first to sixth aspects. An imaging instruction device, an imaging unit, a second communication unit that communicates with the imaging instruction device, a vibration detection unit that detects shaking of the own device, and a state of a subject that is captured in an image being captured by the imaging unit And an image processing unit for recognizing.
　本発明の第８の態様によれば、撮影方法は、撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定し、前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮像指示を行い、さらに、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する。 According to the eighth aspect of the present invention, the imaging method is based on at least one of information indicating information indicating the magnitude of shaking of the imaging device and information relating to the state of the subject in the image being captured by the imaging device. If it is determined whether or not the shooting condition is satisfied, and it is determined that the shooting condition is satisfied, imaging is performed so that the imaging apparatus executes shooting of a still image recording shot image after a lapse of a predetermined time since the determination is made. An instruction is given, and at least one of the vibration module and the audio output module is operated, and control is performed to notify the user of the determination result.
　本発明の第９の態様によれば、プログラムは、撮像指示装置のコンピュータを、撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する手段、前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う手段、前記撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する手段、として機能させる。 According to the ninth aspect of the present invention, the program causes the computer of the imaging instruction apparatus to perform information on information indicating a magnitude of shaking of the imaging apparatus and information on a state of a subject that is captured in an image being captured by the imaging apparatus. Means for determining whether or not a shooting condition is satisfied based on at least one of the information, and when it is determined that the shooting condition is satisfied, the imaging apparatus is configured to store the captured image for still image recording after a predetermined time has elapsed since the determination was made. Means for instructing photographing to execute photographing, means for controlling to operate at least one of the vibration module and the audio output module when notifying that the photographing condition is satisfied, and to notify the user of the judgment result Make it work.
　上記各形態の撮像指示装置、撮像システム、撮影方法およびプログラムによれば、撮像指示装置は、自分撮りを行うユーザの撮影準備が整っているかどうかを判定する。撮像指示装置は、撮影準備が整ったと判定すると撮像装置に撮像指示を行う。これにより、ユーザは、撮影準備が整ってから自分自身を撮影することができる。また、撮像指示装置は、ユーザに撮影を開始する合図を通知し、撮像装置は、撮像指示があってから所定の時間経過後に撮影を行う。これにより、ユーザは所望の表情や姿勢で撮影に臨むことができる。 According to the imaging instruction device, the imaging system, the imaging method, and the program of each aspect described above, the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging. When the imaging instruction device determines that the preparation for shooting is complete, the imaging instruction device instructs the imaging device to take an image. As a result, the user can photograph himself / herself after preparation for photographing is completed. In addition, the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
本発明の第１の実施形態における撮像システムの構成を示した機能ブロック図である。1 is a functional block diagram illustrating a configuration of an imaging system according to a first embodiment of the present invention. 本発明の第１の実施形態における撮像システムの具体的な構成例を示す外観図である。1 is an external view illustrating a specific configuration example of an imaging system according to a first embodiment of the present invention. 本発明の第１の実施形態における撮像システムの使用例を示す図である。It is a figure which shows the usage example of the imaging system in the 1st Embodiment of this invention. 本発明の第１の実施形態における撮像指示装置の画面例を示した第１の図である。It is the 1st figure showing the example of a screen of the imaging directions device in a 1st embodiment of the present invention. 本発明の第１の実施形態における撮像指示装置の画面例を示した第２の図である。It is the 2nd figure which showed the example of a screen of the imaging instruction | indication apparatus in the 1st Embodiment of this invention. 本発明の第１の実施形態における撮影条件の判定処理を説明する第１の図である。It is a 1st figure explaining the determination process of the imaging condition in the 1st Embodiment of this invention. 本発明の第１の実施形態における撮影条件の判定処理を説明する第２の図である。It is a 2nd figure explaining the determination process of the imaging condition in the 1st Embodiment of this invention. 本発明の第１の実施形態における撮像装置の処理の流れの一例を示すフローチャートである。3 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention. 本発明の第１の実施形態における撮像指示装置の処理の流れの一例を示す第１のフローチャートである。It is a 1st flowchart which shows an example of the flow of a process of the imaging instruction | indication apparatus in the 1st Embodiment of this invention. 本発明の第１の実施形態における撮像指示装置の処理の流れの一例を示す第２のフローチャートである。It is a 2nd flowchart which shows an example of the flow of a process of the imaging instruction | indication apparatus in the 1st Embodiment of this invention. 本発明の第２の実施形態における撮像システムの構成を示した機能ブロック図である。It is the functional block diagram which showed the structure of the imaging system in the 2nd Embodiment of this invention. 本発明の第２の実施形態における撮像システムの処理の流れの一例を示すフローチャートである。It is a flowchart which shows an example of the flow of a process of the imaging system in the 2nd Embodiment of this invention. 本発明の第３の実施形態における撮像システムの構成を示した機能ブロック図である。It is the functional block diagram which showed the structure of the imaging system in the 3rd Embodiment of this invention. 本発明の第３の実施形態における撮像システムの処理の流れの一例を示すフローチャートである。It is a flowchart which shows an example of the flow of a process of the imaging system in the 3rd Embodiment of this invention.
（第１の実施形態）
　以下、本発明の第１の実施形態について図面を参照して説明する。図１は、本発明の第１の実施形態における撮像システムの構成を示した機能ブロック図である。図１に示す撮像システム１は、撮像指示装置１０と、撮像装置２０とを有する。撮像指示装置１０は、撮像装置２０に対して撮像指示を行い、撮像装置２０は、その撮像指示に基づいて撮影を行う。 (First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram showing the configuration of the imaging system according to the first embodiment of the present invention. An imaging system 1 illustrated in FIG. 1 includes an imaging instruction device 10 and an imaging device 20. The imaging instruction device 10 issues an imaging instruction to the imaging device 20, and the imaging device 20 performs imaging based on the imaging instruction.
　撮像指示装置１０は、入出力部１１と、条件設定部１２と、撮影条件判定部１３と、通知制御部１４と、撮影指示部１５と、メモリ１６と、第１の通信部１７と、第１のタイマ部１８と、を有する。撮像指示装置１０は、撮像装置２０の制御を行う専用の操作端末であってもよい。また、撮像指示装置１０は、例えば、スマートフォンやタブレット端末などの携帯通信端末に、撮像装置２０の制御を行うアプリケーションソフトウェアを組み込んだ形態であってもよい。この場合、携帯通信端末には、撮像装置２０の制御を行うアプリケーションソフトウェアの他にも、別の様々なアプリケーションソフトウェアが組み込まれていてもよい。 The imaging instruction device 10 includes an input / output unit 11, a condition setting unit 12, an imaging condition determination unit 13, a notification control unit 14, an imaging instruction unit 15, a memory 16, a first communication unit 17, and a first communication unit 17. 1 timer unit 18. The imaging instruction device 10 may be a dedicated operation terminal that controls the imaging device 20. Moreover, the imaging instruction | indication apparatus 10 may be the form which incorporated the application software which controls the imaging device 20 in portable communication terminals, such as a smart phone and a tablet terminal, for example. In this case, various other application software may be incorporated in the mobile communication terminal in addition to the application software for controlling the imaging device 20.
　入出力部１１は、ボタン、タッチパネルなどの入力装置や、液晶ディスプレイなどの表示装置を含む。入出力部１１は、自分撮りの実行に必要な操作画面の画像など各種画像を表示する。入出力部１１は、ユーザからの入力操作を受け付ける。例えば、入出力部１１は、ユーザによる自分撮り開始指示操作の入力を受け付ける。また、入出力部１１は、ユーザによる自分撮りに関する撮影条件の設定操作の入力を受け付ける。また、入出力部１１は、ユーザによる自分撮り処理の中止操作の入力を受け付ける。
　条件設定部１２は、入出力部１１が受け付けた設定操作が示す撮影条件をメモリ１６に記録する。撮影条件とは、例えば、撮像装置２０の揺れの大きさが所定の範囲内となることである。また、撮像条件とは、例えば、撮像装置２０の撮影中の画像に写る被写体の数に対する指定である。また、撮像条件とは、例えば、撮像装置２０の撮影中の画像に写る被写体の位置に対する指定である。 The input / output unit 11 includes an input device such as a button and a touch panel, and a display device such as a liquid crystal display. The input / output unit 11 displays various images such as an image of an operation screen necessary for performing self-portrait. The input / output unit 11 receives an input operation from the user. For example, the input / output unit 11 receives an input of a selfie start instruction operation by the user. In addition, the input / output unit 11 receives an input of a shooting condition setting operation related to self-photographing by the user. In addition, the input / output unit 11 receives an input of a user's self-shooting process cancel operation.
The condition setting unit 12 records the shooting condition indicated by the setting operation received by the input / output unit 11 in the memory 16. The imaging condition is, for example, that the magnitude of shaking of the imaging device 20 is within a predetermined range. The imaging condition is, for example, designation with respect to the number of subjects that appear in the image being captured by the imaging device 20. The imaging condition is, for example, designation with respect to the position of the subject that appears in the image being captured by the imaging device 20.
　撮影条件判定部１３は、条件設定部１２が記録した撮影条件に基づいて、撮影（自分撮り）の準備が整ったかどうかを判定する。
　通知制御部１４は、撮影条件判定部１３が自分撮りの準備が整ったと判定した場合、自分撮りを行うユーザに撮影準備が完了したことを通知する。例えば、通知制御部１４は、音声出力モジュールを動作させ自装置が備えるスピーカから音声を出力させることにより、あるいは自装置が備える振動モジュールを動作させて自装置を振動させることによりユーザに通知を行う。また、通知制御部１４は、撮影のタイミングで撮影を実行したことをユーザに知らせるための通知を行ってもよい。 The shooting condition determination unit 13 determines whether or not preparation for shooting (self-portrait) is completed based on the shooting conditions recorded by the condition setting unit 12.
When the shooting condition determination unit 13 determines that the preparation for self-portrait is ready, the notification control unit 14 notifies the user who performs self-shooting that the preparation for shooting has been completed. For example, the notification control unit 14 notifies the user by operating the audio output module to output sound from a speaker included in the own apparatus, or operating the vibration module included in the own apparatus to vibrate the own apparatus. . Further, the notification control unit 14 may perform a notification for notifying the user that shooting has been performed at the timing of shooting.
　撮影指示部１５は、撮像装置２０に撮影指示を行う。具体的には、撮影指示部１５は、第１の通信部１７を介して撮像装置２０に撮像指示情報を送信する。
　メモリ１６は、撮像指示装置１０に内蔵されるメモリ等の不揮発性記録媒体であって、撮像装置２０が生成した画像や撮像条件など種々の情報を記憶する。
　第１の通信部１７は、撮像装置２０と無線通信を行う。
　第１のタイマ部１８は、撮影条件判定部１３が自分撮りの準備が整ったと判定してから経過した時間を計時する。撮影条件判定部１３は、その判定から所定の時間が経過すると上述の撮影指示部１５へ所定時間が経過したことを通知する情報を出力する。
　表示制御部１９は、入出力部１１が表示する画面画像を生成する。 The shooting instruction unit 15 issues a shooting instruction to the imaging device 20. Specifically, the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17.
The memory 16 is a non-volatile recording medium such as a memory built in the imaging instruction apparatus 10 and stores various information such as an image generated by the imaging apparatus 20 and imaging conditions.
The first communication unit 17 performs wireless communication with the imaging device 20.
The first timer unit 18 measures the time that has elapsed since the shooting condition determination unit 13 determined that preparation for self-taking was completed. The imaging condition determination unit 13 outputs information notifying that the predetermined time has elapsed to the above-described imaging instruction unit 15 when a predetermined time has elapsed since the determination.
The display control unit 19 generates a screen image displayed by the input / output unit 11.
　条件設定部１２と、撮影条件判定部１３と、通知制御部１４と、撮影指示部１５は、撮像指示装置１０が備えるＣＰＵ（Central Processing Unit）等の演算手段がプログラムを読み込んで実行することにより、ソフトウェアの機能として実現可能である。 The condition setting unit 12, the imaging condition determination unit 13, the notification control unit 14, and the imaging instruction unit 15 are read out and executed by an arithmetic unit such as a CPU (Central Processing Unit) provided in the imaging instruction device 10. It can be realized as a software function.
　撮像装置２０は、撮像部２１と、振動検出部２２と、画像処理部２３と、制御部２４と、第２の通信部２５とを有する。
　撮像部２１は、被写体を撮影した画像を生成する。撮像部２１は、生成した画像を画像処理部２３や第２の通信部２５に出力する。なお、撮像部２１が被写体を撮影し出力した画像を「センサ出力画像」、ユーザによる確認用に撮像指示装置１０へ送信する画像であって画像処理部２３が「センサ出力画像」を画像処理して解像度を落とした画像を「低解像度一時画像」、表示制御部１９が「低解像度一時画像」を読み込んで入出力部１１に表示する画像を「ライブ画像」、撮像部２１が撮影した静止画として記録するための画像を「静止画記録用撮影画像」、表示制御部１９が「静止画記録用撮影画像」を読み込んで表示画面に表示する画像を「レックビュー画像」と呼ぶことがある。
　振動検出部２２は、撮像装置２０の揺れの大きさを検出する。振動検出部２２は、例えば、２軸のデジタル水準器である。あるいは、振動検出部２２は、加速度センサやジャイロセンサでもよい。振動検出部２２は、検出した揺れの大きさを示す情報を第２の通信部２５に出力する。 The imaging device 20 includes an imaging unit 21, a vibration detection unit 22, an image processing unit 23, a control unit 24, and a second communication unit 25.
The imaging unit 21 generates an image obtained by photographing the subject. The imaging unit 21 outputs the generated image to the image processing unit 23 and the second communication unit 25. It should be noted that an image obtained by capturing and outputting a subject by the imaging unit 21 is a “sensor output image”, an image transmitted to the imaging instruction apparatus 10 for confirmation by the user, and the image processing unit 23 performs image processing on the “sensor output image”. The image with the reduced resolution is the “low-resolution temporary image”, the display control unit 19 reads the “low-resolution temporary image” and the image displayed on the input / output unit 11 is the “live image”, and the still image captured by the imaging unit 21 An image to be recorded as “still image recording photographic image” may be referred to as “still image recording photographic image”, and an image displayed on the display screen by the display control unit 19 reading “still image recording photographic image” may be referred to as “rec view image”.
The vibration detection unit 22 detects the magnitude of shaking of the imaging device 20. The vibration detection unit 22 is, for example, a two-axis digital level. Alternatively, the vibration detection unit 22 may be an acceleration sensor or a gyro sensor. The vibration detection unit 22 outputs information indicating the magnitude of the detected shake to the second communication unit 25.
　画像処理部２３は、撮像部２１から取得したセンサ出力画像から顔認識技術により被写体を検出する。画像処理部２３は、被写体を検出すると、センサ出力画像における被写体の顔が写った領域の座標情報を算出する。また、画像処理部２３は、センサ出力画像について自動トリミング処理やフィルタ処理などの画像処理を行う。
　制御部２４は、撮像装置２０の動作を制御する。例えば、制御部２４は、撮像部２１の生成した画像、振動検出部２２の検出した揺れの情報、画像処理部２３の算出した画像に写る被写体の座標情報などを第２の通信部２５を介して撮像指示装置１０へ送信するよう制御する。また、制御部２４は、第２の通信部２５を介して撮像指示情報を受信した場合、撮像部２１に撮影を開始するよう制御を行う。
　第２の通信部２５は、撮像指示装置１０と無線通信を行う。 The image processing unit 23 detects a subject from the sensor output image acquired from the imaging unit 21 by a face recognition technique. When the image processing unit 23 detects the subject, the image processing unit 23 calculates coordinate information of an area in which the face of the subject appears in the sensor output image. The image processing unit 23 performs image processing such as automatic trimming processing and filter processing on the sensor output image.
The control unit 24 controls the operation of the imaging device 20. For example, the control unit 24 transmits the image generated by the imaging unit 21, the information on the shake detected by the vibration detection unit 22, the coordinate information of the subject reflected in the image calculated by the image processing unit 23, and the like via the second communication unit 25. Control to transmit to the imaging instruction apparatus 10. In addition, when receiving the imaging instruction information via the second communication unit 25, the control unit 24 controls the imaging unit 21 to start imaging.
The second communication unit 25 performs wireless communication with the imaging instruction device 10.
　画像処理部２３および制御部２４は、撮像装置２０が備えるＣＰＵ（Central Processing Unit）等の演算手段がプログラムを読み込んで実行することにより、ソフトウェアの機能として実現可能である。また、画像処理部２３および制御部２４は、ＡＳＩＣ（Application Specific Integrated Circuit）やＰＬＤ（Programmable Logic Device）やＦＰＧＡ（Field-Programmable Gate Array）等のハードウェアを用いて実現されてもよい。 The image processing unit 23 and the control unit 24 can be realized as a software function when a calculation unit such as a CPU (Central Processing Unit) provided in the imaging apparatus 20 reads and executes a program. The image processing unit 23 and the control unit 24 may be realized using hardware such as ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field-Programmable Gate Array).
　図２は、本発明の第１の実施形態における撮像システムの具体的な構成例を示す外観図である。図２に示す撮像システム１は、撮像指示装置１０と、撮像装置２０と、光学モジュール３０とを有する。
　撮像指示装置１０と撮像装置２０とは無線通信で接続される。撮像装置２０の前面には光学モジュール３０が装着されている。光学モジュール３０は、撮像装置２０に対して装着と取り外しとが可能である。撮像装置２０と光学モジュール３０とは一体的に構成されていてもよい。 FIG. 2 is an external view showing a specific configuration example of the imaging system according to the first embodiment of the present invention. The imaging system 1 illustrated in FIG. 2 includes an imaging instruction device 10, an imaging device 20, and an optical module 30.
The imaging instruction device 10 and the imaging device 20 are connected by wireless communication. An optical module 30 is mounted on the front surface of the imaging device 20. The optical module 30 can be attached to and detached from the imaging device 20. The imaging device 20 and the optical module 30 may be configured integrally.
　撮像指示装置１０には、例えば、自分撮り開始を指示する撮影ボタンが設けられており、ユーザがこの撮影ボタンを押下すると、撮像装置２０は撮像指示装置１０と協調して被写体の撮影を行う。 The imaging instruction device 10 is provided with, for example, a shooting button for instructing the start of self-shooting. When the user presses this shooting button, the imaging device 20 performs shooting of a subject in cooperation with the imaging instruction device 10.
　光学モジュール３０は、レンズと、被写体像を結像させるためにズーム、フォーカス、絞りなどを制御するレンズ制御装置などを備えた光学ユニットである。
　撮像装置２０は、光学モジュール３０を介して入射された被写体光を結像し、被写体の光学像を光電変換する撮像素子と、撮像素子から出力された画素信号に応じた画像を無線通信によって撮像指示装置１０へ送信する。 The optical module 30 is an optical unit that includes a lens and a lens control device that controls zoom, focus, aperture, and the like to form a subject image.
The imaging device 20 forms an image of subject light incident via the optical module 30 and photoelectrically converts an optical image of the subject, and captures an image corresponding to the pixel signal output from the imaging device by wireless communication. Transmit to the instruction device 10.
　図３は、本発明の第１の実施形態における撮像システムの使用例を示す図である。
　図３は、ユーザが本実施形態の撮影システムを用いて自分撮りを行う様子を示している。図３が示すようにユーザは、撮像装置２０と一体的に構成された光学モジュール３０のレンズを自分自身に向け、撮像指示装置１０の撮影ボタンを押下して自分撮りを行う。なお、図３ではユーザが撮像装置２０を把持しているが、ユーザは撮像装置２０を設置して自分撮りを行ってもよい。
　一般にスマートフォン等を用いて自分撮りを行う場合、ユーザは図３の撮像装置２０の代わりにスマートフォン等を把持し、スマートフォンの表示画面と同じ面に備えられたいわゆるインサイドカメラを自分に向け、表示画面に映るライブ画像を確認しながらタイマ撮影を行う。あるいは、ユーザは自撮り棒（セルフィースティック）を用いてＢｌｏｕｅｔｏｏｔｈ（登録商標）などの無線通信によってリモートで撮影指示を行い自分撮りを行う。これらの一般的な方法の場合、ユーザは、撮像指示を行ったり、表示画面を見て構図を考えたり、インサイドカメラを適切な位置に保持したり、表情を作ったりなど、複数のことを適切に行う必要があり操作が煩雑である。また、例えば、これらの方法の場合、表示画面に映る画像が気になって自然な撮影ができない可能性がある。また、表示画面が小さく表示画面に写る自分の姿がよく確認できなかったり、インサイドカメラのレンズと表示画面の位置がずれていて目線がずれてしまったりする可能性がある。 FIG. 3 is a diagram illustrating a usage example of the imaging system according to the first embodiment of the present invention.
FIG. 3 shows how the user takes a selfie using the imaging system of the present embodiment. As shown in FIG. 3, the user takes a self-portrait by directing the lens of the optical module 30 configured integrally with the imaging device 20 to himself and pressing the shooting button of the imaging instruction device 10. In FIG. 3, the user holds the imaging device 20, but the user may install the imaging device 20 and take a selfie.
In general, when taking a self-portrait using a smartphone or the like, the user holds the smartphone or the like instead of the imaging device 20 of FIG. Timer shooting is performed while checking the live image displayed on the screen. Alternatively, the user performs a self-portrait by using a self-shooting stick (selfie stick) to instruct remote shooting by wireless communication such as Bluetooth (registered trademark). With these general methods, the user can do multiple things, such as giving imaging instructions, thinking about the composition by looking at the display screen, holding the inside camera in an appropriate position, and creating facial expressions. The operation is complicated. Further, for example, in the case of these methods, there is a possibility that natural shooting cannot be performed because of an image on the display screen. In addition, there is a possibility that the display screen is small and the appearance of himself / herself on the display screen cannot be confirmed well, or the position of the lens of the inside camera and the display screen is shifted and the line of sight is shifted.
　また、自分撮りにおいては、自分が写った写真を確実に撮るということの他にも、例えば、カメラ目線の写真が撮りたい、カメラ目線以外の自然な写真が撮りたい、素早く撮りたい、周囲に目立たずに撮りたい、撮影のタイミングを知りたい、友達２～３人でも撮りたい、などのニーズがあり、一般的な自分撮りの方法ではこれらのニーズを満たすことは困難であった。また、さまざまな機材や複雑な手順を要する撮影方法では、手軽に撮影ができず周囲の迷惑になってしまい自分撮りには適さない。 Also, in self-taking, in addition to taking a picture of yourself, for example, you want to take a picture looking at the camera, take a natural picture other than the camera, take a picture quickly, There are needs such as wanting to shoot unobtrusively, knowing the timing of shooting, or even two or three friends, and it has been difficult to meet these needs with general self-portrait methods. Also, shooting methods that require a variety of equipment and complicated procedures are not suitable for self-portraits because it is not easy to shoot and annoying the surroundings.
　そこで、本実施形態では、自然な撮影が行えるように表示画面に写る自分の姿を確認せずに自分撮りを行うことができ、また、撮影準備が整った最適なタイミングで撮像を行うことができる撮影システムを提供する。
　具体的には、ユーザによる自分撮りの指示操作が行われると、撮像システム１は、撮影準備が整ったかどうかを判定し、所定時間経過後に撮影を行う。つまり、本実施形態では、ユーザではなく、撮像システム１が撮影タイマのスタートタイミングと、それに伴う撮影タイミングを決定する。より詳細には、撮像指示装置１０が、撮像装置２０の揺れ具合やセンサ出力画像に写る被写体の状態に応じて撮影準備が整ったかどうかの判定を行い、撮影準備が整ったと判定すると、撮影タイマをスタートさせるとともに、撮影のタイミングをユーザに通知する。
　本実施形態によれば、自分撮りを行うユーザは、自分がうまく取れているかどうかを撮像システム１に任せることができるので、ライブ画像の確認を行うために表示画面を見る必要が無くなる。また、撮影のタイミングをユーザに通知するので、ユーザはそのタイミングに合わせて表情を作ったり、自然な姿勢を取ったりして撮影に臨むことができる。 Therefore, in the present embodiment, it is possible to take a self-photographing without confirming the appearance of himself / herself on the display screen so that natural photographing can be performed, and it is possible to perform photographing at an optimal timing when preparation for photographing is complete. Provide a shooting system that can.
Specifically, when a user performs a self-shooting instruction operation, the imaging system 1 determines whether or not preparation for shooting is completed and performs shooting after a predetermined time has elapsed. That is, in this embodiment, not the user but the imaging system 1 determines the start timing of the shooting timer and the shooting timing associated therewith. More specifically, when the imaging instruction device 10 determines whether or not the imaging preparation is ready in accordance with the degree of shaking of the imaging device 20 and the state of the subject shown in the sensor output image. And the user is notified of the timing of shooting.
According to the present embodiment, since the user who takes a self-portrait can leave the imaging system 1 to see whether he / she can take it well, it is not necessary to look at the display screen in order to check the live image. In addition, since the timing of shooting is notified to the user, the user can make a facial expression in accordance with the timing or take a natural posture for shooting.
　図４Ａは、本発明の第１の実施形態における撮像指示装置の画面例を示した第１の図である。図４Ｂは、本発明の第１の実施形態における撮像指示装置の画面例を示した第２の図である。
　図４Ａは、自分撮り設定画面の画像の一例を示している。以下、入出力部１１に表示される画面の画像を単に画面と呼ぶ場合がある。撮像指示装置１０は入出力部１１、ハードボタン１２０を有している。入出力部１１は、タッチパネルと表示装置とが一体的に構成されていて、入出力部１１は、自分撮り設定画面を表示するとともにユーザからの入力操作を受け付ける。表示制御部１９は、自分撮り設定画面の画像を生成し、入出力部１１に出力する。また、ハードボタン１２０は、ユーザが撮像指示装置１０に指示操作を行う場合に用いる入力手段の一例である。
　自分撮り設定画面は、例えば、完了ボタン１００、キャンセルボタン１０１、タイマ設定欄１０２、サウンド設定欄１０３、構図設定欄１０４、画像処理設定欄１０５、レックビュー設定欄１０６を含んでいる。 FIG. 4A is a first diagram illustrating a screen example of the imaging instruction apparatus according to the first embodiment of the present invention. FIG. 4B is a second diagram illustrating a screen example of the imaging instruction device according to the first embodiment of the present invention.
FIG. 4A shows an example of an image of the selfie setting screen. Hereinafter, the screen image displayed on the input / output unit 11 may be simply referred to as a screen. The imaging instruction device 10 includes an input / output unit 11 and a hard button 120. The input / output unit 11 is configured integrally with a touch panel and a display device, and the input / output unit 11 displays a self-portrait setting screen and accepts an input operation from a user. The display control unit 19 generates an image of the selfie setting screen and outputs it to the input / output unit 11. The hard button 120 is an example of an input unit used when a user performs an instruction operation on the imaging instruction device 10.
The self-portrait setting screen includes, for example, a completion button 100, a cancel button 101, a timer setting field 102, a sound setting field 103, a composition setting field 104, an image processing setting field 105, and a rec view setting field 106.
　完了ボタン１００は、自分撮り設定画面でユーザが設定した設定内容を保存する場合にユーザが押下するボタンの画像である。キャンセルボタン１０１は、設定内容を破棄する場合にユーザが押下するボタンの画像である。タイマ設定欄１０２は、撮影準備が整ったと判定してから撮影を行うまでの時間（撮影待ち時間）を設定する項目である。例えば、ユーザはタイマ設定欄１０２に３秒と設定する。サウンド設定欄１０３は、撮影準備が整ったと判定した場合に撮影までのカウントダウンが開始されるときにユーザに通知する音声、撮影時の音声を指定する項目である。例えば、ユーザは、撮影までのカウントダウン開始時の音声としてビープ音を、撮影時の音声として無音（音を発しない）を設定する。構図設定欄１０４は、撮影する画像の構図を設定する項目である。例えば、被写体の顔を中心とした構図、被写体の左側の背景を写した構成、被写体の右側の背景を写した構成、の中から選択できるようにしてもよい。画像処理設定欄１０５は、撮像装置２０が生成した画像に対して行う補正処理・加工処理の設定を行う項目である。例えば、自動トリミングを行うか否か、フィルタ処理の種類の設定（例えば、ポートレートなど）を行えるようにしてもよい。レックビュー設定欄１０６は、撮影した画像（レックビュー画像）を表示するか否かの設定を行う項目である。 The completion button 100 is an image of a button that the user presses when saving the setting content set by the user on the selfie setting screen. The cancel button 101 is an image of a button that the user presses when discarding the setting contents. The timer setting field 102 is an item for setting a time (shooting waiting time) from when it is determined that the preparation for shooting is completed until shooting is performed. For example, the user sets 3 seconds in the timer setting field 102. The sound setting column 103 is an item for designating a voice to be notified to the user when the countdown until the shooting is started when it is determined that the shooting preparation is completed, and a voice at the time of shooting. For example, the user sets a beep sound as the sound at the start of the countdown until shooting, and silence (does not emit sound) as the sound at the time of shooting. The composition setting column 104 is an item for setting the composition of an image to be shot. For example, it is possible to select from a composition centered on the face of the subject, a configuration in which the background on the left side of the subject is captured, and a configuration in which the background on the right side of the subject is captured. The image processing setting column 105 is an item for setting correction processing / processing processing performed on an image generated by the imaging apparatus 20. For example, it may be possible to set whether to perform automatic trimming and to set the type of filter processing (for example, portrait). The REC view setting field 106 is an item for setting whether to display a captured image (REC view image).
　ユーザが、自分撮り設定画面の各項目を設定し、完了ボタン１００を押下すると、条件設定部１２は、設定内容をメモリ１６に記録する。また、ユーザが、キャンセルボタン１０１を押下すると設定内容は変更されず、既にメモリ１６に記録された設定内容が使用される。また、ユーザが、完了ボタン１００またはキャンセルボタン１０１を押下すると、表示制御部１９が、図４Ｂに示す自分撮り指示画像を入出力部１１に出力するように構成されていてもよい。 When the user sets each item on the selfie setting screen and presses the completion button 100, the condition setting unit 12 records the setting contents in the memory 16. When the user presses the cancel button 101, the setting contents are not changed, and the setting contents already recorded in the memory 16 are used. Further, when the user presses the completion button 100 or the cancel button 101, the display control unit 19 may be configured to output the self-portrait instruction image shown in FIG. 4B to the input / output unit 11.
　図４Ｂは、自分撮り指示画面の一例を示している。例えば、ユーザがメニュー画面などから自分撮りを行う指示操作を入力すると、表示制御部１９は、自分撮り指示画面の画像を生成し入出力部１１に出力する。
　自分撮り設定画面は、例えば、設定画面呼び出しボタン１１０、自分撮り実行指示ボタン１１１～１１４を含んでいる。ユーザが設定画面呼び出しボタン１１０を押下すると、表示制御部１９は、図４Ａで示した自分撮り設定画面の画像を生成し入出力部１１に出力する。自分撮り実行指示ボタン１１１は、１人を対象に自分撮りを行うときに押下するボタンである。自分撮り実行指示ボタン１１２は２人を対象に、自分撮り実行指示ボタン１１３は３人を対象に、自分撮り実行指示ボタン１１４は４人以上を対象に自分撮りを行うときに押下するボタンである。ユーザは、撮影対象となる人数に応じて自分撮り実行指示ボタン１１１～１１４の中から適切なボタンを選択し押下する。ユーザが、自分撮り実行指示ボタン１１１～１１４のうち何れかのボタンを押下すると、本実施形態の撮像システム１による自分撮り処理が実行される。本実施形態の自分撮り処理については、図７～図９を用いて後に説明する。 FIG. 4B shows an example of a self-shooting instruction screen. For example, when the user inputs an instruction operation for taking a selfie from a menu screen or the like, the display control unit 19 generates an image of the selfie instruction screen and outputs it to the input / output unit 11.
The self-portrait setting screen includes, for example, a setting screen calling button 110 and self-portrait execution instruction buttons 111 to 114. When the user presses the setting screen call button 110, the display control unit 19 generates an image of the selfie setting screen shown in FIG. 4A and outputs it to the input / output unit 11. The self-taking execution instruction button 111 is a button to be pressed when performing self-taking for one person. The self-portrait execution instruction button 112 is for two persons, the self-capture execution instruction button 113 is for three persons, and the self-execution execution instruction button 114 is a button to be pressed when performing self-taking for four or more persons. . The user selects and presses an appropriate button from the self-shoot execution instruction buttons 111 to 114 according to the number of persons to be photographed. When the user presses any one of the self-portrait execution instruction buttons 111 to 114, the self-portrait process by the imaging system 1 of the present embodiment is executed. Self-portrait processing according to the present embodiment will be described later with reference to FIGS.
　図５は、本発明の第１の実施形態における撮影条件の判定処理を説明する第１の図である。
　上述のとおり本実施形態では、撮像システム１が、撮影準備が整ったかどうかの判定を行い、撮影タイミングを決定する。この判定は、撮像指示装置１０の撮影条件判定部１３が、所定の撮影条件に基づいて行う。所定の条件とは、例えば、撮像装置２０の揺れの大きさである。揺れの大きさが所定の閾値以上の場合、撮影条件判定部１３は、その状態で撮影を行ってもぶれた画像しか撮影できないので撮影準備は整っていないと判定する。 FIG. 5 is a first diagram illustrating the photographing condition determination process according to the first embodiment of the present invention.
As described above, in the present embodiment, the imaging system 1 determines whether or not the preparation for shooting is complete, and determines the shooting timing. This determination is performed by the imaging condition determination unit 13 of the imaging instruction apparatus 10 based on predetermined imaging conditions. The predetermined condition is, for example, the magnitude of shaking of the imaging device 20. When the magnitude of the shake is equal to or greater than a predetermined threshold, the shooting condition determination unit 13 determines that shooting preparation is not complete because only blurred images can be shot even if shooting is performed in that state.
　図５は、撮影条件判定部１３が判定に用いる撮影条件のうち、撮像装置２０の揺れの大きさに基づく判定について説明する図である。図５は、撮像装置２０が備える振動検出部２２が検出した揺れの大きさの推移を示すグラフである。このグラフの縦軸は揺れの大きさを、横軸は時間を示している。例えば、振動検出部２２が２軸のデジタル水準器の場合、振動検出部２２は、水平面のＸ軸方向、Ｙ軸方向の揺れを検出する。振動検出部２２の検出したＸ軸方向、Ｙ軸方向の揺れの情報はそれぞれの揺れの検出時刻の情報と組みにして、所定の時間間隔で撮像指示装置１０へ送信される。撮像指示装置１０では、第１の通信部１７が揺れの情報を受信しメモリ１６に記録する。図５においてグラフ３Ｘは、このようにして記録されたＸ軸方向の揺れの推移を示すグラフである。同様にグラフ３Ｙは、Ｙ軸方向の揺れの推移を示すグラフである。 FIG. 5 is a diagram for explaining determination based on the magnitude of shaking of the imaging apparatus 20 among the imaging conditions used for the determination by the imaging condition determination unit 13. FIG. 5 is a graph showing changes in the magnitude of shaking detected by the vibration detection unit 22 included in the imaging device 20. In this graph, the vertical axis represents the magnitude of shaking, and the horizontal axis represents time. For example, when the vibration detection unit 22 is a two-axis digital level, the vibration detection unit 22 detects shaking in the X-axis direction and the Y-axis direction of the horizontal plane. The information on the shaking in the X-axis direction and the Y-axis direction detected by the vibration detection unit 22 is transmitted to the imaging instruction apparatus 10 at a predetermined time interval in combination with the information on the detection time of each shaking. In the imaging instruction apparatus 10, the first communication unit 17 receives the shake information and records it in the memory 16. In FIG. 5, a graph 3X is a graph showing the transition of the fluctuation in the X-axis direction recorded in this way. Similarly, the graph 3Y is a graph showing the transition of fluctuation in the Y-axis direction.
　撮影条件判定部１３は、メモリ１６に記録されたＸ軸、Ｙ軸方向の揺れの情報に基づいて、撮像装置２０の揺れの大きさが、所定の期間に渡って許容できる範囲の大きさとなったときに撮像装置２０の揺れの大きさは撮影条件を満たすと判定する。例えば、撮影条件判定部１３は、ある時刻ｔにおけるＸ軸、Ｙ軸方向の揺れの大きさが次式（１）を満たす場合、時刻ｔにおいて撮像装置２０の揺れは収まったと判定する。
　｜Ｘ（ｔ）－Ｘ（ｔ－１）｜　＋　｜Ｙ（ｔ）－Ｙ（ｔ－１）｜　
＜　閾値Ｌ　・・・（１）
　ここで、Ｘ（ｔ）、Ｙ（ｔ）は、それぞれ時刻ｔにおけるＸ軸方向の揺れの大きさ、Ｙ軸方向の揺れの大きさである。同様にＸ（ｔ－１）、Ｙ（ｔ－１）は、例えば１秒前の時刻ｔ－１でのＸ軸、Ｙ軸方向の揺れの大きさである。撮影条件判定部１３は、ｔを所定時間に渡ってずらし、それぞれのｔについて式（１）を満たす場合、撮像装置２０の揺れの大きさは撮影条件を満たすと判定する。 Based on the information about the shakes in the X-axis and Y-axis directions recorded in the memory 16, the imaging condition determination unit 13 sets the magnitude of the shake of the imaging device 20 within an allowable range over a predetermined period. The magnitude of the shaking of the imaging device 20 is determined to satisfy the imaging condition. For example, the imaging condition determination unit 13 determines that the shaking of the imaging device 20 has subsided at time t when the magnitude of shaking in the X-axis and Y-axis directions at a certain time t satisfies the following equation (1).
| X (t) −X (t−1) | + | Y (t) −Y (t−1) |
<Threshold L (1)
Here, X (t) and Y (t) are the magnitude of the shake in the X-axis direction and the magnitude of the shake in the Y-axis direction, respectively, at time t. Similarly, X (t-1) and Y (t-1) are, for example, magnitudes of shaking in the X-axis and Y-axis directions at time t-1 one second before. The imaging condition determination unit 13 shifts t over a predetermined time, and determines that the magnitude of shaking of the imaging device 20 satisfies the imaging condition when Expression (1) is satisfied for each t.
　図６は、本発明の第１の実施形態における撮影条件の判定処理を説明する第２の図である。
　図６は、撮影条件判定部１３が、撮影準備が整ったかどうかの判定に用いる所定の撮影条件のうち、センサ出力画像に写る被写体の状態に基づく判定について説明する図である。図６は、ユーザが自分撮り設定画面で設定した構図設定および自分撮り指示画面で選択した撮影対象の人数ごとの被写体の認識方法の概要を示したものである。図６には、構図と人数に対応した１２個のセンサ出力画像Ｋ１１、Ｋ１２、Ｋ１３、Ｋ２１、Ｋ２２、Ｋ２３、Ｋ３１、Ｋ３２、Ｋ３３、Ｋ４１、Ｋ４２、Ｋ４３が示されている。センサ出力画像Ｋ１１は、構成が「顔中心」で対象人数が「１人」の場合の被写体の認識方法の概要を説明する図である。構図ガイドエリアＧ１１は、構図が「顔中心」で対象人数が「１人」の場合に顔の中心座標が含まれるべき領域である。構図ガイドエリアは、構図設定と撮影対象の人数に応じて予め定められており、それぞれの構図ガイドエリアの領域を規定する各頂点の座標情報は、メモリ１６に記録されている。 FIG. 6 is a second diagram illustrating the photographing condition determination process in the first embodiment of the present invention.
FIG. 6 is a diagram illustrating determination based on the state of the subject appearing in the sensor output image among predetermined shooting conditions used for determining whether or not the shooting condition determination unit 13 is ready for shooting. FIG. 6 shows an outline of a composition setting set by the user on the selfie setting screen and a method for recognizing the subject for each number of shooting targets selected on the selfie instruction screen. FIG. 6 shows twelve sensor output images K11, K12, K13, K21, K22, K23, K31, K32, K33, K41, K42, and K43 corresponding to the composition and the number of people. The sensor output image K11 is a diagram illustrating an outline of a method for recognizing a subject when the configuration is “face center” and the number of subjects is “one person”. The composition guide area G11 is an area in which the center coordinates of the face should be included when the composition is “face center” and the number of subjects is “one person”. The composition guide area is determined in advance according to the composition setting and the number of subjects to be photographed, and the coordinate information of each vertex that defines the area of each composition guide area is recorded in the memory 16.
　構図ガイドエリアＧ１１は、構図が「顔中心」に設定されているのでセンサ出力画像の中心付近に設定されている。中心点Ｐ１１は、撮像装置２０の画像処理部２３がセンサ出力画像Ｋ１１を顔認識技術により画像処理した結果算出された、センサ出力画像Ｋ１１に写る被写体の顔画像の中心の位置である。画像処理部２３は、このとき顔認識技術により検出した例えば矩形の領域で示される顔画像の候補の中から、大きいものから順にユーザによって指定された対象人数分を被写体として特定し、その中心座標を算出してもよい。画像処理部２３が算出した顔画像の座標情報は、撮像指示装置１０へ送信される。撮像指示装置１０では撮影条件判定部１３が、メモリ１６に記録された構図ガイドエリアの座標情報と撮像装置２０から受信した顔画像の座標情報に基づいて、被写体の撮影状態が適切かどうかを判定する。例えば、センサ出力画像Ｋ１１の場合、中心点Ｐ１１は、構図ガイドエリアＧ１１に含まれている。このように、中心点Ｐ１１が構図と撮影対象の人数に対応した構図ガイドエリアＧ１１に含まれている場合、撮影条件判定部１３は、被写体の状態は撮影条件を満たすと判定する。 The composition guide area G11 is set near the center of the sensor output image because the composition is set to “face center”. The center point P11 is the position of the center of the face image of the subject in the sensor output image K11 calculated as a result of the image processing unit 23 of the imaging device 20 performing image processing on the sensor output image K11 using the face recognition technology. The image processing unit 23 specifies, as subjects, subjects corresponding to the number of subjects designated by the user in order from the largest in the face image candidates indicated by, for example, a rectangular region detected by the face recognition technology at this time. May be calculated. The coordinate information of the face image calculated by the image processing unit 23 is transmitted to the imaging instruction device 10. In the imaging instruction apparatus 10, the imaging condition determination unit 13 determines whether the imaging state of the subject is appropriate based on the coordinate information of the composition guide area recorded in the memory 16 and the coordinate information of the face image received from the imaging apparatus 20. To do. For example, in the case of the sensor output image K11, the center point P11 is included in the composition guide area G11. As described above, when the center point P11 is included in the composition guide area G11 corresponding to the composition and the number of subjects to be photographed, the photographing condition determination unit 13 determines that the state of the subject satisfies the photographing condition.
　センサ出力画像Ｋ１２は、構成設定が「左風景」で対象人数が「１人」の場合の被写体の認識方法の概要を説明する図である。この場合、構成ガイドエリアＧ１２は、センサ出力画像Ｋ１２の左寄りに設定されている。
　センサ出力画像Ｋ１３は、構成設定が「右風景」で対象人数が「１人」の場合の被写体の認識方法の概要を説明する図である。この場合、構成ガイドエリアＧ１３は、センサ出力画像Ｋ１３の右寄りに設定されている。 The sensor output image K12 is a diagram illustrating an outline of a method for recognizing a subject when the configuration setting is “left landscape” and the target number of people is “one person”. In this case, the configuration guide area G12 is set to the left of the sensor output image K12.
The sensor output image K13 is a diagram for explaining an outline of a method for recognizing a subject when the configuration setting is “right landscape” and the target number of people is “one person”. In this case, the configuration guide area G13 is set to the right of the sensor output image K13.
　同様にセンサ出力画像Ｋ２１の構成ガイドエリアＧ１２は、構成が「顔中心」なのでセンサ出力画像Ｋ２１の中央付近に、対象人数が「２人」に対応した広さで設定されている。この場合も、中心点Ｐ２１Ａ、Ｐ２１Ｂが共に構成ガイドエリアＧ１２内に含まれていれば、撮影条件判定部１３は、被写体の状態は撮影条件を満たすと判定する。
　また、センサ出力画像Ｋ２２の構成ガイドエリアＧ２２は、構成ガイドエリアＧ２１と同じ大きさで左寄りに、センサ出力画像Ｋ２３の構成ガイドエリアＧ２３は、構成ガイドエリアＧ２１と同じ大きさで右寄りに設定されている。 Similarly, since the configuration guide area G12 of the sensor output image K21 has a “face center” configuration, the target number of people is set in the vicinity of the center of the sensor output image K21 with a size corresponding to “2 people”. Also in this case, if both the center points P21A and P21B are included in the configuration guide area G12, the shooting condition determination unit 13 determines that the state of the subject satisfies the shooting condition.
The configuration guide area G22 of the sensor output image K22 is set to the left with the same size as the configuration guide area G21, and the configuration guide area G23 of the sensor output image K23 is set to the right with the same size as the configuration guide area G21. Yes.
　撮影対象人数が３人の場合も同様である。例えば、センサ出力画像Ｋ３１の構成ガイドエリアＧ３１は、画像の中央付近に対象人数が「３人」に対応した広さで設定されている。中心点Ｐ３１Ａ、Ｐ３１Ｂ、３１Ｃが共に構成ガイドエリアＧ３１内に含まれていれば、撮影条件判定部１３は、被写体の撮影状態が適切であると判定する。また、構成設定が「左風景」に対応する構成ガイドエリアＧ３２は左寄りに、構成設定が「右風景」に対応する構成ガイドエリアＧ３３は右寄りに設定されている。
　また、撮影対象人数が４人以上の場合、対象人数に合わせて、構成ガイドエリアＧ４１、Ｇ４２、Ｇ４３は、図示するように各センサ出力画像の全面の大きさに設定されてもよい。 The same applies when the number of subjects to be photographed is three. For example, the configuration guide area G31 of the sensor output image K31 is set with a size corresponding to the number of subjects “3” near the center of the image. If the center points P31A, P31B, and 31C are all included in the configuration guide area G31, the shooting condition determination unit 13 determines that the shooting state of the subject is appropriate. The configuration guide area G32 corresponding to the “left landscape” is set to the left, and the configuration guide area G33 corresponding to the “right landscape” is set to the right.
When the number of subjects to be photographed is four or more, the configuration guide areas G41, G42, and G43 may be set to the size of the entire surface of each sensor output image as shown in the drawing according to the number of subjects.
　このように、構図ガイドエリアの位置、大きさは、それぞれ構図設定と撮影対象の人数に応じて定められている。なお、構図ガイドエリアの大きさは、光学モジュール３０のレンズの仕様、撮像装置２０を手に持って自分に向けた場合の距離（腕の長さ）で概ね定めることが可能であるが、例えば、自撮り棒に撮像装置２０を装着するなどして少し離れた位置から自分撮りを行う場合に対応するために、図４Ａで例示した自分撮り設定画面に、撮像装置２０と被写体との距離を設定する項目を設け、その項目で設定された距離に応じて構図ガイドエリアの大きさを変化させるようにしてもよい。 Thus, the position and size of the composition guide area are determined according to the composition setting and the number of subjects to be photographed. The size of the composition guide area can be roughly determined by the specifications of the lens of the optical module 30 and the distance (arm length) when the image pickup apparatus 20 is held in hand and pointed at itself. In order to cope with the case where the self-portrait is attached to the self-portrait stick and the self-portrait is taken from a slightly distant position, the distance between the image pickup apparatus 20 and the subject is displayed on the self-portrait setting screen illustrated in FIG. 4A. An item to be set may be provided, and the size of the composition guide area may be changed according to the distance set by the item.
　図７は、本発明の第１の実施形態における撮像装置の処理の流れの一例を示すフローチャートである。
　図７を用いて、本実施形態の撮像システム１を用いて自分撮りを行う場合の撮像装置２０の処理について説明する。
　まず、ユーザが撮像装置２０の電源をＯＮにする。すると、撮像装置２０が起動し、撮像機能を発揮するのに必要な初期処理を行う。次に、撮像装置２０の第２の通信部２５が、撮像指示装置１０に対して通信を開始し、無線通信で接続する（ステップＳ１１）。これにより、撮像指示装置１０からの自分撮り撮影開始指示情報を受信できるようになる。次に、光学モジュール３０が電動ズームレンズを備えている場合、光学モジュール３０の制御装置は、撮影時のズーム調整の便宜のためズームをワイド側に駆動する（ステップＳ１２）。これらの準備処理が完了すると、撮像装置２０は、撮像指示装置１０からの自分撮り撮影指示を待機する（ステップＳ１３）。 FIG. 7 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention.
With reference to FIG. 7, processing of the imaging apparatus 20 when performing a self-portrait using the imaging system 1 of the present embodiment will be described.
First, the user turns on the power of the imaging device 20. Then, the imaging device 20 is activated and performs initial processing necessary to exhibit the imaging function. Next, the 2nd communication part 25 of the imaging device 20 starts communication with respect to the imaging instruction | indication apparatus 10, and connects by wireless communication (step S11). Thereby, it is possible to receive the self-portrait start instruction information from the image pickup instruction device 10. Next, when the optical module 30 includes an electric zoom lens, the control device of the optical module 30 drives the zoom to the wide side for the convenience of zoom adjustment at the time of shooting (step S12). When these preparation processes are completed, the imaging device 20 waits for a self-portrait shooting instruction from the imaging instruction device 10 (step S13).
　次に、ユーザが、図４Ｂで例示した自分撮り指示画面にて自分撮り実行指示ボタン１１１～１１４のうち何れかを押下すると、撮像装置２０の第２の通信部２５は、どの自分撮り実行指示ボタンが押下されたかを示す情報、自分撮り処理の開始を指示する自分撮り撮影開始指示情報、画像処理設定欄１０５の設定内容を撮像指示装置１０から受信する（ステップＳ１４）。第２の通信部２５は、受信した情報を制御部２４へ出力する。 Next, when the user presses any one of the selfie execution instruction buttons 111 to 114 on the selfie instruction screen illustrated in FIG. 4B, the second communication unit 25 of the imaging device 20 determines which selfie execution instruction. Information indicating whether the button has been pressed, self-shooting start instruction information for instructing the start of self-portrait processing, and setting contents in the image processing setting field 105 are received from the image pickup instruction device 10 (step S14). The second communication unit 25 outputs the received information to the control unit 24.
　次に、振動検出部２２は、撮像装置２０の揺れの情報（例えば、図５で説明したＸ軸、Ｙ軸方向の揺れの大きさ）を検出する（ステップＳ１５）。振動検出部２２は、検出した揺れの情報とその揺れを検出した時刻の情報とを組にして第２の通信部２５へ出力する。 Next, the vibration detection unit 22 detects information on the shaking of the imaging device 20 (for example, the magnitude of shaking in the X-axis and Y-axis directions described in FIG. 5) (step S15). The vibration detection unit 22 sets the detected shake information and the information on the time when the shake is detected as a set and outputs the set to the second communication unit 25.
　次に、制御部２４は、自分撮り処理の開始を指示する情報を取得すると、画像処理部２３に顔画像の検出を指示する。また、制御部２４は、どの自分撮り実行指示ボタンが押下されたかを示す情報に基づいて検出すべき人数の情報を画像処理部２３に出力する。画像処理部２３は、撮像部２１から対象を撮影したセンサ出力画像を取得し、画像認識によりセンサ出力画像に写る顔画像を認識する。画像処理部２３は、顔画像が写ったと認識した例えば矩形の領域を特定する。画像処理部２３は、特定した領域の中心位置（顔画像の中心）のセンサ出力画像における座標情報を算出する（ステップＳ１６）。ここで、画像処理部２３は、各顔画像について特定した矩形領域の面積が大きい方から順に人数の情報分選択し、選択した領域の中心位置の座標情報を算出してもよい。あるいは、画像処理部２３は、各顔画像について特定した矩形領域の面積が所定の大きさ以上の顔画像を選択し、選択した領域の中心位置の座標情報を算出してもよい。画像処理部２３は、算出した顔画像の座標情報（顔画像の中心の座標情報と各顔に対応する矩形領域の頂点の座標情報）を第２の通信部２５に出力する。制御部２４は、揺れの情報（Ｘ軸、Ｙ軸方向の揺れの大きさとその揺れを検出した時刻）と、顔画像の座標情報を、第２の通信部２５を介して撮像指示装置１０へ送信するよう制御する。第２の通信部２５は、揺れの情報と、顔画像の座標情報を撮像指示装置１０へ送信する（ステップＳ１７）。なお、顔画像の座標情報について、撮像装置２０では、顔に対応する矩形領域の頂点の座標情報を検出して撮像指示装置１０へ送信し、撮像指示装置１０では、撮影条件判定部１３が顔画像の中心の座標情報を算出してもよい。 Next, when the control unit 24 acquires information instructing the start of the self-portrait process, the control unit 24 instructs the image processing unit 23 to detect a face image. Further, the control unit 24 outputs information on the number of persons to be detected to the image processing unit 23 based on information indicating which self-shot execution instruction button has been pressed. The image processing unit 23 acquires a sensor output image obtained by photographing the target from the imaging unit 21, and recognizes a face image that appears in the sensor output image by image recognition. The image processing unit 23 identifies, for example, a rectangular area recognized as having a face image. The image processing unit 23 calculates coordinate information in the sensor output image at the center position of the identified area (the center of the face image) (step S16). Here, the image processing unit 23 may select information corresponding to the number of people in descending order of the area of the rectangular area specified for each face image, and calculate the coordinate information of the center position of the selected area. Alternatively, the image processing unit 23 may select a face image in which the area of the rectangular area specified for each face image is equal to or larger than a predetermined size, and calculate coordinate information of the center position of the selected area. The image processing unit 23 outputs the calculated coordinate information of the face image (the coordinate information of the center of the face image and the coordinate information of the vertex of the rectangular area corresponding to each face) to the second communication unit 25. The control unit 24 sends the shake information (the magnitude of the shake in the X-axis and Y-axis directions and the time when the shake is detected) and the coordinate information of the face image to the imaging instruction apparatus 10 via the second communication unit 25. Control to send. The second communication unit 25 transmits the shake information and the coordinate information of the face image to the imaging instruction device 10 (step S17). As for the coordinate information of the face image, the imaging device 20 detects the coordinate information of the vertices of the rectangular area corresponding to the face and transmits it to the imaging instruction device 10. The coordinate information of the center of the image may be calculated.
　撮像指示装置１０は、受信した揺れの情報、顔画像の座標情報に基づいて撮影準備が整ったかどうかを判定し、撮影準備が整ったと判定してから所定の時間が経過すると撮像指示情報を撮像装置２０に送信する。また、ユーザが自分撮りの中止を指示する操作を行うと、撮像指示装置１０は中止指示情報を撮像装置２０に送信する。
　すると、制御部２４は、第２の通信部２５を介して撮像指示装置１０から撮影指示情報または中止指示情報を受信する（ステップＳ１８）。撮影指示情報を受信した場合（ステップＳ１９；Ｙｅｓ）、制御部２４は撮像部２１に撮影指示を行い、撮像部２１は撮影を実行する（ステップＳ１９２）。撮像部２１は、撮影したセンサ出力画像を画像処理部２３へ出力する。画像処理部２３はセンサ出力画像から静止画記録用撮影画像を生成する。次に制御部２４は、撮影画像（静止画記録用撮影画像）を送信するか否かを判定する（ステップＳ１９３）。制御部２４は、撮影後に静止画記録用撮影画像を送信するか否かの設定に従って静止画記録用撮影画像の送信をするか否かを判定する。撮影後に静止画記録用撮影画像を送信するか否かの設定とは、例えば、レックビュー設定欄１０６の設定である。レックビュー設定欄１０６で「ＯＮ」が設定されている場合、制御部２４は、撮影画像を送信すると判定する。撮影画像を送信すると判定した場合（ステップＳ１９３；Ｙｅｓ）、制御部２４は、撮影画像（静止画記録用撮影画像）を第２の通信部２５を介して撮像指示装置１０へ送信するように制御する。第２の通信部２５は、撮影画像（静止画記録用撮影画像）を撮像指示装置１０へ送信する。撮影画像を送信しないと判定した場合（ステップＳ１９３；Ｎｏ）、本処理フローを終了する。
　一方、撮影指示情報を受信しなかった場合（ステップＳ１９；Ｎｏ）、制御部２４は、撮影中止かどうかを判定する（ステップＳ１９１）。具体的には、中止指示情報を受信した場合、制御部２４は、自分撮り処理の中止を決定し、本処理フローを終了する。 The imaging instruction device 10 determines whether or not the imaging preparation is ready based on the received shake information and the coordinate information of the face image, and captures the imaging instruction information when a predetermined time elapses after determining that the imaging preparation is ready. Transmit to device 20. In addition, when the user performs an operation for instructing to cancel the self-portrait, the imaging instruction apparatus 10 transmits stop instruction information to the imaging apparatus 20.
Then, the control unit 24 receives shooting instruction information or stop instruction information from the imaging instruction device 10 via the second communication unit 25 (step S18). When the imaging instruction information is received (step S19; Yes), the control unit 24 instructs the imaging unit 21 to perform imaging, and the imaging unit 21 performs imaging (step S192). The imaging unit 21 outputs the captured sensor output image to the image processing unit 23. The image processing unit 23 generates a still image recording captured image from the sensor output image. Next, the control unit 24 determines whether or not to transmit a captured image (still image recording captured image) (step S193). The control unit 24 determines whether to transmit the still image recording captured image according to the setting of whether to transmit the still image recording captured image after capturing. The setting as to whether or not to send a still image recording shot image after shooting is, for example, a setting in the REC view setting field 106. When “ON” is set in the REC view setting field 106, the control unit 24 determines to transmit a captured image. When it is determined to transmit the captured image (step S193; Yes), the control unit 24 controls to transmit the captured image (still image recording captured image) to the imaging instruction apparatus 10 via the second communication unit 25. To do. The second communication unit 25 transmits the shot image (still image recording shot image) to the imaging instruction device 10. If it is determined that the captured image is not transmitted (step S193; No), this processing flow ends.
On the other hand, when the shooting instruction information is not received (step S19; No), the control unit 24 determines whether or not shooting is stopped (step S191). Specifically, when the cancel instruction information is received, the control unit 24 determines to cancel the self-portrait process and ends the present process flow.
　なお、ユーザによる所定の指示操作により、画像処理部２３がセンサ出力画像から低解像度一時画像を生成し、撮像装置２０が低解像度一時画像を撮像指示装置１０へ送信してもよい。また、その場合、撮像指示装置１０では、表示制御部１９が、受信した低解像度一次画像からライブ画像を生成し、入出力部１１がライブ画像を表示するようにしてもよい。これによって、ユーザはライブ画像を確認しながら自分撮りを行うこともできる。 The image processing unit 23 may generate a low-resolution temporary image from the sensor output image and the imaging device 20 may transmit the low-resolution temporary image to the imaging instruction device 10 by a predetermined instruction operation by the user. In this case, in the imaging instruction device 10, the display control unit 19 may generate a live image from the received low-resolution primary image, and the input / output unit 11 may display the live image. This allows the user to take a selfie while checking the live image.
　図８は、本発明の第１の実施形態における撮像指示装置の処理の流れの一例を示す第１のフローチャートである。
　図８を用いて、本実施形態の撮像システム１を用いて自分撮りを行う場合の撮像指示装置１０の処理について説明する。
　前提として、撮像指示装置１０の入出力部１１において図４Ｂで例示した自分撮り指示画面が表示されており、ユーザが自分撮り実行指示ボタン１１１～１１４のうち何れかを押下したとする。入出力部１１は、どのボタンが押されたかを示す情報を撮影条件判定部１３へ出力する。また、第１の通信部１７は、どの自分撮り実行指示ボタンが押下されたかを示す情報などを撮像装置２０へ送信する。図７のフローチャートで説明したとおり、撮像装置２０は、揺れの情報や顔画像の座標情報を撮像指示装置１０へ送信する。 FIG. 8 is a first flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
With reference to FIG. 8, processing of the imaging instruction apparatus 10 when taking a self-portrait using the imaging system 1 of the present embodiment will be described.
As a premise, it is assumed that the self-portrait instruction screen illustrated in FIG. 4B is displayed on the input / output unit 11 of the image-capturing instruction apparatus 10 and the user presses one of the self-portrait execution instruction buttons 111 to 114. The input / output unit 11 outputs information indicating which button has been pressed to the imaging condition determination unit 13. In addition, the first communication unit 17 transmits information indicating which self-shoot execution instruction button has been pressed to the imaging device 20. As described with reference to the flowchart of FIG. 7, the imaging device 20 transmits shake information and face image coordinate information to the imaging instruction device 10.
　すると、撮像指示装置１０の第１の通信部１７が、撮像装置２０から揺れの情報（Ｘ軸、Ｙ軸方向の揺れの大きさとその揺れを検出した時刻）と顔画像の座標情報（顔画像の中心の座標情報と顔画像の矩形領域の座標情報のうち少なくとも一方）とを受信する（ステップＳ２０）。第１の通信部１７は受信した揺れの情報と顔画像の座標情報とをメモリ１６に記録する。
　次に、撮影条件判定部１３がメモリ１６から揺れの情報と顔画像の座標情報とを読み出して撮影条件を判定する（ステップＳ２１）。まず、撮影条件判定部１３は、揺れの情報について式（１）によって時刻ｔにおいて揺れが収まったかどうかを判定する。そして、撮影条件判定部１３は、所定の時間に渡って継続的に揺れが収まったと判定すると、撮像装置２０に揺れの大きさに関する撮影条件を満たしたと判定する。 Then, the first communication unit 17 of the imaging instruction apparatus 10 detects shaking information (the magnitude of the shaking in the X-axis and Y-axis directions and the time when the shaking is detected) and the coordinate information (face image) of the face image. At least one of the coordinate information of the center of the face and the coordinate information of the rectangular area of the face image is received (step S20). The first communication unit 17 records the received shake information and face image coordinate information in the memory 16.
Next, the shooting condition determination unit 13 reads the shake information and the coordinate information of the face image from the memory 16 and determines the shooting condition (step S21). First, the imaging condition determination unit 13 determines whether or not the shaking is settled at time t according to Equation (1) for the shaking information. Then, when the shooting condition determination unit 13 determines that the shaking has been continuously stopped for a predetermined time, the shooting condition determination unit 13 determines that the shooting condition regarding the magnitude of the shaking is satisfied in the imaging device 20.
　また、撮影条件判定部１３は、メモリ１６からユーザが図４Ａで例示した自分撮り設定画面で設定した構図設定情報を読み出す。撮影条件判定部１３は、読み出した構図設定情報と入出力部１１から取得したどのボタンが押下されたかを示す情報に対応する撮影対象の人数とに基づいて、その構図設定情報と人数に対応した構図ガイドエリアの領域を規定する座標情報をメモリ１６から読み出す。撮影条件判定部１３は、取得した顔画像の座標情報の数と撮影対象の人数を比較する。座標情報の数と撮影対象の人数が等しい場合、撮影条件判定部１３は、被写体の状態に関する第１の条件を満たしていると判定する。また、撮影条件判定部１３は、取得した顔画像の座標情報の全てがメモリ１６から読み出した構図ガイドエリアに含まれるかどうかを判定する。取得した顔画像の座標情報の全てが構図ガイドエリアに含まれる場合、撮影条件判定部１３は、被写体の状態に関する第２の条件を満たしていると判定する。この２つの条件を満たす場合、撮影条件判定部１３は、被写体の状態に対する撮影条件を満たしたと判定する。
　撮影条件判定部１３は、撮像装置２０に揺れの大きさに関する撮影条件と被写体の状態に対する撮影条件を共に満たした場合、撮影条件を満たしたと判定する。あるいは、撮影条件判定部１３は、撮像装置２０に揺れの大きさに関する撮影条件と被写体の状態に対する撮影条件とのうちどちらか一方を満たした場合、撮影条件を満たしたと判定してもよい。 In addition, the shooting condition determination unit 13 reads the composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the memory 16. The photographing condition determination unit 13 corresponds to the composition setting information and the number of persons based on the read composition setting information and the number of subjects to be photographed corresponding to the information indicating which button acquired from the input / output unit 11 is pressed. Coordinate information defining the composition guide area is read from the memory 16. The shooting condition determination unit 13 compares the number of coordinate information of the acquired face image with the number of shooting targets. When the number of coordinate information is equal to the number of subjects to be photographed, the photographing condition determination unit 13 determines that the first condition regarding the state of the subject is satisfied. Further, the photographing condition determination unit 13 determines whether or not all of the acquired coordinate information of the face image is included in the composition guide area read from the memory 16. When all the coordinate information of the acquired face image is included in the composition guide area, the imaging condition determination unit 13 determines that the second condition relating to the state of the subject is satisfied. When these two conditions are satisfied, the shooting condition determination unit 13 determines that the shooting conditions for the state of the subject are satisfied.
The imaging condition determination unit 13 determines that the imaging condition is satisfied when the imaging apparatus 20 satisfies both the imaging condition related to the magnitude of shaking and the imaging condition for the subject state. Alternatively, the imaging condition determination unit 13 may determine that the imaging condition is satisfied when the imaging device 20 satisfies either the imaging condition regarding the magnitude of shaking or the imaging condition for the state of the subject.
　ステップＳ２１で撮影条件を満たしたと判定した場合（ステップＳ２２；Ｙｅｓ）、撮影条件判定部１３は、撮影準備が整ったことを示す情報を通知制御部１４と第１のタイマ部１８へ出力する。 When it is determined in step S21 that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the shooting preparation is complete to the notification control unit 14 and the first timer unit 18.
　次に、通知制御部１４は、ユーザに撮影準備が完了したことを通知する（ステップＳ２３）。例えば、通知制御部１４は、撮像指示装置１０に備えられた振動モータなどの振動モジュールを動作させて撮像指示装置１０の筐体を振動させ、撮像指示装置１０を把持するユーザに撮影の準備が整ったことを通知する。あるいは、通知制御部１４は、撮像指示装置１０に備えられた音声出力モジュールを動作させてスピーカから所定の音声を出力させ、撮像指示装置１０を把持するユーザに撮影の準備が整ったことを通知する。なお、所定の音声とは、図４Ａで例示した自分撮り設定画面のサウンド設定欄１０３の「カウントダウン開始時」で設定した音声である。 Next, the notification control unit 14 notifies the user that the preparation for photographing has been completed (step S23). For example, the notification control unit 14 operates a vibration module such as a vibration motor provided in the imaging instruction device 10 to vibrate the housing of the imaging instruction device 10, and the user who holds the imaging instruction device 10 prepares for shooting. Notify that it is ready. Alternatively, the notification control unit 14 operates a voice output module provided in the imaging instruction device 10 to output a predetermined sound from the speaker, and notifies the user who holds the imaging instruction device 10 that preparation for shooting is completed. To do. The predetermined voice is a voice set in “when countdown starts” in the sound setting field 103 of the selfie setting screen illustrated in FIG. 4A.
　次に第１のタイマ部１８は、撮影タイマをスタートする（ステップＳ２４）。第１のタイマ部１８は、自分撮り設定画面のタイマ設定欄１０２で設定した時間が経過するまで時間を計時する。設定した撮影待ち時間が経過すると、第１のタイマ部１８は、撮影タイマを停止する（ステップＳ２５）。次に第１のタイマ部１８は、設定時間が経過したことを示す情報を通知制御部１４と撮影指示部１５に出力する。
　次に通知制御部１４は、ユーザに撮影のタイミングで通知を行う（ステップＳ２６）。例えば、通知制御部１４は、撮像指示装置１０を振動させたり、音声を出力させたりする。なお、出力させる音声は図４Ａのサウンド設定欄１０３の「撮影時」で設定した音声である。また、例えば図４Ａのように撮影時のサウンド設定で「Ｎｏｎｅ」を設定した場合は、ステップＳ２６の処理をスキップするようにしてもよい。 Next, the first timer unit 18 starts a shooting timer (step S24). The first timer unit 18 measures the time until the time set in the timer setting field 102 of the selfie setting screen has elapsed. When the set shooting waiting time elapses, the first timer unit 18 stops the shooting timer (step S25). Next, the first timer unit 18 outputs information indicating that the set time has elapsed to the notification control unit 14 and the imaging instruction unit 15.
Next, the notification control unit 14 notifies the user at the shooting timing (step S26). For example, the notification control unit 14 vibrates the imaging instruction device 10 or outputs a sound. Note that the sound to be output is the sound set in “during shooting” of the sound setting field 103 in FIG. 4A. Further, for example, when “None” is set in the sound setting at the time of shooting as shown in FIG. 4A, the processing in step S26 may be skipped.
　通知制御部１４による撮影時の通知と並行して、撮影指示部１５は、第１の通信部１７を介して、撮像装置２０へ撮影指示情報を送信する（ステップＳ２７）。撮像装置２０では、第２の通信部２５が撮影指示情報を受信して、制御部２４へ出力する。制御部２４は撮像部２１に撮影指示を行い、撮像部２１は撮影を実行する。撮像部２１は、撮影したセンサ出力画像を画像処理部２３へ出力する。画像処理部２３は、センサ出力画像に対して画像処理設定欄１０５の設定内容に応じた画像処理を行い、画像処理後の静止画記録用撮影画像を生成する。図７で説明したように撮影画像を送信する設定がなされている場合（例えば、レックビュー設定欄１０６で「ＯＮ」が設定されている場合）、画像処理部２３は、静止画記録用撮影画像を第２の通信部２５へ出力する。第２の通信部２５は、静止画記録用撮影画像を撮像指示装置１０へ送信する。撮像指示装置１０では、第１の通信部１７が撮影画像（静止画記録用撮影画像）を受信し（ステップＳ２７１）、メモリ１６に記録する。レックビュー設定欄１０６で「ＯＮ」が設定されている場合、表示制御部１９は、メモリ１６から静止画記録用撮影画像を読み出してレックビュー画像を生成し、レックビュー画像を入出力部１１に出力する。入出力部１１は、撮影画像（レックビュー画像）を表示する（ステップＳ２７２）。 In parallel with the notification at the time of shooting by the notification control unit 14, the shooting instruction unit 15 transmits shooting instruction information to the imaging device 20 via the first communication unit 17 (step S27). In the imaging device 20, the second communication unit 25 receives the imaging instruction information and outputs it to the control unit 24. The control unit 24 instructs the imaging unit 21 to perform shooting, and the imaging unit 21 executes shooting. The imaging unit 21 outputs the captured sensor output image to the image processing unit 23. The image processing unit 23 performs image processing corresponding to the setting contents of the image processing setting field 105 on the sensor output image, and generates a captured image for still image recording after image processing. As described with reference to FIG. 7, when the setting for transmitting the captured image is made (for example, when “ON” is set in the REC view setting field 106), the image processing unit 23 captures the captured image for still image recording. Is output to the second communication unit 25. The second communication unit 25 transmits the captured image for still image recording to the imaging instruction device 10. In the imaging instruction apparatus 10, the first communication unit 17 receives a captured image (still image recording captured image) (step S <b> 271) and records it in the memory 16. When “ON” is set in the REC view setting field 106, the display control unit 19 reads out the still image recording captured image from the memory 16 to generate a REC view image, and the REC view image is input to the input / output unit 11. Output. The input / output unit 11 displays a captured image (rec view image) (step S272).
　一方、ステップＳ２１で撮影条件を満たしていないと判定した場合（ステップＳ２２；Ｎｏ）、入出力部１１は、ユーザによる自分撮り中止指示操作が行われるかどうかを監視する（ステップＳ２８）。例えば、ユーザがハードボタン１２０を押下すると、入出力部１１は、自分撮り中止指示操作が行われたと判定する。入出力部１１が自分撮り中止指示操作を検出した場合（ステップＳ２８；Ｙｅｓ）、入出力部１１は、中止指示情報を撮影条件判定部１３に出力する。撮影条件判定部１３は、第１のタイマ部１８にタイマの停止を指示し、自分撮り処理を終了する。このとき、通知制御部１４が撮影を中止する通知を行ってもよい。入出力部１１が自分撮り中止指示操作を検出しない場合（ステップＳ２８；Ｎｏ）、撮影条件を満たすまでステップＳ２０からの処理を繰り返す。 On the other hand, if it is determined in step S21 that the shooting conditions are not satisfied (step S22; No), the input / output unit 11 monitors whether or not a self-shooting stop operation is performed by the user (step S28). For example, when the user presses the hard button 120, the input / output unit 11 determines that a self-shooting instruction operation has been performed. When the input / output unit 11 detects a self-shooting stop instruction operation (step S <b> 28; Yes), the input / output unit 11 outputs stop instruction information to the imaging condition determination unit 13. The shooting condition determination unit 13 instructs the first timer unit 18 to stop the timer, and ends the self-portrait process. At this time, the notification control unit 14 may make a notification to stop shooting. When the input / output unit 11 does not detect the self-shooting stop instruction operation (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
　なお、ステップＳ２１の撮影条件判定において、撮像装置２０の揺れの大きさによる判定だけで撮影条件が整ったかどうかを判定してもよい。あるいは、被写体の状態による判定だけで撮影条件が整ったかどうかを判定してもよい。
　また、画像処理部２３が顔認識処理によって被写体の笑顔を検出し、ステップＳ２２の撮影条件判定に加えて、被写体の笑顔を検出すると撮影タイマを開始し、撮影を実行するようにしてもよい。より具体的には、画像処理部２３が、顔画像の座標情報と対応付けてその顔画像の被写体が笑顔かどうかを示す情報を第２の通信部２５へ出力する。第２の通信部２５は、それらの情報を撮像指示装置１０へ送信する。撮像指示装置１０では、撮影条件判定部１３が、第１の通信部１７を介して被写体が笑顔かどうかを示す情報などを取得する。撮影条件判定部１３は、ステップＳ２１の判定条件に加えて、例えば、全ての被写体が笑顔である場合に撮影条件を満たすと判定する。なお、笑顔かどうかを判定に加える場合、笑顔を長時間維持しなくてよいように、撮影待ち時間を短くする（例えば０．５秒など）構成としてもよい。 Note that, in the shooting condition determination in step S21, it may be determined whether the shooting conditions are satisfied only by the determination based on the magnitude of the shaking of the imaging device 20. Alternatively, it may be determined whether or not the shooting conditions are satisfied only by determination based on the state of the subject.
Further, the image processing unit 23 may detect the smiling face of the subject by the face recognition process, and in addition to the shooting condition determination in step S22, when the smiling face of the subject is detected, the shooting timer may be started to execute shooting. More specifically, the image processing unit 23 outputs to the second communication unit 25 information indicating whether the subject of the face image is a smile in association with the coordinate information of the face image. The second communication unit 25 transmits the information to the imaging instruction device 10. In the imaging instruction apparatus 10, the imaging condition determination unit 13 acquires information indicating whether or not the subject is smiling via the first communication unit 17. In addition to the determination condition in step S21, the shooting condition determination unit 13 determines that the shooting condition is satisfied, for example, when all subjects are smiling. In addition, when adding whether it is a smile to a determination, it is good also as a structure which shortens imaging | photography waiting time (for example, 0.5 second etc.) so that a smile may not be maintained for a long time.
　図９は、本発明の第１の実施形態における撮像指示装置の処理の流れの一例を示す第２のフローチャートである。
　図９を用いて、本実施形態の撮像システム１を用いて自分撮りを行う場合の撮像指示装置１０の処理の別の形態について説明する。
　前提条件などは、図８のフローチャートの場合と同様である。図８のフローチャートと同様の処理については、簡単に説明を行う。
　まず、第１の通信部１７が撮像装置２０から揺れの情報と顔画像の座標情報とを受信する（ステップＳ２０）。次に撮影条件判定部１３は、第１の通信部１７から揺れの情報と顔画像の座標情報とを取得する。次に、撮影条件判定部１３が撮影条件を判定する（ステップＳ２１）。撮影条件を満たしたと判定した場合（ステップＳ２２；Ｙｅｓ）、通知制御部１４は、ユーザに撮影準備完了通知を行う（ステップＳ２３）。また、第１のタイマ部１８は、撮影タイマをスタートする（ステップＳ２４）。 FIG. 9 is a second flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
With reference to FIG. 9, another form of processing of the imaging instruction apparatus 10 when performing a self-portrait using the imaging system 1 of the present embodiment will be described.
The preconditions are the same as those in the flowchart of FIG. Processing similar to that in the flowchart of FIG. 8 will be briefly described.
First, the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20). Next, the imaging condition determination unit 13 acquires shake information and face image coordinate information from the first communication unit 17. Next, the shooting condition determination unit 13 determines shooting conditions (step S21). When it is determined that the shooting conditions are satisfied (step S22; Yes), the notification control unit 14 notifies the user of the completion of shooting preparation (step S23). Further, the first timer unit 18 starts a shooting timer (step S24).
　図９のフローチャートの場合、タイマ開始後も撮影条件判定部１３が、撮像装置２０から揺れの情報と顔画像の座標情報とを受信する（ステップＳ２０１）。ステップＳ２０１の処理は、ステップＳ２０と同様である。
　次に、撮影条件判定部１３が撮影キャンセル条件を判定する（ステップＳ２１１）。ステップＳ２１１の判定では、ステップＳ２１と同様に撮像装置２０の揺れの大きさや被写体の状態によって撮影キャンセル条件の判定を行ってもよい。例えば、撮影条件判定部１３は、式（１）を用いて撮像装置２０の揺れが所定の範囲に収まっていないと判定すると撮像装置２０に揺れの大きさに関する撮影キャンセル条件が成立したと判定する。あるいは、撮影条件判定部１３は、所定の時間における揺れが式（１）を満たさない回数が閾値以上となると撮像装置２０に揺れの大きさに関する撮影キャンセル条件が成立したと判定する。 In the case of the flowchart of FIG. 9, even after the timer is started, the imaging condition determination unit 13 receives the shake information and the coordinate information of the face image from the imaging device 20 (step S201). The process of step S201 is the same as that of step S20.
Next, the shooting condition determination unit 13 determines shooting cancellation conditions (step S211). In the determination in step S211, the shooting cancellation condition may be determined based on the magnitude of shaking of the imaging device 20 and the state of the subject, as in step S21. For example, if the imaging condition determination unit 13 determines that the shaking of the imaging device 20 is not within a predetermined range using Expression (1), the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20. . Alternatively, the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20 when the number of times that the shaking in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
　また、撮影条件判定部１３は、撮影対象となる被写体が移動し、被写体の顔画像の座標情報のうち１つでも構図ガイドエリアの領域を外れると、被写体の状態に関する撮影キャンセル条件が成立したと判定する。あるいは、撮像装置２０で画像処理部２３が、所定の大きさ以上の面積を有する顔画像を選択し、選択した顔画像についての中心点の座標情報などを送信してくる場合、撮影条件判定部１３は、撮影対象となる被写体の数が増減し、ユーザが指定した撮影対象の人数と異なると、被写体の状態に関する撮影キャンセル条件が成立したと判定する。撮影条件判定部１３は、撮像装置２０の揺れの大きさと被写体の状態とのうち、どちらか一方に関する撮影キャンセル条件が成立しただけで撮影キャンセル条件が成立したと判定してもよいし、揺れの大きさに関する撮影キャンセル条件と被写体の状態に関する撮影キャンセル条件の両方が成立したときに撮影キャンセル条件が成立したと判定してもよい。また、ステップＳ２１において被写体の笑顔を判定条件に加えた場合、例えば被写体のうち誰か一人が笑顔でなくなったら撮影キャンセル条件が成立したと判定してもよい。
　撮影キャンセル条件が成立した場合、撮影条件判定部１３は、撮影を中止することを決定する。 Further, the shooting condition determination unit 13 determines that the shooting cancel condition regarding the state of the subject is satisfied when the subject to be shot moves and even one of the coordinate information of the face image of the subject leaves the composition guide area. judge. Alternatively, when the image processing unit 23 in the imaging device 20 selects a face image having an area of a predetermined size or larger and transmits coordinate information of the center point of the selected face image, the shooting condition determination unit 13, when the number of subjects to be photographed increases or decreases and differs from the number of subjects to be photographed designated by the user, it is determined that a photographing cancellation condition regarding the state of the subject is satisfied. The imaging condition determination unit 13 may determine that the imaging cancellation condition is satisfied only by satisfying the imaging cancellation condition for either one of the magnitude of the shaking of the imaging device 20 and the state of the subject, It may be determined that the shooting cancel condition is satisfied when both the shooting cancel condition regarding the size and the shooting cancel condition regarding the state of the subject are satisfied. In addition, when the subject's smile is added to the determination condition in step S21, for example, it may be determined that the shooting cancellation condition is satisfied when one of the subjects is no longer smiling.
When the shooting cancellation condition is satisfied, the shooting condition determination unit 13 determines to stop shooting.
　撮影を中止する場合（ステップＳ２２１；Ｙｅｓ）、撮影条件判定部１３は、第１のタイマ部１８に撮影タイマの停止を指示し、自分撮り処理を終了する。
　撮影を中止しない場合（ステップＳ２２１；Ｎｏ）、設定した撮影待ち時間が経過すると、第１のタイマ部１８は、撮影タイマを停止し（ステップＳ２５）、通知制御部１４は、ユーザに撮影のタイミングで通知を行う（ステップＳ２６）。また、撮影指示部１５は、第１の通信部１７を介して、撮像装置２０へ撮影指示情報を送信し（ステップＳ２７）、撮像装置２０では、撮像部２１が撮影を実行する。
　レックビュー設定欄１０６で「ＯＮ」が設定されている場合、撮像装置２０は撮影画像（静止画記録用撮影画像）を送信する。撮像指示装置１０では、第１の通信部１７が撮影画像を受信し（ステップＳ２７１）、メモリ１６に記録する。表示制御部１９は、メモリ１６から撮影画像（静止画記録用撮影画像）を読み出してレックビュー画像を生成し、入出力部１１に出力する。入出力部１１は、撮影画像（レックビュー画像）を表示する（ステップＳ２７２）。 When shooting is stopped (step S221; Yes), the shooting condition determination unit 13 instructs the first timer unit 18 to stop the shooting timer, and ends the self-portrait process.
When shooting is not stopped (step S221; No), when the set shooting wait time has elapsed, the first timer unit 18 stops the shooting timer (step S25), and the notification control unit 14 notifies the user of the shooting timing. (Step S26). Further, the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17 (step S27), and in the imaging device 20, the imaging unit 21 performs imaging.
When “ON” is set in the REC view setting field 106, the imaging device 20 transmits a captured image (a still image recording captured image). In the imaging instruction device 10, the first communication unit 17 receives the captured image (step S <b> 271) and records it in the memory 16. The display control unit 19 reads a captured image (still image recording captured image) from the memory 16, generates a rec view image, and outputs it to the input / output unit 11. The input / output unit 11 displays a captured image (rec view image) (step S272).
　ステップＳ２２で撮影条件を満たしていないと判定した場合（ステップＳ２２；Ｎｏ）、入出力部１１がユーザによる自分撮り中止指示操作を検出すると（ステップＳ２８；Ｙｅｓ）、自分撮り処理を終了する。このとき、通知制御部１４が、振動や音声出力などにより撮影の中止を知らせる通知を行ってもよい。自分撮り中止指示操作を検出しない場合（ステップＳ２８；Ｎｏ）、撮影条件を満たすまでステップＳ２０からの処理を繰り返す。 If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. At this time, the notification control unit 14 may perform notification notifying that the shooting is stopped by vibration or sound output. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
　本実施形態によれば、撮影対象人数や構成を設定すれば、撮影準備が整っているかどうかの判定を撮像指示装置１０に任せることができるので、ユーザは、余計なことを気にせず自分撮りを行うことができる。また、撮像指示装置１０が撮影準備の整ったことを通知し、自分で設定した時間後に撮影が実行されることがわかっているので、ユーザは撮影のタイミングに合わせて所望の表情を作ったり自然な状態で撮影に臨むことができる。また、撮影準備の判定を撮像指示装置１０に任せることで、ユーザは煩雑な操作から解放され、ライブ画面を見ながら細かな調整などを行わなくて良いので、素早く目立たずに自分撮りを行うことができる。また、撮影対象人数や構成設定によって、背後の風景を入れて撮影したい場合や、２～３人などで撮影したい場合にも対応することができる。
　なお、図７～図９では、レックビュー設定欄１０６の設定などに応じて撮像装置２０が静止画記録用画像を送信し、撮像指示装置１０はレックビュー画像を表示する動作を例に説明を行ったが、撮像装置２０は静止画記録用画像を常に撮像指示装置１０へ送信し、撮像指示装置１０は静止画記録用画像を受信してメモリ１６に記録し、レックビュー画像の表示／非表示のみを設定に応じて制御するようにしてもよい。 According to the present embodiment, if the number of people to be photographed and the configuration are set, it can be left to the imaging instruction device 10 to determine whether or not the photographing preparation is complete, so the user can take a self-portrait without worrying about unnecessary things. It can be performed. In addition, since the imaging instruction apparatus 10 notifies that the preparation for shooting is ready and it is known that shooting is performed after the time set by the user, the user can make a desired facial expression in accordance with the timing of shooting. You can start shooting in a safe state. Also, by leaving the determination of shooting preparation to the imaging instruction device 10, the user is freed from complicated operations and does not have to make fine adjustments while watching the live screen, so that the user can take a self-photograph without being noticeable quickly. Can do. In addition, depending on the number of persons to be photographed and the configuration settings, it is possible to cope with the case where it is desired to shoot with a landscape behind, or where it is desired to shoot with two to three people.
7 to 9, the imaging device 20 transmits a still image recording image in accordance with the setting of the REC view setting field 106 and the like, and the imaging instruction device 10 illustrates an operation of displaying the REC view image as an example. However, the imaging device 20 always transmits the still image recording image to the imaging instruction device 10, and the imaging instruction device 10 receives and records the still image recording image in the memory 16, and displays / not displays the REC view image. Only display may be controlled according to the setting.
　（第２の実施形態）
　次に、本発明の第２の実施形態について図１０～図１１を用いて説明する。
　図１０は、本発明の第２の実施形態における撮像システムの構成を示した機能ブロック図である。
　本実施形態と第１の実施形態とで異なる点は、撮像装置２０が第２のタイマ部２６を備えている点である。第２の実施形態において撮像指示装置１０は、第１のタイマ部１８を備えていなくてもよい。本実施形態では、撮像装置２０が撮像指示を受信してから、第２のタイマ部２６が、ユーザが設定した時間の経過を計時し、撮像装置２０自らが撮影のタイミングを決定する。その他の構成および動作については、第１の実施形態と同様である。 (Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS.
FIG. 10 is a functional block diagram showing the configuration of the imaging system in the second embodiment of the present invention.
The difference between the present embodiment and the first embodiment is that the imaging device 20 includes a second timer unit 26. In the second embodiment, the imaging instruction device 10 may not include the first timer unit 18. In the present embodiment, after the imaging device 20 receives the imaging instruction, the second timer unit 26 measures the lapse of time set by the user, and the imaging device 20 itself determines the shooting timing. Other configurations and operations are the same as those in the first embodiment.
　図１１は、本発明の第２の実施形態における撮像システムの処理の流れの一例を示すフローチャートである。
　図１１を用いて、本実施形態の撮像システム１を用いて自分撮りを行う場合の処理について説明する。第１の実施形態と同様の処理については簡単に説明を行う。なお、撮像装置２０について、図７で説明した処理については説明を省略するが、撮像装置２０は、自装置の揺れの情報と撮影対象の顔画像の座標情報などを撮像指示装置１０へ送信しているものとする。
　まず、第１の通信部１７が撮像装置２０から揺れの情報と顔画像の座標情報とを受信する（ステップＳ２０）。撮影条件判定部１３は、第１の通信部１７から揺れの情報と顔画像の座標情報とを取得して撮影条件を判定する（ステップＳ２１）。撮影条件を満たしたと判定した場合（ステップＳ２２；Ｙｅｓ）、撮影条件判定部１３は、撮影準備が整ったことを示す情報を通知制御部１４と撮影指示部１５へ出力する。通知制御部１４は、ユーザに撮影準備完了通知を行う（ステップＳ２３）。また、撮影指示部１５は、第１の通信部１７を介して撮像装置２０へタイマ撮影指示情報を送信する（ステップＳ２９）。タイマ撮影指示情報は、何秒後に撮影を行うかを指定した撮影待ち時間情報を含んだ撮影指示情報である。 FIG. 11 is a flowchart illustrating an example of a processing flow of the imaging system according to the second embodiment of the present invention.
With reference to FIG. 11, a description will be given of processing in the case where a self-portrait is performed using the imaging system 1 of the present embodiment. A process similar to that of the first embodiment will be briefly described. Although the description of the processing described in FIG. 7 for the imaging device 20 is omitted, the imaging device 20 transmits information about the shaking of the device itself and coordinate information of the face image to be photographed to the imaging instruction device 10. It shall be.
First, the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20). The shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15. The notification control unit 14 notifies the user of completion of shooting preparation (step S23). In addition, the shooting instruction unit 15 transmits timer shooting instruction information to the imaging device 20 via the first communication unit 17 (step S29). The timer shooting instruction information is shooting instruction information including shooting waiting time information that specifies how many seconds the shooting should be performed.
　撮像装置２０では、第２の通信部２５がタイマ撮影指示情報を受信し（ステップＳ３０）、制御部２４に出力する。制御部２４は、第２のタイマ部２６に撮影タイマの開始を指示する。第２のタイマ部２６は、撮影タイマをスタートする（ステップＳ３１）。タイマ撮影指示情報に指定された撮影待ち時間が経過すると、第２のタイマ部２６は、撮影タイマを停止する（ステップＳ３２）。第２のタイマ部２６は、設定時間が経過したことを示す情報を制御部２４に出力する。制御部２４は撮像部２１に撮影指示を行い、撮像部２１は撮影を実行する（ステップＳ３３）。また、制御部２４は、撮影完了情報を、第２の通信部２５を介して撮像指示装置１０へ送信するよう制御する。第２の通信部２５は、撮影が完了したことを示す撮影完了情報を撮像指示装置１０へ送信する（ステップＳ３４）。また、撮影が完了すると、撮像部２１は、センサ出力画像を画像処理部２３へ出力し、画像処理部２３は画像処理を行う。第２の通信部２５は、画像処理後の撮影画像（静止画記録用撮影画像）を撮像指示装置１０へ送信する（ステップＳ３５）。 In the imaging device 20, the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24. The control unit 24 instructs the second timer unit 26 to start the shooting timer. The second timer unit 26 starts a shooting timer (step S31). When the imaging waiting time specified in the timer imaging instruction information has elapsed, the second timer unit 26 stops the imaging timer (step S32). The second timer unit 26 outputs information indicating that the set time has elapsed to the control unit 24. The control unit 24 issues a shooting instruction to the imaging unit 21, and the imaging unit 21 performs shooting (step S33). In addition, the control unit 24 performs control so that the shooting completion information is transmitted to the imaging instruction apparatus 10 via the second communication unit 25. The second communication unit 25 transmits shooting completion information indicating that shooting has been completed to the imaging instruction apparatus 10 (step S34). When the photographing is completed, the imaging unit 21 outputs a sensor output image to the image processing unit 23, and the image processing unit 23 performs image processing. The second communication unit 25 transmits the captured image (photographed image for still image recording) after the image processing to the imaging instruction device 10 (step S35).
　撮像指示装置１０では、第１の通信部１７が撮影完了情報を受信し、通知制御部１４に出力する。次に通知制御部１４は、撮像指示装置１０を振動させたり、音声を出力させたりしてユーザに撮影時の通知を行う（ステップＳ２６）。 In the imaging instruction device 10, the first communication unit 17 receives the imaging completion information and outputs it to the notification control unit 14. Next, the notification control unit 14 notifies the user at the time of shooting by vibrating the imaging instruction device 10 or outputting a sound (step S26).
　ステップＳ２２で撮影条件を満たしていないと判定した場合（ステップＳ２２；Ｎｏ）の処理は、第１の実施形態と同様である。入出力部１１がユーザによる自分撮り中止指示操作を検出すると（ステップＳ２８；Ｙｅｓ）、自分撮り処理を終了する。自分撮り中止指示操作を検出しない場合（ステップＳ２８；Ｎｏ）、撮影条件を満たすまでステップＳ２０からの処理を繰り返す。 When it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), the processing is the same as in the first embodiment. When the input / output unit 11 detects a selfie stop instruction operation by the user (step S28; Yes), the selfie process is terminated. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
　本実施形態のように撮像装置２０で撮影タイマを起動し、自分撮りを実行する構成とすることも可能である。
　なお、ステップＳ３３の後に撮影画像を撮像指示装置１０へ送信する場合を例に説明を行ったが、第１の実施形態と同様に、撮影画像を送信するか否かの設定に応じて撮像装置２０が静止画記録用画像を送信し、撮像指示装置１０がレックビュー画像を表示するようにしてもよい。 As in the present embodiment, the imaging timer 20 may be started by the imaging device 20 to execute a self-portrait.
The case where a captured image is transmitted to the imaging instruction apparatus 10 after step S33 has been described as an example. However, as in the first embodiment, the imaging apparatus is set according to whether or not a captured image is transmitted. 20 may transmit a still image recording image, and the imaging instruction apparatus 10 may display a rec view image.
　（第３の実施形態）
　次に、本発明の第３の実施形態について図１２～図１３を用いて説明する。
　図１２は、本発明の第３の実施形態における撮像システムの構成を示した機能ブロック図である。
　本実施形態と第２の実施形態とで異なる点は、撮像装置２０が撮影中止条件判定部２７を備えている点である。本実施形態では、撮像装置２０が撮像指示を受信してから、第２のタイマ部２６によって撮影タイミングを決定するまでの間、撮影中止条件判定部２７が、撮影中止条件の判定を行う。そして、撮影中止条件が満たされた場合、撮像装置２０は撮影を中止する。その他の構成および動作については、第２の実施形態と同様である。 (Third embodiment)
Next, a third embodiment of the present invention will be described with reference to FIGS.
FIG. 12 is a functional block diagram showing the configuration of the imaging system in the third embodiment of the present invention.
The difference between the present embodiment and the second embodiment is that the imaging apparatus 20 includes a shooting stop condition determination unit 27. In the present embodiment, the shooting stop condition determination unit 27 determines the shooting stop condition from when the imaging device 20 receives the shooting instruction until the second timer unit 26 determines the shooting timing. Then, when the shooting stop condition is satisfied, the imaging device 20 stops shooting. Other configurations and operations are the same as those in the second embodiment.
　図１３は、本発明の第３の実施形態における撮像システムの処理の流れの一例を示すフローチャートである。
　図１３を用いて、第２の実施形態における撮像システムの処理について説明する。図１１で説明した処理と同じ処理については簡単に説明する。
　まず、第１の通信部１７が撮像装置２０から揺れの情報と顔画像の座標情報とを受信する（ステップＳ２０）。撮影条件判定部１３は、第１の通信部１７から揺れの情報と顔画像の座標情報とを取得して撮影条件を判定する（ステップＳ２１）。撮影条件を満たしたと判定した場合（ステップＳ２２；Ｙｅｓ）、撮影条件判定部１３は、撮影準備が整ったことを示す情報を通知制御部１４と撮影指示部１５へ出力する。通知制御部１４は、ユーザに撮影準備完了通知を行う（ステップＳ２３）。撮影指示部１５は、第１の通信部１７を介して撮像装置２０へタイマ撮影指示情報を送信する（ステップＳ２９）。 FIG. 13 is a flowchart illustrating an example of a processing flow of the imaging system according to the third embodiment of the present invention.
Processing of the imaging system in the second embodiment will be described with reference to FIG. The same processing as that described in FIG. 11 will be briefly described.
First, the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20). The shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15. The notification control unit 14 notifies the user of completion of shooting preparation (step S23). The imaging instruction unit 15 transmits timer imaging instruction information to the imaging device 20 via the first communication unit 17 (step S29).
　撮像装置２０では、第２の通信部２５がタイマ撮影指示情報を受信し（ステップＳ３０）、制御部２４に出力する。制御部２４は、第２のタイマ部２６に撮影タイマの開始を指示する。第２のタイマ部２６は、撮影タイマをスタートする（ステップＳ３１）。 In the imaging device 20, the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24. The control unit 24 instructs the second timer unit 26 to start the shooting timer. The second timer unit 26 starts a shooting timer (step S31).
　次に、撮影中止条件判定部２７が、撮影中止条件の判定を行う（ステップＳ３６）。例えば、撮影中止条件判定部２７は、振動検出部２２が検出した揺れの情報とその揺れの検出時刻の情報とを、振動検出部２２から取得する。撮影中止条件判定部２７は、式（１）を用いて撮像装置２０の揺れが所定の範囲に収まっていないと判定すると撮影中止条件が成立したと判定する。あるいは、撮影中止条件判定部２７は、所定の時間における揺れが式（１）を満たさない回数が閾値以上となると撮影中止条件が成立したと判定する。 Next, the shooting stop condition determination unit 27 determines the shooting stop condition (step S36). For example, the imaging stop condition determination unit 27 acquires the shake information detected by the vibration detection unit 22 and the information on the detection time of the shake from the vibration detection unit 22. If it is determined that the shaking of the imaging device 20 is not within the predetermined range using the equation (1), the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied. Alternatively, the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied when the number of times that the fluctuation in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
　また、例えば、撮影中止条件判定部２７は、画像処理部２３から顔画像の座標情報を取得し、被写体の状態に関して撮影中止条件を判定してもよい。この場合、撮像装置２０は、撮像指示装置１０からユーザが図４Ａで例示した自分撮り設定画面で設定した構図設定情報を受信しており、また、撮像装置２０の記憶部（図示せず）には、構図設定情報と対象人数に応じた構図ガイドエリアが記録されているものとする。撮影中止条件判定部２７は、被写体の顔画像の座標情報のうち１つでも構図ガイドエリアの領域を外れたり、撮影対象となる被写体の数が増減し、ユーザが指定した撮影対象の人数と異なったりすると撮影中止条件が成立したと判定する。 Further, for example, the shooting stop condition determination unit 27 may acquire the coordinate information of the face image from the image processing unit 23 and determine the shooting stop condition regarding the state of the subject. In this case, the imaging apparatus 20 has received composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the imaging instruction apparatus 10 and stored in a storage unit (not shown) of the imaging apparatus 20. , It is assumed that the composition setting information and the composition guide area corresponding to the target number of persons are recorded. The shooting stop condition determination unit 27 is different from the number of shooting targets specified by the user because one of the coordinate information of the face image of the subject is out of the composition guide area or the number of shooting targets is increased or decreased. Or the like, it is determined that the shooting stop condition is satisfied.
　なお、撮影中止条件判定部２７は、撮像装置２０の揺れの大きさと被写体の状態とのうち、どちらか一方に関する撮影中止条件が成立しただけで撮影中止条件が成立したと判定してもよいし、撮像装置２０の揺れの大きさに関する撮影中止条件と被写体の状態に関する撮影中止条件の両方が成立したときに撮影中止条件が成立したと判定してもよい。撮影中止条件判定部２７は判定結果を制御部２４へ出力する。撮影の中止を判定した場合（ステップＳ３７；Ｙｅｓ）、制御部２４は、第２の通信部２５を介して、撮影の中止を示す撮影中止情報を撮像指示装置１０へ送信する（ステップＳ３８）。また、制御部２４は、第２のタイマ部２６にタイマの停止を指示し、自分撮り処理は終了する。 Note that the shooting stop condition determination unit 27 may determine that the shooting stop condition is satisfied only when the shooting stop condition for either one of the magnitude of shaking of the imaging device 20 and the state of the subject is satisfied. Alternatively, it may be determined that the shooting stop condition is satisfied when both the shooting stop condition regarding the magnitude of the shaking of the imaging device 20 and the shooting stop condition regarding the state of the subject are satisfied. The shooting stop condition determination unit 27 outputs the determination result to the control unit 24. When it is determined that shooting is to be stopped (step S37; Yes), the control unit 24 transmits shooting stop information indicating the stop of shooting to the imaging instruction apparatus 10 via the second communication unit 25 (step S38). In addition, the control unit 24 instructs the second timer unit 26 to stop the timer, and the self-portrait process ends.
　撮影の中止を判定しない場合（ステップＳ３７；Ｎｏ）、設定した撮影待ち時間が経過すると、第２のタイマ部２６は、撮影タイマを停止し（ステップＳ３２）、撮像部２１は撮影を実行する（ステップＳ３３）。また、第２の通信部２５は、撮影完了情報を撮像指示装置１０へ送信する（ステップＳ３４）。また、撮影が完了すると、第２の通信部２５は、撮影画像（静止画記録用撮影画像）を撮像指示装置１０へ送信する（ステップＳ３５）。
　撮像指示装置１０では、第１の通信部１７が撮影完了情報を受信し、通知制御部１４は、ユーザに撮影時の通知を行う（ステップＳ２６）。 When it is not determined to stop shooting (step S37; No), when the set shooting wait time elapses, the second timer unit 26 stops the shooting timer (step S32), and the imaging unit 21 executes shooting (step S32). Step S33). Further, the second communication unit 25 transmits shooting completion information to the imaging instruction device 10 (step S34). When the photographing is completed, the second communication unit 25 transmits a photographed image (still image recording photographed image) to the imaging instruction device 10 (step S35).
In the imaging instruction device 10, the first communication unit 17 receives the imaging completion information, and the notification control unit 14 notifies the user at the time of imaging (step S26).
　ステップＳ２２で撮影条件を満たしていないと判定した場合（ステップＳ２２；Ｎｏ）、入出力部１１がユーザによる自分撮り中止指示操作を検出すると（ステップＳ２８；Ｙｅｓ）、自分撮り処理を終了する。自分撮り中止指示操作を検出しない場合（ステップＳ２８；Ｎｏ）、撮影条件を満たすまでステップＳ２０からの処理を繰り返す。 If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
　本実施形態のように撮像装置２０で撮影タイマを起動し、撮像装置２０で撮影中止判定を行う構成とすることも可能である。
　なお、撮影画像の送信については、第１の実施形態と同様に、撮影画像を送信するか否かの設定に応じて撮像装置２０が静止画記録用画像を送信し、撮像指示装置１０がレックビュー画像を表示するようにしてもよい。 It is also possible to employ a configuration in which a shooting timer is started by the imaging device 20 and the shooting stop determination is performed by the imaging device 20 as in the present embodiment.
As for the transmission of the captured image, as in the first embodiment, the imaging device 20 transmits the still image recording image according to the setting of whether to transmit the captured image, and the imaging instruction device 10 A view image may be displayed.
　以上、この発明の第１の実施形態、第２の実施形態、第３の実施形態について図面を参照して詳述してきたが、例えば、撮像装置２０が撮影して生成した撮影画像を、撮像指示装置１０に送信しているが、撮像装置２０が備える記憶部（図示せず）に保存するようにしてもよい。また、第３の実施形態において、撮影条件の判定を撮像装置２０で行うようにしてもよい。なお、入出力部１１は入力部の一例である。 As described above, the first embodiment, the second embodiment, and the third embodiment of the present invention have been described in detail with reference to the drawings. For example, the captured image generated by the imaging device 20 is captured. Although it is transmitted to the instruction device 10, it may be stored in a storage unit (not shown) included in the imaging device 20. In the third embodiment, the imaging condition may be determined by the imaging device 20. The input / output unit 11 is an example of an input unit.
　なお、上述した実施形態における撮像指示装置１０、撮像装置２０が備える各部の機能全体あるいはその一部は、これらの機能を実現するためのプログラムをコンピュータ読み取り可能な記録媒体に記録して、この記録媒体に記録されたプログラムをコンピュータシステムに読み込ませ、実行することによって実現しても良い。なお、ここでいう「コンピュータシステム」とは、ＯＳや周辺機器等のハードウェアを含むものとする。 Note that all or some of the functions of the units included in the imaging instruction device 10 and the imaging device 20 according to the above-described embodiment are recorded on a computer-readable recording medium, and this recording is performed. You may implement | achieve by making a computer system read the program recorded on the medium and executing it. Here, the “computer system” includes an OS and hardware such as peripheral devices.
　また、「コンピュータ読み取り可能な記録媒体」とは、フレキシブルディスク、光磁気ディスク、ＲＯＭ、ＣＤ－ＲＯＭ等の可搬媒体、コンピュータシステムに内蔵されるハードディスク等の記憶部のことをいう。さらに「コンピュータ読み取り可能な記録媒体」とは、インターネット等のネットワークや電話回線等の通信回線を介してプログラムを送信する場合の通信線のように、短時刻の間、動的にプログラムを保持するもの、その場合のサーバやクライアントとなるコンピュータシステム内部の揮発性メモリのように、一定時刻プログラムを保持しているものも含んでも良い。また上記プログラムは、前述した機能の一部を実現するためのものであっても良く、さらに前述した機能をコンピュータシステムにすでに記録されているプログラムとの組み合わせで実現できるものであっても良い。 The “computer-readable recording medium” means a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
　以上、本発明の好ましい実施形態を説明したが、本発明はこれら実施形態及びその変形例に限定されることはない。本発明の趣旨を逸脱しない範囲で、構成の付加、省略、置換、およびその他の変更が可能である。
　また、本発明は前述した説明によって限定されることはなく、添付のクレームの範囲によってのみ限定される。 As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment and its modification. Additions, omissions, substitutions, and other modifications can be made without departing from the spirit of the present invention.
Further, the present invention is not limited by the above description, and is limited only by the scope of the appended claims.
　上記各形態の撮像指示装置、撮像システム、撮影方法およびプログラムによれば、撮像指示装置は、自分撮りを行うユーザの撮影準備が整っているかどうかを判定する。撮像指示装置は、撮影準備が整ったと判定すると撮像装置に撮像指示を行う。これにより、ユーザは、撮影準備が整ってから自分自身を撮影することができる。また、撮像指示装置は、ユーザに撮影を開始する合図を通知し、撮像装置は、撮像指示があってから所定の時間経過後に撮影を行う。これにより、ユーザは所望の表情や姿勢で撮影に臨むことができる。 According to the imaging instruction device, the imaging system, the imaging method, and the program of each aspect described above, the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging. When the imaging instruction device determines that the preparation for shooting is complete, the imaging instruction device instructs the imaging device to take an image. As a result, the user can photograph himself / herself after preparation for photographing is completed. In addition, the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
　１　　　撮像システム
　１０　　撮像指示装置
　１１　　入出力部
　１２　　条件設定部
　１３　　撮影条件判定部
　１４　　通知制御部
　１５　　撮影指示部
　１６　　メモリ
　１７　　第１の通信部
　１８　　第１のタイマ部
　２０　　撮像装置
　２１　　撮像部
　２２　　振動検出部
　２３　　画像処理部
　２４　　制御部
　２５　　第２の通信部
　２６　　第２のタイマ部
　２７　　撮影中止条件判定部
　３０　　光学モジュール DESCRIPTION OF SYMBOLS 1 Imaging system 10 Imaging instruction | indication apparatus 11 Input / output part 12 Condition setting part 13 Imaging condition determination part 14 Notification control part 15 Imaging | photography instruction | indication part 16 Memory 17 1st communication part 18 1st timer part 20 Imaging device 21 Imaging part 22 Vibration Detection unit 23 Image processing unit 24 Control unit 25 Second communication unit 26 Second timer unit 27 Imaging stop condition determination unit 30 Optical module

Claims (9)

  1. 　撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する撮影条件判定部と、
    　前記撮影条件判定部が撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う撮影指示部と、
    　前記撮影条件判定部が撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する通知制御部と、
    　を備える撮像指示装置。     A shooting condition determining unit that determines whether or not a shooting condition is satisfied based on at least one of information indicating a magnitude of shaking of the imaging device and information relating to a state of a subject captured in the image being shot by the imaging device; ,
    When the shooting condition determining unit determines that the shooting condition is satisfied, a shooting instruction unit that issues a shooting instruction so that the imaging apparatus executes shooting of a still image recording shot image after a predetermined time has elapsed since the determination was made. When,
    When it is determined that the shooting condition determination unit satisfies the shooting condition, a notification control unit that controls at least one of the vibration module and the audio output module to operate and notifies the user of the determination result;
    An imaging instruction apparatus comprising:
  2. 　前記被写体の状態に関する情報は、前記撮影中の画像に写る被写体の数であって、
    　前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像の数によって前記被写体の数を認識し、認識した被写体の数が所定の数であれば、撮影条件を満たすと判定する、
    　を備える請求項１に記載の撮像指示装置。     The information on the state of the subject is the number of subjects that appear in the image being shot,
    The shooting condition determination unit recognizes the number of subjects based on the number of face images of the subject in the image being shot, and determines that the shooting condition is satisfied if the number of recognized subjects is a predetermined number.
    The imaging instruction device according to claim 1, comprising:
  3. 　前記被写体の状態に関する情報は、前記撮影中の画像に写る一人又は複数の被写体の位置であって、
    　前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像が示す位置によって前記被写体の位置を認識し、認識した一人又は複数の被写体の位置が所定の範囲内にあれば、撮影条件を満たすと判定する、
    　請求項１または請求項２の何れか１項に記載の撮像指示装置。     The information on the state of the subject is the position of one or more subjects in the image being shot,
    The shooting condition determining unit recognizes the position of the subject based on the position indicated by the face image of the subject in the image being shot, and if the recognized position of one or more subjects is within a predetermined range, the shooting condition is determined. To determine that
    The imaging instruction | indication apparatus of any one of Claim 1 or Claim 2.
  4. 　前記撮影条件判定部は、前記撮像装置の揺れの大きさ示す情報に基づいて前記撮像装置の揺れの大きさを判定し、前記撮像装置の揺れの大きさが所定の閾値以内であれば、撮影条件を満たすと判定する、
    　請求項１から請求項３の何れか１項に記載の撮像指示装置。     The imaging condition determination unit determines the magnitude of shaking of the imaging device based on information indicating the magnitude of shaking of the imaging device, and if the magnitude of shaking of the imaging device is within a predetermined threshold, imaging is performed. Determine that the condition is met,
    The imaging instruction | indication apparatus of any one of Claims 1-3.
  5. 　前記撮影条件判定部が判定に用いる撮影条件であって、前記撮影条件を満たすと判定してから撮影を実行するまでの時間、または、前記撮影中の画像に含まれる被写体の数、または、被写体の位置のうち少なくとも１つを指定する条件の入力を受け付ける入力部、
    　をさらに備える請求項１から請求項４の何れか１項に記載の撮像指示装置。     The shooting conditions used for the determination by the shooting condition determination unit, the time from when it is determined that the shooting conditions are satisfied until shooting is performed, the number of subjects included in the image being shot, or the subjects An input unit for receiving an input of a condition for designating at least one of the positions of
    The imaging instruction apparatus according to any one of claims 1 to 4, further comprising:
  6. 　前記撮影条件判定部は、ユーザによる撮影を中止する指示操作、または、前記撮像装置の揺れの大きさ示す情報、または、前記撮像装置が撮影中の画像に写る被写体の状態に関する情報、に基づいて撮影の中止を決定する、
    　請求項１から請求項５の何れか１項に記載の撮像指示装置。     The shooting condition determination unit is based on an instruction operation for stopping shooting by a user, information indicating a magnitude of shaking of the imaging device, or information on a state of a subject that is captured in an image being shot by the imaging device. Decide to stop shooting,
    The imaging instruction | indication apparatus of any one of Claims 1-5.
  7. 　前記撮像装置と通信を行う第１の通信部、をさらに備える請求項１から請求項６の何れか１項に記載の撮像指示装置と、
    　撮像部と、前記撮像指示装置と通信を行う第２の通信部と、自装置の揺れを検出する振動検出部と、前記撮像部が撮影中の画像に写る被写体の状態を認識する画像処理部と、を備える撮像装置と、
    　を備える撮像システム。     The imaging instruction device according to any one of claims 1 to 6, further comprising a first communication unit that communicates with the imaging device.
    An imaging unit, a second communication unit that communicates with the imaging instruction device, a vibration detection unit that detects shaking of the own device, and an image processing unit that recognizes a state of a subject that is captured in an image being captured by the imaging unit An imaging device comprising:
    An imaging system comprising:
  8. 　撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定し、
    　前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮像指示を行い、
    　さらに、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する、
    　撮影方法。     Determining whether the imaging condition is satisfied based on at least one of the information indicating the magnitude of shaking of the imaging device and the information on the state of the subject in the image being captured by the imaging device;
    When it is determined that the shooting condition is satisfied, an imaging instruction is performed so that the imaging device executes shooting of a still image recording shot image after a predetermined time has elapsed since the determination is made;
    Further, at least one of the vibration module and the audio output module is operated, and control is performed to notify the user of the determination result.
    Shooting method.
  9. 　撮像指示装置のコンピュータを、
    　撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する手段、
    　前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う手段、
    　前記撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する手段、
    　として機能させるためのプログラム。     The computer of the imaging instruction device
    Means for determining whether or not a photographing condition is satisfied based on at least one of information indicating information indicating a magnitude of shaking of the imaging device and information regarding a state of a subject in the image being captured by the imaging device;
    Means for giving a shooting instruction so that the imaging device executes shooting of a shot image for still image recording after a predetermined time has elapsed since the determination was made that the shooting condition is satisfied;
    Means for operating at least one of the vibration module and the audio output module when it is determined that the shooting condition is satisfied, and controlling the notification result to the user;
    Program to function as.
PCT/JP2015/063074 2015-05-01 2015-05-01 Image-capturing instructing device, image capturing system, image capturing method, and program WO2016178267A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/063074 WO2016178267A1 (en) 2015-05-01 2015-05-01 Image-capturing instructing device, image capturing system, image capturing method, and program

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/063074 WO2016178267A1 (en) 2015-05-01 2015-05-01 Image-capturing instructing device, image capturing system, image capturing method, and program

Publications (1)

Publication Number Publication Date
WO2016178267A1 true WO2016178267A1 (en) 2016-11-10

Family

ID=57218575

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/063074 WO2016178267A1 (en) 2015-05-01 2015-05-01 Image-capturing instructing device, image capturing system, image capturing method, and program

Country Status (1)

Country Link
WO (1) WO2016178267A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023218884A1 (en) * 2022-05-12 2023-11-16 ソニーグループ株式会社 Image-capturing device, control method, and program

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007074296A (en) * 2005-09-06 2007-03-22 Canon Inc Cradle unit and control method thereof, viewer apparatus and control method thereof, and control program
JP2007180869A (en) * 2005-12-27 2007-07-12 Seiko Epson Corp Photographing apparatus, electronic apparatus, photographing method, program, and recording medium
JP2010114842A (en) * 2008-11-10 2010-05-20 Samsung Yokohama Research Institute Co Ltd Image capturing apparatus and method
JP2012010162A (en) * 2010-06-25 2012-01-12 Kyocera Corp Camera device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007074296A (en) * 2005-09-06 2007-03-22 Canon Inc Cradle unit and control method thereof, viewer apparatus and control method thereof, and control program
JP2007180869A (en) * 2005-12-27 2007-07-12 Seiko Epson Corp Photographing apparatus, electronic apparatus, photographing method, program, and recording medium
JP2010114842A (en) * 2008-11-10 2010-05-20 Samsung Yokohama Research Institute Co Ltd Image capturing apparatus and method
JP2012010162A (en) * 2010-06-25 2012-01-12 Kyocera Corp Camera device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023218884A1 (en) * 2022-05-12 2023-11-16 ソニーグループ株式会社 Image-capturing device, control method, and program

Similar Documents

Publication Publication Date Title
JP4884417B2 (en) Portable electronic device and control method thereof
US8730335B2 (en) Imaging apparatus and imaging system
US9106836B2 (en) Imaging apparatus, control method for the same, and recording medium, where continuous shooting or single shooting is performed based on touch
US9094597B2 (en) Imaging apparatus and imaging system
US9172878B2 (en) Image capturing apparatus, image capturing control method and storage medium for capturing a subject to be recorded with intended timing
JP2014057310A (en) Method and apparatus for displaying camera preview screen of portable terminal device
US10447919B2 (en) Imaging device, external device, imaging system, imaging method, operating method, and computer-readable recording medium
JP2014007653A (en) Imaging device, imaging method, imaging system, and program
KR20120090431A (en) Method for capturing picture in a portable terminal
WO2015194084A1 (en) Information processing device, information processing system, and information processing method and program
RU2635873C2 (en) Method and device for displaying framing information
JP2009171428A (en) Control method and program for digital camera apparatus and electronic zoom
KR20110060296A (en) Digital photographing apparatus and controlling method thereof
JP5789725B2 (en) Imaging apparatus, focusing method thereof and focusing control program
KR101510101B1 (en) Apparatus for processing digital image and method for controlling thereof
WO2016178267A1 (en) Image-capturing instructing device, image capturing system, image capturing method, and program
JPWO2016125351A1 (en) Operating device, tracking system, operating method, and program
JP2017103657A (en) Imaging apparatus, imaging method, and computer program for imaging apparatus
JP2021135368A (en) Imaging apparatus, control method of the same, program and storage medium
JP2017055266A (en) Imaging device and control method, program therefor, and storage medium
JP2017041778A (en) Imaging apparatus, moving picture formation method and program
JP2007233135A (en) Photographic device and method for setting operating buttons thereof
JP6700770B2 (en) Display device, control method thereof, and control program
JP2007049478A (en) Potable electronic device
JP7186854B2 (en) Image display device, image display method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15891274

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15891274

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP