WO2016178267A1 - Image-capturing instructing device, image capturing system, image capturing method, and program - Google Patents
Image-capturing instructing device, image capturing system, image capturing method, and program Download PDFInfo
- Publication number
- WO2016178267A1 WO2016178267A1 PCT/JP2015/063074 JP2015063074W WO2016178267A1 WO 2016178267 A1 WO2016178267 A1 WO 2016178267A1 JP 2015063074 W JP2015063074 W JP 2015063074W WO 2016178267 A1 WO2016178267 A1 WO 2016178267A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- imaging
- shooting
- image
- unit
- instruction
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims description 38
- 238000003384 imaging method Methods 0.000 claims description 417
- 238000012545 processing Methods 0.000 claims description 79
- 238000004891 communication Methods 0.000 claims description 68
- 238000001514 detection method Methods 0.000 claims description 19
- 238000002360 preparation method Methods 0.000 description 32
- 238000010586 diagram Methods 0.000 description 16
- 230000003287 optical effect Effects 0.000 description 13
- 230000006870 function Effects 0.000 description 7
- 230000008921 facial expression Effects 0.000 description 5
- 230000014509 gene expression Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000007704 transition Effects 0.000 description 2
- 238000009966 trimming Methods 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 238000007792 addition Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000007429 general method Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 102220322140 rs1554840836 Human genes 0.000 description 1
- 102220272829 rs752608224 Human genes 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/38—Releasing-devices separate from shutter
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B5/00—Adjustment of optical system relative to image or object surface other than for focusing
Definitions
- the present invention relates to an imaging instruction apparatus, an imaging system, an imaging method, and a program.
- Self-portrait There is an imaging method called “self-portrait” (hereinafter referred to as “self-portrait”) in which an image including itself is captured with the camera facing the camera.
- Self-shooting includes, for example, a method of setting a shutter release by a self-timer and moving to a place where the subject is photographed during that time, and a method of taking an image from a remote position by taking an imaging instruction by remote control operation .
- Patent Document 1 describes a camera in which an imaging unit is activated after a predetermined time has elapsed when a shooting instruction is issued by a remote release unit.
- the present invention has been made to solve the above-described problem, and is an imaging instruction apparatus, imaging system, imaging method, and program capable of realizing a more natural self-taking by shooting after preparation for shooting is completed.
- the purpose is to provide.
- the imaging instruction device is based on at least one information of information indicating the magnitude of shaking of the imaging device and information on the state of the subject in the image being captured by the imaging device.
- a shooting condition determination unit that determines whether or not a shooting condition is satisfied, and when the shooting condition determination unit determines that the shooting condition is satisfied, the imaging apparatus performs shooting for still image recording after a predetermined time has elapsed since the determination was made.
- the shooting instruction unit that issues a shooting instruction to perform image shooting and the shooting condition determination unit satisfies the shooting condition, at least one of the vibration module and the audio output module is operated, and the user determines
- a notification control unit that controls to notify the result.
- the information related to the state of the subject in the first aspect is the number of subjects appearing in the image being photographed, and the photographing condition determination unit
- the number of subjects may be recognized based on the number of face images of the subject in the image, and it may be determined that the shooting condition is satisfied if the number of recognized subjects is a predetermined number.
- the information relating to the state of the subject in the first aspect or the second aspect is the position of one or more subjects in the image being photographed
- the shooting condition determination unit recognizes the position of the subject based on the position indicated by the face image of the subject in the image being shot, and sets the shooting condition if the recognized position of the one or more subjects is within a predetermined range. You may determine with satisfy
- the imaging condition determination unit is a magnitude of shaking of the imaging device.
- the magnitude of shaking of the imaging device may be determined based on the information shown, and if the magnitude of shaking of the imaging device is within a predetermined threshold, it may be determined that the imaging condition is satisfied.
- the imaging condition determination unit uses the imaging condition for determination, An input of a condition for designating at least one of a time from when it is determined that the shooting condition is satisfied to when shooting is performed, the number of subjects included in the image being shot, or the position of the subject is received.
- An input unit may be further provided.
- the imaging condition determination unit is configured to instruct the user to stop imaging.
- the stop of shooting may be determined based on information indicating the magnitude of shaking of the imaging device or information on the state of the subject in the image being captured by the imaging device.
- the imaging system further includes a first communication unit that communicates with the imaging device, according to any one of the first to sixth aspects.
- An imaging instruction device an imaging unit, a second communication unit that communicates with the imaging instruction device, a vibration detection unit that detects shaking of the own device, and a state of a subject that is captured in an image being captured by the imaging unit
- an image processing unit for recognizing.
- the imaging method is based on at least one of information indicating information indicating the magnitude of shaking of the imaging device and information relating to the state of the subject in the image being captured by the imaging device. If it is determined whether or not the shooting condition is satisfied, and it is determined that the shooting condition is satisfied, imaging is performed so that the imaging apparatus executes shooting of a still image recording shot image after a lapse of a predetermined time since the determination is made. An instruction is given, and at least one of the vibration module and the audio output module is operated, and control is performed to notify the user of the determination result.
- the program causes the computer of the imaging instruction apparatus to perform information on information indicating a magnitude of shaking of the imaging apparatus and information on a state of a subject that is captured in an image being captured by the imaging apparatus.
- Means for instructing photographing to execute photographing means for controlling to operate at least one of the vibration module and the audio output module when notifying that the photographing condition is satisfied, and to notify the user of the judgment result Make it work.
- the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging.
- the imaging instruction device instructs the imaging device to take an image.
- the user can photograph himself / herself after preparation for photographing is completed.
- the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
- 1 is a functional block diagram illustrating a configuration of an imaging system according to a first embodiment of the present invention.
- 1 is an external view illustrating a specific configuration example of an imaging system according to a first embodiment of the present invention. It is a figure which shows the usage example of the imaging system in the 1st Embodiment of this invention. It is the 1st figure showing the example of a screen of the imaging directions device in a 1st embodiment of the present invention. It is the 2nd figure which showed the example of a screen of the imaging instruction
- 3 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention. It is a 1st flowchart which shows an example of the flow of a process of the imaging instruction
- FIG. 1 is a functional block diagram showing the configuration of the imaging system according to the first embodiment of the present invention.
- An imaging system 1 illustrated in FIG. 1 includes an imaging instruction device 10 and an imaging device 20.
- the imaging instruction device 10 issues an imaging instruction to the imaging device 20, and the imaging device 20 performs imaging based on the imaging instruction.
- the imaging instruction device 10 includes an input / output unit 11, a condition setting unit 12, an imaging condition determination unit 13, a notification control unit 14, an imaging instruction unit 15, a memory 16, a first communication unit 17, and a first communication unit 17. 1 timer unit 18.
- the imaging instruction device 10 may be a dedicated operation terminal that controls the imaging device 20.
- indication apparatus 10 may be the form which incorporated the application software which controls the imaging device 20 in portable communication terminals, such as a smart phone and a tablet terminal, for example. In this case, various other application software may be incorporated in the mobile communication terminal in addition to the application software for controlling the imaging device 20.
- the input / output unit 11 includes an input device such as a button and a touch panel, and a display device such as a liquid crystal display.
- the input / output unit 11 displays various images such as an image of an operation screen necessary for performing self-portrait.
- the input / output unit 11 receives an input operation from the user. For example, the input / output unit 11 receives an input of a selfie start instruction operation by the user. In addition, the input / output unit 11 receives an input of a shooting condition setting operation related to self-photographing by the user. In addition, the input / output unit 11 receives an input of a user's self-shooting process cancel operation.
- the condition setting unit 12 records the shooting condition indicated by the setting operation received by the input / output unit 11 in the memory 16.
- the imaging condition is, for example, that the magnitude of shaking of the imaging device 20 is within a predetermined range.
- the imaging condition is, for example, designation with respect to the number of subjects that appear in the image being captured by the imaging device 20.
- the imaging condition is, for example, designation with respect to the position of the subject that appears in the image being captured by the imaging device 20.
- the shooting condition determination unit 13 determines whether or not preparation for shooting (self-portrait) is completed based on the shooting conditions recorded by the condition setting unit 12.
- the notification control unit 14 notifies the user who performs self-shooting that the preparation for shooting has been completed. For example, the notification control unit 14 notifies the user by operating the audio output module to output sound from a speaker included in the own apparatus, or operating the vibration module included in the own apparatus to vibrate the own apparatus. . Further, the notification control unit 14 may perform a notification for notifying the user that shooting has been performed at the timing of shooting.
- the shooting instruction unit 15 issues a shooting instruction to the imaging device 20. Specifically, the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17.
- the memory 16 is a non-volatile recording medium such as a memory built in the imaging instruction apparatus 10 and stores various information such as an image generated by the imaging apparatus 20 and imaging conditions.
- the first communication unit 17 performs wireless communication with the imaging device 20.
- the first timer unit 18 measures the time that has elapsed since the shooting condition determination unit 13 determined that preparation for self-taking was completed.
- the imaging condition determination unit 13 outputs information notifying that the predetermined time has elapsed to the above-described imaging instruction unit 15 when a predetermined time has elapsed since the determination.
- the display control unit 19 generates a screen image displayed by the input / output unit 11.
- the condition setting unit 12, the imaging condition determination unit 13, the notification control unit 14, and the imaging instruction unit 15 are read out and executed by an arithmetic unit such as a CPU (Central Processing Unit) provided in the imaging instruction device 10. It can be realized as a software function.
- an arithmetic unit such as a CPU (Central Processing Unit) provided in the imaging instruction device 10. It can be realized as a software function.
- the imaging device 20 includes an imaging unit 21, a vibration detection unit 22, an image processing unit 23, a control unit 24, and a second communication unit 25.
- the imaging unit 21 generates an image obtained by photographing the subject.
- the imaging unit 21 outputs the generated image to the image processing unit 23 and the second communication unit 25. It should be noted that an image obtained by capturing and outputting a subject by the imaging unit 21 is a “sensor output image”, an image transmitted to the imaging instruction apparatus 10 for confirmation by the user, and the image processing unit 23 performs image processing on the “sensor output image”.
- the image with the reduced resolution is the “low-resolution temporary image”
- the display control unit 19 reads the “low-resolution temporary image” and the image displayed on the input / output unit 11 is the “live image”
- the still image captured by the imaging unit 21 An image to be recorded as “still image recording photographic image” may be referred to as “still image recording photographic image”, and an image displayed on the display screen by the display control unit 19 reading “still image recording photographic image” may be referred to as “rec view image”.
- the vibration detection unit 22 detects the magnitude of shaking of the imaging device 20.
- the vibration detection unit 22 is, for example, a two-axis digital level. Alternatively, the vibration detection unit 22 may be an acceleration sensor or a gyro sensor.
- the vibration detection unit 22 outputs information indicating the magnitude of the detected shake to the second communication unit 25.
- the image processing unit 23 detects a subject from the sensor output image acquired from the imaging unit 21 by a face recognition technique. When the image processing unit 23 detects the subject, the image processing unit 23 calculates coordinate information of an area in which the face of the subject appears in the sensor output image. The image processing unit 23 performs image processing such as automatic trimming processing and filter processing on the sensor output image.
- the control unit 24 controls the operation of the imaging device 20. For example, the control unit 24 transmits the image generated by the imaging unit 21, the information on the shake detected by the vibration detection unit 22, the coordinate information of the subject reflected in the image calculated by the image processing unit 23, and the like via the second communication unit 25. Control to transmit to the imaging instruction apparatus 10. In addition, when receiving the imaging instruction information via the second communication unit 25, the control unit 24 controls the imaging unit 21 to start imaging.
- the second communication unit 25 performs wireless communication with the imaging instruction device 10.
- the image processing unit 23 and the control unit 24 can be realized as a software function when a calculation unit such as a CPU (Central Processing Unit) provided in the imaging apparatus 20 reads and executes a program.
- the image processing unit 23 and the control unit 24 may be realized using hardware such as ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field-Programmable Gate Array).
- FIG. 2 is an external view showing a specific configuration example of the imaging system according to the first embodiment of the present invention.
- the imaging system 1 illustrated in FIG. 2 includes an imaging instruction device 10, an imaging device 20, and an optical module 30.
- the imaging instruction device 10 and the imaging device 20 are connected by wireless communication.
- An optical module 30 is mounted on the front surface of the imaging device 20.
- the optical module 30 can be attached to and detached from the imaging device 20.
- the imaging device 20 and the optical module 30 may be configured integrally.
- the imaging instruction device 10 is provided with, for example, a shooting button for instructing the start of self-shooting.
- a shooting button for instructing the start of self-shooting.
- the imaging device 20 performs shooting of a subject in cooperation with the imaging instruction device 10.
- the optical module 30 is an optical unit that includes a lens and a lens control device that controls zoom, focus, aperture, and the like to form a subject image.
- the imaging device 20 forms an image of subject light incident via the optical module 30 and photoelectrically converts an optical image of the subject, and captures an image corresponding to the pixel signal output from the imaging device by wireless communication. Transmit to the instruction device 10.
- FIG. 3 is a diagram illustrating a usage example of the imaging system according to the first embodiment of the present invention.
- FIG. 3 shows how the user takes a selfie using the imaging system of the present embodiment.
- the user takes a self-portrait by directing the lens of the optical module 30 configured integrally with the imaging device 20 to himself and pressing the shooting button of the imaging instruction device 10.
- the user holds the imaging device 20, but the user may install the imaging device 20 and take a selfie.
- the smartphone or the like instead of the imaging device 20 of FIG. Timer shooting is performed while checking the live image displayed on the screen.
- the user performs a self-portrait by using a self-shooting stick (selfie stick) to instruct remote shooting by wireless communication such as Bluetooth (registered trademark).
- a self-shooting stick selfie stick
- wireless communication such as Bluetooth (registered trademark).
- the user can do multiple things, such as giving imaging instructions, thinking about the composition by looking at the display screen, holding the inside camera in an appropriate position, and creating facial expressions.
- the operation is complicated. Further, for example, in the case of these methods, there is a possibility that natural shooting cannot be performed because of an image on the display screen. In addition, there is a possibility that the display screen is small and the appearance of himself / herself on the display screen cannot be confirmed well, or the position of the lens of the inside camera and the display screen is shifted and the line of sight is shifted.
- the imaging system 1 determines whether or not preparation for shooting is completed and performs shooting after a predetermined time has elapsed. That is, in this embodiment, not the user but the imaging system 1 determines the start timing of the shooting timer and the shooting timing associated therewith.
- the imaging instruction device 10 determines whether or not the imaging preparation is ready in accordance with the degree of shaking of the imaging device 20 and the state of the subject shown in the sensor output image. And the user is notified of the timing of shooting.
- the user who takes a self-portrait can leave the imaging system 1 to see whether he / she can take it well, it is not necessary to look at the display screen in order to check the live image.
- the timing of shooting is notified to the user, the user can make a facial expression in accordance with the timing or take a natural posture for shooting.
- FIG. 4A is a first diagram illustrating a screen example of the imaging instruction apparatus according to the first embodiment of the present invention.
- FIG. 4B is a second diagram illustrating a screen example of the imaging instruction device according to the first embodiment of the present invention.
- FIG. 4A shows an example of an image of the selfie setting screen.
- the screen image displayed on the input / output unit 11 may be simply referred to as a screen.
- the imaging instruction device 10 includes an input / output unit 11 and a hard button 120.
- the input / output unit 11 is configured integrally with a touch panel and a display device, and the input / output unit 11 displays a self-portrait setting screen and accepts an input operation from a user.
- the display control unit 19 generates an image of the selfie setting screen and outputs it to the input / output unit 11.
- the hard button 120 is an example of an input unit used when a user performs an instruction operation on the imaging instruction device 10.
- the self-portrait setting screen includes, for example, a completion button 100, a cancel button 101, a timer setting field 102, a sound setting field 103, a composition setting field 104, an image processing setting field 105, and a rec view setting field 106.
- the completion button 100 is an image of a button that the user presses when saving the setting content set by the user on the selfie setting screen.
- the cancel button 101 is an image of a button that the user presses when discarding the setting contents.
- the timer setting field 102 is an item for setting a time (shooting waiting time) from when it is determined that the preparation for shooting is completed until shooting is performed. For example, the user sets 3 seconds in the timer setting field 102.
- the sound setting column 103 is an item for designating a voice to be notified to the user when the countdown until the shooting is started when it is determined that the shooting preparation is completed, and a voice at the time of shooting.
- the composition setting column 104 is an item for setting the composition of an image to be shot. For example, it is possible to select from a composition centered on the face of the subject, a configuration in which the background on the left side of the subject is captured, and a configuration in which the background on the right side of the subject is captured.
- the image processing setting column 105 is an item for setting correction processing / processing processing performed on an image generated by the imaging apparatus 20. For example, it may be possible to set whether to perform automatic trimming and to set the type of filter processing (for example, portrait).
- the REC view setting field 106 is an item for setting whether to display a captured image (REC view image).
- the condition setting unit 12 records the setting contents in the memory 16.
- the cancel button 101 the setting contents are not changed, and the setting contents already recorded in the memory 16 are used.
- the display control unit 19 may be configured to output the self-portrait instruction image shown in FIG. 4B to the input / output unit 11.
- FIG. 4B shows an example of a self-shooting instruction screen.
- the display control unit 19 when the user inputs an instruction operation for taking a selfie from a menu screen or the like, the display control unit 19 generates an image of the selfie instruction screen and outputs it to the input / output unit 11.
- the self-portrait setting screen includes, for example, a setting screen calling button 110 and self-portrait execution instruction buttons 111 to 114.
- the display control unit 19 When the user presses the setting screen call button 110, the display control unit 19 generates an image of the selfie setting screen shown in FIG. 4A and outputs it to the input / output unit 11.
- the self-taking execution instruction button 111 is a button to be pressed when performing self-taking for one person.
- the self-portrait execution instruction button 112 is for two persons
- the self-capture execution instruction button 113 is for three persons
- the self-execution execution instruction button 114 is a button to be pressed when performing self-taking for four or more persons. .
- the user selects and presses an appropriate button from the self-shoot execution instruction buttons 111 to 114 according to the number of persons to be photographed.
- the self-portrait process by the imaging system 1 of the present embodiment is executed.
- Self-portrait processing according to the present embodiment will be described later with reference to FIGS.
- FIG. 5 is a first diagram illustrating the photographing condition determination process according to the first embodiment of the present invention.
- the imaging system 1 determines whether or not the preparation for shooting is complete, and determines the shooting timing. This determination is performed by the imaging condition determination unit 13 of the imaging instruction apparatus 10 based on predetermined imaging conditions.
- the predetermined condition is, for example, the magnitude of shaking of the imaging device 20.
- the shooting condition determination unit 13 determines that shooting preparation is not complete because only blurred images can be shot even if shooting is performed in that state.
- FIG. 5 is a diagram for explaining determination based on the magnitude of shaking of the imaging apparatus 20 among the imaging conditions used for the determination by the imaging condition determination unit 13.
- FIG. 5 is a graph showing changes in the magnitude of shaking detected by the vibration detection unit 22 included in the imaging device 20.
- the vertical axis represents the magnitude of shaking
- the horizontal axis represents time.
- the vibration detection unit 22 detects shaking in the X-axis direction and the Y-axis direction of the horizontal plane.
- the information on the shaking in the X-axis direction and the Y-axis direction detected by the vibration detection unit 22 is transmitted to the imaging instruction apparatus 10 at a predetermined time interval in combination with the information on the detection time of each shaking.
- the first communication unit 17 receives the shake information and records it in the memory 16.
- a graph 3X is a graph showing the transition of the fluctuation in the X-axis direction recorded in this way.
- the graph 3Y is a graph showing the transition of fluctuation in the Y-axis direction.
- the imaging condition determination unit 13 sets the magnitude of the shake of the imaging device 20 within an allowable range over a predetermined period.
- the magnitude of the shaking of the imaging device 20 is determined to satisfy the imaging condition. For example, the imaging condition determination unit 13 determines that the shaking of the imaging device 20 has subsided at time t when the magnitude of shaking in the X-axis and Y-axis directions at a certain time t satisfies the following equation (1).
- X (t) and Y (t) are the magnitude of the shake in the X-axis direction and the magnitude of the shake in the Y-axis direction, respectively, at time t.
- X (t-1) and Y (t-1) are, for example, magnitudes of shaking in the X-axis and Y-axis directions at time t-1 one second before.
- the imaging condition determination unit 13 shifts t over a predetermined time, and determines that the magnitude of shaking of the imaging device 20 satisfies the imaging condition when Expression (1) is satisfied for each t.
- FIG. 6 is a second diagram illustrating the photographing condition determination process in the first embodiment of the present invention.
- FIG. 6 is a diagram illustrating determination based on the state of the subject appearing in the sensor output image among predetermined shooting conditions used for determining whether or not the shooting condition determination unit 13 is ready for shooting.
- FIG. 6 shows an outline of a composition setting set by the user on the selfie setting screen and a method for recognizing the subject for each number of shooting targets selected on the selfie instruction screen.
- FIG. 6 shows twelve sensor output images K11, K12, K13, K21, K22, K23, K31, K32, K33, K41, K42, and K43 corresponding to the composition and the number of people.
- the sensor output image K11 is a diagram illustrating an outline of a method for recognizing a subject when the configuration is “face center” and the number of subjects is “one person”.
- the composition guide area G11 is an area in which the center coordinates of the face should be included when the composition is “face center” and the number of subjects is “one person”.
- the composition guide area is determined in advance according to the composition setting and the number of subjects to be photographed, and the coordinate information of each vertex that defines the area of each composition guide area is recorded in the memory 16.
- the composition guide area G11 is set near the center of the sensor output image because the composition is set to “face center”.
- the center point P11 is the position of the center of the face image of the subject in the sensor output image K11 calculated as a result of the image processing unit 23 of the imaging device 20 performing image processing on the sensor output image K11 using the face recognition technology.
- the image processing unit 23 specifies, as subjects, subjects corresponding to the number of subjects designated by the user in order from the largest in the face image candidates indicated by, for example, a rectangular region detected by the face recognition technology at this time. May be calculated.
- the coordinate information of the face image calculated by the image processing unit 23 is transmitted to the imaging instruction device 10.
- the imaging condition determination unit 13 determines whether the imaging state of the subject is appropriate based on the coordinate information of the composition guide area recorded in the memory 16 and the coordinate information of the face image received from the imaging apparatus 20. To do. For example, in the case of the sensor output image K11, the center point P11 is included in the composition guide area G11. As described above, when the center point P11 is included in the composition guide area G11 corresponding to the composition and the number of subjects to be photographed, the photographing condition determination unit 13 determines that the state of the subject satisfies the photographing condition.
- the sensor output image K12 is a diagram illustrating an outline of a method for recognizing a subject when the configuration setting is “left landscape” and the target number of people is “one person”.
- the configuration guide area G12 is set to the left of the sensor output image K12.
- the sensor output image K13 is a diagram for explaining an outline of a method for recognizing a subject when the configuration setting is “right landscape” and the target number of people is “one person”. In this case, the configuration guide area G13 is set to the right of the sensor output image K13.
- the configuration guide area G12 of the sensor output image K21 has a “face center” configuration
- the target number of people is set in the vicinity of the center of the sensor output image K21 with a size corresponding to “2 people”.
- the shooting condition determination unit 13 determines that the state of the subject satisfies the shooting condition.
- the configuration guide area G22 of the sensor output image K22 is set to the left with the same size as the configuration guide area G21, and the configuration guide area G23 of the sensor output image K23 is set to the right with the same size as the configuration guide area G21. Yes.
- the configuration guide area G31 of the sensor output image K31 is set with a size corresponding to the number of subjects “3” near the center of the image. If the center points P31A, P31B, and 31C are all included in the configuration guide area G31, the shooting condition determination unit 13 determines that the shooting state of the subject is appropriate.
- the configuration guide area G32 corresponding to the “left landscape” is set to the left, and the configuration guide area G33 corresponding to the “right landscape” is set to the right.
- the configuration guide areas G41, G42, and G43 may be set to the size of the entire surface of each sensor output image as shown in the drawing according to the number of subjects.
- the position and size of the composition guide area are determined according to the composition setting and the number of subjects to be photographed.
- the size of the composition guide area can be roughly determined by the specifications of the lens of the optical module 30 and the distance (arm length) when the image pickup apparatus 20 is held in hand and pointed at itself.
- the distance between the image pickup apparatus 20 and the subject is displayed on the self-portrait setting screen illustrated in FIG. 4A.
- An item to be set may be provided, and the size of the composition guide area may be changed according to the distance set by the item.
- FIG. 7 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention.
- processing of the imaging apparatus 20 when performing a self-portrait using the imaging system 1 of the present embodiment will be described.
- the user turns on the power of the imaging device 20.
- the imaging device 20 is activated and performs initial processing necessary to exhibit the imaging function.
- the 2nd communication part 25 of the imaging device 20 starts communication with respect to the imaging instruction
- the control device of the optical module 30 drives the zoom to the wide side for the convenience of zoom adjustment at the time of shooting (step S12).
- the imaging device 20 waits for a self-portrait shooting instruction from the imaging instruction device 10 (step S13).
- the second communication unit 25 of the imaging device 20 determines which selfie execution instruction.
- Information indicating whether the button has been pressed, self-shooting start instruction information for instructing the start of self-portrait processing, and setting contents in the image processing setting field 105 are received from the image pickup instruction device 10 (step S14).
- the second communication unit 25 outputs the received information to the control unit 24.
- the vibration detection unit 22 detects information on the shaking of the imaging device 20 (for example, the magnitude of shaking in the X-axis and Y-axis directions described in FIG. 5) (step S15).
- the vibration detection unit 22 sets the detected shake information and the information on the time when the shake is detected as a set and outputs the set to the second communication unit 25.
- control unit 24 when the control unit 24 acquires information instructing the start of the self-portrait process, the control unit 24 instructs the image processing unit 23 to detect a face image. Further, the control unit 24 outputs information on the number of persons to be detected to the image processing unit 23 based on information indicating which self-shot execution instruction button has been pressed.
- the image processing unit 23 acquires a sensor output image obtained by photographing the target from the imaging unit 21, and recognizes a face image that appears in the sensor output image by image recognition.
- the image processing unit 23 identifies, for example, a rectangular area recognized as having a face image.
- the image processing unit 23 calculates coordinate information in the sensor output image at the center position of the identified area (the center of the face image) (step S16).
- the image processing unit 23 may select information corresponding to the number of people in descending order of the area of the rectangular area specified for each face image, and calculate the coordinate information of the center position of the selected area.
- the image processing unit 23 may select a face image in which the area of the rectangular area specified for each face image is equal to or larger than a predetermined size, and calculate coordinate information of the center position of the selected area.
- the image processing unit 23 outputs the calculated coordinate information of the face image (the coordinate information of the center of the face image and the coordinate information of the vertex of the rectangular area corresponding to each face) to the second communication unit 25.
- the control unit 24 sends the shake information (the magnitude of the shake in the X-axis and Y-axis directions and the time when the shake is detected) and the coordinate information of the face image to the imaging instruction apparatus 10 via the second communication unit 25. Control to send.
- the second communication unit 25 transmits the shake information and the coordinate information of the face image to the imaging instruction device 10 (step S17).
- the imaging device 20 detects the coordinate information of the vertices of the rectangular area corresponding to the face and transmits it to the imaging instruction device 10.
- the coordinate information of the center of the image may be calculated.
- the imaging instruction device 10 determines whether or not the imaging preparation is ready based on the received shake information and the coordinate information of the face image, and captures the imaging instruction information when a predetermined time elapses after determining that the imaging preparation is ready. Transmit to device 20.
- the imaging instruction apparatus 10 transmits stop instruction information to the imaging apparatus 20.
- the control unit 24 receives shooting instruction information or stop instruction information from the imaging instruction device 10 via the second communication unit 25 (step S18).
- the control unit 24 instructs the imaging unit 21 to perform imaging, and the imaging unit 21 performs imaging (step S192).
- the imaging unit 21 outputs the captured sensor output image to the image processing unit 23.
- the image processing unit 23 generates a still image recording captured image from the sensor output image.
- the control unit 24 determines whether or not to transmit a captured image (still image recording captured image) (step S193).
- the control unit 24 determines whether to transmit the still image recording captured image according to the setting of whether to transmit the still image recording captured image after capturing.
- the setting as to whether or not to send a still image recording shot image after shooting is, for example, a setting in the REC view setting field 106. When “ON” is set in the REC view setting field 106, the control unit 24 determines to transmit a captured image.
- step S193 When it is determined to transmit the captured image (step S193; Yes), the control unit 24 controls to transmit the captured image (still image recording captured image) to the imaging instruction apparatus 10 via the second communication unit 25. To do.
- the second communication unit 25 transmits the shot image (still image recording shot image) to the imaging instruction device 10. If it is determined that the captured image is not transmitted (step S193; No), this processing flow ends.
- the control unit 24 determines whether or not shooting is stopped (step S191). Specifically, when the cancel instruction information is received, the control unit 24 determines to cancel the self-portrait process and ends the present process flow.
- the image processing unit 23 may generate a low-resolution temporary image from the sensor output image and the imaging device 20 may transmit the low-resolution temporary image to the imaging instruction device 10 by a predetermined instruction operation by the user.
- the display control unit 19 may generate a live image from the received low-resolution primary image, and the input / output unit 11 may display the live image. This allows the user to take a selfie while checking the live image.
- FIG. 8 is a first flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
- processing of the imaging instruction apparatus 10 when taking a self-portrait using the imaging system 1 of the present embodiment will be described.
- the self-portrait instruction screen illustrated in FIG. 4B is displayed on the input / output unit 11 of the image-capturing instruction apparatus 10 and the user presses one of the self-portrait execution instruction buttons 111 to 114.
- the input / output unit 11 outputs information indicating which button has been pressed to the imaging condition determination unit 13.
- the first communication unit 17 transmits information indicating which self-shoot execution instruction button has been pressed to the imaging device 20.
- the imaging device 20 transmits shake information and face image coordinate information to the imaging instruction device 10.
- the first communication unit 17 of the imaging instruction apparatus 10 detects shaking information (the magnitude of the shaking in the X-axis and Y-axis directions and the time when the shaking is detected) and the coordinate information (face image) of the face image. At least one of the coordinate information of the center of the face and the coordinate information of the rectangular area of the face image is received (step S20). The first communication unit 17 records the received shake information and face image coordinate information in the memory 16.
- the shooting condition determination unit 13 reads the shake information and the coordinate information of the face image from the memory 16 and determines the shooting condition (step S21). First, the imaging condition determination unit 13 determines whether or not the shaking is settled at time t according to Equation (1) for the shaking information. Then, when the shooting condition determination unit 13 determines that the shaking has been continuously stopped for a predetermined time, the shooting condition determination unit 13 determines that the shooting condition regarding the magnitude of the shaking is satisfied in the imaging device 20.
- the shooting condition determination unit 13 reads the composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the memory 16.
- the photographing condition determination unit 13 corresponds to the composition setting information and the number of persons based on the read composition setting information and the number of subjects to be photographed corresponding to the information indicating which button acquired from the input / output unit 11 is pressed.
- Coordinate information defining the composition guide area is read from the memory 16.
- the shooting condition determination unit 13 compares the number of coordinate information of the acquired face image with the number of shooting targets. When the number of coordinate information is equal to the number of subjects to be photographed, the photographing condition determination unit 13 determines that the first condition regarding the state of the subject is satisfied.
- the photographing condition determination unit 13 determines whether or not all of the acquired coordinate information of the face image is included in the composition guide area read from the memory 16. When all the coordinate information of the acquired face image is included in the composition guide area, the imaging condition determination unit 13 determines that the second condition relating to the state of the subject is satisfied. When these two conditions are satisfied, the shooting condition determination unit 13 determines that the shooting conditions for the state of the subject are satisfied. The imaging condition determination unit 13 determines that the imaging condition is satisfied when the imaging apparatus 20 satisfies both the imaging condition related to the magnitude of shaking and the imaging condition for the subject state. Alternatively, the imaging condition determination unit 13 may determine that the imaging condition is satisfied when the imaging device 20 satisfies either the imaging condition regarding the magnitude of shaking or the imaging condition for the state of the subject.
- step S21 When it is determined in step S21 that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the shooting preparation is complete to the notification control unit 14 and the first timer unit 18.
- the notification control unit 14 notifies the user that the preparation for photographing has been completed (step S23).
- the notification control unit 14 operates a vibration module such as a vibration motor provided in the imaging instruction device 10 to vibrate the housing of the imaging instruction device 10, and the user who holds the imaging instruction device 10 prepares for shooting. Notify that it is ready.
- the notification control unit 14 operates a voice output module provided in the imaging instruction device 10 to output a predetermined sound from the speaker, and notifies the user who holds the imaging instruction device 10 that preparation for shooting is completed.
- the predetermined voice is a voice set in “when countdown starts” in the sound setting field 103 of the selfie setting screen illustrated in FIG. 4A.
- the first timer unit 18 starts a shooting timer (step S24).
- the first timer unit 18 measures the time until the time set in the timer setting field 102 of the selfie setting screen has elapsed.
- the first timer unit 18 stops the shooting timer (step S25).
- the first timer unit 18 outputs information indicating that the set time has elapsed to the notification control unit 14 and the imaging instruction unit 15.
- the notification control unit 14 notifies the user at the shooting timing (step S26).
- the notification control unit 14 vibrates the imaging instruction device 10 or outputs a sound.
- the sound to be output is the sound set in “during shooting” of the sound setting field 103 in FIG. 4A.
- the processing in step S26 may be skipped.
- the shooting instruction unit 15 transmits shooting instruction information to the imaging device 20 via the first communication unit 17 (step S27).
- the second communication unit 25 receives the imaging instruction information and outputs it to the control unit 24.
- the control unit 24 instructs the imaging unit 21 to perform shooting, and the imaging unit 21 executes shooting.
- the imaging unit 21 outputs the captured sensor output image to the image processing unit 23.
- the image processing unit 23 performs image processing corresponding to the setting contents of the image processing setting field 105 on the sensor output image, and generates a captured image for still image recording after image processing. As described with reference to FIG.
- the image processing unit 23 captures the captured image for still image recording. Is output to the second communication unit 25.
- the second communication unit 25 transmits the captured image for still image recording to the imaging instruction device 10.
- the first communication unit 17 receives a captured image (still image recording captured image) (step S ⁇ b> 271) and records it in the memory 16.
- the display control unit 19 reads out the still image recording captured image from the memory 16 to generate a REC view image, and the REC view image is input to the input / output unit 11. Output.
- the input / output unit 11 displays a captured image (rec view image) (step S272).
- step S21 determines whether or not a self-shooting stop operation is performed by the user (step S28). For example, when the user presses the hard button 120, the input / output unit 11 determines that a self-shooting instruction operation has been performed. When the input / output unit 11 detects a self-shooting stop instruction operation (step S ⁇ b> 28; Yes), the input / output unit 11 outputs stop instruction information to the imaging condition determination unit 13. The shooting condition determination unit 13 instructs the first timer unit 18 to stop the timer, and ends the self-portrait process. At this time, the notification control unit 14 may make a notification to stop shooting. When the input / output unit 11 does not detect the self-shooting stop instruction operation (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
- the shooting condition determination in step S21 it may be determined whether the shooting conditions are satisfied only by the determination based on the magnitude of the shaking of the imaging device 20. Alternatively, it may be determined whether or not the shooting conditions are satisfied only by determination based on the state of the subject.
- the image processing unit 23 may detect the smiling face of the subject by the face recognition process, and in addition to the shooting condition determination in step S22, when the smiling face of the subject is detected, the shooting timer may be started to execute shooting. More specifically, the image processing unit 23 outputs to the second communication unit 25 information indicating whether the subject of the face image is a smile in association with the coordinate information of the face image. The second communication unit 25 transmits the information to the imaging instruction device 10.
- the imaging condition determination unit 13 acquires information indicating whether or not the subject is smiling via the first communication unit 17. In addition to the determination condition in step S21, the shooting condition determination unit 13 determines that the shooting condition is satisfied, for example, when all subjects are smiling. In addition, when adding whether it is a smile to a determination, it is good also as a structure which shortens imaging
- FIG. 9 is a second flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
- the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20).
- the imaging condition determination unit 13 acquires shake information and face image coordinate information from the first communication unit 17.
- the shooting condition determination unit 13 determines shooting conditions (step S21). When it is determined that the shooting conditions are satisfied (step S22; Yes), the notification control unit 14 notifies the user of the completion of shooting preparation (step S23). Further, the first timer unit 18 starts a shooting timer (step S24).
- the imaging condition determination unit 13 receives the shake information and the coordinate information of the face image from the imaging device 20 (step S201).
- the process of step S201 is the same as that of step S20.
- the shooting condition determination unit 13 determines shooting cancellation conditions (step S211).
- the shooting cancellation condition may be determined based on the magnitude of shaking of the imaging device 20 and the state of the subject, as in step S21. For example, if the imaging condition determination unit 13 determines that the shaking of the imaging device 20 is not within a predetermined range using Expression (1), the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20. . Alternatively, the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20 when the number of times that the shaking in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
- the shooting condition determination unit 13 determines that the shooting cancel condition regarding the state of the subject is satisfied when the subject to be shot moves and even one of the coordinate information of the face image of the subject leaves the composition guide area. judge.
- the image processing unit 23 in the imaging device 20 selects a face image having an area of a predetermined size or larger and transmits coordinate information of the center point of the selected face image
- the shooting condition determination unit 13 when the number of subjects to be photographed increases or decreases and differs from the number of subjects to be photographed designated by the user, it is determined that a photographing cancellation condition regarding the state of the subject is satisfied.
- the imaging condition determination unit 13 may determine that the imaging cancellation condition is satisfied only by satisfying the imaging cancellation condition for either one of the magnitude of the shaking of the imaging device 20 and the state of the subject, It may be determined that the shooting cancel condition is satisfied when both the shooting cancel condition regarding the size and the shooting cancel condition regarding the state of the subject are satisfied. In addition, when the subject's smile is added to the determination condition in step S21, for example, it may be determined that the shooting cancellation condition is satisfied when one of the subjects is no longer smiling. When the shooting cancellation condition is satisfied, the shooting condition determination unit 13 determines to stop shooting.
- the shooting condition determination unit 13 instructs the first timer unit 18 to stop the shooting timer, and ends the self-portrait process.
- the first timer unit 18 stops the shooting timer (step S25), and the notification control unit 14 notifies the user of the shooting timing.
- the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17 (step S27), and in the imaging device 20, the imaging unit 21 performs imaging.
- the imaging device 20 transmits a captured image (a still image recording captured image).
- the first communication unit 17 receives the captured image (step S ⁇ b> 271) and records it in the memory 16.
- the display control unit 19 reads a captured image (still image recording captured image) from the memory 16, generates a rec view image, and outputs it to the input / output unit 11.
- the input / output unit 11 displays a captured image (rec view image) (step S272).
- step S22 If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. At this time, the notification control unit 14 may perform notification notifying that the shooting is stopped by vibration or sound output. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
- the imaging instruction device 10 can determine whether or not the photographing preparation is complete, so the user can take a self-portrait without worrying about unnecessary things. It can be performed.
- the imaging instruction apparatus 10 since the imaging instruction apparatus 10 notifies that the preparation for shooting is ready and it is known that shooting is performed after the time set by the user, the user can make a desired facial expression in accordance with the timing of shooting. You can start shooting in a safe state. Also, by leaving the determination of shooting preparation to the imaging instruction device 10, the user is freed from complicated operations and does not have to make fine adjustments while watching the live screen, so that the user can take a self-photograph without being noticeable quickly. Can do.
- the imaging device 20 transmits a still image recording image in accordance with the setting of the REC view setting field 106 and the like, and the imaging instruction device 10 illustrates an operation of displaying the REC view image as an example.
- the imaging device 20 always transmits the still image recording image to the imaging instruction device 10, and the imaging instruction device 10 receives and records the still image recording image in the memory 16, and displays / not displays the REC view image. Only display may be controlled according to the setting.
- FIG. 10 is a functional block diagram showing the configuration of the imaging system in the second embodiment of the present invention.
- the imaging device 20 includes a second timer unit 26.
- the imaging instruction device 10 may not include the first timer unit 18.
- the second timer unit 26 measures the lapse of time set by the user, and the imaging device 20 itself determines the shooting timing.
- Other configurations and operations are the same as those in the first embodiment.
- FIG. 11 is a flowchart illustrating an example of a processing flow of the imaging system according to the second embodiment of the present invention.
- a description will be given of processing in the case where a self-portrait is performed using the imaging system 1 of the present embodiment.
- a process similar to that of the first embodiment will be briefly described.
- the imaging device 20 transmits information about the shaking of the device itself and coordinate information of the face image to be photographed to the imaging instruction device 10. It shall be.
- the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20).
- the shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15. The notification control unit 14 notifies the user of completion of shooting preparation (step S23). In addition, the shooting instruction unit 15 transmits timer shooting instruction information to the imaging device 20 via the first communication unit 17 (step S29).
- the timer shooting instruction information is shooting instruction information including shooting waiting time information that specifies how many seconds the shooting should be performed.
- the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24.
- the control unit 24 instructs the second timer unit 26 to start the shooting timer.
- the second timer unit 26 starts a shooting timer (step S31).
- the second timer unit 26 stops the imaging timer (step S32).
- the second timer unit 26 outputs information indicating that the set time has elapsed to the control unit 24.
- the control unit 24 issues a shooting instruction to the imaging unit 21, and the imaging unit 21 performs shooting (step S33). In addition, the control unit 24 performs control so that the shooting completion information is transmitted to the imaging instruction apparatus 10 via the second communication unit 25.
- the second communication unit 25 transmits shooting completion information indicating that shooting has been completed to the imaging instruction apparatus 10 (step S34).
- the imaging unit 21 outputs a sensor output image to the image processing unit 23, and the image processing unit 23 performs image processing.
- the second communication unit 25 transmits the captured image (photographed image for still image recording) after the image processing to the imaging instruction device 10 (step S35).
- the first communication unit 17 receives the imaging completion information and outputs it to the notification control unit 14.
- the notification control unit 14 notifies the user at the time of shooting by vibrating the imaging instruction device 10 or outputting a sound (step S26).
- step S22 When it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), the processing is the same as in the first embodiment.
- step S28; Yes When the input / output unit 11 detects a selfie stop instruction operation by the user (step S28; Yes), the selfie process is terminated.
- step S28; No When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
- the imaging timer 20 may be started by the imaging device 20 to execute a self-portrait.
- the case where a captured image is transmitted to the imaging instruction apparatus 10 after step S33 has been described as an example.
- the imaging apparatus is set according to whether or not a captured image is transmitted. 20 may transmit a still image recording image, and the imaging instruction apparatus 10 may display a rec view image.
- FIG. 12 is a functional block diagram showing the configuration of the imaging system in the third embodiment of the present invention.
- the imaging apparatus 20 includes a shooting stop condition determination unit 27.
- the shooting stop condition determination unit 27 determines the shooting stop condition from when the imaging device 20 receives the shooting instruction until the second timer unit 26 determines the shooting timing. Then, when the shooting stop condition is satisfied, the imaging device 20 stops shooting.
- Other configurations and operations are the same as those in the second embodiment.
- FIG. 13 is a flowchart illustrating an example of a processing flow of the imaging system according to the third embodiment of the present invention. Processing of the imaging system in the second embodiment will be described with reference to FIG. The same processing as that described in FIG. 11 will be briefly described.
- the first communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20).
- the shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15.
- the notification control unit 14 notifies the user of completion of shooting preparation (step S23).
- the imaging instruction unit 15 transmits timer imaging instruction information to the imaging device 20 via the first communication unit 17 (step S29).
- the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24.
- the control unit 24 instructs the second timer unit 26 to start the shooting timer.
- the second timer unit 26 starts a shooting timer (step S31).
- the shooting stop condition determination unit 27 determines the shooting stop condition (step S36). For example, the imaging stop condition determination unit 27 acquires the shake information detected by the vibration detection unit 22 and the information on the detection time of the shake from the vibration detection unit 22. If it is determined that the shaking of the imaging device 20 is not within the predetermined range using the equation (1), the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied. Alternatively, the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied when the number of times that the fluctuation in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
- the shooting stop condition determination unit 27 may acquire the coordinate information of the face image from the image processing unit 23 and determine the shooting stop condition regarding the state of the subject.
- the imaging apparatus 20 has received composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the imaging instruction apparatus 10 and stored in a storage unit (not shown) of the imaging apparatus 20. , It is assumed that the composition setting information and the composition guide area corresponding to the target number of persons are recorded.
- the shooting stop condition determination unit 27 is different from the number of shooting targets specified by the user because one of the coordinate information of the face image of the subject is out of the composition guide area or the number of shooting targets is increased or decreased. Or the like, it is determined that the shooting stop condition is satisfied.
- the shooting stop condition determination unit 27 may determine that the shooting stop condition is satisfied only when the shooting stop condition for either one of the magnitude of shaking of the imaging device 20 and the state of the subject is satisfied. Alternatively, it may be determined that the shooting stop condition is satisfied when both the shooting stop condition regarding the magnitude of the shaking of the imaging device 20 and the shooting stop condition regarding the state of the subject are satisfied.
- the shooting stop condition determination unit 27 outputs the determination result to the control unit 24.
- the control unit 24 transmits shooting stop information indicating the stop of shooting to the imaging instruction apparatus 10 via the second communication unit 25 (step S38).
- the control unit 24 instructs the second timer unit 26 to stop the timer, and the self-portrait process ends.
- step S37 When it is not determined to stop shooting (step S37; No), when the set shooting wait time elapses, the second timer unit 26 stops the shooting timer (step S32), and the imaging unit 21 executes shooting (step S32). Step S33). Further, the second communication unit 25 transmits shooting completion information to the imaging instruction device 10 (step S34). When the photographing is completed, the second communication unit 25 transmits a photographed image (still image recording photographed image) to the imaging instruction device 10 (step S35). In the imaging instruction device 10, the first communication unit 17 receives the imaging completion information, and the notification control unit 14 notifies the user at the time of imaging (step S26).
- step S22 If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
- the imaging device 20 transmits the still image recording image according to the setting of whether to transmit the captured image, and the imaging instruction device 10 A view image may be displayed.
- the captured image generated by the imaging device 20 is captured. Although it is transmitted to the instruction device 10, it may be stored in a storage unit (not shown) included in the imaging device 20. In the third embodiment, the imaging condition may be determined by the imaging device 20.
- the input / output unit 11 is an example of an input unit.
- the imaging instruction device 10 and the imaging device 20 are recorded on a computer-readable recording medium, and this recording is performed.
- the “computer system” includes an OS and hardware such as peripheral devices.
- the “computer-readable recording medium” means a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case.
- the program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
- the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging.
- the imaging instruction device instructs the imaging device to take an image.
- the user can photograph himself / herself after preparation for photographing is completed.
- the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
Abstract
An image-capturing instructing device according to the present invention is provided with: an image-capturing condition determining unit that determines whether or not an image-capturing condition is satisfied on the basis of at least information indicating the magnitude of shaking of an image capturing device, or information relating to the state of an object in an image captured by the image capturing device; an image-capturing instructing unit that gives an image-capturing instruction, when the image-capturing condition determining unit has determined that an image-capturing condition is satisfied, to the image capturing device to capture an image after a prescribed time has elapsed from the determination; and a notification controlling unit that performs controlling so as to actuate at least a vibration module or a sound output module, when the image-capturing condition determining unit has determined that the image-capturing condition is satisfied, to notify a user of the determination result.
Description
本発明は、撮像指示装置、撮像システム、撮影方法およびプログラムに関する。
The present invention relates to an imaging instruction apparatus, an imaging system, an imaging method, and a program.
カメラを自分に向け自分自身を含む画像を撮像するいわゆる「自撮り」(以下、自分撮りと呼ぶ)と呼ばれる撮像方法が存在する。自分撮りには、例えば、セルフタイマによるシャッタレリーズを設定し、その間に被写体が写る場所に移動する方法や、リモートコントロール操作によって離れた位置から撮像指示を行って自分自身を撮像する方法が存在する。また、近年ではスマートフォン等に搭載されたカメラ機能を利用して、どこでも手軽に自分撮りを行うことができる。
なお、特許文献1には、遠隔レリーズ手段によって撮影指示を行うと、所定の時間経過後に撮像手段が起動するカメラについて記載されている。 There is an imaging method called “self-portrait” (hereinafter referred to as “self-portrait”) in which an image including itself is captured with the camera facing the camera. Self-shooting includes, for example, a method of setting a shutter release by a self-timer and moving to a place where the subject is photographed during that time, and a method of taking an image from a remote position by taking an imaging instruction by remote control operation . In recent years, it is possible to easily take a selfie anywhere using a camera function mounted on a smartphone or the like.
Note thatPatent Document 1 describes a camera in which an imaging unit is activated after a predetermined time has elapsed when a shooting instruction is issued by a remote release unit.
なお、特許文献1には、遠隔レリーズ手段によって撮影指示を行うと、所定の時間経過後に撮像手段が起動するカメラについて記載されている。 There is an imaging method called “self-portrait” (hereinafter referred to as “self-portrait”) in which an image including itself is captured with the camera facing the camera. Self-shooting includes, for example, a method of setting a shutter release by a self-timer and moving to a place where the subject is photographed during that time, and a method of taking an image from a remote position by taking an imaging instruction by remote control operation . In recent years, it is possible to easily take a selfie anywhere using a camera function mounted on a smartphone or the like.
Note that
これらの自分撮りの方法の問題点として、実際の撮像時に自分の撮影準備が整っているとは限らないことが挙げられる。例えば、セルフタイマによる方法では、準備が整う前に撮像されてしまう可能性がある。また、特許文献1の方法でも、遠隔レリーズ手段による撮像指示からシャッタの開閉までに時間が設けられているとはいえ、やはり撮像のタイミングで準備が整っているかどうかの補償はない。
The problem with these self-shooting methods is that they are not always ready for shooting at the time of actual shooting. For example, in the method using the self-timer, there is a possibility that an image is captured before the preparation is completed. Even in the method of Patent Document 1, although there is a time from the imaging instruction by the remote release means to the opening and closing of the shutter, there is no compensation for whether the preparation is ready at the timing of imaging.
本発明は、上記課題を解決するためになされたものであり、撮影準備が整ってから撮影を行うことでより自然な自分撮りを実現することができる撮像指示装置、撮像システム、撮影方法およびプログラムを提供することを目的とする。
The present invention has been made to solve the above-described problem, and is an imaging instruction apparatus, imaging system, imaging method, and program capable of realizing a more natural self-taking by shooting after preparation for shooting is completed. The purpose is to provide.
本発明の第1の態様に係る撮像指示装置は、撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する撮影条件判定部と、前記撮影条件判定部が撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う撮影指示部と、前記撮影条件判定部が撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する通知制御部と、を備える。
The imaging instruction device according to the first aspect of the present invention is based on at least one information of information indicating the magnitude of shaking of the imaging device and information on the state of the subject in the image being captured by the imaging device. A shooting condition determination unit that determines whether or not a shooting condition is satisfied, and when the shooting condition determination unit determines that the shooting condition is satisfied, the imaging apparatus performs shooting for still image recording after a predetermined time has elapsed since the determination was made. When it is determined that the shooting instruction unit that issues a shooting instruction to perform image shooting and the shooting condition determination unit satisfies the shooting condition, at least one of the vibration module and the audio output module is operated, and the user determines A notification control unit that controls to notify the result.
本発明の第2の態様によれば、上記第1の態様における前記被写体の状態に関する情報は、前記撮影中の画像に写る被写体の数であって、前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像の数によって前記被写体の数を認識し、認識した被写体の数が所定の数であれば、撮影条件を満たすと判定してもよい。
According to the second aspect of the present invention, the information related to the state of the subject in the first aspect is the number of subjects appearing in the image being photographed, and the photographing condition determination unit The number of subjects may be recognized based on the number of face images of the subject in the image, and it may be determined that the shooting condition is satisfied if the number of recognized subjects is a predetermined number.
本発明の第3の態様によれば、上記第1の態様または上記第2の態様における前記被写体の状態に関する情報は、前記撮影中の画像に写る一人又は複数の被写体の位置であって、前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像が示す位置によって前記被写体の位置を認識し、認識した一人又は複数の被写体の位置が所定の範囲内にあれば、撮影条件を満たすと判定してもよい。
According to a third aspect of the present invention, the information relating to the state of the subject in the first aspect or the second aspect is the position of one or more subjects in the image being photographed, The shooting condition determination unit recognizes the position of the subject based on the position indicated by the face image of the subject in the image being shot, and sets the shooting condition if the recognized position of the one or more subjects is within a predetermined range. You may determine with satisfy | filling.
本発明の第4の態様によれば、上記第1の態様から上記第3の態様のいずれか一態様に記載の撮像指示装置において、前記撮影条件判定部は、前記撮像装置の揺れの大きさ示す情報に基づいて前記撮像装置の揺れの大きさを判定し、前記撮像装置の揺れの大きさが所定の閾値以内であれば、撮影条件を満たすと判定してもよい。
According to a fourth aspect of the present invention, in the imaging instruction device according to any one of the first aspect to the third aspect, the imaging condition determination unit is a magnitude of shaking of the imaging device. The magnitude of shaking of the imaging device may be determined based on the information shown, and if the magnitude of shaking of the imaging device is within a predetermined threshold, it may be determined that the imaging condition is satisfied.
本発明の第5の態様によれば、上記第1の態様から上記第4の態様のいずれか一態様に記載の撮像指示装置において、前記撮影条件判定部が判定に用いる撮影条件であって、前記撮影条件を満たすと判定してから撮影を実行するまでの時間、または、前記撮影中の画像に含まれる被写体の数、または、被写体の位置のうち少なくとも1つを指定する条件の入力を受け付ける入力部、をさらに備えていてもよい。
According to a fifth aspect of the present invention, in the imaging instruction device according to any one of the first aspect to the fourth aspect, the imaging condition determination unit uses the imaging condition for determination, An input of a condition for designating at least one of a time from when it is determined that the shooting condition is satisfied to when shooting is performed, the number of subjects included in the image being shot, or the position of the subject is received. An input unit may be further provided.
本発明の第6の態様によれば、上記第1の態様から上記第5の態様のいずれか一態様に記載の撮像指示装置において、前記撮影条件判定部は、ユーザによる撮影を中止する指示操作、または、前記撮像装置の揺れの大きさ示す情報、または、前記撮像装置が撮影中の画像に写る被写体の状態に関する情報、に基づいて撮影の中止を決定してもよい。
According to a sixth aspect of the present invention, in the imaging instruction device according to any one of the first to fifth aspects, the imaging condition determination unit is configured to instruct the user to stop imaging. Alternatively, the stop of shooting may be determined based on information indicating the magnitude of shaking of the imaging device or information on the state of the subject in the image being captured by the imaging device.
本発明の第7の態様によれば、撮像システムは、前記撮像装置と通信を行う第1の通信部、をさらに備える上記第1の態様から上記第6の態様のいずれか一態様に記載の撮像指示装置と、撮像部と、前記撮像指示装置と通信を行う第2の通信部と、自装置の揺れを検出する振動検出部と、前記撮像部が撮影中の画像に写る被写体の状態を認識する画像処理部と、を備える撮像装置と、を備える。
According to a seventh aspect of the present invention, the imaging system further includes a first communication unit that communicates with the imaging device, according to any one of the first to sixth aspects. An imaging instruction device, an imaging unit, a second communication unit that communicates with the imaging instruction device, a vibration detection unit that detects shaking of the own device, and a state of a subject that is captured in an image being captured by the imaging unit And an image processing unit for recognizing.
本発明の第8の態様によれば、撮影方法は、撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定し、前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮像指示を行い、さらに、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する。
According to the eighth aspect of the present invention, the imaging method is based on at least one of information indicating information indicating the magnitude of shaking of the imaging device and information relating to the state of the subject in the image being captured by the imaging device. If it is determined whether or not the shooting condition is satisfied, and it is determined that the shooting condition is satisfied, imaging is performed so that the imaging apparatus executes shooting of a still image recording shot image after a lapse of a predetermined time since the determination is made. An instruction is given, and at least one of the vibration module and the audio output module is operated, and control is performed to notify the user of the determination result.
本発明の第9の態様によれば、プログラムは、撮像指示装置のコンピュータを、撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する手段、前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う手段、前記撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する手段、として機能させる。
According to the ninth aspect of the present invention, the program causes the computer of the imaging instruction apparatus to perform information on information indicating a magnitude of shaking of the imaging apparatus and information on a state of a subject that is captured in an image being captured by the imaging apparatus. Means for determining whether or not a shooting condition is satisfied based on at least one of the information, and when it is determined that the shooting condition is satisfied, the imaging apparatus is configured to store the captured image for still image recording after a predetermined time has elapsed since the determination was made. Means for instructing photographing to execute photographing, means for controlling to operate at least one of the vibration module and the audio output module when notifying that the photographing condition is satisfied, and to notify the user of the judgment result Make it work.
上記各形態の撮像指示装置、撮像システム、撮影方法およびプログラムによれば、撮像指示装置は、自分撮りを行うユーザの撮影準備が整っているかどうかを判定する。撮像指示装置は、撮影準備が整ったと判定すると撮像装置に撮像指示を行う。これにより、ユーザは、撮影準備が整ってから自分自身を撮影することができる。また、撮像指示装置は、ユーザに撮影を開始する合図を通知し、撮像装置は、撮像指示があってから所定の時間経過後に撮影を行う。これにより、ユーザは所望の表情や姿勢で撮影に臨むことができる。
According to the imaging instruction device, the imaging system, the imaging method, and the program of each aspect described above, the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging. When the imaging instruction device determines that the preparation for shooting is complete, the imaging instruction device instructs the imaging device to take an image. As a result, the user can photograph himself / herself after preparation for photographing is completed. In addition, the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
(第1の実施形態)
以下、本発明の第1の実施形態について図面を参照して説明する。図1は、本発明の第1の実施形態における撮像システムの構成を示した機能ブロック図である。図1に示す撮像システム1は、撮像指示装置10と、撮像装置20とを有する。撮像指示装置10は、撮像装置20に対して撮像指示を行い、撮像装置20は、その撮像指示に基づいて撮影を行う。 (First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram showing the configuration of the imaging system according to the first embodiment of the present invention. Animaging system 1 illustrated in FIG. 1 includes an imaging instruction device 10 and an imaging device 20. The imaging instruction device 10 issues an imaging instruction to the imaging device 20, and the imaging device 20 performs imaging based on the imaging instruction.
以下、本発明の第1の実施形態について図面を参照して説明する。図1は、本発明の第1の実施形態における撮像システムの構成を示した機能ブロック図である。図1に示す撮像システム1は、撮像指示装置10と、撮像装置20とを有する。撮像指示装置10は、撮像装置20に対して撮像指示を行い、撮像装置20は、その撮像指示に基づいて撮影を行う。 (First embodiment)
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings. FIG. 1 is a functional block diagram showing the configuration of the imaging system according to the first embodiment of the present invention. An
撮像指示装置10は、入出力部11と、条件設定部12と、撮影条件判定部13と、通知制御部14と、撮影指示部15と、メモリ16と、第1の通信部17と、第1のタイマ部18と、を有する。撮像指示装置10は、撮像装置20の制御を行う専用の操作端末であってもよい。また、撮像指示装置10は、例えば、スマートフォンやタブレット端末などの携帯通信端末に、撮像装置20の制御を行うアプリケーションソフトウェアを組み込んだ形態であってもよい。この場合、携帯通信端末には、撮像装置20の制御を行うアプリケーションソフトウェアの他にも、別の様々なアプリケーションソフトウェアが組み込まれていてもよい。
The imaging instruction device 10 includes an input / output unit 11, a condition setting unit 12, an imaging condition determination unit 13, a notification control unit 14, an imaging instruction unit 15, a memory 16, a first communication unit 17, and a first communication unit 17. 1 timer unit 18. The imaging instruction device 10 may be a dedicated operation terminal that controls the imaging device 20. Moreover, the imaging instruction | indication apparatus 10 may be the form which incorporated the application software which controls the imaging device 20 in portable communication terminals, such as a smart phone and a tablet terminal, for example. In this case, various other application software may be incorporated in the mobile communication terminal in addition to the application software for controlling the imaging device 20.
入出力部11は、ボタン、タッチパネルなどの入力装置や、液晶ディスプレイなどの表示装置を含む。入出力部11は、自分撮りの実行に必要な操作画面の画像など各種画像を表示する。入出力部11は、ユーザからの入力操作を受け付ける。例えば、入出力部11は、ユーザによる自分撮り開始指示操作の入力を受け付ける。また、入出力部11は、ユーザによる自分撮りに関する撮影条件の設定操作の入力を受け付ける。また、入出力部11は、ユーザによる自分撮り処理の中止操作の入力を受け付ける。
条件設定部12は、入出力部11が受け付けた設定操作が示す撮影条件をメモリ16に記録する。撮影条件とは、例えば、撮像装置20の揺れの大きさが所定の範囲内となることである。また、撮像条件とは、例えば、撮像装置20の撮影中の画像に写る被写体の数に対する指定である。また、撮像条件とは、例えば、撮像装置20の撮影中の画像に写る被写体の位置に対する指定である。 The input /output unit 11 includes an input device such as a button and a touch panel, and a display device such as a liquid crystal display. The input / output unit 11 displays various images such as an image of an operation screen necessary for performing self-portrait. The input / output unit 11 receives an input operation from the user. For example, the input / output unit 11 receives an input of a selfie start instruction operation by the user. In addition, the input / output unit 11 receives an input of a shooting condition setting operation related to self-photographing by the user. In addition, the input / output unit 11 receives an input of a user's self-shooting process cancel operation.
Thecondition setting unit 12 records the shooting condition indicated by the setting operation received by the input / output unit 11 in the memory 16. The imaging condition is, for example, that the magnitude of shaking of the imaging device 20 is within a predetermined range. The imaging condition is, for example, designation with respect to the number of subjects that appear in the image being captured by the imaging device 20. The imaging condition is, for example, designation with respect to the position of the subject that appears in the image being captured by the imaging device 20.
条件設定部12は、入出力部11が受け付けた設定操作が示す撮影条件をメモリ16に記録する。撮影条件とは、例えば、撮像装置20の揺れの大きさが所定の範囲内となることである。また、撮像条件とは、例えば、撮像装置20の撮影中の画像に写る被写体の数に対する指定である。また、撮像条件とは、例えば、撮像装置20の撮影中の画像に写る被写体の位置に対する指定である。 The input /
The
撮影条件判定部13は、条件設定部12が記録した撮影条件に基づいて、撮影(自分撮り)の準備が整ったかどうかを判定する。
通知制御部14は、撮影条件判定部13が自分撮りの準備が整ったと判定した場合、自分撮りを行うユーザに撮影準備が完了したことを通知する。例えば、通知制御部14は、音声出力モジュールを動作させ自装置が備えるスピーカから音声を出力させることにより、あるいは自装置が備える振動モジュールを動作させて自装置を振動させることによりユーザに通知を行う。また、通知制御部14は、撮影のタイミングで撮影を実行したことをユーザに知らせるための通知を行ってもよい。 The shootingcondition determination unit 13 determines whether or not preparation for shooting (self-portrait) is completed based on the shooting conditions recorded by the condition setting unit 12.
When the shootingcondition determination unit 13 determines that the preparation for self-portrait is ready, the notification control unit 14 notifies the user who performs self-shooting that the preparation for shooting has been completed. For example, the notification control unit 14 notifies the user by operating the audio output module to output sound from a speaker included in the own apparatus, or operating the vibration module included in the own apparatus to vibrate the own apparatus. . Further, the notification control unit 14 may perform a notification for notifying the user that shooting has been performed at the timing of shooting.
通知制御部14は、撮影条件判定部13が自分撮りの準備が整ったと判定した場合、自分撮りを行うユーザに撮影準備が完了したことを通知する。例えば、通知制御部14は、音声出力モジュールを動作させ自装置が備えるスピーカから音声を出力させることにより、あるいは自装置が備える振動モジュールを動作させて自装置を振動させることによりユーザに通知を行う。また、通知制御部14は、撮影のタイミングで撮影を実行したことをユーザに知らせるための通知を行ってもよい。 The shooting
When the shooting
撮影指示部15は、撮像装置20に撮影指示を行う。具体的には、撮影指示部15は、第1の通信部17を介して撮像装置20に撮像指示情報を送信する。
メモリ16は、撮像指示装置10に内蔵されるメモリ等の不揮発性記録媒体であって、撮像装置20が生成した画像や撮像条件など種々の情報を記憶する。
第1の通信部17は、撮像装置20と無線通信を行う。
第1のタイマ部18は、撮影条件判定部13が自分撮りの準備が整ったと判定してから経過した時間を計時する。撮影条件判定部13は、その判定から所定の時間が経過すると上述の撮影指示部15へ所定時間が経過したことを通知する情報を出力する。
表示制御部19は、入出力部11が表示する画面画像を生成する。 Theshooting instruction unit 15 issues a shooting instruction to the imaging device 20. Specifically, the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17.
Thememory 16 is a non-volatile recording medium such as a memory built in the imaging instruction apparatus 10 and stores various information such as an image generated by the imaging apparatus 20 and imaging conditions.
Thefirst communication unit 17 performs wireless communication with the imaging device 20.
Thefirst timer unit 18 measures the time that has elapsed since the shooting condition determination unit 13 determined that preparation for self-taking was completed. The imaging condition determination unit 13 outputs information notifying that the predetermined time has elapsed to the above-described imaging instruction unit 15 when a predetermined time has elapsed since the determination.
Thedisplay control unit 19 generates a screen image displayed by the input / output unit 11.
メモリ16は、撮像指示装置10に内蔵されるメモリ等の不揮発性記録媒体であって、撮像装置20が生成した画像や撮像条件など種々の情報を記憶する。
第1の通信部17は、撮像装置20と無線通信を行う。
第1のタイマ部18は、撮影条件判定部13が自分撮りの準備が整ったと判定してから経過した時間を計時する。撮影条件判定部13は、その判定から所定の時間が経過すると上述の撮影指示部15へ所定時間が経過したことを通知する情報を出力する。
表示制御部19は、入出力部11が表示する画面画像を生成する。 The
The
The
The
The
条件設定部12と、撮影条件判定部13と、通知制御部14と、撮影指示部15は、撮像指示装置10が備えるCPU(Central Processing Unit)等の演算手段がプログラムを読み込んで実行することにより、ソフトウェアの機能として実現可能である。
The condition setting unit 12, the imaging condition determination unit 13, the notification control unit 14, and the imaging instruction unit 15 are read out and executed by an arithmetic unit such as a CPU (Central Processing Unit) provided in the imaging instruction device 10. It can be realized as a software function.
撮像装置20は、撮像部21と、振動検出部22と、画像処理部23と、制御部24と、第2の通信部25とを有する。
撮像部21は、被写体を撮影した画像を生成する。撮像部21は、生成した画像を画像処理部23や第2の通信部25に出力する。なお、撮像部21が被写体を撮影し出力した画像を「センサ出力画像」、ユーザによる確認用に撮像指示装置10へ送信する画像であって画像処理部23が「センサ出力画像」を画像処理して解像度を落とした画像を「低解像度一時画像」、表示制御部19が「低解像度一時画像」を読み込んで入出力部11に表示する画像を「ライブ画像」、撮像部21が撮影した静止画として記録するための画像を「静止画記録用撮影画像」、表示制御部19が「静止画記録用撮影画像」を読み込んで表示画面に表示する画像を「レックビュー画像」と呼ぶことがある。
振動検出部22は、撮像装置20の揺れの大きさを検出する。振動検出部22は、例えば、2軸のデジタル水準器である。あるいは、振動検出部22は、加速度センサやジャイロセンサでもよい。振動検出部22は、検出した揺れの大きさを示す情報を第2の通信部25に出力する。 Theimaging device 20 includes an imaging unit 21, a vibration detection unit 22, an image processing unit 23, a control unit 24, and a second communication unit 25.
Theimaging unit 21 generates an image obtained by photographing the subject. The imaging unit 21 outputs the generated image to the image processing unit 23 and the second communication unit 25. It should be noted that an image obtained by capturing and outputting a subject by the imaging unit 21 is a “sensor output image”, an image transmitted to the imaging instruction apparatus 10 for confirmation by the user, and the image processing unit 23 performs image processing on the “sensor output image”. The image with the reduced resolution is the “low-resolution temporary image”, the display control unit 19 reads the “low-resolution temporary image” and the image displayed on the input / output unit 11 is the “live image”, and the still image captured by the imaging unit 21 An image to be recorded as “still image recording photographic image” may be referred to as “still image recording photographic image”, and an image displayed on the display screen by the display control unit 19 reading “still image recording photographic image” may be referred to as “rec view image”.
Thevibration detection unit 22 detects the magnitude of shaking of the imaging device 20. The vibration detection unit 22 is, for example, a two-axis digital level. Alternatively, the vibration detection unit 22 may be an acceleration sensor or a gyro sensor. The vibration detection unit 22 outputs information indicating the magnitude of the detected shake to the second communication unit 25.
撮像部21は、被写体を撮影した画像を生成する。撮像部21は、生成した画像を画像処理部23や第2の通信部25に出力する。なお、撮像部21が被写体を撮影し出力した画像を「センサ出力画像」、ユーザによる確認用に撮像指示装置10へ送信する画像であって画像処理部23が「センサ出力画像」を画像処理して解像度を落とした画像を「低解像度一時画像」、表示制御部19が「低解像度一時画像」を読み込んで入出力部11に表示する画像を「ライブ画像」、撮像部21が撮影した静止画として記録するための画像を「静止画記録用撮影画像」、表示制御部19が「静止画記録用撮影画像」を読み込んで表示画面に表示する画像を「レックビュー画像」と呼ぶことがある。
振動検出部22は、撮像装置20の揺れの大きさを検出する。振動検出部22は、例えば、2軸のデジタル水準器である。あるいは、振動検出部22は、加速度センサやジャイロセンサでもよい。振動検出部22は、検出した揺れの大きさを示す情報を第2の通信部25に出力する。 The
The
The
画像処理部23は、撮像部21から取得したセンサ出力画像から顔認識技術により被写体を検出する。画像処理部23は、被写体を検出すると、センサ出力画像における被写体の顔が写った領域の座標情報を算出する。また、画像処理部23は、センサ出力画像について自動トリミング処理やフィルタ処理などの画像処理を行う。
制御部24は、撮像装置20の動作を制御する。例えば、制御部24は、撮像部21の生成した画像、振動検出部22の検出した揺れの情報、画像処理部23の算出した画像に写る被写体の座標情報などを第2の通信部25を介して撮像指示装置10へ送信するよう制御する。また、制御部24は、第2の通信部25を介して撮像指示情報を受信した場合、撮像部21に撮影を開始するよう制御を行う。
第2の通信部25は、撮像指示装置10と無線通信を行う。 Theimage processing unit 23 detects a subject from the sensor output image acquired from the imaging unit 21 by a face recognition technique. When the image processing unit 23 detects the subject, the image processing unit 23 calculates coordinate information of an area in which the face of the subject appears in the sensor output image. The image processing unit 23 performs image processing such as automatic trimming processing and filter processing on the sensor output image.
Thecontrol unit 24 controls the operation of the imaging device 20. For example, the control unit 24 transmits the image generated by the imaging unit 21, the information on the shake detected by the vibration detection unit 22, the coordinate information of the subject reflected in the image calculated by the image processing unit 23, and the like via the second communication unit 25. Control to transmit to the imaging instruction apparatus 10. In addition, when receiving the imaging instruction information via the second communication unit 25, the control unit 24 controls the imaging unit 21 to start imaging.
Thesecond communication unit 25 performs wireless communication with the imaging instruction device 10.
制御部24は、撮像装置20の動作を制御する。例えば、制御部24は、撮像部21の生成した画像、振動検出部22の検出した揺れの情報、画像処理部23の算出した画像に写る被写体の座標情報などを第2の通信部25を介して撮像指示装置10へ送信するよう制御する。また、制御部24は、第2の通信部25を介して撮像指示情報を受信した場合、撮像部21に撮影を開始するよう制御を行う。
第2の通信部25は、撮像指示装置10と無線通信を行う。 The
The
The
画像処理部23および制御部24は、撮像装置20が備えるCPU(Central Processing Unit)等の演算手段がプログラムを読み込んで実行することにより、ソフトウェアの機能として実現可能である。また、画像処理部23および制御部24は、ASIC(Application Specific Integrated Circuit)やPLD(Programmable Logic Device)やFPGA(Field-Programmable Gate Array)等のハードウェアを用いて実現されてもよい。
The image processing unit 23 and the control unit 24 can be realized as a software function when a calculation unit such as a CPU (Central Processing Unit) provided in the imaging apparatus 20 reads and executes a program. The image processing unit 23 and the control unit 24 may be realized using hardware such as ASIC (Application Specific Integrated Circuit), PLD (Programmable Logic Device), and FPGA (Field-Programmable Gate Array).
図2は、本発明の第1の実施形態における撮像システムの具体的な構成例を示す外観図である。図2に示す撮像システム1は、撮像指示装置10と、撮像装置20と、光学モジュール30とを有する。
撮像指示装置10と撮像装置20とは無線通信で接続される。撮像装置20の前面には光学モジュール30が装着されている。光学モジュール30は、撮像装置20に対して装着と取り外しとが可能である。撮像装置20と光学モジュール30とは一体的に構成されていてもよい。 FIG. 2 is an external view showing a specific configuration example of the imaging system according to the first embodiment of the present invention. Theimaging system 1 illustrated in FIG. 2 includes an imaging instruction device 10, an imaging device 20, and an optical module 30.
Theimaging instruction device 10 and the imaging device 20 are connected by wireless communication. An optical module 30 is mounted on the front surface of the imaging device 20. The optical module 30 can be attached to and detached from the imaging device 20. The imaging device 20 and the optical module 30 may be configured integrally.
撮像指示装置10と撮像装置20とは無線通信で接続される。撮像装置20の前面には光学モジュール30が装着されている。光学モジュール30は、撮像装置20に対して装着と取り外しとが可能である。撮像装置20と光学モジュール30とは一体的に構成されていてもよい。 FIG. 2 is an external view showing a specific configuration example of the imaging system according to the first embodiment of the present invention. The
The
撮像指示装置10には、例えば、自分撮り開始を指示する撮影ボタンが設けられており、ユーザがこの撮影ボタンを押下すると、撮像装置20は撮像指示装置10と協調して被写体の撮影を行う。
The imaging instruction device 10 is provided with, for example, a shooting button for instructing the start of self-shooting. When the user presses this shooting button, the imaging device 20 performs shooting of a subject in cooperation with the imaging instruction device 10.
光学モジュール30は、レンズと、被写体像を結像させるためにズーム、フォーカス、絞りなどを制御するレンズ制御装置などを備えた光学ユニットである。
撮像装置20は、光学モジュール30を介して入射された被写体光を結像し、被写体の光学像を光電変換する撮像素子と、撮像素子から出力された画素信号に応じた画像を無線通信によって撮像指示装置10へ送信する。 Theoptical module 30 is an optical unit that includes a lens and a lens control device that controls zoom, focus, aperture, and the like to form a subject image.
Theimaging device 20 forms an image of subject light incident via the optical module 30 and photoelectrically converts an optical image of the subject, and captures an image corresponding to the pixel signal output from the imaging device by wireless communication. Transmit to the instruction device 10.
撮像装置20は、光学モジュール30を介して入射された被写体光を結像し、被写体の光学像を光電変換する撮像素子と、撮像素子から出力された画素信号に応じた画像を無線通信によって撮像指示装置10へ送信する。 The
The
図3は、本発明の第1の実施形態における撮像システムの使用例を示す図である。
図3は、ユーザが本実施形態の撮影システムを用いて自分撮りを行う様子を示している。図3が示すようにユーザは、撮像装置20と一体的に構成された光学モジュール30のレンズを自分自身に向け、撮像指示装置10の撮影ボタンを押下して自分撮りを行う。なお、図3ではユーザが撮像装置20を把持しているが、ユーザは撮像装置20を設置して自分撮りを行ってもよい。
一般にスマートフォン等を用いて自分撮りを行う場合、ユーザは図3の撮像装置20の代わりにスマートフォン等を把持し、スマートフォンの表示画面と同じ面に備えられたいわゆるインサイドカメラを自分に向け、表示画面に映るライブ画像を確認しながらタイマ撮影を行う。あるいは、ユーザは自撮り棒(セルフィースティック)を用いてBlouetooth(登録商標)などの無線通信によってリモートで撮影指示を行い自分撮りを行う。これらの一般的な方法の場合、ユーザは、撮像指示を行ったり、表示画面を見て構図を考えたり、インサイドカメラを適切な位置に保持したり、表情を作ったりなど、複数のことを適切に行う必要があり操作が煩雑である。また、例えば、これらの方法の場合、表示画面に映る画像が気になって自然な撮影ができない可能性がある。また、表示画面が小さく表示画面に写る自分の姿がよく確認できなかったり、インサイドカメラのレンズと表示画面の位置がずれていて目線がずれてしまったりする可能性がある。 FIG. 3 is a diagram illustrating a usage example of the imaging system according to the first embodiment of the present invention.
FIG. 3 shows how the user takes a selfie using the imaging system of the present embodiment. As shown in FIG. 3, the user takes a self-portrait by directing the lens of theoptical module 30 configured integrally with the imaging device 20 to himself and pressing the shooting button of the imaging instruction device 10. In FIG. 3, the user holds the imaging device 20, but the user may install the imaging device 20 and take a selfie.
In general, when taking a self-portrait using a smartphone or the like, the user holds the smartphone or the like instead of theimaging device 20 of FIG. Timer shooting is performed while checking the live image displayed on the screen. Alternatively, the user performs a self-portrait by using a self-shooting stick (selfie stick) to instruct remote shooting by wireless communication such as Bluetooth (registered trademark). With these general methods, the user can do multiple things, such as giving imaging instructions, thinking about the composition by looking at the display screen, holding the inside camera in an appropriate position, and creating facial expressions. The operation is complicated. Further, for example, in the case of these methods, there is a possibility that natural shooting cannot be performed because of an image on the display screen. In addition, there is a possibility that the display screen is small and the appearance of himself / herself on the display screen cannot be confirmed well, or the position of the lens of the inside camera and the display screen is shifted and the line of sight is shifted.
図3は、ユーザが本実施形態の撮影システムを用いて自分撮りを行う様子を示している。図3が示すようにユーザは、撮像装置20と一体的に構成された光学モジュール30のレンズを自分自身に向け、撮像指示装置10の撮影ボタンを押下して自分撮りを行う。なお、図3ではユーザが撮像装置20を把持しているが、ユーザは撮像装置20を設置して自分撮りを行ってもよい。
一般にスマートフォン等を用いて自分撮りを行う場合、ユーザは図3の撮像装置20の代わりにスマートフォン等を把持し、スマートフォンの表示画面と同じ面に備えられたいわゆるインサイドカメラを自分に向け、表示画面に映るライブ画像を確認しながらタイマ撮影を行う。あるいは、ユーザは自撮り棒(セルフィースティック)を用いてBlouetooth(登録商標)などの無線通信によってリモートで撮影指示を行い自分撮りを行う。これらの一般的な方法の場合、ユーザは、撮像指示を行ったり、表示画面を見て構図を考えたり、インサイドカメラを適切な位置に保持したり、表情を作ったりなど、複数のことを適切に行う必要があり操作が煩雑である。また、例えば、これらの方法の場合、表示画面に映る画像が気になって自然な撮影ができない可能性がある。また、表示画面が小さく表示画面に写る自分の姿がよく確認できなかったり、インサイドカメラのレンズと表示画面の位置がずれていて目線がずれてしまったりする可能性がある。 FIG. 3 is a diagram illustrating a usage example of the imaging system according to the first embodiment of the present invention.
FIG. 3 shows how the user takes a selfie using the imaging system of the present embodiment. As shown in FIG. 3, the user takes a self-portrait by directing the lens of the
In general, when taking a self-portrait using a smartphone or the like, the user holds the smartphone or the like instead of the
また、自分撮りにおいては、自分が写った写真を確実に撮るということの他にも、例えば、カメラ目線の写真が撮りたい、カメラ目線以外の自然な写真が撮りたい、素早く撮りたい、周囲に目立たずに撮りたい、撮影のタイミングを知りたい、友達2~3人でも撮りたい、などのニーズがあり、一般的な自分撮りの方法ではこれらのニーズを満たすことは困難であった。また、さまざまな機材や複雑な手順を要する撮影方法では、手軽に撮影ができず周囲の迷惑になってしまい自分撮りには適さない。
Also, in self-taking, in addition to taking a picture of yourself, for example, you want to take a picture looking at the camera, take a natural picture other than the camera, take a picture quickly, There are needs such as wanting to shoot unobtrusively, knowing the timing of shooting, or even two or three friends, and it has been difficult to meet these needs with general self-portrait methods. Also, shooting methods that require a variety of equipment and complicated procedures are not suitable for self-portraits because it is not easy to shoot and annoying the surroundings.
そこで、本実施形態では、自然な撮影が行えるように表示画面に写る自分の姿を確認せずに自分撮りを行うことができ、また、撮影準備が整った最適なタイミングで撮像を行うことができる撮影システムを提供する。
具体的には、ユーザによる自分撮りの指示操作が行われると、撮像システム1は、撮影準備が整ったかどうかを判定し、所定時間経過後に撮影を行う。つまり、本実施形態では、ユーザではなく、撮像システム1が撮影タイマのスタートタイミングと、それに伴う撮影タイミングを決定する。より詳細には、撮像指示装置10が、撮像装置20の揺れ具合やセンサ出力画像に写る被写体の状態に応じて撮影準備が整ったかどうかの判定を行い、撮影準備が整ったと判定すると、撮影タイマをスタートさせるとともに、撮影のタイミングをユーザに通知する。
本実施形態によれば、自分撮りを行うユーザは、自分がうまく取れているかどうかを撮像システム1に任せることができるので、ライブ画像の確認を行うために表示画面を見る必要が無くなる。また、撮影のタイミングをユーザに通知するので、ユーザはそのタイミングに合わせて表情を作ったり、自然な姿勢を取ったりして撮影に臨むことができる。 Therefore, in the present embodiment, it is possible to take a self-photographing without confirming the appearance of himself / herself on the display screen so that natural photographing can be performed, and it is possible to perform photographing at an optimal timing when preparation for photographing is complete. Provide a shooting system that can.
Specifically, when a user performs a self-shooting instruction operation, theimaging system 1 determines whether or not preparation for shooting is completed and performs shooting after a predetermined time has elapsed. That is, in this embodiment, not the user but the imaging system 1 determines the start timing of the shooting timer and the shooting timing associated therewith. More specifically, when the imaging instruction device 10 determines whether or not the imaging preparation is ready in accordance with the degree of shaking of the imaging device 20 and the state of the subject shown in the sensor output image. And the user is notified of the timing of shooting.
According to the present embodiment, since the user who takes a self-portrait can leave theimaging system 1 to see whether he / she can take it well, it is not necessary to look at the display screen in order to check the live image. In addition, since the timing of shooting is notified to the user, the user can make a facial expression in accordance with the timing or take a natural posture for shooting.
具体的には、ユーザによる自分撮りの指示操作が行われると、撮像システム1は、撮影準備が整ったかどうかを判定し、所定時間経過後に撮影を行う。つまり、本実施形態では、ユーザではなく、撮像システム1が撮影タイマのスタートタイミングと、それに伴う撮影タイミングを決定する。より詳細には、撮像指示装置10が、撮像装置20の揺れ具合やセンサ出力画像に写る被写体の状態に応じて撮影準備が整ったかどうかの判定を行い、撮影準備が整ったと判定すると、撮影タイマをスタートさせるとともに、撮影のタイミングをユーザに通知する。
本実施形態によれば、自分撮りを行うユーザは、自分がうまく取れているかどうかを撮像システム1に任せることができるので、ライブ画像の確認を行うために表示画面を見る必要が無くなる。また、撮影のタイミングをユーザに通知するので、ユーザはそのタイミングに合わせて表情を作ったり、自然な姿勢を取ったりして撮影に臨むことができる。 Therefore, in the present embodiment, it is possible to take a self-photographing without confirming the appearance of himself / herself on the display screen so that natural photographing can be performed, and it is possible to perform photographing at an optimal timing when preparation for photographing is complete. Provide a shooting system that can.
Specifically, when a user performs a self-shooting instruction operation, the
According to the present embodiment, since the user who takes a self-portrait can leave the
図4Aは、本発明の第1の実施形態における撮像指示装置の画面例を示した第1の図である。図4Bは、本発明の第1の実施形態における撮像指示装置の画面例を示した第2の図である。
図4Aは、自分撮り設定画面の画像の一例を示している。以下、入出力部11に表示される画面の画像を単に画面と呼ぶ場合がある。撮像指示装置10は入出力部11、ハードボタン120を有している。入出力部11は、タッチパネルと表示装置とが一体的に構成されていて、入出力部11は、自分撮り設定画面を表示するとともにユーザからの入力操作を受け付ける。表示制御部19は、自分撮り設定画面の画像を生成し、入出力部11に出力する。また、ハードボタン120は、ユーザが撮像指示装置10に指示操作を行う場合に用いる入力手段の一例である。
自分撮り設定画面は、例えば、完了ボタン100、キャンセルボタン101、タイマ設定欄102、サウンド設定欄103、構図設定欄104、画像処理設定欄105、レックビュー設定欄106を含んでいる。 FIG. 4A is a first diagram illustrating a screen example of the imaging instruction apparatus according to the first embodiment of the present invention. FIG. 4B is a second diagram illustrating a screen example of the imaging instruction device according to the first embodiment of the present invention.
FIG. 4A shows an example of an image of the selfie setting screen. Hereinafter, the screen image displayed on the input /output unit 11 may be simply referred to as a screen. The imaging instruction device 10 includes an input / output unit 11 and a hard button 120. The input / output unit 11 is configured integrally with a touch panel and a display device, and the input / output unit 11 displays a self-portrait setting screen and accepts an input operation from a user. The display control unit 19 generates an image of the selfie setting screen and outputs it to the input / output unit 11. The hard button 120 is an example of an input unit used when a user performs an instruction operation on the imaging instruction device 10.
The self-portrait setting screen includes, for example, acompletion button 100, a cancel button 101, a timer setting field 102, a sound setting field 103, a composition setting field 104, an image processing setting field 105, and a rec view setting field 106.
図4Aは、自分撮り設定画面の画像の一例を示している。以下、入出力部11に表示される画面の画像を単に画面と呼ぶ場合がある。撮像指示装置10は入出力部11、ハードボタン120を有している。入出力部11は、タッチパネルと表示装置とが一体的に構成されていて、入出力部11は、自分撮り設定画面を表示するとともにユーザからの入力操作を受け付ける。表示制御部19は、自分撮り設定画面の画像を生成し、入出力部11に出力する。また、ハードボタン120は、ユーザが撮像指示装置10に指示操作を行う場合に用いる入力手段の一例である。
自分撮り設定画面は、例えば、完了ボタン100、キャンセルボタン101、タイマ設定欄102、サウンド設定欄103、構図設定欄104、画像処理設定欄105、レックビュー設定欄106を含んでいる。 FIG. 4A is a first diagram illustrating a screen example of the imaging instruction apparatus according to the first embodiment of the present invention. FIG. 4B is a second diagram illustrating a screen example of the imaging instruction device according to the first embodiment of the present invention.
FIG. 4A shows an example of an image of the selfie setting screen. Hereinafter, the screen image displayed on the input /
The self-portrait setting screen includes, for example, a
完了ボタン100は、自分撮り設定画面でユーザが設定した設定内容を保存する場合にユーザが押下するボタンの画像である。キャンセルボタン101は、設定内容を破棄する場合にユーザが押下するボタンの画像である。タイマ設定欄102は、撮影準備が整ったと判定してから撮影を行うまでの時間(撮影待ち時間)を設定する項目である。例えば、ユーザはタイマ設定欄102に3秒と設定する。サウンド設定欄103は、撮影準備が整ったと判定した場合に撮影までのカウントダウンが開始されるときにユーザに通知する音声、撮影時の音声を指定する項目である。例えば、ユーザは、撮影までのカウントダウン開始時の音声としてビープ音を、撮影時の音声として無音(音を発しない)を設定する。構図設定欄104は、撮影する画像の構図を設定する項目である。例えば、被写体の顔を中心とした構図、被写体の左側の背景を写した構成、被写体の右側の背景を写した構成、の中から選択できるようにしてもよい。画像処理設定欄105は、撮像装置20が生成した画像に対して行う補正処理・加工処理の設定を行う項目である。例えば、自動トリミングを行うか否か、フィルタ処理の種類の設定(例えば、ポートレートなど)を行えるようにしてもよい。レックビュー設定欄106は、撮影した画像(レックビュー画像)を表示するか否かの設定を行う項目である。
The completion button 100 is an image of a button that the user presses when saving the setting content set by the user on the selfie setting screen. The cancel button 101 is an image of a button that the user presses when discarding the setting contents. The timer setting field 102 is an item for setting a time (shooting waiting time) from when it is determined that the preparation for shooting is completed until shooting is performed. For example, the user sets 3 seconds in the timer setting field 102. The sound setting column 103 is an item for designating a voice to be notified to the user when the countdown until the shooting is started when it is determined that the shooting preparation is completed, and a voice at the time of shooting. For example, the user sets a beep sound as the sound at the start of the countdown until shooting, and silence (does not emit sound) as the sound at the time of shooting. The composition setting column 104 is an item for setting the composition of an image to be shot. For example, it is possible to select from a composition centered on the face of the subject, a configuration in which the background on the left side of the subject is captured, and a configuration in which the background on the right side of the subject is captured. The image processing setting column 105 is an item for setting correction processing / processing processing performed on an image generated by the imaging apparatus 20. For example, it may be possible to set whether to perform automatic trimming and to set the type of filter processing (for example, portrait). The REC view setting field 106 is an item for setting whether to display a captured image (REC view image).
ユーザが、自分撮り設定画面の各項目を設定し、完了ボタン100を押下すると、条件設定部12は、設定内容をメモリ16に記録する。また、ユーザが、キャンセルボタン101を押下すると設定内容は変更されず、既にメモリ16に記録された設定内容が使用される。また、ユーザが、完了ボタン100またはキャンセルボタン101を押下すると、表示制御部19が、図4Bに示す自分撮り指示画像を入出力部11に出力するように構成されていてもよい。
When the user sets each item on the selfie setting screen and presses the completion button 100, the condition setting unit 12 records the setting contents in the memory 16. When the user presses the cancel button 101, the setting contents are not changed, and the setting contents already recorded in the memory 16 are used. Further, when the user presses the completion button 100 or the cancel button 101, the display control unit 19 may be configured to output the self-portrait instruction image shown in FIG. 4B to the input / output unit 11.
図4Bは、自分撮り指示画面の一例を示している。例えば、ユーザがメニュー画面などから自分撮りを行う指示操作を入力すると、表示制御部19は、自分撮り指示画面の画像を生成し入出力部11に出力する。
自分撮り設定画面は、例えば、設定画面呼び出しボタン110、自分撮り実行指示ボタン111~114を含んでいる。ユーザが設定画面呼び出しボタン110を押下すると、表示制御部19は、図4Aで示した自分撮り設定画面の画像を生成し入出力部11に出力する。自分撮り実行指示ボタン111は、1人を対象に自分撮りを行うときに押下するボタンである。自分撮り実行指示ボタン112は2人を対象に、自分撮り実行指示ボタン113は3人を対象に、自分撮り実行指示ボタン114は4人以上を対象に自分撮りを行うときに押下するボタンである。ユーザは、撮影対象となる人数に応じて自分撮り実行指示ボタン111~114の中から適切なボタンを選択し押下する。ユーザが、自分撮り実行指示ボタン111~114のうち何れかのボタンを押下すると、本実施形態の撮像システム1による自分撮り処理が実行される。本実施形態の自分撮り処理については、図7~図9を用いて後に説明する。 FIG. 4B shows an example of a self-shooting instruction screen. For example, when the user inputs an instruction operation for taking a selfie from a menu screen or the like, thedisplay control unit 19 generates an image of the selfie instruction screen and outputs it to the input / output unit 11.
The self-portrait setting screen includes, for example, a settingscreen calling button 110 and self-portrait execution instruction buttons 111 to 114. When the user presses the setting screen call button 110, the display control unit 19 generates an image of the selfie setting screen shown in FIG. 4A and outputs it to the input / output unit 11. The self-taking execution instruction button 111 is a button to be pressed when performing self-taking for one person. The self-portrait execution instruction button 112 is for two persons, the self-capture execution instruction button 113 is for three persons, and the self-execution execution instruction button 114 is a button to be pressed when performing self-taking for four or more persons. . The user selects and presses an appropriate button from the self-shoot execution instruction buttons 111 to 114 according to the number of persons to be photographed. When the user presses any one of the self-portrait execution instruction buttons 111 to 114, the self-portrait process by the imaging system 1 of the present embodiment is executed. Self-portrait processing according to the present embodiment will be described later with reference to FIGS.
自分撮り設定画面は、例えば、設定画面呼び出しボタン110、自分撮り実行指示ボタン111~114を含んでいる。ユーザが設定画面呼び出しボタン110を押下すると、表示制御部19は、図4Aで示した自分撮り設定画面の画像を生成し入出力部11に出力する。自分撮り実行指示ボタン111は、1人を対象に自分撮りを行うときに押下するボタンである。自分撮り実行指示ボタン112は2人を対象に、自分撮り実行指示ボタン113は3人を対象に、自分撮り実行指示ボタン114は4人以上を対象に自分撮りを行うときに押下するボタンである。ユーザは、撮影対象となる人数に応じて自分撮り実行指示ボタン111~114の中から適切なボタンを選択し押下する。ユーザが、自分撮り実行指示ボタン111~114のうち何れかのボタンを押下すると、本実施形態の撮像システム1による自分撮り処理が実行される。本実施形態の自分撮り処理については、図7~図9を用いて後に説明する。 FIG. 4B shows an example of a self-shooting instruction screen. For example, when the user inputs an instruction operation for taking a selfie from a menu screen or the like, the
The self-portrait setting screen includes, for example, a setting
図5は、本発明の第1の実施形態における撮影条件の判定処理を説明する第1の図である。
上述のとおり本実施形態では、撮像システム1が、撮影準備が整ったかどうかの判定を行い、撮影タイミングを決定する。この判定は、撮像指示装置10の撮影条件判定部13が、所定の撮影条件に基づいて行う。所定の条件とは、例えば、撮像装置20の揺れの大きさである。揺れの大きさが所定の閾値以上の場合、撮影条件判定部13は、その状態で撮影を行ってもぶれた画像しか撮影できないので撮影準備は整っていないと判定する。 FIG. 5 is a first diagram illustrating the photographing condition determination process according to the first embodiment of the present invention.
As described above, in the present embodiment, theimaging system 1 determines whether or not the preparation for shooting is complete, and determines the shooting timing. This determination is performed by the imaging condition determination unit 13 of the imaging instruction apparatus 10 based on predetermined imaging conditions. The predetermined condition is, for example, the magnitude of shaking of the imaging device 20. When the magnitude of the shake is equal to or greater than a predetermined threshold, the shooting condition determination unit 13 determines that shooting preparation is not complete because only blurred images can be shot even if shooting is performed in that state.
上述のとおり本実施形態では、撮像システム1が、撮影準備が整ったかどうかの判定を行い、撮影タイミングを決定する。この判定は、撮像指示装置10の撮影条件判定部13が、所定の撮影条件に基づいて行う。所定の条件とは、例えば、撮像装置20の揺れの大きさである。揺れの大きさが所定の閾値以上の場合、撮影条件判定部13は、その状態で撮影を行ってもぶれた画像しか撮影できないので撮影準備は整っていないと判定する。 FIG. 5 is a first diagram illustrating the photographing condition determination process according to the first embodiment of the present invention.
As described above, in the present embodiment, the
図5は、撮影条件判定部13が判定に用いる撮影条件のうち、撮像装置20の揺れの大きさに基づく判定について説明する図である。図5は、撮像装置20が備える振動検出部22が検出した揺れの大きさの推移を示すグラフである。このグラフの縦軸は揺れの大きさを、横軸は時間を示している。例えば、振動検出部22が2軸のデジタル水準器の場合、振動検出部22は、水平面のX軸方向、Y軸方向の揺れを検出する。振動検出部22の検出したX軸方向、Y軸方向の揺れの情報はそれぞれの揺れの検出時刻の情報と組みにして、所定の時間間隔で撮像指示装置10へ送信される。撮像指示装置10では、第1の通信部17が揺れの情報を受信しメモリ16に記録する。図5においてグラフ3Xは、このようにして記録されたX軸方向の揺れの推移を示すグラフである。同様にグラフ3Yは、Y軸方向の揺れの推移を示すグラフである。
FIG. 5 is a diagram for explaining determination based on the magnitude of shaking of the imaging apparatus 20 among the imaging conditions used for the determination by the imaging condition determination unit 13. FIG. 5 is a graph showing changes in the magnitude of shaking detected by the vibration detection unit 22 included in the imaging device 20. In this graph, the vertical axis represents the magnitude of shaking, and the horizontal axis represents time. For example, when the vibration detection unit 22 is a two-axis digital level, the vibration detection unit 22 detects shaking in the X-axis direction and the Y-axis direction of the horizontal plane. The information on the shaking in the X-axis direction and the Y-axis direction detected by the vibration detection unit 22 is transmitted to the imaging instruction apparatus 10 at a predetermined time interval in combination with the information on the detection time of each shaking. In the imaging instruction apparatus 10, the first communication unit 17 receives the shake information and records it in the memory 16. In FIG. 5, a graph 3X is a graph showing the transition of the fluctuation in the X-axis direction recorded in this way. Similarly, the graph 3Y is a graph showing the transition of fluctuation in the Y-axis direction.
撮影条件判定部13は、メモリ16に記録されたX軸、Y軸方向の揺れの情報に基づいて、撮像装置20の揺れの大きさが、所定の期間に渡って許容できる範囲の大きさとなったときに撮像装置20の揺れの大きさは撮影条件を満たすと判定する。例えば、撮影条件判定部13は、ある時刻tにおけるX軸、Y軸方向の揺れの大きさが次式(1)を満たす場合、時刻tにおいて撮像装置20の揺れは収まったと判定する。
|X(t)-X(t-1)| + |Y(t)-Y(t-1)|
< 閾値L ・・・(1)
ここで、X(t)、Y(t)は、それぞれ時刻tにおけるX軸方向の揺れの大きさ、Y軸方向の揺れの大きさである。同様にX(t-1)、Y(t-1)は、例えば1秒前の時刻t-1でのX軸、Y軸方向の揺れの大きさである。撮影条件判定部13は、tを所定時間に渡ってずらし、それぞれのtについて式(1)を満たす場合、撮像装置20の揺れの大きさは撮影条件を満たすと判定する。 Based on the information about the shakes in the X-axis and Y-axis directions recorded in thememory 16, the imaging condition determination unit 13 sets the magnitude of the shake of the imaging device 20 within an allowable range over a predetermined period. The magnitude of the shaking of the imaging device 20 is determined to satisfy the imaging condition. For example, the imaging condition determination unit 13 determines that the shaking of the imaging device 20 has subsided at time t when the magnitude of shaking in the X-axis and Y-axis directions at a certain time t satisfies the following equation (1).
| X (t) −X (t−1) | + | Y (t) −Y (t−1) |
<Threshold L (1)
Here, X (t) and Y (t) are the magnitude of the shake in the X-axis direction and the magnitude of the shake in the Y-axis direction, respectively, at time t. Similarly, X (t-1) and Y (t-1) are, for example, magnitudes of shaking in the X-axis and Y-axis directions at time t-1 one second before. The imagingcondition determination unit 13 shifts t over a predetermined time, and determines that the magnitude of shaking of the imaging device 20 satisfies the imaging condition when Expression (1) is satisfied for each t.
|X(t)-X(t-1)| + |Y(t)-Y(t-1)|
< 閾値L ・・・(1)
ここで、X(t)、Y(t)は、それぞれ時刻tにおけるX軸方向の揺れの大きさ、Y軸方向の揺れの大きさである。同様にX(t-1)、Y(t-1)は、例えば1秒前の時刻t-1でのX軸、Y軸方向の揺れの大きさである。撮影条件判定部13は、tを所定時間に渡ってずらし、それぞれのtについて式(1)を満たす場合、撮像装置20の揺れの大きさは撮影条件を満たすと判定する。 Based on the information about the shakes in the X-axis and Y-axis directions recorded in the
| X (t) −X (t−1) | + | Y (t) −Y (t−1) |
<Threshold L (1)
Here, X (t) and Y (t) are the magnitude of the shake in the X-axis direction and the magnitude of the shake in the Y-axis direction, respectively, at time t. Similarly, X (t-1) and Y (t-1) are, for example, magnitudes of shaking in the X-axis and Y-axis directions at time t-1 one second before. The imaging
図6は、本発明の第1の実施形態における撮影条件の判定処理を説明する第2の図である。
図6は、撮影条件判定部13が、撮影準備が整ったかどうかの判定に用いる所定の撮影条件のうち、センサ出力画像に写る被写体の状態に基づく判定について説明する図である。図6は、ユーザが自分撮り設定画面で設定した構図設定および自分撮り指示画面で選択した撮影対象の人数ごとの被写体の認識方法の概要を示したものである。図6には、構図と人数に対応した12個のセンサ出力画像K11、K12、K13、K21、K22、K23、K31、K32、K33、K41、K42、K43が示されている。センサ出力画像K11は、構成が「顔中心」で対象人数が「1人」の場合の被写体の認識方法の概要を説明する図である。構図ガイドエリアG11は、構図が「顔中心」で対象人数が「1人」の場合に顔の中心座標が含まれるべき領域である。構図ガイドエリアは、構図設定と撮影対象の人数に応じて予め定められており、それぞれの構図ガイドエリアの領域を規定する各頂点の座標情報は、メモリ16に記録されている。 FIG. 6 is a second diagram illustrating the photographing condition determination process in the first embodiment of the present invention.
FIG. 6 is a diagram illustrating determination based on the state of the subject appearing in the sensor output image among predetermined shooting conditions used for determining whether or not the shootingcondition determination unit 13 is ready for shooting. FIG. 6 shows an outline of a composition setting set by the user on the selfie setting screen and a method for recognizing the subject for each number of shooting targets selected on the selfie instruction screen. FIG. 6 shows twelve sensor output images K11, K12, K13, K21, K22, K23, K31, K32, K33, K41, K42, and K43 corresponding to the composition and the number of people. The sensor output image K11 is a diagram illustrating an outline of a method for recognizing a subject when the configuration is “face center” and the number of subjects is “one person”. The composition guide area G11 is an area in which the center coordinates of the face should be included when the composition is “face center” and the number of subjects is “one person”. The composition guide area is determined in advance according to the composition setting and the number of subjects to be photographed, and the coordinate information of each vertex that defines the area of each composition guide area is recorded in the memory 16.
図6は、撮影条件判定部13が、撮影準備が整ったかどうかの判定に用いる所定の撮影条件のうち、センサ出力画像に写る被写体の状態に基づく判定について説明する図である。図6は、ユーザが自分撮り設定画面で設定した構図設定および自分撮り指示画面で選択した撮影対象の人数ごとの被写体の認識方法の概要を示したものである。図6には、構図と人数に対応した12個のセンサ出力画像K11、K12、K13、K21、K22、K23、K31、K32、K33、K41、K42、K43が示されている。センサ出力画像K11は、構成が「顔中心」で対象人数が「1人」の場合の被写体の認識方法の概要を説明する図である。構図ガイドエリアG11は、構図が「顔中心」で対象人数が「1人」の場合に顔の中心座標が含まれるべき領域である。構図ガイドエリアは、構図設定と撮影対象の人数に応じて予め定められており、それぞれの構図ガイドエリアの領域を規定する各頂点の座標情報は、メモリ16に記録されている。 FIG. 6 is a second diagram illustrating the photographing condition determination process in the first embodiment of the present invention.
FIG. 6 is a diagram illustrating determination based on the state of the subject appearing in the sensor output image among predetermined shooting conditions used for determining whether or not the shooting
構図ガイドエリアG11は、構図が「顔中心」に設定されているのでセンサ出力画像の中心付近に設定されている。中心点P11は、撮像装置20の画像処理部23がセンサ出力画像K11を顔認識技術により画像処理した結果算出された、センサ出力画像K11に写る被写体の顔画像の中心の位置である。画像処理部23は、このとき顔認識技術により検出した例えば矩形の領域で示される顔画像の候補の中から、大きいものから順にユーザによって指定された対象人数分を被写体として特定し、その中心座標を算出してもよい。画像処理部23が算出した顔画像の座標情報は、撮像指示装置10へ送信される。撮像指示装置10では撮影条件判定部13が、メモリ16に記録された構図ガイドエリアの座標情報と撮像装置20から受信した顔画像の座標情報に基づいて、被写体の撮影状態が適切かどうかを判定する。例えば、センサ出力画像K11の場合、中心点P11は、構図ガイドエリアG11に含まれている。このように、中心点P11が構図と撮影対象の人数に対応した構図ガイドエリアG11に含まれている場合、撮影条件判定部13は、被写体の状態は撮影条件を満たすと判定する。
The composition guide area G11 is set near the center of the sensor output image because the composition is set to “face center”. The center point P11 is the position of the center of the face image of the subject in the sensor output image K11 calculated as a result of the image processing unit 23 of the imaging device 20 performing image processing on the sensor output image K11 using the face recognition technology. The image processing unit 23 specifies, as subjects, subjects corresponding to the number of subjects designated by the user in order from the largest in the face image candidates indicated by, for example, a rectangular region detected by the face recognition technology at this time. May be calculated. The coordinate information of the face image calculated by the image processing unit 23 is transmitted to the imaging instruction device 10. In the imaging instruction apparatus 10, the imaging condition determination unit 13 determines whether the imaging state of the subject is appropriate based on the coordinate information of the composition guide area recorded in the memory 16 and the coordinate information of the face image received from the imaging apparatus 20. To do. For example, in the case of the sensor output image K11, the center point P11 is included in the composition guide area G11. As described above, when the center point P11 is included in the composition guide area G11 corresponding to the composition and the number of subjects to be photographed, the photographing condition determination unit 13 determines that the state of the subject satisfies the photographing condition.
センサ出力画像K12は、構成設定が「左風景」で対象人数が「1人」の場合の被写体の認識方法の概要を説明する図である。この場合、構成ガイドエリアG12は、センサ出力画像K12の左寄りに設定されている。
センサ出力画像K13は、構成設定が「右風景」で対象人数が「1人」の場合の被写体の認識方法の概要を説明する図である。この場合、構成ガイドエリアG13は、センサ出力画像K13の右寄りに設定されている。 The sensor output image K12 is a diagram illustrating an outline of a method for recognizing a subject when the configuration setting is “left landscape” and the target number of people is “one person”. In this case, the configuration guide area G12 is set to the left of the sensor output image K12.
The sensor output image K13 is a diagram for explaining an outline of a method for recognizing a subject when the configuration setting is “right landscape” and the target number of people is “one person”. In this case, the configuration guide area G13 is set to the right of the sensor output image K13.
センサ出力画像K13は、構成設定が「右風景」で対象人数が「1人」の場合の被写体の認識方法の概要を説明する図である。この場合、構成ガイドエリアG13は、センサ出力画像K13の右寄りに設定されている。 The sensor output image K12 is a diagram illustrating an outline of a method for recognizing a subject when the configuration setting is “left landscape” and the target number of people is “one person”. In this case, the configuration guide area G12 is set to the left of the sensor output image K12.
The sensor output image K13 is a diagram for explaining an outline of a method for recognizing a subject when the configuration setting is “right landscape” and the target number of people is “one person”. In this case, the configuration guide area G13 is set to the right of the sensor output image K13.
同様にセンサ出力画像K21の構成ガイドエリアG12は、構成が「顔中心」なのでセンサ出力画像K21の中央付近に、対象人数が「2人」に対応した広さで設定されている。この場合も、中心点P21A、P21Bが共に構成ガイドエリアG12内に含まれていれば、撮影条件判定部13は、被写体の状態は撮影条件を満たすと判定する。
また、センサ出力画像K22の構成ガイドエリアG22は、構成ガイドエリアG21と同じ大きさで左寄りに、センサ出力画像K23の構成ガイドエリアG23は、構成ガイドエリアG21と同じ大きさで右寄りに設定されている。 Similarly, since the configuration guide area G12 of the sensor output image K21 has a “face center” configuration, the target number of people is set in the vicinity of the center of the sensor output image K21 with a size corresponding to “2 people”. Also in this case, if both the center points P21A and P21B are included in the configuration guide area G12, the shootingcondition determination unit 13 determines that the state of the subject satisfies the shooting condition.
The configuration guide area G22 of the sensor output image K22 is set to the left with the same size as the configuration guide area G21, and the configuration guide area G23 of the sensor output image K23 is set to the right with the same size as the configuration guide area G21. Yes.
また、センサ出力画像K22の構成ガイドエリアG22は、構成ガイドエリアG21と同じ大きさで左寄りに、センサ出力画像K23の構成ガイドエリアG23は、構成ガイドエリアG21と同じ大きさで右寄りに設定されている。 Similarly, since the configuration guide area G12 of the sensor output image K21 has a “face center” configuration, the target number of people is set in the vicinity of the center of the sensor output image K21 with a size corresponding to “2 people”. Also in this case, if both the center points P21A and P21B are included in the configuration guide area G12, the shooting
The configuration guide area G22 of the sensor output image K22 is set to the left with the same size as the configuration guide area G21, and the configuration guide area G23 of the sensor output image K23 is set to the right with the same size as the configuration guide area G21. Yes.
撮影対象人数が3人の場合も同様である。例えば、センサ出力画像K31の構成ガイドエリアG31は、画像の中央付近に対象人数が「3人」に対応した広さで設定されている。中心点P31A、P31B、31Cが共に構成ガイドエリアG31内に含まれていれば、撮影条件判定部13は、被写体の撮影状態が適切であると判定する。また、構成設定が「左風景」に対応する構成ガイドエリアG32は左寄りに、構成設定が「右風景」に対応する構成ガイドエリアG33は右寄りに設定されている。
また、撮影対象人数が4人以上の場合、対象人数に合わせて、構成ガイドエリアG41、G42、G43は、図示するように各センサ出力画像の全面の大きさに設定されてもよい。 The same applies when the number of subjects to be photographed is three. For example, the configuration guide area G31 of the sensor output image K31 is set with a size corresponding to the number of subjects “3” near the center of the image. If the center points P31A, P31B, and 31C are all included in the configuration guide area G31, the shootingcondition determination unit 13 determines that the shooting state of the subject is appropriate. The configuration guide area G32 corresponding to the “left landscape” is set to the left, and the configuration guide area G33 corresponding to the “right landscape” is set to the right.
When the number of subjects to be photographed is four or more, the configuration guide areas G41, G42, and G43 may be set to the size of the entire surface of each sensor output image as shown in the drawing according to the number of subjects.
また、撮影対象人数が4人以上の場合、対象人数に合わせて、構成ガイドエリアG41、G42、G43は、図示するように各センサ出力画像の全面の大きさに設定されてもよい。 The same applies when the number of subjects to be photographed is three. For example, the configuration guide area G31 of the sensor output image K31 is set with a size corresponding to the number of subjects “3” near the center of the image. If the center points P31A, P31B, and 31C are all included in the configuration guide area G31, the shooting
When the number of subjects to be photographed is four or more, the configuration guide areas G41, G42, and G43 may be set to the size of the entire surface of each sensor output image as shown in the drawing according to the number of subjects.
このように、構図ガイドエリアの位置、大きさは、それぞれ構図設定と撮影対象の人数に応じて定められている。なお、構図ガイドエリアの大きさは、光学モジュール30のレンズの仕様、撮像装置20を手に持って自分に向けた場合の距離(腕の長さ)で概ね定めることが可能であるが、例えば、自撮り棒に撮像装置20を装着するなどして少し離れた位置から自分撮りを行う場合に対応するために、図4Aで例示した自分撮り設定画面に、撮像装置20と被写体との距離を設定する項目を設け、その項目で設定された距離に応じて構図ガイドエリアの大きさを変化させるようにしてもよい。
Thus, the position and size of the composition guide area are determined according to the composition setting and the number of subjects to be photographed. The size of the composition guide area can be roughly determined by the specifications of the lens of the optical module 30 and the distance (arm length) when the image pickup apparatus 20 is held in hand and pointed at itself. In order to cope with the case where the self-portrait is attached to the self-portrait stick and the self-portrait is taken from a slightly distant position, the distance between the image pickup apparatus 20 and the subject is displayed on the self-portrait setting screen illustrated in FIG. 4A. An item to be set may be provided, and the size of the composition guide area may be changed according to the distance set by the item.
図7は、本発明の第1の実施形態における撮像装置の処理の流れの一例を示すフローチャートである。
図7を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の撮像装置20の処理について説明する。
まず、ユーザが撮像装置20の電源をONにする。すると、撮像装置20が起動し、撮像機能を発揮するのに必要な初期処理を行う。次に、撮像装置20の第2の通信部25が、撮像指示装置10に対して通信を開始し、無線通信で接続する(ステップS11)。これにより、撮像指示装置10からの自分撮り撮影開始指示情報を受信できるようになる。次に、光学モジュール30が電動ズームレンズを備えている場合、光学モジュール30の制御装置は、撮影時のズーム調整の便宜のためズームをワイド側に駆動する(ステップS12)。これらの準備処理が完了すると、撮像装置20は、撮像指示装置10からの自分撮り撮影指示を待機する(ステップS13)。 FIG. 7 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention.
With reference to FIG. 7, processing of theimaging apparatus 20 when performing a self-portrait using the imaging system 1 of the present embodiment will be described.
First, the user turns on the power of theimaging device 20. Then, the imaging device 20 is activated and performs initial processing necessary to exhibit the imaging function. Next, the 2nd communication part 25 of the imaging device 20 starts communication with respect to the imaging instruction | indication apparatus 10, and connects by wireless communication (step S11). Thereby, it is possible to receive the self-portrait start instruction information from the image pickup instruction device 10. Next, when the optical module 30 includes an electric zoom lens, the control device of the optical module 30 drives the zoom to the wide side for the convenience of zoom adjustment at the time of shooting (step S12). When these preparation processes are completed, the imaging device 20 waits for a self-portrait shooting instruction from the imaging instruction device 10 (step S13).
図7を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の撮像装置20の処理について説明する。
まず、ユーザが撮像装置20の電源をONにする。すると、撮像装置20が起動し、撮像機能を発揮するのに必要な初期処理を行う。次に、撮像装置20の第2の通信部25が、撮像指示装置10に対して通信を開始し、無線通信で接続する(ステップS11)。これにより、撮像指示装置10からの自分撮り撮影開始指示情報を受信できるようになる。次に、光学モジュール30が電動ズームレンズを備えている場合、光学モジュール30の制御装置は、撮影時のズーム調整の便宜のためズームをワイド側に駆動する(ステップS12)。これらの準備処理が完了すると、撮像装置20は、撮像指示装置10からの自分撮り撮影指示を待機する(ステップS13)。 FIG. 7 is a flowchart illustrating an example of a processing flow of the imaging apparatus according to the first embodiment of the present invention.
With reference to FIG. 7, processing of the
First, the user turns on the power of the
次に、ユーザが、図4Bで例示した自分撮り指示画面にて自分撮り実行指示ボタン111~114のうち何れかを押下すると、撮像装置20の第2の通信部25は、どの自分撮り実行指示ボタンが押下されたかを示す情報、自分撮り処理の開始を指示する自分撮り撮影開始指示情報、画像処理設定欄105の設定内容を撮像指示装置10から受信する(ステップS14)。第2の通信部25は、受信した情報を制御部24へ出力する。
Next, when the user presses any one of the selfie execution instruction buttons 111 to 114 on the selfie instruction screen illustrated in FIG. 4B, the second communication unit 25 of the imaging device 20 determines which selfie execution instruction. Information indicating whether the button has been pressed, self-shooting start instruction information for instructing the start of self-portrait processing, and setting contents in the image processing setting field 105 are received from the image pickup instruction device 10 (step S14). The second communication unit 25 outputs the received information to the control unit 24.
次に、振動検出部22は、撮像装置20の揺れの情報(例えば、図5で説明したX軸、Y軸方向の揺れの大きさ)を検出する(ステップS15)。振動検出部22は、検出した揺れの情報とその揺れを検出した時刻の情報とを組にして第2の通信部25へ出力する。
Next, the vibration detection unit 22 detects information on the shaking of the imaging device 20 (for example, the magnitude of shaking in the X-axis and Y-axis directions described in FIG. 5) (step S15). The vibration detection unit 22 sets the detected shake information and the information on the time when the shake is detected as a set and outputs the set to the second communication unit 25.
次に、制御部24は、自分撮り処理の開始を指示する情報を取得すると、画像処理部23に顔画像の検出を指示する。また、制御部24は、どの自分撮り実行指示ボタンが押下されたかを示す情報に基づいて検出すべき人数の情報を画像処理部23に出力する。画像処理部23は、撮像部21から対象を撮影したセンサ出力画像を取得し、画像認識によりセンサ出力画像に写る顔画像を認識する。画像処理部23は、顔画像が写ったと認識した例えば矩形の領域を特定する。画像処理部23は、特定した領域の中心位置(顔画像の中心)のセンサ出力画像における座標情報を算出する(ステップS16)。ここで、画像処理部23は、各顔画像について特定した矩形領域の面積が大きい方から順に人数の情報分選択し、選択した領域の中心位置の座標情報を算出してもよい。あるいは、画像処理部23は、各顔画像について特定した矩形領域の面積が所定の大きさ以上の顔画像を選択し、選択した領域の中心位置の座標情報を算出してもよい。画像処理部23は、算出した顔画像の座標情報(顔画像の中心の座標情報と各顔に対応する矩形領域の頂点の座標情報)を第2の通信部25に出力する。制御部24は、揺れの情報(X軸、Y軸方向の揺れの大きさとその揺れを検出した時刻)と、顔画像の座標情報を、第2の通信部25を介して撮像指示装置10へ送信するよう制御する。第2の通信部25は、揺れの情報と、顔画像の座標情報を撮像指示装置10へ送信する(ステップS17)。なお、顔画像の座標情報について、撮像装置20では、顔に対応する矩形領域の頂点の座標情報を検出して撮像指示装置10へ送信し、撮像指示装置10では、撮影条件判定部13が顔画像の中心の座標情報を算出してもよい。
Next, when the control unit 24 acquires information instructing the start of the self-portrait process, the control unit 24 instructs the image processing unit 23 to detect a face image. Further, the control unit 24 outputs information on the number of persons to be detected to the image processing unit 23 based on information indicating which self-shot execution instruction button has been pressed. The image processing unit 23 acquires a sensor output image obtained by photographing the target from the imaging unit 21, and recognizes a face image that appears in the sensor output image by image recognition. The image processing unit 23 identifies, for example, a rectangular area recognized as having a face image. The image processing unit 23 calculates coordinate information in the sensor output image at the center position of the identified area (the center of the face image) (step S16). Here, the image processing unit 23 may select information corresponding to the number of people in descending order of the area of the rectangular area specified for each face image, and calculate the coordinate information of the center position of the selected area. Alternatively, the image processing unit 23 may select a face image in which the area of the rectangular area specified for each face image is equal to or larger than a predetermined size, and calculate coordinate information of the center position of the selected area. The image processing unit 23 outputs the calculated coordinate information of the face image (the coordinate information of the center of the face image and the coordinate information of the vertex of the rectangular area corresponding to each face) to the second communication unit 25. The control unit 24 sends the shake information (the magnitude of the shake in the X-axis and Y-axis directions and the time when the shake is detected) and the coordinate information of the face image to the imaging instruction apparatus 10 via the second communication unit 25. Control to send. The second communication unit 25 transmits the shake information and the coordinate information of the face image to the imaging instruction device 10 (step S17). As for the coordinate information of the face image, the imaging device 20 detects the coordinate information of the vertices of the rectangular area corresponding to the face and transmits it to the imaging instruction device 10. The coordinate information of the center of the image may be calculated.
撮像指示装置10は、受信した揺れの情報、顔画像の座標情報に基づいて撮影準備が整ったかどうかを判定し、撮影準備が整ったと判定してから所定の時間が経過すると撮像指示情報を撮像装置20に送信する。また、ユーザが自分撮りの中止を指示する操作を行うと、撮像指示装置10は中止指示情報を撮像装置20に送信する。
すると、制御部24は、第2の通信部25を介して撮像指示装置10から撮影指示情報または中止指示情報を受信する(ステップS18)。撮影指示情報を受信した場合(ステップS19;Yes)、制御部24は撮像部21に撮影指示を行い、撮像部21は撮影を実行する(ステップS192)。撮像部21は、撮影したセンサ出力画像を画像処理部23へ出力する。画像処理部23はセンサ出力画像から静止画記録用撮影画像を生成する。次に制御部24は、撮影画像(静止画記録用撮影画像)を送信するか否かを判定する(ステップS193)。制御部24は、撮影後に静止画記録用撮影画像を送信するか否かの設定に従って静止画記録用撮影画像の送信をするか否かを判定する。撮影後に静止画記録用撮影画像を送信するか否かの設定とは、例えば、レックビュー設定欄106の設定である。レックビュー設定欄106で「ON」が設定されている場合、制御部24は、撮影画像を送信すると判定する。撮影画像を送信すると判定した場合(ステップS193;Yes)、制御部24は、撮影画像(静止画記録用撮影画像)を第2の通信部25を介して撮像指示装置10へ送信するように制御する。第2の通信部25は、撮影画像(静止画記録用撮影画像)を撮像指示装置10へ送信する。撮影画像を送信しないと判定した場合(ステップS193;No)、本処理フローを終了する。
一方、撮影指示情報を受信しなかった場合(ステップS19;No)、制御部24は、撮影中止かどうかを判定する(ステップS191)。具体的には、中止指示情報を受信した場合、制御部24は、自分撮り処理の中止を決定し、本処理フローを終了する。 Theimaging instruction device 10 determines whether or not the imaging preparation is ready based on the received shake information and the coordinate information of the face image, and captures the imaging instruction information when a predetermined time elapses after determining that the imaging preparation is ready. Transmit to device 20. In addition, when the user performs an operation for instructing to cancel the self-portrait, the imaging instruction apparatus 10 transmits stop instruction information to the imaging apparatus 20.
Then, thecontrol unit 24 receives shooting instruction information or stop instruction information from the imaging instruction device 10 via the second communication unit 25 (step S18). When the imaging instruction information is received (step S19; Yes), the control unit 24 instructs the imaging unit 21 to perform imaging, and the imaging unit 21 performs imaging (step S192). The imaging unit 21 outputs the captured sensor output image to the image processing unit 23. The image processing unit 23 generates a still image recording captured image from the sensor output image. Next, the control unit 24 determines whether or not to transmit a captured image (still image recording captured image) (step S193). The control unit 24 determines whether to transmit the still image recording captured image according to the setting of whether to transmit the still image recording captured image after capturing. The setting as to whether or not to send a still image recording shot image after shooting is, for example, a setting in the REC view setting field 106. When “ON” is set in the REC view setting field 106, the control unit 24 determines to transmit a captured image. When it is determined to transmit the captured image (step S193; Yes), the control unit 24 controls to transmit the captured image (still image recording captured image) to the imaging instruction apparatus 10 via the second communication unit 25. To do. The second communication unit 25 transmits the shot image (still image recording shot image) to the imaging instruction device 10. If it is determined that the captured image is not transmitted (step S193; No), this processing flow ends.
On the other hand, when the shooting instruction information is not received (step S19; No), thecontrol unit 24 determines whether or not shooting is stopped (step S191). Specifically, when the cancel instruction information is received, the control unit 24 determines to cancel the self-portrait process and ends the present process flow.
すると、制御部24は、第2の通信部25を介して撮像指示装置10から撮影指示情報または中止指示情報を受信する(ステップS18)。撮影指示情報を受信した場合(ステップS19;Yes)、制御部24は撮像部21に撮影指示を行い、撮像部21は撮影を実行する(ステップS192)。撮像部21は、撮影したセンサ出力画像を画像処理部23へ出力する。画像処理部23はセンサ出力画像から静止画記録用撮影画像を生成する。次に制御部24は、撮影画像(静止画記録用撮影画像)を送信するか否かを判定する(ステップS193)。制御部24は、撮影後に静止画記録用撮影画像を送信するか否かの設定に従って静止画記録用撮影画像の送信をするか否かを判定する。撮影後に静止画記録用撮影画像を送信するか否かの設定とは、例えば、レックビュー設定欄106の設定である。レックビュー設定欄106で「ON」が設定されている場合、制御部24は、撮影画像を送信すると判定する。撮影画像を送信すると判定した場合(ステップS193;Yes)、制御部24は、撮影画像(静止画記録用撮影画像)を第2の通信部25を介して撮像指示装置10へ送信するように制御する。第2の通信部25は、撮影画像(静止画記録用撮影画像)を撮像指示装置10へ送信する。撮影画像を送信しないと判定した場合(ステップS193;No)、本処理フローを終了する。
一方、撮影指示情報を受信しなかった場合(ステップS19;No)、制御部24は、撮影中止かどうかを判定する(ステップS191)。具体的には、中止指示情報を受信した場合、制御部24は、自分撮り処理の中止を決定し、本処理フローを終了する。 The
Then, the
On the other hand, when the shooting instruction information is not received (step S19; No), the
なお、ユーザによる所定の指示操作により、画像処理部23がセンサ出力画像から低解像度一時画像を生成し、撮像装置20が低解像度一時画像を撮像指示装置10へ送信してもよい。また、その場合、撮像指示装置10では、表示制御部19が、受信した低解像度一次画像からライブ画像を生成し、入出力部11がライブ画像を表示するようにしてもよい。これによって、ユーザはライブ画像を確認しながら自分撮りを行うこともできる。
The image processing unit 23 may generate a low-resolution temporary image from the sensor output image and the imaging device 20 may transmit the low-resolution temporary image to the imaging instruction device 10 by a predetermined instruction operation by the user. In this case, in the imaging instruction device 10, the display control unit 19 may generate a live image from the received low-resolution primary image, and the input / output unit 11 may display the live image. This allows the user to take a selfie while checking the live image.
図8は、本発明の第1の実施形態における撮像指示装置の処理の流れの一例を示す第1のフローチャートである。
図8を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の撮像指示装置10の処理について説明する。
前提として、撮像指示装置10の入出力部11において図4Bで例示した自分撮り指示画面が表示されており、ユーザが自分撮り実行指示ボタン111~114のうち何れかを押下したとする。入出力部11は、どのボタンが押されたかを示す情報を撮影条件判定部13へ出力する。また、第1の通信部17は、どの自分撮り実行指示ボタンが押下されたかを示す情報などを撮像装置20へ送信する。図7のフローチャートで説明したとおり、撮像装置20は、揺れの情報や顔画像の座標情報を撮像指示装置10へ送信する。 FIG. 8 is a first flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
With reference to FIG. 8, processing of theimaging instruction apparatus 10 when taking a self-portrait using the imaging system 1 of the present embodiment will be described.
As a premise, it is assumed that the self-portrait instruction screen illustrated in FIG. 4B is displayed on the input /output unit 11 of the image-capturing instruction apparatus 10 and the user presses one of the self-portrait execution instruction buttons 111 to 114. The input / output unit 11 outputs information indicating which button has been pressed to the imaging condition determination unit 13. In addition, the first communication unit 17 transmits information indicating which self-shoot execution instruction button has been pressed to the imaging device 20. As described with reference to the flowchart of FIG. 7, the imaging device 20 transmits shake information and face image coordinate information to the imaging instruction device 10.
図8を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の撮像指示装置10の処理について説明する。
前提として、撮像指示装置10の入出力部11において図4Bで例示した自分撮り指示画面が表示されており、ユーザが自分撮り実行指示ボタン111~114のうち何れかを押下したとする。入出力部11は、どのボタンが押されたかを示す情報を撮影条件判定部13へ出力する。また、第1の通信部17は、どの自分撮り実行指示ボタンが押下されたかを示す情報などを撮像装置20へ送信する。図7のフローチャートで説明したとおり、撮像装置20は、揺れの情報や顔画像の座標情報を撮像指示装置10へ送信する。 FIG. 8 is a first flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
With reference to FIG. 8, processing of the
As a premise, it is assumed that the self-portrait instruction screen illustrated in FIG. 4B is displayed on the input /
すると、撮像指示装置10の第1の通信部17が、撮像装置20から揺れの情報(X軸、Y軸方向の揺れの大きさとその揺れを検出した時刻)と顔画像の座標情報(顔画像の中心の座標情報と顔画像の矩形領域の座標情報のうち少なくとも一方)とを受信する(ステップS20)。第1の通信部17は受信した揺れの情報と顔画像の座標情報とをメモリ16に記録する。
次に、撮影条件判定部13がメモリ16から揺れの情報と顔画像の座標情報とを読み出して撮影条件を判定する(ステップS21)。まず、撮影条件判定部13は、揺れの情報について式(1)によって時刻tにおいて揺れが収まったかどうかを判定する。そして、撮影条件判定部13は、所定の時間に渡って継続的に揺れが収まったと判定すると、撮像装置20に揺れの大きさに関する撮影条件を満たしたと判定する。 Then, thefirst communication unit 17 of the imaging instruction apparatus 10 detects shaking information (the magnitude of the shaking in the X-axis and Y-axis directions and the time when the shaking is detected) and the coordinate information (face image) of the face image. At least one of the coordinate information of the center of the face and the coordinate information of the rectangular area of the face image is received (step S20). The first communication unit 17 records the received shake information and face image coordinate information in the memory 16.
Next, the shootingcondition determination unit 13 reads the shake information and the coordinate information of the face image from the memory 16 and determines the shooting condition (step S21). First, the imaging condition determination unit 13 determines whether or not the shaking is settled at time t according to Equation (1) for the shaking information. Then, when the shooting condition determination unit 13 determines that the shaking has been continuously stopped for a predetermined time, the shooting condition determination unit 13 determines that the shooting condition regarding the magnitude of the shaking is satisfied in the imaging device 20.
次に、撮影条件判定部13がメモリ16から揺れの情報と顔画像の座標情報とを読み出して撮影条件を判定する(ステップS21)。まず、撮影条件判定部13は、揺れの情報について式(1)によって時刻tにおいて揺れが収まったかどうかを判定する。そして、撮影条件判定部13は、所定の時間に渡って継続的に揺れが収まったと判定すると、撮像装置20に揺れの大きさに関する撮影条件を満たしたと判定する。 Then, the
Next, the shooting
また、撮影条件判定部13は、メモリ16からユーザが図4Aで例示した自分撮り設定画面で設定した構図設定情報を読み出す。撮影条件判定部13は、読み出した構図設定情報と入出力部11から取得したどのボタンが押下されたかを示す情報に対応する撮影対象の人数とに基づいて、その構図設定情報と人数に対応した構図ガイドエリアの領域を規定する座標情報をメモリ16から読み出す。撮影条件判定部13は、取得した顔画像の座標情報の数と撮影対象の人数を比較する。座標情報の数と撮影対象の人数が等しい場合、撮影条件判定部13は、被写体の状態に関する第1の条件を満たしていると判定する。また、撮影条件判定部13は、取得した顔画像の座標情報の全てがメモリ16から読み出した構図ガイドエリアに含まれるかどうかを判定する。取得した顔画像の座標情報の全てが構図ガイドエリアに含まれる場合、撮影条件判定部13は、被写体の状態に関する第2の条件を満たしていると判定する。この2つの条件を満たす場合、撮影条件判定部13は、被写体の状態に対する撮影条件を満たしたと判定する。
撮影条件判定部13は、撮像装置20に揺れの大きさに関する撮影条件と被写体の状態に対する撮影条件を共に満たした場合、撮影条件を満たしたと判定する。あるいは、撮影条件判定部13は、撮像装置20に揺れの大きさに関する撮影条件と被写体の状態に対する撮影条件とのうちどちらか一方を満たした場合、撮影条件を満たしたと判定してもよい。 In addition, the shootingcondition determination unit 13 reads the composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the memory 16. The photographing condition determination unit 13 corresponds to the composition setting information and the number of persons based on the read composition setting information and the number of subjects to be photographed corresponding to the information indicating which button acquired from the input / output unit 11 is pressed. Coordinate information defining the composition guide area is read from the memory 16. The shooting condition determination unit 13 compares the number of coordinate information of the acquired face image with the number of shooting targets. When the number of coordinate information is equal to the number of subjects to be photographed, the photographing condition determination unit 13 determines that the first condition regarding the state of the subject is satisfied. Further, the photographing condition determination unit 13 determines whether or not all of the acquired coordinate information of the face image is included in the composition guide area read from the memory 16. When all the coordinate information of the acquired face image is included in the composition guide area, the imaging condition determination unit 13 determines that the second condition relating to the state of the subject is satisfied. When these two conditions are satisfied, the shooting condition determination unit 13 determines that the shooting conditions for the state of the subject are satisfied.
The imagingcondition determination unit 13 determines that the imaging condition is satisfied when the imaging apparatus 20 satisfies both the imaging condition related to the magnitude of shaking and the imaging condition for the subject state. Alternatively, the imaging condition determination unit 13 may determine that the imaging condition is satisfied when the imaging device 20 satisfies either the imaging condition regarding the magnitude of shaking or the imaging condition for the state of the subject.
撮影条件判定部13は、撮像装置20に揺れの大きさに関する撮影条件と被写体の状態に対する撮影条件を共に満たした場合、撮影条件を満たしたと判定する。あるいは、撮影条件判定部13は、撮像装置20に揺れの大きさに関する撮影条件と被写体の状態に対する撮影条件とのうちどちらか一方を満たした場合、撮影条件を満たしたと判定してもよい。 In addition, the shooting
The imaging
ステップS21で撮影条件を満たしたと判定した場合(ステップS22;Yes)、撮影条件判定部13は、撮影準備が整ったことを示す情報を通知制御部14と第1のタイマ部18へ出力する。
When it is determined in step S21 that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the shooting preparation is complete to the notification control unit 14 and the first timer unit 18.
次に、通知制御部14は、ユーザに撮影準備が完了したことを通知する(ステップS23)。例えば、通知制御部14は、撮像指示装置10に備えられた振動モータなどの振動モジュールを動作させて撮像指示装置10の筐体を振動させ、撮像指示装置10を把持するユーザに撮影の準備が整ったことを通知する。あるいは、通知制御部14は、撮像指示装置10に備えられた音声出力モジュールを動作させてスピーカから所定の音声を出力させ、撮像指示装置10を把持するユーザに撮影の準備が整ったことを通知する。なお、所定の音声とは、図4Aで例示した自分撮り設定画面のサウンド設定欄103の「カウントダウン開始時」で設定した音声である。
Next, the notification control unit 14 notifies the user that the preparation for photographing has been completed (step S23). For example, the notification control unit 14 operates a vibration module such as a vibration motor provided in the imaging instruction device 10 to vibrate the housing of the imaging instruction device 10, and the user who holds the imaging instruction device 10 prepares for shooting. Notify that it is ready. Alternatively, the notification control unit 14 operates a voice output module provided in the imaging instruction device 10 to output a predetermined sound from the speaker, and notifies the user who holds the imaging instruction device 10 that preparation for shooting is completed. To do. The predetermined voice is a voice set in “when countdown starts” in the sound setting field 103 of the selfie setting screen illustrated in FIG. 4A.
次に第1のタイマ部18は、撮影タイマをスタートする(ステップS24)。第1のタイマ部18は、自分撮り設定画面のタイマ設定欄102で設定した時間が経過するまで時間を計時する。設定した撮影待ち時間が経過すると、第1のタイマ部18は、撮影タイマを停止する(ステップS25)。次に第1のタイマ部18は、設定時間が経過したことを示す情報を通知制御部14と撮影指示部15に出力する。
次に通知制御部14は、ユーザに撮影のタイミングで通知を行う(ステップS26)。例えば、通知制御部14は、撮像指示装置10を振動させたり、音声を出力させたりする。なお、出力させる音声は図4Aのサウンド設定欄103の「撮影時」で設定した音声である。また、例えば図4Aのように撮影時のサウンド設定で「None」を設定した場合は、ステップS26の処理をスキップするようにしてもよい。 Next, thefirst timer unit 18 starts a shooting timer (step S24). The first timer unit 18 measures the time until the time set in the timer setting field 102 of the selfie setting screen has elapsed. When the set shooting waiting time elapses, the first timer unit 18 stops the shooting timer (step S25). Next, the first timer unit 18 outputs information indicating that the set time has elapsed to the notification control unit 14 and the imaging instruction unit 15.
Next, thenotification control unit 14 notifies the user at the shooting timing (step S26). For example, the notification control unit 14 vibrates the imaging instruction device 10 or outputs a sound. Note that the sound to be output is the sound set in “during shooting” of the sound setting field 103 in FIG. 4A. Further, for example, when “None” is set in the sound setting at the time of shooting as shown in FIG. 4A, the processing in step S26 may be skipped.
次に通知制御部14は、ユーザに撮影のタイミングで通知を行う(ステップS26)。例えば、通知制御部14は、撮像指示装置10を振動させたり、音声を出力させたりする。なお、出力させる音声は図4Aのサウンド設定欄103の「撮影時」で設定した音声である。また、例えば図4Aのように撮影時のサウンド設定で「None」を設定した場合は、ステップS26の処理をスキップするようにしてもよい。 Next, the
Next, the
通知制御部14による撮影時の通知と並行して、撮影指示部15は、第1の通信部17を介して、撮像装置20へ撮影指示情報を送信する(ステップS27)。撮像装置20では、第2の通信部25が撮影指示情報を受信して、制御部24へ出力する。制御部24は撮像部21に撮影指示を行い、撮像部21は撮影を実行する。撮像部21は、撮影したセンサ出力画像を画像処理部23へ出力する。画像処理部23は、センサ出力画像に対して画像処理設定欄105の設定内容に応じた画像処理を行い、画像処理後の静止画記録用撮影画像を生成する。図7で説明したように撮影画像を送信する設定がなされている場合(例えば、レックビュー設定欄106で「ON」が設定されている場合)、画像処理部23は、静止画記録用撮影画像を第2の通信部25へ出力する。第2の通信部25は、静止画記録用撮影画像を撮像指示装置10へ送信する。撮像指示装置10では、第1の通信部17が撮影画像(静止画記録用撮影画像)を受信し(ステップS271)、メモリ16に記録する。レックビュー設定欄106で「ON」が設定されている場合、表示制御部19は、メモリ16から静止画記録用撮影画像を読み出してレックビュー画像を生成し、レックビュー画像を入出力部11に出力する。入出力部11は、撮影画像(レックビュー画像)を表示する(ステップS272)。
In parallel with the notification at the time of shooting by the notification control unit 14, the shooting instruction unit 15 transmits shooting instruction information to the imaging device 20 via the first communication unit 17 (step S27). In the imaging device 20, the second communication unit 25 receives the imaging instruction information and outputs it to the control unit 24. The control unit 24 instructs the imaging unit 21 to perform shooting, and the imaging unit 21 executes shooting. The imaging unit 21 outputs the captured sensor output image to the image processing unit 23. The image processing unit 23 performs image processing corresponding to the setting contents of the image processing setting field 105 on the sensor output image, and generates a captured image for still image recording after image processing. As described with reference to FIG. 7, when the setting for transmitting the captured image is made (for example, when “ON” is set in the REC view setting field 106), the image processing unit 23 captures the captured image for still image recording. Is output to the second communication unit 25. The second communication unit 25 transmits the captured image for still image recording to the imaging instruction device 10. In the imaging instruction apparatus 10, the first communication unit 17 receives a captured image (still image recording captured image) (step S <b> 271) and records it in the memory 16. When “ON” is set in the REC view setting field 106, the display control unit 19 reads out the still image recording captured image from the memory 16 to generate a REC view image, and the REC view image is input to the input / output unit 11. Output. The input / output unit 11 displays a captured image (rec view image) (step S272).
一方、ステップS21で撮影条件を満たしていないと判定した場合(ステップS22;No)、入出力部11は、ユーザによる自分撮り中止指示操作が行われるかどうかを監視する(ステップS28)。例えば、ユーザがハードボタン120を押下すると、入出力部11は、自分撮り中止指示操作が行われたと判定する。入出力部11が自分撮り中止指示操作を検出した場合(ステップS28;Yes)、入出力部11は、中止指示情報を撮影条件判定部13に出力する。撮影条件判定部13は、第1のタイマ部18にタイマの停止を指示し、自分撮り処理を終了する。このとき、通知制御部14が撮影を中止する通知を行ってもよい。入出力部11が自分撮り中止指示操作を検出しない場合(ステップS28;No)、撮影条件を満たすまでステップS20からの処理を繰り返す。
On the other hand, if it is determined in step S21 that the shooting conditions are not satisfied (step S22; No), the input / output unit 11 monitors whether or not a self-shooting stop operation is performed by the user (step S28). For example, when the user presses the hard button 120, the input / output unit 11 determines that a self-shooting instruction operation has been performed. When the input / output unit 11 detects a self-shooting stop instruction operation (step S <b> 28; Yes), the input / output unit 11 outputs stop instruction information to the imaging condition determination unit 13. The shooting condition determination unit 13 instructs the first timer unit 18 to stop the timer, and ends the self-portrait process. At this time, the notification control unit 14 may make a notification to stop shooting. When the input / output unit 11 does not detect the self-shooting stop instruction operation (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
なお、ステップS21の撮影条件判定において、撮像装置20の揺れの大きさによる判定だけで撮影条件が整ったかどうかを判定してもよい。あるいは、被写体の状態による判定だけで撮影条件が整ったかどうかを判定してもよい。
また、画像処理部23が顔認識処理によって被写体の笑顔を検出し、ステップS22の撮影条件判定に加えて、被写体の笑顔を検出すると撮影タイマを開始し、撮影を実行するようにしてもよい。より具体的には、画像処理部23が、顔画像の座標情報と対応付けてその顔画像の被写体が笑顔かどうかを示す情報を第2の通信部25へ出力する。第2の通信部25は、それらの情報を撮像指示装置10へ送信する。撮像指示装置10では、撮影条件判定部13が、第1の通信部17を介して被写体が笑顔かどうかを示す情報などを取得する。撮影条件判定部13は、ステップS21の判定条件に加えて、例えば、全ての被写体が笑顔である場合に撮影条件を満たすと判定する。なお、笑顔かどうかを判定に加える場合、笑顔を長時間維持しなくてよいように、撮影待ち時間を短くする(例えば0.5秒など)構成としてもよい。 Note that, in the shooting condition determination in step S21, it may be determined whether the shooting conditions are satisfied only by the determination based on the magnitude of the shaking of theimaging device 20. Alternatively, it may be determined whether or not the shooting conditions are satisfied only by determination based on the state of the subject.
Further, theimage processing unit 23 may detect the smiling face of the subject by the face recognition process, and in addition to the shooting condition determination in step S22, when the smiling face of the subject is detected, the shooting timer may be started to execute shooting. More specifically, the image processing unit 23 outputs to the second communication unit 25 information indicating whether the subject of the face image is a smile in association with the coordinate information of the face image. The second communication unit 25 transmits the information to the imaging instruction device 10. In the imaging instruction apparatus 10, the imaging condition determination unit 13 acquires information indicating whether or not the subject is smiling via the first communication unit 17. In addition to the determination condition in step S21, the shooting condition determination unit 13 determines that the shooting condition is satisfied, for example, when all subjects are smiling. In addition, when adding whether it is a smile to a determination, it is good also as a structure which shortens imaging | photography waiting time (for example, 0.5 second etc.) so that a smile may not be maintained for a long time.
また、画像処理部23が顔認識処理によって被写体の笑顔を検出し、ステップS22の撮影条件判定に加えて、被写体の笑顔を検出すると撮影タイマを開始し、撮影を実行するようにしてもよい。より具体的には、画像処理部23が、顔画像の座標情報と対応付けてその顔画像の被写体が笑顔かどうかを示す情報を第2の通信部25へ出力する。第2の通信部25は、それらの情報を撮像指示装置10へ送信する。撮像指示装置10では、撮影条件判定部13が、第1の通信部17を介して被写体が笑顔かどうかを示す情報などを取得する。撮影条件判定部13は、ステップS21の判定条件に加えて、例えば、全ての被写体が笑顔である場合に撮影条件を満たすと判定する。なお、笑顔かどうかを判定に加える場合、笑顔を長時間維持しなくてよいように、撮影待ち時間を短くする(例えば0.5秒など)構成としてもよい。 Note that, in the shooting condition determination in step S21, it may be determined whether the shooting conditions are satisfied only by the determination based on the magnitude of the shaking of the
Further, the
図9は、本発明の第1の実施形態における撮像指示装置の処理の流れの一例を示す第2のフローチャートである。
図9を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の撮像指示装置10の処理の別の形態について説明する。
前提条件などは、図8のフローチャートの場合と同様である。図8のフローチャートと同様の処理については、簡単に説明を行う。
まず、第1の通信部17が撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS20)。次に撮影条件判定部13は、第1の通信部17から揺れの情報と顔画像の座標情報とを取得する。次に、撮影条件判定部13が撮影条件を判定する(ステップS21)。撮影条件を満たしたと判定した場合(ステップS22;Yes)、通知制御部14は、ユーザに撮影準備完了通知を行う(ステップS23)。また、第1のタイマ部18は、撮影タイマをスタートする(ステップS24)。 FIG. 9 is a second flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
With reference to FIG. 9, another form of processing of theimaging instruction apparatus 10 when performing a self-portrait using the imaging system 1 of the present embodiment will be described.
The preconditions are the same as those in the flowchart of FIG. Processing similar to that in the flowchart of FIG. 8 will be briefly described.
First, thefirst communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20). Next, the imaging condition determination unit 13 acquires shake information and face image coordinate information from the first communication unit 17. Next, the shooting condition determination unit 13 determines shooting conditions (step S21). When it is determined that the shooting conditions are satisfied (step S22; Yes), the notification control unit 14 notifies the user of the completion of shooting preparation (step S23). Further, the first timer unit 18 starts a shooting timer (step S24).
図9を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の撮像指示装置10の処理の別の形態について説明する。
前提条件などは、図8のフローチャートの場合と同様である。図8のフローチャートと同様の処理については、簡単に説明を行う。
まず、第1の通信部17が撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS20)。次に撮影条件判定部13は、第1の通信部17から揺れの情報と顔画像の座標情報とを取得する。次に、撮影条件判定部13が撮影条件を判定する(ステップS21)。撮影条件を満たしたと判定した場合(ステップS22;Yes)、通知制御部14は、ユーザに撮影準備完了通知を行う(ステップS23)。また、第1のタイマ部18は、撮影タイマをスタートする(ステップS24)。 FIG. 9 is a second flowchart illustrating an example of a processing flow of the imaging instruction apparatus according to the first embodiment of the present invention.
With reference to FIG. 9, another form of processing of the
The preconditions are the same as those in the flowchart of FIG. Processing similar to that in the flowchart of FIG. 8 will be briefly described.
First, the
図9のフローチャートの場合、タイマ開始後も撮影条件判定部13が、撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS201)。ステップS201の処理は、ステップS20と同様である。
次に、撮影条件判定部13が撮影キャンセル条件を判定する(ステップS211)。ステップS211の判定では、ステップS21と同様に撮像装置20の揺れの大きさや被写体の状態によって撮影キャンセル条件の判定を行ってもよい。例えば、撮影条件判定部13は、式(1)を用いて撮像装置20の揺れが所定の範囲に収まっていないと判定すると撮像装置20に揺れの大きさに関する撮影キャンセル条件が成立したと判定する。あるいは、撮影条件判定部13は、所定の時間における揺れが式(1)を満たさない回数が閾値以上となると撮像装置20に揺れの大きさに関する撮影キャンセル条件が成立したと判定する。 In the case of the flowchart of FIG. 9, even after the timer is started, the imagingcondition determination unit 13 receives the shake information and the coordinate information of the face image from the imaging device 20 (step S201). The process of step S201 is the same as that of step S20.
Next, the shootingcondition determination unit 13 determines shooting cancellation conditions (step S211). In the determination in step S211, the shooting cancellation condition may be determined based on the magnitude of shaking of the imaging device 20 and the state of the subject, as in step S21. For example, if the imaging condition determination unit 13 determines that the shaking of the imaging device 20 is not within a predetermined range using Expression (1), the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20. . Alternatively, the imaging condition determination unit 13 determines that the imaging cancellation condition regarding the magnitude of the shaking is satisfied in the imaging device 20 when the number of times that the shaking in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
次に、撮影条件判定部13が撮影キャンセル条件を判定する(ステップS211)。ステップS211の判定では、ステップS21と同様に撮像装置20の揺れの大きさや被写体の状態によって撮影キャンセル条件の判定を行ってもよい。例えば、撮影条件判定部13は、式(1)を用いて撮像装置20の揺れが所定の範囲に収まっていないと判定すると撮像装置20に揺れの大きさに関する撮影キャンセル条件が成立したと判定する。あるいは、撮影条件判定部13は、所定の時間における揺れが式(1)を満たさない回数が閾値以上となると撮像装置20に揺れの大きさに関する撮影キャンセル条件が成立したと判定する。 In the case of the flowchart of FIG. 9, even after the timer is started, the imaging
Next, the shooting
また、撮影条件判定部13は、撮影対象となる被写体が移動し、被写体の顔画像の座標情報のうち1つでも構図ガイドエリアの領域を外れると、被写体の状態に関する撮影キャンセル条件が成立したと判定する。あるいは、撮像装置20で画像処理部23が、所定の大きさ以上の面積を有する顔画像を選択し、選択した顔画像についての中心点の座標情報などを送信してくる場合、撮影条件判定部13は、撮影対象となる被写体の数が増減し、ユーザが指定した撮影対象の人数と異なると、被写体の状態に関する撮影キャンセル条件が成立したと判定する。撮影条件判定部13は、撮像装置20の揺れの大きさと被写体の状態とのうち、どちらか一方に関する撮影キャンセル条件が成立しただけで撮影キャンセル条件が成立したと判定してもよいし、揺れの大きさに関する撮影キャンセル条件と被写体の状態に関する撮影キャンセル条件の両方が成立したときに撮影キャンセル条件が成立したと判定してもよい。また、ステップS21において被写体の笑顔を判定条件に加えた場合、例えば被写体のうち誰か一人が笑顔でなくなったら撮影キャンセル条件が成立したと判定してもよい。
撮影キャンセル条件が成立した場合、撮影条件判定部13は、撮影を中止することを決定する。 Further, the shootingcondition determination unit 13 determines that the shooting cancel condition regarding the state of the subject is satisfied when the subject to be shot moves and even one of the coordinate information of the face image of the subject leaves the composition guide area. judge. Alternatively, when the image processing unit 23 in the imaging device 20 selects a face image having an area of a predetermined size or larger and transmits coordinate information of the center point of the selected face image, the shooting condition determination unit 13, when the number of subjects to be photographed increases or decreases and differs from the number of subjects to be photographed designated by the user, it is determined that a photographing cancellation condition regarding the state of the subject is satisfied. The imaging condition determination unit 13 may determine that the imaging cancellation condition is satisfied only by satisfying the imaging cancellation condition for either one of the magnitude of the shaking of the imaging device 20 and the state of the subject, It may be determined that the shooting cancel condition is satisfied when both the shooting cancel condition regarding the size and the shooting cancel condition regarding the state of the subject are satisfied. In addition, when the subject's smile is added to the determination condition in step S21, for example, it may be determined that the shooting cancellation condition is satisfied when one of the subjects is no longer smiling.
When the shooting cancellation condition is satisfied, the shootingcondition determination unit 13 determines to stop shooting.
撮影キャンセル条件が成立した場合、撮影条件判定部13は、撮影を中止することを決定する。 Further, the shooting
When the shooting cancellation condition is satisfied, the shooting
撮影を中止する場合(ステップS221;Yes)、撮影条件判定部13は、第1のタイマ部18に撮影タイマの停止を指示し、自分撮り処理を終了する。
撮影を中止しない場合(ステップS221;No)、設定した撮影待ち時間が経過すると、第1のタイマ部18は、撮影タイマを停止し(ステップS25)、通知制御部14は、ユーザに撮影のタイミングで通知を行う(ステップS26)。また、撮影指示部15は、第1の通信部17を介して、撮像装置20へ撮影指示情報を送信し(ステップS27)、撮像装置20では、撮像部21が撮影を実行する。
レックビュー設定欄106で「ON」が設定されている場合、撮像装置20は撮影画像(静止画記録用撮影画像)を送信する。撮像指示装置10では、第1の通信部17が撮影画像を受信し(ステップS271)、メモリ16に記録する。表示制御部19は、メモリ16から撮影画像(静止画記録用撮影画像)を読み出してレックビュー画像を生成し、入出力部11に出力する。入出力部11は、撮影画像(レックビュー画像)を表示する(ステップS272)。 When shooting is stopped (step S221; Yes), the shootingcondition determination unit 13 instructs the first timer unit 18 to stop the shooting timer, and ends the self-portrait process.
When shooting is not stopped (step S221; No), when the set shooting wait time has elapsed, thefirst timer unit 18 stops the shooting timer (step S25), and the notification control unit 14 notifies the user of the shooting timing. (Step S26). Further, the imaging instruction unit 15 transmits imaging instruction information to the imaging device 20 via the first communication unit 17 (step S27), and in the imaging device 20, the imaging unit 21 performs imaging.
When “ON” is set in the RECview setting field 106, the imaging device 20 transmits a captured image (a still image recording captured image). In the imaging instruction device 10, the first communication unit 17 receives the captured image (step S <b> 271) and records it in the memory 16. The display control unit 19 reads a captured image (still image recording captured image) from the memory 16, generates a rec view image, and outputs it to the input / output unit 11. The input / output unit 11 displays a captured image (rec view image) (step S272).
撮影を中止しない場合(ステップS221;No)、設定した撮影待ち時間が経過すると、第1のタイマ部18は、撮影タイマを停止し(ステップS25)、通知制御部14は、ユーザに撮影のタイミングで通知を行う(ステップS26)。また、撮影指示部15は、第1の通信部17を介して、撮像装置20へ撮影指示情報を送信し(ステップS27)、撮像装置20では、撮像部21が撮影を実行する。
レックビュー設定欄106で「ON」が設定されている場合、撮像装置20は撮影画像(静止画記録用撮影画像)を送信する。撮像指示装置10では、第1の通信部17が撮影画像を受信し(ステップS271)、メモリ16に記録する。表示制御部19は、メモリ16から撮影画像(静止画記録用撮影画像)を読み出してレックビュー画像を生成し、入出力部11に出力する。入出力部11は、撮影画像(レックビュー画像)を表示する(ステップS272)。 When shooting is stopped (step S221; Yes), the shooting
When shooting is not stopped (step S221; No), when the set shooting wait time has elapsed, the
When “ON” is set in the REC
ステップS22で撮影条件を満たしていないと判定した場合(ステップS22;No)、入出力部11がユーザによる自分撮り中止指示操作を検出すると(ステップS28;Yes)、自分撮り処理を終了する。このとき、通知制御部14が、振動や音声出力などにより撮影の中止を知らせる通知を行ってもよい。自分撮り中止指示操作を検出しない場合(ステップS28;No)、撮影条件を満たすまでステップS20からの処理を繰り返す。
If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. At this time, the notification control unit 14 may perform notification notifying that the shooting is stopped by vibration or sound output. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
本実施形態によれば、撮影対象人数や構成を設定すれば、撮影準備が整っているかどうかの判定を撮像指示装置10に任せることができるので、ユーザは、余計なことを気にせず自分撮りを行うことができる。また、撮像指示装置10が撮影準備の整ったことを通知し、自分で設定した時間後に撮影が実行されることがわかっているので、ユーザは撮影のタイミングに合わせて所望の表情を作ったり自然な状態で撮影に臨むことができる。また、撮影準備の判定を撮像指示装置10に任せることで、ユーザは煩雑な操作から解放され、ライブ画面を見ながら細かな調整などを行わなくて良いので、素早く目立たずに自分撮りを行うことができる。また、撮影対象人数や構成設定によって、背後の風景を入れて撮影したい場合や、2~3人などで撮影したい場合にも対応することができる。
なお、図7~図9では、レックビュー設定欄106の設定などに応じて撮像装置20が静止画記録用画像を送信し、撮像指示装置10はレックビュー画像を表示する動作を例に説明を行ったが、撮像装置20は静止画記録用画像を常に撮像指示装置10へ送信し、撮像指示装置10は静止画記録用画像を受信してメモリ16に記録し、レックビュー画像の表示/非表示のみを設定に応じて制御するようにしてもよい。 According to the present embodiment, if the number of people to be photographed and the configuration are set, it can be left to theimaging instruction device 10 to determine whether or not the photographing preparation is complete, so the user can take a self-portrait without worrying about unnecessary things. It can be performed. In addition, since the imaging instruction apparatus 10 notifies that the preparation for shooting is ready and it is known that shooting is performed after the time set by the user, the user can make a desired facial expression in accordance with the timing of shooting. You can start shooting in a safe state. Also, by leaving the determination of shooting preparation to the imaging instruction device 10, the user is freed from complicated operations and does not have to make fine adjustments while watching the live screen, so that the user can take a self-photograph without being noticeable quickly. Can do. In addition, depending on the number of persons to be photographed and the configuration settings, it is possible to cope with the case where it is desired to shoot with a landscape behind, or where it is desired to shoot with two to three people.
7 to 9, theimaging device 20 transmits a still image recording image in accordance with the setting of the REC view setting field 106 and the like, and the imaging instruction device 10 illustrates an operation of displaying the REC view image as an example. However, the imaging device 20 always transmits the still image recording image to the imaging instruction device 10, and the imaging instruction device 10 receives and records the still image recording image in the memory 16, and displays / not displays the REC view image. Only display may be controlled according to the setting.
なお、図7~図9では、レックビュー設定欄106の設定などに応じて撮像装置20が静止画記録用画像を送信し、撮像指示装置10はレックビュー画像を表示する動作を例に説明を行ったが、撮像装置20は静止画記録用画像を常に撮像指示装置10へ送信し、撮像指示装置10は静止画記録用画像を受信してメモリ16に記録し、レックビュー画像の表示/非表示のみを設定に応じて制御するようにしてもよい。 According to the present embodiment, if the number of people to be photographed and the configuration are set, it can be left to the
7 to 9, the
(第2の実施形態)
次に、本発明の第2の実施形態について図10~図11を用いて説明する。
図10は、本発明の第2の実施形態における撮像システムの構成を示した機能ブロック図である。
本実施形態と第1の実施形態とで異なる点は、撮像装置20が第2のタイマ部26を備えている点である。第2の実施形態において撮像指示装置10は、第1のタイマ部18を備えていなくてもよい。本実施形態では、撮像装置20が撮像指示を受信してから、第2のタイマ部26が、ユーザが設定した時間の経過を計時し、撮像装置20自らが撮影のタイミングを決定する。その他の構成および動作については、第1の実施形態と同様である。 (Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS.
FIG. 10 is a functional block diagram showing the configuration of the imaging system in the second embodiment of the present invention.
The difference between the present embodiment and the first embodiment is that theimaging device 20 includes a second timer unit 26. In the second embodiment, the imaging instruction device 10 may not include the first timer unit 18. In the present embodiment, after the imaging device 20 receives the imaging instruction, the second timer unit 26 measures the lapse of time set by the user, and the imaging device 20 itself determines the shooting timing. Other configurations and operations are the same as those in the first embodiment.
次に、本発明の第2の実施形態について図10~図11を用いて説明する。
図10は、本発明の第2の実施形態における撮像システムの構成を示した機能ブロック図である。
本実施形態と第1の実施形態とで異なる点は、撮像装置20が第2のタイマ部26を備えている点である。第2の実施形態において撮像指示装置10は、第1のタイマ部18を備えていなくてもよい。本実施形態では、撮像装置20が撮像指示を受信してから、第2のタイマ部26が、ユーザが設定した時間の経過を計時し、撮像装置20自らが撮影のタイミングを決定する。その他の構成および動作については、第1の実施形態と同様である。 (Second Embodiment)
Next, a second embodiment of the present invention will be described with reference to FIGS.
FIG. 10 is a functional block diagram showing the configuration of the imaging system in the second embodiment of the present invention.
The difference between the present embodiment and the first embodiment is that the
図11は、本発明の第2の実施形態における撮像システムの処理の流れの一例を示すフローチャートである。
図11を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の処理について説明する。第1の実施形態と同様の処理については簡単に説明を行う。なお、撮像装置20について、図7で説明した処理については説明を省略するが、撮像装置20は、自装置の揺れの情報と撮影対象の顔画像の座標情報などを撮像指示装置10へ送信しているものとする。
まず、第1の通信部17が撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS20)。撮影条件判定部13は、第1の通信部17から揺れの情報と顔画像の座標情報とを取得して撮影条件を判定する(ステップS21)。撮影条件を満たしたと判定した場合(ステップS22;Yes)、撮影条件判定部13は、撮影準備が整ったことを示す情報を通知制御部14と撮影指示部15へ出力する。通知制御部14は、ユーザに撮影準備完了通知を行う(ステップS23)。また、撮影指示部15は、第1の通信部17を介して撮像装置20へタイマ撮影指示情報を送信する(ステップS29)。タイマ撮影指示情報は、何秒後に撮影を行うかを指定した撮影待ち時間情報を含んだ撮影指示情報である。 FIG. 11 is a flowchart illustrating an example of a processing flow of the imaging system according to the second embodiment of the present invention.
With reference to FIG. 11, a description will be given of processing in the case where a self-portrait is performed using theimaging system 1 of the present embodiment. A process similar to that of the first embodiment will be briefly described. Although the description of the processing described in FIG. 7 for the imaging device 20 is omitted, the imaging device 20 transmits information about the shaking of the device itself and coordinate information of the face image to be photographed to the imaging instruction device 10. It shall be.
First, thefirst communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20). The shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15. The notification control unit 14 notifies the user of completion of shooting preparation (step S23). In addition, the shooting instruction unit 15 transmits timer shooting instruction information to the imaging device 20 via the first communication unit 17 (step S29). The timer shooting instruction information is shooting instruction information including shooting waiting time information that specifies how many seconds the shooting should be performed.
図11を用いて、本実施形態の撮像システム1を用いて自分撮りを行う場合の処理について説明する。第1の実施形態と同様の処理については簡単に説明を行う。なお、撮像装置20について、図7で説明した処理については説明を省略するが、撮像装置20は、自装置の揺れの情報と撮影対象の顔画像の座標情報などを撮像指示装置10へ送信しているものとする。
まず、第1の通信部17が撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS20)。撮影条件判定部13は、第1の通信部17から揺れの情報と顔画像の座標情報とを取得して撮影条件を判定する(ステップS21)。撮影条件を満たしたと判定した場合(ステップS22;Yes)、撮影条件判定部13は、撮影準備が整ったことを示す情報を通知制御部14と撮影指示部15へ出力する。通知制御部14は、ユーザに撮影準備完了通知を行う(ステップS23)。また、撮影指示部15は、第1の通信部17を介して撮像装置20へタイマ撮影指示情報を送信する(ステップS29)。タイマ撮影指示情報は、何秒後に撮影を行うかを指定した撮影待ち時間情報を含んだ撮影指示情報である。 FIG. 11 is a flowchart illustrating an example of a processing flow of the imaging system according to the second embodiment of the present invention.
With reference to FIG. 11, a description will be given of processing in the case where a self-portrait is performed using the
First, the
撮像装置20では、第2の通信部25がタイマ撮影指示情報を受信し(ステップS30)、制御部24に出力する。制御部24は、第2のタイマ部26に撮影タイマの開始を指示する。第2のタイマ部26は、撮影タイマをスタートする(ステップS31)。タイマ撮影指示情報に指定された撮影待ち時間が経過すると、第2のタイマ部26は、撮影タイマを停止する(ステップS32)。第2のタイマ部26は、設定時間が経過したことを示す情報を制御部24に出力する。制御部24は撮像部21に撮影指示を行い、撮像部21は撮影を実行する(ステップS33)。また、制御部24は、撮影完了情報を、第2の通信部25を介して撮像指示装置10へ送信するよう制御する。第2の通信部25は、撮影が完了したことを示す撮影完了情報を撮像指示装置10へ送信する(ステップS34)。また、撮影が完了すると、撮像部21は、センサ出力画像を画像処理部23へ出力し、画像処理部23は画像処理を行う。第2の通信部25は、画像処理後の撮影画像(静止画記録用撮影画像)を撮像指示装置10へ送信する(ステップS35)。
In the imaging device 20, the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24. The control unit 24 instructs the second timer unit 26 to start the shooting timer. The second timer unit 26 starts a shooting timer (step S31). When the imaging waiting time specified in the timer imaging instruction information has elapsed, the second timer unit 26 stops the imaging timer (step S32). The second timer unit 26 outputs information indicating that the set time has elapsed to the control unit 24. The control unit 24 issues a shooting instruction to the imaging unit 21, and the imaging unit 21 performs shooting (step S33). In addition, the control unit 24 performs control so that the shooting completion information is transmitted to the imaging instruction apparatus 10 via the second communication unit 25. The second communication unit 25 transmits shooting completion information indicating that shooting has been completed to the imaging instruction apparatus 10 (step S34). When the photographing is completed, the imaging unit 21 outputs a sensor output image to the image processing unit 23, and the image processing unit 23 performs image processing. The second communication unit 25 transmits the captured image (photographed image for still image recording) after the image processing to the imaging instruction device 10 (step S35).
撮像指示装置10では、第1の通信部17が撮影完了情報を受信し、通知制御部14に出力する。次に通知制御部14は、撮像指示装置10を振動させたり、音声を出力させたりしてユーザに撮影時の通知を行う(ステップS26)。
In the imaging instruction device 10, the first communication unit 17 receives the imaging completion information and outputs it to the notification control unit 14. Next, the notification control unit 14 notifies the user at the time of shooting by vibrating the imaging instruction device 10 or outputting a sound (step S26).
ステップS22で撮影条件を満たしていないと判定した場合(ステップS22;No)の処理は、第1の実施形態と同様である。入出力部11がユーザによる自分撮り中止指示操作を検出すると(ステップS28;Yes)、自分撮り処理を終了する。自分撮り中止指示操作を検出しない場合(ステップS28;No)、撮影条件を満たすまでステップS20からの処理を繰り返す。
When it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), the processing is the same as in the first embodiment. When the input / output unit 11 detects a selfie stop instruction operation by the user (step S28; Yes), the selfie process is terminated. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
本実施形態のように撮像装置20で撮影タイマを起動し、自分撮りを実行する構成とすることも可能である。
なお、ステップS33の後に撮影画像を撮像指示装置10へ送信する場合を例に説明を行ったが、第1の実施形態と同様に、撮影画像を送信するか否かの設定に応じて撮像装置20が静止画記録用画像を送信し、撮像指示装置10がレックビュー画像を表示するようにしてもよい。 As in the present embodiment, theimaging timer 20 may be started by the imaging device 20 to execute a self-portrait.
The case where a captured image is transmitted to theimaging instruction apparatus 10 after step S33 has been described as an example. However, as in the first embodiment, the imaging apparatus is set according to whether or not a captured image is transmitted. 20 may transmit a still image recording image, and the imaging instruction apparatus 10 may display a rec view image.
なお、ステップS33の後に撮影画像を撮像指示装置10へ送信する場合を例に説明を行ったが、第1の実施形態と同様に、撮影画像を送信するか否かの設定に応じて撮像装置20が静止画記録用画像を送信し、撮像指示装置10がレックビュー画像を表示するようにしてもよい。 As in the present embodiment, the
The case where a captured image is transmitted to the
(第3の実施形態)
次に、本発明の第3の実施形態について図12~図13を用いて説明する。
図12は、本発明の第3の実施形態における撮像システムの構成を示した機能ブロック図である。
本実施形態と第2の実施形態とで異なる点は、撮像装置20が撮影中止条件判定部27を備えている点である。本実施形態では、撮像装置20が撮像指示を受信してから、第2のタイマ部26によって撮影タイミングを決定するまでの間、撮影中止条件判定部27が、撮影中止条件の判定を行う。そして、撮影中止条件が満たされた場合、撮像装置20は撮影を中止する。その他の構成および動作については、第2の実施形態と同様である。 (Third embodiment)
Next, a third embodiment of the present invention will be described with reference to FIGS.
FIG. 12 is a functional block diagram showing the configuration of the imaging system in the third embodiment of the present invention.
The difference between the present embodiment and the second embodiment is that theimaging apparatus 20 includes a shooting stop condition determination unit 27. In the present embodiment, the shooting stop condition determination unit 27 determines the shooting stop condition from when the imaging device 20 receives the shooting instruction until the second timer unit 26 determines the shooting timing. Then, when the shooting stop condition is satisfied, the imaging device 20 stops shooting. Other configurations and operations are the same as those in the second embodiment.
次に、本発明の第3の実施形態について図12~図13を用いて説明する。
図12は、本発明の第3の実施形態における撮像システムの構成を示した機能ブロック図である。
本実施形態と第2の実施形態とで異なる点は、撮像装置20が撮影中止条件判定部27を備えている点である。本実施形態では、撮像装置20が撮像指示を受信してから、第2のタイマ部26によって撮影タイミングを決定するまでの間、撮影中止条件判定部27が、撮影中止条件の判定を行う。そして、撮影中止条件が満たされた場合、撮像装置20は撮影を中止する。その他の構成および動作については、第2の実施形態と同様である。 (Third embodiment)
Next, a third embodiment of the present invention will be described with reference to FIGS.
FIG. 12 is a functional block diagram showing the configuration of the imaging system in the third embodiment of the present invention.
The difference between the present embodiment and the second embodiment is that the
図13は、本発明の第3の実施形態における撮像システムの処理の流れの一例を示すフローチャートである。
図13を用いて、第2の実施形態における撮像システムの処理について説明する。図11で説明した処理と同じ処理については簡単に説明する。
まず、第1の通信部17が撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS20)。撮影条件判定部13は、第1の通信部17から揺れの情報と顔画像の座標情報とを取得して撮影条件を判定する(ステップS21)。撮影条件を満たしたと判定した場合(ステップS22;Yes)、撮影条件判定部13は、撮影準備が整ったことを示す情報を通知制御部14と撮影指示部15へ出力する。通知制御部14は、ユーザに撮影準備完了通知を行う(ステップS23)。撮影指示部15は、第1の通信部17を介して撮像装置20へタイマ撮影指示情報を送信する(ステップS29)。 FIG. 13 is a flowchart illustrating an example of a processing flow of the imaging system according to the third embodiment of the present invention.
Processing of the imaging system in the second embodiment will be described with reference to FIG. The same processing as that described in FIG. 11 will be briefly described.
First, thefirst communication unit 17 receives shaking information and face image coordinate information from the imaging device 20 (step S20). The shooting condition determination unit 13 acquires shaking information and face image coordinate information from the first communication unit 17 and determines shooting conditions (step S21). When it is determined that the shooting condition is satisfied (step S22; Yes), the shooting condition determination unit 13 outputs information indicating that the preparation for shooting is ready to the notification control unit 14 and the shooting instruction unit 15. The notification control unit 14 notifies the user of completion of shooting preparation (step S23). The imaging instruction unit 15 transmits timer imaging instruction information to the imaging device 20 via the first communication unit 17 (step S29).
図13を用いて、第2の実施形態における撮像システムの処理について説明する。図11で説明した処理と同じ処理については簡単に説明する。
まず、第1の通信部17が撮像装置20から揺れの情報と顔画像の座標情報とを受信する(ステップS20)。撮影条件判定部13は、第1の通信部17から揺れの情報と顔画像の座標情報とを取得して撮影条件を判定する(ステップS21)。撮影条件を満たしたと判定した場合(ステップS22;Yes)、撮影条件判定部13は、撮影準備が整ったことを示す情報を通知制御部14と撮影指示部15へ出力する。通知制御部14は、ユーザに撮影準備完了通知を行う(ステップS23)。撮影指示部15は、第1の通信部17を介して撮像装置20へタイマ撮影指示情報を送信する(ステップS29)。 FIG. 13 is a flowchart illustrating an example of a processing flow of the imaging system according to the third embodiment of the present invention.
Processing of the imaging system in the second embodiment will be described with reference to FIG. The same processing as that described in FIG. 11 will be briefly described.
First, the
撮像装置20では、第2の通信部25がタイマ撮影指示情報を受信し(ステップS30)、制御部24に出力する。制御部24は、第2のタイマ部26に撮影タイマの開始を指示する。第2のタイマ部26は、撮影タイマをスタートする(ステップS31)。
In the imaging device 20, the second communication unit 25 receives the timer shooting instruction information (step S30) and outputs it to the control unit 24. The control unit 24 instructs the second timer unit 26 to start the shooting timer. The second timer unit 26 starts a shooting timer (step S31).
次に、撮影中止条件判定部27が、撮影中止条件の判定を行う(ステップS36)。例えば、撮影中止条件判定部27は、振動検出部22が検出した揺れの情報とその揺れの検出時刻の情報とを、振動検出部22から取得する。撮影中止条件判定部27は、式(1)を用いて撮像装置20の揺れが所定の範囲に収まっていないと判定すると撮影中止条件が成立したと判定する。あるいは、撮影中止条件判定部27は、所定の時間における揺れが式(1)を満たさない回数が閾値以上となると撮影中止条件が成立したと判定する。
Next, the shooting stop condition determination unit 27 determines the shooting stop condition (step S36). For example, the imaging stop condition determination unit 27 acquires the shake information detected by the vibration detection unit 22 and the information on the detection time of the shake from the vibration detection unit 22. If it is determined that the shaking of the imaging device 20 is not within the predetermined range using the equation (1), the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied. Alternatively, the shooting stop condition determination unit 27 determines that the shooting stop condition is satisfied when the number of times that the fluctuation in the predetermined time does not satisfy Expression (1) is equal to or greater than the threshold value.
また、例えば、撮影中止条件判定部27は、画像処理部23から顔画像の座標情報を取得し、被写体の状態に関して撮影中止条件を判定してもよい。この場合、撮像装置20は、撮像指示装置10からユーザが図4Aで例示した自分撮り設定画面で設定した構図設定情報を受信しており、また、撮像装置20の記憶部(図示せず)には、構図設定情報と対象人数に応じた構図ガイドエリアが記録されているものとする。撮影中止条件判定部27は、被写体の顔画像の座標情報のうち1つでも構図ガイドエリアの領域を外れたり、撮影対象となる被写体の数が増減し、ユーザが指定した撮影対象の人数と異なったりすると撮影中止条件が成立したと判定する。
Further, for example, the shooting stop condition determination unit 27 may acquire the coordinate information of the face image from the image processing unit 23 and determine the shooting stop condition regarding the state of the subject. In this case, the imaging apparatus 20 has received composition setting information set by the user on the selfie setting screen illustrated in FIG. 4A from the imaging instruction apparatus 10 and stored in a storage unit (not shown) of the imaging apparatus 20. , It is assumed that the composition setting information and the composition guide area corresponding to the target number of persons are recorded. The shooting stop condition determination unit 27 is different from the number of shooting targets specified by the user because one of the coordinate information of the face image of the subject is out of the composition guide area or the number of shooting targets is increased or decreased. Or the like, it is determined that the shooting stop condition is satisfied.
なお、撮影中止条件判定部27は、撮像装置20の揺れの大きさと被写体の状態とのうち、どちらか一方に関する撮影中止条件が成立しただけで撮影中止条件が成立したと判定してもよいし、撮像装置20の揺れの大きさに関する撮影中止条件と被写体の状態に関する撮影中止条件の両方が成立したときに撮影中止条件が成立したと判定してもよい。撮影中止条件判定部27は判定結果を制御部24へ出力する。撮影の中止を判定した場合(ステップS37;Yes)、制御部24は、第2の通信部25を介して、撮影の中止を示す撮影中止情報を撮像指示装置10へ送信する(ステップS38)。また、制御部24は、第2のタイマ部26にタイマの停止を指示し、自分撮り処理は終了する。
Note that the shooting stop condition determination unit 27 may determine that the shooting stop condition is satisfied only when the shooting stop condition for either one of the magnitude of shaking of the imaging device 20 and the state of the subject is satisfied. Alternatively, it may be determined that the shooting stop condition is satisfied when both the shooting stop condition regarding the magnitude of the shaking of the imaging device 20 and the shooting stop condition regarding the state of the subject are satisfied. The shooting stop condition determination unit 27 outputs the determination result to the control unit 24. When it is determined that shooting is to be stopped (step S37; Yes), the control unit 24 transmits shooting stop information indicating the stop of shooting to the imaging instruction apparatus 10 via the second communication unit 25 (step S38). In addition, the control unit 24 instructs the second timer unit 26 to stop the timer, and the self-portrait process ends.
撮影の中止を判定しない場合(ステップS37;No)、設定した撮影待ち時間が経過すると、第2のタイマ部26は、撮影タイマを停止し(ステップS32)、撮像部21は撮影を実行する(ステップS33)。また、第2の通信部25は、撮影完了情報を撮像指示装置10へ送信する(ステップS34)。また、撮影が完了すると、第2の通信部25は、撮影画像(静止画記録用撮影画像)を撮像指示装置10へ送信する(ステップS35)。
撮像指示装置10では、第1の通信部17が撮影完了情報を受信し、通知制御部14は、ユーザに撮影時の通知を行う(ステップS26)。 When it is not determined to stop shooting (step S37; No), when the set shooting wait time elapses, thesecond timer unit 26 stops the shooting timer (step S32), and the imaging unit 21 executes shooting (step S32). Step S33). Further, the second communication unit 25 transmits shooting completion information to the imaging instruction device 10 (step S34). When the photographing is completed, the second communication unit 25 transmits a photographed image (still image recording photographed image) to the imaging instruction device 10 (step S35).
In theimaging instruction device 10, the first communication unit 17 receives the imaging completion information, and the notification control unit 14 notifies the user at the time of imaging (step S26).
撮像指示装置10では、第1の通信部17が撮影完了情報を受信し、通知制御部14は、ユーザに撮影時の通知を行う(ステップS26)。 When it is not determined to stop shooting (step S37; No), when the set shooting wait time elapses, the
In the
ステップS22で撮影条件を満たしていないと判定した場合(ステップS22;No)、入出力部11がユーザによる自分撮り中止指示操作を検出すると(ステップS28;Yes)、自分撮り処理を終了する。自分撮り中止指示操作を検出しない場合(ステップS28;No)、撮影条件を満たすまでステップS20からの処理を繰り返す。
If it is determined in step S22 that the shooting conditions are not satisfied (step S22; No), when the input / output unit 11 detects a self-shooting stop operation by the user (step S28; Yes), the self-shooting process is terminated. When the self-shooting stop instruction operation is not detected (step S28; No), the processing from step S20 is repeated until the shooting condition is satisfied.
本実施形態のように撮像装置20で撮影タイマを起動し、撮像装置20で撮影中止判定を行う構成とすることも可能である。
なお、撮影画像の送信については、第1の実施形態と同様に、撮影画像を送信するか否かの設定に応じて撮像装置20が静止画記録用画像を送信し、撮像指示装置10がレックビュー画像を表示するようにしてもよい。 It is also possible to employ a configuration in which a shooting timer is started by theimaging device 20 and the shooting stop determination is performed by the imaging device 20 as in the present embodiment.
As for the transmission of the captured image, as in the first embodiment, theimaging device 20 transmits the still image recording image according to the setting of whether to transmit the captured image, and the imaging instruction device 10 A view image may be displayed.
なお、撮影画像の送信については、第1の実施形態と同様に、撮影画像を送信するか否かの設定に応じて撮像装置20が静止画記録用画像を送信し、撮像指示装置10がレックビュー画像を表示するようにしてもよい。 It is also possible to employ a configuration in which a shooting timer is started by the
As for the transmission of the captured image, as in the first embodiment, the
以上、この発明の第1の実施形態、第2の実施形態、第3の実施形態について図面を参照して詳述してきたが、例えば、撮像装置20が撮影して生成した撮影画像を、撮像指示装置10に送信しているが、撮像装置20が備える記憶部(図示せず)に保存するようにしてもよい。また、第3の実施形態において、撮影条件の判定を撮像装置20で行うようにしてもよい。なお、入出力部11は入力部の一例である。
As described above, the first embodiment, the second embodiment, and the third embodiment of the present invention have been described in detail with reference to the drawings. For example, the captured image generated by the imaging device 20 is captured. Although it is transmitted to the instruction device 10, it may be stored in a storage unit (not shown) included in the imaging device 20. In the third embodiment, the imaging condition may be determined by the imaging device 20. The input / output unit 11 is an example of an input unit.
なお、上述した実施形態における撮像指示装置10、撮像装置20が備える各部の機能全体あるいはその一部は、これらの機能を実現するためのプログラムをコンピュータ読み取り可能な記録媒体に記録して、この記録媒体に記録されたプログラムをコンピュータシステムに読み込ませ、実行することによって実現しても良い。なお、ここでいう「コンピュータシステム」とは、OSや周辺機器等のハードウェアを含むものとする。
Note that all or some of the functions of the units included in the imaging instruction device 10 and the imaging device 20 according to the above-described embodiment are recorded on a computer-readable recording medium, and this recording is performed. You may implement | achieve by making a computer system read the program recorded on the medium and executing it. Here, the “computer system” includes an OS and hardware such as peripheral devices.
また、「コンピュータ読み取り可能な記録媒体」とは、フレキシブルディスク、光磁気ディスク、ROM、CD-ROM等の可搬媒体、コンピュータシステムに内蔵されるハードディスク等の記憶部のことをいう。さらに「コンピュータ読み取り可能な記録媒体」とは、インターネット等のネットワークや電話回線等の通信回線を介してプログラムを送信する場合の通信線のように、短時刻の間、動的にプログラムを保持するもの、その場合のサーバやクライアントとなるコンピュータシステム内部の揮発性メモリのように、一定時刻プログラムを保持しているものも含んでも良い。また上記プログラムは、前述した機能の一部を実現するためのものであっても良く、さらに前述した機能をコンピュータシステムにすでに記録されているプログラムとの組み合わせで実現できるものであっても良い。
The “computer-readable recording medium” means a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage unit such as a hard disk built in the computer system. Further, the “computer-readable recording medium” dynamically holds a program for a short time, like a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line. It is also possible to include those that hold a program for a certain time, such as a volatile memory inside a computer system serving as a server or client in that case. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
以上、本発明の好ましい実施形態を説明したが、本発明はこれら実施形態及びその変形例に限定されることはない。本発明の趣旨を逸脱しない範囲で、構成の付加、省略、置換、およびその他の変更が可能である。
また、本発明は前述した説明によって限定されることはなく、添付のクレームの範囲によってのみ限定される。 As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment and its modification. Additions, omissions, substitutions, and other modifications can be made without departing from the spirit of the present invention.
Further, the present invention is not limited by the above description, and is limited only by the scope of the appended claims.
また、本発明は前述した説明によって限定されることはなく、添付のクレームの範囲によってのみ限定される。 As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment and its modification. Additions, omissions, substitutions, and other modifications can be made without departing from the spirit of the present invention.
Further, the present invention is not limited by the above description, and is limited only by the scope of the appended claims.
上記各形態の撮像指示装置、撮像システム、撮影方法およびプログラムによれば、撮像指示装置は、自分撮りを行うユーザの撮影準備が整っているかどうかを判定する。撮像指示装置は、撮影準備が整ったと判定すると撮像装置に撮像指示を行う。これにより、ユーザは、撮影準備が整ってから自分自身を撮影することができる。また、撮像指示装置は、ユーザに撮影を開始する合図を通知し、撮像装置は、撮像指示があってから所定の時間経過後に撮影を行う。これにより、ユーザは所望の表情や姿勢で撮影に臨むことができる。
According to the imaging instruction device, the imaging system, the imaging method, and the program of each aspect described above, the imaging instruction device determines whether or not the user who performs self-taking is ready for imaging. When the imaging instruction device determines that the preparation for shooting is complete, the imaging instruction device instructs the imaging device to take an image. As a result, the user can photograph himself / herself after preparation for photographing is completed. In addition, the imaging instruction device notifies the user of a cue to start imaging, and the imaging device performs imaging after a predetermined time has elapsed since the imaging instruction was given. Thereby, the user can face shooting with a desired facial expression and posture.
1 撮像システム
10 撮像指示装置
11 入出力部
12 条件設定部
13 撮影条件判定部
14 通知制御部
15 撮影指示部
16 メモリ
17 第1の通信部
18 第1のタイマ部
20 撮像装置
21 撮像部
22 振動検出部
23 画像処理部
24 制御部
25 第2の通信部
26 第2のタイマ部
27 撮影中止条件判定部
30 光学モジュール DESCRIPTION OFSYMBOLS 1 Imaging system 10 Imaging instruction | indication apparatus 11 Input / output part 12 Condition setting part 13 Imaging condition determination part 14 Notification control part 15 Imaging | photography instruction | indication part 16 Memory 17 1st communication part 18 1st timer part 20 Imaging device 21 Imaging part 22 Vibration Detection unit 23 Image processing unit 24 Control unit 25 Second communication unit 26 Second timer unit 27 Imaging stop condition determination unit 30 Optical module
10 撮像指示装置
11 入出力部
12 条件設定部
13 撮影条件判定部
14 通知制御部
15 撮影指示部
16 メモリ
17 第1の通信部
18 第1のタイマ部
20 撮像装置
21 撮像部
22 振動検出部
23 画像処理部
24 制御部
25 第2の通信部
26 第2のタイマ部
27 撮影中止条件判定部
30 光学モジュール DESCRIPTION OF
Claims (9)
- 撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する撮影条件判定部と、
前記撮影条件判定部が撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う撮影指示部と、
前記撮影条件判定部が撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する通知制御部と、
を備える撮像指示装置。 A shooting condition determining unit that determines whether or not a shooting condition is satisfied based on at least one of information indicating a magnitude of shaking of the imaging device and information relating to a state of a subject captured in the image being shot by the imaging device; ,
When the shooting condition determining unit determines that the shooting condition is satisfied, a shooting instruction unit that issues a shooting instruction so that the imaging apparatus executes shooting of a still image recording shot image after a predetermined time has elapsed since the determination was made. When,
When it is determined that the shooting condition determination unit satisfies the shooting condition, a notification control unit that controls at least one of the vibration module and the audio output module to operate and notifies the user of the determination result;
An imaging instruction apparatus comprising: - 前記被写体の状態に関する情報は、前記撮影中の画像に写る被写体の数であって、
前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像の数によって前記被写体の数を認識し、認識した被写体の数が所定の数であれば、撮影条件を満たすと判定する、
を備える請求項1に記載の撮像指示装置。 The information on the state of the subject is the number of subjects that appear in the image being shot,
The shooting condition determination unit recognizes the number of subjects based on the number of face images of the subject in the image being shot, and determines that the shooting condition is satisfied if the number of recognized subjects is a predetermined number.
The imaging instruction device according to claim 1, comprising: - 前記被写体の状態に関する情報は、前記撮影中の画像に写る一人又は複数の被写体の位置であって、
前記撮影条件判定部は、前記撮影中の画像に写る被写体の顔画像が示す位置によって前記被写体の位置を認識し、認識した一人又は複数の被写体の位置が所定の範囲内にあれば、撮影条件を満たすと判定する、
請求項1または請求項2の何れか1項に記載の撮像指示装置。 The information on the state of the subject is the position of one or more subjects in the image being shot,
The shooting condition determining unit recognizes the position of the subject based on the position indicated by the face image of the subject in the image being shot, and if the recognized position of one or more subjects is within a predetermined range, the shooting condition is determined. To determine that
The imaging instruction | indication apparatus of any one of Claim 1 or Claim 2. - 前記撮影条件判定部は、前記撮像装置の揺れの大きさ示す情報に基づいて前記撮像装置の揺れの大きさを判定し、前記撮像装置の揺れの大きさが所定の閾値以内であれば、撮影条件を満たすと判定する、
請求項1から請求項3の何れか1項に記載の撮像指示装置。 The imaging condition determination unit determines the magnitude of shaking of the imaging device based on information indicating the magnitude of shaking of the imaging device, and if the magnitude of shaking of the imaging device is within a predetermined threshold, imaging is performed. Determine that the condition is met,
The imaging instruction | indication apparatus of any one of Claims 1-3. - 前記撮影条件判定部が判定に用いる撮影条件であって、前記撮影条件を満たすと判定してから撮影を実行するまでの時間、または、前記撮影中の画像に含まれる被写体の数、または、被写体の位置のうち少なくとも1つを指定する条件の入力を受け付ける入力部、
をさらに備える請求項1から請求項4の何れか1項に記載の撮像指示装置。 The shooting conditions used for the determination by the shooting condition determination unit, the time from when it is determined that the shooting conditions are satisfied until shooting is performed, the number of subjects included in the image being shot, or the subjects An input unit for receiving an input of a condition for designating at least one of the positions of
The imaging instruction apparatus according to any one of claims 1 to 4, further comprising: - 前記撮影条件判定部は、ユーザによる撮影を中止する指示操作、または、前記撮像装置の揺れの大きさ示す情報、または、前記撮像装置が撮影中の画像に写る被写体の状態に関する情報、に基づいて撮影の中止を決定する、
請求項1から請求項5の何れか1項に記載の撮像指示装置。 The shooting condition determination unit is based on an instruction operation for stopping shooting by a user, information indicating a magnitude of shaking of the imaging device, or information on a state of a subject that is captured in an image being shot by the imaging device. Decide to stop shooting,
The imaging instruction | indication apparatus of any one of Claims 1-5. - 前記撮像装置と通信を行う第1の通信部、をさらに備える請求項1から請求項6の何れか1項に記載の撮像指示装置と、
撮像部と、前記撮像指示装置と通信を行う第2の通信部と、自装置の揺れを検出する振動検出部と、前記撮像部が撮影中の画像に写る被写体の状態を認識する画像処理部と、を備える撮像装置と、
を備える撮像システム。 The imaging instruction device according to any one of claims 1 to 6, further comprising a first communication unit that communicates with the imaging device.
An imaging unit, a second communication unit that communicates with the imaging instruction device, a vibration detection unit that detects shaking of the own device, and an image processing unit that recognizes a state of a subject that is captured in an image being captured by the imaging unit An imaging device comprising:
An imaging system comprising: - 撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定し、
前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮像指示を行い、
さらに、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する、
撮影方法。 Determining whether the imaging condition is satisfied based on at least one of the information indicating the magnitude of shaking of the imaging device and the information on the state of the subject in the image being captured by the imaging device;
When it is determined that the shooting condition is satisfied, an imaging instruction is performed so that the imaging device executes shooting of a still image recording shot image after a predetermined time has elapsed since the determination is made;
Further, at least one of the vibration module and the audio output module is operated, and control is performed to notify the user of the determination result.
Shooting method. - 撮像指示装置のコンピュータを、
撮像装置の揺れの大きさ示す情報と前記撮像装置が撮影中の画像に写る被写体の状態に関する情報とのうちの少なくとも一方の情報に基づいて撮影条件を満たすかどうかを判定する手段、
前記撮影条件を満たすと判定した場合、その判定を行ってから所定時間の経過後に前記撮像装置が静止画記録用撮影画像の撮影を実行するように撮影指示を行う手段、
前記撮影条件を満たすと判定した場合、振動モジュールと音声出力モジュールのうち少なくとも一方を動作させ、ユーザにその判定結果を通知するよう制御する手段、
として機能させるためのプログラム。 The computer of the imaging instruction device
Means for determining whether or not a photographing condition is satisfied based on at least one of information indicating information indicating a magnitude of shaking of the imaging device and information regarding a state of a subject in the image being captured by the imaging device;
Means for giving a shooting instruction so that the imaging device executes shooting of a shot image for still image recording after a predetermined time has elapsed since the determination was made that the shooting condition is satisfied;
Means for operating at least one of the vibration module and the audio output module when it is determined that the shooting condition is satisfied, and controlling the notification result to the user;
Program to function as.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2015/063074 WO2016178267A1 (en) | 2015-05-01 | 2015-05-01 | Image-capturing instructing device, image capturing system, image capturing method, and program |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2015/063074 WO2016178267A1 (en) | 2015-05-01 | 2015-05-01 | Image-capturing instructing device, image capturing system, image capturing method, and program |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016178267A1 true WO2016178267A1 (en) | 2016-11-10 |
Family
ID=57218575
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/063074 WO2016178267A1 (en) | 2015-05-01 | 2015-05-01 | Image-capturing instructing device, image capturing system, image capturing method, and program |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2016178267A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023218884A1 (en) * | 2022-05-12 | 2023-11-16 | ソニーグループ株式会社 | Image-capturing device, control method, and program |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007074296A (en) * | 2005-09-06 | 2007-03-22 | Canon Inc | Cradle unit and control method thereof, viewer apparatus and control method thereof, and control program |
JP2007180869A (en) * | 2005-12-27 | 2007-07-12 | Seiko Epson Corp | Photographing apparatus, electronic apparatus, photographing method, program, and recording medium |
JP2010114842A (en) * | 2008-11-10 | 2010-05-20 | Samsung Yokohama Research Institute Co Ltd | Image capturing apparatus and method |
JP2012010162A (en) * | 2010-06-25 | 2012-01-12 | Kyocera Corp | Camera device |
-
2015
- 2015-05-01 WO PCT/JP2015/063074 patent/WO2016178267A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007074296A (en) * | 2005-09-06 | 2007-03-22 | Canon Inc | Cradle unit and control method thereof, viewer apparatus and control method thereof, and control program |
JP2007180869A (en) * | 2005-12-27 | 2007-07-12 | Seiko Epson Corp | Photographing apparatus, electronic apparatus, photographing method, program, and recording medium |
JP2010114842A (en) * | 2008-11-10 | 2010-05-20 | Samsung Yokohama Research Institute Co Ltd | Image capturing apparatus and method |
JP2012010162A (en) * | 2010-06-25 | 2012-01-12 | Kyocera Corp | Camera device |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2023218884A1 (en) * | 2022-05-12 | 2023-11-16 | ソニーグループ株式会社 | Image-capturing device, control method, and program |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4884417B2 (en) | Portable electronic device and control method thereof | |
US8730335B2 (en) | Imaging apparatus and imaging system | |
US9106836B2 (en) | Imaging apparatus, control method for the same, and recording medium, where continuous shooting or single shooting is performed based on touch | |
US9094597B2 (en) | Imaging apparatus and imaging system | |
US9172878B2 (en) | Image capturing apparatus, image capturing control method and storage medium for capturing a subject to be recorded with intended timing | |
JP2014057310A (en) | Method and apparatus for displaying camera preview screen of portable terminal device | |
US10447919B2 (en) | Imaging device, external device, imaging system, imaging method, operating method, and computer-readable recording medium | |
JP2014007653A (en) | Imaging device, imaging method, imaging system, and program | |
KR20120090431A (en) | Method for capturing picture in a portable terminal | |
WO2015194084A1 (en) | Information processing device, information processing system, and information processing method and program | |
RU2635873C2 (en) | Method and device for displaying framing information | |
JP2009171428A (en) | Control method and program for digital camera apparatus and electronic zoom | |
KR20110060296A (en) | Digital photographing apparatus and controlling method thereof | |
JP5789725B2 (en) | Imaging apparatus, focusing method thereof and focusing control program | |
KR101510101B1 (en) | Apparatus for processing digital image and method for controlling thereof | |
WO2016178267A1 (en) | Image-capturing instructing device, image capturing system, image capturing method, and program | |
JPWO2016125351A1 (en) | Operating device, tracking system, operating method, and program | |
JP2017103657A (en) | Imaging apparatus, imaging method, and computer program for imaging apparatus | |
JP2021135368A (en) | Imaging apparatus, control method of the same, program and storage medium | |
JP2017055266A (en) | Imaging device and control method, program therefor, and storage medium | |
JP2017041778A (en) | Imaging apparatus, moving picture formation method and program | |
JP2007233135A (en) | Photographic device and method for setting operating buttons thereof | |
JP6700770B2 (en) | Display device, control method thereof, and control program | |
JP2007049478A (en) | Potable electronic device | |
JP7186854B2 (en) | Image display device, image display method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15891274 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 15891274 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: JP |