CN116324615A

CN116324615A - Imaging apparatus, method of controlling imaging apparatus, and program

Info

Publication number: CN116324615A
Application number: CN202180068818.5A
Authority: CN
Inventors: 江守智之
Original assignee: Sony Group Corp
Current assignee: Sony Group Corp
Priority date: 2020-10-16
Filing date: 2021-06-11
Publication date: 2023-06-23
Also published as: WO2022079945A1; JPWO2022079945A1; US20230379570A1

Abstract

The invention provides an easier display of the focus, for example during a sparing period. The imaging apparatus includes a focal distance display control unit that performs control to display, on a display unit, a current focal distance indicating a position currently in focus and a plurality of focal distances at the previous shooting indicating positions in focus at the previous shooting and displayed in order of focus.

Description

Imaging apparatus, method of controlling imaging apparatus, and program

Technical Field

The present disclosure relates to an imaging apparatus, a method of controlling the imaging apparatus, and a program.

Background

Patent document 1 discloses a technique for displaying a scout image. Further, patent document 2 discloses a technique for displaying a mark (symbol) on a focus bar. With these techniques, it is possible to perform photographing at a focal length and a view angle similar to those at the time of exercise.

CITATION LIST

Patent literature

Patent document 1: japanese patent application laid-open No.2002-281358

Patent document 2: japanese patent application laid-open No.2001-326834

Disclosure of Invention

Problems to be solved by the invention

However, with the technology described in the above patent document, it is not possible to perform more user-friendly display on the focus at the time of exercise.

It is an object of the present disclosure to provide an imaging apparatus for performing more user-friendly display on a focus at the time of exercise, a method of controlling the imaging apparatus, and a program.

Solution to the problem

For example, the present disclosure is

An imaging apparatus includes a focal length display control unit that performs control to display, on a display unit, a current focal length indicating the current focal length and focal lengths at a plurality of preliminary shots indicating focal lengths recorded at the time of the preliminary shots and displayed in order of registration at the time of the preliminary shots.

Further, for example, the present disclosure is

A method of controlling an imaging apparatus, wherein a focal length display control unit performs control to display, on a display unit, a current focal length indicating the current focal length and focal lengths at a plurality of preliminary shots indicating focal lengths recorded at the time of the preliminary shots and displayed in order of registration at the time of the preliminary shots.

Further, for example, the present disclosure is

A program for causing a computer to execute a method of controlling an imaging apparatus, wherein a focal length display control unit performs control to display a current focal length indicating the current focal length and focal lengths at a plurality of preliminary shots indicating focal lengths recorded at the preliminary shots and displayed in order of registration at the preliminary shots on a display unit.

Drawings

Fig. 1 is a block diagram for explaining a configuration example of an image forming apparatus according to an embodiment.

Fig. 2 is a flowchart for explaining a workflow performed by a user at the time of preliminary photographing.

Fig. 3 is a flowchart for explaining an example of processing performed by the imaging apparatus at the time of preliminary shooting.

Fig. 4 is a flowchart for explaining a workflow performed by a user at the time of subsequent photographing.

Fig. 5 is a flowchart for explaining an example of processing of displaying the current focal length and the like.

Fig. 6 is a diagram to be referred to when describing a first example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 7 is a diagram to be referred to in describing a first example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 8 is a diagram to be referred to when describing a second example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 9 is a diagram to be referred to when describing a second example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 10A and 10B are diagrams to be referred to in describing a third example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 11 is a diagram to be referred to in describing a fourth example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 12 is a diagram to be referred to in describing a fifth example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 13 is a diagram to be referred to in describing a fifth example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 14A and 14B are diagrams to be referred to in describing a sixth example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 15 is a diagram to be referred to in describing a seventh example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 16 is a diagram to be referred to in describing an eighth example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 17 is a diagram to be referred to in describing a ninth example of a display method of a current focal length and a focal length at the time of preliminary shooting.

Fig. 18 is a flowchart illustrating a flow of processing of the auto-switching focus control.

Fig. 19 is a flowchart illustrating a flow of processing performed in response to an operation of manually switching focus control.

Fig. 20 is a diagram for explaining the modification.

Fig. 21 is a diagram for explaining the modification.

Fig. 22 is a diagram for explaining the modification.

Detailed Description

Hereinafter, embodiments and the like of the present disclosure will be described with reference to the drawings. Note that description will be given in the following order.

< summary of the disclosure >

< one embodiment >

< modification >

The embodiment and the like described below are preferred specific examples of the present invention, and the disclosure is not limited to this embodiment and the like.

< summary of the disclosure >

First, in order to facilitate an understanding of the present disclosure, an overview of the present disclosure will be described. In general, in shooting of a movie or a television series, a sparing shooting is performed before an actual shooting. If the focal length at the time of the exercise can be used in the actual shooting, a video substantially similar to the video at the time of the exercise can be obtained in the actual shooting. Thus, for example, a current focal length indicating the current focal length and a plurality of focal lengths at the time of preliminary shooting, which indicate focal lengths recorded at the time of preliminary shooting and are displayed in the order of registration at the time of preliminary shooting, are displayed on the display unit. Note that, in addition to information about how much the lens is driven, the focal length may be described in detail by various methods such as a method of detecting the position of the lens, and may also be referred to as a focal position.

Further, in news story shooting, although detailed sparing is not performed like shooting such as dramatic shooting, there is a manual operation of checking focus in advance by aiming a camera at a subject before actual shooting. In this case, an image of the subject as a photographed point and the focal length at that time are recorded in the camera body during a pre-check of a focusing operation before photographing, and the image at the focal length and the focal length are displayed on the viewfinder at the time of actual photographing, so that the photographer can easily perform focusing with the focal length and the image as targets.

As described above, for example, the present disclosure displays, on a display unit, a current focal length indicating the current focal length and focal lengths at the time of a plurality of preliminary shots indicating focal lengths recorded at the time of the preliminary shots and displayed in the order of registration at the time of the preliminary shots. Hereinafter, embodiments of the present disclosure will be described in detail.

< one embodiment >

[ configuration example of imaging device ]

First, a configuration example of an imaging apparatus (imaging apparatus 1) according to an embodiment will be described with reference to fig. 1. The imaging apparatus 1 has an optical system 101, an imaging element 102, a signal processing unit 103, a recording unit 104, a control unit 105, a driving unit 106, a recognition unit 107, a display unit 108, an output unit 109, and an operation unit 110. The control unit 105 has a focus detection unit 105A, a focus display control unit 105B, a focus control unit 105C, and a display control unit 105D as functional blocks.

The optical system 101 includes an imaging lens or the like for condensing light from a subject on the imaging element 102. In general, the optical system 101 has a plurality of lenses such as an incident end lens, a zoom lens, a focus lens, and a condenser lens.

The imaging element 102 includes an imaging element that photoelectrically converts incident light from an object obtained by the optical system 100, converts the light into an electric charge amount, and outputs an imaging signal, and an image signal processing unit that performs known image processing for correcting gain or brightness. As the imaging element, a Charge Coupled Device (CCD), a Complementary Metal Oxide Semiconductor (CMOS), or the like is used.

The signal processing unit 103 performs sample-and-hold to maintain a good signal-to-noise (S/N) ratio by performing Correlated Double Sampling (CDS) processing, automatic Gain Control (AGC) processing, analog-to-digital (a/D) conversion, and the like on the imaging signal output from the imaging element 102, and generates an image signal.

The recording unit 104 is a storage medium such as a hard disk or a flash memory. The video data recorded in the recording unit 104 is saved in a compressed state or a non-compressed state based on a predetermined standard. The control of recording in the recording unit 104 and the control of reading from the recording unit 104 are performed by the control unit 105. The recording unit 104 records the photographed video data, a focal length at the time of preliminary photographing, which will be described later, information related to the focal length at the time of preliminary photographing, including at least one of a thumbnail image corresponding to the focal length at the time of preliminary photographing, a time required for focal length transition, and the like.

The control unit 105 integrally controls the imaging device 1. The focus detection unit 105A detects a focal length. The focal length may be detected based on a signal indicating how many lenses are driven by the focus control unit 105C, may be detected based on a lens position, or may be detected based on edge detection information or depth information. Further, the focal length may be detected for each frame, or may be detected in a case where the position of the lens included in the optical system 101 is detected to be moved.

The focal length display control unit 105B performs control to display, on the display unit 108, a current focal length indicating the current focal length and focal lengths at the time of a plurality of preliminary shots indicating focal lengths recorded at the time of the preliminary shots and displayed in the order of registration at the time of the preliminary shots.

The focus control unit 105C generates focus control data for performing focus control. In the case of operating autofocus, or in the case of manual focus for focus control based on a user operation in the case where the user performs an operation related to focus on the operation unit 110, the focus control unit 105C generates control data.

The display control unit 105D performs control to display the image signal subjected to the signal processing by the signal processing unit 103, the video data recorded in the recording unit 104, and the like on the display unit 108.

The driving unit 106 acquires focus control data by performing communication with the control unit 105, and performs autofocus to focus on a target object by moving the lens by a predetermined amount in the optical axis direction based on the focus control data. Further, the operation of the driving mechanism, shutter mechanism, aperture mechanism, and the like of the optical system 101 is controlled in accordance with the control from the control unit 105. Therefore, the exposure time (shutter speed) is adjusted, and the aperture value (F value) and the like are adjusted.

The recognition unit 107 performs object recognition based on the image signal subjected to the signal processing by the signal processing unit 103. For example, as a result of the object recognition by the recognition unit 107, the recognized object is associated with a focal length obtained when the object is focused.

The display unit 108 is a display device such as a display that displays a live view image as an image signal for display that is processed for display, an image/movie that is image-processed for recording and saving in the recording unit 104, a Graphical User Interface (GUI), and the like.

The output unit 109 is an interface with another device, the internet, or the like. The output unit 109 may include a wired or wireless communication interface. Further, more specifically, the wired or wireless communication interface may include cellular communication such as 3TTE, wi-Fi, bluetooth (registered trademark), near Field Communication (NFC), ethernet (registered trademark), high Definition Multimedia Interface (HDMI) (registered trademark), universal Serial Bus (USB), and the like.

Note that the imaging apparatus 1 may include a communication unit capable of connecting to the internet, other devices, and the like, such as a wireless Local Area Network (LAN), a Wide Area Network (WAN), or wireless fidelity (WiFi). Further, the communication between the imaging apparatus 1 and the external device may be a close range wireless communication such as Near Field Communication (NFC) or ZigBee (registered trademark), or a tethered connection (tethering connection such as WiFi tethered, universal Serial Bus (USB) tethered, or bluetooth (registered trademark) tethered.

The user uses the operation unit 110 to give various instructions to the imaging apparatus 1, for example. If an operation input is made from the user to the operation unit 110, a control signal corresponding to the operation input is generated and supplied to the control unit 105. Then, the control unit 105 executes various processes corresponding to the control signals. Examples of the operation unit 110 include a shutter button for shutter input, physical buttons for various operations, a touch panel, a touch screen configured integrally with a display as the display unit 108, a microphone for receiving voice input, and the like. Further, the operation unit 110 includes a focus ring for manual focusing. Note that manual focus may be set by a touch panel or a button-type operation mechanism.

Although the configuration example of the imaging apparatus 1 has been described above, the configuration of the imaging apparatus 1 may be appropriately changed. For example, the imaging apparatus 1 may include a sensor that acquires depth information, or may include a communication unit that communicates with another device.

[ example of operation of imaging device ]

(operation example in preliminary shooting)

Next, an operation example of the imaging apparatus 1 will be described. First, an operation example of the imaging apparatus 1 in preliminary shooting will be described with reference to a flowchart shown in fig. 2. The preliminary photographing may be a sparing photographing, or may be photographing performed before the sparing photographing. The flow illustrated in fig. 2 is a flow of a workflow performed by a focus person responsible for focusing, for example.

In step ST11, the angle of view and the photographed object are determined. Then, the process proceeds to step ST12.

In step ST12, the most suitable focal length is determined. For example, the focus ring of the imaging apparatus 1 is appropriately operated, and the focal length is determined while fine-tuning. Then, the process proceeds to step ST13.

In step ST13, an operation of registering in advance the optimal focal length and the image corresponding to the focal length in the imaging apparatus 1 is performed. This operation gives a trigger. The operation is given a trigger for an operation of pressing an assignable switch, voice input, or the like. This registered focal length is a focal length at the time of preliminary shooting.

In step ST14, a time corresponding to the focal length at the time of preliminary shooting is determined and registered. For example, such time is an elapsed time from the storage start timing. For example, a time corresponding to the focal length at the time of preliminary shooting is stored in the recording unit 104 in association with image data corresponding to the focal length at the time of preliminary shooting.

Note that a plurality of focal lengths at the time of preliminary shooting may be set. In this case, the above-described process is repeated for the number of focal lengths at the time of preliminary shooting. In the following description, unless otherwise specified, it is assumed that three preliminary photographing focal lengths (preliminary photographing focal length a, preliminary photographing focal length B, and preliminary photographing focal length C) are set.

Fig. 3 is a flowchart illustrating a flow of a specific process performed by the imaging apparatus 1 in response to the above-described operation.

In step ST21, the control unit 105 determines whether the mode of the imaging device 1 is a focus recording mode in which a focus is recorded. In the case where the mode of the imaging apparatus 1 is not the focus recording mode, the process of step ST21 is repeated. In the case where the mode of the imaging apparatus 1 is the focus recording mode, the process proceeds to step ST22.

In step ST22, the focus detection unit 105A detects a focal length. The detection of the focal length may be performed for each frame, may be performed in a case where a change in the position of a lens included in the optical system 101 is detected, or may be performed at other timings. Then, the process proceeds to step ST23.

In step ST23, it is determined whether there is a user operation. Such a user operation is an operation for recording the focal length. For example, the control unit 105 determines whether there is a user operation based on the presence or absence of an operation signal from the operation unit 110. In the case where there is no user operation, the process returns to step ST23. In the case where there is a user operation, the process proceeds to step ST24.

In step ST24, the focal length detected in step ST22 is saved as the focal length at the time of preliminary shooting. Specifically, the control unit 105 records the focal length detected by the focus detection unit 105A in the recording unit 104 as the focal length at the time of preliminary shooting. Then, the process proceeds to step ST25.

In step ST25, the control unit 105 determines whether the process is ended. For example, it is determined that the process has ended when the power of the imaging apparatus 1 is turned off or the focus recording mode is ended. In the case where it is determined that the processing has ended, the entire processing ends. In the case where it is determined that the processing has not ended, the processing returns to step ST22.

(operation example in subsequent shooting)

Next, an operation example of the imaging apparatus 1 in the subsequent shooting will be described with reference to a flowchart shown in fig. 4. The subsequent photographing is photographing performed after the preliminary photographing, and specific examples thereof include actual photographing and sparing photographing. The flowchart shown in fig. 4 is also a flow of a workflow performed by, for example, a focusing operator who is responsible for focusing.

In step ST31, a user operation of recording video is performed. Then, the process proceeds to step ST32.

In step ST32, the current focal length and the focal length at the time of preliminary shooting are displayed on the display unit 108. The user performs a focusing operation such that the current focal length matches the focal length at the time of preliminary photographing. Then, the process proceeds to step ST33.

In step ST33, it is determined whether or not shooting is ended. If the photographing has not been completed, the process returns to step ST32. When the photographing is completed, the process proceeds to step ST34.

In step ST34, the user stops the process of recording video.

(display of an operation example of the present focal Length and the like)

Next, an operation example of displaying the current focal length and the like in the imaging apparatus 1 will be described with reference to the flowchart of fig. 5. For example, when a display mode for displaying the current focal length or the like is set, the current focal length or the like is displayed.

In step ST41, a process of reading the saved focal length at the time of preliminary shooting is performed. For example, the focal length display control unit 105B reads the focal length at the time of preliminary shooting from the recording unit 104. Further, the focal length display control unit 105B acquires the current focal length from the focal point detection unit 105A. Then, the process proceeds to step ST42.

In step ST42, the focus display control unit 105B performs control to display information including the current focus and the focus at the time of preliminary shooting on the display unit 108. Then, the process ends.

Specific examples of the display methods of the current focal length and the focal length at the time of preliminary shooting

(first example)

Next, specific examples of a display method of the current focal length and the focal length at the time of preliminary shooting will be described. The display methods of the current focal length and the focal length at the time of preliminary shooting include a plurality of display methods, and the focal length display control unit 105B selects at least one of the plurality of display methods. Then, the focal length display control unit 105B performs control for realizing the selected display method. Note that the focal length display control unit 105B may perform control for realizing a display method obtained by combining a plurality of display methods.

In the first example, as shown in fig. 6, a case where the user (photographer) U changes the focal length from the object HA to the object HB to the object HC at the same angle of view will be regarded as an example. The focal length corresponding to the object HA is the preliminary photographing focal length a, the focal length corresponding to the object HB is the preliminary photographing focal length B, and the focal length corresponding to the object HC is the preliminary photographing focal length C.

Fig. 7 is a diagram illustrating an example of information displayed on the display unit 108 in the first example. In the area AR of the display unit 108 on the lower side of the portion near the center, a currently photographed video (image) is displayed. Further, a focus bar FB is displayed on the upper side of the display unit 108, and a sparing video RV photographed in a preliminary photographing (sparing photographing in this example) is displayed below the focus bar FB.

The focus bar FB indicates a focal length and is a rectangular bar extending in the lateral direction of the display unit 108. The focusing bar FB may be a rectangular bar extending in the vertical direction of the display unit 108, or may have a shape other than a rectangle. On the upper side of the focus bar FB, a black triangle indicating each of the preliminary photographing focal lengths A, B, C is displayed together with order information indicating the order of focal lengths at the time of preliminary photographing. The information indicating the order of the focal lengths may be numerals instead of letters. Further, a mark 11 indicating the current focal length corresponding to the current focal length acquired by the focus detection unit 105A is displayed in the focus bar FB. The marks 11 according to the present example are, for example, black lines extending in the vertical direction, but may be another display manner.

Further, on the upper side of the focus bar FB, transition information 12 is displayed. The transition information 12 according to the present example is indicated with a black triangle, for example, but may also be another display mode. The transition information 12 is information indicating a transition of the focal length at the time of the rehearsal shooting, and moves on the focus bar FB. There is a case where the transition information 12 moves rightward on the focus bar FB, and there is a case where the transition information 12 moves leftward on the focus bar FB. Note that, for example, transition information may be displayed by recording a focal length associated with each frame of an image obtained at the time of preliminary shooting and reading the focal length associated with each frame at the time of reproducing the image obtained at the time of preliminary shooting.

When the actual photographing is started, the video being photographed is displayed in the area AR of the display unit 108. Further, the photographed video data obtained in the sparing photographing is reproduced from the recording unit 104 by the control unit 105. Further, the focal length of each frame of the video data for shooting obtained in the sparing shooting is supplied to the focal length display control unit 105B. The focus display control unit 105B displays the focus in the upper portion of the focus bar FB while moving the display position of the transition information 12 based on such a focus position for each frame.

Further, the captured video data obtained in the exercise capturing is temporarily adjusted by the control unit 105, and then displayed on the display unit 108 as an exercise video RV by the display control unit 105D. Further, images corresponding to the focal lengths A, B and C at the time of preliminary shooting, respectively, are read from the recording unit 104 by the focal length display control unit 105B. For example, the focal length display control unit 105B displays images corresponding to the focal lengths A, B and C at the time of preliminary shooting as thumbnail images SA, SB, and SC at predetermined positions of the sparing video RV based on times associated with the images corresponding to the focal lengths A, B and C at the time of preliminary shooting, respectively. An arrow 13 indicating a reproduction position is displayed on the upper side of the training video RV.

Note that since it is sufficient if the total video recording time is known from the sparing video RV, the video between thumbnail images may be thinned out and displayed, or in the case where the recording time of the sparing video RV is very long, the intermediate portion may be omitted and hidden.

The sparing video RV is reproduced simultaneously with the start of recording. The user U adjusts the focus position so that the mark 11 indicating the current focus distance matches the transition information 12.

Note that focusing may be temporarily stopped at the focal length at each preliminary shooting. In the case of producing a movie or a television series, there are many cases where recording is started before the start of a performance by an instruction of a director (for example, an instruction of "action"), instead of the time from the start of recording to the focal length, so that a block capable of starting the performance by instruction voice detection of the director can be provided inside the imaging apparatus 1, and the start point of a video can be adjusted between the practice and the actual shooting based on the start of the performance.

As in the present example, by displaying the transition information 12, a focus change similar to that at the time of preliminary shooting can be reproduced in actual shooting.

(second example)

Next, a second example will be described. The second example is an example of a display method considering a use case photographed in a news story. In the photographing of news stories, detailed sparing is not performed before actual photographing, but photographing operations are checked in advance before actual photographing. A photographed image of a subject as a point to be photographed and a focal length at that time are recorded in a memory of a main body of the imaging apparatus 1. Unlike the first example, since the time from the focal length at the start of recording to the focal length of recording and the time interval between the respective focal lengths are not particularly determined, they are set and recorded in the recording unit 104 using a menu screen or the like of the imaging apparatus 1 as a guide at the time of shooting. The focal length at the time of preliminary shooting and the image corresponding thereto registered in advance before actual shooting are displayed on the time axis, and for example, the photographer performs focusing so that the focus ring is operated with the focal length at the time of preliminary shooting as a guide, and the current focal length is made coincident with the focal length at the time of preliminary shooting and stopped there.

Description will be made taking a reporter field report as an example. As shown in fig. 8, the user U first adjusts the viewing angle to the reporter HD, then adjusts the viewing angle to the front side house 20A, and then adjusts to the rear side house 20B. Before the actual shooting, the user U registers the focal lengths A, B and C at the time of preliminary shooting as target positions to stop the focusing operation in association with the angle of view using a menu or an assignable button.

Thereafter, a time corresponding to the focal length at the time of each preliminary shooting is acquired by the control unit 105 and registered in association with the focal length at the time of the preliminary shooting. For example, the time is acquired based on a counter included in the control unit 105. The user U moves the current focus position to match the movement of the focal length at the time of the preliminary photographing, and stops the focus operation of the focal length at the time of each preliminary photographing.

Fig. 9 is a diagram illustrating an example of information displayed on the display unit 108 in the second example. Although substantially similar to the first example, in the case of a news story, the training video RV is not displayed, but only thumbnail images SA, SB, and SC corresponding to the focal lengths at the time of the respective preliminary shots are displayed.

Third example

The present example is an example of a display method concerning a thumbnail image displayed together with the focus bar FB. There are cases where it is not possible to determine exactly whether focusing is for a front subject or for a rear subject only by thumbnail images because the images are too small or the difference in focus level is not large. For this reason, in order to display a focused object or portion in an easy-to-understand manner, a process of emphasizing the focused object and portion by emphasizing a contour or the like and strongly blurring an unfocused object and portion is performed on the thumbnail image. Further, processing is performed to leave a color or add a color by color peaking or the like to a focused object, and to reduce the hue of an unfocused object to be close to black and white or full black and white. By performing the above-described processing, even in a small thumbnail image, the user can easily recognize a focused object and portion.

For example, in the case where there are two flowers on the front and back, the flower on the front is focused at the preliminary photographing focal length a, and the flower on the back is focused at the preliminary photographing focal length B. In this case, for the thumbnail displayed in the actual shooting, as shown in fig. 10A, the front flower in the thumbnail SA corresponding to the preliminary shooting focal length a is emphasized, and as shown in fig. 10B, the back flower in the thumbnail SB corresponding to the preliminary shooting focal length B is emphasized.

For example, the generation of the thumbnail image shown in fig. 10A and 10B is performed by the display control unit 105D. Since the angle of view and position of the subject in the video read from the recording unit 104 substantially match those in the captured image, the display control unit 105D generates a thumbnail image after performing emphasized focusing or defocusing on the image data associated with the focal length in the training video RV. The generated thumbnail image is displayed together with the video being photographed.

Fourth example

Next, a fourth example of the display method will be described. Depending on the vertical and horizontal dimensions of the imaged effective image, there is a case where the outside of the effective image is a black image when viewing the display image displayed on the display unit 108. As shown in fig. 11, the thumbnail image in the above example may be displayed in the black image area ARB. For example, when shooting a movie, there is a case where shooting is performed at a horizontal aspect ratio (horizontally long aspect) such as 2.4:1, and there is a case where display is performed by inserting a wide screen (screen) of a black image above and below when using the display unit 108 of 16:9. By displaying thumbnail images in upper and lower black image areas, it is possible to simultaneously display video of an effective area and thumbnail images.

In the case where there are a plurality of focal lengths at the time of preliminary shooting, thumbnail images are easily associated with images corresponding to the focal lengths at the time of the respective preliminary shooting. However, there is a case of one focal length, or a case where a thumbnail image is associated with an object in the head of the user U and the thumbnail image is unnecessary is possible. In view of the above, the thumbnail image may be hidden.

Fifth example

Next, a fifth example of the display method will be described. In the example shown in fig. 7 and 9, display is performed below the focus bar FB (i.e., side by side in the vertical direction of the display unit 108). However, as shown in fig. 12, the display may also be performed on the focus bar FB side (i.e., side by side in the lateral direction of the display unit 108).

In the case where there is no black image area outside the video effective area (area corresponding to the area AR), there is a case where the focus bar FB is displayed in the video effective area. In this case, if the thumbnail image is arranged below the focus bar FB, the video displayed in the area AR becomes difficult to see. By disposing the thumbnail images beside the focus bar FB, the area occupied by the focus bar FB and the thumbnail images can be reduced. Control related to such display is performed by the display control unit 105D.

In the case of dramatic shooting or story shooting, it is also important to indicate the current shooting position with respect to the entire recording time of the sparing video. In this case, the position may be displayed with a mark or a character, for example, in an area smaller than the thumbnail image.

Further, by the control of the display control unit 105D, the display mode of the thumbnail image can be changed according to the progress of the order of the focal lengths at the time of preliminary shooting to be adjusted. For example, after the timing at which the current focal length is set to the focal length a at the time of preliminary shooting, a thumbnail SB corresponding to the next focal length B at the time of preliminary shooting may be displayed so as to be distinguished from other thumbnail images. Specifically, as shown in fig. 13, the thumbnail image SB may be displayed to be surrounded by a frame of a predetermined color (e.g., a red frame). In this case, the thumbnail image SA for which photographing of the focal length has been performed may be surrounded by a frame of another color (e.g., a green frame) and displayed. The color box allows the user U to identify the order of focal lengths to adjust. Thumbnail images whose order has been already deleted. In the case where a character is displayed in the center of a thumbnail image, the character can be displayed semi-transparently since an object in the image needs to be visually recognized.

Note that, in the case where there is no black image area, a thumbnail image may be displayed in the effective area as a picture-in-picture image.

Sixth example

Next, a sixth example of the display method will be described. The present example is an example of a display method concerning the focus bar FB. In the case where the difference between the mark 11 as the current focal length and the focal length at the time of preliminary photographing is equal to or smaller than the threshold value, the portion including the mark 11 in the focus bar FB may be enlarged and displayed. The determination of whether the difference is equal to or smaller than the threshold value, and the enlargement and display are performed by the focal length display control unit 105B. Some display control may be performed by the display control unit 105D.

For example, as shown in fig. 14A, the mark 11 approaches the focal length B. In the case where the difference between the mark 11 and the focal length B at the time of preliminary shooting is equal to or smaller than the threshold value, the portion including the mark 11 and the focal length B may be enlarged and displayed as shown in fig. 14B. Note that, for example, the focus display control unit 105B obtains a difference between the mark 11 and the focus B at the time of the preliminary shooting based on the time corresponding to the mark 11 (for example, the time from the start of recording) and the elapsed time at the time of setting the focus B at the time of the preliminary shooting, and determines whether the obtained difference is equal to or smaller than a threshold value. The display method according to the present example enables fine adjustment of the focus to be easily performed when the current focus is close to the predetermined focus at the time of preliminary shooting.

Seventh example

Next, a seventh example of the display method will be described. Fig. 15 is a diagram illustrating a display mode according to the present example. As shown in fig. 15, the thumbnail image is not required to be displayed. In the case where the thumbnail image is not displayed, since the object corresponding to the focal length at each preliminary shooting is unknown, the objects HA1, HB1, HC1 focused at the respective focal lengths at the preliminary shooting are surrounded by rectangular frames, so that the position of the object at the focal length at each preliminary shooting can be known based on the training video RV. In this case, the subjects HA, HB1, and HC1 in focus at the corresponding focal lengths at the time of the preliminary shooting are recorded in association with the focal lengths at the time of the preliminary shooting. The manner of indicating the subjects HA1, HB1, and HC1 may be such that the training video RV becomes translucent and displayed to be superimposed on the currently captured image. Further, as shown in fig. 15, among the currently photographed subjects HA1, HB1, and HC1, the focused subject may be emphasized. For example, processing of displaying the outline of the focused object in an emphasized manner or blurring an image portion other than the focused object is performed. This process is performed by the display control unit 105D, for example.

Further, as shown in fig. 15, (1), (2), and (3) can be displayed in the vicinity of the focal length at the time of the corresponding preliminary photographing in the focus bar FB, so that the order of photographing can be known.

Further, a focal length transition required time, which is a time required when the focal position moves from the focal length at the time of the first preliminary shooting registered at the first timing of the preliminary shooting to the focal length at the time of the second preliminary shooting registered at the second timing later than the first timing, may be displayed. For example, the time 31 required for focal length transition measured when the focal length is changed from focal length a to focal length B is displayed on the display unit 108. In the example shown in fig. 15, two seconds are displayed on the right side of the focus bar FB as the time required for focal length transition 31. By such display, the user U can know the quantization time for the focal position to move to the focal length B when the current focal position is at the focal length a. Note that, in the case of the present example, a first timing (for example, an elapsed time from a preliminary shooting start time) of recording the focal length at the time of the first preliminary shooting is recorded in association with the focal length at the time of the first preliminary shooting. The same applies similarly to the second timing. For example, the focal length display control unit 105B calculates the time between the first timing and the second timing, and displays the calculation result as the focal length transition required time 31.

Further, the time 32 measured from the start of shooting to the focal length at the time of transition to each preliminary shooting may be displayed. In the example shown in fig. 15, as the time 32 of the transition to the focal length at the time of each preliminary shooting, the time of the transition to the focal length a at the time of the preliminary shooting is 3 to 6 seconds, the time of the transition to the focal length B at the time of the preliminary shooting is 8 to 15 seconds, and the time of the transition to the focal length C at the time of the preliminary shooting is 20 to 30 seconds are displayed.

Eighth example

Next, an eighth example of the display method will be described. Fig. 16 is a diagram illustrating a display mode according to the present example. In this example, the focal length is displayed not only in the focus bar FB but also in the graph.

As shown in fig. 16, for example, the graph G is a graph in which the vertical axis represents the focal position and the horizontal axis represents time. Unlike fig. 15, the change speed of the focal length is represented by the gradient (inclination angle) of the graph G. On the line of the graph G, for example, two

circular marks

41 and 42 moving on the line of the graph G are displayed. The mark 41 is a display corresponding to the mark 11, and the mark 42 is a mark corresponding to the current focal length. The user U simply adjusts the focus to match the indicia 41 with the indicia 42. In this case, the moving speed of the focal position may be adjusted according to the gradient of the graph G. For example, the graph G is largely superimposed on the currently photographed object.

Ninth example

Next, a ninth example of the display method will be described. Fig. 17 is a diagram illustrating a display mode according to the present example. In the present example, the focus bar FB is not displayed, but thumbnail images SA to SB corresponding to the focal lengths at the time of the respective preliminary shots are displayed.

The rectangular frame surrounding the outside of the subjects HA1, HB1, HC1 shown in fig. 17 indicates a subject at a focal length at the time of preliminary shooting. However, in the present example, since the thumbnail images SA to SC are displayed, the frame surrounding the outside of each subject can be hidden.

In the present embodiment, above each thumbnail image, there is a number indicating the order of the focal lengths at the time of preliminary shooting and the focal length at the time of preliminary shooting at that time indicated by a number. By indicating the focal length at the time of preliminary shooting with a number, the user U can know how much the current focal length needs to be quantitatively moved so that the focal length at the time of the next preliminary shooting is adjusted. In the example shown in fig. 17, similarly to the example shown in fig. 15, the time 31 required for the focal length transition and the time 32 from the start of shooting to the focal length at the time of transition to each preliminary shooting are displayed.

The display elements in the above-described various display modes may be combined.

Note that the focus display control unit 105B may select one of the above-described plurality of display methods according to the shooting mode. For example, the shooting modes are shooting modes in which recording formats are different from each other. Specifically, the shooting mode is a shooting mode for drama and movie and a shooting mode for report and news. The former is generally recorded as RAW data (data recorded in a RAW mode and recorded data having an uncompressed or compression ratio equal to or smaller than a threshold value), and the latter is compressed and recorded in an appropriate format.

Specific examples will be described. In the case of shooting a movie or a drama, there are many cases where a focus-adjusting operation is performed by a focus-adjusting person, and a monitor viewed by the focus-adjusting person is a small monitor attached to an upper portion of the imaging apparatus 1 or a medium-sized display mounted on a movable tripod. Further, there are also cases where a ranging sensor is connected and its output is superimposed on the imaged image. As described above, since there is a case where there is a shortage of screen area in which a focus and a thumbnail can be displayed and visually recognized, it is desirable to provide a menu that enables display switching according to the preference of the user U or enables switching of display by an operation using a specifiable switch. In view of the above, in the case where the shooting mode is a shooting mode for drama and movie, the display methods shown in fig. 12, 13, 15, 16, and 17 are preferable. However, even in the case of shooting a movie or a television show, in the case where the monitor for focusing operation may be a large screen, there is a case where it is possible to ensure that the focal length at the time of preliminary shooting and the region of the thumbnail image are displayed simultaneously. Therefore, in the case of a shooting mode for drama and movie, another display mode can be adopted.

On the other hand, in the case of news report shooting, basically, the camera operator operates the imaging apparatus 1 and the lens all by himself/herself. At this time, the focusing operation is performed while viewing the small viewer. For this reason, the monitor has a high possibility of small screen, and it is desired to display or prepare a focal length or a thumbnail image at the time of shooting, or to enable display switching of temporary hidden display. Further, since the aspect ratio of the effective image area is 16:9 in many cases, it is difficult to display the focal length and thumbnail image at the time of preliminary shooting outside the video effective area as shown in fig. 12 and 13. In view of the above, in the case of the shooting mode for stories and news, for example, the display method shown in fig. 15 and 16 in which thumbnail images are not displayed is employed.

[ switching of Focus control ]

Although it is assumed in the above description that manual focusing is performed when the focus is adjusted to the focal length at the time of preliminary photographing, it is also possible to automatically cause movement by auto focusing. In the case of dramatic shooting or the like, in the case where it is desired that the focus movement in actual shooting and the focus movement in sparing shooting completely match, auto focus is set in focus setting by an operation or an assignment button on a menu screen, and the focus movement is performed automatically. Further, switching of focus control may be automatically performed.

Fig. 18 is a flowchart illustrating a flow of processing of the auto-switching focus control. For example, control of switching of focus control is performed by the control unit 105. Further, a description will be given assuming that the focus control at the start of the process is manual control.

In step ST51, the control unit 105 acquires the current focal length acquired by the focus detection unit 105A. Then, the control unit 105 determines whether the difference (absolute value) between the current focal length and the focal length at the time of preliminary shooting is smaller than the threshold ThA. In the case where the difference is greater than the threshold ThA (in the case of "no"), the process returns to step ST51, and the process of step ST51 is repeated. In the case where the difference is smaller than the threshold ThA (in the case of yes), the process proceeds to step ST52.

In step ST52, the focus control unit 105C switches focus control from Manual Focus (MF) to Auto Focus (AF). The switching to the auto focus is because in the case where the current focal length is close to the focal length at the time of preliminary shooting, the auto focus is more likely to be able to properly adjust the focal length than the manual focus. Then, the process proceeds to step ST53.

In step ST53, the control unit 105 determines whether or not there is an operation to switch the focus control to manual focus. Examples of such operations include, for example, an operation of pressing a dedicated switch for switching focus control and whether or not a focus ring is touched (specifically, whether or not a sensor such as a touch sensor provided in the focus ring is touched). In the case of no operation, the process returns to step ST53, and the determination process of step ST53 is repeated. In the case where there is an operation, the process proceeds to step ST54.

In step ST54, the focus control unit 105C switches focus control from automatic focusing to manual focusing. The above-described processing is repeated during preliminary shooting such as actual shooting. For example, when shooting ends, the above-described processing ends.

Fig. 19 is a flowchart illustrating a flow of processing performed in response to an operation of manually switching focus control. In step ST61, the control unit 105 determines whether there is an operation. Such an operation is, for example, a pressing operation of a dedicated switch. The operation may be an operation of not touching the focus ring for a predetermined time or more. In the case where the determination result is no, the process returns to step ST61, and the determination process of step ST61 is repeated. In the case where the determination result is yes, the process proceeds to step ST62.

In step ST62, the focus control unit 105C switches the focus control from manual focus to automatic focus. Then, the process proceeds to step ST63.

In step ST63, the control unit 105 determines whether there is an operation. This operation is the same as the operation of determining the presence or absence in step ST 61. In the case where the determination result is no, the process returns to step ST63, and the determination process of step ST63 is repeated. In the case where the determination result is yes, the process proceeds to step ST64.

In step ST64, the focus control unit 105C switches the focus control from automatic focusing to manual focusing. The above-described processing is repeated during preliminary shooting such as actual shooting. For example, when shooting ends, the process ends.

In the above-described process, in the case where a function such as a touch sensor is incorporated in the focus ring, a manual focusing operation may be performed while touching the focus ring, and an automatic focusing operation may be performed while releasing the hand from the focus ring. Thus, the advantage of not requiring the use of other fingers for button operation in addition to the operation of the focus ring is obtained.

[ Effect obtained by the present embodiment ]

According to the present embodiment, for example, the following effects can be obtained.

A more user-friendly display can be performed on the focus at the time of the sparing.

Although the performance of autofocus has been increasing recently, it is difficult to perform focusing intended by a photographer only by autofocus. Particularly in the production of movies or dramas, focusing is one of video manifestations of video producers and changes depending on shooting scenes, such as slow focusing or fast focusing on a subject, and it is difficult to incorporate the producer's intention into an autofocus operation each time, or to obtain the same reproducibility of the focus operation and focus accuracy as in the case of sparing. Further, in recent years, there are increasing cases where photographing is performed by a combination of a shallow depth lens and a camera, or a camera mounted with a high resolution image sensor is used, regardless of photographing workflow. On the other hand, since a screen of a monitor for photographing attached to a camera is often a small monitor having a resolution lower than that of an image sensor, it is difficult for a photographer to check the accuracy of focusing. However, according to the present embodiment, for example, since it is possible to check a plurality of focal lengths while capturing an image and to perform capturing while capturing an image at that time, it is possible to improve reproducibility of a focusing operation at the time of manually performing focusing and accurately adjust the current focal length to the focal length at the time of preliminary capturing.

Further, in the present embodiment, for example, the focal length at the time of preliminary photographing and the image at that time are displayed simultaneously, and the images are displayed so that the in-focus position is easily known even with a small thumbnail image. Therefore, in the case where there are a plurality of focal lengths at the time of preliminary shooting, the focal length at the time of preliminary shooting can be easily associated with the subject or part.

Further, in the present embodiment, for example, since the focal length at the time of preliminary photographing and the image at that time can be checked on the same monitor as the photographed video viewed by the photographer, the user can easily perform focusing.

< modification >

Although one embodiment of the present disclosure has been specifically described above, the disclosure of the present disclosure is not limited to the above-described one embodiment, and various modifications based on the technical idea of the present disclosure are possible.

First modification

In the above-described embodiment, the registration position of the focal length at the time of preliminary shooting and the order of the focal length at the time of preliminary shooting may be changed later. Fig. 20 is a flowchart illustrating a flow of processing performed by the imaging apparatus 1 in response to an operation of correcting a focal length later. For example, the processing shown in fig. 20 is processing performed in a case where a mode for correcting the focal length at the time of preliminary shooting is set.

In step ST71, the control unit 105 reads representative images (for example, thumbnail images) respectively corresponding to the focal lengths at the time of the plurality of preliminary shots recorded in the recording unit 104. The display control unit 105D displays all the read images on the display unit 108. Then, the process proceeds to step ST72.

In step ST72, the display control unit 105D displays the representative image selected by the user U to be subjected to fine correction on the display unit 108. Then, the process proceeds to step ST73.

In step ST73, the control unit 105 records the corrected representative image in the recording unit 104 in association with the focal length at the time of preliminary shooting associated before correction.

Fig. 21 is a diagram illustrating a specific example of the above-described processing. On the left side of the display unit 108, thumbnail images corresponding to a predetermined focal length at the time of preliminary shooting are displayed. Such thumbnail images are images focused on the nose. Further, on the right side of the display unit 108, the currently photographed image is displayed. For example, when the user corrects the focal length a from the nose position 51 to the eye position 52 of the face, the corrected focal length a' is recorded in the recording unit 104.

Second modification

It is also assumed that a case occurs in which the position of the subject of the imaging apparatus 1 currently capturing a drama or movie does not match the position of the subject in preliminary shooting such as at the time of the sparing shooting. Video synchronization of an object is achieved between a sparing video and a currently shot video by automatically detecting a shooting start timing instruction based on a slate sound or video used at the start of movie or drama shooting or the sound of a director in terms of voice and video. Also, the delay adjustment is performed in units of frames.

In the case where the currently photographed video is significantly different from the exercise video due to a change in performance of a performer or a change in photographing environment, the focal length may also be changed. In this case, a warning display such as adding a color to the outer frame of the screen to cause flickering may be displayed so that a photographed person can recognize a change in the angle of view and a change in the subject.

For example, as shown in fig. 22, the position of the actor 61 at the time of exercise is the position P1, and the position of the actor 61 in the current shooting is the position P2. For example, the recognition unit 107 recognizes each of the positions P1 and P2 by performing object recognition, and sends the recognition result to the control unit 105. The control unit 105 may display a warning display in the case where it is determined that the position P1 and the position P2 transmitted from the recognition unit 107 are separated by a threshold value or more.

Note that, since there is a case where the photographer intentionally changes the photographing angle of view or the subject as compared with the exercise, a user interface for updating the original exercise video after photographing may be provided. Further, in the case where a gyro sensor or a Global Navigation Satellite System (GNSS) is mounted on the imaging apparatus 1, the photographing position and photographing direction of the imaging apparatus 1 are known. Therefore, if recording is performed as metadata of the shooting position and the shooting direction at the time of the sparing shooting, a difference from the shooting position and the shooting direction of the camera at the time of the current shooting can be obtained. In the case where the difference is large to the threshold value or more, a warning display may be displayed.

Further, in the case where the angle of view of the imaging apparatus 1 currently performing photographing does not match (differs by a predetermined value or more) the angle of view at the time of preliminary photographing such as the sparing photographing, a warning display may be displayed, or in the case where the position of the subject and the angle of view differ by a predetermined value or more, a warning display may be displayed. Further, in the case where the difference between the current focus position and the focal length is equal to or greater than the threshold value, a warning display may be displayed.

[ other modifications ]

The configuration of the image forming apparatus according to the above-described embodiments and modifications may be appropriately changed. Further, part of the processing in the imaging apparatus may be performed by a server device or the like on the cloud.

The configurations, methods, steps, shapes, materials, numerical values, and the like described in the above embodiments and modified examples are merely examples. Different configurations, methods, steps, shapes, materials, values, etc. than those described above may be used as desired, and the configurations, methods, steps, shapes, materials, values, etc. described above may be replaced with known configurations, methods, steps, shapes, materials, values, etc. In addition, configurations, methods, steps, shapes, materials, numerical values, and the like in the embodiments and modifications may be combined with each other within the scope not causing technical contradiction.

Note that the content of the present disclosure should not be interpreted as being limited by the effects exemplified in the present specification.

The present disclosure may also employ the following configuration.

(1)

(2)

The image forming apparatus according to (1),

wherein the display methods of the current focal length and the focal length at the time of preliminary photographing include a plurality of display methods, and the focal length display control unit selects at least one of the plurality of display methods.

(3)

The image forming apparatus according to (2),

wherein the plurality of display methods includes a display method of displaying a current focal length and focal lengths at the time of the plurality of preliminary shots through a focus bar.

(4)

The image forming apparatus according to (3),

wherein the plurality of display methods includes a display method of displaying a plurality of thumbnail images respectively corresponding to focal lengths at the plurality of preliminary shots together with a focus bar.

(5)

The image forming apparatus according to (4),

wherein the display mode of the thumbnail images is changed according to the progress of the order.

(6)

The image forming apparatus according to (2),

wherein the plurality of display methods includes a display method of displaying order information indicating an order of focal lengths at the time of the plurality of preliminary shots.

(7)

The image forming apparatus according to (2),

wherein the plurality of display methods includes a method for displaying a graph in which a vertical axis represents a focal position and a horizontal axis represents time.

(8)

The image forming apparatus according to (2),

wherein the focus display control unit selects one of the plurality of display methods according to the photographing mode.

(9)

The image forming apparatus according to (8),

wherein the shooting modes include shooting modes for dramas and movies and shooting modes for stories and news.

(10)

The image forming apparatus according to any one of (1) to (9),

wherein the focal length display control unit performs control such that the currently photographed image is also displayed on the display unit.

(11)

The image forming apparatus according to (10),

wherein the focal length display control unit performs control to emphasize an object in current focus when the current captured image is displayed on the display unit.

(12)

The image forming apparatus according to (11),

wherein the focus display control unit displays the outline of the focused subject in an emphasized manner or displays the image portion other than the focused subject after the blurring process.

(13)

The image forming apparatus according to (1),

wherein the focal length display control unit enlarges and displays a portion of the focus bar including the current focal length and the focal length at the time of the preliminary photographing in a case where a difference between the current focal length and the focal length at the time of the preliminary photographing is equal to or smaller than a threshold value.

(14)

The image forming apparatus according to (1),

wherein the focal length display control unit performs control to display a time required for focal length transition, which is a time required at the time of a focal length at the time of preliminary shooting when the focal length moves from a focal length at the time of a first preliminary shooting registered at a first timing to a focal length at the time of a second preliminary shooting registered at a second timing later than the first timing.

(15)

The image forming apparatus according to any one of (1) to (14),

wherein the focus display control unit performs the warning display in a case where a difference between the current focus and the focus at the time of preliminary photographing is equal to or greater than a threshold value.

(16)

The image forming apparatus according to any one of (1) to (15),

wherein the focal length display control unit performs the warning display in a case where at least one of the angle of view of the current captured image or the subject position is different from that at the time of preliminary capturing.

(17)

The image forming apparatus according to any one of (1) to (16),

wherein the focal length at the time of the preliminary photographing and the information related to the focal length at the time of the preliminary photographing are stored in association with each other.

(18)

The image forming apparatus according to (17),

wherein the information related to the focal length at the time of the preliminary photographing includes at least one of a thumbnail corresponding to the focal length at the time of the preliminary photographing or a time required for focal length transition.

(19)

(20)

List of reference numerals

1. Image forming apparatus

104. Recording unit

105. Control unit

105B focus display control unit

108. Display unit

Claims

1. An imaging apparatus includes a focal length display control unit that performs control to display, on a display unit, a current focal length indicating the current focal length and focal lengths at a plurality of preliminary shots indicating focal lengths recorded at the time of the preliminary shots and displayed in order of registration at the time of the preliminary shots.

2. The image forming apparatus according to claim 1,

3. The image forming apparatus according to claim 2,

4. An imaging apparatus according to claim 3,

5. The image forming apparatus according to claim 4,

6. The image forming apparatus according to claim 2,

7. The image forming apparatus according to claim 2,

8. The image forming apparatus according to claim 2,

9. The image forming apparatus according to claim 8,

10. The image forming apparatus according to claim 1,

11. The image forming apparatus according to claim 10,

12. The image forming apparatus according to claim 11,

13. The image forming apparatus according to claim 1,

14. The image forming apparatus according to claim 1,

15. The image forming apparatus according to claim 1,

16. The image forming apparatus according to claim 1,

17. The image forming apparatus according to claim 1,

18. The imaging apparatus of claim 17,

19. A method of controlling an imaging apparatus, wherein a focal length display control unit performs control to display, on a display unit, a current focal length indicating the current focal length and focal lengths at a plurality of preliminary shots indicating focal lengths recorded at the time of the preliminary shots and displayed in order of registration at the time of the preliminary shots.

20. A program for causing a computer to execute a method of controlling an imaging apparatus, wherein a focal length display control unit performs control to display a current focal length indicating the current focal length and focal lengths at a plurality of preliminary shots indicating focal lengths recorded at the preliminary shots and displayed in order of registration at the preliminary shots on a display unit.