WO2008050806A1 - Imaging device and reproduction control device - Google Patents
Imaging device and reproduction control device Download PDFInfo
- Publication number
- WO2008050806A1 WO2008050806A1 PCT/JP2007/070745 JP2007070745W WO2008050806A1 WO 2008050806 A1 WO2008050806 A1 WO 2008050806A1 JP 2007070745 W JP2007070745 W JP 2007070745W WO 2008050806 A1 WO2008050806 A1 WO 2008050806A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- frame rate
- imaging
- image
- mode
- moving image
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
- G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
- G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
- G07F17/3202—Hardware aspects of a gaming system, e.g. components, construction, architecture thereof
- G07F17/3204—Player-machine interfaces
- G07F17/3211—Display means
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07F—COIN-FREED OR LIKE APPARATUS
- G07F17/00—Coin-freed apparatus for hiring articles; Coin-freed facilities or services
- G07F17/32—Coin-freed apparatus for hiring articles; Coin-freed facilities or services for games, toys, sports, or amusements
- G07F17/3202—Hardware aspects of a gaming system, e.g. components, construction, architecture thereof
- G07F17/3204—Player-machine interfaces
- G07F17/3211—Display means
- G07F17/3213—Details of moving display elements, e.g. spinning reels, tumbling members
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/70—Circuitry for compensating brightness variation in the scene
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/775—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television receiver
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/7921—Processing of colour television signals in connection with recording for more than one processing mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/806—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components with processing of the sound signal
- H04N9/8063—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components with processing of the sound signal using time division multiplex of the PCM audio and PCM video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
Definitions
- the present invention relates to an imaging device capable of imaging by switching frame rates and a playback control device capable of reproducing moving image information at a frame rate supported by an external monitor device.
- Japanese Unexamined Patent Publication No. 63-59074 discloses a high-speed video camera that enables high-speed imaging by changing the shotta speed and frame speed.
- Japanese Laid-Open Patent Publication No. 20 01-292409 high-quality slow motion recording and normal recording can be switched as a recording / reproducing device that reproduces images obtained in an imaging environment at a high frame rate. It is disclosed that.
- the imaging device of the present invention includes an imaging unit capable of imaging at a first frame rate and a second frame rate higher than the first frame rate, A detection unit that detects a highlight scene and a control unit that switches a frame rate of the imaging unit in response to detection of the highlight scene by the detection unit.
- the playback control device provides a frame rate to which the external monitor device corresponds to the playback control device that plays back the moving image information and the attached information of the moving image information from the recording medium. Based on the attached information! /, The judgment means for judging whether the playback mode when playing back the moving picture information is the thinning playback mode or the non-decimation playback mode, and the judgment result of the judgment means And a control means for controlling the reproduction operation of the moving image information accordingly.
- the frame rate is switched in response to the detection of the highlight scene, for example, from the first frame rate to the second frame rate higher than the first frame rate. It is switched automatically. For this reason, it is possible to save the trouble of performing a frame rate switching operation when capturing a highlight scene.
- the second frame rate is switched when a highlight scene is detected, power consumption and storage medium capacity can be saved as compared with the case of fixing to the second frame rate.
- the playback control device of the present invention when moving image information is played based on the frame rate supported by the external monitor device and the attached information to be played back together with the moving image information to be played back. It is determined whether the reproduction mode is the thinning reproduction mode or the non-decimation reproduction mode, and the reproduction operation of moving image information is controlled according to the determination result. For example, if it is determined that the frame rate of the moving image information is higher than the frame rate supported by the external monitor device, it is determined as the thinning playback mode, and the moving image information corresponds to the external monitor device. It is played back at the frame rate. For this reason, the output image according to the corresponding situation, such as whether the display of the playback output destination supports the high-speed frame rate or not. Video information can be output at the frame rate.
- FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to the present invention.
- FIG. 2 is a flowchart showing a frame rate switching operation in the imaging apparatus.
- FIG. 3 is a flowchart showing highlight scene detection processing.
- FIG. 4 is a diagram for explaining operations during recording and playback of the imaging device (when the external monitor device does not support the high-speed frame rate).
- FIG. 5 is a diagram for explaining operations during recording and playback of the imaging device (when the external monitor device supports a high-speed frame rate).
- FIG. 6 is a flowchart showing the switching operation between the high-speed frame rate playback mode and the normal frame rate playback mode.
- FIG. 7 is an explanatory diagram showing a moving image file structure.
- FIG. 8 is a diagram for explaining an operation when an image signal having a moving image file structure is reproduced when the external monitor device does not support the high-speed frame rate.
- FIG. 9 is a diagram for explaining an operation when an image signal having a moving image file structure is reproduced when the external monitor device supports the high-speed frame rate.
- FIG. 10 is a diagram showing the structure of data recorded on an external recording medium (or internal recording medium).
- FIG. 11 is a diagram for explaining a reproduction operation when an external monitor device is connected in correspondence with a high-speed frame rate! /, Na! /.
- FIG.12 Flowchart showing frame rate selection operation by manual operation during playback.
- FIG. 13 is a flowchart showing an automatic switching operation between a normal frame rate thinning reproduction mode and a normal frame rate non-decimation reproduction mode.
- FIG. 14 is a flowchart showing an automatic generation operation of frame rate switching information.
- FIG. 1 is a block diagram showing the configuration of the imaging apparatus of the present invention.
- the imaging device of the present invention is connected to the imaging device.
- the first frame rate is set to a standard television frame rate, for example, 60 fps (frame / second) or 50 fps (here, “odd field” or “odd field” in NTSC, PAL, SECAM, etc.
- One field of “Even field” is described as “1 frame”.
- the second frame rate is 240 fps (frames / second), which is four times the first frame rate, for example.
- the first frame rate is called the normal frame rate, and the second frame rate is called the high-speed frame rate.
- the image pickup apparatus of the present invention includes an imager driving driver 1, an electronic image pickup device (imager) 2, an analog front end (AFE) 3, an image'audio processing ASIC (Application Specific Integrated Circuit) 4, a microphone 5, Analog amplifier 6, speaker 7, memory 8, panel drive driver 9, LCD (Liquid Crystal Display) panel 10, operation unit 11, notch 12, power management IC 13, external recording medium 14, image output terminal 15, internal recording medium 21
- a programmable RAM (Random Access Memory) 22, an angular velocity sensor 23, a lens driving driver 24, a lens 25, and a system MPU (Micro Processing Unit) 26 are provided.
- the imager drive driver 1 is a circuit for driving the electronic image sensor 2.
- the electronic image sensor 2 is an image sensor that can generate an image signal with a high frame rate that can be generated only with an image signal with a normal frame rate.
- CMOS Complementary Metal Oxide Semiconductor
- AFE3 includes an analog signal processing circuit, an A / D converter, and the like!
- the AFE 3 performs signal processing of an analog image signal generated by the electronic image sensor 2, such as noise removal processing and signal level adjustment processing. Furthermore, the image signal after signal processing is converted into a digital image signal.
- Image / sound processing ASIC4 is an application-specific integration circuit that processes image signals and sound signals.
- Image, audio processing ASIC4 is a digital image obtained by AFE3, for example. Processing such as color processing and lens correction processing is performed on the image signal. It also performs image signal compression and decompression.
- the microphone 5 detects sound, converts it into an electrical signal, and outputs it.
- the analog amplifier 6 is a circuit that amplifies the electric signal output from the microphone 5.
- the speaker 7 converts the electrical signal amplified by the analog amplifier 6 into sound and outputs it.
- the memory 8 is a circuit that stores various data.
- the panel drive driver 9 is a circuit that drives each pixel of the LCD panel 10 based on the image signal processed by the image / sound processing ASIC 4.
- the operation unit 11 includes various operation switches.
- the battery 12 generates power to be supplied to each part of the imaging device.
- the power management IC 13 is a circuit that detects the state of the battery 12 and the load state and manages the power supply of the imaging apparatus.
- the external recording medium 14 is an external recording medium for storing moving image information, audio information, and the like generated by the imaging apparatus.
- the image output terminal 15 is an output terminal for supplying the moving image information generated by the imaging device and the moving image information recorded on the external recording medium 14 to the external monitor device 30 so that the image can be monitored. is there.
- the internal recording medium 21 is a storage device built in the imaging apparatus, and stores moving image information, audio information, and the like generated by the imaging apparatus.
- the programmable RAM 22 constitutes various logics necessary for this imaging apparatus.
- the angular velocity sensor 23 is a sensor for realizing a camera shake prevention function in the imaging apparatus, and detects an angular velocity when the imaging apparatus moves.
- the lens driving driver 24 is a circuit for driving the lens 25 based on the lens driving signal to perform zoom operation and the like.
- the system MPU 26 is a microprocessing unit that controls each part of the imaging apparatus.
- the system MPU 26 uses a drive node corresponding to the high-speed frame rate for the imager drive driver 1.
- the image sensor 2 is driven in high speed mode.
- the system MPU26 also performs signal processing in the high-speed mode for the AFE3 and the image 'audio processing ASIC4. To generate an image signal with a high frame rate. Furthermore, the system MPU 26 causes the image signal processing ASIC 4 to compress the image signal at the high frame rate.
- the system MPU26 is obtained by outputting the high-speed frame rate image signal obtained by controlling the operation of each part in this way from the image output terminal 15, or by compressing the high-speed frame rate image signal.
- the recorded image recording data is recorded on the external recording medium 14 (or the internal recording medium 21).
- the sound input from the microphone 5 is compressed after being subjected to digital sampling, and is recorded in synchronization with the captured image of the high-speed frame rate. Note that an image signal with a high frame rate may be recorded on the external recording medium 14 (or the internal recording medium 21). In this way, if the high-speed mode is selected as the operation mode, it is possible to output or record a captured image with high time resolution.
- the operation mode of the image pickup apparatus is set to an operation mode for generating an image signal of a normal frame rate (hereinafter referred to as "normal mode"!)
- the system MPU 26 uses less power consumption of the image pickup apparatus than the high-speed mode.
- the frequency of the drive pulse itself is lowered, and the electronic image pickup device 2, AFE3, image'audio processing ASIC4, etc. are driven in the normal mode.
- the resolution in the time direction is lower than that in the high-speed mode.
- the frame rate of the image signal is lowered, there are advantages such as less power consumption and less burden on the capacity of the recording medium.
- the exposure time differs between the high-speed mode and the normal mode. Therefore, by adjusting the gain of the image signal using the image / sound processing ASIC4 etc., the signal level can be made equal even when the exposure time is different. Good.
- the external monitor device 30 When the external monitor device 30 is capable of supporting a high-speed frame rate, a captured image can be displayed using an image signal output from the image output terminal 15 of the imaging device.
- the external monitor device 30 does not support the high-speed frame rate, for example, when it is an LCD panel or the like provided in a conventional television device or equipment, the image signal output from the image output terminal 15 of the imaging device When the frame rate is a high frame rate, the captured image cannot be displayed.
- the imaging device is equipped with a high-speed frame rate imaging function.
- a slow playback mode is provided to output the high frame rate image signal obtained by performing the image at the normal frame rate. For example, by playing 240 frame images per second (240fps) at a rate of 60 frame images per second (60fps), a slow playback mode that outputs image signals over four times the time is provided. . In this way, it is possible to perform slow playback image display with high time resolution using an image signal at a high frame rate.
- the captured image can be displayed by providing the slow playback mode. It is also possible to do this. However, if all images are taken at a high frame rate, the power consumption of the imaging device increases as described above, and the operable time of the imaging device is shortened. Also, if the resolution in the high-speed mode is the same as the resolution in the normal mode, the recordable time will be shortened due to the large number of frames per unit time.
- the imaging apparatus of the present invention detects a highlight scene based on information obtained by the imaging apparatus at the time of imaging, and automatically sets the frame rate of the captured image in response to the detection of the highlight scene. Switch automatically. By switching the frame rate in this way, it is possible to automatically create a slow-motion video effect of a highlight scene while saving the power consumption and the medium capacity while saving the effort required for the frame rate switching operation. .
- FIG. 2 is a flowchart showing a frame rate switching operation in the imaging apparatus.
- the system MPU 26 performs highlight scene detection processing (step Sl).
- the system MPU 26 determines whether or not a highlight scene has been detected (step S2).
- the system MPU 26 operates at a frame rate of 240 fps with the operation mode as the high speed mode.
- To generate an image signal step S3).
- the system MPU 26 determines whether or not the generation of the image signal in the high speed mode has passed a predetermined time (step S4), and generates the image signal in the high speed mode when the predetermined time has not passed.
- the system MPU 26 generates an image signal by performing an imaging operation at a frame rate of 60 fps with the operation mode as a normal mode (step S5).
- the highlight scene detection indicates when the amount of movement of the subject exceeds a predetermined value.
- the system MPU 26 detects the highlight scene using the image signal of the captured image. For example, the difference calculation between frames is performed by the image 'sound processing ASI C4, and the obtained calculation result is supplied to the system MPU26.
- the system MPU 26 compares the calculation result with a predetermined threshold, and when the calculation result exceeds the threshold, the amount of movement of the subject exceeds the predetermined value and is detected as a highlight scene. When the calculation result does not exceed the threshold value, the amount of movement of the subject exceeds the predetermined amount, and the highlight scene is detected as a thing! /,! /.
- the calculation result of the interframe difference calculation is a value indicating the amount of movement of the subject.
- a zoom operation that changes the imaging range for example, when a zoom-in or zoom-out operation is performed
- the imaging direction for example, when a pan / tilt operation is performed or manually
- the calculation result of the inter-frame difference calculation may become large even if the subject is not moving.
- the system MPU 26 improves the accuracy of highlight scene detection by detecting the highlight scene using the zoom operation status and / or the output of the sensor for correcting camera shake (here, the angular velocity sensor 23). be able to.
- FIG. 3 is a flowchart showing highlight scene detection processing.
- the highlight scene detection process shown in Fig. 3 uses the zoom operation status of the imaging device and the output of the angular velocity sensor 23 only with the difference calculation result between frames to accurately detect the highlight scene. Is shown.
- the system MPU 26 determines whether or not the lens driving driver 24 is operating a zoom (ZOOM) (step Sl 1). If the zoom is in operation, the system MPU 26 determines that no highlight scene has been detected (step S15).
- step SI 1 If zoom is not active in step SI 1, then the system MPU 26 Based on the output of the sensor 23, it is determined whether or not the angular velocity applied to the imaging apparatus is high! /, For example, by comparing with a preset threshold value (step S12). As a result, if the angular velocity detected by the angular velocity sensor 23 is larger than the threshold value, the system MP U26 does not detect the highlight scene (step S15).
- step S12 determines whether or not the angular velocity is not greater than the threshold.
- the system MPU 26 determines whether or not the calculation result of the inter-frame difference calculation is small by comparing it with a preset threshold, for example. (Step S13). As a result, if the calculation result is smaller than the threshold value, the system MPU 26 determines that no highlight scene has been detected (step S15).
- step S14 If the calculation result is not smaller than the threshold value in step S13, it is assumed that the system MPU 26 detects a highlight scene (step S14).
- the system MPU 26 may detect a highlight scene by using an audio signal from a microphone or the like that uses only an image signal of a captured image. For example, it is assumed that a highlight scene has been detected when the signal level of the audio signal from the microphone exceeds a threshold value, and image signal generation is performed for a predetermined time in the high-speed mode, for example, in a race scene such as athletic meet. It is possible to record a scene as a highlight scene at a high frame rate.
- FIG. 4 shows operations during recording and reproduction of the imaging apparatus, and shows a case where the external monitor device 30 is lazy corresponding to the high-speed frame rate.
- FIG. 4 (a) shows a case where the external monitor device 30 connected to the image output terminal 15 corresponds to the high-speed frame rate! /, NA! /, And the highlight scene is detected. ! /, Na! /, When recording and playing. That is, since no or ill scene has not been detected, frames of frame numbers [0, 4, 8, 12...] Generated by the imaging device are recorded at 1/60 second intervals during recording. Also, since the external monitor device 30 does not support high-speed frame rates and the recorded frames are 1/60 second intervals, Frame power of number [0, 4, 8, 12 ...] Played at intervals of seconds.
- FIG. 4B shows a case where the external monitor device 30 connected to the image output terminal 15 does not support the high-speed frame rate and is recorded when a highlight scene is detected. And the operation during playback. That is, when a highlight scene is detected, the operation mode is set to the high speed mode for a predetermined time. Therefore, at the time of recording, frames of frame numbers [0, 1, 2, 3, 4, 5, 6, 7, 8...] Generated by the imaging device are recorded at intervals of 1/240 seconds. Since the external monitor device 30 does not support the high-speed frame rate, the frame of the recorded frame number [0, 1, 2, 3, 4, 5, 6, 7, 8. Is played at 1/60 second intervals.
- the imaging apparatus of the present invention is provided with a high frame rate reproduction mode for outputting an image signal at a high frame rate as an application for an external monitor apparatus that supports a high frame rate.
- a high frame rate reproduction mode when the image signal to be output is an image signal generated in the high speed mode, it is output as it is without changing the frame rate.
- the image signal to be output is an image signal generated in the normal mode, the frame image is repeatedly output to convert it to an image signal with a high frame rate and output it.
- a mode for outputting an image signal is referred to as a normal frame rate reproduction mode. That is, in the normal frame rate reproduction mode, when the image signal to be output is an image signal generated in the normal mode, it is output as it is without changing the frame rate. When the image signal to be output is an image signal generated in the high speed mode, the image signal is output at the frame rate of the normal mode.
- FIG. 5 shows operations during recording and reproduction of the imaging device, and shows a case where the external monitor device 30 records in correspondence with the high-speed frame rate.
- FIG. 5 (a) shows a case where the external monitor device 30 connected to the image output terminal 15 corresponds to a high-speed frame rate, and a highlight scene is detected! /, Na! /, Shows the operation during recording and playback.
- the frames of frame numbers [0, 4, 8, 12...] Generated by the imaging device are recorded at 1/60 second intervals during recording.
- the external monitor device 30 supports high frame rate. Since the frames during playback are 1/240 second intervals, each frame image is output four times during playback (dummy frames are output), so that the number of frames is quadrupled and the frame number [0, 0, [0, 0, 4, 4, 4, 4, 8 ...] frames are played back every 1/240 seconds.
- FIG. 5 shows the operation at the time of recording and reproduction when a highlight scene is detected, in the case where the external monitor device 30 supports the high-speed frame rate. That is, when the no-light scene is detected, the operation mode is set to the high-speed mode for a predetermined time. Therefore, at the time of recording, frames of frame numbers [0, 1, 2, 3, 4, 5, 6, 7, 8...] Generated by the imaging device are recorded at intervals of 1/240 seconds. Since the external monitor device 30 supports the high-speed frame rate, the recorded frame number [0, 1, 2, 3, 4, 5, 6, 7, 8 ... ] Frames are played back every 1/240 seconds.
- a mode for outputting an image signal as shown in FIG. 5 is referred to as a high-speed frame rate reproduction mode. That is, in the high-speed frame rate reproduction mode, when the image signal to be output is an image signal generated in the high-speed mode, it is output as it is without changing the frame rate. When the image signal to be output is an image signal generated in the normal mode, the frame is interpolated and converted into an image signal with a high frame rate and output.
- the image signal force S frame rate generated in the high-speed mode is output without being changed. Therefore, it is possible to display an image with a high temporal resolution for a predetermined time after the highlight scene is detected.
- the image signal generated in the high-speed mode is output at the normal mode frame rate. Therefore, an image for a predetermined time after the no-light scene is detected can be played back in slow motion.
- FIG. 6 is a flowchart showing the switching operation between the high-speed frame rate playback mode and the normal frame rate playback mode.
- the system MPU 26 first determines whether or not the external monitor device 30 that is the output destination of the image signal corresponds to the high-speed frame rate (step S21). This determination is performed based on a signal from the operation unit 11, for example. That is, you The user determines whether or not the external monitor device 30 as the output destination supports the high-speed frame rate, and operates the operation unit 11 based on the determination result.
- the system MPU 26 determines whether or not a user operation based on the determination result of whether or not the high-speed frame rate is supported based on the signal from the operation unit 11 and the like, and based on this user operation.
- step S21 it is determined whether the output destination external monitor device 30 supports the high-speed frame rate.
- step S21 when it is determined in step S21 that the output destination external monitor device 30 is compatible with the high-speed frame rate, the mode shifts to the high-speed frame rate reproduction mode (step S23).
- step S21 when it is determined in step S21 that the high-speed frame rate is not supported, the normal frame rate reproduction mode is set (step S22).
- the image signal is generated by switching the frame rate in response to the detection of the highlight scene, the power consumption and the amount of data stored in the storage medium can be reduced. Will be able to. Furthermore, by switching the frame rate of the image signal to be output according to whether or not the external monitor device 30 supports high-speed frame rate, the time resolution is high for a predetermined time after the detection of the no-light scene. The image can be displayed in a single motion.
- the external monitor device 30 is capable of high-speed correspondence can be determined by an electric setting or a control signal at the time of user setting or cable connection as described above. For example, if the external monitor device supports HDMI (High Definition Multimedia Interface), it may be determined based on the display specifications of the external monitor device obtained via HDMI).
- HDMI High Definition Multimedia Interface
- Figure 7 shows a mixture of image signals obtained by performing an imaging operation (normal shooting) in normal mode and image signals obtained by performing an imaging operation (high-speed shooting) in high-speed mode. Shows the video file structure.
- FIG. 8 shows an operation when the image signal having the moving image file structure shown in FIG. 7 is reproduced when the external monitor device 30 connected to the image output terminal 15 does not support the high-speed frame rate. .
- the operation mode is automatically set from the normal mode to the high-speed mode. Since the time is switched, the image signal obtained by performing the imaging operation in the normal mode and the image signal obtained by performing the imaging operation in the high-speed mode are recorded together.
- the external monitor device 30 does not support the high-speed frame rate, when the normal frame rate playback mode is automatically set, the image signal obtained by performing the imaging operation in the normal mode and the high-speed mode is not normal. Sequentially output at the frame rate. Therefore, on the screen of the external monitor device 30, an image captured in the high-speed mode is a slow-motion playback image that is extended four times in time.
- FIG. 9 shows an operation when the image signal having the moving image file structure shown in FIG. 7 is reproduced when the external monitor device 30 connected to the image output terminal 15 supports the high-speed frame rate. .
- the operation mode is automatically switched from the normal mode to the high-speed mode for a predetermined time.
- the image signal obtained by performing the imaging operation in the normal mode and the image signal obtained by performing the imaging operation in the high speed mode are recorded together.
- the external monitor device 30 supports high-speed frame rate and is automatically set to high-speed frame rate playback mode
- the image signal obtained by performing the imaging operation in normal mode and high-speed mode is high-speed. Sequentially output at the frame rate. Therefore, the image captured in the high speed mode is displayed on the screen of the external monitor device 30 as an image having a higher time resolution than the image captured in the normal mode.
- frame interpolation processing is performed, and the previous frame is repeatedly inserted as a dummy frame to be converted into an image signal with a high frame rate and output.
- the imaging apparatus of the present invention for example, if the zoom operation is not being performed, the magnitude of the angular velocity applied to the imaging apparatus based on the output of the angular velocity sensor 23 is next. Is determined based on a preset threshold value. As a result, when the angular velocity detected by the angular velocity sensor 23 is larger than the threshold value, the imaging operation is performed in the normal mode. If it is determined that the angular velocity is smaller than the threshold value, the image / sound processing ASIC4 performs an inter-frame difference calculation and compares the calculation result with the threshold value. Judgment whether or not to exceed.
- the imaging operation in the normal mode is performed.
- a high-speed mode imaging operation is performed for a predetermined time on the assumption that a highlight scene has been detected when the amount of movement of the subject exceeds a predetermined value.
- the imaging apparatus of the present invention in an imaging device capable of imaging and recording a captured image at a first frame rate and a second frame rate higher than the first frame rate, It is possible to automatically switch the imaging frame rate in highlight scenes that require images with high temporal resolution. As a result, there is an effect that an imaging apparatus capable of realizing a moving image capturing with a small amount of power consumption and a medium capacity without being burdened, a high time resolution in an appropriate place with a load, and the like.
- the second frame rate at the time of reproduction is used.
- the captured scene can be played back in slow motion and displayed, and images captured at the second frame rate can be used effectively.
- images in which the first frame rate and the second frame rate are mixed can be maintained in the time direction. It is possible to output in real time.
- the playback control device is provided in, for example, an imaging device
- the block diagram of FIG. 1 is also applied to this playback control device.
- the playback control device of the present invention is compatible with external monitor devices capable of displaying a high-speed frame rate that will be mixed in the future and high-speed frame rates.
- the frame rate of the output image is fixed at a higher frame rate than the normal frame rate (60fps!) And at a high frame rate (240fps).
- the frame rate of the output image depends on the frame rate supported by the external monitor device at the output destination. Make it adjustable. For this reason, the playback control device attaches the image recorded in correspondence with the frame rate supported by the external monitor device 30 that is the output destination of the image and the image recorded at the high-speed frame rate.
- This playback mode determination and playback operation control are implemented by the system MPU26.
- an image pickup apparatus equipped with this reproduction control device includes an imager drive driver 1, an electronic image pickup device 2, an analog front end (AFE) 3, and an image 'audio processing ASIC (Application Specific Integrated Circuit) 4, microphone 5, analog amplifier 6, speaker 7, memory 8, panel driver 9, LCD (Liquid Crystal Display) panel 10, operation unit 11, battery 12, power management IC 13, external recording medium 14, image output Terminal 15, internal recording medium 21, programmable RAM (Random Access Memory) 22, angular velocity sensor 23, lens drive dryer 24, lens 25, and system MPU (Micro Processing Unit) 26 are fg.
- AFE analog front end
- the imager drive driver 1 is a circuit for driving the electronic image sensor 2.
- the electronic image pickup device 2 is an image pickup device that can generate an image signal with a high frame rate that can be generated using only an image signal with a standard frame rate.
- CMOS Complementary Metal Oxide Semiconductor
- AFE3 includes an analog signal processing circuit, an A / D converter, and the like!
- the AFE 3 performs signal processing of an analog image signal generated by the electronic image sensor 2, such as noise removal processing and signal level adjustment processing. Furthermore, the image signal after signal processing is converted into a digital image signal.
- Image / sound processing ASIC 4 is an application-specific integration circuit that processes image signals and sound signals.
- Image / sound processing The ASIC4 performs processing such as color processing and lens correction processing on the digital image signal obtained by AFE3, for example. It also performs image signal compression and decompression.
- the microphone 5 detects sound, converts it into an electric signal, and outputs it.
- the analog amplifier 6 is a circuit that amplifies the electric signal output from the microphone 5.
- the speaker 7 converts the electrical signal amplified by the analog amplifier 6 into sound and outputs it.
- Memory 8 stores various data Circuit.
- the panel drive driver 9 is a circuit that drives each pixel of the LCD panel 10 based on the image signal processed by the image / sound processing ASIC 4.
- the operation unit 11 includes various operation switches.
- the battery 12 generates power to be supplied to each part of the imaging device.
- the power management IC 13 is a circuit that detects the state of the battery 12 and the load state and manages the power supply of the imaging apparatus.
- the external recording medium 14 is an external recording medium for storing moving image information, audio information, and the like generated by the imaging apparatus.
- the image output terminal 15 is an output terminal for supplying the moving image information generated by the imaging device and the moving image information recorded on the external recording medium 14 to the external monitor device 30 so that the image can be monitored. is there.
- the internal recording medium 21 is a storage device built in the imaging apparatus, and stores moving image information, audio information, and the like generated by the imaging apparatus.
- the programmable RAM 22 constitutes various logics necessary for this imaging apparatus.
- the angular velocity sensor 23 is a sensor for realizing a camera shake prevention function in the imaging apparatus, and detects an angular velocity when the imaging apparatus moves.
- the lens driving driver 24 is a circuit for driving the lens 25 based on the lens driving signal to perform zoom operation and the like.
- the system MPU 26 is a microprocessing unit that controls each unit of the imaging apparatus.
- the system MPU 26 sends a drive noise corresponding to the high-speed frame rate to the imager drive driver 1 to drive the electronic imaging device 2 in the high-speed mode.
- the system MPU 26 also causes the AFE 3 and the image'sound processing ASIC 4 to perform signal processing in the high speed mode to generate an image signal with a high frame rate. Furthermore, the system MPU 26 causes the image signal processing ASIC 4 to compress the image signal at the high frame rate.
- the system MPU26 is obtained by outputting the high-speed frame rate image signal obtained by controlling the operation of each part in this way from the image output terminal 15, or by compressing the high-speed frame rate image signal.
- the recorded image recording data is recorded on the external recording medium 14 (or the internal recording medium 21). When recording image recording data, input from microphone 5.
- the voice to be applied is compressed after being subjected to digital sampling, and is recorded in synchronization with a captured image of a high-speed frame rate.
- the system MPU 26 generates auxiliary information and records the image recording data and the time axis in association with each other on the external recording medium 14 (or the internal recording medium 21).
- the external recording medium 14 (or the internal recording medium 21) may be subjected to compression processing to record the image signal at a high frame rate.
- the image recording data recorded on the external recording medium 14 (or the internal recording medium 21) and the image signal of the high frame rate are the moving image information!
- FIG. 10 shows the structure of data recorded on the external recording medium 14 (or the internal recording medium 21).
- the accessory information 33 is recorded separately from the image recording data 31 and the audio recording data 32 here.
- the example shown in FIG. 10 is configured to have attached information in file units, as described above, the recording format of attached information is not limited to this.
- the attached information 33 includes date, frame rate switching information (flag), and imaging status when a high-speed frame rate image signal used for generating frame rate switching information is generated, for example, zoom operation status,
- the angular velocity detected by the angular velocity sensor 23 is included. The user can arbitrarily change the frame rate switching information (flag) of the attached information 33 at the time of recording or reproduction.
- the external monitor device 30 connected to the image output terminal 15 can support the high-speed frame rate, it is possible to display an image based on the moving image information output from the image output terminal 15. It becomes.
- the external monitor device 30 corresponds to a high-speed frame rate, such as! /, NA! /, For example, an LCD panel provided in a conventional television device or equipment, the video output from the image output terminal 15 If the frame rate of the image information is a high-speed frame rate, the image cannot be displayed based on the moving image information output from the image output terminal 15.
- a normal frame rate thinning reproduction mode is provided.
- a normal frame rate decimation playback mode is set, in which 240 frame images (240 fps) per second are thinned out to 60 frame images (60 fps) per second.
- a normal frame rate non-decimation reproduction mode is provided in which the external monitor device 30 outputs at a corresponding normal frame rate without performing frame decimation of moving image information, which is a high-speed frame rate.
- FIG. 11 shows a reproduction operation when an external monitor device that does not support such a high-speed frame rate is connected.
- (A) in FIG. 11 shows the playback operation in the normal frame rate thinning playback mode.
- the moving picture information to be played back has a high frame rate, and the frame number [0, 1, 2, 3, 4 , 5, 6, 7, 8 «] is said to be 1/240 less.
- frame thinning is performed and a frame image of frame numbers [0, 4, 8, 12.
- FIG. 11 (b) shows the playback operation in the normal frame rate non-decimated playback mode.
- frame decimation is performed.
- the moving image information is output at the corresponding normal frame rate of the external monitor device 30 without performing the operation. That is, frame images of frame numbers [0, 1, 2, 3, 4, 5, 6, 7, 8...] Are output at 1/60 second intervals.
- FIG. 12 is a flowchart showing a frame rate selection operation by manual operation during playback depending on whether or not the output destination is an external monitor device that supports a high-speed frame rate.
- the system MPU 26 determines whether or not the external monitor device 30 that is the output destination supports the high-speed frame rate (step S51).
- system MPU26 indicates that the output destination is an external monitor device that supports the high-speed frame rate by the user's manual operation
- system MPU26 controls high-speed frame rate by controlling image's audio processing ASIC4.
- Output images in non-decimated playback mode step S53.
- the external recording medium 14 or Outputs the high-speed frame rate (240 fps) moving image information recorded on the internal recording medium 21) without changing the frame rate.
- the system MPU 26 When the external monitor device does not support the high-speed frame rate, the system MPU 26 further responds to whether the frame rate switching information (flag) set by manual operation is on or off (step S52). When the frame rate switching information is OFF, the normal frame rate thinning playback mode is selected (step S54). In normal frame rate thinning playback mode, when moving image information recorded on the external recording medium 14 (or internal recording medium 21) is played back, the frame is thinned out on the image's audio processing ASIC4, and the high-speed frame rate ( This is a playback mode in which video information of 240fps) is output as video information of normal frame rate (60fps) by the external monitor device.
- the frame rate switching information flag
- Normal frame rate non-decimated playback mode refers to high-speed frame rate (240fps) moving image information that is recorded at the normal frame rate when playing back moving image information recorded on the external recording medium 14 (or internal recording medium 21).
- This mode outputs at (60 fps).
- this is a playback mode that performs slow playback with high temporal resolution by outputting a 1-second image (240 images) as a slow-motion image for 4 seconds, which is four times the imaging time.
- the playback control device automatically performs normal frame rate thinning playback mode and normal frame rate non-decimated playback based on frame rate switching information included in the attached information. Switch the mode. Thereby, for example, a desired period of a reproduced image can be automatically displayed as a slow motion image with a high time resolution.
- the auxiliary information recorded on the external recording medium 14 or the internal recording medium 21 is reproduced to determine the playback mode, and the moving image information related to the auxiliary information used for this determination is Play in the determined playback mode.
- FIG. 13 is a flowchart showing an operation for automatically switching between the normal frame rate thinning playback mode and the normal frame rate non-thinning playback mode based on the frame switching information included in the auxiliary information 33. .
- the playback control device indicates an angular velocity indicating a zoom operation and / or an amount of motion of the imaging device when moving image information at a high frame rate included in the auxiliary information 33 is generated by the imaging device. It is also possible to generate frame rate switching information using the information and automatically switch the playback mode based on the generated frame rate switching information.
- FIG. 14 is a flowchart showing an automatic generation operation of frame rate switching information.
- the system MPU 26 determines whether or not zooming (ZOOM) is in operation (step S71). If the zoom is in operation, the system MPU 26 assumes that frame rate switching is not instructed, and displays frame rate switching information.
- ZOOM zooming
- the system MPU 26 next determines whether or not the angular velocity is large, for example, by comparing with a preset threshold value (step S72). As a result, if the angular velocity is greater than the threshold, the system MPU 26 does not instruct frame rate switching! / (Step S75).
- step S72 If it is determined in step S72 that the angular velocity is not greater than the threshold value, the system MPU 26 performs the inter-frame difference calculation using the reproduced high frame rate moving image information on the seventh fire, and the calculation result is the threshold value. It is determined whether it is smaller than (step S73). As a result, when the calculation result is smaller than the threshold value, the system MPU 26 does not instruct the frame rate switching (step S75).
- system MPU 26 turns on frame rate switching information on the assumption that frame rate switching is to be performed (step S73). P74).
- the frame rate switching information is turned on in pulses to switch to the normal frame rate non-decimated playback mode, and then the normal frame rate non-decimated playback is performed. Play the mode for a predetermined time.
- the system MPU 26 may generate frame rate switching information using a reproduced audio signal obtained only with the attached information.
- the frame rate switching instruction is given when the signal level of the audio signal from the microphone becomes higher than a threshold value.
- the frame rate switching information is generated, when the amount of motion of the subject exceeds a predetermined value, the normal frame rate non-decimation playback mode is selected and the motion of the subject is It is possible to display highlight scenes that increase in volume as slow-motion images with high temporal resolution. Also, even if the amount of movement of the subject increases due to the zoom operation or the change in the imaging direction, the frame rate is not switched in such a case. It is possible to prevent switching to the normal frame rate non-decimation playback mode when the amount of movement is not large.
- this playback control device is a high-speed that outputs moving image information at a high frame rate without changing the frame rate. Has frame rate non-decimated playback mode. Also, when an external monitor device that does not support high-speed frame rate is used during playback, moving image information of high-speed frame rate is thinned out on the image-sound processing ASIC4, and the video of the frame rate supported by the external monitor device It has a normal frame rate thinning playback mode for playback as image information.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Devices (AREA)
- Television Signal Processing For Recording (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/312,111 US8154606B2 (en) | 2006-10-24 | 2007-10-24 | Image pickup apparatus and reproduction control apparatus |
JP2008541012A JPWO2008050806A1 (ja) | 2006-10-24 | 2007-10-24 | 撮像装置と再生制御装置 |
EP07830479.7A EP2079231B1 (en) | 2006-10-24 | 2007-10-24 | Imaging device and reproduction control device |
KR1020097007784A KR101411627B1 (ko) | 2006-10-24 | 2007-10-24 | 촬상장치와 재생제어장치 |
CN2007800397298A CN101529890B (zh) | 2006-10-24 | 2007-10-24 | 图像摄取设备和再现控制设备 |
US13/365,727 US9013583B2 (en) | 2006-10-24 | 2012-02-03 | Image pickup apparatus and reproduction control apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2006-288626 | 2006-10-24 | ||
JP2006288626 | 2006-10-24 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US12/312,111 A-371-Of-International US8154606B2 (en) | 2006-10-24 | 2007-10-24 | Image pickup apparatus and reproduction control apparatus |
US13/365,727 Continuation US9013583B2 (en) | 2006-10-24 | 2012-02-03 | Image pickup apparatus and reproduction control apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2008050806A1 true WO2008050806A1 (en) | 2008-05-02 |
Family
ID=39324600
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2007/070745 WO2008050806A1 (en) | 2006-10-24 | 2007-10-24 | Imaging device and reproduction control device |
Country Status (7)
Country | Link |
---|---|
US (2) | US8154606B2 (ja) |
EP (1) | EP2079231B1 (ja) |
JP (2) | JPWO2008050806A1 (ja) |
KR (1) | KR101411627B1 (ja) |
CN (1) | CN101529890B (ja) |
TW (1) | TW200828991A (ja) |
WO (1) | WO2008050806A1 (ja) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2459684A (en) * | 2008-04-30 | 2009-11-04 | British Broadcasting Corp | Television Signal having high frame rate |
JP2010050877A (ja) * | 2008-08-25 | 2010-03-04 | Nikon Corp | 撮像装置、画像再生装置、画像変換装置、画像再生プログラム |
CN101835017A (zh) * | 2009-03-09 | 2010-09-15 | 佳能株式会社 | 视频重放设备和视频重放方法 |
JP2010233183A (ja) * | 2009-03-30 | 2010-10-14 | Canon Inc | 動画保存装置及びその制御方法 |
JP2011183054A (ja) * | 2010-03-10 | 2011-09-22 | Shoichiro Taniguchi | 弓を用いて矢を射る動作を解析する装置および方法 |
JP2012105012A (ja) * | 2010-11-09 | 2012-05-31 | Canon Inc | 動画再生装置、動画再生方法、コンピュータプログラム、記憶媒体 |
JP2012151705A (ja) * | 2011-01-20 | 2012-08-09 | Casio Comput Co Ltd | 動画像処理装置、動画像処理方法及びプログラム |
JP2012523788A (ja) * | 2009-04-13 | 2012-10-04 | ショースキャン デジタル エルエルシー | 動画の撮影及び投影方法及びその装置 |
US20120327273A1 (en) * | 2009-05-20 | 2012-12-27 | Canon Kabushiki Kaisha | Imaging apparatus and reproducing apparatus which changes frame rate based on zoom operation |
JP2013258609A (ja) * | 2012-06-13 | 2013-12-26 | Panasonic Corp | 撮像装置 |
JP2015080035A (ja) * | 2013-10-15 | 2015-04-23 | キヤノン株式会社 | 画像処理装置、画像処理方法、プログラム |
WO2016139971A1 (ja) * | 2015-03-03 | 2016-09-09 | ソニー株式会社 | 信号処理装置、信号処理システム、信号処理方法、および、プログラム |
CN108322650A (zh) * | 2018-02-08 | 2018-07-24 | 广东欧珀移动通信有限公司 | 视频拍摄方法和装置、电子设备、计算机可读存储介质 |
JP7188382B2 (ja) | 2017-04-27 | 2022-12-13 | コニカミノルタ株式会社 | 光計測装置 |
Families Citing this family (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8903222B2 (en) | 2007-02-01 | 2014-12-02 | Sony Corporation | Image reproducing apparatus, image reproducing method, image capturing apparatus, and control method therefor |
JP5057917B2 (ja) * | 2007-09-28 | 2012-10-24 | 富士通テン株式会社 | ドライブレコーダ |
JP2010087778A (ja) * | 2008-09-30 | 2010-04-15 | Casio Computer Co Ltd | 撮像装置、変速撮像方法、及びプログラム |
JP5279589B2 (ja) * | 2009-04-13 | 2013-09-04 | キヤノン株式会社 | 映像記録再生装置およびその制御方法 |
JP2011114801A (ja) * | 2009-11-30 | 2011-06-09 | Olympus Imaging Corp | 表示装置、撮影装置、及び、表示方法 |
JP5627383B2 (ja) * | 2010-01-06 | 2014-11-19 | キヤノン株式会社 | 動画再生装置及びその制御方法、プログラム、及び記憶媒体 |
JP2011250103A (ja) * | 2010-05-26 | 2011-12-08 | Canon Inc | 再生装置 |
JP5478776B2 (ja) * | 2011-04-11 | 2014-04-23 | 東芝三菱電機産業システム株式会社 | データ同期再生装置、データ同期再生方法およびデータ同期制御プログラム |
JP5751942B2 (ja) * | 2011-06-13 | 2015-07-22 | キヤノン株式会社 | 再生装置及び再生方法 |
JP5820055B2 (ja) | 2012-03-12 | 2015-11-24 | 東芝三菱電機産業システム株式会社 | データ同期再生装置、データ同期再生方法およびデータ同期制御プログラム |
TWI521965B (zh) * | 2012-05-14 | 2016-02-11 | Sony Corp | Camera and camera methods, electronic machines and programs |
JP5872981B2 (ja) * | 2012-08-02 | 2016-03-01 | オリンパス株式会社 | 撮影機器,動体の撮影方法,撮影プログラム |
US9794527B1 (en) * | 2012-09-28 | 2017-10-17 | Google Inc. | Content capture |
US9201487B2 (en) * | 2013-03-05 | 2015-12-01 | Intel Corporation | Reducing power consumption during graphics rendering |
JP5962600B2 (ja) * | 2013-06-26 | 2016-08-03 | カシオ計算機株式会社 | 動画生成装置、動画生成方法、及びプログラム |
CN104572052B (zh) * | 2013-10-21 | 2019-07-02 | 腾讯科技(深圳)有限公司 | 一种应用程序帧率的测量方法及装置 |
US9300869B2 (en) * | 2013-10-24 | 2016-03-29 | Fujitsu Limited | Reduction of spatial resolution for temporal resolution |
DE102013222795A1 (de) * | 2013-11-08 | 2015-05-13 | Sommer-Hugendubel-Pollack-Strauss Gbr (Vertretungsberechtigter Gesellschafter: Till Strauss, 10119 Berlin) | Verfahren und Vorrichtung zur Erzeugung einer künstlichen Kopplung zwischen einer Eingangsgröße und einer Ausgangsgröße |
JP2015122734A (ja) * | 2013-11-25 | 2015-07-02 | パナソニックIpマネジメント株式会社 | 撮像装置及び撮像方法 |
DE102014102689A1 (de) * | 2014-02-28 | 2015-09-03 | Arnold & Richter Cine Technik Gmbh & Co. Betriebs Kg | Laufbildkameraanordnung und Verfahren zum Betreiben einer Laufbildkameraanordnung |
JP2015186235A (ja) * | 2014-03-26 | 2015-10-22 | ソニー株式会社 | イメージセンサ、および電子装置 |
US10099132B2 (en) * | 2014-05-16 | 2018-10-16 | Sega Sammy Creation Inc. | Game image generation device and program |
US20150373293A1 (en) * | 2014-06-24 | 2015-12-24 | Sony Corporation | Video acquisition with adaptive frame rate |
US10129501B2 (en) * | 2014-11-27 | 2018-11-13 | Sony Semiconductor Solutions Corporation | Image processing device, image processing method, and program |
US20160182866A1 (en) * | 2014-12-19 | 2016-06-23 | Sony Corporation | Selective high frame rate video capturing in imaging sensor subarea |
CN104683691B (zh) * | 2015-02-02 | 2017-11-14 | 上海小蚁科技有限公司 | 拍摄方法、装置及设备 |
US20160269674A1 (en) * | 2015-03-09 | 2016-09-15 | Microsoft Technology Licensing, Llc | Dynamic Video Capture Rate Control |
US10572735B2 (en) * | 2015-03-31 | 2020-02-25 | Beijing Shunyuan Kaihua Technology Limited | Detect sports video highlights for mobile computing devices |
CN104735385B (zh) * | 2015-03-31 | 2018-10-12 | 小米科技有限责任公司 | 播放控制方法及装置、电子设备 |
US10965867B2 (en) * | 2016-03-03 | 2021-03-30 | Sony Corporation | Display control device and display control method |
KR20190029606A (ko) * | 2016-07-26 | 2019-03-20 | 소니 주식회사 | 촬상 제어 장치 및 촬상 제어 방법, 및 촬상 소자 |
KR102537210B1 (ko) * | 2016-07-29 | 2023-05-26 | 삼성전자주식회사 | 동영상 컨텐츠 제공 방법 및 이를 지원하는 전자 장치 |
KR102641894B1 (ko) | 2017-02-03 | 2024-02-29 | 삼성전자주식회사 | 이미지를 촬영하는 센서 및 그 제어 방법 |
CN107707934A (zh) * | 2017-10-24 | 2018-02-16 | 南昌黑鲨科技有限公司 | 一种视频数据处理方法、处理装置及计算机可读存储介质 |
CN107707860B (zh) * | 2017-10-24 | 2020-04-10 | 南昌黑鲨科技有限公司 | 一种视频数据处理方法、处理装置及计算机可读存储介质 |
CN107864334A (zh) * | 2017-11-09 | 2018-03-30 | 睿魔智能科技(东莞)有限公司 | 一种使用深度学习的智能镜头拍摄方法及*** |
CN108184165B (zh) * | 2017-12-28 | 2020-08-07 | Oppo广东移动通信有限公司 | 视频播放方法、电子装置和计算机可读存储介质 |
RU2716005C2 (ru) * | 2018-06-29 | 2020-03-05 | Закрытое акционерное общество "МНИТИ" (ЗАО "МНИТИ") | Способ видеосопровождения с улучшенными динамическими характеристиками и устройство для его осуществления |
JP6913830B2 (ja) | 2018-08-31 | 2021-08-04 | 富士フイルム株式会社 | 撮像素子、撮像装置、画像データ処理方法、及びプログラム |
JP6705534B2 (ja) * | 2018-10-19 | 2020-06-03 | ソニー株式会社 | センサ装置、信号処理方法 |
JP7004852B2 (ja) * | 2018-12-26 | 2022-01-21 | 富士フイルム株式会社 | 撮像素子、撮像装置、撮像素子の作動方法、及びプログラム |
WO2020137665A1 (ja) * | 2018-12-27 | 2020-07-02 | 富士フイルム株式会社 | 撮像素子、撮像装置、撮像方法及びプログラム |
CN110933294B (zh) * | 2019-11-04 | 2022-11-04 | 深圳传音控股股份有限公司 | 一种图像处理方法、终端及计算机存储介质 |
US11425306B2 (en) * | 2021-01-22 | 2022-08-23 | Qualcomm Incorporated | Zoom in or zoom out with slow-motion video capture |
US20220327718A1 (en) * | 2021-04-13 | 2022-10-13 | Qualcomm Incorporated | Techniques for enhancing slow motion recording |
CN116347224B (zh) * | 2022-10-31 | 2023-11-21 | 荣耀终端有限公司 | 拍摄帧率控制方法、电子设备、芯片***及可读存储介质 |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6359074A (ja) | 1986-08-27 | 1988-03-14 | Omron Tateisi Electronics Co | 高速ビデオカメラ |
JPH11177868A (ja) * | 1997-12-16 | 1999-07-02 | Canon Inc | 撮像方法及び再生方法とその装置 |
JP2001292409A (ja) | 2000-04-07 | 2001-10-19 | Sony Corp | データ記録再生装置及び方法 |
JP2001358984A (ja) * | 2000-06-15 | 2001-12-26 | Mitsubishi Heavy Ind Ltd | 動画像処理カメラ |
JP2002320198A (ja) * | 2001-04-23 | 2002-10-31 | Casio Comput Co Ltd | 動画記録装置 |
JP2004120384A (ja) * | 2002-09-26 | 2004-04-15 | Photron Ltd | 高速度撮像装置及び撮像速度の変更方法 |
JP2004187018A (ja) * | 2002-12-04 | 2004-07-02 | Casio Comput Co Ltd | 動画撮影装置、及び動画撮影方法 |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5239418A (en) * | 1989-10-17 | 1993-08-24 | Eastman Kodak Company | Single split frame mode for a fast frame recorder |
JP3450449B2 (ja) * | 1994-07-18 | 2003-09-22 | キヤノン株式会社 | 撮像装置およびその撮像方法 |
US5455561A (en) * | 1994-08-02 | 1995-10-03 | Brown; Russell R. | Automatic security monitor reporter |
JPH1115425A (ja) | 1997-06-26 | 1999-01-22 | Hitachi Ltd | 表示モード切り替え制御ディスプレイ |
US7196720B2 (en) * | 1998-03-06 | 2007-03-27 | Intel Corporation | Method and apparatus for powering on an electronic device with a video camera that detects motion |
JP2000059698A (ja) | 1998-08-06 | 2000-02-25 | Sony Corp | 高速撮像装置 |
JP2001036848A (ja) | 1999-07-15 | 2001-02-09 | Victor Co Of Japan Ltd | カムコーダ |
JP3697129B2 (ja) * | 2000-01-20 | 2005-09-21 | キヤノン株式会社 | 撮像装置 |
JP2001352471A (ja) * | 2000-06-07 | 2001-12-21 | Toshiba Corp | ビデオカメラ装置 |
CN1367612A (zh) * | 2000-06-30 | 2002-09-04 | 株式会社东芝 | 特殊再生控制信息记录方法,产生装置及方法,图象再生装置 |
KR100792283B1 (ko) * | 2001-08-07 | 2008-01-07 | 삼성전자주식회사 | 이동물체 자동 추적장치 및 방법 |
JP2003209731A (ja) * | 2002-01-09 | 2003-07-25 | Sony Corp | 画像信号処理方法及び撮像装置 |
US6778766B2 (en) * | 2002-01-25 | 2004-08-17 | Nikon Corporation | Vibration detection device and vibration correcting optical device |
US7456875B2 (en) * | 2002-03-14 | 2008-11-25 | Sony Corporation | Image pickup apparatus and method, signal processing apparatus and method, and wearable signal processing apparatus |
US7385626B2 (en) * | 2002-10-21 | 2008-06-10 | Sarnoff Corporation | Method and system for performing surveillance |
JP4222869B2 (ja) * | 2002-12-10 | 2009-02-12 | 株式会社ソニー・コンピュータエンタテインメント | 画像再生装置 |
JP4208634B2 (ja) * | 2003-04-23 | 2009-01-14 | キヤノン株式会社 | 再生装置 |
JP3926316B2 (ja) * | 2003-10-31 | 2007-06-06 | 松下電器産業株式会社 | 撮像装置 |
JP4107269B2 (ja) | 2004-02-23 | 2008-06-25 | ソニー株式会社 | 固体撮像装置 |
JP2006033160A (ja) * | 2004-07-13 | 2006-02-02 | Canon Inc | 撮像システム |
JP2006113264A (ja) * | 2004-10-14 | 2006-04-27 | Fujinon Corp | 像振れ補正装置 |
JP4296145B2 (ja) * | 2004-11-08 | 2009-07-15 | 株式会社東芝 | 再生装置及びその方法 |
US7817193B2 (en) * | 2004-11-25 | 2010-10-19 | Sony Corporation | Image pickup apparatus and image pickup method to display or record images picked up at high rate in real time |
JP2006265475A (ja) | 2005-03-25 | 2006-10-05 | Fuji Photo Film Co Ltd | インク組成物 |
JP2006295350A (ja) * | 2005-04-07 | 2006-10-26 | Sony Corp | 撮像装置及び撮像結果の処理方法 |
JP4434151B2 (ja) * | 2006-01-23 | 2010-03-17 | 富士フイルム株式会社 | 撮像装置 |
JP4895016B2 (ja) * | 2006-09-28 | 2012-03-14 | 三洋電機株式会社 | 撮像装置 |
US7948526B2 (en) * | 2006-11-14 | 2011-05-24 | Casio Computer Co., Ltd. | Imaging apparatus, imaging method and program thereof |
-
2007
- 2007-10-24 KR KR1020097007784A patent/KR101411627B1/ko not_active IP Right Cessation
- 2007-10-24 EP EP07830479.7A patent/EP2079231B1/en not_active Not-in-force
- 2007-10-24 CN CN2007800397298A patent/CN101529890B/zh not_active Expired - Fee Related
- 2007-10-24 TW TW096139858A patent/TW200828991A/zh not_active IP Right Cessation
- 2007-10-24 US US12/312,111 patent/US8154606B2/en not_active Expired - Fee Related
- 2007-10-24 JP JP2008541012A patent/JPWO2008050806A1/ja active Pending
- 2007-10-24 WO PCT/JP2007/070745 patent/WO2008050806A1/ja active Application Filing
-
2011
- 2011-11-22 JP JP2011255231A patent/JP5252063B2/ja not_active Expired - Fee Related
-
2012
- 2012-02-03 US US13/365,727 patent/US9013583B2/en not_active Expired - Fee Related
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6359074A (ja) | 1986-08-27 | 1988-03-14 | Omron Tateisi Electronics Co | 高速ビデオカメラ |
JPH11177868A (ja) * | 1997-12-16 | 1999-07-02 | Canon Inc | 撮像方法及び再生方法とその装置 |
JP2001292409A (ja) | 2000-04-07 | 2001-10-19 | Sony Corp | データ記録再生装置及び方法 |
JP2001358984A (ja) * | 2000-06-15 | 2001-12-26 | Mitsubishi Heavy Ind Ltd | 動画像処理カメラ |
JP2002320198A (ja) * | 2001-04-23 | 2002-10-31 | Casio Comput Co Ltd | 動画記録装置 |
JP2004120384A (ja) * | 2002-09-26 | 2004-04-15 | Photron Ltd | 高速度撮像装置及び撮像速度の変更方法 |
JP2004187018A (ja) * | 2002-12-04 | 2004-07-02 | Casio Comput Co Ltd | 動画撮影装置、及び動画撮影方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP2079231A4 |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
GB2459684A (en) * | 2008-04-30 | 2009-11-04 | British Broadcasting Corp | Television Signal having high frame rate |
JP2010050877A (ja) * | 2008-08-25 | 2010-03-04 | Nikon Corp | 撮像装置、画像再生装置、画像変換装置、画像再生プログラム |
CN101835017A (zh) * | 2009-03-09 | 2010-09-15 | 佳能株式会社 | 视频重放设备和视频重放方法 |
JP2010233183A (ja) * | 2009-03-30 | 2010-10-14 | Canon Inc | 動画保存装置及びその制御方法 |
JP2012523788A (ja) * | 2009-04-13 | 2012-10-04 | ショースキャン デジタル エルエルシー | 動画の撮影及び投影方法及びその装置 |
US9270968B2 (en) | 2009-05-20 | 2016-02-23 | Canon Kabushiki Kaisha | Imaging apparatus and reproducing apparatus which changes frame rate based on zoom operation |
US20120327273A1 (en) * | 2009-05-20 | 2012-12-27 | Canon Kabushiki Kaisha | Imaging apparatus and reproducing apparatus which changes frame rate based on zoom operation |
US8508627B2 (en) * | 2009-05-20 | 2013-08-13 | Canon Kabushiki Kaisha | Imaging apparatus and reproducing apparatus which changes frame rate based on zoom operation |
JP2011183054A (ja) * | 2010-03-10 | 2011-09-22 | Shoichiro Taniguchi | 弓を用いて矢を射る動作を解析する装置および方法 |
JP2012105012A (ja) * | 2010-11-09 | 2012-05-31 | Canon Inc | 動画再生装置、動画再生方法、コンピュータプログラム、記憶媒体 |
JP2012151705A (ja) * | 2011-01-20 | 2012-08-09 | Casio Comput Co Ltd | 動画像処理装置、動画像処理方法及びプログラム |
JP2013258609A (ja) * | 2012-06-13 | 2013-12-26 | Panasonic Corp | 撮像装置 |
JP2015080035A (ja) * | 2013-10-15 | 2015-04-23 | キヤノン株式会社 | 画像処理装置、画像処理方法、プログラム |
WO2016139971A1 (ja) * | 2015-03-03 | 2016-09-09 | ソニー株式会社 | 信号処理装置、信号処理システム、信号処理方法、および、プログラム |
US10262690B2 (en) | 2015-03-03 | 2019-04-16 | Sony Semiconductor Solutions Corporation | Signal processing device, signal processing system, signal processing method, and program |
JP7188382B2 (ja) | 2017-04-27 | 2022-12-13 | コニカミノルタ株式会社 | 光計測装置 |
CN108322650A (zh) * | 2018-02-08 | 2018-07-24 | 广东欧珀移动通信有限公司 | 视频拍摄方法和装置、电子设备、计算机可读存储介质 |
CN108322650B (zh) * | 2018-02-08 | 2020-03-27 | Oppo广东移动通信有限公司 | 视频拍摄方法和装置、电子设备、计算机可读存储介质 |
Also Published As
Publication number | Publication date |
---|---|
EP2079231A1 (en) | 2009-07-15 |
US8154606B2 (en) | 2012-04-10 |
US20120133791A1 (en) | 2012-05-31 |
TW200828991A (en) | 2008-07-01 |
CN101529890A (zh) | 2009-09-09 |
JP2012050141A (ja) | 2012-03-08 |
US20100060752A1 (en) | 2010-03-11 |
KR101411627B1 (ko) | 2014-06-25 |
US9013583B2 (en) | 2015-04-21 |
TWI359612B (ja) | 2012-03-01 |
EP2079231B1 (en) | 2014-04-30 |
JP5252063B2 (ja) | 2013-07-31 |
KR20090068333A (ko) | 2009-06-26 |
JPWO2008050806A1 (ja) | 2010-02-25 |
CN101529890B (zh) | 2011-11-30 |
EP2079231A4 (en) | 2010-04-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5252063B2 (ja) | 撮像装置と再生制御装置 | |
JP4724577B2 (ja) | 撮像装置及びその制御方法 | |
JP5036410B2 (ja) | 撮像装置及びその制御方法 | |
JP4525561B2 (ja) | 撮像装置、画像処理方法、並びにプログラム | |
KR101222727B1 (ko) | 촬상 장치 | |
JP2008109245A (ja) | 記録再生装置 | |
US20050163492A1 (en) | Picked up image recording system, signal recording device, and signal recording method | |
TWI420905B (zh) | 記錄動態影像之記錄裝置、記錄方法及程式 | |
US20050036055A1 (en) | Image pickup apparatus and control method therefor | |
JP4536173B2 (ja) | 画像記録装置及び画像記録方法 | |
JP7110985B2 (ja) | 画像処理装置、画像処理方法、およびプログラム | |
JP5024331B2 (ja) | ビデオカメラ及び情報送信方法 | |
JP4547877B2 (ja) | 撮像装置 | |
JP2015122731A (ja) | 動画再生装置及び動画再生方法 | |
JP2001136420A (ja) | 撮像装置 | |
KR20050090807A (ko) | 촬영모드 및 출력모드에 따라 영상신호의 출력경로 및출력방식을 제어할 수 있는 복합촬영장치 및 그출력제어방법 | |
JP4465655B2 (ja) | ビデオカメラ及び情報送信方法 | |
JP3846733B2 (ja) | 画像撮影装置 | |
JP2006217214A (ja) | 再生装置および撮像装置並びに再生方法 | |
KR20050090806A (ko) | 하나의 줌스위치로 다양한 조작명령을 입력할 수 있는복합촬영장치 및 그 동작제어방법 | |
KR20010001263A (ko) | 스피커 내장형 비디오 카메라의 볼륨 조절방법 | |
JP2008263429A (ja) | ビデオカメラ装置 | |
JP2005303626A (ja) | 記録装置及び記録再生装置 | |
KR20000020694A (ko) | 디지털 영상 기록/재생 방법 및 그 장치 | |
KR19990038432A (ko) | 비디오 영상 입력을 촬영할 수 있는 디지탈 스틸 카메라 및 그 제어 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 200780039729.8 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 07830479 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2008541012 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 1020097007784 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 12312111 Country of ref document: US |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007830479 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |