WO2004025956A1 - データ処理装置 - Google Patents
データ処理装置 Download PDFInfo
- Publication number
- WO2004025956A1 WO2004025956A1 PCT/JP2003/011279 JP0311279W WO2004025956A1 WO 2004025956 A1 WO2004025956 A1 WO 2004025956A1 JP 0311279 W JP0311279 W JP 0311279W WO 2004025956 A1 WO2004025956 A1 WO 2004025956A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- jpeg
- file
- processing
- variable
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/78—Television signal recording using magnetic recording
- H04N5/781—Television signal recording using magnetic recording on disks or drums
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/7921—Processing of colour television signals in connection with recording for more than one processing mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
- H04N9/8047—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/806—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components with processing of the sound signal
- H04N9/8063—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components with processing of the sound signal using time division multiplex of the PCM audio and PCM video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/82—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only
- H04N9/8205—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal
- H04N9/8227—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback the individual colour picture signal components being recorded simultaneously only involving the multiplexing of an additional signal and the colour video signal the additional signal being at least another television signal
Definitions
- the present invention relates to a data processing device, and more particularly to a data processing device that is applied to, for example, a video camera and that processes audio data and still image data of a plurality of screens in parallel with each other.
- Conventional technology is applied to, for example, a video camera and that processes audio data and still image data of a plurality of screens in parallel with each other.
- the moving image data captured by the image sensor and the audio data captured from the microphone are recorded in parallel, and when the playback mode is selected, the video data is read from the recording medium.
- the reproduced moving image data and audio data are subjected to reproduction processing in parallel.
- the sampling frequency of the audio data was shifted between the actual processing by the hardware and the calculation of the software due to design reasons. Specifically, while the actual sampling frequency on the hardware was 804 Hz, the sampling frequency used for the calculation on the software was 804 Hz. For this reason, in the related art, synchronization between the moving image data and the audio data is ensured by thinning / interpolating the audio data. However, there is a problem in that when the Z interpolation is applied to the audio data overnight, audio noise is generated, which causes discomfort to the viewer. Summary of the Invention
- a main object of the present invention is to provide a data processing device capable of ensuring synchronization between image data and audio data and preventing generation of audio noise.
- an error between the actual processing amount and the virtual processing amount of the audio data is calculated at a predetermined cycle by the calculating means.
- the adjusting means adjusts the number of screens in a still image based on the calculated error.
- the number of screens of still image data is adjusted, unlike the related art in which audio data is adjusted. Therefore, synchronization between the image data and the audio data is ensured while preventing the generation of audio noise.
- the number of screens of the processed still image data is counted by the counting means, and the actual processing amount of the audio data is integrated by the integrating means every screen period.
- the calculating means calculates a difference value between the first integrated value obtained by integrating the virtual processing amount corresponding to one screen based on the count value by the counting means and the second integrated value obtained by the integrating means. Ask.
- the adjustment means compares the calculated error with a virtual processing amount of audio data corresponding to an N (N: an integer of 1 or more) screen, and performs adjustment based on the comparison result.
- the number of screens is increased when the integrated value is a numerical value for the shortage, and the number of screens is reduced when the integrated value is a numerical value for the surplus.
- the processing procedure information is created based on the comparison result. Is used to adjust the number of screens.
- the audio data and the still image data of a plurality of screens are recorded on the recording medium by the first recording means, and the index information of the still image data of each screen is recorded on the recording medium by the second recording means.
- the adjustment executing means performs thinning / interpolation on the index information recorded by the second recording means based on the comparison result of the comparing means.
- the number of screens in a still image to be reproduced can be adjusted by thinning out the index information and interpolation.
- the virtual processing amount indicates a numerical value that approximates the actual processing amount and is suitable for software calculation.
- FIG. 1 is a block diagram showing one embodiment of the present invention
- FIG. 2 is an illustrative view showing one example of a matting state of SDRAM
- FIG. 3 is an illustrative view showing another example of the mating state of the SDRAM;
- FIG. 4 is an illustrative view showing an example of the configuration of the instruction list;
- FIG. 5 is an illustrative view showing one example of a configuration of an access information table
- FIG. 6 is an illustrative view showing one example of a configuration of a recording medium
- FIG. 7 is an illustrative view showing one example of a configuration of a free space table
- FIG. 8 is an illustrative view showing the structure of a completed movie file
- FIG. 9 (A) is an illustrative view showing a part of the index information creating process
- FIG. 9 (B) is an illustrative view showing another part of the index information creating process
- FIG. 9 (C) is FIG. 4 is an illustrative view showing another portion of the creation processing of the index information
- FIG. 10 (A) is an illustrative view showing a part of an access information table creating process
- FIG. 10 (B) is an illustrative view showing another part of an access information table creating process
- FIG. 10 (C) is an illustrative view showing another part of the process of creating the access information table
- FIG. 11 (A) is an illustrative view showing a part of the index information creating process
- FIG. 11 (B) is an illustrative view showing another part of the index information creating process
- C) is an illustrative view showing another portion of the index information creating process
- FIG. 12 (A) is an illustrative view showing a part of an access information table creating process
- FIG. 12 (B) is an illustrative view showing another part of an access information table creating process
- Figure 12 (C) is an illustrative view showing another part of the process of creating the access information table
- FIG. 13 is a flowchart showing a part of the operation of the CPU when performing the shooting processing task
- FIG. 14 is a flowchart showing another part of the operation of the CPU when performing the imaging process
- Figure 15 is a flow chart showing another part of the operation of CPU when performing the imaging processing task
- Figure 16 is a flowchart showing yet another part of the operation of the CPU when performing the imaging processing task
- Figure 17 is a front view showing another part of the operation of the CPU when performing the shooting process
- Figure 18 is a flow chart showing another part of the operation of CPU when performing the imaging processing task
- Fig. 19 is a flowchart showing yet another part of the operation of the CPU when performing the imaging processing task
- FIG. 20 is a flowchart showing a part of the operation of the CPU when performing the BG processing task.
- FIG. 21 is a flowchart showing another part of the operation of the CPU when performing the BG processing task.
- digital video camera 10 of this embodiment includes an image sensor 12.
- An aperture unit and an optical lens are arranged in front of the image sensor 12, and an optical image of a subject is irradiated on the image sensor 12 via these members.
- the CPU 52 is a multi-task CPU equipped with a multitasking S like ITRON.In the shooting mode, multiple tasks such as a shooting processing task, a shooting condition control task, and a BG (Back Ground) processing task are executed in parallel. Executed. Specifically, each task is It is executed in a time-sharing manner according to a preset priority and in response to a vertical synchronization signal described later.
- the operator can select a desired shooting mode from a plurality of shooting modes by operating the menu key 60. Either the resolution and frame rate of the captured image, or the audio system, bit rate, and sampling rate of the captured audio are different in each shooting mode.
- a desired photographing mode is selected, a corresponding information signal is provided from the system controller 56 to the CPU 52.
- the CPU 52 stores the shooting mode information (resolution, frame rate, sound system, bit rate, sampling rate) indicating the selected shooting mode and the file name of the movie file to be created in the register rgst. Store.
- the CPU 52 also instructs the timing generator (TG) 14 to shoot at the resolution and frame rate indicated by the shooting mode information.
- the TG 14 generates a timing signal according to a desired photographing mode (resolution, frame rate) based on a vertical synchronizing signal and a horizontal synchronizing signal output from the signal generator (SG) 16, and controls the image sensor 12 to use a raster scan method.
- a raw image signal (charge) having a desired resolution is output at a desired frame rate, and the output raw image signal passes through a CDS / AGC circuit 18 and an A / D converter 20.
- the digital image data is input to the signal processing circuit 22 as raw image data.
- the signal processing circuit 22 When the set zoom magnification is “1.0”, the signal processing circuit 22 performs a series of signal processing such as white balance adjustment, color separation, and YUV conversion on the raw image data input from the AZD converter 20. 1. Generate 0x YUV data. When the set zoom magnification is less than "1.0", the raw image data input from the A / D converter 20 is first subjected to the reduced zoom by the zoom circuit 22a, and after the reduced zoom, the above-described series is performed. Is performed. The YUV data generated by such processing is stored in the SDRAM 26 via the path B1 and the memory control circuit 26.
- the zoom circuit 22a first converts the raw image data input from the A / D converter 20 into SDRAM 26 through bus B 1 and memory control circuit 24 Once. Subsequently, the zoom circuit 22a reads the raw image data of a part of the area necessary for the enlargement zoom processing through the bus B1 and the memory control circuit 24, and enlarges the raw image data of the read part of the area. Apply zoom. The enlarged raw image is converted into YUV data by the above-described series of signal processing. As a result, YUV data having a magnification larger than "1.0" is generated. The generated YUV data is stored in the SDRAM 26 via the bus B1 and the memory control circuit 26.
- the video encoder 28 reads the YUV data from the SDRAM 26 through the bus B1 and the memory control circuit 24, and encodes the read YUV data into a composite image signal.
- the encoded composite image signal is
- the CPU 52 controls shooting conditions such as an aperture amount, an exposure time, a white balance adjustment gain, and an electronic zoom magnification. Specifically, the aperture amount or the exposure time is adjusted according to the brightness of the subject, the white balance adjustment gain is corrected according to the color of the subject, and the variation in the state signal indicating the operation state of the zoom key 64 is adjusted. To adjust the electronic zoom magnification. As a result, changes in the brightness and tint of the through image are prevented, and the zoom magnification of the through image changes in response to the operation of the zoom key 64.
- the recording medium 50 is a detachable recording medium that can be accessed by the I / F 46 when the recording medium 50 is inserted into the slot 48.
- the recording medium 50 is provided with a CPU 50a, a notch memory 50b, and a hard disk 50c.
- the hard disk 50c has a FAT area 501c, a root directory area 502c, and a data area 503 as shown in FIG. c is formed. Data writing to the data storage area 503c is performed by a predetermined amount via the buffer memory 50b.
- the CPU 52 When recording a moving image, the CPU 52 starts a BG processing task. At this time, an instruction list 52a as shown in FIG. 4 is created so that processing can be smoothly performed between the imaging processing task and the BG processing task.
- the CPU 52 performs a thumbnail image capturing process and a header information creating process in the next one frame period in order to create a movie file header.
- the signal processing circuit 22 is instructed to perform a thinning process, and the JPEG codec 32 is instructed to perform a compression process.
- the signal processing circuit 22 performs a thinning process in addition to the above-described YUV conversion, and writes the generated thumbnail YUV data into the SDRAM 26 through the path B1 and the memory control circuit 24.
- the JPEG codec 32 reads the thumbnail YUV data from the SDRAM 26 through the bus B1 and the memory control circuit 24, and performs JPEG compression on the read thumbnail YUV data.
- the JPEG codec 32 then writes the JPEG raw data Rth of the thumbnail image generated by the JPEG compression to the SDRAM 26 through the bus B1 and the memory control circuit 24.
- the CPU 46 also creates the J PEG header H th of the thumbnail image by itself, and writes the created J PEG header H th to the SD RAM 26 through the bus B 1 and the memory control circuit 24.
- the CPU 46 further creates its own header information H inf including the above-described shooting mode information, and transfers the created header information H inf to the bus B1 and the memory. Write to SDRAM 26 through memory control circuit 24.
- the JPEG raw data Rth, the JPEG header Hth and the header information Hinf are mapped to the SDRAM 26 as shown in FIG.
- the CPU 52 When the creation of the movie file header is completed, the CPU 52 performs an image capturing process and an audio capturing process each time a vertical synchronization signal is generated.
- the JPEG header created by itself is written into the SDRAM 26 through the bus B1 and the memory control circuit 24, and a compression instruction is given to the JPEG codec 32.
- the JPEG codec 32 reads the YUV data of the current frame from the SDRAM 26 through the bus B1 and the memory control circuit 24, and compresses the read YUV data to a target size.
- the JPEG codec 32 writes the JPEG raw data to the SDRAM 26 through the bus B1 and the memory control circuit 24.
- the target size at the time of JPEG compression is changed according to the recording status on the recording medium 50.
- the recording processing speed is slow, the processing may break down due to a bottleneck.
- the recording status of the recording medium 50 is periodically detected, and the target size at the time of JPEG compression is changed according to the detection result. Is done. This target size change processing will be described in detail later.
- a processing instruction is given to the signal processing circuit 38.
- the signal processing circuit 38 writes the audio data corresponding to one frame stored in the SRAM 38a to the SDRAM 26 through the bus B1 and the memory control circuit 38a.
- This kind of image capture processing and audio capture processing is one frame
- the JPEG header, JPEG raw data and audio data of each frame are mapped to the SDRAM 26 as shown in FIG.
- serial numbers 0, 1, 2,... are assigned to the JPEG header and JPEG raw data for each frame, while the serial numbers 0, 1, 2 are assigned to the audio data every 3 frames. ,... Are attached.
- JPEG data for one frame is formed by the JPEG header and JPEG raw data with the same number, and the start and end of the JPEG data of each frame are shown in Fig. 8. Thus, markers SOI (Start Of Image) and EOI (End Of Image) are allocated.
- the CPU 52 also creates JPEG raw data access information, JPEG header access information and JPEG data index information every time one frame period elapses, and generates audio data every three frame periods elapses. Create access information and voice data index information.
- the access information of the JPEG raw data includes the data size of each frame and the start address in the SDRAM 26.
- the access information of the JPEG header also includes the data size of each frame and the start address in the SDRAM 26.
- the index information of the JPEG data includes the data size of each frame and the distance from the beginning of the movie file when written to the recording medium 50.
- the access information of the audio data is composed of a data size equivalent to three frames and a start address in the SDRAM 26, and the index information of the audio data is composed of a data size equivalent to three frames and a movie file when written to the recording medium 50. Distance from the beginning of the file.
- the access information is created in the access information table 52b shown in FIG. 5, and the index information is created in the SDRAM 26 in the manner shown in FIG.
- the SDRAM address and data size of the JPEG raw data for three frames the SDRAM address and data size of the JPEG header for three frames, and the SDRAM address of audio data equivalent to three frames And data size are associated with each other.
- position information and size information of audio data corresponding to three frames and position information and size information of JPEG data for three frames are alternately mapped to the SDRAM 26.
- the sampling frequency of the audio signal may deviate between the actual processing by hardware and the calculation by software.
- thinning out Z interpolation is performed on the index information and access information of the JPEG data. This decimation / interpolation processing will be described later in detail.
- the CPU 52 sets “write file” in the instruction list 52a based on the access information described above so as to write audio data equivalent to three frames and JPEG data of three frames into the recording medium 50.
- audio data equivalent to three frames and JPEG data of three frames are read out from the SDRAM 26 and transmitted via the bus B 1 and the IZF circuit 46. And given to the recording medium 50.
- a data area 503c of the recording medium 50 an audio chunk composed of audio data equivalent to three frames and an image chunk composed of three frames of JPEG data are recorded. As shown in FIG. 8, audio chunks and image chunks are mapped alternately on a movie file.
- the CPU 52 stops the image capture and the voice capture, and “writes the file” in order to record the index information created in the SDRAM 26 in the manner shown in FIG. Is set to the instruction list 52a.
- the index information is read out from the SDRAM 26 and given to the recording medium 50 via the bus B 1 and the I / F circuit 46.
- the index chunk shown in Fig. 8 is formed at the end of the movie file.
- the position and size of audio data on a file are managed every time corresponding to three frames, and the position and size of JPEG data on a file are managed for each frame.
- the CPU 52 calculates the total size value of the copy file created this time and instructs “write file” to write the calculated total size value to the copy file header. Set to. This file writing is executed by the BG processing task, so that the total size value is added to the header information H inf of the movie file header. This completes the creation of a copy file that satisfies the QuickTime standard.
- the CPU 52 sets “file close” and “BG processing end” in the instruction list 52a.
- the size information written in the root directory area 502c and the FAT information written in the FAT area 501c are updated. Specifically, the file name of the movie file created this time is detected from the directory entry, and the size information assigned to the detected file name is updated from "0" to the total size value. Also, the FAT information is updated so that a link is formed in the write area (cluster) of the movie file created this time.
- the BG processing is ended by "BG processing end".
- the playback mode When the playback mode is selected by the mode switching switch 62 and the desired movie file is selected by the menu key 60, a corresponding status signal is given to the system controller 56.
- the CPU 52 detects the selected movie file from the recording medium 50, and reproduces the audio data and the JPEG data in the detected movie file. At this time, the playback order follows the index information in the movie file.
- audio data and JPEG data will be audio data 0, J?
- the data is read from the recording medium 50 in the order of 3 to 5,.
- the read audio data and JPEG data are first stored in the SDRAM 26 by the memory control circuit 24.
- the CPU 52 gives a decompression instruction to the JPEG codec 32 in the order according to the index information of the JPEG data, and gives a processing instruction to the signal processing circuit 40 in the order according to the index information of the audio data.
- the JPEG codec 32 reads the JPEG raw data forming the JPEG data of the desired frame from the SDRAM 26 through the bus B1 and the memory control circuit 24, and reads the read JPEG raw data. Perform JPEG decompression overnight.
- the YUV data generated by the JPEG decompression is stored in the SDRAM 26 through the bus B1 and the memory control circuit 24, and is then supplied to the video encoder 28 through the bus B1 and the memory control circuit 24. As a result, the corresponding playback image is displayed on the monitor. Will be displayed.
- the signal processing circuit 40 reads audio data corresponding to the desired three frames from the SDRAM 26 through the bus B1 and the memory control circuit 24, and stores the read audio data in the SRAM 40a.
- the audio data stored in the SRAM 40a is then converted into an analog audio signal by the DZA converter 42, and the converted audio signal is output from the speaker 44.
- the reproduced moving image is displayed on the monitor 30, and an audio signal synchronized with the reproduced moving image is output from the speaker 44.
- the CPU 52 executes the photographing processing task shown in FIGS. 13 to 19 and the BG processing task shown in FIGS. 20 to 21 according to the control program stored in the ROM 54.
- step S1 a shooting mode determination process is performed. Specifically, a menu indicating a plurality of shooting modes is displayed on the monitor 30, and a desired shooting mode is determined in response to the operation of the menu key 52. When the shooting mode is determined, the process proceeds to step S3, and shooting mode information indicating the determined shooting mode is created.
- the setting information is, for example, "resolution: VGA”, "frame rate: 30 fps", "sound system: monaural”, “bit rate: 8 bits", and "sampling rate: 8040 Hz”.
- step S5 the file name of the movie file created by the current shooting processing is determined. The file name is, for example, "VCLP 0003. MOV”. Creation Z The determined shooting mode information and file name are registered in the register rgst.
- step S7 various variables are initialized. Specifically, each of the variables f rmc nt, flsz, BG-RemData, re-f 1 sz, t-sz and au d_s z is set to "0", and the variable trgt-sz is set to the maximum value MAX And sets the variable a ud s z_fps to the theoretical value LG.
- the variables i and frmcnt are both variables indicating the frame number.
- the variable i is continuously incremented in response to the vertical synchronization signal, and the variable f rmcnt is cyclically updated between “0” and “3” in response to the vertical synchronization signal.
- the numerical values "0" to "3” taken by the variable f rmc nt those that actually have meaning are "0" to "2" It is.
- one image chunk is formed by three frames of JPEG data.
- the variable f rmcn t is used to specify the order of the JPEG data of interest in the image chunk.
- the variable ⁇ 1 s z is a variable indicating the total size value of JPEG raw data generated by JPEG compression.
- the variable BG—RemD ata is a variable that indicates the size of the JPEG raw data for which the “write file” instruction has been set in the instruction list 52a shown in FIG. 4 but has not yet been recorded on the recording medium 50.
- the variable p re — f 1 s z is a variable indicating the total size value of the JPEG raw data already recorded on the recording medium 50.
- variable trgt_sz is a variable indicating the target size value when compressing the YUV data of each frame
- variable t-sz is a variable used for calculating the target size value
- variable a ud—s z is a variable that indicates the total size value (bytes) of the captured audio data
- the variable aud s z—fps is a variable that indicates the size of the audio data equivalent to one frame.
- step S9 a processing instruction is given to each of the TG 14, the signal processing circuit 22, and the video encoder 28 in order to display a through image.
- a through image of the object is displayed.
- FILE-STRT is set as a command for "Start BG processing", and a command, parameters 1 and 2 for FILE-CREATE, and drive number (for driving recording medium 44) Drive number) and file path are set.
- FILE-SET-ALLOC and drive number are set as command and parameter 1
- File open command, parameter FILE-OPEN, drive number and file path are set as parameters 1 and 2. Is done.
- the file path set in "Create file” includes the size information and the file name determined in step S25, and the size information and the file name are written to the directory entry. However, since the movie file is incomplete, the size information indicates "0".
- step S21 When the vertical synchronization signal is output from the SG 16 after the processing in step S19 is completed, YES is determined in step S21, and the value of the variable i is determined in step S23.
- the variable i if the variable i is equal to or greater than "1", the process proceeds to step S31, but if the variable i is "0", the process proceeds to steps S31 through S29 through S29. .
- step S25 a thumbnail image capturing process is performed. Specifically, the JPEG header H th created by itself is written into the SD RAM 26, and the signal processing circuit 22 and the JPEG codec 32 are instructed to perform the thinning process and the compression process, respectively.
- the signal processing circuit 22 performs the thinning process of the YUV data over one frame period, and writes the thumbnail YUV data thus generated to the SDRAM 26 through the bus B1 and the memory control circuit 24.
- the JPEG codec 32 reads out the thumbnail YUV data from the SD RAM 26 through the bus B1 and the memory control circuit 24, performs JPEG compression processing on the read thumbnail YUV data, and outputs the JPEG raw data R th, and writes the J PEG raw data R th to the SDRAM 26 through the bus B1 and the memory control circuit 24.
- JP EG header H th and J PEG raw data R th are mapped to SDRAM M26 as shown in FIG. '
- header information H inf including the above-mentioned shooting mode information (resolution, frame rate, sound system, bit rate, sampling rate) is created, and the header information H inf is transferred to the bus B1 and the memory.
- the header information H inf is mapped onto the J PEG header H th as shown in FIG.
- the “file write” is performed in step S29 in FIG. Set them in the list numbers "4" and "5" of the instruction list 52a shown.
- "file write” sets the command, parameters FILE-WRITE, handle number (obtained by file open processing), SDRAM address, data size and data type as parameters 1, 2, 3 and 4. You.
- the two "file write” settings are that the header information H inf and the J PEG header H th are continuous on the SDRAM 26, but the J PEG raw data R th is stored at a remote location. Because it is.
- the start address of the header information H inf is set as the SDRAM address
- the total size of the header information H inf and the JPEG header H th is set as the data size
- the data type is set.
- "Movie file header” is set.
- the start address of JPEG raw data Rth is set as the SDRAM address
- the data size and Then, the size of the JPEG raw data Rth is set
- "movie file header” is set as the data type.
- a compression processing instruction is given to the JPEG codec 32.
- the compression processing instruction includes a target size value according to the variable trgt-sz.
- the JPEG codec 32 reads one frame of YUV data from the SDRAM 26 through the bus B1 and the memory control circuit 24, compresses the read YUV data, and outputs a JPEG raw data having a size close to the target size. An overnight is created, and the generated JPEG raw data is written to the SDRAM 26 through the bus B1 and the memory control circuit 24.
- the JPEG raw data is mapped to the SDRAM 26 in the manner shown in FIG.
- step S33 a processing instruction is given to the signal processing circuit 38 in order to perform a process of capturing audio data corresponding to one frame.
- the signal processing circuit 38 writes the audio data of one frame given from the A / D converter 36 and held in the SRAM 38 a to the SDRAM 26 through the bus B 1 and the memory control circuit 24.
- the audio data is mapped to the SDRAM 26 as shown in FIG.
- the signal processing circuit 38 also returns the size value of the audio data written in the SDRAM 26, that is, the fetched size value, to the CPU 52. Therefore, in step S35, the calculation according to Equation 1 is performed, and the returned captured size value is integrated into the variable au d_s z.
- step S37 it is determined in step S37 whether or not the JPEG compression has been completed.
- the JPEG codec 32 returns the generated JPEG raw data size value, that is, the compressed size value and the compression completion signal to the CPU 46. . Therefore, in step S37, It is determined as YES when the compression completion signal is returned.
- step S39 the operation of Expression 2 is performed to add the returned compressed size value to the variable f1sz.
- step S41 the self-created JPEG header is written to the SDRAM 26 through the bus B1 and the memory control circuit 24.
- step S43 the index information of the current frame is: Write to SDRAM 26 through circuit 24.
- the J PEG header is mapped to the SDRAM 26 as shown in FIG. 2, and the index information is mapped to the SDRAM 26 as shown in FIG.
- step S43 position information and size information of one frame of JPEG data are created as index information.
- one image chunk is formed by three frames of JPEG data.
- step S43 the number of the current frame in the three consecutive frames is specified from the variable f rmcnt, thereby determining at which position in the SDRAM 26 the index information is created. .
- step S45 JPEG raw data of the current frame and access information of the JPEG header are created in the access information table 52b shown in FIG. That is, the start address information and the size information of the JPEG raw data of the current frame existing in the SDRAM 26 are created as access information of the JPEG raw data of the current frame, and the JPEG header of the current frame existing in the SDRAM 26 is generated. Creates start address information and size information as access information for the JPEG header of the current frame. Then, each created access information is assigned to the variable i set in the access information table 52b.
- step S47 the variable i is compared with the frame rate value FPS of the current shooting mode.
- the current shooting mode frame rate is 30 f If ps, the frame rate value F PS will be "30" and the variable i will be compared to "30". If i is less than FPS, the process directly proceeds to step S83, but if i ⁇ FPS, the process proceeds to step S81 via the processes of steps S49 to S81.
- step S49 it is determined whether or not the variable f rmcn t force S is less than "2". If YES, it is determined in step S51 whether or not the condition of Expression 3 is satisfied. On the other hand, if the variable rmcnt is equal to or greater than "2", it is determined in step S59 whether the condition of Expression 4 is satisfied.
- aud sz-fps * (i + 1))-aud one sz> aud sz-fps aud_s z is the total size value of the audio data actually captured, and aud sz-fps * (i + 1) is , This is the product of the number of frames from the start of capture and the theoretical value LG.
- the difference between the two values is compared to the theoretical value LG. Then, as long as the difference value is equal to or less than the theoretical value LG, the process proceeds to step S63.If the difference value exceeds the theoretical value LG, the process proceeds through steps S53 to S57 or through step S61. Proceed to step S63.
- the error between the two is 3Hz. Then, the size of the audio data corresponding to one second is shifted by 3 bytes. Since the theoretical value LG is 268 bytes, the condition of Expression 3 is satisfied about once every 90 seconds, and steps S53 to S57 are processed. If the actual sampling rate is 8034 Hz and the sampling rate calculated by software is 8040 Hz, the error between the two is 6 Hz. At this time, the condition of Expression 4 is satisfied about once every 45 seconds, and the process of step S61 is executed.
- step S53 each of the variables i and frmcnt is incremented.
- step S55 the same image index information as the previous time, that is, the same index information as the index information created in the previous step S43 is created in the SDR AM 26.
- step S57 the same access information as the previous time, that is, the previous step S43 is created. 45 Create the same access information in the access information table 52b as the access information created in step 5.
- step S61 each of the variables i and f rmcn t is decremented, and then the process proceeds to step S63.
- the condition shown in Expression 3 is satisfied.
- the index information of the same JPEG data is set in the SDRAM 26 as shown in FIG. 9B by the processing in steps S53 to S57, and the JPEG data forming the same JPEG data is generated.
- the access information of the header and the JPEG header is set in the access information table 52b as shown in FIG. 10 (B).
- the index information of the JPEG data P is set in the SDRAM 26.
- the variable frcmnt is incremented and the index information created in the previous step S43 is re-enabled, so that the index information of the JPEG data P is interpolated as shown in FIG. 9 (B).
- the index information of the JPEG data P + 1 is set as shown in FIG. 9 (C).
- the access to the JPEG raw data P and the JPEG header P is performed as shown in Fig. 10 (B).
- the information will be assigned to the variable i (-P + 1).
- the index information of the JPEG data P and the index information of the JPEG data P + 1 are set in the SDRAM 26.
- the index information of the JPEG data P + 1 is converted to the JPEG data P + by the processing of the next step S43, as shown in FIG. 11 (B). Overwritten by the index information of 2.
- the index information of J PEG data P + 1 is thinned out.
- the index information of the JPEG data P + 3 is set as shown in FIG. 11 (C).
- the access information of the JPEG raw data P and the access information of the JPEG header P and the access information of the JPEG raw data P + 1 and the JPEG header P + 1 are shown in the access information table.
- Set to b In this state, since the variable i is decremented, the access information of the J PEG raw data P + 1 and the J PEG header P + 1 is changed to the J PEG header by the processing in the next step S45, as shown in FIG. Overwritten by the access information of raw data P + 2 and J PEG header P + 2. As a result, the access information of the JPEG data P + 1 is thinned out. Following the access information of J PEG raw data P + 2 and J PEG header P + 2, the access information of J PEG raw data P + 3 and J PEG header P + 3 is set as shown in FIG. 12 (C). .
- variable i is incremented in step S53, and the determination of NO is continued in the next and subsequent steps S51. Since the variable i is decremented in step S61, the determination of NO is continued in the next step NO in step S59.
- the process proceeds directly to step S83, but if the remaining force is “0”, the process proceeds to step S83 via the processes of steps S65 to S81. Since the excessive force S becomes "0" only once in 30 frames, the processing in steps S65 to S81 is executed once in 30 frames.
- step S65 the variable f 1 sz and pre_f 1 sz are subjected to an operation according to equation 5, and in step S67, the difference value ⁇ f 1 sz, the variable BG—RemData and the frame rate value FPS obtained by equation 5 are calculated. The operation according to Equation 6 is performed.
- a f 1 s z f 1 s z— p r e-i f l s z
- t_s z ( ⁇ f 1 s z-BG-R emD a t a) / FP S
- the variable f 1 sz is the total size value of J PEG raw data obtained by J PEG compression
- the variable pre_f 1 sz is the total of the J PEG raw data already recorded on the recording medium 50.
- the variable! E_f 1 sz is updated only once every 30 frames, and the operation according to Equation 5 is also updated only once every 30 frames, so the difference value ⁇ f 1 sz Indicates the total size of the JPEG raw data generated in the latest 30 frames.
- the variable BG—RemData is the total size value of the J PEG raw data that has been set in the instruction list 52a but not yet recorded on the recording medium 50.
- This variable BG—RemData is smaller when the time required for "file writing” is shorter, and is larger when the time required for "file writing” is longer.
- the subtraction value obtained by subtracting such a variable BG—RemData from the difference value ⁇ f 1 sz reflects the current processing speed of “file writing”, and divides this subtraction value by the frame rate FPS.
- the value is a compressed size value where the variation of the variable BG-RemData under the current processing speed falls within the specified range. Such a compressed size value is calculated as a variable t-sz.
- the processing speed of the "file writing" may be varied by the characteristics of the recording medium 50, such as the processing speed of the CPU 50a and the capacity of the buffer memory 50b, as well as the occupancy of the bus B1 and the BG processing task.
- the processing status of tasks other than the above may be considered.
- a zoom magnification larger than “1.0” is selected by operating the zoom key 64
- the raw image data is temporarily stored in the SDRAM 26 and then input to the signal processing circuit 22.
- the raw image de The signal is supplied to the DRAM 26 and returned to the signal processing circuit 22 via the bus B1.
- the occupation rate of the bus B1 increases due to the raw image data transfer processing, thereby decreasing the processing speed of "file writing".
- a shooting condition control task is started, and the aperture / exposure time, white-parameter adjustment gain, and the like are adjusted. Since each task cannot be executed at the same time, when the imaging condition control task is activated, the BG processing task is interrupted, which slows down the "file write" processing speed.
- variable t-sz is updated periodically in consideration of the fluctuation in the processing speed of the "file writing".
- the target size value and thus the J PEG compression ratio are updated as described later.
- step S69 the calculated variable t—sz is compared with the variable trg t_sz. If t_sz ⁇ trgt—sz, the variable t—sz is compared with the minimum value MIN in step S71. If t-sz ⁇ MIN, the process directly proceeds to step S79. If t-sz ⁇ MIN, the variable t-sz is updated to the minimum value MIN in step S73, and then the process proceeds to step S79. On the other hand, if it is determined in step S69 that t-sz ⁇ trgt-sz, the variable t-sz is compared with the maximum value MAX in step S75.
- step S79 the variable t—sz is set as the variable trg t_sz.
- Equation 6 the variable t—sz decreases when the variable BG—RemDa t a is large, and conversely, the variable t—sz increases when the variable BG—RemDa t a is small. Therefore, “t ⁇ sz ⁇ trgt ⁇ sz” means that the amount of unrecorded JPEG data is large, that is, the processing speed of “file write” is slow. “T ⁇ sz ⁇ trgt ⁇ sz” means that the amount of unrecorded JPEG data is small, that is, the recording characteristics of the recording medium 50 are excellent.
- variable t—sz is less than the variable trg t__s z
- the variable t_sz is used to enable a smaller target size value (higher JPEG compression ratio) in the next second.
- sz is set as a variable trgt—sz.
- variable t—sz is greater than or equal to the variable trgt—sz
- the variable t—sz is changed to the variable trgt—sz to enable a larger target size value (lower JPEG compression ratio) in the next second.
- the size of the JPEG data generated in the next one second is larger than the size of the JPEG data generated in the current one second, and the deterioration of the image quality due to the compression processing is reduced.
- step S81 the variable f 1 s z and BG—RemData are subjected to the operation of Expression 7 to update the variable pre_f 1 s z.
- Equation 7 the total size value of the unrecorded JPEG raw data is subtracted from the total size value of the JPEG raw data generated so far. Since this operation is also performed every 30 frames, the variable p re_f 1s z is updated once every 30 frames. In the next operation, that is, in the operation of Equation 5 after 30 frames, the updated variable pre_f 1 s z is subtracted from the latest variable f 1 s z. In step S83, the variable frmcnt is incremented, and in the following step S85, the value of the incremented variable frmcnt is determined.
- variable f rmc nt force S is “1” or “2”
- the process proceeds directly to step S 95, but if the variable f rmc nt is “3”, the process proceeds through the processes of steps S 87 to S 93. Proceed to S95.
- step S87 the index information of the audio data is written into the SDRAM 26.
- the movie file shown in Fig. 7 one audio chunk is formed by audio data corresponding to three frames.
- the position and size of audio data in the file are managed at intervals corresponding to three frames. For this reason, in step S85, the audio data corresponding to the latest three frames—the evening position information and the size information are created, and the created index information is shown in FIG. Write to SDR AM 26 as shown.
- the access information of the audio data is written to the access information table 52b. That is, the head address information and the size information of the audio data corresponding to three frames existing in the SDRAM 26 are created as access information, and the created access information is written in the access information table 52b. At this time, the access information is associated with the access information of the JPEG data of the three frames of interest.
- step S91 three frames of JPEG raw data set in the access information table 52b, three frames of JPEG header access information, and three frames of audio data access information are referenced. Then, "write file" is set in the instruction list 52a shown in FIG. As shown in FIG.
- step S91 a total of seven "file writing” are set in the instruction list 52a.
- “File Write”, which is the first of these seven “File Writes” the SDRAM address indicates the start address of the audio data equivalent to the three frames of interest, and the data size is the three frames of interest. Indicates the size of the audio data equivalent to 1 m, and the data type indicates the audio chunk.
- the start address and the data size are equal to the SDRAM address and data size forming the access information created in step S87.
- the SDRAM address indicates the start address of the JPEG header of the three frames of interest
- the data size is the size of the JPEG header of the three frames of interest. Indicates the size, and the data type indicates the JPEG header.
- the start address and the data size are equal to the SDRAM address and data size forming the access information of the JPEG header of the latest three frames created in step S45 or S57.
- the SDRAM address indicates the start address of the JPEG raw data of the target 3 frames
- the data size is the size of the JPEG raw data of the target 3 frames.
- the data type indicates JPEG raw data.
- the size is equal to the SDRAM address and data size forming the latest 3 frames of JPEG raw data—evening access information created in step S45 or S57.
- step S93 the calculation of equation 8 is performed to add the size values of the three-frame JPEG raw data set in the instruction list 52a in step S91 to the variable BG—RemDat a.
- step S95 the frame number i is incremented, and in step S97, it is determined whether or not the shirt tapotan 58 has been operated. Steps S21 to S95 are repeated unless the shirt button 58 is pressed, and the JPEG header, JPEG raw data and audio data generated in each frame are mapped to the SDRAM 26 as shown in FIG. .
- step S99 determines the value of the variable f rmc n t. If the variable f rmcnt is "3", the process proceeds to step S103. If the variable f rmcn t is "1" or "2”, "file write” is instructed in step S101. After setting to a, go to step S103.
- variable f rmc nt force S "1"
- the last audio chunk and image chunk are formed by one frame of audio data and JPEG data
- the instruction list 52a has a total of three "file writing”. Is set.
- the variable f rmc nt is "2”
- the last audio chunk and image chunk are formed by two frames of audio data and J PEG data
- the instruction list 52a has a total of five "write files”. Is set.
- An image chunk consisting of PEG data is formed in the movie file. .
- step S103 "write file” is set in the instruction list 52a in order to write the index information shown in FIG. 3 into the movie file.
- the SDRAM address and data size set here indicate the start address and the total size of the index information shown in Fig. 3, and the data type indicates the movie file header.
- step S105 the total size of the movie file is calculated based on the size information included in the index information, and the calculated total size data is written to the SDRAM 26.
- steps S107 to S111 "write file”, "close file” and “end BG processing” are set in the instruction list 52a.
- the SDRAM address and data size set in “File write” indicate the start address and data size of the total size data, and the data type indicates the movie file header.
- File close FILE-CLOSE is set as a command
- End BG processing FILE-END is set as a command.
- the total size value is added to the size information of the movie file header.
- the size information of the directory entry (the size information written based on the process in step S15) is updated from “0” to the total size value.
- the FAT information in the FAT area 501c is updated.
- the BG processing ends with "BG processing end”.
- step S 1 2 the read destination list number L is set to “0”, and in subsequent step S 1 2 3 Determines whether the command read from list number L is FILE-STRT. If it is YE S, the list number L is incremented in step S125 and the contents of the command read from the incremented list number L are incremented in steps S127, S131, S1. Discrimination is made for each of 35, S139 and S147. If the read command is FILE-CREATE, YES is determined in step S127 and file creation processing is performed in step S129.
- the recording medium 50 is specified by the drive number set in parameter 1 and the file name and the file name are set in the directory entry of the recording medium 50 based on the file path set in parameter 2.
- Write size information indicating size 0.
- step S133 a table creation process is performed in step S133. That is, the recording medium 50 is specified by the drive number set in the parameter — evening 1 and the free area table 52 c shown in FIG. 7 is created by referring to the FAT information.
- the process returns to step S125.
- step S135 the flow advances from step S135 to step S137 to perform a file open process. That is, the recording medium 50 is specified by the drive number set in the parameter 1, the file is specified based on the file path set in the parameter 2, and a handle number to be assigned to this file is created. The created handle number is used for the photographing process. Upon completion of the processing, the flow returns to step S125.
- the flow advances from step S139 to step S141 to perform a file write process.
- the write destination movie file is specified by the handle number set in parameter 1 and the read start address and read size are determined according to the SD RAM address and data size set in parameters 2 and 3. Identify. Then, based on the read start address and the read size, data is read from the SD RAM 26 in units of code, and the read data is stored in the CPU 50a of the recording medium 50 together with the write destination movie file information. give. If the read size set in the parameter 3 is larger than the buffer memory 50b provided in the recording medium 50, a BUSY signal is returned from the CPU 50a to the CPU 52 when the buffer memory 50b becomes full.
- step S141 is interrupted in response to the BUSY signal.
- a READY signal is returned from the CPU 50 a to the CPU 52.
- the process in step S141 is restarted in response to the READY signal.
- step S143 the type of parameter set for parameter 4 is determined.
- the process directly returns to step S 125, but if the data type is “J PEG raw data”, the calculation according to equation 9 is executed in step S 145. From step S125.
- B G—R emD a t a B G_R emD t a-J PE G Raw data size value According to Equation 9, the data size set in parameter 3 is subtracted from the variable BG—Re mD a t a. As a result, the variable BG—RemDat a indicates the size of the JPEG image data set in the instruction list 52a but not yet recorded on the recording medium 50.
- step S149 the process advances from step S147 to step S149 to perform a file close process. Specifically, the size information assigned to the file name of the opened movie file is updated with the total size value held in the SDRAM 26, and the FAT information stored in the SDRAM 26 is used to update the FAT area 501c. Update FAT information. Upon completion of the process, the process returns to the step S125.
- step S147 If the read command is FILE-END, NO is determined in step S147, and the process returns to step S121.
- the BG process shifts to a standby state.
- the number of frames of JPEG data recorded on the recording medium 50 is adjusted (S53 to S57, S61). Specifically, the number of frames is adjusted by thinning out interpolation of index information and access information. Therefore, synchronization between the reproduced moving image and the reproduced sound can be ensured while preventing the generation of audio noise.
- the image compression is performed by the JPEG system, but the MPEG system may be adopted instead of the JPEG system, and the target size value may be updated in G ⁇ P units.
- the target size value is updated every 30 frames.
- the target size value is changed to 32 frames, 64 frames, and 128 frames.
- the target size may be updated for each number of frames corresponding to a power.
- the number of frames of the JPEG data is adjusted when performing the recording process.
- the number of frames may be adjusted during the reproduction process.
- both the access information and the index information are thinned out / interpolated.
- only the index information is used. It is also possible to apply thinning / interpolation to the data. As a result, it is possible to prevent the JPEG data from being lost due to the access information thinning process.
- the FAT method is adopted as the recording method of the moving image signal, but a UDF (Universal Disk Format) method may be adopted instead.
- the description is made using a digital video camera.
- the present invention can also be applied to a stationary hard disk recorder that records TV programs.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Signal Processing For Recording (AREA)
- Synchronizing For Television (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/526,897 US7382401B2 (en) | 2002-09-10 | 2003-09-03 | Data processing apparatus |
EP03795288A EP1549062A4 (en) | 2002-09-10 | 2003-09-03 | DATA PROCESSING DEVICE |
AU2003264380A AU2003264380A1 (en) | 2002-09-10 | 2003-09-03 | Data processing device |
KR1020047007677A KR100581323B1 (ko) | 2002-09-10 | 2003-09-03 | 데이터 처리 장치 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2002-263768 | 2002-09-10 | ||
JP2002263768A JP4162454B2 (ja) | 2002-09-10 | 2002-09-10 | データ処理装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2004025956A1 true WO2004025956A1 (ja) | 2004-03-25 |
Family
ID=31986468
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2003/011279 WO2004025956A1 (ja) | 2002-09-10 | 2003-09-03 | データ処理装置 |
Country Status (7)
Country | Link |
---|---|
US (1) | US7382401B2 (ja) |
EP (1) | EP1549062A4 (ja) |
JP (1) | JP4162454B2 (ja) |
KR (1) | KR100581323B1 (ja) |
CN (1) | CN1330180C (ja) |
AU (1) | AU2003264380A1 (ja) |
WO (1) | WO2004025956A1 (ja) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4179831B2 (ja) * | 2002-09-10 | 2008-11-12 | 三洋電機株式会社 | 動画像記録装置 |
US7873106B2 (en) | 2004-11-15 | 2011-01-18 | Mediatek Inc. | Method and apparatus for synchronized recording of audio and video streams |
US7634005B2 (en) | 2004-11-15 | 2009-12-15 | Mediatek Incorporation | Method and apparatus for synchronized recording of audio and video streams |
KR100639109B1 (ko) * | 2005-03-23 | 2006-10-31 | 주식회사 코아로직 | 섬네일 제이피이지 이미지의 생성 장치, 그의 생성 방법 및그의 저장 매체 |
KR101156115B1 (ko) * | 2005-05-18 | 2012-06-21 | 삼성전자주식회사 | 디지털 영상 처리 장치의 제어 방법 |
KR100709892B1 (ko) * | 2005-07-20 | 2007-04-20 | 삼성테크윈 주식회사 | 디지털 이미지 리사이즈 방법 및 이를 수행하는 디지털이미지 처리장치 |
US20070186250A1 (en) * | 2006-02-03 | 2007-08-09 | Sona Innovations Inc. | Video processing methods and systems for portable electronic devices lacking native video support |
JP5018332B2 (ja) * | 2007-08-17 | 2012-09-05 | ソニー株式会社 | 画像処理装置、撮像装置、画像処理方法、およびプログラム |
US8098318B2 (en) * | 2007-11-27 | 2012-01-17 | Panasonic Corporation | Video reproduction apparatus, digital camera, semiconductor integrated circuit, and method for video reproduction |
KR101607295B1 (ko) * | 2009-07-31 | 2016-04-11 | 엘지전자 주식회사 | 압축 파일 생성 방법 및 장치, 이와 관련된 카메라 모듈 및 이를 포함하는 단말기 |
KR101490468B1 (ko) * | 2010-02-04 | 2015-02-06 | 삼성전자 주식회사 | 데이터 처리 장치 및 방법 |
JP6190236B2 (ja) * | 2013-10-10 | 2017-08-30 | キヤノン株式会社 | 画像表示装置、撮像装置、画像表示方法 |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06121276A (ja) * | 1992-10-07 | 1994-04-28 | Nec Corp | 画像及び音声情報の圧縮再生システム |
JPH08102908A (ja) * | 1994-10-03 | 1996-04-16 | Canon Inc | 再生装置 |
JPH11164256A (ja) * | 1997-11-26 | 1999-06-18 | Nec Corp | オーディオ・ビデオ同期再生装置及び方法 |
Family Cites Families (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3255308B2 (ja) * | 1992-12-18 | 2002-02-12 | ソニー株式会社 | データ再生装置 |
KR100307618B1 (ko) * | 1994-05-31 | 2001-11-30 | 윤종용 | 영상부호화방법및장치 |
JPH08212071A (ja) | 1995-02-02 | 1996-08-20 | Mitsubishi Electric Corp | 命令コード生成方法 |
KR100471956B1 (ko) * | 1996-04-25 | 2005-05-16 | 마쯔시다덴기산교 가부시키가이샤 | 화상압축부호화장치및방법 |
JP3193947B2 (ja) * | 1997-01-08 | 2001-07-30 | 株式会社ディジタル・ビジョン・ラボラトリーズ | データ送信システム及びデータ送信方法 |
JPH10228728A (ja) * | 1997-02-17 | 1998-08-25 | Sony Corp | デジタル信号記録方法及び装置、デジタル信号再生方法及び装置 |
US6160847A (en) * | 1998-06-26 | 2000-12-12 | Lsi Logic Corporation | Detection mechanism for video channel underflow in MPEG-2 video decoding |
US6963608B1 (en) * | 1998-10-02 | 2005-11-08 | General Instrument Corporation | Method and apparatus for providing rate control in a video encoder |
US6643402B1 (en) * | 1999-03-23 | 2003-11-04 | Sanyo Electric Co., Ltd | Image compression device allowing rapid and highly precise encoding while suppressing code amount of image data after compression |
US7145597B1 (en) * | 1999-10-28 | 2006-12-05 | Fuji Photo Film Co., Ltd. | Method and apparatus for image processing |
JP3941305B2 (ja) * | 1999-11-22 | 2007-07-04 | ソニー株式会社 | 光ディスク装置及びデータ再生方法 |
JP3495709B2 (ja) | 2001-01-12 | 2004-02-09 | 三洋電機株式会社 | データ記録装置 |
-
2002
- 2002-09-10 JP JP2002263768A patent/JP4162454B2/ja not_active Expired - Fee Related
-
2003
- 2003-09-03 KR KR1020047007677A patent/KR100581323B1/ko not_active IP Right Cessation
- 2003-09-03 US US10/526,897 patent/US7382401B2/en not_active Expired - Fee Related
- 2003-09-03 EP EP03795288A patent/EP1549062A4/en not_active Withdrawn
- 2003-09-03 AU AU2003264380A patent/AU2003264380A1/en not_active Abandoned
- 2003-09-03 WO PCT/JP2003/011279 patent/WO2004025956A1/ja active Application Filing
- 2003-09-03 CN CNB038017423A patent/CN1330180C/zh not_active Expired - Fee Related
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH06121276A (ja) * | 1992-10-07 | 1994-04-28 | Nec Corp | 画像及び音声情報の圧縮再生システム |
JPH08102908A (ja) * | 1994-10-03 | 1996-04-16 | Canon Inc | 再生装置 |
JPH11164256A (ja) * | 1997-11-26 | 1999-06-18 | Nec Corp | オーディオ・ビデオ同期再生装置及び方法 |
Non-Patent Citations (1)
Title |
---|
See also references of EP1549062A4 * |
Also Published As
Publication number | Publication date |
---|---|
US7382401B2 (en) | 2008-06-03 |
CN1330180C (zh) | 2007-08-01 |
KR20040054788A (ko) | 2004-06-25 |
EP1549062A4 (en) | 2010-06-02 |
CN1606877A (zh) | 2005-04-13 |
EP1549062A1 (en) | 2005-06-29 |
AU2003264380A1 (en) | 2004-04-30 |
JP4162454B2 (ja) | 2008-10-08 |
KR100581323B1 (ko) | 2006-11-17 |
JP2004104471A (ja) | 2004-04-02 |
US20060164519A1 (en) | 2006-07-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US8208792B2 (en) | Content shooting apparatus for generating scene representation metadata | |
JP3819669B2 (ja) | ディジタルカメラ | |
JP4179831B2 (ja) | 動画像記録装置 | |
WO2006129868A1 (ja) | 撮像装置、撮像結果の処理方法、画像処理装置、撮像結果の処理方法のプログラム、撮像結果の処理方法のプログラムを記録した記録媒体及び撮像結果の処理システム | |
WO2004025956A1 (ja) | データ処理装置 | |
JP4992639B2 (ja) | コンテンツ撮影装置 | |
JP4161773B2 (ja) | 映像編集装置,映像編集装置の処理方法 | |
JP2009194770A (ja) | 撮像装置、動画再生装置及びそのプログラム | |
JP3495709B2 (ja) | データ記録装置 | |
US7146052B2 (en) | Image processing apparatus and surveillance camera system utilizing the same | |
JP5213503B2 (ja) | 記憶再生装置 | |
US7509019B2 (en) | Contents editing apparatus with frequency adjustment | |
US20030113099A1 (en) | Image recording apparatus | |
JP4717101B2 (ja) | 動画像記録装置 | |
JP2003189227A (ja) | 画像記録装置 | |
JP4262913B2 (ja) | 画像処理装置 | |
JP2003125385A (ja) | 画像処理装置 | |
JP3789346B2 (ja) | 動画像記録再生装置 | |
JP6332963B2 (ja) | 画像処理装置及び画像処理装置の制御方法 | |
JP2000184330A (ja) | ディジタルカメラ | |
JPH0870420A (ja) | 電子スチルカメラおよび該電子スチルカメラの画像データ記録方法 | |
JP2003309817A (ja) | 動画像再生装置 | |
JP2003101931A (ja) | 画像処理装置および方法、記録媒体、並びにプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 1020047007677 Country of ref document: KR |
|
WWE | Wipo information: entry into national phase |
Ref document number: 20038017423 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2003795288 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2006164519 Country of ref document: US Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 10526897 Country of ref document: US |
|
WWP | Wipo information: published in national office |
Ref document number: 2003795288 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 10526897 Country of ref document: US |