US20140146874A1 - Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method - Google Patents
Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method Download PDFInfo
- Publication number
- US20140146874A1 US20140146874A1 US14/022,203 US201314022203A US2014146874A1 US 20140146874 A1 US20140146874 A1 US 20140146874A1 US 201314022203 A US201314022203 A US 201314022203A US 2014146874 A1 US2014146874 A1 US 2014146874A1
- Authority
- US
- United States
- Prior art keywords
- multimedia data
- compression algorithm
- interface
- output
- data processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000007906 compression Methods 0.000 title claims abstract description 270
- 230000006835 compression Effects 0.000 title claims abstract description 233
- 238000012545 processing Methods 0.000 title claims abstract description 65
- 238000003672 processing method Methods 0.000 title claims description 21
- 230000003044 adaptive effect Effects 0.000 title description 22
- 238000004891 communication Methods 0.000 title description 3
- 238000012856 packing Methods 0.000 claims description 24
- 238000004458 analytical method Methods 0.000 claims description 12
- 238000013139 quantization Methods 0.000 claims description 4
- 230000008520 organization Effects 0.000 claims description 2
- 238000000034 method Methods 0.000 description 20
- 238000013144 data compression Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 12
- 230000000007 visual effect Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 5
- 238000013461 design Methods 0.000 description 5
- 230000006837 decompression Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000001525 retina Anatomy 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
- H04N23/815—Camera processing pipelines; Components thereof for controlling the resolution by using a single image
-
- H04N19/00212—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/12—Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3278—Power saving in modem or I/O interface
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/154—Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/179—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a scene or a shot
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/184—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being bits, e.g. of the compressed video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/65—Control of camera operation in relation to power supply
- H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/02—Handling of images in compressed format, e.g. JPEG, MPEG
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Definitions
- the disclosed embodiments of the present invention relate to transmitting and receiving multimedia data over a camera interface, and more particularly, to a data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over a camera interface and related data processing method.
- a camera interface is disposed between a first chip and a second chip to transmit multimedia data from the first chip to the second chip for further processing.
- the first chip may include a camera module
- the second chip may include an image signal processor (ISP).
- the multimedia data may include image data (i.e., a single captured image) or video data (i.e., a video sequence composed of captured images).
- image data i.e., a single captured image
- video data i.e., a video sequence composed of captured images
- the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface.
- a portable device e.g., a smartphone
- the battery life is shortened due to the increased power consumption of the camera interface.
- a data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over a camera interface and related data processing method are proposed.
- an exemplary data processing apparatus includes a compressor and an output interface.
- the compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data.
- the output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to context characteristics of the input multimedia data.
- an exemplary data processing apparatus includes a compressor and an output interface.
- the compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data.
- the output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a power supply status.
- an exemplary data processing apparatus includes a compressor and an output interface.
- the compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data.
- the output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to an operational status of a storage device.
- an exemplary data processing apparatus includes a compressor and an output interface.
- the compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data.
- the output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to at least one image capture characteristic.
- an exemplary data processing apparatus includes a compressor and an output interface.
- the compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data.
- the output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream to another data processing apparatus via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a de-compression algorithm supported by the another data processing apparatus.
- an exemplary data processing apparatus includes an input interface and a de-compressor.
- the input interface is arranged for receiving an input bitstream from another data processing apparatus via a camera interface, and un-packing the input bitstream into an input multimedia data, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- the de-compressor is arranged for generating a de-compressed multimedia data according to the input multimedia data when the input multimedia data is a compressed multimedia data.
- the de-compressor adaptively adjusts a de-compression algorithm according to a compression algorithm employed by the another data processing apparatus.
- an exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusts a compression algorithm according to context characteristics of the input multimedia data; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- an exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to a power supply status; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- an exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to an operational status of a storage device; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- an exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to at least one image capture characteristic; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- an exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to a de-compression algorithm supported by a data processing apparatus; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream to the data processing apparatus via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- an exemplary data processing method includes at least the following steps: receiving an input bitstream from a data processing apparatus via a camera interface, and un-packing the input bitstream into an input multimedia data, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI); adaptively adjusting a de-compression algorithm according to a compression algorithm employed by the data processing apparatus; and when the input multimedia data is a compressed multimedia data, generating a de-compressed multimedia data according to the input multimedia data and the de-compression algorithm.
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention.
- FIG. 2 is a table showing characteristics of different compression algorithms supported by the compressor shown in FIG. 1 .
- FIG. 3 is a diagram illustrating an embodiment of the compressor shown in FIG. 1 .
- FIG. 4 is a diagram illustrating one frame included in the input multimedia data.
- FIG. 5 is a flowchart illustrating an adaptive compression method based on context characteristics of the input multimedia data according to an embodiment of the present invention.
- FIG. 6 is a diagram illustrating another embodiment of the compressor shown in FIG. 1 .
- FIG. 7 is a diagram illustrating thresholds of the battery capacity of the battery device.
- FIG. 8 is a flowchart illustrating an adaptive compression method based on a power supply status according to an embodiment of the present invention.
- FIG. 9 is a diagram illustrating thresholds of the bandwidth of the storage device.
- FIG. 10 is a flowchart illustrating an adaptive compression method based on an operating status of a storage device according to an embodiment of the present invention.
- FIG. 11 is a flowchart illustrating an adaptive compression method based on at least one image capture characteristic according to an embodiment of the present invention.
- FIG. 12 is a diagram illustrating configuration of a compressor in a camera module and configuration of a de-compressor in an ISP according to an embodiment of the present invention.
- FIG. 13 is a flowchart illustrating an adaptive compression and de-compression method based on side information communicated between a camera module and an ISP according to an embodiment of the present invention.
- the present invention proposes applying data compression to a multimedia data and then transmitting a compressed multimedia data over a camera interface.
- the data size/data rate of the compressed multimedia data is smaller than that of the original un-compressed multimedia data, the power consumption of the camera interface is reduced correspondingly.
- the present invention further proposes an adaptive compression/de-compression scheme which is based on side information given by one or more signal processing elements (e.g., an image signal processor (ISP), a video/image codec, a graphic engine, a display processor, an external storage, and a battery meter). This may allow the configuration of the compressor and the counterpart de-compressor to be adjusted in a static or dynamic way.
- ISP image signal processor
- the present invention proposes using the adaptive compression scheme for enabling a compression algorithm selected from a plurality of candidate compression algorithms, where the selected compression algorithm most efficiently compresses the multimedia data. Compared to a typical compression scheme using a fixed compression algorithm, the proposed adaptive compression scheme achieves better performance.
- the ISP may refer to side information given by the camera module to adaptively select a de-compression algorithm compliant with the compression algorithm employed by the camera module. In this way, the compressed data stream from the camera module can be correctly de-compressed by the ISP. Further details will be described as below.
- FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention.
- the data processing system 100 includes a plurality of data processing apparatuses such as a camera module 110 external to an application processor 102 and an image signal processor (ISP) 114 included in the application processor 102 .
- the camera module 110 and the ISP 114 may be implemented in different chips, and the camera module 110 communicates with the ISP 114 via a camera interface 103 .
- the ISP 114 may be integrated within the camera module 110 , and a single chip having the ISP 114 and the camera module 110 included therein communicates with another data processing apparatus in the application processor 102 via the camera interface 103 .
- the camera interface 103 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- CSI camera serial interface
- MIPI Mobile Industry Processor Interface
- the camera module 110 is coupled to the camera interface 103 , and supports un-compressed data transmission and compressed data transmission.
- the camera module 110 When the camera module 110 is used to transmit un-compressed data to the ISP 114 , the camera module 110 generates an un-compressed multimedia data, and transmits the un-compressed multimedia data over the camera interface 103 .
- the camera module 110 When the camera module 110 is used to transmit compressed data to the ISP 114 , the camera module 110 generates a compressed multimedia data, and transmits the compressed multimedia data over the camera interface 103 .
- the camera module 110 includes a compressor 142 , other circuitry 144 , and an output interface 146 .
- Other circuitry 144 includes circuit elements required for capturing incident light to obtain an input multimedia data D 1 .
- other circuitry 144 may have a lens module, a camera sensor, a camera controller, a camera buffer, multiplexer(s), etc.
- the compressor 142 When the camera module 110 is operated in the compression mode, the compressor 142 performs data compression upon the input multimedia data D 1 generated from other circuitry 144 , and accordingly generates an output multimedia data D 1 ′, wherein the compressed multimedia data (i.e., output multimedia data D 1 ′) is packed/packetized into an output bitstream by the output interface 146 according to the transmission protocol of the camera interface 103 , and the output bitstream is transmitted to the ISP 114 via the camera interface 103 .
- the compressed multimedia data i.e., output multimedia data D 1 ′
- the ISP 114 it is coupled to the camera interface 103 , and supports un-compressed data reception and compressed data reception.
- the ISP 114 is operated under a non-decompression mode to receive an un-compressed data from the camera interface 103 and generate a processed multimedia data according to the un-compressed multimedia data.
- the ISP 114 is operated under a de-compression mode to receive a compressed multimedia data from the camera interface 103 and generate the processed multimedia data according to a de-compressed multimedia data derived from de-compressing the compressed multimedia data.
- the un-compressed data transmitted under the non-compression mode should be identical to the un-compressed data received under the non-decompression mode, and the compressed data transmitted under the compression mode should be identical to the compressed data received under the de-compression mode.
- the ISP 114 includes a de-compressor 132 , other circuitry 134 , and an input interface 136 .
- the input interface 136 receives an input bitstream from the camera interface 103 , and un-packs/un-packetizes the input bitstream into an input multimedia data D 2 which is a compressed multimedia data when the camera module 110 is operated under the compression mode.
- the de-compressor 132 is arranged to perform data de-compression upon the input multimedia data D 2 , and accordingly generate a de-compressed multimedia data D 2 ′.
- Other circuitry 134 is arranged to generate a processed multimedia data according to the de-compressed multimedia data D 2 ′.
- other circuitry 134 includes circuit elements required for generating the processed multimedia data according to an internal transmission mode (e.g., an on-the-fly mode or an off-line mode).
- other circuitry 134 may have a write direct memory access (DMA) controller, a read DMA controller, an image processor, multiplexers, etc.
- DMA write direct memory access
- the present invention focuses on the adaptive compression and de-compression scheme for configuring the compressor 142 and the de-compressor 132 , further details directed to transmitting compressed/un-compressed multimedia data from the camera module 110 to the ISP 114 via the camera interface 103 and generating the processed multimedia data based on the compressed/un-compressed multimedia data received from the camera interface 103 are omitted here for brevity.
- the application processor 102 further includes a micro control unit (MCU) 112 , an image encoder 116 , an image decoder 118 , a display processor 120 , a video encoder 122 , a video decoder 124 , a graphic engine 126 , and a battery meter 130 .
- the battery meter 130 is arranged to monitor the power status of a power source such as the battery capacity of a battery device 109 .
- the camera module 110 and other data processing apparatuses shown in FIG. 1 are powered by the battery device 109 .
- the MCU 112 serves as a display controller used for controlling generation of a display data, and therefore controls circuit elements within the application processor 102 to generate a desired display data to the driver IC 104 . In other words, the MCU 112 controls the operation of the application processor 102 .
- the ISP 114 serves as a backend processor for an image/video output of the camera module 110 .
- the ISP 114 may be used to perform auto white balance (AWB), auto exposure (AE) and auto focus (AF).
- a processed image generated from the ISP 114 may be transmitted to the image encoder 116 , and an encoded image is generated from the image encoder 116 to an external storage 108 such as a dynamic random access memory (DRAM).
- DRAM dynamic random access memory
- a processed video generated from the ISP 114 may be transmitted to the video encoder 122 , and an encoded video is generated from the video encoder 122 to the external storage 108 .
- the image decoder 118 receives an encoded image from the external storage 108 , and generates a decoded image to the display processor 120 .
- the video decoder 124 receives an encoded video from the external storage 108 , and generates a decoded video to the display processor 120 .
- the graphic engine 126 generates graphic data (e.g., a 3D graphic image) to the display processor 120 .
- the display processor 120 is arranged to generate a display data based on one or more of the image data, video data, graphic data, etc., and transmit the display data to a driver integrated circuit (IC) 104 .
- the display data generated at the application processor 102 is derived from the output multimedia D 1 ′ transmitted from the camera module 110 to the ISP 114 via the camera interface 103 .
- the display processor 120 may combine video data, text data and graphic data to generate a multimedia data of a frame, such that the display of the frame would show a graphic scene, a web-browsing text content, and a video playback content.
- the driver IC 104 is coupled between the display processor 120 and a display panel 106 , and drives the display panel 106 according to the display data generated from the display processor 120 .
- the display panel 106 may be implemented using any 2D/3D display device (e.g. a retina display), and the pixel arrangement may be a rectangle layout, a triangle layout or a pentile layout.
- the compressor 142 supports a plurality of compression algorithms having different compression characteristics.
- FIG. 2 is a table showing characteristics of different compression algorithms supported by the compressor 142 shown in FIG. 1 .
- a compression algorithm represents a set of coding tools so as to remove the data redundancy on the input multimedia data D 1 .
- the coding tools may be any kind of compression methods developed by proprietary algorithms or specified by state-of-the-art video standards (e.g., MPEG-1/2/4, H.261/262/263/264, and HEVC) or image standards (e.g., PEG, JPEG-1s, JPEG-2000, JPEG-XR, PNG, and GIF). As shown in FIG.
- these compression algorithms indicate different capability of compression performance in terms of compression ratio, compression efficiency, compression complexity, and power dissipation.
- the compression efficiency is the ability of a compression algorithm to encode the input multimedia data D 1 at the lowest possible bit rate while maintaining a certain level of visual quality.
- PSNR peak signal-to-noise ratio
- the compression efficiency of a compression algorithm is low, it means that the compression algorithm will lose more input data information after compression is performed under a certain compression ratio. Hence, a high compression efficiency algorithm can preserve more input data information under a certain compression ratio, and the de-compressed multimedia data can have better visual appearance and visual quality.
- the compressor 142 is capable of adaptively adjusting a compression algorithm applied to the input multimedia data D 1 according to at least the side information shown as dotted lines in FIG. 1 , where the side information may be provided by at least one of external storage 108 , ISP 114 , image encoder 116 , video encoder 122 , display processor 120 , graphic engine 126 , and battery meter 130 .
- the compressor 142 refers to the side information to select an adequate compression algorithm from supported compression algorithms having different compression characteristics, the compression performance can be optimized. For better understanding of technical features of the present invention, several embodiments are illustrated as below.
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to context characteristics of the input multimedia data D 1 .
- FIG. 3 is a diagram illustrating an embodiment of the compressor 142 shown in FIG. 1 .
- the compressor 142 includes a content analysis unit 202 and a compression unit 204 .
- the content analysis unit 202 receives the input multimedia data D 1 and side information SI, where the side information SI may include information provided by the display processor 120 , the image encoder 116 , the video encoder 122 , and/or the graphic engine 126 .
- the content analysis unit 202 may be configured to analyze the input multimedia data D 1 to classify contents included in the input multimedia data D 1 , and accordingly generate a content classification result CR. More specifically, the content analysis unit 202 could recognize the pixel data as text, graphic user interface (UI), video scene or image scene by detecting features in each received pixel unit of the input multimedia data D 1 , where the size of the pixel unit to be compressed may be any positive value based on actual design requirement/consideration.
- UI graphic user interface
- the contents classified by the content analysis unit 202 may include a video content, an image content, a text content (i.e., a text-rich image content), and a graphic content.
- the content analysis unit 202 could check if the received pixel unit is data generated by a video engine (e.g., video decoder 124 ) by comparing the characteristic of pixels with typical video data characteristics. If the characteristic of the pixels match the characteristic of video data, the content analysis unit 202 could classify the received pixel unit as data generated by the video engine (e.g., video decoder 124 ).
- the content analysis unit 202 could check if the received pixel unit is data generated by an image engine (e.g., image decoder 118 ) by comparing the characteristic of pixels with typical image data characteristics. Also, the content analysis unit 202 could check if the received pixel unit is data generated by the graphic engine 126 by matching it with several typical graphic data patterns such as monotonic repeated pixels, monotonic gradient color, and clear sharp edges.
- an image engine e.g., image decoder 118
- the content analysis unit 202 could check if the received pixel unit is data generated by the graphic engine 126 by matching it with several typical graphic data patterns such as monotonic repeated pixels, monotonic gradient color, and clear sharp edges.
- the content analysis unit 202 may refer to the side information SI to classify the contents of the input multimedia data D 1 into video contents generated by the video engine (e.g., video decoder 124 ), image contents are generated by the image engine (e.g., image decoder 118 ), and graphic contents generated by the graphic engine 126 .
- the video engine e.g., video decoder 124
- image contents are generated by the image engine (e.g., image decoder 118 )
- graphic contents generated by the graphic engine 126 e.g., graphic contents generated by the graphic engine 126 .
- the compression unit 204 is arranged for referring to the content classification result CR to adaptively adjust the compression algorithm employed. In this way, a content-aware compression based on the content classification result CR is achieved.
- FIG. 4 is a diagram illustrating one frame 302 included in the input multimedia data D 1 .
- the content classification result CR indicates that the frame 302 include graphic contents at a top portion of the frame 302 , text contents at the bottom-left portion of the frame 302 , and video contents at the bottom-right portion of the frame 302 .
- compression algorithms N 1 and N 2 are selected when the received pixel units are classified as graphic content and image content, respectively.
- Compression algorithms N 3 and N 4 are dedicated to the data classified as video content, where compression algorithm N 3 is suitable for the high bit rate video content and compression algorithm N 4 is suitable for the low bit rate video content. Moreover, the compression algorithm N 6 is suitable for a text-rich image on web-browsing scenario.
- the compression algorithm N 5 is the default algorithm when none of above contents is detected.
- the classification of high bit rate content and low bit rate content may depend on the quantization parameter (QP) of a video bitstream such as an HEVC or H.264 encoded bitstream. When the QP is higher than a threshold, the input data is classified as low bit rate content; otherwise, it is high bit rate content.
- QP quantization parameter
- the compression algorithm N 4 is employed by the compression unit 204 ; and when QP 2 ⁇ THR, the compression algorithm N 3 is employed by the compression unit 204 .
- Another embodiment is to calculate the data variance of the input data. When the variance is higher than a threshold, the input data is classified as high bit rate content; otherwise, it is low bit rate content.
- FIG. 5 is a flowchart illustrating an adaptive compression method based on context characteristics of the input multimedia data D 1 according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 5 .
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 400 Start.
- Step 402 Apply a content classification to each received pixel unit included in the input multimedia data D 1 , and accordingly generate the content classification result CR.
- Step 404 Check if the content classification result CR indicates that the received pixel unit is a video content. If yes, go to step 406 ; otherwise, go to step 412 .
- Step 406 Check if the content classification result CR indicates that the received pixel unit is a low bit rate content (e.g., QP>THR). If yes, go to step 408 ; otherwise, go to step 410 .
- a low bit rate content e.g., QP>THR
- Step 408 Apply the compression algorithm N 4 . Go to step 426 .
- Step 410 Apply the compression algorithm N 3 . Go to step 426 .
- Step 412 Check if the content classification result CR indicates that the received pixel unit is an image content. If yes, go to step 414 ; otherwise, go to step 416 .
- Step 414 Apply the compression algorithm N 2 . Go to step 426 .
- Step 416 Check if the content classification result CR indicates that the received pixel unit is a text content. If yes, go to step 418 ; otherwise, go to step 420 .
- Step 418 Apply the compression algorithm N 6 . Go to step 426 .
- Step 420 Check if the content classification result CR indicates that the received pixel unit is a graphic content. If yes, go to step 422 ; otherwise, go to step 424 .
- Step 422 Apply the compression algorithm N 1 . Go to step 426 .
- Step 424 Apply the compression algorithm N 5 .
- Step 426 Check if all of the received pixel units included in the input multimedia data D 1 have been processed. If yes, go to step 428 ; otherwise, go to step 404 to process the next received pixel unit.
- Step 428 End.
- step 402 is performed by the content analysis unit 202
- steps 404 - 426 are performed by the compression unit 204 .
- steps 404 - 426 are performed by the compression unit 204 .
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to a power supply status.
- the camera module 110 and other data processing apparatuses are powered by the battery device 109 , and the side information given by the battery meter 130 would include the power supply status indicative of an available battery capacity of the battery device 109 .
- FIG. 6 is a diagram illustrating another embodiment of the compressor 142 shown in FIG. 1 .
- the compressor 142 includes a comparison unit 502 and a compression unit 504 .
- the comparison unit 502 receives side information SI from the battery meter 130 .
- the comparison unit 502 compares the available battery capacity of the battery device 109 as indicated by the side information SI with at least one predetermined threshold to generate a comparison result CR′.
- the compression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR′ to select one of the supported compression algorithms for data compression. For example, as shown in FIG. 7 , the comparison unit 502 employs a first predetermined threshold THR 1 and a second predetermined threshold THR 2 , where THR 1 >THR 2 .
- the first predetermined threshold THR 1 is checked to see if the data compression can be disabled to avoid information loss caused by a lossy compression algorithm.
- the compressor 142 is arranged to disable the data compression when the power supply status indicates that the available battery capacity is higher than the first predetermined threshold THR 1 , and enable the data compression when the power supply status indicates that the available battery capacity is not higher than the first predetermined threshold THR 1 .
- the compression algorithm is disabled to get better visual quality; and when the battery power is lower than the first predetermined threshold THR 1 , a compression algorithm is enabled to save power dissipation of the camera interface 103 .
- the second predetermined threshold THR 2 is checked to select one compression algorithm from supported compression algorithms having different characteristics. More specifically, the compressor 142 is arranged to employ the compression algorithm N 1 for compressing the input multimedia data D 1 when the power supply status indicates that the available battery capacity is higher than the second predetermined threshold THR 2 , and employ the compression algorithm N 2 for compressing the input multimedia data D 1 when the power supply status indicates that the available battery capacity is not higher than the second predetermined threshold THR 2 , where the compression algorithm N 1 is more complex than the compression algorithm N 2 , and/or the compression algorithm N 1 has a higher compression efficiency than the compression algorithm N 2 .
- FIG. 8 is a flowchart illustrating an adaptive compression method based on a power supply status according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 8 .
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 700 Start.
- Step 702 Check if the battery is full. If yes, go to step 704 ; otherwise, go to step 706 .
- Step 704 Disable data compression.
- Step 706 Check if the available battery capacity is higher than the first predetermined threshold THR 1 . If yes, go to step 704 ; otherwise, go to step 708 .
- Step 708 Check if the available battery capacity is higher than the second predetermined threshold THR 2 . If yes, go to step 710 ; otherwise, go to step 712 .
- Step 710 Apply the compression algorithm N 1 . Go to step 714 .
- Step 712 Apply the compression algorithm N 2 .
- Step 714 End.
- steps 702 , 706 , 708 are performed by the comparison unit 502
- steps 704 , 710 , 712 are performed by the compression unit 504 .
- steps 702 , 706 , 708 are performed by the comparison unit 502
- steps 704 , 710 , 712 are performed by the compression unit 504 .
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to an operational status of a storage device such as the external storage 108 .
- the side information SI given by the external storage 108 would include the operational status indicative of a used bandwidth of the external storage 108 .
- the comparison unit 502 receives the side information SI from the external storage 108 .
- the comparison unit 502 compares the used bandwidth of the external storage 108 as indicated by the side information SI with at least one predetermined threshold to generate the comparison result CR′.
- the compression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR′ to select one of the supported compression algorithms for data compression.
- the comparison unit 502 employs a first predetermined threshold THR 1 and a second predetermined threshold THR 2 , where THR 1 >THR 2 .
- the second predetermined threshold THR 2 is checked to see if the data compression can be disabled to avoid information loss caused by a lossy compression algorithm.
- the compressor 142 is arranged to disable the data compression when the side information SI indicates that the used bandwidth is lower than the second predetermined threshold THR 2 , and enable the data compression when the side information SI indicates that the used bandwidth is not lower than the second predetermined threshold THR 2 .
- the first predetermined threshold THR 1 is checked to select one compression algorithm from candidate compression algorithms having different characteristics. More specifically, the compressor 142 is arranged to employ the compression algorithm N 1 for compressing the input multimedia data D 1 when the side information SI indicates that the used bandwidth is lower than the first predetermined threshold THR 1 , and employ the compression algorithm N 2 for compressing the input multimedia data D 1 when the side information SI indicates that the used bandwidth is not lower than the first predetermined threshold THR 1 , where the compression algorithm N 1 is more complex than the compression algorithm N 2 , and/or the compression algorithm N 1 has a higher compression efficiency than the compression algorithm N 2 .
- a more complex and higher compression efficiency algorithm can be selected by the compression unit 504 to get better visual quality; and when the bandwidth is almost used or the used bandwidth is not lower than the first predetermined threshold THR 1 , a less complex and lower compression efficiency algorithm can be selected by the compression unit 504 to save power dissipation of the camera interface 103 .
- FIG. 10 is a flowchart illustrating an adaptive compression method based on an operating status of a storage device according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 10 .
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 900 Start.
- Step 902 Check if the bandwidth is not occupied yet. If yes, go to step 904 ; otherwise, go to step 906 .
- Step 904 Disable data compression. Go to step 914 .
- Step 906 Check if the used bandwidth is lower than the second predetermined threshold THR 2 . If yes, go to step 904 ; otherwise, go to step 908 .
- Step 908 Check if the used bandwidth is lower than the first predetermined threshold THR 1 . If yes, go to step 910 ; otherwise, go to step 912 .
- Step 910 Apply the compression algorithm N 1 . Go to step 914 .
- Step 912 Apply the compression algorithm N 2 .
- Step 914 End.
- steps 902 , 906 , 908 are performed by the comparison unit 502
- steps 904 , 910 , 912 are performed by the compression unit 504 .
- steps 902 , 906 , 908 are performed by the comparison unit 502
- steps 904 , 910 , 912 are performed by the compression unit 504 .
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to at least one image capture characteristic.
- the ISP 114 may be configured to perform digital gain adjustment for a focus level, an exposure level, and an ISO (International Organization for Standardization) value.
- the side information SI given by the ISP 114 may include at least one of the focus level, the exposure level, and the ISO value.
- the comparison unit 502 receives the side information SI from the ISP 114 , and compares the side information SI with at least one predetermined threshold to generate the comparison result CR′.
- the compression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR′ to select one of the supported compression algorithms to achieve better compression performance or visual quality. For example, a blurred image is captured when the focus level is lower than a first predetermined threshold THR 1 . Hence, the compression algorithm N 4 particularly designed for compressing the blurred image is selected by the comparison unit 502 . An over-exposure or under-exposure image is obtained when the exposure level is out of a specific range delimited by a second predetermined threshold THR 2 and a third predetermined threshold THR 3 , where THR 2 >THR 3 . Hence, the compression algorithm N 3 particularly designed to manipulate this kind of captured image is selected by the comparison unit 502 .
- the over-exposure image and the under-exposure image may be processed by different compression algorithms.
- the ISO value from the ISP 114 can be exploited as side information since it impacts the noise level on the captured image. Specifically, the ISO value is positively correlated to the noise level.
- the compression algorithm N 1 if the ISO value is not lower than a fourth predetermined threshold THR 4 , a high ISO image can be compressed using the compression algorithm N 1 such that noise pixels can be properly considered during the compression. If the ISO value is lower than the fourth predetermined threshold THR 4 , the compression algorithm N 2 is selected by the compression unit 504 to achieve better compression performance for the low ISO image.
- FIG. 11 is a flowchart illustrating an adaptive compression method based on at least one image capture characteristic according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 11 .
- the exemplary adaptive compression method may be briefly summarized by following steps.
- Step 1000 Start.
- Step 1002 Receive an image.
- Step 1004 Check if the focus level of the image is lower than the first predetermined threshold THR 1 . If yes, go to step 1006 ; otherwise, go to step 1008 .
- Step 1006 Apply the compression algorithm N 4 . Go to step 1018 .
- Step 1008 Check if the exposure level of the image is higher than the second predetermined threshold THR 2 or lower than the third predetermined threshold THR 3 . If yes, go to step 1010 ; otherwise, go to step 1012 .
- Step 1010 Apply the compression algorithm N 3 . Go to step 1018 .
- Step 1012 Check if the ISO value of the image is lower than the fourth predetermined threshold THR 4 . If yes, go to step 1014 ; otherwise, go to step 1016 .
- Step 1014 Apply the compression algorithm N 2 . Go to step 1018 .
- Step 1016 Apply the compression algorithm N 1 .
- Step 1018 Check if all of the images have been processed. If yes, go to step 1020 ; otherwise, go to step 1002 to process the next image.
- Step 1020 End.
- steps 1004 , 1008 , 1012 are performed by the comparison unit 502
- steps 1002 , 1006 , 1010 , 1014 , 1016 , 1018 are performed by the compression unit 504 .
- steps 1002 , 1006 , 1010 , 1014 , 1016 , 1018 are performed by the compression unit 504 .
- the compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D 1 according to a de-compression algorithm supported by the ISP 114
- the de-compressor 132 may adaptively adjust a de-compression algorithm applied to the input multimedia data D 2 according to a compression algorithm supported by the camera module 110 .
- FIG. 12 is a diagram illustrating a configuration of a compressor in a camera module and a configuration of a de-compressor in an ISP according to an embodiment of the present invention.
- Each of the camera modules 1302 _ 1 and 1302 _ 2 supports a plurality of compression algorithms
- the ISP 1304 supports a plurality of de-compression algorithms.
- the ISP 1304 e.g., ISP 114 shown in FIG. 1
- the ISP 1304 sends side information to inform the camera module 1302 _ 1 of the supported de-compression algorithms X′ and Y′.
- the compression algorithm X supported by the camera module 1302 _ 1 is compliant with the de-compression algorithm X′, the camera module 1302 _ 1 therefore selects and enables the compression algorithm X of the compressor (e.g., compressor 142 shown in FIG. 1 ).
- the camera module 1302 _ 1 sends side information to inform the ISP 1304 of the employed compression algorithm X.
- the ISP 1304 selects and enables the de-compression algorithm X′ of the de-compressor (e.g., de-compressor 132 shown in FIG. 1 ).
- the ISP 1304 may be used in a variety of applications, and therefore supports different de-compression algorithms. Thus, in one exemplary application, the ISP 1304 is used to connect the camera module 1302 _ 1 . However, in another application, the ISP 1304 is used to connect the camera module 1302 _ 2 . When the ISP 1304 is used to connect the camera module 1302 _ 2 via the camera interface 1303 , the ISP 1304 sends side information to inform the camera module 1302 _ 2 of the supported de-compression algorithms X′ and Y′. As the compression algorithm Y supported by the camera module 1302 _ 2 is compliant with the de-compression algorithm Y′, the camera module 1302 _ 2 therefore selects and enables the compression algorithm Y of the compressor.
- the camera module 1302 _ 2 sends side information to inform the ISP 1304 of the employed compression algorithm Y.
- the ISP 1304 selects and enables the de-compression algorithm Y′ of the de-compressor.
- FIG. 13 is a flowchart illustrating an adaptive compression and de-compression method based on side information communicated between a camera module and an ISP according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown in FIG. 13 .
- the exemplary adaptive compression and de-compression method may be briefly summarized by following steps.
- Step 1400 Start.
- Step 1402 Receive side information of the ISP.
- Step 1404 Refer to the ISP's side information to select and enable a compression algorithm compliant with a de-compression algorithm supported by the ISP.
- Step 1406 Receive side information of the camera module.
- Step 1408 Refer to the camera module's side information to select and enable a de-compression algorithm compliant with a compression algorithm employed by the camera module.
- Step 1410 End.
- steps 1402 and 1404 are performed by the camera module, and steps 1406 and 1408 are performed by the ISP.
- steps 1402 and 1404 are performed by the camera module, and steps 1406 and 1408 are performed by the ISP.
- steps 1402 and 1404 are performed by the camera module, and steps 1406 and 1408 are performed by the ISP.
- steps 1402 and 1404 are performed by the camera module, and steps 1406 and 1408 are performed by the ISP.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Discrete Mathematics (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Television Signal Processing For Recording (AREA)
- Telephone Function (AREA)
Abstract
A data processing apparatus has a compressor and an output interface. The compressor generates an output multimedia data according to an input multimedia data. The output interface packs the output multimedia data into an output bitstream, and outputs the output bitstream to another data processing apparatus via a camera interface. The camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). In addition, the compressor adaptively adjusts a compression algorithm according to context characteristics in the input multimedia data, power supply status, operational status of a storage device, image capture characteristic, configuration of the another data processing apparatus, and/or compression algorithm supported by the another data processing apparatus. Further, the another data processing apparatus adaptively adjusts a de-compression algorithm according to a compression algorithm supported by the compressor.
Description
- This application claims the benefit of U.S. provisional application No. 61/729,426, filed on Nov. 23, 2012 and incorporated herein by reference.
- The disclosed embodiments of the present invention relate to transmitting and receiving multimedia data over a camera interface, and more particularly, to a data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over a camera interface and related data processing method.
- A camera interface is disposed between a first chip and a second chip to transmit multimedia data from the first chip to the second chip for further processing. For example, the first chip may include a camera module, and the second chip may include an image signal processor (ISP). The multimedia data may include image data (i.e., a single captured image) or video data (i.e., a video sequence composed of captured images). When a camera sensor with a higher resolution is employed in the camera module, the multimedia data transmitted over the camera interface would have a larger data size/data rate, which increases the power consumption of the camera interface inevitably. If the camera module and the ISP are both located at a portable device (e.g., a smartphone) powered by a battery device, the battery life is shortened due to the increased power consumption of the camera interface. Thus, there is a need for an innovative design which can effectively reduce the power consumption of the camera interface.
- In accordance with exemplary embodiments of the present invention, a data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over a camera interface and related data processing method are proposed.
- According to one aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). In addition, the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to context characteristics of the input multimedia data.
- According to another aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). In addition, the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a power supply status.
- According to another aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). In addition, the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to an operational status of a storage device.
- According to another aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). In addition, the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to at least one image capture characteristic.
- According to another aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes a compressor and an output interface. The compressor is arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data. The output interface is arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream to another data processing apparatus via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). In addition, the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a de-compression algorithm supported by the another data processing apparatus.
- According to another aspect of the present invention, an exemplary data processing apparatus is disclosed. The exemplary data processing apparatus includes an input interface and a de-compressor. The input interface is arranged for receiving an input bitstream from another data processing apparatus via a camera interface, and un-packing the input bitstream into an input multimedia data, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). The de-compressor is arranged for generating a de-compressed multimedia data according to the input multimedia data when the input multimedia data is a compressed multimedia data. In addition, the de-compressor adaptively adjusts a de-compression algorithm according to a compression algorithm employed by the another data processing apparatus.
- According to another aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusts a compression algorithm according to context characteristics of the input multimedia data; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- According to another aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to a power supply status; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- According to another aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to an operational status of a storage device; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- According to another aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to at least one image capture characteristic; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- According to another aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input multimedia data; adaptively adjusting a compression algorithm according to a de-compression algorithm supported by a data processing apparatus; generating an output multimedia data according to the compression algorithm and the input multimedia data; and packing the output multimedia data into an output bitstream, and outputting the output bitstream to the data processing apparatus via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
- According to another aspect of the present invention, an exemplary data processing method is disclosed. The exemplary data processing method includes at least the following steps: receiving an input bitstream from a data processing apparatus via a camera interface, and un-packing the input bitstream into an input multimedia data, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI); adaptively adjusting a de-compression algorithm according to a compression algorithm employed by the data processing apparatus; and when the input multimedia data is a compressed multimedia data, generating a de-compressed multimedia data according to the input multimedia data and the de-compression algorithm.
- These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
-
FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention. -
FIG. 2 is a table showing characteristics of different compression algorithms supported by the compressor shown inFIG. 1 . -
FIG. 3 is a diagram illustrating an embodiment of the compressor shown inFIG. 1 . -
FIG. 4 is a diagram illustrating one frame included in the input multimedia data. -
FIG. 5 is a flowchart illustrating an adaptive compression method based on context characteristics of the input multimedia data according to an embodiment of the present invention. -
FIG. 6 is a diagram illustrating another embodiment of the compressor shown inFIG. 1 . -
FIG. 7 is a diagram illustrating thresholds of the battery capacity of the battery device. -
FIG. 8 is a flowchart illustrating an adaptive compression method based on a power supply status according to an embodiment of the present invention. -
FIG. 9 is a diagram illustrating thresholds of the bandwidth of the storage device. -
FIG. 10 is a flowchart illustrating an adaptive compression method based on an operating status of a storage device according to an embodiment of the present invention. -
FIG. 11 is a flowchart illustrating an adaptive compression method based on at least one image capture characteristic according to an embodiment of the present invention. -
FIG. 12 is a diagram illustrating configuration of a compressor in a camera module and configuration of a de-compressor in an ISP according to an embodiment of the present invention. -
FIG. 13 is a flowchart illustrating an adaptive compression and de-compression method based on side information communicated between a camera module and an ISP according to an embodiment of the present invention. - Certain terms are used throughout the description and following claims to refer to particular components. As one skilled in the art will appreciate, manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not function. In the following description and in the claims, the terms “include” and “comprise” are used in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to . . . ”. Also, the term “couple” is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
- The present invention proposes applying data compression to a multimedia data and then transmitting a compressed multimedia data over a camera interface. As the data size/data rate of the compressed multimedia data is smaller than that of the original un-compressed multimedia data, the power consumption of the camera interface is reduced correspondingly. Besides, the present invention further proposes an adaptive compression/de-compression scheme which is based on side information given by one or more signal processing elements (e.g., an image signal processor (ISP), a video/image codec, a graphic engine, a display processor, an external storage, and a battery meter). This may allow the configuration of the compressor and the counterpart de-compressor to be adjusted in a static or dynamic way. In general, data compression is exploited to remove the information redundancy under a specific pixel size (i.e., a unit size of compression) and produce a compressed data constrained by a compression ratio. In a case where the compression ratio is equal to 0.5, the size of the compressed data is half of the size of the uncompressed data. As the compression performance is strongly related to some design factors such as the unit size of compression and the constrained compression ratio, the present invention therefore proposes using the adaptive compression scheme for enabling a compression algorithm selected from a plurality of candidate compression algorithms, where the selected compression algorithm most efficiently compresses the multimedia data. Compared to a typical compression scheme using a fixed compression algorithm, the proposed adaptive compression scheme achieves better performance. Besides, the ISP may refer to side information given by the camera module to adaptively select a de-compression algorithm compliant with the compression algorithm employed by the camera module. In this way, the compressed data stream from the camera module can be correctly de-compressed by the ISP. Further details will be described as below.
-
FIG. 1 is a block diagram illustrating a data processing system according to an embodiment of the present invention. Thedata processing system 100 includes a plurality of data processing apparatuses such as acamera module 110 external to anapplication processor 102 and an image signal processor (ISP) 114 included in theapplication processor 102. Thecamera module 110 and theISP 114 may be implemented in different chips, and thecamera module 110 communicates with theISP 114 via acamera interface 103. Alternatively, theISP 114 may be integrated within thecamera module 110, and a single chip having theISP 114 and thecamera module 110 included therein communicates with another data processing apparatus in theapplication processor 102 via thecamera interface 103. In this embodiment, thecamera interface 103 may be a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI). - The
camera module 110 is coupled to thecamera interface 103, and supports un-compressed data transmission and compressed data transmission. When thecamera module 110 is used to transmit un-compressed data to theISP 114, thecamera module 110 generates an un-compressed multimedia data, and transmits the un-compressed multimedia data over thecamera interface 103. When thecamera module 110 is used to transmit compressed data to theISP 114, thecamera module 110 generates a compressed multimedia data, and transmits the compressed multimedia data over thecamera interface 103. - As shown in
FIG. 1 , thecamera module 110 includes acompressor 142,other circuitry 144, and anoutput interface 146.Other circuitry 144 includes circuit elements required for capturing incident light to obtain an input multimedia data D1. For example,other circuitry 144 may have a lens module, a camera sensor, a camera controller, a camera buffer, multiplexer(s), etc. When thecamera module 110 is operated in the compression mode, thecompressor 142 performs data compression upon the input multimedia data D1 generated fromother circuitry 144, and accordingly generates an output multimedia data D1′, wherein the compressed multimedia data (i.e., output multimedia data D1′) is packed/packetized into an output bitstream by theoutput interface 146 according to the transmission protocol of thecamera interface 103, and the output bitstream is transmitted to theISP 114 via thecamera interface 103. - Regarding the
ISP 114, it is coupled to thecamera interface 103, and supports un-compressed data reception and compressed data reception. When thecamera module 110 transmits the un-compressed data to theISP 114, theISP 114 is operated under a non-decompression mode to receive an un-compressed data from thecamera interface 103 and generate a processed multimedia data according to the un-compressed multimedia data. When thecamera module 110 transmits the compressed data to theISP 114, theISP 114 is operated under a de-compression mode to receive a compressed multimedia data from thecamera interface 103 and generate the processed multimedia data according to a de-compressed multimedia data derived from de-compressing the compressed multimedia data. If there is no error introduced during the data transmission, the un-compressed data transmitted under the non-compression mode should be identical to the un-compressed data received under the non-decompression mode, and the compressed data transmitted under the compression mode should be identical to the compressed data received under the de-compression mode. - As shown in
FIG. 1 , theISP 114 includes a de-compressor 132,other circuitry 134, and aninput interface 136. Theinput interface 136 receives an input bitstream from thecamera interface 103, and un-packs/un-packetizes the input bitstream into an input multimedia data D2 which is a compressed multimedia data when thecamera module 110 is operated under the compression mode. In this embodiment, the de-compressor 132 is arranged to perform data de-compression upon the input multimedia data D2, and accordingly generate a de-compressed multimedia data D2′.Other circuitry 134 is arranged to generate a processed multimedia data according to the de-compressed multimedia data D2′. Specifically,other circuitry 134 includes circuit elements required for generating the processed multimedia data according to an internal transmission mode (e.g., an on-the-fly mode or an off-line mode). For example,other circuitry 134 may have a write direct memory access (DMA) controller, a read DMA controller, an image processor, multiplexers, etc. - As the present invention focuses on the adaptive compression and de-compression scheme for configuring the
compressor 142 and the de-compressor 132, further details directed to transmitting compressed/un-compressed multimedia data from thecamera module 110 to theISP 114 via thecamera interface 103 and generating the processed multimedia data based on the compressed/un-compressed multimedia data received from thecamera interface 103 are omitted here for brevity. - As shown in
FIG. 1 , theapplication processor 102 further includes a micro control unit (MCU) 112, animage encoder 116, animage decoder 118, adisplay processor 120, avideo encoder 122, avideo decoder 124, agraphic engine 126, and abattery meter 130. Thebattery meter 130 is arranged to monitor the power status of a power source such as the battery capacity of abattery device 109. In this embodiment, thecamera module 110 and other data processing apparatuses shown inFIG. 1 are powered by thebattery device 109. TheMCU 112 serves as a display controller used for controlling generation of a display data, and therefore controls circuit elements within theapplication processor 102 to generate a desired display data to thedriver IC 104. In other words, theMCU 112 controls the operation of theapplication processor 102. TheISP 114 serves as a backend processor for an image/video output of thecamera module 110. For example, theISP 114 may be used to perform auto white balance (AWB), auto exposure (AE) and auto focus (AF). In a case where thecamera module 110 generates a single captured image to theISP 114 under a photo mode, a processed image generated from theISP 114 may be transmitted to theimage encoder 116, and an encoded image is generated from theimage encoder 116 to anexternal storage 108 such as a dynamic random access memory (DRAM). In another case where thecamera module 110 generates a video sequence composed of successive captured images to theISP 114 under a video recording mode, a processed video generated from theISP 114 may be transmitted to thevideo encoder 122, and an encoded video is generated from thevideo encoder 122 to theexternal storage 108. - The
image decoder 118 receives an encoded image from theexternal storage 108, and generates a decoded image to thedisplay processor 120. Thevideo decoder 124 receives an encoded video from theexternal storage 108, and generates a decoded video to thedisplay processor 120. However, it is possible that the single captured image/video sequence generated from theISP 114 may be bypassed to thedisplay processor 120 without additional encoding and decoding operations applied thereto. Thegraphic engine 126 generates graphic data (e.g., a 3D graphic image) to thedisplay processor 120. - The
display processor 120 is arranged to generate a display data based on one or more of the image data, video data, graphic data, etc., and transmit the display data to a driver integrated circuit (IC) 104. Hence, the display data generated at theapplication processor 102 is derived from the output multimedia D1′ transmitted from thecamera module 110 to theISP 114 via thecamera interface 103. For example, thedisplay processor 120 may combine video data, text data and graphic data to generate a multimedia data of a frame, such that the display of the frame would show a graphic scene, a web-browsing text content, and a video playback content. Thedriver IC 104 is coupled between thedisplay processor 120 and adisplay panel 106, and drives thedisplay panel 106 according to the display data generated from thedisplay processor 120. By way of example, thedisplay panel 106 may be implemented using any 2D/3D display device (e.g. a retina display), and the pixel arrangement may be a rectangle layout, a triangle layout or a pentile layout. - In this embodiment, the
compressor 142 supports a plurality of compression algorithms having different compression characteristics. Please refer toFIG. 2 , which is a table showing characteristics of different compression algorithms supported by thecompressor 142 shown inFIG. 1 . A compression algorithm represents a set of coding tools so as to remove the data redundancy on the input multimedia data D1. The coding tools may be any kind of compression methods developed by proprietary algorithms or specified by state-of-the-art video standards (e.g., MPEG-1/2/4, H.261/262/263/264, and HEVC) or image standards (e.g., PEG, JPEG-1s, JPEG-2000, JPEG-XR, PNG, and GIF). As shown inFIG. 2 , these compression algorithms indicate different capability of compression performance in terms of compression ratio, compression efficiency, compression complexity, and power dissipation. Specifically, the compression efficiency is the ability of a compression algorithm to encode the input multimedia data D1 at the lowest possible bit rate while maintaining a certain level of visual quality. There are two standard ways to measure the compression efficiency of a compression algorithm. One is to use an objective metric, such as a peak signal-to-noise ratio (PSNR). The other is to use a subjective assessment of video/image quality. If the compression efficiency of a compression algorithm is high, it means that the compression algorithm can preserve more input data information after compression is performed under a certain compression ratio. If the compression efficiency of a compression algorithm is low, it means that the compression algorithm will lose more input data information after compression is performed under a certain compression ratio. Hence, a high compression efficiency algorithm can preserve more input data information under a certain compression ratio, and the de-compressed multimedia data can have better visual appearance and visual quality. - The
compressor 142 is capable of adaptively adjusting a compression algorithm applied to the input multimedia data D1 according to at least the side information shown as dotted lines inFIG. 1 , where the side information may be provided by at least one ofexternal storage 108,ISP 114,image encoder 116,video encoder 122,display processor 120,graphic engine 126, andbattery meter 130. As thecompressor 142 refers to the side information to select an adequate compression algorithm from supported compression algorithms having different compression characteristics, the compression performance can be optimized. For better understanding of technical features of the present invention, several embodiments are illustrated as below. - In a first exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to context characteristics of the input multimedia data D1. Please refer toFIG. 3 , which is a diagram illustrating an embodiment of thecompressor 142 shown inFIG. 1 . As shown inFIG. 3 , thecompressor 142 includes acontent analysis unit 202 and acompression unit 204. Thecontent analysis unit 202 receives the input multimedia data D1 and side information SI, where the side information SI may include information provided by thedisplay processor 120, theimage encoder 116, thevideo encoder 122, and/or thegraphic engine 126. In one exemplary design, thecontent analysis unit 202 may be configured to analyze the input multimedia data D1 to classify contents included in the input multimedia data D1, and accordingly generate a content classification result CR. More specifically, thecontent analysis unit 202 could recognize the pixel data as text, graphic user interface (UI), video scene or image scene by detecting features in each received pixel unit of the input multimedia data D1, where the size of the pixel unit to be compressed may be any positive value based on actual design requirement/consideration. - The contents classified by the
content analysis unit 202 may include a video content, an image content, a text content (i.e., a text-rich image content), and a graphic content. For example, thecontent analysis unit 202 could check if the received pixel unit is data generated by a video engine (e.g., video decoder 124) by comparing the characteristic of pixels with typical video data characteristics. If the characteristic of the pixels match the characteristic of video data, thecontent analysis unit 202 could classify the received pixel unit as data generated by the video engine (e.g., video decoder 124). In a similar way, thecontent analysis unit 202 could check if the received pixel unit is data generated by an image engine (e.g., image decoder 118) by comparing the characteristic of pixels with typical image data characteristics. Also, thecontent analysis unit 202 could check if the received pixel unit is data generated by thegraphic engine 126 by matching it with several typical graphic data patterns such as monotonic repeated pixels, monotonic gradient color, and clear sharp edges. In another exemplary design, thecontent analysis unit 202 may refer to the side information SI to classify the contents of the input multimedia data D1 into video contents generated by the video engine (e.g., video decoder 124), image contents are generated by the image engine (e.g., image decoder 118), and graphic contents generated by thegraphic engine 126. - The
compression unit 204 is arranged for referring to the content classification result CR to adaptively adjust the compression algorithm employed. In this way, a content-aware compression based on the content classification result CR is achieved.FIG. 4 is a diagram illustrating oneframe 302 included in the input multimedia data D1. The content classification result CR indicates that theframe 302 include graphic contents at a top portion of theframe 302, text contents at the bottom-left portion of theframe 302, and video contents at the bottom-right portion of theframe 302. After the classification procedure, compression algorithms N1 and N2 are selected when the received pixel units are classified as graphic content and image content, respectively. Compression algorithms N3 and N4 are dedicated to the data classified as video content, where compression algorithm N3 is suitable for the high bit rate video content and compression algorithm N4 is suitable for the low bit rate video content. Moreover, the compression algorithm N6 is suitable for a text-rich image on web-browsing scenario. The compression algorithm N5 is the default algorithm when none of above contents is detected. The classification of high bit rate content and low bit rate content may depend on the quantization parameter (QP) of a video bitstream such as an HEVC or H.264 encoded bitstream. When the QP is higher than a threshold, the input data is classified as low bit rate content; otherwise, it is high bit rate content. For example, when QP1>THR, the compression algorithm N4 is employed by thecompression unit 204; and when QP2≦THR, the compression algorithm N3 is employed by thecompression unit 204. Another embodiment is to calculate the data variance of the input data. When the variance is higher than a threshold, the input data is classified as high bit rate content; otherwise, it is low bit rate content. -
FIG. 5 is a flowchart illustrating an adaptive compression method based on context characteristics of the input multimedia data D1 according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 5 . The exemplary adaptive compression method may be briefly summarized by following steps. - Step 400: Start.
- Step 402: Apply a content classification to each received pixel unit included in the input multimedia data D1, and accordingly generate the content classification result CR.
- Step 404: Check if the content classification result CR indicates that the received pixel unit is a video content. If yes, go to step 406; otherwise, go to step 412.
- Step 406: Check if the content classification result CR indicates that the received pixel unit is a low bit rate content (e.g., QP>THR). If yes, go to step 408; otherwise, go to step 410.
- Step 408: Apply the compression algorithm N4. Go to step 426.
- Step 410: Apply the compression algorithm N3. Go to step 426.
- Step 412: Check if the content classification result CR indicates that the received pixel unit is an image content. If yes, go to step 414; otherwise, go to step 416.
- Step 414: Apply the compression algorithm N2. Go to step 426.
- Step 416: Check if the content classification result CR indicates that the received pixel unit is a text content. If yes, go to step 418; otherwise, go to step 420.
- Step 418: Apply the compression algorithm N6. Go to step 426.
- Step 420: Check if the content classification result CR indicates that the received pixel unit is a graphic content. If yes, go to step 422; otherwise, go to step 424.
- Step 422: Apply the compression algorithm N1. Go to step 426.
- Step 424: Apply the compression algorithm N5.
- Step 426: Check if all of the received pixel units included in the input multimedia data D1 have been processed. If yes, go to step 428; otherwise, go to step 404 to process the next received pixel unit.
- Step 428: End.
- It should be noted that
step 402 is performed by thecontent analysis unit 202, and steps 404-426 are performed by thecompression unit 204. As a person skilled in the art can readily understand details of each step shown inFIG. 5 after reading above paragraphs, further description is omitted here for brevity. - In a second exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to a power supply status. As shown inFIG. 1 , thecamera module 110 and other data processing apparatuses are powered by thebattery device 109, and the side information given by thebattery meter 130 would include the power supply status indicative of an available battery capacity of thebattery device 109. Please refer toFIG. 6 , which is a diagram illustrating another embodiment of thecompressor 142 shown inFIG. 1 . Thecompressor 142 includes acomparison unit 502 and acompression unit 504. Thecomparison unit 502 receives side information SI from thebattery meter 130. Thecomparison unit 502 compares the available battery capacity of thebattery device 109 as indicated by the side information SI with at least one predetermined threshold to generate a comparison result CR′. Thecompression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR′ to select one of the supported compression algorithms for data compression. For example, as shown inFIG. 7 , thecomparison unit 502 employs a first predetermined threshold THR1 and a second predetermined threshold THR2, where THR1>THR2. The first predetermined threshold THR1 is checked to see if the data compression can be disabled to avoid information loss caused by a lossy compression algorithm. More specifically, thecompressor 142 is arranged to disable the data compression when the power supply status indicates that the available battery capacity is higher than the first predetermined threshold THR1, and enable the data compression when the power supply status indicates that the available battery capacity is not higher than the first predetermined threshold THR1. To put it another way, when the battery power is full or higher than the first predetermined threshold THR1, the compression algorithm is disabled to get better visual quality; and when the battery power is lower than the first predetermined threshold THR1, a compression algorithm is enabled to save power dissipation of thecamera interface 103. - The second predetermined threshold THR2 is checked to select one compression algorithm from supported compression algorithms having different characteristics. More specifically, the
compressor 142 is arranged to employ the compression algorithm N1 for compressing the input multimedia data D1 when the power supply status indicates that the available battery capacity is higher than the second predetermined threshold THR2, and employ the compression algorithm N2 for compressing the input multimedia data D1 when the power supply status indicates that the available battery capacity is not higher than the second predetermined threshold THR2, where the compression algorithm N1 is more complex than the compression algorithm N2, and/or the compression algorithm N1 has a higher compression efficiency than the compression algorithm N2. To put it another way, when the battery power is almost full or higher than the second predetermined threshold THR2, a more complex and higher compression efficiency algorithm can be selected by thecompression unit 504 to get better visual quality; and when the battery power is almost empty or lower than the second predetermined threshold THR2, a less complex and lower compression efficiency algorithm can be selected by thecompression unit 504 to save power dissipation of thecamera interface 103. -
FIG. 8 is a flowchart illustrating an adaptive compression method based on a power supply status according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 8 . The exemplary adaptive compression method may be briefly summarized by following steps. - Step 700: Start.
- Step 702: Check if the battery is full. If yes, go to step 704; otherwise, go to step 706.
- Step 704: Disable data compression.
- Step 706: Check if the available battery capacity is higher than the first predetermined threshold THR1. If yes, go to step 704; otherwise, go to step 708.
- Step 708: Check if the available battery capacity is higher than the second predetermined threshold THR2. If yes, go to step 710; otherwise, go to step 712.
- Step 710: Apply the compression algorithm N1. Go to step 714.
- Step 712: Apply the compression algorithm N2.
- Step 714: End.
- It should be noted that
steps comparison unit 502, and steps 704, 710, 712 are performed by thecompression unit 504. As a person skilled in the art can readily understand details of each step shown inFIG. 8 after reading above paragraphs, further description is omitted here for brevity. - In a third exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to an operational status of a storage device such as theexternal storage 108. The side information SI given by theexternal storage 108 would include the operational status indicative of a used bandwidth of theexternal storage 108. Please refer toFIG. 6 again. In this embodiment, thecomparison unit 502 receives the side information SI from theexternal storage 108. Next, thecomparison unit 502 compares the used bandwidth of theexternal storage 108 as indicated by the side information SI with at least one predetermined threshold to generate the comparison result CR′. Thecompression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR′ to select one of the supported compression algorithms for data compression. For example, as shown inFIG. 9 , thecomparison unit 502 employs a first predetermined threshold THR1 and a second predetermined threshold THR2, where THR1>THR2. The second predetermined threshold THR2 is checked to see if the data compression can be disabled to avoid information loss caused by a lossy compression algorithm. More specifically, thecompressor 142 is arranged to disable the data compression when the side information SI indicates that the used bandwidth is lower than the second predetermined threshold THR2, and enable the data compression when the side information SI indicates that the used bandwidth is not lower than the second predetermined threshold THR2. - The first predetermined threshold THR1 is checked to select one compression algorithm from candidate compression algorithms having different characteristics. More specifically, the
compressor 142 is arranged to employ the compression algorithm N1 for compressing the input multimedia data D1 when the side information SI indicates that the used bandwidth is lower than the first predetermined threshold THR1, and employ the compression algorithm N2 for compressing the input multimedia data D1 when the side information SI indicates that the used bandwidth is not lower than the first predetermined threshold THR1, where the compression algorithm N1 is more complex than the compression algorithm N2, and/or the compression algorithm N1 has a higher compression efficiency than the compression algorithm N2. To put it another way, when the used bandwidth is lower than the first predetermined threshold THR1, a more complex and higher compression efficiency algorithm can be selected by thecompression unit 504 to get better visual quality; and when the bandwidth is almost used or the used bandwidth is not lower than the first predetermined threshold THR1, a less complex and lower compression efficiency algorithm can be selected by thecompression unit 504 to save power dissipation of thecamera interface 103. -
FIG. 10 is a flowchart illustrating an adaptive compression method based on an operating status of a storage device according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 10 . The exemplary adaptive compression method may be briefly summarized by following steps. - Step 900: Start.
- Step 902: Check if the bandwidth is not occupied yet. If yes, go to step 904; otherwise, go to step 906.
- Step 904: Disable data compression. Go to step 914.
- Step 906: Check if the used bandwidth is lower than the second predetermined threshold THR2. If yes, go to step 904; otherwise, go to step 908.
- Step 908: Check if the used bandwidth is lower than the first predetermined threshold THR1. If yes, go to step 910; otherwise, go to step 912.
- Step 910: Apply the compression algorithm N1. Go to step 914.
- Step 912: Apply the compression algorithm N2.
- Step 914: End.
- It should be noted that
steps comparison unit 502, and steps 904, 910, 912 are performed by thecompression unit 504. As a person skilled in the art can readily understand details of each step shown inFIG. 10 after reading above paragraphs, further description is omitted here for brevity. - In a fourth exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to at least one image capture characteristic. TheISP 114 may be configured to perform digital gain adjustment for a focus level, an exposure level, and an ISO (International Organization for Standardization) value. Hence, the side information SI given by theISP 114 may include at least one of the focus level, the exposure level, and the ISO value. Please refer toFIG. 6 again. In this embodiment, thecomparison unit 502 receives the side information SI from theISP 114, and compares the side information SI with at least one predetermined threshold to generate the comparison result CR′. Thecompression unit 504 supports a plurality of compression algorithms having different characteristics, and refers to the comparison result CR′ to select one of the supported compression algorithms to achieve better compression performance or visual quality. For example, a blurred image is captured when the focus level is lower than a first predetermined threshold THR1. Hence, the compression algorithm N4 particularly designed for compressing the blurred image is selected by thecomparison unit 502. An over-exposure or under-exposure image is obtained when the exposure level is out of a specific range delimited by a second predetermined threshold THR2 and a third predetermined threshold THR3, where THR2>THR3. Hence, the compression algorithm N3 particularly designed to manipulate this kind of captured image is selected by thecomparison unit 502. Alternatively, the over-exposure image and the under-exposure image may be processed by different compression algorithms. In addition, the ISO value from theISP 114 can be exploited as side information since it impacts the noise level on the captured image. Specifically, the ISO value is positively correlated to the noise level. Hence, if the ISO value is not lower than a fourth predetermined threshold THR4, a high ISO image can be compressed using the compression algorithm N1 such that noise pixels can be properly considered during the compression. If the ISO value is lower than the fourth predetermined threshold THR4, the compression algorithm N2 is selected by thecompression unit 504 to achieve better compression performance for the low ISO image. -
FIG. 11 is a flowchart illustrating an adaptive compression method based on at least one image capture characteristic according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 11 . The exemplary adaptive compression method may be briefly summarized by following steps. - Step 1000: Start.
- Step 1002: Receive an image.
- Step 1004: Check if the focus level of the image is lower than the first predetermined threshold THR1. If yes, go to
step 1006; otherwise, go tostep 1008. - Step 1006: Apply the compression algorithm N4. Go to step 1018.
- Step 1008: Check if the exposure level of the image is higher than the second predetermined threshold THR2 or lower than the third predetermined threshold THR3. If yes, go to
step 1010; otherwise, go tostep 1012. - Step 1010: Apply the compression algorithm N3. Go to step 1018.
- Step 1012: Check if the ISO value of the image is lower than the fourth predetermined threshold THR4. If yes, go to
step 1014; otherwise, go tostep 1016. - Step 1014: Apply the compression algorithm N2. Go to step 1018.
- Step 1016: Apply the compression algorithm N1.
- Step 1018: Check if all of the images have been processed. If yes, go to
step 1020; otherwise, go to step 1002 to process the next image. - Step 1020: End.
- It should be noted that
steps comparison unit 502, andsteps compression unit 504. As a person skilled in the art can readily understand details of each step shown inFIG. 11 after reading above paragraphs, further description is omitted here for brevity. - In a fifth exemplary embodiment, the
compressor 142 may adaptively adjust a compression algorithm applied to the input multimedia data D1 according to a de-compression algorithm supported by theISP 114, and the de-compressor 132 may adaptively adjust a de-compression algorithm applied to the input multimedia data D2 according to a compression algorithm supported by thecamera module 110. Please refer toFIG. 12 , which is a diagram illustrating a configuration of a compressor in a camera module and a configuration of a de-compressor in an ISP according to an embodiment of the present invention. Each of the camera modules 1302_1 and 1302_2 supports a plurality of compression algorithms, and theISP 1304 supports a plurality of de-compression algorithms. When the ISP 1304 (e.g.,ISP 114 shown inFIG. 1 ) is used to connect the camera module 1302_1 (e.g.,camera module 110 shown inFIG. 1 ) via a camera interface 1303 (e.g.,camera interface 103 shown inFIG. 1 ), theISP 1304 sends side information to inform the camera module 1302_1 of the supported de-compression algorithms X′ and Y′. As the compression algorithm X supported by the camera module 1302_1 is compliant with the de-compression algorithm X′, the camera module 1302_1 therefore selects and enables the compression algorithm X of the compressor (e.g.,compressor 142 shown inFIG. 1 ). In addition, the camera module 1302_1 sends side information to inform theISP 1304 of the employed compression algorithm X. As the de-compression algorithm X′ supported by theISP 1304 is compliant with the compression algorithm X, theISP 1304 therefore selects and enables the de-compression algorithm X′ of the de-compressor (e.g., de-compressor 132 shown inFIG. 1 ). - The
ISP 1304 may be used in a variety of applications, and therefore supports different de-compression algorithms. Thus, in one exemplary application, theISP 1304 is used to connect the camera module 1302_1. However, in another application, theISP 1304 is used to connect the camera module 1302_2. When theISP 1304 is used to connect the camera module 1302_2 via thecamera interface 1303, theISP 1304 sends side information to inform the camera module 1302_2 of the supported de-compression algorithms X′ and Y′. As the compression algorithm Y supported by the camera module 1302_2 is compliant with the de-compression algorithm Y′, the camera module 1302_2 therefore selects and enables the compression algorithm Y of the compressor. In addition, the camera module 1302_2 sends side information to inform theISP 1304 of the employed compression algorithm Y. As the de-compression algorithm Y′ supported by theISP 1304 is compliant with the compression algorithm Y, theISP 1304 therefore selects and enables the de-compression algorithm Y′ of the de-compressor. -
FIG. 13 is a flowchart illustrating an adaptive compression and de-compression method based on side information communicated between a camera module and an ISP according to an embodiment of the present invention. Provided that the result is substantially the same, the steps are not required to be executed in the exact order shown inFIG. 13 . The exemplary adaptive compression and de-compression method may be briefly summarized by following steps. - Step 1400: Start.
- Step 1402: Receive side information of the ISP.
- Step 1404: Refer to the ISP's side information to select and enable a compression algorithm compliant with a de-compression algorithm supported by the ISP.
- Step 1406: Receive side information of the camera module.
- Step 1408: Refer to the camera module's side information to select and enable a de-compression algorithm compliant with a compression algorithm employed by the camera module.
- Step 1410: End.
- It should be noted that
steps steps FIG. 13 after reading above paragraphs, further description is omitted here for brevity. - Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims (25)
1. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI);
wherein the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to context characteristics of the input multimedia data.
2. The data processing apparatus of claim 1 , wherein the compressor comprises:
a content analysis unit, arranged for analyzing the input multimedia data to classify contents included in the input multimedia data and accordingly generating a content classification result; and
a compression unit, arranged for referring to at least the content classification result to adaptively adjust the compression algorithm.
3. The data processing apparatus of claim 2 , wherein the contents are selected from a group consisting of a video content, an image content, a text content, and a graphic content.
4. The data processing apparatus of claim 2 , wherein the contents comprise a first content generated using a first quantization level and a second content generated using a second quantization level which is different from the first quantization level.
5. The data processing apparatus of claim 2 , wherein the contents comprise a first content with a first bit rate and a second content with a second bit rate which is different from the first bit rate.
6. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI);
wherein the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a power supply status.
7. The data processing apparatus of claim 6 , wherein the data processing apparatus is powered by a battery device, and the power supply status indicates an available battery capacity of the battery device.
8. The data processing apparatus of claim 7 , wherein the compressor is arranged to employ a first compression algorithm as the compression algorithm when the power supply status indicates that the available battery capacity is higher than a predetermined threshold, and employ a second compression algorithm as the compression algorithm when the power supply status indicates that the available battery capacity is not higher than the predetermined threshold, where the second compression algorithm is different from the first compression algorithm.
9. The data processing apparatus of claim 8 , wherein the first compression algorithm is more complex than the second compression algorithm; or the first compression algorithm has a higher compression efficiency than the second compression algorithm.
10. The data processing apparatus of claim 7 , wherein the compressor is arranged to disable the compression algorithm when the power supply status indicates that the available battery capacity is higher than a predetermined threshold, and enable the compression algorithm when the power supply status indicates that the available battery capacity is not higher than the predetermined threshold.
11. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI);
wherein the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to an operational status of a storage device.
12. The data processing apparatus of claim 11 , wherein the operational status indicates a used bandwidth of the storage device.
13. The data processing apparatus of claim 12 , wherein the compressor is arranged to employ a first compression algorithm as the compression algorithm when the operational status indicates that the used bandwidth is lower than a predetermined threshold, and employ a second compression algorithm as the compression algorithm when the operational status indicates that the used bandwidth is not lower than the predetermined threshold, where the second compression algorithm is different from the first compression algorithm.
14. The data processing apparatus of claim 13 , wherein the first compression algorithm is more complex than the second compression algorithm; or the first compression algorithm has a higher compression efficiency than the second compression algorithm.
15. The data processing apparatus of claim 12 , wherein the compressor is arranged to disable the compression algorithm when the operational status indicates that the used bandwidth is lower than a predetermined threshold, and enable the compression algorithm when the operational status indicates that the used bandwidth is not lower than the predetermined threshold.
16. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI);
wherein the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to at least one image capture characteristic.
17. The data processing apparatus of claim 16 , wherein the at least one image capture characteristic includes at least one of a focus level, an exposure level, and an ISO (International Organization for Standardization) value.
18. A data processing apparatus comprising:
a compressor, arranged for receiving an input multimedia data and generating an output multimedia data according to the input multimedia data; and
an output interface, arranged for packing the output multimedia data into an output bitstream, and outputting the output bitstream to another data processing apparatus via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI);
wherein the compressor adaptively adjusts a compression algorithm applied to the input multimedia data according to a de-compression algorithm supported by the another data processing apparatus.
19. A data processing apparatus comprising:
an input interface, arranged for receiving an input bitstream from another data processing apparatus via a camera interface, and un-packing the input bitstream into an input multimedia data, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI); and
a de-compressor, arranged for generating a de-compressed multimedia data according to the input multimedia data when the input multimedia data is a compressed multimedia data;
wherein the de-compressor adaptively adjusts a de-compression algorithm according to a compression algorithm employed by the another data processing apparatus.
20. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusts a compression algorithm according to context characteristics of the input multimedia data;
generating an output multimedia data according to the compression algorithm and the input multimedia data; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
21. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusting a compression algorithm according to a power supply status;
generating an output multimedia data according to the compression algorithm and the input multimedia data; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
22. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusting a compression algorithm according to an operational status of a storage device;
generating an output multimedia data according to the compression algorithm and the input multimedia data; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
23. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusting a compression algorithm according to at least one image capture characteristic;
generating an output multimedia data according to the compression algorithm and the input multimedia data; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
24. A data processing method comprising:
receiving an input multimedia data;
adaptively adjusting a compression algorithm according to a de-compression algorithm supported by a data processing apparatus;
generating an output multimedia data according to the compression algorithm and the input multimedia data; and
packing the output multimedia data into an output bitstream, and outputting the output bitstream to the data processing apparatus via a camera interface, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI).
25. A data processing method comprising:
receiving an input bitstream from a data processing apparatus via a camera interface, and un-packing the input bitstream into an input multimedia data, wherein the camera interface is a camera serial interface (CSI) standardized by a Mobile Industry Processor Interface (MIPI);
adaptively adjusting a de-compression algorithm according to a compression algorithm employed by the data processing apparatus; and
when the input multimedia data is a compressed multimedia data, generating a de-compressed multimedia data according to the input multimedia data and the de-compression algorithm.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/022,203 US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
CN201310593889.4A CN103841317A (en) | 2012-11-23 | 2013-11-21 | Data processing apparatus and related data processing method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201261729426P | 2012-11-23 | 2012-11-23 | |
US14/022,203 US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20140146874A1 true US20140146874A1 (en) | 2014-05-29 |
Family
ID=50772955
Family Applications (8)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/964,102 Active US9568985B2 (en) | 2012-11-23 | 2013-08-11 | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
US13/965,169 Abandoned US20140146187A1 (en) | 2012-11-23 | 2013-08-12 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US13/965,210 Abandoned US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
US13/965,225 Abandoned US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
US13/965,203 Active 2034-01-11 US9535489B2 (en) | 2012-11-23 | 2013-08-13 | Data processing system for transmitting compressed multimedia data over camera interface |
US14/022,203 Abandoned US20140146874A1 (en) | 2012-11-23 | 2013-09-09 | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method |
US15/292,145 Abandoned US20170034517A1 (en) | 2012-11-23 | 2016-10-13 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US15/361,006 Active US10200603B2 (en) | 2012-11-23 | 2016-11-24 | Data processing system for transmitting compressed multimedia data over camera interface |
Family Applications Before (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/964,102 Active US9568985B2 (en) | 2012-11-23 | 2013-08-11 | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
US13/965,169 Abandoned US20140146187A1 (en) | 2012-11-23 | 2013-08-12 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US13/965,210 Abandoned US20140146195A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus for transmitting/receiving compression-related indication information via camera interface and related data processing method |
US13/965,225 Abandoned US20140146188A1 (en) | 2012-11-23 | 2013-08-13 | Data processing apparatus with adaptive compression algorithm selection for data communication based on sensor input/sensor configuration/display configuration over camera interface and related data processing method |
US13/965,203 Active 2034-01-11 US9535489B2 (en) | 2012-11-23 | 2013-08-13 | Data processing system for transmitting compressed multimedia data over camera interface |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/292,145 Abandoned US20170034517A1 (en) | 2012-11-23 | 2016-10-13 | Data processing apparatus for configuring camera interface based on compression characteristic of compressed multimedia data and related data processing method |
US15/361,006 Active US10200603B2 (en) | 2012-11-23 | 2016-11-24 | Data processing system for transmitting compressed multimedia data over camera interface |
Country Status (2)
Country | Link |
---|---|
US (8) | US9568985B2 (en) |
CN (7) | CN103841415B (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9536045B1 (en) | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US20170104995A1 (en) * | 2014-03-25 | 2017-04-13 | Owtware Holdings Limited, BVI | Video content classification |
US20200363534A1 (en) * | 2016-09-16 | 2020-11-19 | Sony Semiconductor Solutions Corporation | Imaging device and electronic device |
US11164545B2 (en) * | 2018-07-10 | 2021-11-02 | Displaylink (Uk) Limited | Compression of display data |
US11432187B2 (en) * | 2018-04-04 | 2022-08-30 | Charter Communications Operating, Llc | Dynamic use of header compression in a wireless network |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10275924B2 (en) * | 2011-12-26 | 2019-04-30 | Intel Corporation | Techniques for managing three-dimensional graphics display modes |
US9568985B2 (en) * | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
CN103369142B (en) * | 2013-07-09 | 2015-02-04 | 广东欧珀移动通信有限公司 | Method and system for avoiding call-up malfunction |
JP2015053644A (en) * | 2013-09-09 | 2015-03-19 | オリンパス株式会社 | Imaging device |
US20160154444A1 (en) * | 2014-06-12 | 2016-06-02 | Mediatek Inc. | Thermal management method and electronic system with thermal management mechanism |
CN105404331A (en) * | 2014-09-10 | 2016-03-16 | 联想(北京)有限公司 | Control method and device, and electronic equipment |
US9491495B2 (en) * | 2015-01-16 | 2016-11-08 | Analog Devices Global | Method and apparatus for providing input to a camera serial interface transmitter |
CN104717433A (en) * | 2015-03-27 | 2015-06-17 | 电子科技大学 | Distributed transmission device for video stream signal processing system |
JP6355595B2 (en) * | 2015-06-02 | 2018-07-11 | キヤノン株式会社 | IMAGING ELEMENT, IMAGING DEVICE, IMAGING ELEMENT CONTROL METHOD, PROGRAM, AND STORAGE MEDIUM |
US20170094190A1 (en) * | 2015-09-30 | 2017-03-30 | Microsoft Technology Licensing, Llc | Processing display of digital camera readout with minimal latency |
US10827039B1 (en) * | 2015-10-19 | 2020-11-03 | Quest Software Inc. | Systems and methods for dynamic compression of time-series data |
JP6743427B2 (en) * | 2016-03-08 | 2020-08-19 | 株式会社リコー | Information processing apparatus, imaging system, and data transfer method |
KR102510708B1 (en) * | 2016-07-25 | 2023-03-16 | 삼성전자주식회사 | Electronic device and method for diplaying image |
WO2018139947A1 (en) * | 2017-01-24 | 2018-08-02 | Huawei Technologies Co., Ltd. | Apparatus and method for data compression |
US10229322B2 (en) | 2017-04-06 | 2019-03-12 | Ants Technology (Hk) Limited | Apparatus, methods and computer products for video analytics |
US10453221B2 (en) | 2017-04-10 | 2019-10-22 | Intel Corporation | Region based processing |
CN107241600B (en) * | 2017-04-20 | 2018-07-03 | 中国科学技术大学 | A kind of static background inner frame coding method and device |
CN107176100A (en) * | 2017-05-12 | 2017-09-19 | 深圳市京弘全智能科技股份有限公司 | Car-mounted terminal and its distance-finding method with distance measurement function |
KR102204596B1 (en) * | 2017-06-02 | 2021-01-19 | 삼성전자주식회사 | Processor, image processing device comprising the same, and method for image processing |
KR102434417B1 (en) | 2017-07-20 | 2022-08-22 | 삼성전자주식회사 | Method for transmitting image data and data associated with control of image capture based on sizes of image data and data associated with control of image capture and electronic device for supporting the same |
TWI640957B (en) | 2017-07-26 | 2018-11-11 | 聚晶半導體股份有限公司 | Image processing chip and image processing system |
US10331564B2 (en) * | 2017-11-29 | 2019-06-25 | Intel Corporation | Technologies for secure I/O with MIPI camera device |
KR102301940B1 (en) | 2017-12-01 | 2021-09-14 | 삼성전자주식회사 | Method and apparatus for image fusion |
CN108205320A (en) * | 2017-12-18 | 2018-06-26 | 深圳市奇虎智能科技有限公司 | Map data processing method and device |
TWI653886B (en) | 2017-12-21 | 2019-03-11 | 鴻海精密工業股份有限公司 | Picture transmision method and photographic device |
US10739838B2 (en) * | 2017-12-28 | 2020-08-11 | Omnivision Technologies, Inc. | Quality-driven dynamic frequency scaling for energy optimization of smart camera systems |
KR102499033B1 (en) | 2018-01-31 | 2023-02-13 | 삼성전자주식회사 | Image sensor and electronic device including the image sensor |
KR102499286B1 (en) | 2018-02-23 | 2023-02-14 | 삼성전자주식회사 | Electronic device for compressing image based on compression loss data associated with compression of a plurality of blocks into which image has been segmented and method for operating thefeof |
CN110971943B (en) * | 2018-09-30 | 2021-10-15 | 北京微播视界科技有限公司 | Video code rate adjusting method, device, terminal and storage medium |
US11412136B2 (en) * | 2018-12-07 | 2022-08-09 | Samsung Electronics Co., Ltd. | Apparatus and method for operating multiple cameras for digital photography |
CN111756963B (en) * | 2019-03-29 | 2022-01-14 | 华为技术有限公司 | Image shooting module and electronic terminal |
KR20210009255A (en) | 2019-07-16 | 2021-01-26 | 삼성전자주식회사 | Image sensor and image processing system comprising thereof |
TWM600051U (en) * | 2020-04-15 | 2020-08-11 | 聯詠科技股份有限公司 | Image device and image processing integrated circuit thereof |
CN113918298B (en) * | 2021-10-12 | 2024-05-14 | 北京字节跳动网络技术有限公司 | Multimedia data processing method, system and equipment |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040008772A1 (en) * | 2001-06-07 | 2004-01-15 | Masaaki Kojima | Camera-integrated video recording and reproducing apparatus, and record control method thereof |
US20050276496A1 (en) * | 2004-05-31 | 2005-12-15 | Claus Molgaard | Image compression for rapid high-quality imaging |
US20090086174A1 (en) * | 2007-09-28 | 2009-04-02 | Sanyo Electric Co., Ltd. | Image recording apparatus, image correcting apparatus, and image sensing apparatus |
US20100309987A1 (en) * | 2009-06-05 | 2010-12-09 | Apple Inc. | Image acquisition and encoding system |
US20110273589A1 (en) * | 2010-01-04 | 2011-11-10 | Nikon Corporation | Image processing apparatus and image processing program |
US8599316B2 (en) * | 2010-05-25 | 2013-12-03 | Intellectual Ventures Fund 83 Llc | Method for determining key video frames |
US20140092439A1 (en) * | 2012-09-28 | 2014-04-03 | Scott A. Krig | Encoding images using a 3d mesh of polygons and corresponding textures |
Family Cites Families (92)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5502485A (en) | 1993-06-23 | 1996-03-26 | Nikon Corporation | Camera which compresses digital image data in correspondence with the focus control or the stop value of the camera |
CA2163556C (en) | 1994-04-22 | 2006-07-11 | Tetsuji Kawashima | System and method for transmitting compressed data or pre-compressed data based on a preset compression ratio |
US5553160A (en) * | 1994-09-01 | 1996-09-03 | Intel Corporation | Method and apparatus for dynamically selecting an image compression process based on image size and color resolution |
US5778191A (en) | 1995-10-26 | 1998-07-07 | Motorola, Inc. | Method and device for error control of a macroblock-based video compression technique |
US6031929A (en) * | 1996-07-18 | 2000-02-29 | University Of Pittsburgh | Image facsimile with real time image segmentation |
JP3796756B2 (en) * | 1996-08-30 | 2006-07-12 | ソニー株式会社 | Still image moving image recording apparatus and still image moving image recording method |
JPH1093918A (en) | 1996-09-17 | 1998-04-10 | Nikon Corp | Picture recording device |
US6201834B1 (en) | 1996-12-20 | 2001-03-13 | Intel Corporation | Method and apparatus for packet loss recovery with standard-based packet video |
US7110025B1 (en) | 1997-05-28 | 2006-09-19 | Eastman Kodak Company | Digital camera for capturing a sequence of full and reduced resolution digital images and storing motion and still digital image data |
US6507672B1 (en) | 1997-09-10 | 2003-01-14 | Lsi Logic Corporation | Video encoder for digital video displays |
US6614934B1 (en) * | 1998-03-06 | 2003-09-02 | Divio, Inc. | Method and apparatus for concatenating bits of odd-length words |
JP2000232649A (en) * | 1998-12-10 | 2000-08-22 | Fujitsu Ltd | Mpeg video decoder and mpeg video decoding method |
US6704310B1 (en) | 1999-06-30 | 2004-03-09 | Logitech Europe, S.A. | Header encoding method and apparatus for packet-based bus |
US6995794B2 (en) | 1999-06-30 | 2006-02-07 | Logitech Europe S.A. | Video camera with major functions implemented in host software |
US6956971B1 (en) | 1999-07-20 | 2005-10-18 | Lg Electronics Inc. | Terminal and method for transporting still picture |
US6300973B1 (en) | 2000-01-13 | 2001-10-09 | Meir Feder | Method and system for multimedia communication control |
US7027520B2 (en) | 2001-08-30 | 2006-04-11 | Thomson Licensing | Method and apparatus for simultaneously retrieving portions of a data stream from different channels |
US7088398B1 (en) * | 2001-12-24 | 2006-08-08 | Silicon Image, Inc. | Method and apparatus for regenerating a clock for auxiliary data transmitted over a serial link with video data |
KR20030097310A (en) * | 2002-06-20 | 2003-12-31 | 삼성전자주식회사 | method and system for adjusting image size of display apparatus and recording media for computer program therefor |
JP2004040548A (en) * | 2002-07-04 | 2004-02-05 | Minolta Co Ltd | Image pickup device |
US7069394B2 (en) | 2002-12-05 | 2006-06-27 | International Business Machines Corporation | Dynamic data routing mechanism for a high speed memory cloner |
US7403660B2 (en) | 2003-04-30 | 2008-07-22 | Nokia Corporation | Encoding picture arrangement parameter in picture bitstream |
KR100513274B1 (en) | 2003-07-30 | 2005-09-09 | 이디텍 주식회사 | A controlling method for a high speed DVI using compression technique and a DVI transmitter and Receiver using the method |
US20050073586A1 (en) * | 2003-10-06 | 2005-04-07 | Songnian Li | Digital camera interface |
CN1309258C (en) * | 2003-12-19 | 2007-04-04 | 联想(北京)有限公司 | A method of lossless image compression applied to real time transmission |
US7394410B1 (en) | 2004-02-13 | 2008-07-01 | Samplify Systems, Inc. | Enhanced data converters using compression and decompression |
US20050195205A1 (en) * | 2004-03-03 | 2005-09-08 | Microsoft Corporation | Method and apparatus to decode a streaming file directly to display drivers |
US7539218B2 (en) * | 2004-03-04 | 2009-05-26 | Nvidia Corporation | Media processing engine framework |
US7570270B2 (en) * | 2004-05-21 | 2009-08-04 | Broadcom Corporation | Buffer for driving display with asynchronous display engine |
EP1787477A1 (en) * | 2004-08-13 | 2007-05-23 | Koninklijke Philips Electronics N.V. | System and method for compression of mixed graphic and video sources |
CN2724334Y (en) | 2004-08-27 | 2005-09-07 | 马晨阳 | Cell phone video frequency image monitor |
US20060104356A1 (en) * | 2004-11-15 | 2006-05-18 | Microsoft Corporation | Timing for decoder buffer examination |
US20060176960A1 (en) * | 2005-02-07 | 2006-08-10 | Paul Lu | Method and system for decoding variable length code (VLC) in a microprocessor |
US8311088B2 (en) * | 2005-02-07 | 2012-11-13 | Broadcom Corporation | Method and system for image processing in a microprocessor for portable video communication devices |
KR101199498B1 (en) | 2005-03-31 | 2012-11-09 | 삼성전자주식회사 | Apparatus for encoding or generation of multi-view video by using a camera parameter, and a method thereof, and a recording medium having a program to implement thereof |
JP4368835B2 (en) | 2005-08-29 | 2009-11-18 | 富士通マイクロエレクトロニクス株式会社 | Image processing apparatus, imaging apparatus, and image processing system |
KR100744120B1 (en) | 2006-01-10 | 2007-08-01 | 삼성전자주식회사 | Video signal scaler and video signal processing apparatus having the same |
JP5173840B2 (en) * | 2006-02-07 | 2013-04-03 | エルジー エレクトロニクス インコーポレイティド | Encoding / decoding apparatus and method |
US7873224B2 (en) | 2006-03-01 | 2011-01-18 | Qualcomm Incorporated | Enhanced image/video quality through artifact evaluation |
US20070286277A1 (en) * | 2006-06-13 | 2007-12-13 | Chen Xuemin Sherman | Method and system for video compression using an iterative encoding algorithm |
DE102007035204A1 (en) | 2006-07-28 | 2008-02-07 | Mediatek Inc. | Video processing and operating device |
JP4250648B2 (en) | 2006-09-21 | 2009-04-08 | 株式会社東芝 | Information processing device |
EP1921867B1 (en) * | 2006-10-17 | 2016-05-25 | Harman Becker Automotive Systems GmbH | Sensor assisted video compression |
CN101578869B (en) * | 2006-12-28 | 2012-11-14 | 汤姆逊许可证公司 | Method and apparatus for automatic visual artifact analysis and artifact reduction |
TW200830170A (en) | 2007-01-04 | 2008-07-16 | Benq Corp | Data processing system and method |
KR20080066408A (en) | 2007-01-12 | 2008-07-16 | 삼성전자주식회사 | Device and method for generating three-dimension image and displaying thereof |
JP4858294B2 (en) * | 2007-05-09 | 2012-01-18 | ソニー株式会社 | Imaging device, imaging circuit, and image processing circuit |
FR2917919B1 (en) | 2007-06-21 | 2010-06-11 | Canon Kk | METHOD AND DEVICE FOR TRANSMITTING IMAGES |
US20090074058A1 (en) | 2007-09-14 | 2009-03-19 | Sony Corporation | Coding tool selection in video coding based on human visual tolerance |
US8049761B1 (en) | 2007-11-08 | 2011-11-01 | Nvidia Corporation | Bus protocol for transferring pixel data between chips |
JP2009129484A (en) | 2007-11-21 | 2009-06-11 | Hitachi Ltd | Information recording/reproducing apparatus |
DE102007058724B3 (en) | 2007-12-06 | 2009-05-14 | Fujitsu Siemens Computers Gmbh | Data processing system |
CN201127091Y (en) | 2007-12-20 | 2008-10-01 | 唐斌 | Mobile phone having function of preventing wireless video from watching |
CN101217623B (en) | 2007-12-26 | 2012-07-11 | 广东威创视讯科技股份有限公司 | A quick manual focusing method |
CN101472190B (en) * | 2007-12-28 | 2013-01-23 | 华为终端有限公司 | Multi-visual angle filming and image processing apparatus and system |
JP5593596B2 (en) | 2008-02-04 | 2014-09-24 | ソニー株式会社 | Video signal transmitting apparatus and video signal transmitting method |
TW201026056A (en) | 2008-12-16 | 2010-07-01 | Quanta Comp Inc | Image capturing device and image delivery method |
RU2689191C2 (en) * | 2009-01-26 | 2019-05-24 | Томсон Лайсенсинг | Packaging frames for encoding video |
US8157738B2 (en) * | 2009-06-02 | 2012-04-17 | Samplify Systems, Inc. | Ultrasound signal compression |
TWM378589U (en) * | 2009-07-10 | 2010-04-11 | Jetcom Technology Inc | Video conference device in combination with camera lens |
JP2011045039A (en) * | 2009-07-21 | 2011-03-03 | Fujifilm Corp | Compound-eye imaging apparatus |
CN102063265A (en) * | 2009-11-17 | 2011-05-18 | 智微科技股份有限公司 | Memory device and memory controller for accessing non-volatile memory |
CN101702778B (en) * | 2009-11-30 | 2011-04-13 | 公安部第一研究所 | Network video encoder using PS encapsulation technology to carry OSD information |
CN102118791B (en) * | 2009-12-31 | 2014-01-08 | 华为技术有限公司 | Method and device for transmitting data packets |
CN102118792B (en) * | 2009-12-31 | 2015-01-21 | 华为技术有限公司 | Method and device for transmitting data packets |
CN101778161A (en) * | 2010-01-19 | 2010-07-14 | 中兴通讯股份有限公司 | Mobile Internet terminal |
US8588536B2 (en) | 2010-02-22 | 2013-11-19 | Texas Instruments Incorporated | Guaranteed-rate tiled image data compression |
US9973768B2 (en) | 2010-03-16 | 2018-05-15 | Texas Instruments Incorporated | CABAC decoder with decoupled arithmetic decoding and inverse binarization |
US20110234200A1 (en) * | 2010-03-24 | 2011-09-29 | Kishan Shenoi | Adaptive slip double buffer |
US8233534B2 (en) * | 2010-04-09 | 2012-07-31 | Newport Media, Inc. | Frame buffer compression and memory allocation in a video decoder |
US8446484B2 (en) | 2010-04-21 | 2013-05-21 | Nokia Corporation | Image processing architecture with pre-scaler |
US20120120083A1 (en) * | 2010-11-12 | 2012-05-17 | Novatek Microelectronics Corp. | Display apparatus, and display controller and operating method thereof |
JP2012105188A (en) | 2010-11-12 | 2012-05-31 | Sony Corp | Image output device, image output method, image processing system, image processing method, program, and imaging apparatus |
KR20120058057A (en) * | 2010-11-29 | 2012-06-07 | 삼성전자주식회사 | Offset canceling circuit, sampling circuit and image sensor |
GB201020983D0 (en) * | 2010-12-10 | 2011-01-26 | Apical Ltd | Display controller and display system |
CN102647611A (en) | 2011-02-18 | 2012-08-22 | 安凯(广州)微电子技术有限公司 | Chip camera interface function testing method and chip camera interface function testing system |
JP5822544B2 (en) * | 2011-06-08 | 2015-11-24 | キヤノン株式会社 | Imaging apparatus and imaging system |
US9077917B2 (en) * | 2011-06-09 | 2015-07-07 | Apple Inc. | Image sensor having HDR capture capability |
US8879826B2 (en) * | 2011-07-05 | 2014-11-04 | Texas Instruments Incorporated | Method, system and computer program product for switching between 2D and 3D coding of a video sequence of images |
CN102523446B (en) * | 2011-12-26 | 2014-06-04 | 南京鹏力***工程研究所 | Adaptive compression method of radar video in vessel traffic navigation system |
WO2013155028A1 (en) * | 2012-04-09 | 2013-10-17 | Vid Scale, Inc. | Weighted prediction parameter signaling for video coding |
CN202551178U (en) | 2012-04-25 | 2012-11-21 | 东北石油大学 | Portable image acquisition and compression device |
US9532080B2 (en) * | 2012-05-31 | 2016-12-27 | Sonic Ip, Inc. | Systems and methods for the reuse of encoding information in encoding alternative streams of video data |
CN102685532B (en) * | 2012-06-04 | 2014-04-16 | 山东大学 | Coding method for free view point four-dimensional space video coding system |
CN102843566B (en) | 2012-09-20 | 2015-06-17 | 歌尔声学股份有限公司 | Communication method and equipment for three-dimensional (3D) video data |
US20140098111A1 (en) | 2012-10-09 | 2014-04-10 | Mediatek Inc. | Data processing system for transmitting compressed display data over display interface |
US9355613B2 (en) | 2012-10-09 | 2016-05-31 | Mediatek Inc. | Data processing apparatus for transmitting/receiving compression-related indication information via display interface and related data processing method |
US9077965B2 (en) | 2012-10-12 | 2015-07-07 | Mediatek Inc. | Method and apparatus for performing lossy image compression through source quantization and lossless compression kernel, and related method and apparatus for image decompression |
US9568985B2 (en) * | 2012-11-23 | 2017-02-14 | Mediatek Inc. | Data processing apparatus with adaptive compression algorithm selection based on visibility of compression artifacts for data communication over camera interface and related data processing method |
CN103220492A (en) | 2013-03-25 | 2013-07-24 | 东莞市久益通信科技有限公司 | Mobile phone video conference system based on 3G networks |
CN103294038A (en) | 2013-06-10 | 2013-09-11 | 中山市拓维电子科技有限公司 | Stabilized soil and cement stabilized macadam production process dynamic quality remote monitoring system |
CN103338354A (en) | 2013-06-17 | 2013-10-02 | 青岛海信电子设备有限公司 | Small-sized video encoding equipment, and video capture, coding and transmission system |
-
2013
- 2013-08-11 US US13/964,102 patent/US9568985B2/en active Active
- 2013-08-12 US US13/965,169 patent/US20140146187A1/en not_active Abandoned
- 2013-08-13 US US13/965,210 patent/US20140146195A1/en not_active Abandoned
- 2013-08-13 US US13/965,225 patent/US20140146188A1/en not_active Abandoned
- 2013-08-13 US US13/965,203 patent/US9535489B2/en active Active
- 2013-09-09 US US14/022,203 patent/US20140146874A1/en not_active Abandoned
- 2013-11-04 CN CN201310539313.XA patent/CN103841415B/en active Active
- 2013-11-05 CN CN201710412700.5A patent/CN107277347A/en not_active Withdrawn
- 2013-11-05 CN CN201310544279.5A patent/CN103841417B/en not_active Expired - Fee Related
- 2013-11-05 CN CN201310541485.0A patent/CN103841315B/en active Active
- 2013-11-21 CN CN201310593889.4A patent/CN103841317A/en active Pending
- 2013-11-21 CN CN201310593750.XA patent/CN103841316B/en not_active Expired - Fee Related
- 2013-11-21 CN CN201310594147.3A patent/CN103841318A/en active Pending
-
2016
- 2016-10-13 US US15/292,145 patent/US20170034517A1/en not_active Abandoned
- 2016-11-24 US US15/361,006 patent/US10200603B2/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040008772A1 (en) * | 2001-06-07 | 2004-01-15 | Masaaki Kojima | Camera-integrated video recording and reproducing apparatus, and record control method thereof |
US20050276496A1 (en) * | 2004-05-31 | 2005-12-15 | Claus Molgaard | Image compression for rapid high-quality imaging |
US20090086174A1 (en) * | 2007-09-28 | 2009-04-02 | Sanyo Electric Co., Ltd. | Image recording apparatus, image correcting apparatus, and image sensing apparatus |
US20100309987A1 (en) * | 2009-06-05 | 2010-12-09 | Apple Inc. | Image acquisition and encoding system |
US20110273589A1 (en) * | 2010-01-04 | 2011-11-10 | Nikon Corporation | Image processing apparatus and image processing program |
US8599316B2 (en) * | 2010-05-25 | 2013-12-03 | Intellectual Ventures Fund 83 Llc | Method for determining key video frames |
US20140092439A1 (en) * | 2012-09-28 | 2014-04-03 | Scott A. Krig | Encoding images using a 3d mesh of polygons and corresponding textures |
Cited By (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170104995A1 (en) * | 2014-03-25 | 2017-04-13 | Owtware Holdings Limited, BVI | Video content classification |
US10080018B2 (en) * | 2014-03-25 | 2018-09-18 | Owtware Holdings Limited, BVI | Video content classification |
US9536045B1 (en) | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US9536324B1 (en) * | 2015-03-16 | 2017-01-03 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US20170064319A1 (en) * | 2015-03-16 | 2017-03-02 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US9800882B2 (en) * | 2015-03-16 | 2017-10-24 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US10129553B2 (en) * | 2015-03-16 | 2018-11-13 | D.R. Systems, Inc. | Dynamic digital image compression based on digital image characteristics |
US20200363534A1 (en) * | 2016-09-16 | 2020-11-19 | Sony Semiconductor Solutions Corporation | Imaging device and electronic device |
US20220214458A1 (en) * | 2016-09-16 | 2022-07-07 | Sony Semiconductor Solutions Corporation | Imaging device and electronic device |
US11432187B2 (en) * | 2018-04-04 | 2022-08-30 | Charter Communications Operating, Llc | Dynamic use of header compression in a wireless network |
US11164545B2 (en) * | 2018-07-10 | 2021-11-02 | Displaylink (Uk) Limited | Compression of display data |
Also Published As
Publication number | Publication date |
---|---|
CN103841316B (en) | 2018-04-17 |
US20140146187A1 (en) | 2014-05-29 |
US20140146188A1 (en) | 2014-05-29 |
CN103841315B (en) | 2017-07-07 |
CN103841316A (en) | 2014-06-04 |
US20140146186A1 (en) | 2014-05-29 |
CN103841417B (en) | 2018-03-06 |
CN103841317A (en) | 2014-06-04 |
US20170034517A1 (en) | 2017-02-02 |
CN103841415B (en) | 2017-08-01 |
US9535489B2 (en) | 2017-01-03 |
US9568985B2 (en) | 2017-02-14 |
CN103841318A (en) | 2014-06-04 |
US20140146195A1 (en) | 2014-05-29 |
CN107277347A (en) | 2017-10-20 |
US20140146194A1 (en) | 2014-05-29 |
US20170078567A1 (en) | 2017-03-16 |
CN103841415A (en) | 2014-06-04 |
CN103841417A (en) | 2014-06-04 |
CN103841315A (en) | 2014-06-04 |
US10200603B2 (en) | 2019-02-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20140146874A1 (en) | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over camera interface and related data processing method | |
US9773469B2 (en) | Data processing apparatus with adaptive compression/de-compression algorithm selection for data communication over display interface and related data processing method | |
CN104813666B (en) | Decoding device and decoding method, encoding device, and computer-readable medium | |
USRE40079E1 (en) | Video encoding and decoding apparatus | |
US20150237351A1 (en) | Techniques for inclusion of region of interest indications in compressed video data | |
JP6449329B2 (en) | System and method for selecting quantization parameter (QP) in display stream compression (DSC) | |
US9398302B2 (en) | Image encoding method and apparatus with rate control by selecting target bit budget from pre-defined candidate bit budgets and related image decoding method and apparatus | |
US8179452B2 (en) | Method and apparatus for generating compressed file, and terminal comprising the apparatus | |
US10666975B2 (en) | Image processing apparatus and image processing method | |
US11838510B2 (en) | Content adaptive quantization for video coding | |
US10477207B2 (en) | Image processing apparatus and image processing method | |
EP2428032A2 (en) | Bitstream syntax for graphics-mode compression in wireless hd 1.1 | |
US9674554B2 (en) | Image processing system with coding mode and method of operation thereof | |
US9681141B2 (en) | Error detection on variable length code decoder | |
US20120121199A1 (en) | Image processing device, image processing chip and method for processing raw high resolution image data | |
JP2012195849A (en) | Moving image processing apparatus and camera system |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JU, CHI-CHENG;LIU, TSU-MING;REEL/FRAME:031169/0165 Effective date: 20130903 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |