CN110727340B - Method, device and system for adapting dynamic bandwidth of image acquisition display - Google Patents
Method, device and system for adapting dynamic bandwidth of image acquisition display Download PDFInfo
- Publication number
- CN110727340B CN110727340B CN201910916877.8A CN201910916877A CN110727340B CN 110727340 B CN110727340 B CN 110727340B CN 201910916877 A CN201910916877 A CN 201910916877A CN 110727340 B CN110727340 B CN 110727340B
- Authority
- CN
- China
- Prior art keywords
- memory
- blanking period
- frequency
- display
- frame rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/26—Power supply means, e.g. regulation thereof
- G06F1/32—Means for saving power
- G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
- G06F1/3234—Power saving characterised by the action undertaken
- G06F1/325—Power saving in peripheral device
- G06F1/3265—Power saving in display device
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
- Controls And Circuits For Display Device (AREA)
- Control Of Indicators Other Than Cathode Ray Tubes (AREA)
Abstract
The invention provides a method, a device and a system for adapting dynamic bandwidth of image acquisition display, wherein the method comprises the following steps: controlling the image acquisition module to reduce the frame rate so as to prolong a first blanking period of the image acquisition module, wherein the first blanking period is larger than a second blanking period; the second blanking period is a blanking period corresponding to the display module; and in the first blanking period of the image acquisition module, and in the second blanking period of the display module, the internal memory is subjected to frequency conversion. By the scheme, the image acquisition module can acquire images, and the display module can realize self-adaptation between the bandwidth and the memory frequency of the layer display process, so that the power consumption of the system is effectively reduced.
Description
Technical Field
The invention relates to the field of memory frequency conversion, in particular to a method, a device and a system for dynamic bandwidth adaptation of image acquisition and display.
Background
The memory frequency is usually set according to the actual bandwidth requirement, that is, the memory frequency conversion is performed, in order to optimize the system power consumption. However, the display principle of the LCD display is to refresh the memory at regular time, and the resolution of the LCD is relatively high, so the requirement on the bandwidth of the memory is relatively high, and therefore, if the data is terminated due to the frequency conversion of the memory during the refresh process, the LCD will display an abnormal state.
The prior art, as described in patent publication No. CN104317542, extends the blanking period by reducing the clock frequency in the blanking period of the display screen to complete the memory frequency conversion. The method needs to support synchronous clock reduction by means of external devices, and many external devices cannot support synchronous clock reduction at present. Therefore, when the synchronous clock of the data phase is inconsistent with the synchronous clock of the blanking period phase, the work is abnormal, and the compatibility problem exists.
In addition, each controller is not allowed to access the memory port to access data during the memory frequency conversion period, and when the memory data needs to be acquired, the frequency conversion is performed when each port enters idle. And the display module needs to interact with the user, and if the real data is not refreshed timely, the user can intuitively feel the phenomenon of blocking, so that the sensory experience of the user is influenced. In a scene with a camera function, the memory frequency not only needs to meet the requirements of the display module, but also needs to meet the requirements of the camera module. At present, no existing scheme is available for adjusting the memory bandwidth by linking two high-bandwidth modules.
Disclosure of Invention
Therefore, a technical scheme for dynamic bandwidth adaptation of image acquisition and display needs to be provided, so as to solve the problem that the memory frequency cannot be adjusted under a linkage mechanism of two bandwidth modules.
To achieve the above object, the inventors provide a method for dynamic bandwidth adaptation of an image acquisition display, the method comprising the steps of:
controlling the image acquisition module to reduce the frame rate so as to prolong a first blanking period of the image acquisition module, wherein the first blanking period is larger than a second blanking period; the second blanking period is a blanking period corresponding to the display module;
and in the first blanking period of the image acquisition module, and in the second blanking period of the display module, the internal memory is subjected to frequency conversion.
Further, "frequency converting the memory in the second blanking period of the display module" includes:
and when the display module enters a second blanking period, starting to carry out frequency conversion on the memory, and finishing the frequency conversion on the memory in the second blanking period.
Further, "frequency converting the memory in the second blanking period of the display module" includes:
and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module according to the corresponding relation between the frame rate and the memory frequency.
Further, the method comprises:
judging whether the current memory frequency is less than the memory frequency corresponding to the frame rate reduced by the camera module, if so, executing step S1: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module.
Further, the method comprises the steps of:
when it is determined that the current memory frequency is not less than the memory frequency corresponding to the frame rate reduced by the camera module, step S2 is executed: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module.
Further, the "correspondence between frame rate and memory frequency" is obtained by:
selecting the lowest memory operation frequency required by each frame rate under the condition of meeting the preset condition, determining the lowest memory operation frequency as the memory frequency corresponding to each frame rate, and recording the memory frequencies into a table;
the preset conditions are that the screen flashing phenomenon does not occur in the current display module and the video data transmission is not interrupted abnormally.
The inventors also provide an apparatus for dynamic bandwidth adaptation of image acquisition displays, the apparatus comprising a processor for frequency conversion of a memory according to the method of any one of the preceding claims.
The inventor also provides a system for adapting the dynamic bandwidth of image acquisition display, which is characterized in that the system comprises a processor, a display module and a camera module, wherein the display module and the camera module are respectively connected with the processor, and the processor is the processor as described above.
The method, the device and the system for adapting the dynamic bandwidth of image acquisition and display in the technical scheme comprise the following steps: controlling the image acquisition module to reduce the frame rate so as to prolong a first blanking period of the image acquisition module, wherein the first blanking period is larger than a second blanking period; the second blanking period is a blanking period corresponding to the display module; and in the first blanking period of the image acquisition module, and in the second blanking period of the display module, the internal memory is subjected to frequency conversion. By the scheme, the image acquisition module can acquire images, and the display module can realize self-adaptation between the bandwidth and the memory frequency of the layer display process, so that the power consumption of the system is effectively reduced.
Drawings
FIG. 1 is a flow chart of a method for dynamic bandwidth adaptation of an image capture display according to an embodiment of the present invention;
fig. 2 is a schematic diagram of a dynamic bandwidth adaptation apparatus for a display layer according to an embodiment of the present invention;
fig. 3 is a timing diagram illustrating a method for dynamic bandwidth adaptation of an image capture display according to an embodiment of the present invention.
Description of reference numerals:
101. a memory;
102. a display module;
103. a processor;
104. and an image acquisition module.
Detailed Description
To explain technical contents, structural features, and objects and effects of the technical solutions in detail, the following detailed description is given with reference to the accompanying drawings in conjunction with the embodiments.
Fig. 1 is a flowchart illustrating a method for adapting a dynamic bandwidth of an image capture display according to an embodiment of the present invention. The method comprises the following steps:
firstly, the method comprises the following steps of S101, controlling an image acquisition module to reduce the frame rate so as to prolong a first blanking period of the image acquisition module, wherein the first blanking period is larger than a second blanking period; the second blanking period is a blanking period corresponding to the display module;
then, the method proceeds to step S102, in a first blanking period of the image acquisition module, and in a second blanking period of the display module, the memory is frequency-converted.
By reducing the frame rate of the image acquisition module, the speed of the image acquisition module for acquiring image data is reduced, so that the blanking period (namely, the first blanking period) of the image acquisition module is prolonged, the memory frequency is adjusted to the memory frequency corresponding to the reduced frame rate, on one hand, the situation that the next acquired frame of image is blocked when displayed can be avoided, and on the other hand, the system power consumption is also reduced.
In some embodiments, "frequency converting the memory during the second blanking period of the display module" comprises: and when the display module enters a second blanking period, starting to carry out frequency conversion on the memory, and finishing the frequency conversion on the memory in the second blanking period. In short, since the second blanking period is included in the first blanking period, the memory frequency conversion is started in the second blanking period, which does not affect the acquisition of the image data by the image acquisition module or the display of the image data by the display module. When the display module enters the second blanking period, the frequency conversion of the memory is started immediately, and the frequency conversion of the memory can be completed by making full use of the time of the second blanking period.
In some embodiments, "frequency converting the memory during the second blanking period of the display module" comprises: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module according to the corresponding relation between the frame rate and the memory frequency.
Preferably, the "correspondence between frame rate and memory frequency" is obtained by: selecting the lowest memory operation frequency required by each frame rate under the condition of meeting the preset condition, determining the lowest memory operation frequency as the memory frequency corresponding to each frame rate, and recording the memory frequencies into a table; the preset conditions are that the screen flashing phenomenon does not occur in the current display module and the video data transmission is not interrupted abnormally. The phenomenon of screen flashing can be obtained through manual observation of technicians and also can be obtained through analyzing the pixel value of each display pixel on the current display screen. The abnormal interruption can be judged by a video output module of the display controller, and when data cannot be transmitted to a display screen for display (on the premise that the bandwidth is met, the current internal memory frequency is complemented), the abnormal interruption occurs.
In certain embodiments, the method comprises: judging whether the current memory frequency is less than the memory frequency corresponding to the frame rate reduced by the camera module, if so, executing step S1: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module. In other embodiments, the method comprises the steps of: when it is determined that the current memory frequency is not less than the memory frequency corresponding to the frame rate reduced by the camera module, step S2 is executed: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module.
Both steps S1 and S2 are performed during the second blank period (i.e., the blank period corresponding to the display module). In short, if the current memory frequency does not satisfy the bandwidth requirement of the next frame of image display, the frame rate of the image acquisition module is decreased first, and the current memory frequency is adjusted to the frequency corresponding to the bandwidth requirement of the adjusted frame rate, so that the next frame of image does not have a pause phenomenon during transmission and display. Otherwise, if the current memory frequency is greater than the bandwidth requirement for acquiring and displaying the next frame of image, the current memory frequency is adjusted to the memory frequency corresponding to the reduced frame rate, so as to reduce the power consumption of the system.
The present application also provides an apparatus for dynamic bandwidth adaptation for image capture display, wherein the apparatus comprises a processor, and the processor performs frequency conversion on a memory according to the method described above.
The processor performs frequency conversion on the memory in a blanking period (i.e., a second blanking period) of the display screen, where the blanking period refers to a time required for the display screen to start displaying another picture or region, and the frequency conversion is to change the frequency of the memory, such as to reduce the frequency of the memory, so as to achieve the purpose of reducing the bandwidth and reducing the power consumption, or such as to improve the frequency of the memory, so as to achieve the purpose of improving the storage efficiency of the memory. The frequency conversion is carried out in the blanking period of the display screen, and the display does not update the display picture at the moment, so that the influence on the display picture when the internal memory is subjected to frequency conversion is reduced as much as possible. Generally, the second blanking period is relatively fixed, and in order to ensure that no abnormality occurs in the acquisition and display of the image, the first blanking period (i.e. the blanking period corresponding to the image acquisition module) is required to be longer than the second blanking period, which can be implemented by reducing the frame rate of the image acquisition module, wherein the lower the frame rate is, the longer the blanking period corresponding to the image acquisition module is.
As shown in fig. 2, the inventor further provides a system for dynamic bandwidth adaptation of image capture display, where the system includes a processor 103, a display module 102, and a camera module 104, where the display module 102 and the camera module 104 are respectively connected to the processor 103, and the processor 103 performs frequency conversion on a memory according to the method described above.
Preferably, the processor may be a device having a processing function, such as a CPU, an MCU, or the like; the display module is a display screen which can be various display screens such as LCD, LED, CRT and the like; the internal memory can be SDRAM, DDR, RDRAM, etc.; the image acquisition module can be a camera or an electronic device with the camera.
Fig. 3 is a timing chart of a method for dynamic bandwidth adaptation of image capture display according to an embodiment of the present invention. The following takes fig. 3 as an example to specifically describe the memory frequency conversion method of the present application:
in a time period t1, the processor receives a memory frequency conversion request (i.e. notification frequency conversion in fig. 3), and controls the camera module (i.e. the image acquisition module described above) to reduce the frame rate;
in the time period t2, although the frame rate of the camera module is reduced, in order to ensure that the capture of the current frame image does not appear stuck, the DDR frequency is not adjusted when the current frame image is captured, transmitted and displayed;
in the time period t3, the blanking period (i.e. the first blanking period) of the camera module comes, and the processor immediately enters a mode waiting for the display module to come, and the time point from the first blanking period to the second blanking period is denoted as t 3;
in the time period T4, the second blanking period comes, the frequency conversion operation for the memory can be started, and the completion time from the beginning to the end of the frequency conversion operation is T4, and the time period T4 is less than the second blanking period time T2.
In fig. 3, T1 is a first blanking period, T2 is a second blanking period, and T4 is a DDR conversion time. It can be seen that T2 is smaller than T1 and is included in the time period of T1, and T4 is smaller than or equal to T2, so that the memory frequency conversion operation can be completed in the blanking period where the camera module and the display module are overlapped together, the acquisition and display of images are not affected, and the power consumption of the system can be reduced as much as possible.
The invention provides a method, a device and a system for adapting dynamic bandwidth of image acquisition display, wherein the method comprises the following steps: controlling the image acquisition module to reduce the frame rate so as to prolong a first blanking period of the image acquisition module, wherein the first blanking period is larger than a second blanking period; the second blanking period is a blanking period corresponding to the display module; and in the first blanking period of the image acquisition module, and in the second blanking period of the display module, the internal memory is subjected to frequency conversion. By the scheme, the image acquisition module can acquire images, and the display module can realize self-adaptation between the bandwidth and the memory frequency of the layer display process, so that the power consumption of the system is effectively reduced.
It should be noted that, although the above embodiments have been described herein, the invention is not limited thereto. Therefore, based on the innovative concepts of the present invention, the technical solutions of the present invention can be directly or indirectly applied to other related technical fields by making changes and modifications to the embodiments described herein, or by using equivalent structures or equivalent processes performed in the content of the present specification and the attached drawings, which are included in the scope of the present invention.
Claims (6)
1. A method for dynamic bandwidth adaptation of an image capture display, the method comprising the steps of:
controlling the image acquisition module to reduce the frame rate so as to prolong a first blanking period of the image acquisition module, wherein the first blanking period is larger than a second blanking period; the second blanking period is a blanking period corresponding to the display module;
in a first blanking period of the image acquisition module and in a second blanking period of the display module, carrying out frequency conversion on the memory;
the step of changing the frequency of the memory in the second blanking period of the display module comprises the following steps:
according to the corresponding relation between the frame rate and the memory frequency, adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module;
the corresponding relation between the frame rate and the memory frequency is obtained by the following method:
selecting the lowest memory operation frequency required by each frame rate under the condition of meeting the preset condition, determining the lowest memory operation frequency as the memory frequency corresponding to each frame rate, and recording the memory frequencies into a table;
the preset conditions are that the screen flashing phenomenon does not occur in the current display module and the video data transmission is not interrupted abnormally.
2. The method of dynamic bandwidth adaptation for image capture display of claim 1, wherein "frequency converting the memory during the second blanking interval of the display module" comprises:
and when the display module enters a second blanking period, starting to carry out frequency conversion on the memory, and finishing the frequency conversion on the memory in the second blanking period.
3. The method of dynamic bandwidth adaptation of an image capture display of claim 1, the method comprising:
judging whether the current memory frequency is less than the memory frequency corresponding to the frame rate reduced by the camera module, if so, executing step S1: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module.
4. The method for dynamic bandwidth adaptation of an image capture display of claim 1, comprising the steps of:
when it is determined that the current memory frequency is not less than the memory frequency corresponding to the frame rate reduced by the camera module, step S2 is executed: and adjusting the current memory frequency to the memory frequency corresponding to the frame rate reduced by the camera module.
5. An apparatus for dynamic bandwidth adaptation of image capture display, the apparatus comprising a processor for frequency conversion of a memory according to the method of any one of claims 1 to 4.
6. A system for dynamic bandwidth adaptation of image acquisition display, the system comprising a processor, a display module and a camera module, the display module and the camera module are respectively connected with the processor, and the processor is the processor according to claim 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910916877.8A CN110727340B (en) | 2019-09-26 | 2019-09-26 | Method, device and system for adapting dynamic bandwidth of image acquisition display |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910916877.8A CN110727340B (en) | 2019-09-26 | 2019-09-26 | Method, device and system for adapting dynamic bandwidth of image acquisition display |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110727340A CN110727340A (en) | 2020-01-24 |
| CN110727340B true CN110727340B (en) | 2021-03-02 |
Family
ID=69218456
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910916877.8A Active CN110727340B (en) | 2019-09-26 | 2019-09-26 | Method, device and system for adapting dynamic bandwidth of image acquisition display |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110727340B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111510772B (en) * | 2020-03-23 | 2022-03-29 | 珠海亿智电子科技有限公司 | Method, device, equipment and storage medium for balancing video frame rate error |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317542A (en) * | 2014-10-10 | 2015-01-28 | 福州瑞芯微电子有限公司 | Method and system for converting frequency of internal storage |
| CN104869360A (en) * | 2015-05-19 | 2015-08-26 | 华为技术有限公司 | Video acquisition and display synchronization method and apparatus |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4718024A (en) * | 1985-11-05 | 1988-01-05 | Texas Instruments Incorporated | Graphics data processing apparatus for graphic image operations upon data of independently selectable pitch |
| CN201238361Y (en) * | 2008-06-19 | 2009-05-13 | 同济大学 | Video collection apparatus |
| US8964007B2 (en) * | 2010-02-01 | 2015-02-24 | Vizio, Inc. | Frame system, method and apparatus for synchronizing three-dimensional eyewear |
| CN103761152B (en) * | 2013-12-31 | 2017-04-12 | 福州瑞芯微电子股份有限公司 | Method for preventing display anomaly during DDR (double data rate) frequency conversion |
| CN105141873A (en) * | 2015-07-08 | 2015-12-09 | 成都西可科技有限公司 | System and method for dynamically adjusting frame rate of motion camera |
| CN106791956B (en) * | 2016-11-25 | 2020-01-21 | 百度在线网络技术（北京）有限公司 | Network live broadcast card pause processing method and device |
| CN108281119B (en) * | 2018-01-18 | 2020-05-15 | 福州瑞芯微电子股份有限公司 | Memory variable frequency window period display method and system |
-
2019
- 2019-09-26 CN CN201910916877.8A patent/CN110727340B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104317542A (en) * | 2014-10-10 | 2015-01-28 | 福州瑞芯微电子有限公司 | Method and system for converting frequency of internal storage |
| CN104869360A (en) * | 2015-05-19 | 2015-08-26 | 华为技术有限公司 | Video acquisition and display synchronization method and apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110727340A (en) | 2020-01-24 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6069354B2 (en) | Receiving apparatus, video refresh frequency control method, apparatus and system | |
| US20210358358A1 (en) | Timing controller, display device, apparatus and method for controlling refresh rate | |
| EP2760013A1 (en) | Backlight adjustment method, backlight adjustment apparatus, and display screen | |
| EP2693425A1 (en) | Display method, display device and display system | |
| US20110157202A1 (en) | Techniques for aligning frame data | |
| US20100315427A1 (en) | Multiple graphics processing unit display synchronization system and method | |
| US8953082B2 (en) | Method in which camera module transfers image data and computer therefor | |
| US20140320039A1 (en) | Backlight control module and backlight control method | |
| CN105469746A (en) | Liquid crystal screen backlight control device, liquid crystal television and micro control unit (MCU) chip | |
| CN105681720B (en) | The processing method and processing device of video playing | |
| US11482185B2 (en) | Method for driving display device, and display device | |
| CN110727340B (en) | Method, device and system for adapting dynamic bandwidth of image acquisition display | |
| US20160379583A1 (en) | Display device and driving method thereof | |
| US8264441B2 (en) | Method for driving liquid crystal display apparatus | |
| CN202694758U (en) | Advanced RISC machine (ARM) signal spreading display device | |
| CN110610688B (en) | Method and device for adapting dynamic bandwidth of display layer | |
| EP1484737A1 (en) | Display controller | |
| CN115512665A (en) | Data processing method and device | |
| CN113119866A (en) | Rearview mirror display method and device based on streaming media | |
| CN108281119B (en) | Memory variable frequency window period display method and system | |
| CN100418351C (en) | Method for reducing brightness variation during channel change of TV set | |
| CN115951855B (en) | Method and device for processing display command set of chip system based on chip | |
| CN116112627B (en) | Method and circuit for video frame rate self-adaptive transformation | |
| CN114040125B (en) | Synchronous exposure control method and system for coaxial line separated camera | |
| US20070153101A1 (en) | Image processing system and method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant after: Ruixin Microelectronics Co., Ltd Address before: 350003 building 18, No.89, software Avenue, Gulou District, Fuzhou City, Fujian Province Applicant before: Fuzhou Rockchips Electronics Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |