TWI648982B - Video stream quality processing method - Google Patents

Video stream quality processing method Download PDF

Info

Publication number
TWI648982B
TWI648982B TW106143281A TW106143281A TWI648982B TW I648982 B TWI648982 B TW I648982B TW 106143281 A TW106143281 A TW 106143281A TW 106143281 A TW106143281 A TW 106143281A TW I648982 B TWI648982 B TW I648982B
Authority
TW
Taiwan
Prior art keywords
image
time
sharing
brightness
value
Prior art date
Application number
TW106143281A
Other languages
Chinese (zh)
Other versions
TW201926997A (en
Inventor
袁上元
陳元龍
Original Assignee
群光電子股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 群光電子股份有限公司 filed Critical 群光電子股份有限公司
Priority to TW106143281A priority Critical patent/TWI648982B/en
Application granted granted Critical
Publication of TWI648982B publication Critical patent/TWI648982B/en
Publication of TW201926997A publication Critical patent/TW201926997A/en

Links

Landscapes

  • Studio Devices (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

一種影像串流畫質處理系統，包含影像擷取模組、畫面偵測單元及影像組合單元。影像擷取模組擷取第一影像串流及第二影像串流，第一影像串流包含複數具有第一曝光值的第一影像分時畫面，第二影像串流包含複數具有第二曝光值的第二分時影像分時畫面。同一時刻第一影像分時畫面對應第二影像分時畫面，第一曝光值大於第二曝光值。畫面偵測單元偵測第一影像分時畫面的第一曝光值及亮度值，在第一曝光值低於曝光門檻值且亮度值低於亮度門檻值時輸出疊加信號。此時，影像組合單元將第一影像分時畫面與第二影像分時畫面疊合成亮度疊加影像分時畫面。 An image streaming image quality processing system includes an image capture module, a frame detection unit, and an image combination unit. The image capture module captures a first image stream and a second image stream. The first image stream includes a plurality of first image time-sharing pictures with a first exposure value, and the second image stream includes a plurality of images with a second exposure. The value of the second time-sharing image time-sharing screen. At the same time, the first image time-sharing screen corresponds to the second image time-sharing screen, and the first exposure value is greater than the second exposure value. The frame detection unit detects a first exposure value and a brightness value of the first image time-sharing frame, and outputs a superimposed signal when the first exposure value is lower than the exposure threshold value and the brightness value is lower than the brightness threshold value. At this time, the image combining unit superimposes the first image time-sharing picture and the second image time-sharing picture into a brightness superimposed image time-sharing picture.

Description

影像串流畫質處理方法 Image stream quality processing method

本發明涉及影像處理領域，尤其是影像串流畫質處理系統及影像串流畫質處理方法。 The present invention relates to the field of image processing, and in particular to an image stream image quality processing system and an image stream image quality processing method.

一般相機或攝影機，對於一個場景中最亮與最暗明度的比值(又稱為動態範圍，Dynamic Range)大約為1000：1。然而，人眼能分辨的動態範圍大約為10000：1，從而在特定的環境場域，相機照出的照片與人眼視覺有明顯落差。例如，在明亮的環境下，相機若欲對焦於物件的細節時，可能呈現背景過亮，呈現一片白色的情況；而若欲呈現出背景，則可能造成物件過暗、細節無法呈現的情形。 For a general camera or video camera, for a scene, the ratio of the brightest to the darkest lightness (also referred to as Dynamic Range) is about 1000: 1. However, the dynamic range that can be resolved by the human eye is about 10000: 1, so that in a specific environmental field, the photos taken by the camera are significantly different from the human vision. For example, in a bright environment, if the camera wants to focus on the details of the object, the background may be too bright and a piece of white; if you want to show the background, the object may be too dark and the details cannot be displayed.

對於此，目前數位相機透過影像處理的運算，拍攝數張不同曝光值的照片，將該些影像取部分疊合，而能同時呈現背景與物件的細節，使照片更接近人眼的解析，稱為高動態範為(High Dynamic Range，HDR)。 For this, the current digital camera takes several photos with different exposure values through image processing operations, and partially overlaps these images, which can simultaneously display the background and object details, making the photos closer to the analysis of the human eye. Is High Dynamic Range (HDR).

然而，對於影像串流，也就是動態影像，若要進行影像的合成，同一時點就必須拍攝兩個畫面。例如，以一般人眼解析上能夠流暢的相機每秒至少具有30個畫面(30 frame per second，30FPS)，每秒最少要截取60個畫面才有辦法進行疊合。當拍攝的畫面增加時，曝光時間則降低，造成進光量的減少，整體亮度變暗，而在環境光不足的條件下，即使以疊合的方式進行影像處理，仍無法清楚地解析物件的細節。 However, for image streaming, that is, moving images, to synthesize images, two frames must be taken at the same time. For example, a camera that can be analyzed smoothly by human eyes has at least 30 frames per second (30 frames per second, 30FPS), and at least 60 frames per second can be used to overlap. When the number of shots increases, the exposure time decreases, resulting in a reduction in the amount of light entering and the overall brightness becomes dark. Under the condition of insufficient ambient light, even if the image processing is performed in a superimposed manner, the details of the object cannot be clearly analyzed. .

為了解決習用技術上的種種問題，在此提供一種影像串流畫質處理系統。影像串流畫質處理系統包含影像擷取模組、畫面偵測單元、以及影像組合單元。影像擷取模組擷取第一影像串流及第二影像串流，第一影像串流包含複數個第一影像分時畫面，該等第一影像分時畫面具有相同之第一曝光值。第二影像串流包含複數個第二分時影像分時畫面，該等第二影像分時畫面具有相同之第二曝光值。在同一時刻的第一影像分時畫面對應第二影像分時畫面，且第一曝光值大於第二曝光值。畫面偵測單元通訊連接於影像擷取模組，並接收第一影像串流及第一曝光值，畫面偵測單元更偵測各第一影像分時畫面的第一亮度值，畫面偵測單元在第一曝光值低於曝光門檻值，且第一亮度值低於亮度門檻值時，產生並輸出疊加信號。影像組合單元通訊連接於影像擷取模組，接收第一影像串流及第二影像串流，影像組合單元更連接於畫面偵測單元，並接收疊加信號，當影像組合單元接收到疊加信號時，將對應疊加信號時刻之第一影像分時畫面與第二影像分時畫面疊合成亮度疊加影像分時畫面。 In order to solve various problems in conventional technology, a video stream image processing system is provided here. The image stream image quality processing system includes an image capture module, a frame detection unit, and an image combination unit. The image capture module captures a first image stream and a second image stream. The first image stream includes a plurality of first image time-sharing pictures, and the first image time-sharing pictures have the same first exposure value. The second image stream includes a plurality of second time-sharing images, and the second time-sharing images have the same second exposure value. The first image time-sharing picture at the same time corresponds to the second image time-sharing picture, and the first exposure value is greater than the second exposure value. The frame detection unit is communicatively connected to the image capture module and receives a first image stream and a first exposure value. The frame detection unit further detects a first brightness value of each first image time-sharing frame. The frame detection unit When the first exposure value is lower than the exposure threshold and the first brightness value is lower than the brightness threshold, a superimposed signal is generated and output. The image combination unit is communicatively connected to the image capture module and receives the first image stream and the second image stream. The image combination unit is further connected to the screen detection unit and receives the superimposed signal. When the image combination unit receives the superimposed signal, , Superimposing the first image time-sharing picture and the second image time-sharing picture corresponding to the time of the superimposed signal into a brightness superimposed time-sharing picture.

在此，更提供一種影像串流畫質處理方法，包含以下步驟：由影像擷取模組擷取第一影像串流及第二影像串流，第一影像串流包含複數個第一影像分時畫面，第一影像分時畫面具有相同的一第一曝光值，第二影像串流包含複數個第二分時影像畫面，第二影像分時畫面具有相同的一第二曝光值，在同一時刻的第一影像分時畫面對應第二影像分時畫面，且第一曝光值大於第二曝光值；由畫面偵測單元接收第一影像串流及第一影像串流的第一曝光值，並偵測各第一影像分時畫面的第一亮度值，當第一曝光值低於曝光門檻值，且第一亮度值高於亮度門檻值時，產生並輸出疊加信號；以及由影像組合單元接收第一影像串流、第二影像串流及疊加信號，當影像組合單元接收到疊加信號時，將對應疊加信號之時刻的第一 影像分時畫面及第二影像分時畫面全部疊合以形成亮度疊加分時畫面。 Here, an image stream quality processing method is further provided, including the following steps: the first image stream and the second image stream are captured by an image capture module, and the first image stream includes a plurality of first image streams; Time picture, the first image time-sharing picture has the same first exposure value, the second image stream includes a plurality of second time-sharing picture frames, and the second image time-sharing picture has the same second exposure value. The first image time-sharing screen at the time corresponds to the second image time-sharing screen, and the first exposure value is greater than the second exposure value; the frame detection unit receives the first image stream and the first exposure value of the first image stream, And detecting the first brightness value of each first image time-sharing screen, and generating and outputting a superimposed signal when the first exposure value is lower than the exposure threshold value and the first brightness value is higher than the brightness threshold value; and an image combining unit Receive the first video stream, the second video stream, and the superimposed signal. When the video combination unit receives the superimposed signal, it will correspond to the first time of the superimposed signal. The image time-sharing picture and the second image time-sharing picture are all superimposed to form a brightness superimposed time-sharing picture.

在一些實施例中，畫面偵測單元在第一曝光值高於曝光門檻值，或第一亮度值高於亮度門檻值時，產生並輸出組合信號，當影像組合單元收到組合信號時，將對應組合信號時刻之第一影像分時畫面與第二影像分時畫面局部疊合成高動態範圍分時畫面。進一步地，各時刻的亮度疊加分時畫面及高動態範圍分時畫面可以合成為合成影像串流。 In some embodiments, the frame detection unit generates and outputs a combined signal when the first exposure value is higher than the exposure threshold or the first brightness value is higher than the brightness threshold. When the image combining unit receives the combined signal, it outputs The first image time-sharing picture and the second image time-sharing picture corresponding to the time of the combined signal are partially superimposed into a high dynamic range time-sharing picture. Further, the brightness superimposed time-sharing picture and the high dynamic range time-sharing picture at each time can be synthesized into a composite image stream.

在一些實施例中，第一曝光值所對應的第一曝光時間為第二值所對應之第二曝光時間的倍數。 In some embodiments, the first exposure time corresponding to the first exposure value is a multiple of the second exposure time corresponding to the second value.

在一些實施例中，曝光門檻值所對應的曝光時間為1/120至1/60秒。進一步地，亮度門檻值為20至80。 In some embodiments, the exposure time corresponding to the exposure threshold is 1/120 to 1/60 second. Further, the brightness threshold is 20 to 80.

在一些實施例中，當畫面偵測單元產生並輸出疊加信號時，產生回饋信號至影像擷取模組。影像擷取模組收到回饋信號時，再擷取第三影像分時畫面，並傳送至影像組合單元。當判斷第一影像分時畫面的第一亮度的兩倍是仍低於亮度門檻值時，將第一影像分時畫面與第三影像分時畫面疊合形成改良亮度分時畫面以取代亮度疊加分時畫面。若第一影像分時畫面的第一亮度的三倍是仍低於亮度門檻值時，可將第一影像分時畫面、第二影像分時畫面、以及第三影像分時畫面疊合形成增強亮度分時畫面以取代亮度疊加分時畫面。在此，第三影像分時畫面所對應的第三曝光值大於第二曝光值，且小於或等於第一曝光值。 In some embodiments, when the frame detection unit generates and outputs a superimposed signal, a feedback signal is generated to the image capture module. When the image capture module receives the feedback signal, it captures the third image time-sharing screen and sends it to the image combination unit. When it is judged that twice the first brightness of the first time-sharing picture is still lower than the brightness threshold, the first time-sharing picture and the third time-sharing picture are superimposed to form an improved brightness time-sharing picture to replace the brightness superimposition. Time-sharing screen. If three times the first brightness of the first image time-sharing picture is still lower than the brightness threshold, the first image time-sharing picture, the second image time-sharing picture, and the third image time-sharing picture can be superimposed to form an enhancement. The brightness time-sharing picture replaces the brightness time-sharing picture. Here, the third exposure value corresponding to the third image time-sharing screen is greater than the second exposure value and less than or equal to the first exposure value.

藉此，在影像串流疊合時，除了能利用高動態範圍的方式，使過亮、過暗的地方能夠互補調整畫質，更能針對受限於影像串流，曝光時間不足，對於畫面亮度過暗之處，透過亮度疊合的方式進行亮度補償，使得物件能清楚解析。從而，影像串流能更符合人眼所觀察到的視覺動態範圍。 In this way, when the image stream is superimposed, in addition to using a high dynamic range method, the bright and dark places can be adjusted to complement the image quality. It can also be used to limit the image stream and the exposure time is insufficient. Where the brightness is too dark, the brightness is compensated by overlapping the brightness, so that the object can be clearly analyzed. As a result, the image stream can more closely match the visual dynamic range observed by the human eye.

1‧‧‧影像串流畫質處理系統 1‧‧‧Video Stream Image Quality Processing System

10‧‧‧影像擷取模組 10‧‧‧Image capture module

20‧‧‧畫面偵測單元 20‧‧‧Screen detection unit

30‧‧‧影像組合單元 30‧‧‧Image combination unit

200‧‧‧影像處理晶片模組 200‧‧‧Image Processing Chip Module

F‧‧‧回饋信號 F‧‧‧Feedback signal

F1‧‧‧第一影像分時畫面 F1‧‧‧ The first image time-sharing screen

F2‧‧‧第二影像分時畫面 F2‧‧‧Second image time-sharing screen

F3‧‧‧第三影像分時畫面 F3‧‧‧ Third image time-sharing screen

FB‧‧‧改良亮度分時畫面 FB‧‧‧Improved brightness time-sharing screen

FBI‧‧‧增強亮度分時畫面 FBI‧‧‧Enhance brightness time-sharing screen

FL‧‧‧亮度疊加分時畫面 FL‧‧‧ Brightness superimposed time-sharing screen

IS1‧‧‧第一影像串流 IS1‧‧‧First Video Stream

IS2‧‧‧第二影像串流 IS2‧‧‧Second Video Stream

ISP‧‧‧合成影像串流 ISP‧‧‧Synthetic Video Stream

S1‧‧‧疊加信號 S1‧‧‧ Overlay signal

S2‧‧‧組合信號 S2‧‧‧Combined Signal

S100‧‧‧影像串流畫質處理方法 S100‧‧‧Image stream quality processing method

S200‧‧‧影像串流畫質處理方法 S200‧‧‧Image stream quality processing method

S10‧‧‧擷取第一影像串流及第二影像串流 S10‧‧‧ Capture the first video stream and the second video stream

S20‧‧‧第一影像分時畫面的第一曝光值是否小於曝光門檻值 S20. Is the first exposure value of the first image time-sharing screen smaller than the exposure threshold?

S30‧‧‧第一影像分時畫面的第一亮度值是否小於亮度門檻值 S30. Is the first brightness value of the first image time-sharing screen smaller than the brightness threshold?

S41‧‧‧產生並輸出疊加信號 S41‧‧‧ Generates and outputs superimposed signals

S42‧‧‧產生並輸出疊加信號及回饋信號 S42‧‧‧ Generates and outputs superimposed signals and feedback signals

S43‧‧‧疊合第一影像分時畫面及第二影像分時畫面形成亮度疊加影像分時畫面 S43‧‧‧ superimposing the first image time-sharing screen and the second image time-sharing screen to form a brightness superimposed image time-sharing screen

S44‧‧‧第一影像分時畫面的第一亮度值的的兩倍是否小於亮度門檻值 S44 ‧‧‧ Is twice the first brightness value of the first image time-sharing screen smaller than the brightness threshold?

S45‧‧‧疊合第一影像分時畫面及第二影像分時畫面形成亮度疊加影像分時畫面 S45‧‧‧ superimposing the first image time-sharing screen and the second image time-sharing screen to form a brightness superimposed image time-sharing screen

S46‧‧‧擷取第三影像分時畫面 S46‧‧‧ Capture the third image time-sharing screen

S47‧‧‧第一影像分時畫面的第一亮度值的的三倍是否小於亮度門檻值 S47 Is the three times the first brightness value of the first image time-sharing screen smaller than the brightness threshold?

S48‧‧‧疊合第一影像分時畫面、第二影像分時畫面及第三影像分時畫面形成增強亮度分時畫面 S48‧‧‧ Superimposing the first image time-sharing screen, the second image time-sharing screen and the third image time-sharing screen to form an enhanced brightness time-sharing screen

S49‧‧‧疊合第一影像分時畫面及第三影像分時畫面形成改良亮度分時畫面 S49‧‧‧ Superimposing the first image time-sharing screen and the third image time-sharing screen to form an improved brightness time-sharing screen

S51‧‧‧產生並輸出組合信號 S51‧‧‧ Generates and outputs a combined signal

S53‧‧‧局部疊合第一影像分時畫面及第二影像分時畫面形成高動態範圍分時畫面 S53‧‧‧ Partially superimposing the first image time-sharing picture and the second image time-sharing picture to form a high dynamic range time-sharing picture

S60‧‧‧產生合成影像串流 S60‧‧‧Generate a composite image stream

通過參照附圖進一步詳細描述本發明的示例性實施例，本發明的上述和其他示例性實施例，優點和特徵將變得更加清楚，其中：圖1為影像串流畫質處理系統的單元示意圖；圖2為疊合分時畫面一實施例的示意圖；圖3為疊合分時畫面另一實施例的示意圖；圖4為疊合分時畫面又一實施例的示意圖；圖5為影像串流畫質處理方法一實施例的流程圖；以及圖6為影像串流畫質處理方法另一實施例的流程圖。 By further describing the exemplary embodiments of the present invention in detail with reference to the accompanying drawings, the advantages and features of the above and other exemplary embodiments of the present invention will become more clear, in which: FIG. 1 is a schematic diagram of a unit of a video stream image quality processing system 2 is a schematic diagram of an embodiment of a superimposed time-sharing screen; FIG. 3 is a schematic diagram of another embodiment of a superimposed time-sharing screen; FIG. 4 is a schematic diagram of another embodiment of a superimposed time-sharing screen; A flowchart of one embodiment of a streaming image quality processing method; and FIG. 6 is a flowchart of another embodiment of a streaming image quality processing method.

圖1為影像串流畫質處理系統的單元示意圖。圖2為疊合分時畫面一實施例的示意圖。如圖1-2所示，影像串流畫質處理系統1包含影像擷取模組10、畫面偵測單元20、以及影像組合單元30。影像擷取模組10擷取第一影像串流IS1及第二影像串流IS2。第一影像串流IS1包含複數個第一影像分時畫面F1，第一影像分時畫面F1具有相同之第一曝光值。第二影像串流IS2包含複數個第二分時影像分時畫面F2，第二影像分時畫面F2具有相同之第二曝光值。對應同一時刻的第一影像分時畫面F1對應第二影像分時畫面F2，且第一曝光值大於第二曝光值。畫面偵測單元20通訊連接於影像擷取模組10，並接收第一影像串流IS1及第一影像串流IS1第一曝光值，畫面偵測單元20更偵測各第一影像分時畫面F1的第一亮度值，畫面偵測單元20在第一曝光值低於曝光門檻值，且第一亮度值低於亮度門檻值時，產生並輸出疊加信號S1。影像組合單元30通訊連接於影像擷取模組10，接收第一影像串流IS1及第二影像串流IS2。影像組合單元30 更連接於畫面偵測單元20，並接收疊加信號S1，當影像組合單元30接收到疊加信號S1時，將對應疊加信號S1時刻之第一影像分時畫面F1與第二影像分時畫面F2疊合(overlapping)成亮度疊加影像分時畫面FL。 FIG. 1 is a schematic diagram of a unit of a video stream image quality processing system. FIG. 2 is a schematic diagram of an embodiment of a superimposed time-sharing screen. As shown in FIG. 1-2, the image streaming image quality processing system 1 includes an image capturing module 10, a frame detecting unit 20, and an image combining unit 30. The image capture module 10 captures a first image stream IS1 and a second image stream IS2. The first image stream IS1 includes a plurality of first image time-sharing pictures F1, and the first image time-sharing pictures F1 have the same first exposure value. The second image stream IS2 includes a plurality of second time-sharing image time-sharing pictures F2, and the second image time-sharing picture F2 has the same second exposure value. The first image time-sharing screen F1 corresponding to the same time corresponds to the second image time-sharing screen F2, and the first exposure value is greater than the second exposure value. The frame detection unit 20 is communicatively connected to the image capture module 10 and receives the first image stream IS1 and the first exposure value of the first image stream IS1. The frame detection unit 20 further detects each first image time-sharing screen. For the first brightness value of F1, the frame detection unit 20 generates and outputs a superimposed signal S1 when the first exposure value is lower than the exposure threshold and the first brightness value is lower than the brightness threshold. The image combining unit 30 is communicatively connected to the image capturing module 10 and receives a first image stream IS1 and a second image stream IS2. Image combination unit 30 It is further connected to the frame detection unit 20 and receives the superimposed signal S1. When the image combination unit 30 receives the superimposed signal S1, it superimposes the first image time-sharing picture F1 and the second image time-sharing picture F2 corresponding to the time of the superimposed signal S1. Overlaps the time-sharing picture FL of the brightness superimposed image.

再次參閱圖1，畫面偵測單元20在第一曝光值高於曝光門檻值，或第一亮度值高於亮度門檻值時，產生並輸出組合信號S2，當影像組合單元30收到組合信號S2時，將對應組合信號S2時刻之第一影像分時畫面F1與第二影像分時畫面F2局部疊合成高動態範圍分時畫面。在此，局部疊合成高動態範圍分時畫面係利用現有技術上各種高動態範圍影像處理的技術來達成。 Referring again to FIG. 1, the frame detection unit 20 generates and outputs a combined signal S2 when the first exposure value is higher than the exposure threshold, or the first brightness value is higher than the brightness threshold. , The first image time-sharing picture F1 and the second image time-sharing picture F2 corresponding to the time of the combined signal S2 are partially superimposed into a high dynamic range time-sharing picture. Here, the local superimposed high dynamic range time-sharing picture is achieved by using various high dynamic range image processing techniques in the prior art.

在一些實施例中，影像擷取模組10可以為鏡頭及感光元件的組合，感光元件可以為感光耦合元件(Charge-coupled Device，CCD)，或是互補式金屬氧化物半導體(Complementary Metal-Oxide-Semiconductor，CMOS)感光元件。畫面偵測單元20以及影像組合單元30可以整合成一個影像處理晶片模組200。 In some embodiments, the image capture module 10 may be a combination of a lens and a photosensitive element. The photosensitive element may be a photosensitive-coupled device (CCD), or a complementary metal-oxide semiconductor (Complementary Metal-Oxide). -Semiconductor (CMOS) photosensitive element. The frame detection unit 20 and the image combination unit 30 can be integrated into an image processing chip module 200.

在一些實施例中，曝光門檻值所對應的曝光時間為1/120至1/60秒，較佳為，1/120秒、1/90秒、1/80秒、1/60秒等。第一曝光值所對應的第一曝光時間為第二曝光值所對應之第二曝光時間的倍數。例如，第一影像串流IS1對應的曝光時間為1/60，而第二影像串流IS2對應的曝光時間為1/540。但實際上並不限於此。 In some embodiments, the exposure time corresponding to the exposure threshold is 1/120 to 1/60 second, preferably 1/120 second, 1/90 second, 1/80 second, 1/60 second, or the like. The first exposure time corresponding to the first exposure value is a multiple of the second exposure time corresponding to the second exposure value. For example, the exposure time corresponding to the first video stream IS1 is 1/60, and the exposure time corresponding to the second video stream IS2 is 1/540. But in fact it is not limited to this.

在此，亮度是指第一影像分時畫面F1中各像素亮度的平均值，每一像素最高的亮度為255、最低為0。亮度門檻值為20至80。較佳為20、30、40、50、60、70等。如圖2所示，在此呈現疊合分時畫面一實施例，在此僅以5x5的像素方格做為示例，在實際上像素的數量遠多於此，將第一影像分時畫面F1與第二影像分時畫面F2疊合成亮度疊加影像分時 畫面FL是指將各像素的亮度直接疊加。如此，每一像素的亮度值直接疊加。 Here, the brightness refers to an average value of the brightness of each pixel in the first image time-sharing screen F1, and the highest brightness of each pixel is 255 and the lowest is 0. The brightness threshold is 20 to 80. Preferred are 20, 30, 40, 50, 60, 70 and the like. As shown in FIG. 2, an embodiment of a superimposed time-sharing screen is shown here. Here, only a 5 × 5 pixel grid is taken as an example. In reality, the number of pixels is much more than this. The first time-sharing screen F1 is used. Superimposed with the second image time-sharing screen F2 to synthesize the brightness superimposed image time-sharing The screen FL refers to directly superimposing the brightness of each pixel. In this way, the brightness value of each pixel is directly superimposed.

圖1為影像串流畫質處理系統的單元示意圖。圖3為疊合分時畫面另一實施例的示意圖、圖4為疊合分時畫面又一實施例的示意圖。再次參閱圖1，當畫面偵測單元20產生並輸出疊加信號S1時，更產生回饋信號F至影像擷取模組10。當影像擷取模組10收到回饋信號F，再擷取一第三影像分時畫面F3，並傳送至影像組合單元30。第三影像分時畫面F3所對應的第三曝光值大於第二曝光值，且小於或等於第一曝光值。影像組合單元30係能選擇式地疊合形成亮度疊加分時畫面FL，或選擇式地將第一影像分時畫面F1與第三影像分時畫面F3疊合形成改良亮度分時畫面FB。例如，如圖3所示，假定設定亮度門檻值為50時，第一分時畫面F1的亮度約為23，當第一影像分時畫面F1之亮度的兩倍仍低於亮度門檻值時，影像組合單元30將第一影像分時畫面F1與第三影像分時畫面F3疊合形成改良亮度分時畫面FB。在此，是以5x5的像素方格、第三影像分時畫面F3的亮度等於第一影像分時畫面F1、亮度門檻值為50、第一影像分時畫面F1之亮度的兩倍仍低於亮度門檻值為示例，但非用以限制，實際上的操作設定並不限於此。 FIG. 1 is a schematic diagram of a unit of a video stream image quality processing system. FIG. 3 is a schematic diagram of another embodiment of a superimposed time-sharing screen, and FIG. 4 is a schematic diagram of another embodiment of a superimposed time-sharing screen. Referring again to FIG. 1, when the frame detection unit 20 generates and outputs the superimposed signal S1, it also generates a feedback signal F to the image capture module 10. When the image capture module 10 receives the feedback signal F, a third image time-sharing frame F3 is captured and transmitted to the image combining unit 30. The third exposure value corresponding to the third image time-sharing frame F3 is greater than the second exposure value and is less than or equal to the first exposure value. The image combining unit 30 can selectively overlap to form a brightness superimposed time-sharing picture FL, or selectively superimpose a first image time-sharing picture F1 and a third image time-sharing picture F3 to form an improved brightness time-sharing picture FB. For example, as shown in FIG. 3, it is assumed that when the brightness threshold value is set to 50, the brightness of the first time-sharing screen F1 is about 23, and when the brightness of the first image time-sharing picture F1 is still lower than the brightness threshold, The image combining unit 30 superimposes the first image time-sharing picture F1 and the third image time-sharing picture F3 to form an improved brightness time-sharing picture FB. Here, with a 5x5 pixel grid, the brightness of the third image time-sharing screen F3 is equal to the first image time-sharing screen F1, the brightness threshold is 50, and twice the brightness of the first image time-sharing screen F1 is still lower than The brightness threshold value is an example, but it is not a limitation, and the actual operation setting is not limited to this.

更進一步地，如圖4所示，當設定亮度門檻值為70時，第一影像分時畫面F1之亮度的三倍仍低於亮度門檻值時，影像組合單元30將第一影像分時畫面F1、第二影像分時畫面F2及第三影像分時畫面F3疊合形成增強亮度分時畫面FBI。在此，是以5x5的像素方格做為示例、第三影像分時畫面F3的亮度等於第一影像分時畫面F1、亮度門檻值為70、第一影像分時畫面F1之亮度的三倍仍低於亮度門檻值為示例，但非用以限制，實際上並不限於此。實際上也可以採三個與第一影像分時畫面F1的畫面疊 加、亦可以疊加更多個畫面，然而，都需以影像擷取模組10的擷取功能而決定。 Further, as shown in FIG. 4, when the brightness threshold is set to 70, when the three times the brightness of the first image time-sharing screen F1 is still lower than the brightness threshold, the image combining unit 30 divides the first image time-sharing screen. F1, the second image time-sharing picture F2, and the third image time-sharing picture F3 are superimposed to form an enhanced brightness time-sharing picture FBI. Here, a 5x5 pixel grid is taken as an example. The brightness of the third image time-sharing picture F3 is equal to the first image time-sharing picture F1, the brightness threshold is 70, and the brightness of the first image time-sharing picture F1 is three times. It is still below the brightness threshold value as an example, but it is not a limitation, and it is actually not limited to this. In fact, it is also possible to use three frames overlapping with the first image time-sharing frame F1. It is also possible to superimpose more pictures, however, both need to be determined by the capturing function of the image capturing module 10.

圖5為影像串流畫質處理方法一實施例的流程圖。如圖5所示，並同時參照圖1及圖2，影像串流畫質處理方法S100包含步驟S10、步驟S20、步驟S30、步驟41、以及步驟S43。步驟S10是由影像擷取模組10擷取第一影像串流IS1及第二影像串流IS2，第一影像串流IS1包含複數個第一影像分時畫面F1，第一影像分時畫面F1具有相同的第一曝光值。第二影像串流IS2包含複數個第二分時影像畫面F2，第二影像分時畫面F2具有相同的第二曝光值。在同一時刻的第一影像分時畫面F1對應第二影像分時畫面F2，且第一曝光值大於該第二曝光值。 FIG. 5 is a flowchart of an embodiment of a video stream quality processing method. As shown in FIG. 5 and referring to FIG. 1 and FIG. 2 at the same time, the video stream image quality processing method S100 includes step S10, step S20, step S30, step 41, and step S43. Step S10 is capturing the first image stream IS1 and the second image stream IS2 by the image capturing module 10. The first image stream IS1 includes a plurality of first image time-sharing pictures F1, and the first image time-sharing picture F1. Have the same first exposure value. The second image stream IS2 includes a plurality of second time-sharing image frames F2, and the second image time-sharing frame F2 has the same second exposure value. The first image time-sharing picture F1 at the same time corresponds to the second image time-sharing picture F2, and the first exposure value is greater than the second exposure value.

步驟S20是由畫面偵測單元20接收第一影像串流IS1及第一影像串流IS1的第一曝光值，並判斷第一曝光值是否低於曝光門檻值。當判斷為是時，進入步驟S30。步驟S30是由畫面偵測單元20判斷第一影像串流IS1中各第一影像分時畫面F1的第一亮度值是否低於亮度門檻值。當判斷為是時，進入步驟S41畫面偵測單元20產生並輸出疊加信號S1至影像組合單元30，並進入步驟S43。 In step S20, the frame detection unit 20 receives the first exposure value of the first image stream IS1 and the first image stream IS1, and determines whether the first exposure value is lower than the exposure threshold. When it is determined as YES, the process proceeds to step S30. In step S30, the frame detection unit 20 determines whether the first brightness value of each first image time-sharing frame F1 in the first image stream IS1 is lower than a brightness threshold. When the determination is yes, the process proceeds to step S41, and the picture detection unit 20 generates and outputs the superimposed signal S1 to the image combining unit 30, and proceeds to step S43.

步驟S43由影像組合單元30在接收到疊加信號S1後，將所接收到第一影像串流IS1及第二影像串流IS2中對應疊加信號之時刻的第一影像分時畫面F1及第二影像分時畫面F2全部疊合以形成亮度疊加分時畫面FL。 In step S43, after the superimposed signal S1 is received by the image combining unit 30, the first image time-sharing screen F1 and the second image at the time corresponding to the superimposed signal in the received first image stream IS1 and second image stream IS2 are received. The time-sharing pictures F2 are all superimposed to form a brightness superimposed time-sharing picture FL.

進一步地，如圖5所示，影像串流畫質處理方法S100更包含步驟S51、步驟S53、及步驟S60。當步驟S20或步驟S30判斷為否時，進步步驟S51中。步驟S51是由畫面偵測單元20產生並輸出組合信號S1至影像組合單元30，並進入步驟S53。步驟S53是當影像組合單元30收到組 合信號S2時，將對應組合信號S2時刻之第一影像分時畫面F1與第二影像分時畫面F2局部疊合成高動態範圍分時畫面。在此，局部疊合成高動態範圍分時畫面係利用現有技術上各種高動態範圍影像處理的技術來達成。 Further, as shown in FIG. 5, the video stream image quality processing method S100 further includes steps S51, S53, and S60. When it is determined NO at step S20 or step S30, the process proceeds to step S51. In step S51, the frame detection unit 20 generates and outputs a combined signal S1 to the image combining unit 30, and proceeds to step S53. Step S53 is when the image combining unit 30 receives the group When the signal S2 is combined, the first image time-sharing picture F1 and the second image time-sharing picture F2 corresponding to the time of the combined signal S2 are partially superimposed into a high dynamic range time-sharing picture. Here, the local superimposed high dynamic range time-sharing picture is achieved by using various high dynamic range image processing techniques in the prior art.

最後在步驟S43及步驟S53後，進入步驟S60，各時刻經處理後的成高動態範圍分時畫面及亮度疊加分時畫面FL組合成合成影像串流ISP。 Finally, after step S43 and step S53, the process proceeds to step S60, and the processed high dynamic range time-sharing picture and brightness superimposed time-sharing picture FL at each time are combined into a composite image stream ISP.

圖6為影像串流畫質處理方法另一實施例的流程圖。如圖5所示，並同時參照圖1、圖3、以及圖4，影像串流畫質處理方法S200包含步驟S10、步驟S20、步驟S30、步驟S42、步驟S44、步驟S45、步驟S46、步驟S47、步驟S48、步驟S49、步驟S51、步驟S53、及步驟S60。其中步驟S10、步驟S20、步驟S30、步驟S51、步驟S53、及步驟S60與前述的實施方是大致相同，在此不再贅述。 FIG. 6 is a flowchart of another embodiment of a video stream image processing method. As shown in FIG. 5, and referring to FIG. 1, FIG. 3, and FIG. 4 at the same time, the video stream image quality processing method S200 includes steps S10, S20, S30, S42, S44, S45, S46, and steps S47, step S48, step S49, step S51, step S53, and step S60. Step S10, step S20, step S30, step S51, step S53, and step S60 are substantially the same as those in the foregoing embodiment, and details are not described herein again.

在步驟S42中，畫面偵測單元20產生並輸出疊加信號S1時，同時產生回饋信號F至影像擷取模組10。接著先進入步驟S44，畫面偵測單元20判斷第一影像串流IS1中各第一影像分時畫面F1的第一亮度值的兩倍是否低於亮度門檻值。當判斷為否時，進入步驟S45。若判斷為是時，進入步驟S46。在此，是以第一影像分時畫面F1的第一亮度值的兩倍是否低於亮度門檻值僅作為判斷的示例，並不用以限制。 In step S42, when the frame detection unit 20 generates and outputs the superimposed signal S1, it also generates a feedback signal F to the image capture module 10. Then, the process proceeds to step S44. The frame detection unit 20 determines whether the first brightness value of each of the first image time-sharing frames F1 in the first image stream IS1 is lower than a brightness threshold. When the determination is negative, the process proceeds to step S45. If it is determined as YES, the process proceeds to step S46. Here, whether the twice of the first brightness value of the first image time-sharing screen F1 is lower than the brightness threshold value is merely used as an example for judgment, and is not intended to limit.

步驟S45與前述實施例的步驟S43大致相同，在接收到疊加信號S1後，將所接收到第一影像串流IS1及第二影像串流IS2中對應疊加信號S1之時刻的第一影像分時畫面F1及第二影像分時畫面F2全部疊合以形成亮度疊加分時畫面FL。步驟S46，是影像擷取模組10在收到回饋信號F時，擷取第三影像分時畫面F3。 Step S45 is substantially the same as step S43 of the foregoing embodiment. After receiving the superimposed signal S1, the first video stream IS1 and the second video stream IS2 corresponding to the time corresponding to the superimposed signal S1 are time-shared. The picture F1 and the second image time-sharing picture F2 are all superimposed to form a brightness superimposed time-sharing picture FL. In step S46, when the image capture module 10 receives the feedback signal F, it captures a third image time-sharing screen F3.

步驟S47是畫面偵測單元20判斷第一影像串流IS1中各第 一影像分時畫面F1的第一亮度值的三倍是否低於亮度門檻值。當判斷為否時，進入步驟S48、若判斷為否時，進入步驟S49。在此，是以第一影像分時畫面F1的第一亮度值的三倍是否低於亮度門檻值僅作為判斷的示例，並不用以限制。 In step S47, the picture detection unit 20 determines each of the first video stream IS1. Whether three times the first brightness value of an image time-sharing picture F1 is lower than the brightness threshold. When the determination is NO, the process proceeds to step S48, and when the determination is NO, the process proceeds to step S49. Here, whether the three times of the first brightness value of the first image time-sharing screen F1 is lower than the brightness threshold value is merely used as an example for determination, and is not intended to limit.

步驟S48是影像組合單元30將第一影像分時畫面F1、第二影像分時畫面F2、以及第三影像分時畫面F3疊合形成增強亮度分時畫面FBI。步驟S49是影像組合單元30將第一影像分時畫面F1與第三影像分時畫面F3疊合形成改良亮度分時畫面FB。 In step S48, the image combining unit 30 superimposes the first time-sharing picture F1, the second time-sharing picture F2, and the third time-sharing picture F3 to form an enhanced brightness time-sharing picture FBI. In step S49, the image combining unit 30 superimposes the first image time-sharing picture F1 and the third image time-sharing picture F3 to form an improved brightness time-sharing picture FB.

在上述實施例中，在影像串流疊合時，除了能利用高動態範圍的方式，使過亮、過暗的地方能夠互補調整畫質，更能針對受限於影像串流的曝光時間不足，對於畫面亮度過暗之處，透過亮度疊合的方式進行亮度補償。從而，整體物件的解析更為清晰，影像串流能更接近人眼所觀察到的視覺動態範圍。 In the above embodiments, when the image streams are superimposed, in addition to using a high dynamic range method, it is possible to complement the image quality in areas that are too bright or too dark to complement the exposure time that is limited by the image stream. For areas where the brightness of the screen is too dark, the brightness is compensated by overlapping the brightness. As a result, the analysis of the overall object is clearer, and the image stream can be closer to the visual dynamic range observed by the human eye.

雖然已經結合目前被認為是實用的示例性實施例描述了本發明，但是應當理解，本發明不限於所公開的實施例，而是相反，旨在適用於各種修改和等同佈置包括在所附權利要求的精神和範圍內。 Although the invention has been described in connection with exemplary embodiments that are presently considered to be practical, it should be understood that the invention is not limited to the disclosed embodiments, but rather, is intended to be applicable to various modifications and equivalent arrangements included in the appended claims Within the spirit and scope required.

Claims (7)

一種影像串流畫質處理方法，包含：由一影像擷取模組擷取一第一影像串流及一第二影像串流，該第一影像串流包含複數個第一影像分時畫面，該等第一影像分時畫面具有相同的一第一曝光值，該第二影像串流包含複數個第二分時影像畫面，該等第二影像分時畫面具有相同的一第二曝光值，在同一時刻的該第一影像分時畫面對應該第二影像分時畫面，且該第一曝光值大於該第二曝光值；由一畫面偵測單元接收該第一影像串流及該第一影像串流的該第一曝光值，並偵測該第一影像串流的一第一亮度值，當該第一曝光值低於一曝光門檻值，且該第一亮度值低於一亮度門檻值時，產生並輸出一疊加信號；由一影像組合單元接收該第一影像串流、該第二影像串流及該疊加信號，當該影像組合單元接收到該疊加信號時，將對應該疊加信號之時刻的該第一影像分時畫面及該第二影像分時畫面全部疊合以形成一亮度疊加分時畫面；在該畫面偵測單元產生並輸出該疊加信號時，產生一回饋信號至該影像擷取模組；該影像擷取模組收到該回饋信號時，再擷取一第三影像分時畫面，並傳送至該影像組合單元；判斷該第一影像分時畫面的該第一亮度值的兩倍是否低於該亮度門檻值；以及當該影像組合單元判斷該第一影像分時畫面的該第一亮度的兩倍仍低於該亮度門檻值時，將該第一影像分時畫面與該第三影像分時畫面疊合形成一改良亮度分時畫面以取代該亮度疊加分時畫面，其中該第三影像分時畫面所對應的一第三曝光值大於該第二曝光值，且小於或等於該第一曝光值。An image stream quality processing method includes: capturing a first image stream and a second image stream by an image capture module, the first image stream including a plurality of first image time-sharing pictures, The first image time-sharing pictures have the same first exposure value, the second image stream includes a plurality of second time-sharing picture pictures, and the second image time-sharing pictures have the same second exposure value, The first image time-sharing picture at the same time corresponds to the second image time-sharing picture, and the first exposure value is greater than the second exposure value; a frame detection unit receives the first image stream and the first The first exposure value of the image stream, and detecting a first brightness value of the first image stream, when the first exposure value is below an exposure threshold, and the first brightness value is below a brightness threshold When the value is set, an overlay signal is generated and output; an image combining unit receives the first image stream, the second image stream, and the overlay signal. When the image combining unit receives the overlay signal, it will correspond to the overlay. The first image at the moment of the signal The time picture and the second image time-sharing picture are all superimposed to form a brightness superimposed time-sharing picture; when the picture detection unit generates and outputs the superimposed signal, a feedback signal is generated to the image capture module; the image When the capture module receives the feedback signal, it captures a third image time-sharing picture and sends it to the image combination unit; determines whether the first brightness value of the first image time-sharing picture is less than twice The brightness threshold value; and when the image combination unit judges that the first brightness of the first image time-sharing picture is twice lower than the brightness threshold value, the first image time-sharing picture is divided from the third image time-sharing picture The time frame is superimposed to form an improved brightness time-sharing picture to replace the brightness time-sharing picture, wherein a third exposure value corresponding to the third image time-sharing picture is greater than the second exposure value and less than or equal to the first Exposure value. 如請求項1所述之影像串流畫質處理方法，其中該畫面偵測單元在該第一曝光值高於該曝光門檻值，或該第一亮度值高於該亮度門檻值時，產生並輸出一組合信號，當該影像組合單元收到該組合信號時，將對應該組合信號時刻之該第一影像分時畫面與該第二影像分時畫面局部疊合成一高動態範圍分時畫面。The method for processing image stream quality as described in claim 1, wherein the frame detection unit generates and activates when the first exposure value is higher than the exposure threshold value, or the first brightness value is higher than the brightness threshold value. A combined signal is output, and when the image combining unit receives the combined signal, the first image time-sharing picture and the second image time-sharing picture corresponding to the time of the combined signal are partially superimposed into a high dynamic range time-sharing picture. 如請求項2所述之影像串流畫質處理方法，更包含將該高動態範圍分時畫面及該亮度疊加分時畫面成合為一合成影像串流。The method for processing image stream quality as described in claim 2, further comprising combining the high dynamic range time-sharing picture and the brightness superimposed time-sharing picture into a composite image stream. 如請求項1所述之影像串流畫質處理方法，其中該第一曝光值所對應的一第一曝光時間為該第二曝光值所對應之一第二曝光時間的倍數。The method for processing image stream quality according to claim 1, wherein a first exposure time corresponding to the first exposure value is a multiple of a second exposure time corresponding to the second exposure value. 如請求項1所述之影像串流畫質處理方法，其中該曝光門檻值所對應的曝光時間為1/120秒至1/60秒。The method for processing image stream quality according to claim 1, wherein the exposure time corresponding to the exposure threshold is 1/120 second to 1/60 second. 如請求項5所述之影像串流畫質處理方法，其中該亮度門檻值為20至60。The method for processing image stream quality according to claim 5, wherein the brightness threshold is 20 to 60. 如請求項1所述之影像串流畫質處理方法，更包含：判斷該第一影像分時畫面的該第一亮度值的三倍是否低於該亮度門檻值；以及當該影像組合單元判斷該第一影像分時畫面的該第一亮度值的三倍低於該亮度門檻值時，將該第一影像分時畫面、該第二影像分時畫面、以及該第三影像分時畫面疊合形成一增強亮度分時畫面，取代該亮度疊加分時畫面，其中該第三影像分時畫面所對應的一第三曝光值大於該第二曝光值，且小於或等於該第一曝光值。The image stream quality processing method according to claim 1, further comprising: determining whether three times the first brightness value of the first image time-sharing screen is lower than the brightness threshold value; and when the image combination unit determines When three times the first brightness value of the first image time-sharing picture is lower than the brightness threshold, the first image time-sharing picture, the second image time-sharing picture, and the third image time-sharing picture overlap. An enhanced brightness time-sharing picture is combined to replace the brightness superimposed time-sharing picture, wherein a third exposure value corresponding to the third image time-sharing picture is greater than the second exposure value and less than or equal to the first exposure value.
TW106143281A 2017-12-08 2017-12-08 Video stream quality processing method TWI648982B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW106143281A TWI648982B (en) 2017-12-08 2017-12-08 Video stream quality processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW106143281A TWI648982B (en) 2017-12-08 2017-12-08 Video stream quality processing method

Publications (2)

Publication Number Publication Date
TWI648982B true TWI648982B (en) 2019-01-21
TW201926997A TW201926997A (en) 2019-07-01

Family

ID=65803968

Family Applications (1)

Application Number Title Priority Date Filing Date
TW106143281A TWI648982B (en) 2017-12-08 2017-12-08 Video stream quality processing method

Country Status (1)

Country Link
TW (1) TWI648982B (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201216691A (en) * 2010-08-23 2012-04-16 Red Com Inc High dynamic range video
CN102946513A (en) * 2012-11-08 2013-02-27 北京小米科技有限责任公司 Method, device and terminal for starting HDR (high-dynamic range) function of shooting device
TW201533705A (en) * 2014-02-25 2015-09-01 Acer Inc Dynamic exposure adjusting method and electronic apparatus using the same

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW201216691A (en) * 2010-08-23 2012-04-16 Red Com Inc High dynamic range video
CN102946513A (en) * 2012-11-08 2013-02-27 北京小米科技有限责任公司 Method, device and terminal for starting HDR (high-dynamic range) function of shooting device
TW201533705A (en) * 2014-02-25 2015-09-01 Acer Inc Dynamic exposure adjusting method and electronic apparatus using the same

Also Published As

Publication number Publication date
TW201926997A (en) 2019-07-01

Similar Documents

Publication Publication Date Title
TWI526068B (en) Dual image capture processing
US10778881B2 (en) Video signal processing device, video signal processing method, and camera device
JP2010136224A (en) Imaging apparatus and imaging method
JP2009010616A (en) Imaging device and image output control method
JP2022115944A (en) Imaging apparatus
JP2016134862A (en) Imaging device, imaging method, image display device, and program
JP5569617B2 (en) Image processing apparatus and program
JP2008271024A (en) Image processing apparatus and method and program
US20070269133A1 (en) Image-data noise reduction apparatus and method of controlling same
CN109936700B (en) Image series flow image quality processing system and image series flow image quality processing method
TWI648982B (en) Video stream quality processing method
JP7123568B2 (en) IMAGE PROCESSING DEVICE, CONTROL METHOD AND PROGRAM THEREOF
JP2008160620A (en) Image processing apparatus and imaging apparatus
WO2018181612A1 (en) Electronic device
JP2010056796A (en) Image processing apparatus, and program
JP2010213105A (en) Imaging apparatus
JP7442989B2 (en) Imaging device, control method for the imaging device, and program
JP2015080157A (en) Image processing device, image processing method and program
JP6173027B2 (en) Image processing apparatus and image processing method
WO2018181615A1 (en) Electronic device
WO2017208991A1 (en) Image capturing and processing device, electronic instrument, image capturing and processing method, and image capturing and processing device control program
JP2003209850A (en) Signal processing circuit for imaging apparatus and signal processing method thereof
KR20120075693A (en) Camera enhancing image sharpness, enhancement method for camera image and recording medium thereof
JP2019129472A (en) Imaging apparatus
JP7352745B2 (en) Image processing device, imaging device, image processing method, and image processing program