TWI442771B - Method for processing multi-media stream and multi-media stream device with time-shift function - Google Patents
Method for processing multi-media stream and multi-media stream device with time-shift function Download PDFInfo
- Publication number
- TWI442771B TWI442771B TW98100879A TW98100879A TWI442771B TW I442771 B TWI442771 B TW I442771B TW 98100879 A TW98100879 A TW 98100879A TW 98100879 A TW98100879 A TW 98100879A TW I442771 B TWI442771 B TW I442771B
- Authority
- TW
- Taiwan
- Prior art keywords
- data stream
- storage unit
- multimedia
- stream
- data
- Prior art date
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Television Signal Processing For Recording (AREA)
- Closed-Circuit Television Systems (AREA)
Description
本發明是有關於一種應用於多媒體串流裝置的資料處理方法,且特別是有關於一種應用於多媒體串流裝置的資料處理方法及運用此方法之支援時移功能的多媒體串流裝置,使得應用此種串流裝置的監控系統,能連續不間斷地記錄且儲存資料。The present invention relates to a data processing method applied to a multimedia streaming device, and more particularly to a data processing method applied to a multimedia streaming device and a multimedia streaming device supporting the time shift function using the same method, so that the application The monitoring system of such a streaming device can continuously record and store data continuously.
隨著多媒體技術的發展和寬頻網路的普及,多媒體串流技術得到越來越廣泛的應用,例如:網路上的娛樂、新聞、商業應用等,簡言之,藉著多媒體串流技術,用戶端不需要等候龐大檔案完成下載後才收看影像或收聽聲音。With the development of multimedia technology and the popularity of broadband networks, multimedia streaming technology has become more and more widely used, such as entertainment, news, business applications, etc. on the Internet. In short, by means of multimedia streaming technology, users The terminal does not need to wait for a huge file to complete the download before viewing the image or listening to the sound.
另一方面,傳統的監視裝置加上多媒體串流技術產生另一種遠端即時監控系統,以網路攝影機為例,藉著支援網際網路應用的網路攝影機、多媒體串流技術及同時支援網路存取、遠端監控及多媒體串流技術的可攜式電子裝置,使用者可透過該可攜式電子裝置,隨時隨地監視到網路攝影機所擷取到的最新畫面。On the other hand, the traditional monitoring device plus multimedia streaming technology produces another remote real-time monitoring system, taking the network camera as an example, through the network camera, multimedia streaming technology and simultaneous support network supporting the Internet application. The portable electronic device of the road access, remote monitoring and multimedia streaming technology allows the user to monitor the latest images captured by the network camera anytime and anywhere through the portable electronic device.
不論在傳統的監視裝置或者現代的遠端即時監控系統中,為了確保沒有重要資料遺失,連續記錄且儲存資料都是非常重要的,但是現代的遠端即時監控系統中,為了連續記錄且儲存資料,將需要很高的傳輸頻寬傳輸資料,以及大量的記憶體空間儲存資料。Whether in traditional surveillance devices or modern remote monitoring systems, in order to ensure that no important data is lost, continuous recording and storage of data is very important, but in modern remote monitoring systems, in order to continuously record and store data. It will require high transmission bandwidth transmission data and a large amount of memory space to store data.
為了解決此一問題,在一些現在的監控系統中,利用影像分析的方式只有在發生某一事件時才記錄資料且儲存資料,雖然這樣可以大幅的減少儲存的資料空間,但是由於在該事件發生之後,監控系統才開始記錄,因此經常會遺漏重要的資訊。In order to solve this problem, in some current monitoring systems, image analysis is used to record data and store data only when an event occurs, although this can greatly reduce the stored data space, but because of this event After that, the monitoring system begins to record, so important information is often missed.
因此有必要提供一種應用於多媒體串流裝置的資料處理方法及運用此方法之支援時移功能的多媒體串流裝置,讓應用此種串流裝置的監控系統,能連續不間斷地的記錄且儲存資料,以解決上述問題。Therefore, it is necessary to provide a data processing method applied to a multimedia streaming device and a multimedia streaming device supporting the time shift function using the method, so that the monitoring system using the streaming device can continuously record and store continuously. Information to address the above issues.
鑑於上述需求,本發明之目的在於提供一種應用於多媒體串流裝置的資料處理方法及運用此方法之支援時移功能的多媒體串流裝置,以使應用此種串流裝置的監控系統,將能連續不間斷地的記錄且儲存資料。In view of the above needs, an object of the present invention is to provide a data processing method applied to a multimedia streaming device and a multimedia streaming device supporting the time shift function using the method, so that a monitoring system using the streaming device can Record and store data continuously and continuously.
本發明提出一種應用於多媒體串流裝置的資料處理方法,其包括下列步驟:將一多媒體資料編碼成一第一資料串流;利用一儲存單元暫存該第一資料串流;以及將暫存於該儲存單元中的第一資料串流,選擇於一第一起始點或一第二起始點開始輸出。The present invention provides a data processing method applied to a multimedia streaming device, which includes the steps of: encoding a multimedia data into a first data stream; temporarily storing the first data stream using a storage unit; and temporarily storing the data stream; The first data stream in the storage unit is selected to be output at a first starting point or a second starting point.
本發明還提出一種支援時移功能的多媒體串流裝置,其包括;一編碼單元,用以將一多媒體資料編碼成一第一資料串流,並將該第一資料串流複製成一第二資料串流;一儲存單元,用以暫存該第二資料串流;以及一串流處理單元,其電連接至該編碼單元及儲存單元,可用以將該編碼單元送入的第一資料串流輸出,或是將暫存於該儲存單元而延遲一段時間才送入的第二資料串流輸出。The present invention further provides a multimedia streaming device supporting a time shift function, comprising: an encoding unit for encoding a multimedia data into a first data stream and copying the first data stream into a second data stream a storage unit for temporarily storing the second data stream; and a stream processing unit electrically connected to the coding unit and the storage unit, and configured to output the first data stream sent by the coding unit Or outputting a second data stream that is temporarily stored in the storage unit and delayed for a period of time.
另一方面,本發明更提出一種多媒體網路監控系統,其包括:一影像感測器,用以將一光學訊號轉變成一數位訊號;一網路介面;一偵測元件;一多媒體串流裝置,其包括:一編碼單元,用以將該數位訊號編碼成一第一資料串流,並將該第一資料串流複製成一第二資料串流;一儲存單元,用以暫存該第二資料串流;及一串流處理單元,其電連接至該編碼單元及儲存單元,用以透過該網路介面將該編碼單元送入的第一資料串流輸出,或是透過該網路介面將暫存於該儲存單元而延遲一段時間才送入的第二資料串流輸出;以及一資料串流記錄裝置,其根據該偵測元件送入之一觸發命令,儲存該多媒體串流裝置輸出之第一資料串流及第二資料串流。In another aspect, the present invention further provides a multimedia network monitoring system, including: an image sensor for converting an optical signal into a digital signal; a network interface; a detecting component; and a multimedia streaming device The method includes: a coding unit, configured to encode the digital signal into a first data stream, and copy the first data stream into a second data stream; and a storage unit for temporarily storing the second data And a stream processing unit electrically connected to the coding unit and the storage unit for outputting the first data stream sent by the coding unit through the network interface, or through the network interface a second data stream output that is temporarily stored in the storage unit and delayed to be sent for a period of time; and a data stream recording device that stores the output of the multimedia stream device according to a trigger command sent by the detecting component The first data stream and the second data stream.
本發明提出另一種支援時移功能的多媒體串流裝置,其包括:一編碼單元,用以將一多媒體資料編碼成一第一資料串流;一儲存單元,用以暫存該編碼單元送入的該第一資料串流;以及一串流處理單元,其電連接至該編碼單元及儲存單元,用以將暫存於該儲存單元中的第一資料串流,選擇於一第一起始點或一第二起始點開始輸出,進而產生不同程度的時移效果。The present invention provides another multimedia streaming device that supports a time shift function, comprising: an encoding unit for encoding a multimedia data into a first data stream; and a storage unit for temporarily storing the encoding unit The first data stream; and a stream processing unit electrically coupled to the encoding unit and the storage unit for selecting the first data stream temporarily stored in the storage unit to be selected from a first starting point or A second starting point begins to output, which in turn produces different degrees of time shifting effects.
另一方面,本發明更提出一種多媒體網路監控系統,其包括:一影像感測器,用以將一光學訊號轉變成一數位訊號;一網路介面;一偵測元件;一多媒體串流裝置,其包括:一編碼單元,用以將該數位訊號編碼成一第一資料串流;一儲存單元,用以於一段時間內儲存該編碼單元送入的第一資料串流;及一串流處理單元,其電連接儲存單元,用以透過該網路介面分別於一第一時間及一第二時間將該儲存單元的第一資料串流輸出;以及一資料串流記錄裝置,其根據該偵測元件送入之一觸發命令,儲存該多媒體串流裝置輸出之第一資料串流。In another aspect, the present invention further provides a multimedia network monitoring system, including: an image sensor for converting an optical signal into a digital signal; a network interface; a detecting component; and a multimedia streaming device The method includes: a coding unit for encoding the digital signal into a first data stream; a storage unit for storing the first data stream sent by the coding unit for a period of time; and a stream processing The unit is electrically connected to the storage unit for outputting the first data stream of the storage unit at a first time and a second time respectively through the network interface; and a data stream recording device according to the detection The measuring component sends a trigger command to store the first data stream output by the multimedia stream device.
為了使 貴審查委員能更進一步瞭解本發明特徵及技術內容,請參閱以下有關本發明之詳細說明與附圖,然而所附圖式僅提供參考與說明,並非用來對本發明加以限制。The detailed description of the present invention and the accompanying drawings are to be understood by the accompanying claims
本發明揭露一種應用於多媒體串流裝置的資料處理方法及運用此方法之支援時移功能的多媒體串流裝置,應用此種串流裝置的監控系統,將能連續不間斷地記錄且儲存資料。為使本發明之敘述更加詳盡與完備,可參照下列描述並配合相關圖式。The invention discloses a data processing method applied to a multimedia stream device and a multimedia stream device supporting the time shift function using the method. The monitoring system using the stream device can continuously record and store data continuously. In order to make the description of the present invention more detailed and complete, reference is made to the following description and the related drawings.
第1圖為本發明之應用於多媒體串流裝置的資料處理方法的流程圖,如第1圖所示,首先,將多媒體資料編碼成資料串流(步驟S102)。接著,利用儲存單元暫存該資料串流(步驟S104)。最後,可接收遠端指令之請求,而可被選擇於第一起始點或第二起始點,開始輸出暫存之資料串流(步驟S106)。為使本發明之敘述更加詳盡與完備,下文特舉兩個實施例說明運用此方法之支援時移功能的多媒體串流裝置。1 is a flow chart of a data processing method applied to a multimedia stream device of the present invention. As shown in FIG. 1, first, a multimedia material is encoded into a data stream (step S102). Next, the data stream is temporarily stored by the storage unit (step S104). Finally, the request for the remote command can be received, and the first starting point or the second starting point can be selected to start outputting the temporarily stored data stream (step S106). In order to make the description of the present invention more detailed and complete, the following two embodiments are described to illustrate a multimedia streaming device that supports the time shift function using this method.
第2A圖為本發明第一實施例之支援時移功能(time-shift function)的多媒體串流裝置的示意圖。如圖所示,支援時移功能的多媒體串流裝置200包括編碼單元202、先進先出緩衝器204、串流處理單元206及介面單元208。編碼單元202用以將多媒體資料編碼成即時資料串流SD1 ,並將即時資料串流SD1 複製成資料串流SDC ,編碼單元202會將即時資料串流SD1 送到串流處理單元206,並且將資料串流SDC 送入先進先出緩衝器204。送入先進先出緩衝器204的資料串流SDC ,在一段時間T_d 之後,先進先出緩衝器204會依序推出時移資料串流STD1 。在本發明中,串流處理單元206可同時輸出即時資料串流SD1 ,並且於該段時間T_d 之後,輸出時移資料串流STD1 。另外,該段時間T_d 可由外界使用者透過介面單元208來進行輸入設定,使用者也可透過介面單元208輸入需求命令,要求串流處理單元206於第一起始點或第二起始點來輸出時移資料串流。FIG. 2A is a schematic diagram of a multimedia stream device supporting a time-shift function according to the first embodiment of the present invention. As shown, the multimedia streaming device 200 supporting the time shift function includes an encoding unit 202, a first in first out buffer 204, a stream processing unit 206, and an interface unit 208. The encoding unit 202 is configured to encode the multimedia data into the real-time data stream S D1 , and copy the real-time data stream S D1 into the data stream S DC , and the encoding unit 202 sends the real-time data stream S D1 to the stream processing unit. 206, and the data stream S DC is sent to the FIFO buffer 204. The data stream S DC sent to the FIFO buffer 204, after a period of time T_d , the FIFO buffer 204 sequentially pushes the time-shifted data stream ST D1 . In the present invention, the stream processing unit 206 can simultaneously output the real-time data stream S D1 , and after the period of time T _d , output the time-shifted data stream ST D1 . In addition, the time T _d can be input and set by the external user through the interface unit 208, and the user can also input a demand command through the interface unit 208, and request the stream processing unit 206 to be at the first starting point or the second starting point. Output time-shifted data stream.
假設使用者設定該段時間T_d 為20秒,那麼串流處理單元206可同時輸出即時資料串流SD1 並於20秒以後輸出時移資料串流STD1 。從另一角度來看本發明,使用者如設定該段時間T_d 為20秒,那麼在現在這個時間點,串流處理單元206會同時輸出即時資料串流SD1 以及先前已存在先進先出緩衝器204中達到20秒的時移資料串流STD-20 (圖中未顯示)。另外,由於先進先出緩衝器204中儲存了從前20秒到現在的資料串流,因此,使用者如果需要前15秒或者前10秒的資料串流也可以另外透過介面單元208輸入需求命令,要求串流處理單元206輸出。Assuming that the user sets the period of time T_d to 20 seconds, the stream processing unit 206 can simultaneously output the instant data stream S D1 and output the time-shifted data stream ST D1 after 20 seconds. From another point of view, if the user sets the time T _d to 20 seconds, then at this point in time, the stream processing unit 206 simultaneously outputs the instant data stream S D1 and the previously existing FIFO. A time-shifted data stream ST D-20 (not shown) of 20 seconds is reached in the buffer 204. In addition, since the FIFO buffer 204 stores the data stream from the first 20 seconds to the present, the user may additionally input the demand command through the interface unit 208 if the data stream of the first 15 seconds or the first 10 seconds is required. The stream processing unit 206 is required to output.
而由於先進先出緩衝器204可儲存的資料串流量是有限的,因此,在資料串流存入先進先出緩衝器204前,判斷先進先出緩衝器204是否已存滿,當先進先出緩衝器204已存滿時,捨棄最先存之資料,再將資料串流存入,進而可持續保持前20秒之影像資料串流。換句話說,由於緩衝器容量可支援之該段時間T_d 也是有限的,例如緩衝器容量最多可支援到20秒的資料串流量,即使外界使用者設定該段時間T_d 為30秒,還是只能看到20秒前的影像畫面。Since the data stream that can be stored by the FIFO buffer 204 is limited, it is determined whether the FIFO buffer 204 is full before the data stream is stored in the FIFO buffer 204, when the first in first out buffer When the buffer 204 is full, the first stored data is discarded, and the data stream is stored, so that the image data stream of the first 20 seconds can be continuously maintained. In other words, since the buffer capacity of the supports of the period of time T_ d it is limited, for example, the buffer capacity to support up to 20 seconds streamed data, even outside the time period set by the user T_ d 30 seconds, or Only the image screen 20 seconds ago can be seen.
另外,在本發明可用其如隨機存取記憶體、快閃記憶體或者硬碟等有類似功能的儲存裝置來暫存資料串流,如果儲存裝置可以儲存的空間越大,那麼可支援之該段時間T_d 將可以越長。In addition, the present invention can temporarily store data streams by using a storage device having similar functions such as random access memory, flash memory or hard disk. If the storage device can store more space, then the support can be supported. period of time will be longer T_ d.
第2B圖為本發明第一實施例之應用於多媒體串流裝置的資料處理方法的流程圖。請配合第2A圖來進行了解,本發明之應用於多媒體串流裝置200的資料處理方法包括下列步驟:首先,編碼單元202將多媒體資料編碼成即時資料串流SD1 (步驟S250)。接著,編碼單元202將即時資料串流SD1 複製成資料串流SDC (步驟S252)。將即時資料串流SD1 送入串流處理單元206,由串流處理單元206直接輸出(步驟S254)。將資料串流SDC 送入先進先出緩衝器204暫存(步驟S256)。最後,於該段時間後,串流處理單元輸出暫存於先進先出緩衝器中之時移資料串流STD1 (步驟S258)。FIG. 2B is a flowchart of a data processing method applied to a multimedia stream device according to the first embodiment of the present invention. Please refer to FIG. 2A for understanding. The data processing method applied to the multimedia stream device 200 of the present invention includes the following steps: First, the encoding unit 202 encodes the multimedia material into the real-time data stream S D1 (step S250). Next, the encoding unit 202 copies the real-time data stream S D1 into the data stream S DC (step S252). The real-time data stream S D1 is sent to the stream processing unit 206, and is directly output by the stream processing unit 206 (step S254). The data stream S DC is sent to the FIFO buffer 204 for temporary storage (step S256). Finally, after the period of time, the stream processing unit outputs the time-shifted data stream ST D1 temporarily stored in the FIFO buffer (step S258).
本發明第一實施例之多媒體串流裝置可應用於多種多媒體網路監控系統中,下文將以將本發明第一實施例之多媒體串流裝置應用於網路攝影機中為例進行說明。第3圖為本發明第一實施例之網路攝影機的示意圖,如圖所示,網路攝影機300包括:編碼單元302、先進先出緩衝器304、串流處理單元306、區域網路介面308及偵測元件(圖中未顯示)、影像感測器310及鏡頭312。鏡頭312及影像感測器310用以將光學訊號轉變成數位影像訊號,編碼單元302將數位影像訊號編碼成即時資料串流SD1 ,即時資料串流SD1 為適合被串流處理單元306經由區域網路介面308傳輸到網路上的格式,因此本發明之網路攝影機300便具備提供數位動態影像傳輸的功能。The multimedia streaming device of the first embodiment of the present invention can be applied to a plurality of multimedia network monitoring systems. The following will be described by taking the multimedia streaming device of the first embodiment of the present invention as a network camera. 3 is a schematic diagram of a network camera according to a first embodiment of the present invention. As shown, the network camera 300 includes an encoding unit 302, a first in first out buffer 304, a stream processing unit 306, and a regional network interface 308. And a detecting component (not shown), an image sensor 310, and a lens 312. The lens 312 and the image sensor 310 are configured to convert the optical signal into a digital image signal, and the encoding unit 302 encodes the digital image signal into the real-time data stream S D1 , and the real-time data stream S D1 is adapted to be processed by the stream processing unit 306 . The area network interface 308 is transmitted to the format on the network, so the network camera 300 of the present invention has the function of providing digital motion picture transmission.
編碼單元302除了將數位影像訊號編碼成即時資料串流SD1 外,並將即時資料串流SD1 複製成資料串流SDC ,編碼單元302將即時資料串流SD1 直接送入串流處理單元306,並將資料串流SDC 送入先進先出緩衝器304。送入先進先出緩衝器304的資料串流SDC ,在該段時間T_d 之後,先進先出緩衝器304會依續推出時移資料串流STD1 。在本發明中,串流處理單元306可同時透過區域網路介面308輸出即時資料串流SD1 ,並且於該段時間T_d 之後,輸出時移資料串流STD1 。In addition to encoding the digital video signal into the real-time data stream S D1 , the encoding unit 302 copies the real-time data stream S D1 into the data stream S DC , and the encoding unit 302 directly sends the real-time data stream S D1 into the stream processing. Unit 306 sends the data stream S DC to the FIFO buffer 304. The data stream S DC is sent to the FIFO buffer 304. After the period of time T_d , the FIFO buffer 304 successively pushes the time-shifted data stream ST D1 . In the present invention, the stream processing unit 306 can simultaneously output the real-time data stream S D1 through the area network interface 308, and output the time-shifted data stream ST D1 after the period of time T_d .
另外,網路攝影機可透過路由器330連至安裝有錄影軟體之個人電腦320、支援網路攝影機之網路磁碟機(下文簡稱NAS)322或者網路影像錄影主機(Network Video Recorder,下文簡稱NVR)324等電子裝置以錄影,經由這些配置於同一個區域網路內的電子裝置來達成近端監控的功能。此外,網路攝影機可透過路由器330連上網際網路340,並和遠端之個人電腦350、手機352、個人數位助理354或者接收盒356等遠端電子裝置互相通訊,使用者可透過這些遠端電子裝置開啟網路攝影機300以進行遠端監控,並利用這些遠端電子裝置錄影。In addition, the network camera can be connected to the personal computer 320 with the video software installed through the router 330, the network disk drive (hereinafter referred to as NAS) 322 supporting the network camera or the network video recording host (Network Video Recorder, hereinafter referred to as NVR). The electronic device such as 324 realizes the function of near-end monitoring through video recording via these electronic devices arranged in the same regional network. In addition, the network camera can connect to the Internet 340 through the router 330, and communicate with remote electronic devices such as the remote personal computer 350, the mobile phone 352, the personal digital assistant 354 or the receiving box 356. The end electronic device turns on the webcam 300 for remote monitoring and uses these remote electronic devices to record.
在本發明中,該段時間T_d 可由使用者透過上述電子裝置設定,舉例來說,使用者設定該段時間T_d 為20秒,那麼串流處理單元306可同時輸出即時資料串流SD1 並於20秒以後輸出時移資料串流STD1 。從另一角度來看本發明,使用者如設定該段時間T_d 為20秒,那麼在現在這個時間點,串流處理單元306會同時輸出即時資料串流SD1 以及先前已存在先進先出緩衝器304中達到20秒的時移資料串流STD_20 。另外,由於先進先出緩衝器304中儲存了從前20秒到現在的資料串流,因此,使用者如果需要前15秒或者前10秒的資料串流,也可透過上述電子裝置設定輸入需求命令,要求串流處理單元306提前輸出時移資料串流。In the present invention, the time T_d can be set by the user through the electronic device. For example, if the user sets the time T_d to 20 seconds, the stream processing unit 306 can simultaneously output the instant data stream S D1. And after 20 seconds, the time shift data stream ST D1 is output. From another point of view, if the user sets the time T _d to 20 seconds, then at this point in time, the stream processing unit 306 simultaneously outputs the instant data stream S D1 and the previously existing first in first out. A time-shifted data stream ST D_20 of 20 seconds is reached in the buffer 304. In addition, since the FIFO buffer 304 stores the data stream from the first 20 seconds to the present, if the user needs the data stream of the first 15 seconds or the first 10 seconds, the input demand command can also be set through the above electronic device. The stream processing unit 306 is required to output the time-shifted data stream in advance.
另外,本發明之網路攝影機300中的偵測元件可為內建之事件偵測器(圖中未顯示)以因應一些特殊事件及特別需求,例如防破壞偵測器可偵測攝影機遭受破壞(噴漆、遮擋等),移動偵測器可偵測指定禁區的不正常騷動,被動式紅外線偵測器可偵測附近有生物靠近,甚至於智慧型分析可以做精密及複雜的影像處理以過濾出人眼無法分辨或需大量人力才可做到的事,例如建築物進出口出入人數計算,交通規則違規,禁區之可疑人物逗留等等。除此之外,本發明之網路攝影機300中的偵測元件可為外接之感測器(圖中未顯示),如熱感測器可偵測火災,電磁感測器可偵測門窗的一些闖入行為。透過這些各種不同內建或外接的偵測元件。藉由偵測元件,本發明之網路攝影機300可即時偵測各種事件的觸發,並利用安裝有錄影軟體之個人電腦320、NAS 322、NVR 324、個人電腦350、手機352、個人數位助理354或者接收盒356等電子裝置錄影達到有效監控的目的。In addition, the detecting component in the network camera 300 of the present invention may be a built-in event detector (not shown) to detect camera damage caused by special events and special needs, such as a vandal-proof detector. (painting, occlusion, etc.), the motion detector can detect abnormal turbulence in the designated restricted area, the passive infrared detector can detect nearby creatures close, and even intelligent analysis can do sophisticated and complex image processing to filter out Things that the human eye can't distinguish or require a lot of manpower to do, such as the calculation of the number of entrances and exits of buildings, the violation of traffic rules, the stay of suspicious people in the restricted area, and so on. In addition, the detecting component in the network camera 300 of the present invention may be an external sensor (not shown), such as a thermal sensor that can detect a fire, and an electromagnetic sensor that can detect a door or a window. Some intrusive behavior. Through these various built-in or external detection components. By detecting the component, the network camera 300 of the present invention can instantly detect the triggering of various events, and utilizes the personal computer 320, the NAS 322, the NVR 324, the personal computer 350, the mobile phone 352, and the personal digital assistant 354 equipped with the video software. Or the electronic device such as the receiving box 356 is recorded for effective monitoring.
第4A圖為本發明第二實施例之支援時移功能(time-shift function)的多媒體串流裝置的示意圖。如圖所示,支援時移功能的多媒體串流裝置400包括編碼單元402、先進先出緩衝器404、串流處理單元406及介面單元408。編碼單元402用以將多媒體資料編碼成資料串流SDC ,編碼單元402會將資料串流SDC 送入先進先出緩衝器404。串流處理單元406可將送入先進先出緩衝器404的資料串流SDC 立即依序讀出如圖中的即時資料串流SD1 ,同時串流處理單元406也可在該段時間T_d 之後,將送入先進先出緩衝器404的資料串流SDC 依序讀出如圖中的時移資料串流STD1 。在本發明中,串流處理單元406可同時輸出即時資料串流SD1 ,也可透過介面單元408來接收遠端指令之請求,而選擇讀出暫存於先進先出緩衝器404中該段時間T_d 前存入之時移資料串流STD1 。也就是說,該段時間T_d 可由外界使用者透過介面單元408來進行輸入設定,如此一來,使用者也可透過介面單元408輸入需求命令,要求串流處理單元406改變讀出時移資料串流之時間點。4A is a schematic diagram of a multimedia stream device supporting a time-shift function according to a second embodiment of the present invention. As shown, the multimedia streaming device 400 supporting the time shift function includes an encoding unit 402, a first in first out buffer 404, a stream processing unit 406, and an interface unit 408. The encoding unit 402 is configured to encode the multimedia data into the data stream S DC , and the encoding unit 402 sends the data stream S DC to the first in first out buffer 404 . The stream processing unit 406 can immediately read the data stream S DC sent to the FIFO buffer 404 to the instant data stream S D1 in the figure, and the stream processing unit 406 can also be in the time T_. After d , the data stream S DC sent to the FIFO buffer 404 sequentially reads out the time-shifted data stream ST D1 as shown in the figure. In the present invention, the stream processing unit 406 can simultaneously output the instant data stream S D1 , and can also receive the request of the remote command through the interface unit 408 , and select to read the segment temporarily stored in the first in first out buffer 404 . when deposited before d time T_ shift data stream ST D1. That is, the period of time T_ d may be input outside a user set 408 via the interface unit, so that users can enter through the interface unit 408 demands a command, required shift change stream data processing unit 406 is read out The point in time of the stream.
假設使用者設定該段時間T_d 為20秒,那麼串流處理單元406可同時輸出即時資料串流SD1 並於20秒以後輸出時移資料串流STD1 。從另一角度來看本發明,使用者如設定該段時間T_d 為20秒,那麼在現在這個時間點,串流處理單元406會同時處理即時資料串流SD1 以及先前已存在先進先出緩衝器404中達到20秒的時移資料串流STD-20 (圖中未顯示)。另外,由於先進先出緩衝器404中儲存了從前20秒到現在的資料串流,因此,使用者如果需要前15秒或者前10秒的資料串流也可以另外透過介面單元408輸入需求命令,要求串流處理單元406向先進先出緩衝器404進行讀取。Assuming that the user sets the period of time T_d to 20 seconds, the stream processing unit 406 can simultaneously output the instant data stream S D1 and output the time-shifted data stream ST D1 after 20 seconds. From another point of view, if the user sets the time T _d to 20 seconds, then at this point in time, the stream processing unit 406 processes the instant data stream S D1 and the previously existing FIFO. A time-shifted data stream ST D-20 (not shown) of up to 20 seconds in the buffer 404. In addition, since the FIFO buffer 404 stores the data stream from the first 20 seconds to the present, the user may additionally input the demand command through the interface unit 408 if the data stream of the first 15 seconds or the first 10 seconds is required. The stream processing unit 406 is required to read from the first in first out buffer 404.
另外,在本發明的另一實施例中,假設先進先出緩衝器404可儲存的資料串流量是有限的,因此,在資料串流量在存入先進先出緩衝器404前,判斷先進先出緩衝器404是否已存滿,當先進先出緩衝器404已存滿時,捨棄最先存之資料,再將資料串流存入,進而可持續保持前20秒之影像資料串流。換句話說,由於緩衝器容量可支援之該段時間T_d 也是有限的,例如緩衝器容量最多可支援到20秒的資料串流量,即使外界使用者設定該段時間T_d 為30秒,還是只能看到20秒前的影像畫面。In addition, in another embodiment of the present invention, it is assumed that the data stream that can be stored by the FIFO buffer 404 is limited. Therefore, before the data stream is stored in the FIFO buffer 404, the first in first out is judged. Whether the buffer 404 is full or not, when the FIFO buffer 404 is full, the first stored data is discarded, and the data stream is stored, so that the image data stream of the first 20 seconds can be continuously maintained. In other words, since the buffer capacity can support the period of time T _d is also limited, for example, the buffer capacity can support up to 20 seconds of data stream traffic, even if the external user sets the time T _d to 30 seconds, Only the image screen 20 seconds ago can be seen.
另外,可用其如隨機存取記憶體、快閃記憶體或者硬碟等有類似功能的儲存裝置來暫存資料串流,如果儲存裝置可以儲存的空間越大,那麼可支援的該段時間T_d 將可以越長。In addition, the data stream can be temporarily stored by a storage device having a similar function such as a random access memory, a flash memory or a hard disk. If the storage device can store more space, the time T can be supported. _d will be longer.
第4B圖為本發明第二實施例之應用於多媒體串流裝置的資料處理方法的流程圖。請參看第4A圖,本發明之應用於多媒體串流裝置400的資料處理方法包括下列步驟:首先,編碼單元402將多媒體資料編碼成資料串流SDC (步驟S450)。將資料串流SDC 送入先進先出緩衝器404,並暫存於先進先出緩衝器404(步驟S452)。接著,串流處理單元406分別於立即及該段時間T_d 之後輸出由先進先出緩衝器404暫存之資料串流(步驟S454)。FIG. 4B is a flowchart of a data processing method applied to a multimedia stream device according to a second embodiment of the present invention. Referring to FIG. 4A, the data processing method applied to the multimedia stream device 400 of the present invention includes the following steps: First, the encoding unit 402 encodes the multimedia material into the data stream S DC (step S450). The data stream S DC is sent to the FIFO buffer 404 and temporarily stored in the FIFO buffer 404 (step S452). Next, the stream processing unit 406 outputs the data stream temporarily stored by the FIFO buffer 404 immediately after the period of time T_d (step S454).
在本發明中,串流處理單元406控制先進先出緩衝器404暫存之資料串流的輸出時間可由使用者設定,在此實施例,假設使用者設定之兩個資料串流的輸出時間之差異值,即該段時間T_d 為20秒,那麼串流處理單元406可同時輸出即時資料串流SD1 並於20秒以後輸出時移資料串流STD1 。從另一角度來看本發明,使用者如設定該段時間T_d 為20秒,那麼在現在這個時間點,串流處理單元406會同時輸出即時資料串流SD1 以及先前已存在先進先出緩衝器404中達到20秒的時移資料串流STD-20 (圖中未顯示)。另外,由於先進先出緩衝器404中儲存了從前20秒到現在的資料串流,因此,使用者如果需要前15秒或者前10秒的資料串流也可以另外透過介面單元408輸入需求命令,要求串流處理單元406輸出。In the present invention, the output time of the data stream temporarily stored by the stream processing unit 406 for controlling the FIFO buffer 404 can be set by the user. In this embodiment, it is assumed that the output time of the two data streams set by the user is difference value, i.e., the period of time T_ d is 20 seconds, the streaming processing unit 406 can output data stream S D1 and immediate shift in the output data stream ST D1 after 20 seconds. From another point of view, if the user sets the time T _d to 20 seconds, then at this point in time, the stream processing unit 406 simultaneously outputs the instant data stream S D1 and the previously existing first in first out. A time-shifted data stream ST D-20 (not shown) of up to 20 seconds in the buffer 404. In addition, since the FIFO buffer 404 stores the data stream from the first 20 seconds to the present, the user may additionally input the demand command through the interface unit 408 if the data stream of the first 15 seconds or the first 10 seconds is required. The stream processing unit 406 is required to output.
另外本發明第二實施例之多媒體串流裝置可應用於多種多媒體網路監控系統中,下文將以將本發明第二實施例之多媒體串流裝置應用於網路攝影機中為例進行說明。第5圖為本發明第二實施例之網路攝影機的示意圖,如圖所示,網路攝影機500包括:編碼單元502、先進先出緩衝器504、串流處理單元506、區域網路介面508及偵測元件(圖中未顯示)、影像感測器510及鏡頭512。鏡頭512及影像感測器510用以將光學訊號轉變成數位影像訊號,編碼單元502將數位影像訊號編碼成資料串流SDC ,資料串流SDC 為適合被串流處理單元506經由區域網路介面508傳輸到網路上的格式,因此本發明之網路攝影機500便具備提供數位動態影像傳輸的功能。In addition, the multimedia stream device of the second embodiment of the present invention can be applied to a plurality of multimedia network monitoring systems. Hereinafter, the multimedia stream device of the second embodiment of the present invention will be applied to a network camera as an example. 5 is a schematic diagram of a network camera according to a second embodiment of the present invention. As shown, the network camera 500 includes an encoding unit 502, a first in first out buffer 504, a stream processing unit 506, and a regional network interface 508. And a detecting component (not shown), an image sensor 510, and a lens 512. The lens 512 and the image sensor 510 are configured to convert the optical signal into a digital image signal, and the encoding unit 502 encodes the digital image signal into the data stream S DC , and the data stream S DC is suitable for being streamed by the stream processing unit 506 via the area network. The interface 508 is transmitted to the format on the network, so the network camera 500 of the present invention has the function of providing digital video transmission.
編碼單元502除了將數位影像訊號編碼成資料串流SDC 外,並將資料串流SDC 直接送入先進先出緩衝器504。串流處理單元506可將送入先進先出緩衝器504的資料串流SDC 立即依序讀出如圖中的即時資料串流SD1 ,同時送入先進先出緩衝器504的資料串流SDC ,在該段時間T_d 之後,先進先出緩衝器504會依續推出時移資料串流STD1 。在本發明中,串流處理單元506可同時透過區域網路介面508輸出即時資料串流SD1 ,並且於該段時間T_d 之後,輸出時移資料串流STD1 。The encoding unit 502 encodes the digital video signal into the data stream S DC and directly feeds the data stream S DC into the FIFO buffer 504. The stream processing unit 506 can immediately read the data stream S DC sent to the FIFO buffer 504 to sequentially read the real-time data stream S D1 in the figure and simultaneously feed the data stream into the FIFO buffer 504. S DC , after the period of time T _d , the FIFO buffer 504 will continue to push the time-shifted data stream ST D1 . In the present invention, the stream processing unit 506 can simultaneously output the real-time data stream S D1 through the area network interface 508, and after the period of time T_d , output the time-shifted data stream ST D1 .
另外,網路攝影機可透過路由器530連至安裝有錄影軟體之個人電腦520、支援網路攝影機之網路磁碟機(下文簡稱NAS)522或者網路影像錄影主機(Network Video Recorder,下文簡稱NVR)524等電子裝置以錄影,經由這些配置於同一個區域網路內的電子裝置來達成近端監控的功能。此外,網路攝影機可透過路由器530連上網際網路540,並和遠端之個人電腦550、手機552、個人數位助理554或者接收盒556等遠端電子裝置互相通訊,使用者可透過這些遠端電子裝置開啟網路攝影機500以進行遠端監控,並利用這些遠端電子裝置錄影。In addition, the network camera can be connected to the personal computer 520 with the video software installed through the router 530, the network disk drive (hereinafter referred to as NAS) 522 supporting the network camera or the network video recording host (Network Video Recorder, hereinafter referred to as NVR). The electronic device such as 524 realizes the function of near-end monitoring through video recording via these electronic devices arranged in the same regional network. In addition, the network camera can connect to the Internet 540 through the router 530, and communicate with remote electronic devices such as the remote personal computer 550, the mobile phone 552, the personal digital assistant 554 or the receiving box 556. The end electronic device turns on the webcam 500 for remote monitoring and uses these remote electronic devices to record.
在本發明中,該段時間T_d 可由使用者透過上述電子裝置設定,舉例來說,使用者設定該段時間T_d 為20秒,那麼串流處理單元506可同時輸出即時資料串流SD1 並於20秒以後輸出時移資料串流STD1 。從另一角度來看本發明,使用者如設定該段時間T_d 為20秒,那麼在現在這個時間點,串流處理單元506會同時輸出即時資料串流SD1 以及先前已存在先進先出緩衝器504中達到20秒的時移資料串流STD-20 。另外,由於先進先出緩衝器504中儲存了從前20秒到現在的資料串流,因此,使用者如果需要前15秒或者前10秒的資料串流,也可透過上述電子裝置設定輸入需求命令,要求串流處理單元506提前輸出時移資料串流。In the present invention, the time T_d can be set by the user through the electronic device. For example, if the user sets the time T_d to 20 seconds, the stream processing unit 506 can simultaneously output the instant data stream S D1. And after 20 seconds, the time shift data stream ST D1 is output. From another point of view, if the user sets the time T _d to 20 seconds, then at this point in time, the stream processing unit 506 simultaneously outputs the instant data stream S D1 and the previously existing FIFO. A time-shifted data stream ST D-20 of 20 seconds is reached in the buffer 504. In addition, since the FIFO buffer 504 stores the data stream from the first 20 seconds to the present, if the user needs the data stream of the first 15 seconds or the first 10 seconds, the input demand command can also be set through the above electronic device. The stream processing unit 506 is required to output the time-shifted data stream in advance.
另外,本發明之網路攝影機500中的偵測元件可為內建之事件偵測器(圖中未顯示)以因應一些特殊事件及特別需求,例如防破壞偵測器可偵測攝影機遭受破壞(噴漆、遮擋等),移動偵測器可偵測指定禁區的不正常騷動,被動式紅外線偵測器可偵測附近有生物靠近,甚至於智慧型分析可以做精密及複雜的影像處理以過濾出人眼無法分辨或需大量人力才可做到的事,例如建築物進出口出入人數計算,交通規則違規,禁區之可疑人物逗留等等。除此之外,本發明之網路攝影機500中的偵測元件可為外接之感測器(圖中未顯示),如熱感測器可偵測火災,電磁感測器可偵測門窗的一些闖入行為。透過這些各種不同內建或外接的偵測元件。藉由偵測元件,本發明之網路攝影機500可即時偵測各種事件的觸發,並利用安裝有錄影軟體之個人電腦520、NAS 522、NVR 524、個人電腦550、手機552、個人數位助理554或者接收盒556等電子裝置錄影達到有效監控的目的。In addition, the detecting component in the network camera 500 of the present invention may be a built-in event detector (not shown) to detect camera damage caused by special events and special needs, such as a vandal-proof detector. (painting, occlusion, etc.), the motion detector can detect abnormal turbulence in the designated restricted area, the passive infrared detector can detect nearby creatures close, and even intelligent analysis can do sophisticated and complex image processing to filter out Things that the human eye can't distinguish or require a lot of manpower to do, such as the calculation of the number of entrances and exits of buildings, the violation of traffic rules, the stay of suspicious people in the restricted area, and so on. In addition, the detecting component in the network camera 500 of the present invention may be an external sensor (not shown), such as a thermal sensor capable of detecting a fire, and an electromagnetic sensor capable of detecting a door and a window. Some intrusive behavior. Through these various built-in or external detection components. By detecting the component, the network camera 500 of the present invention can instantly detect the triggering of various events, and utilizes the personal computer 520, the NAS 522, the NVR 524, the personal computer 550, the mobile phone 552, and the personal digital assistant 554 equipped with the video software. Or the electronic device such as the receiving box 556 is recorded for effective monitoring.
綜上所述,本發明之一種支援時移功能的多媒體串流裝置及應用於其中的資料處理方法,將使得應用此種串流裝置的監控系統,將能連續不間斷地的記錄且儲存資料,達成本發明的目的。In summary, the multimedia streaming device supporting the time shift function of the present invention and the data processing method applied thereto can enable the monitoring system using the streaming device to continuously record and store data continuously. The object of the invention is achieved.
雖然本發明已以較佳實施例揭露如上,然其並非用以限定本發明,任何熟習此技藝者,在不脫離本發明之精神和範圍內,當可作些許之更動與潤飾,因此本發明之保護範圍當視後附之申請專利範圍所界定者為準。While the present invention has been described in its preferred embodiments, the present invention is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.
本案圖式中所包含之各元件列示如下:The components included in the diagram of this case are listed as follows:
200、400‧‧‧多媒體串流裝置200,400‧‧‧Multimedia streaming device
202、302、402、502‧‧‧編碼單元202, 302, 402, 502‧‧ ‧ coding unit
204、304、404、504‧‧‧先進先出緩衝器204, 304, 404, 504‧‧‧ FIFO buffer
206、306、406、506‧‧‧串流處理單元206, 306, 406, 506‧‧‧ stream processing unit
300、500‧‧‧網路攝影機300, 500‧‧‧ webcams
308、508‧‧‧區域網路介面308, 508‧‧‧Local Network Interface
310、510‧‧‧影像感測器310, 510‧‧‧ image sensor
312、512‧‧‧鏡頭312, 512‧‧‧ lens
320、520‧‧‧個人電腦320, 520‧‧‧ PC
322、522‧‧‧網路磁碟機322, 522‧‧‧ network drive
324、524‧‧‧網路影像錄影主機324, 524‧‧‧ network video recording host
330、530‧‧‧路由器330, 530‧‧‧ router
340、540‧‧‧網際網路340, 540‧‧‧ Internet
350、550‧‧‧個人電腦350, 550‧ ‧ personal computer
352、552‧‧‧手機352, 552‧‧‧ mobile phones
354、554‧‧‧個人數位助理354, 554‧ ‧ personal digital assistant
356、556‧‧‧接收盒356, 556‧‧‧ receiving box
208、408‧‧‧介面單元208, 408‧‧ interface unit
SDC 、SD1 、STD1 ‧‧‧資料串流S DC , S D1 , ST D1 ‧‧‧ data stream
本案得藉由下列圖式及說明,俾得一更深入之了解:第1圖為本發明之應用於多媒體串流裝置的資料處理方法的流程圖。The present invention can be further understood by the following figures and descriptions: FIG. 1 is a flow chart of a data processing method applied to a multimedia stream device according to the present invention.
第2A圖為本發明第一實施例之支援時移功能的多媒體串流裝置的示意圖。FIG. 2A is a schematic diagram of a multimedia streaming device supporting a time shift function according to a first embodiment of the present invention.
第2B圖為本發明第一實施例之應用於多媒體串流裝置的資料處理方法的流程圖。FIG. 2B is a flowchart of a data processing method applied to a multimedia stream device according to the first embodiment of the present invention.
第3圖為本發明第一實施例之網路攝影機的示意圖。Fig. 3 is a schematic view showing a network camera of the first embodiment of the present invention.
第4A圖為本發明第二實施例之支援時移功能的多媒體串流裝置的示意圖。4A is a schematic diagram of a multimedia streaming device supporting a time shift function according to a second embodiment of the present invention.
第4B圖為本發明第二實施例之應用於多媒體串流裝置的資料處理方法的流程圖。FIG. 4B is a flowchart of a data processing method applied to a multimedia stream device according to a second embodiment of the present invention.
第5圖為本發明第二實施例之網路攝影機的示意圖。Fig. 5 is a schematic view showing a network camera of a second embodiment of the present invention.
Claims (32)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW98100879A TWI442771B (en) | 2009-01-10 | 2009-01-10 | Method for processing multi-media stream and multi-media stream device with time-shift function |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW98100879A TWI442771B (en) | 2009-01-10 | 2009-01-10 | Method for processing multi-media stream and multi-media stream device with time-shift function |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201027998A TW201027998A (en) | 2010-07-16 |
TWI442771B true TWI442771B (en) | 2014-06-21 |
Family
ID=44853377
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW98100879A TWI442771B (en) | 2009-01-10 | 2009-01-10 | Method for processing multi-media stream and multi-media stream device with time-shift function |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI442771B (en) |
-
2009
- 2009-01-10 TW TW98100879A patent/TWI442771B/en active
Also Published As
Publication number | Publication date |
---|---|
TW201027998A (en) | 2010-07-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9819973B2 (en) | Embedded appliance for multimedia capture | |
US8780199B2 (en) | Networked security camera with local storage and continuous recording loop | |
KR101220884B1 (en) | Multi-conrol system using smart phone | |
KR20040106964A (en) | Real time moving picture remote guard controling system | |
US11350161B2 (en) | Digital video recorder with additional video inputs over a packet link | |
US11272243B2 (en) | Cloud recording system, cloud recording server and cloud recording method | |
US20110161515A1 (en) | Multimedia stream recording method and program product and device for implementing the same | |
TWI442771B (en) | Method for processing multi-media stream and multi-media stream device with time-shift function | |
KR101837980B1 (en) | Total image transmission and using system having different kinds of image providing apparatus and control method of the same | |
WO2019076155A1 (en) | Data transmission method, camera and electronic device | |
JP2004349743A (en) | Video stream switching system, method, and video image monitoring and video image distribution system including video stream switching system | |
AU2019204751B2 (en) | Embedded appliance for multimedia capture | |
JP2019068187A (en) | Information processing apparatus, control method thereof, and program | |
CN108881810A (en) | The method of transmitting audio-video stream | |
KR100466790B1 (en) | integerated DVR system | |
TW201442520A (en) | Real-time monitoring system for integrating IP sharing device and audio and video processing server | |
CA2914803C (en) | Embedded appliance for multimedia capture | |
JP2005006002A (en) | Camera photographing system | |
KR20050075834A (en) | Recording apparatus and method thereof in dvr system | |
KR20050122382A (en) | Method and apparatus for addressing internet back-up information in dvr | |
AU2013254937A1 (en) | Embedded Appliance for Multimedia Capture | |
AU2012202843A1 (en) | Embedded appliance for multimedia capture |