201242349 六、發明說明： 【發明所屬之技術領域】 本發明係有關於一種使包含攝影機拍攝監視對象之 複數個影像圖框的影像資料、與包含從監視對象依時間序 列取得之複數個數值資料的過程資料進行同步顯示之資料 同步再生裝置、資料同步再生方法及資料同步控制程式。 【先前技術】 作為資料同步再生裝置，例如在工廠發生異常時，藉 由在工廠監視用監視器顯示異常發生時之工廠的數值資料 與影像圖框，並且在記憶裝置中將其數值資料與影像圖框 儲存作為另一個檔案，且在為了追究明暸異常而展開履歷 資訊畫面時，同時的顯示該異常發生時的數值資料與影像 圖框，而進行細腻之工廠監視的先前技術已有人提案（例 如，參考專利文獻1)。 (先前技術文獻） (專利文獻） 專利文獻1:日本特開平5-34181號公報。 【發明内容】 (發明欲解決的課題） 但是，在前述專利文獻1之資料同步再生裝置中，具 有下述問題：亦即，因僅於工廠發生異常時，才顯示並且 儲存工廠數值資料與影像圖框，故後來無法確認在異常發 生時以外之正常運轉時中的數值資料與影像圖框。 尤以，在前述專利文獻1之資料同步再生裝置中，具 4 323150 201242349 有下述問題，亦即，於後來要進行確認異常發生時機具數 值資料與影像圖框之情形中，係根據各個數值資料記錄與 附加於各個影像之日時資訊進行同步再生，故當增加監視 對象、或亦要儲存通常運轉時之數值資料及影像圖框時， 因增加了檔案數量及檔案記憶容量，故經過長時間儲存資 料，後來要進行同步再生影像圖框與數值資料時，變得需 要非常大容量的記憶裝置。 再者，在專利文獻1之資料同步再生裝置中，有下述 問題，亦即，因依據對數值資料與影像圖框附加日時資訊 而進行同步再生，故於影像保存時無法利用MPEG-4等影像 圖框壓縮、解碼技術；且因於影像再生時無法利用Quick Time(註冊商標）播放器等通用性影像資料再生程式，故增 加了開發成本。 復有下述問題，亦即，於進行同步再生影像圖框與數 值資料時，因一邊對照各個數值資料之記錄與附加於各個 影像圖框之日時資訊一邊進行再生，故高速的同步再生或 提示將會很困難。 本發明為有鑑於前述之問題點所開發者，其目的係為 提供一種可將包含於影像資料之影像圖框、與包含於過程 資料進行高速同步再生之資料的資料同步再生裝置、資料 同步再生方法及資料同步控制程式。 (解決課題的手段） 為了達成前述目的，本發明資料同步再生裝置之第一 特徵係在具有：影像資料記憶部，係將攝影機拍攝監視對 5 323150 201242349 象所得之複數個影像圖框，對各個影像圖框附加圖框編號， 並與前述影像圖框的圖框週期一起記憶作為影像資料；過 程資料記憶部，用以將從前述監視對象依時間序列取得之 複數個資料，對各個資料附加記錄編號，並與前述資料的 取樣間隔一起記憶作為過程資料；影像資料再生部，用以 將前述影像資料記憶部所記憶的前述影像資料輸出並再生 於監視器，而且輸出再生影像圖框的圖框編號；及資料同 步再生控制部，將從前述影像資料再生部所輸出的前述圖 框編號，根據前述影像圖框的圖框週期與前述資料的取樣 間隔，予以轉換成前述資料的記錄編號，同時將具有轉換 後之記錄編號的前述資料再生於前述監視器。 再者，本發明資料同步再生裝置之第二特徵係在：前 述資料同步再生控制部係進行下述運作：在顯示於前述監 視器之前述過程資料中，在特定時序裡指定前述資料之情 形時，將所指定之該資料的前述記錄編號，根據前述資料 的取樣間隔與前述影像圖框的圖框週期，予以轉換成前述 圖框編號，且輸出轉換後之前述圖框編號至前述影像料再 生部，使具有轉換後圖框編號的前述影像資料進行再生。 再者，本發明資料同步再生裝置之第三特徵係在具 有：同步影像圖框選擇部，用以在顯示於前述監視器之過 程資料中，由外部輸入指定有作為另一檔案予以記憶之資 料範圍時’根據前述資料的取樣間隔與前述影像圖框的圖 框週期，將該所指定範圍之前述資料的記錄編號轉換成前 述影像圖框的圖框編號，而選擇與所指定範圍之前述資料 6 323150 201242349 同步之範圍的影像圖框；及同步保存控制部，用以將由外 部輸入所指定範圍的前述資料、與藉由前述同步影像圖框 選擇部所選擇之範圍的前述影像圖框記憶作為同一檔案。 再者，本發明資料同步再生裝置之第四特徵係在具有 晝面配置設定部，用以根據外部輸入，於前述監視器設定： 藉由前述影像資料再生部顯示前述影像資料的影像資料再 生區域、與藉由前述資料同步再生控制部而顯示前述過程 資料的過程育料再生區域5且同時在前述影像資料再生區 域中，在預定條件内，設定應再生之影像資料數量及大小。 再者，本發明資料同步再生方法之第一特徵係在具 有：將攝影機拍攝監視對象所得之複數個影像圖框，對各 個影像圖框附加圖框編號，而與前述影像圖框的圖框週期 一起記憶作為影像資料之步驟；將從前述監視對象依時間 序列取得之複數個資料，對各個資料附加記錄編號，並與 前述資料的取樣間隔一起記憶作為過程資料之步驟；使前 述影像資料輸出並再生於監視器，且輸出再生之影像圖框 的圖框編號時，將所輸出之前述圖框編號，根據前述影像 圖框的圖框週期與前述資料的取樣間隔，予以轉換成前述 資料的記錄編號，並且將具有轉換後之記錄編號的前述資 料再生於前述監視器之步驟。 再者，本發明資料同步再生方法之第二特徵係在：在 顯示於前述監視器之前述過程資料中，在特定時序裡指定 前述資料時’將所指定之該貨料的前述記錄編號^根據前 述資料的取樣間隔與前述影像圖框的圖框週期，予以轉換 7 323150 201242349 成則述圖框編號，使具有轉換後圖框編號的前述影像資料 進行再生。 再者’本發明資料同步再生方法之第三特徵係在復具 有：在顯示於前述監視器之過程資料中，指定有要記憶作 為另一檔案之資料範圍時，將該所指定範圍之前述資料的 $錄編號’根據前述資料的取樣間隔與前述影像圖框的圖 框週期，予以轉換成前述影像圖框的圖框編號，並選擇與 所指U圍之前述資料同步之範圍的影像圖框之步驟；及 將所指定範圍的前述資料、與戶斤選擇範圍的前述影像圖框 S己憶作為同一稽案之步驟。 再者’本發明資料同步再生方法之第四特徵係在復具 有.根據外部輸入，於前述監視器設定：藉由前述影像資 料=生部而顯讀述影像資料的影像資料再生區域、與藉 由則述貝料同步再生控制部而顯示前述過程資料的過程資 ，再生(1域’並且在前述影像資料再生區财，在預定條 件内’設定應再生之影像資料數量及大小之步驟。 執行.t本發明資料同步控制程式之第-特徵係於電腦 各個影傻=機拍攝監視對象所得之複數個影像圖框，對 期-二險寸加圖框編號，並與前述影像圖框的圖框週 間序列取得之複數個資料::個=前述監視對象依時 與前述Μ紅資料附加記錄編號，並 前述影像資料輸出並再生於監之步驟，使 框的廣I #、見器，並且輸出再生影像圖 一_’將所輸出之前述圖柜編號，根據前述影 323150 8 201242349 像圖框的圖框週期與前述資料的取樣間隔，予以轉換成前 述資料的記錄編號，並且將具有轉換後之記錄編號的前述 資料再生於前述監視器之步驟。 ‘再者，本發明資料同步控制程式之第二特徵係在復執 行：在顯示於前述監視器之前述過程資料中，在特定時序 裡指定前述資料時，將所指定之該資料的前述記錄編號， 根據前述資料的取樣間隔與前述影像圖框的圖框週期，予 以轉換成前述圖框編號，使具有轉換後圖框編號的前述影 像資料進行再生之步驟。 再者，本發明資料同步控制程式之第三特徵係在復執 行：在顯示於前述監視器之過程資料中，指定有要記憶作 為另一檔案之資料範圍時，根據前述資料的取樣間隔與前 述影像圖框的圖框週期’將該所指定範圍之前述資料的記 錄編號轉換成前述影像圖框的圖框編號，而選擇與所指定 範圍之前述資料同步之範圍的影像圖框之步驟；將所指定 範圍的前述資料、與所選擇之範圍的前述影像圖框記憶作 為同一檔案之步驟。 再者，本發明資料同步控制程式之第四特徵係在復執 行：根據外部輸入，於前述監視器設定：藉由前述影像資 料再生部而顯示前述影像資料的影像資料再生區域；與藉 由前述資料同步再生控制部而顯示前述過程資料的過程資 料再生區域，並且在前述影像資料再生區域中在預定條件 内，設定應再生之影像資料數量及大小之步驟。 (發明的效果） 9 323150 201242349 如依照本發明之資料同步再生裝置、資料同步再生方 法及資料同步控制程式，不是基於時刻資訊，而是基於包 含於影像資料之影像圖框的圖框編號、及包含於過程資料 之資料的記錄編號，使影像圖框與資料同步再生，故而不 需對資料及影像圖框附加時刻資訊。 因此，可減少檔案數量及檔案記憶容量，可用與以往 相同記憶容量的記憶裝置進行較以往更長時間的記憶與同 步再生。 再者，於影像保存時，因可利用MPEG-4等影像圖框 壓縮解碼技術，故於影像再生時，可使用Quick Time(註 冊商標）播放器等通用性影像資料再生程式，藉此，可減少 開發成本。 而且，不須使用時刻資訊，可高速的同步再生資料與 影像圖框，或進行提示。 【實施方式】 (第一實施形態） 以下針對本發明之資料同步再生裝置、資料同步再生 方法及資料同步控制程式之第一實施形態進行說明。 <構成說明> 第1圖係為顯示包含本發明資料再生裝置之線上數據 管理系統之構成圖。.… .............. 該線上數據管理系統係例如，使以輥軋機進行滾軋加 熱後之鋼鐵、不鏽鋼、鋁胚（鋼板），加工完成厚度數毫米 (mm)至數十mm熱軋盤元的熱軋工廠系統、或為了將熱軋工 10 323150 201242349 廠或冷軋工廠所製造之盤元精加工成最終成品，而進行酸 洗退火、電鍍、塗裝、切割等處理生產線工廠系統中拍 攝各個監視對象所得的影像資料、與從各個監視對象取得 之過程資料’於監視器上進行同步顯示及管理的系統。 在第1圖中，該線上數據管理系統係由：本發明之資 料门^再生裝置1、複數台工業電視（〖Tv，industriai television)攝影機21至2m(m為自然數）、攝影機切換器 3、數位影像轉換單元4、可程式邏輯控制器（pLC)等之控 制機器51至5n(n為自然數）相連接而構成，並藉由複數台 ITV攝影機21至2m拍攝輥軋機或沖壓機、驅動這些機械 的馬達、活塞等各個監視對象物61至6p(p為自然數）的動 作狀癌及控制狀態等所得之影像資料，與控制機器51至 5n取得之過程資料，而進行監視之系統。 一在，，例如，資料同步再生裝置丨與數位影像轉換單 元4係藉由乙太網路（註冊商標）等LAN(L〇Cal Area Network’區域網路）7而相連接，另一方面，資料同步再 生裝置1與控制機n 51至511係藉由與圓分開之另一個 控制用顺8相連接。另外，在控制機器51至5〇可與[樹 連接之㈣中，控制用網路8係可置換為LAN7。 、再者，本發明之資料同步再生裝置1係為在裝置本體 11連接有監視器（顯示器）12、鍵盤13、滑鼠丨4等之電腦 裝置所，成。並且，該資湘步再生裝置1係藉由數位影 像轉換單元4將從由龜視黯_換絲位視訊信號之 複數台m攝影機21至2m的影像資料、與包含從控制機 323150 11 201242349 器51至5η取得之複數個數值資料的過程資料輸入其中， 且通常顯示於監視器12，或進行同步顯示處理者。關於本 發明之資料同步裝置i之構成或動作、影像資料、過程資 料之構成等，容後陳述。 ITV攝影機21至2m係為拍攝複數個監視對象物61至 6ρ 而輸出 PAL(Phase Alternation by Line，相位交替線） 或 NTSC(National Television System Committee，國家 電視標準委員會）形式等類比影像信號者，其可為固定式攝 影機、或可藉傳送控制信號而進行水平移動、傾斜、變焦 等遠端操作之攝影機。另外，在ITV攝影機21至2m，設 置或不設置麥克風均可。再者，ITV攝影機21至2m係對 各個監視對象物61至6p各設置一台亦可，或設置複數台 亦可。 攝影機切換器3係為從複數台ITV攝影機21至2m視 訊信號中’切換顯示於監視器12之預定數量（在本第一實 施形態’例如為4台）的視訊信號而進行輸出者。另外，於 未限制顯示於監視器12之視訊信號數量之情形中，或ITV 攝影機21至2m台數為前述預定數量以下之情形中，使在 數位影像轉換單元4或資料同步再生裝置1擁有該切換功 此時’則當然攝影機切換器3省略亦可。 數位影像轉換單元4係為將從複數台ITV攝影機21 至2m所輸出之NTSC或PAL形式之類比視訊信號’壓縮編 碼成MPEG-4等數位影像資料而向資料同步再生裝置1進行 輸出者。另外，在複數台ITV攝影機21至2m内部進行拍 12 323150 201242349 視訊信號進行A/D轉換，而可以輪出數位形式的 象貝科之情形時，職位影像轉換單元4可以省略。 控制機器51至5n分別係藉由程式來控制馬達、加熱 幾、油壓'鮮各個監視對象物61至心動作者，且分別 =各個ι/(Κ輸入輸出）單元511至5nl從各個監視對象 :至6P取得’包含有讀述駭取樣間隔依時間序列 偵測所得之數值資料的過程資料者。 第2圖係為顯不本發明之^ 例之方塊®。 料丨之糾时再生Μ 1的構成 與監步再生裝置1係為_本體11 腦裳置所構成不者益及鍵盤13、滑鼠14等相連接之電 _ 體U係如第2圖所示，將⑽⑴、記憶體112、 ^記憶體等之記憶部113、外部機 以 I 114 二部 c厶由内部匯流排in連接而構成。 部113^1係為與藉由執行儲存於記憶部113之程式記憶 為本發明之各種广用程式中的影像資料再生程式，來發揮作 祖Γΐ影像資料再生部之功能，並且同時藉由Γ 部:為本發明之資料同步再生二 設定部之步保存控制部、及晝面配置 作進！^，⑴係於咖⑴執行各種應用程式時用來當 丁暫時儲存或展開等之演算區域等之者。 323150 13 201242349 記憶部113係具有程式記憶部113a與資料記,隱部 113b。程式記憶部113a係儲存有〇s(〇peratin£y g System » 作業系統）、及使CPU111發揮作為本發明之影像資料再生 部功能之影像資料再生程式；以及使CPU111發揮作為本發 明之資料同步再生控制部、同步影像圖框選擇部 # " °|、同步保 存控制部、及畫面配置設定部功能之資料同步控制程弋等 應用程式。另外，在本第一實施形態中，作為影像資=再 生程式，係可使用為本裝置專用規劃之影像資料再生程 式，或是QuickTime(註冊商標）播放器等通用性影像資料 再生程式。 ^ ’ 資料記憶部113b係作為本發明之影像資料記憶部， 而儲存包含複數台in攝影機21至2m拍攝監視對象物61 至6p並進行A/D轉換所得之複數個影像圖框的影像資料， 並且同時作為本發明之過程資料記憶部，而儲存包含控制 機器51至5n從複數個監視對象物61至6p依時間序列取 得之複數個數值資料的過程資料者。 另外，在本第一實施形態中，於一個記憶部113中， 雖汉置有程式記憶部113a與資料記憶部n3b，但程式記 憶部113a與資料記憶部U3b’當財分別作為各個記憶 部而構成。 外部機器I/F部114係為供監視器12、及鍵盤13、 滑鼠14等外部機器與裝置本體11連接之介面者。 控制網路I/F部115係為供控制網路19與裝置本體 11連接之介面者。 14 323150 201242349 LAN Ι/F部116係為供LAN7與裝置本體1丨連接之介 面者。 第3A圖至第3C圖係為分別顯示儲存於資料同步再生 裝置1之資料記憶部113b的影像資料與過程資料的檔案形 式’與影像資料及過程資料之資料結構之一例圖。 如第3A圖所示，在資料同步再生裝置1之記憶部113 的資料記憶部113b中，係將包含複數台ITV攝影機21至 2m拍攝複數個監視對象物61至6p之複數個影像資料的影 像資料D1、與包含控制機器51至5n從複數個監視對象物 61至6p依時間序列取得之複數個數值資料之過程資料 D2，於一個資料檔案£)f内’儲存在2個區塊§ 1、S2。在 此’影像資料D1、過程資料D2,當然如儲存於另一個檔案 的另一個區塊亦可。 第3B圖係為顯示儲存於資料記憶部ii3b之影像資料 D1的資料結構圖。 如第3B圖所示’影像資料D1係為從複數台I τν攝影 機21至2m分別輸出之類比視訊信號藉由數位影像轉換單 元4轉換成MPEG-4編碼方式等的數位影像資料者，係由影 像標頭資訊D11、與各個ITV攝影機21至2m拍攝作為對 象之監視對象物61至6p後之圖框編號#1至#q(cl為自然數） 的複數個影像圖框D12所構成。另外，為便於說明，雖僅 表示一個影像資料D1 ,但實際上，複數台約每ITV攝影機 21至2m均具有影像資料Dh / 影像標頭資訊Dll，本第一實施形態之情形中，如第 323150 15 201242349 3B圖所示，至少具有：屬於構成該影像資料w之$像· 框D12的每一個單位圖框時間的圖框週期Tf、與盖 資料D1之複數個影像圖框！)12的全圖框數n。v ,衫像 4。另外，在該 影像標頭資訊D11，當然可設成包含供辨識輪出影像資料 D1之ITV攝影機21至2m的攝影機識別資訊、或$包含胃供辨 識來自同一個ΠΤ攝影機21至2m之影像資料^但曰時不 相同之影像資料D1的日時識別資訊之方式。再者，當然復 可没成包含使該影像標頭資訊Dl 1與對應之過程資料D2 進行鏈結的鏈結資訊之方式。 在此，在本第一實施形態1中，影像圖框D12之圖框 週期Tf係設為例如一個圖框= ι/3〇秒者。另外，1/3〇秒係 為一例，當然影像圖框D12之圖框週期Tf，為1/60秒、 1 / 5 0秒皆可。 影像圖框D12係為數位影像轉換單元4藉由MPEG-4 等動態影像壓縮方式以高效率將ΙΠ攝影機21至2m拍攝 所得之類比形式之視訊信號壓縮編碼後的資料；當然其他 壓縮編碼形式’例如H· 264編碼方式，或不進行圖框間預 測之Motino-JPEG等皆可。總之’只要是藉由LAN7所傳送 之數位影像資料形式即可。另外，當然亦可對複數個影像 圖框D12反者，分別賦予一般解碼再生用之解碼時間標記 (.DTS)或再生時刻資.訊（PTSJ等的時刻資訊。.但本第一實施 形態中與過程資料之同步再生處理，並不使用解碼時刻標 記（DTS)及再生時刻資訊（PTS)等的時刻資訊。 如此，在本第一實施形態中，影像資料D1，雖不具有 323150 16 201242349 時刻資訊，但即使具有時刻資訊，在與過程資料D2的同步 再生時並不使用。因此，在本第—實施形態中，在影像資 料D1與過程資料D2的再生處理時’係將對應影像資料 之過程資料D2的過程資料標頭資訊D21所儲存的取樣開始 時刻Ts卜當作影像資料D1的起始時刻，即是圖框編號尥 影像圖框D12之再生開始資訊來使用。於是，圖框編號#1 之影像圖框M2之後的圖框編號#2至p影像圖框D12的圖 框再生開始時刻，係根據當作圖框編號#1之影像圖框Dl2 之再生開始時刻來使用的取樣開始時刻Ts 1、與各個影像 圖框D12的圖框編號#等，以如後述之方式進行計算。因 此，在本第一實施形態中，與過裎資料D2的同步再生處 理，並無需各個影像圖框D12的時刻資訊，縱使有時刻資 訊等，亦不使用（參照）。藉此，因不使用各個影像圖框Dl2 的時刻> sfl，只根據圖框編號而進行再生，故可進行高速 化再生及提示。 第3C圖係為顯示記憶於資料記憶部i13b之過程資料 D2的資料結構圖。 過程資料D2係由控制機器51至511從複數個監视對 象物61至6p於各個預定取樣間隔Ts2依時間序列取得之 數值資料D22所構成之二進碼資料（Binary data)，如第 3C圖所不，具有過程資料標頭資訊D21、與複數台控制機 器51至5n從監視對象物61至6p取得之記錄編號#1至 為自然數）之複數個數值資料])22。 過程資料標頭資訊D21，在本第一實施形態之情形中， 17 323150 201242349 最少儲存有：屬於該過程資料D2取得之開始時刻的取樣開 始時刻Tsl、屬於取得數值資料!)22之間隔的取樣間隔Ts2、 及從監視對象物61至6p以預定取樣間隔Ts2取得之複數 個數值資料D22的全記錄筆數在此，在本第一實施形 態中，過程資料標頭資訊D21之取樣間隔Ts2係設為例如 1毫秒（mSec)，此係為一例，當然im秒以外亦可。 再者，根據取樣間隔Ts2對從監視對象物“至卟依 時間序列所取得之數值資料D22中，分別以記錄編號#1至 #r之方式，從過程-貝料D2記錄編號#ι的數值資料開 始附予記錄編號。㈣，各個數值資料奶，係如第扣圖 所示由項目編號#1至#心為自然數）的一個或是複數個 項目所構成。例如，項目#1為溫度感測值、項目#2為壓力 感測值。另外，在本發明，目因與發明主要部分無關， 故考慮將之省略亦可。 如此，構成影像資料])1之複數個影像圖框D12與構 成過程資# D2之複數個數值資料奶，於記錄時並未取得 同步。再者，影像資料圖框週期Tf的1/3〇秒，與數值資 料^樣間隔TS2的llD秒為不—致。因此’本第—實施形態 之-貝料同步再生裝置丨並不使用解碼時刻標記及再 生時刻資訊⑽）等影像資料D1的日㈣#訊、及表示過程 男料D2的貝料取得時的時刻資訊，故為了構成影像資料 D1之衫像圖棍D12與構成過程資料D2之數值資料哪進 行同步再生處理，就必需於同步再生_行同步處理。 因此，在本第一實施形態之資料同步再生裝置1中， 18 323150 201242349 係不使用或參照時刻資訊，而使用圖框編號與記錄編號， 並使用影像圖框與數值資料進行同步再生處理。 <動作說明> 接著，針對本第一實施形態之資料同步再生裝置1中 的資料同步顯示處理，參照流程圖進行說明。 (說明從影像資料D1向過程資料D2同步再生的動作） 首先，請參照流程圖說明有關在本第一實施形態之資 料再生裝置1中根據影像資料進行之過程資料同步再生動 作。 第4圖係為表示藉由本第一實施形態之資料同步再生 裝置1進行之資料同步顯示處理順序的流程圖。 首先，使用者操作資料同步再生裝置1的鍵盤13或 滑鼠14等點選（click，選擇）同步再生按鈕（圖中未示），而 對裝置本體11輸入影像資料D1與過程資料D2之同步再生 指示（S400，“是”），CPU111則啟動儲存在程式記憶部 113a之影像資料再生程式與資料同步控制程式，而開始進 行同步再生處理。 換言之，裝置本體11之CPU111係首先藉由執行影像 資料再生程式來發揮作為影像資料再生部之功能，並讀出 儲存在資料記憶部113b之影像資料D1的影像標頭資訊 D11、與過程資料D2的過程資料標頭資訊D21，將其暫時 保存在記憶體112，再進行取得包含於影像標頭資訊D11 的圖框週期Tf與包含於過程資料標頭資訊D21的取樣間隔 Ts2(S410)。在此，CPU111如前述，係取得例如1/30秒作 19 323150 201242349 為圖框週期Tf、取得例如lm秒作為取樣間隔Ts2。 另外’ CPU111於S400處理前，當然亦可藉由該S410 處理’贱取得圖框週期Tf及取樣間 隔 Ts2。再者，CPU111 在包3於影像標頭資訊Du的圖框週期Tf為已知之情形 下並不取彳于包含於影像標頭資訊mi的圖框週期Tf，而 僅取得包3於過程資料標頭資訊Mi的取樣間隔。 接著’ CPU111係藉由影像資料再生程式的執行來作為 本發明之t像資料再生部發揮魏，並· QS的計時器 (圖中未不），以屬於影像資料W的圖框週期的1/3〇 秒間隔產生計時ϋ事件訊號（timer event)(S420) 〇 ^然後’ CPU111以屬於圖框週期的Tf 1/30秒間隔產生 :十時器事件訊號⑽〇，‘‘是’，）時，係作為本發明之影像 資料再生。p發揮功能’並讀出儲存在資料記憶部⑴匕之相 2像資料D1的影像圖框D12，若該影像圖框D i 2藉由 4 $式等進行編碼，則將該影像圖框ρΐ2卩 =式等進行解碼，並再生於監㈣12 影像圖咖的圖框編號⑽ =號等指定再生開始的影像圏框之情：，則 影像圖框開始進行再生。另外，影像圖框⑽之卜又之 =圖的框:號：，藉由鍵盤13或滑鼠14，在顯示：:Γ ==示畫.面上蝴_指定㈣。未指 =形，係從在影像資料D1中 ：彻 疋從圖框編號#丨_㈣框D12 ^像1^ ’印 在該階段，影像資料一資料。:二::月 32315〇 201242349 生。 與此同時’ CPU111係藉由執行有關 ::程式來作為本發明之資料同步再生控制部發：步 首先，取得現在再生之f彡像圖框D12 _ :咖)。在此’請0處理，亦 =201242349 VI. Description of the Invention: [Technical Field] The present invention relates to an image data including a plurality of image frames including a camera to be monitored by a camera, and a plurality of numerical data including time-series obtained from a monitoring object. The data synchronization synchronization device, the data synchronization regeneration method and the data synchronization control program are simultaneously displayed in the process data. [Prior Art] As a data synchronization/reproduction device, for example, when an abnormality occurs in a factory, the factory monitors the numerical data and image frames of the factory when the abnormality occurs, and displays the numerical data and images in the memory device. When the frame is stored as another file, and the history information screen is displayed in order to investigate the abnormality, the numerical data and the image frame at the time of the abnormality are simultaneously displayed, and the prior art for fine factory monitoring has been proposed ( For example, refer to Patent Document 1). (Prior Art Document) (Patent Document) Patent Document 1: Japanese Laid-Open Patent Publication No. Hei 5-34181. [Problems to be Solved by the Invention] However, in the data synchronous reproduction device of Patent Document 1, there is a problem that the factory numerical data and images are displayed and stored because an abnormality occurs only in the factory. Because of the frame, it is impossible to confirm the numerical data and image frame during normal operation except when the abnormality occurs. In particular, in the data synchronous reproducing apparatus of the above-mentioned Patent Document 1, the problem of 4 323150 201242349 is that, in the case where the numerical value data and the image frame of the apparatus at the time of confirming the abnormality are to be confirmed, the numerical values are based on the respective values. The data record is synchronized with the information added to the date of each image. Therefore, when the monitoring object is added, or the numerical data and image frame during normal operation are also stored, the number of files and the file memory capacity are increased. When storing data, it is necessary to synchronously reproduce image frames and numerical data, and it becomes a very large-capacity memory device. Further, in the data synchronous reproduction device of Patent Document 1, there is a problem that synchronization is performed by adding time-of-day information based on the logarithmic data and the image frame, so that MPEG-4 cannot be used for image storage. Image frame compression and decoding technology; and because the common image data reproduction program such as the Quick Time (registered trademark) player cannot be used during image reproduction, the development cost is increased. The following problems are solved, that is, when the image frame and the numerical data are synchronously reproduced, the reproduction is performed while checking the data of each numerical data and the information attached to the time of each image frame, so that high-speed synchronous reproduction or prompting is performed. It will be very difficult. The present invention has been made in view of the above problems, and an object of the present invention is to provide a data synchronization frame and a data synchronous reproduction device which can be used for image frame data included in image data and synchronously reproduced in process data. Method and data synchronization control program. (Means for Solving the Problem) In order to achieve the above object, the first feature of the data synchronous reproduction device of the present invention is that the image data storage unit is configured to capture a plurality of image frames obtained by the camera for monitoring images 5 323 150 201242349. The frame of the image frame is appended with the frame number and stored as image data together with the frame period of the image frame; the process data storage unit is configured to attach a record to each piece of data obtained from the monitored object in time series. The number is stored as the process data together with the sampling interval of the foregoing data; the image data reproducing unit is configured to output and reproduce the image data stored in the image data storage unit to the monitor, and output the frame of the reconstructed image frame. And the data synchronization/reproduction control unit converts the frame number output from the video data reproducing unit into a recording number of the data based on a frame period of the video frame and a sampling interval of the data. Regenerate the aforementioned data with the converted record number Monitor. Furthermore, in the second aspect of the data synchronous reproduction device of the present invention, the data synchronous reproduction control unit performs an operation of designating the data in a specific time series in the process data displayed on the monitor. And converting the record number of the specified data to the frame number according to the sampling interval of the data and the frame period of the image frame, and outputting the converted frame number to the image material regeneration The portion of the image data having the converted frame number is reproduced. Furthermore, the third feature of the data synchronous reproducing apparatus of the present invention has: a synchronous image frame selecting unit for specifying, in the process data displayed on the monitor, externally inputting data to be memorized as another file. In the range, according to the sampling interval of the foregoing data and the frame period of the image frame, the record number of the data of the specified range is converted into the frame number of the image frame, and the aforementioned data of the specified range is selected. 6 323150 201242349 The image frame of the synchronization range; and the synchronous storage control unit for storing the aforementioned data of the range specified by the external input and the image frame of the range selected by the synchronous image frame selection unit as The same file. Furthermore, the fourth feature of the data synchronous reproducing apparatus of the present invention is characterized by having a facet setting setting unit for setting on the monitor according to an external input: displaying the image data reproducing area of the image data by the image data reproducing unit And the process feed regeneration area 5 for displaying the process data by the data synchronization control unit, and simultaneously setting the number and size of the image data to be reproduced within the predetermined condition in the image data reproduction area. Furthermore, the first feature of the data synchronization reproducing method of the present invention has a plurality of image frames obtained by capturing a monitoring target by a camera, and adding a frame number to each image frame, and a frame period of the image frame. Memorizing together as a video data; adding a record number to each data from the plurality of data acquired by the monitoring object in time series, and storing the step as a process data together with the sampling interval of the foregoing data; When reproducing the monitor and outputting the frame number of the reproduced image frame, the frame number outputted is converted into the record of the data according to the frame period of the image frame and the sampling interval of the data. The step of numbering and reproducing the aforementioned material having the converted record number on the aforementioned monitor. Furthermore, the second feature of the data synchronous reproducing method of the present invention is: when the foregoing data is specified in a specific time sequence in the foregoing process data displayed on the monitor, 'the aforementioned record number of the specified material is ^ The sampling interval of the foregoing data and the frame period of the image frame are converted into 7 323150 201242349, and the image data having the converted frame number is reproduced. Furthermore, the third feature of the data synchronization regeneration method of the present invention further comprises: in the process data displayed on the monitor, when the data range to be memorized as another file is specified, the data of the specified range is The number of the record number is converted into the frame number of the image frame according to the sampling interval of the foregoing data and the frame period of the image frame, and the image frame of the range synchronized with the aforementioned data of the U-shaped frame is selected. The steps of the above-mentioned information in the specified range and the above-mentioned image frame of the selection range of the household are taken as the same as the steps of the same case. Furthermore, the fourth feature of the data synchronization regeneration method of the present invention is provided in the above-mentioned monitor according to an external input: the image data reproduction area in which the image data is read by the image data = the living part, and the borrowing The process of displaying the process data by the bedding synchronous regeneration control unit, and reproducing (1 domain 'and the amount of image data to be reproduced and the size of the image data to be reproduced within the predetermined condition in the image data reproduction area. .t The first feature of the data synchronization control program of the present invention is a plurality of image frames obtained by the computer shooting shadows of the computer, and the number of the image frames of the period-two risk inch and the image frame. The plurality of pieces of data obtained in the sequence of the frame:: = the monitoring object is added with the record number of the aforementioned blush data, and the image data is output and reproduced in the monitoring step, so that the frame is wide I #, see, and output The reproduced image map _' will output the aforementioned cabinet number, according to the frame period of the image 323150 8 201242349 image frame and the sampling interval of the aforementioned data, The record number of the foregoing data, and the step of reproducing the aforementioned data having the converted record number on the monitor. 'Furthermore, the second feature of the data synchronization control program of the present invention is repeatedly executed: displayed on the aforementioned monitor In the foregoing process data, when the foregoing data is specified in a specific time sequence, the record number of the specified data is converted into the frame number according to the sampling interval of the data and the frame period of the image frame. The step of reproducing the image data having the converted frame number is further performed. Further, the third feature of the data synchronization control program of the present invention is repeated: in the process data displayed on the monitor, the memory is specified to be In the data range of another file, according to the sampling interval of the foregoing data and the frame period of the image frame, the record number of the data of the specified range is converted into the frame number of the image frame, and the selection is The steps of the image frame of the specified range of data synchronization; the front of the specified range The data and the image frame of the selected range are stored as the same file. Further, the fourth feature of the data synchronization control program of the present invention is repeatedly executed: according to an external input, set on the monitor: by the foregoing a video data reproduction area for displaying the video data by the video data reproduction unit; and a process data reproduction area for displaying the process data by the data synchronization reproduction control unit, and setting within the predetermined condition in the video data reproduction area Step of reproducing the number and size of image data. (Effect of the invention) 9 323150 201242349 The data synchronous reproduction device, the data synchronization regeneration method and the data synchronization control program according to the present invention are not based on time information but are based on image data. The frame number of the image frame and the record number of the data contained in the process data enable the image frame to be reproduced synchronously with the data, so that it is not necessary to attach time information to the data and image frames. Therefore, the number of files and the memory capacity of the file can be reduced, and the memory and the synchronous reproduction can be performed for a longer period of time than the conventional memory device having the same memory capacity. In addition, since the image frame compression and decoding technology such as MPEG-4 can be used for image storage, a general image data reproduction program such as a Quick Time (registered trademark) player can be used for image reproduction. Reduce development costs. Moreover, it is possible to simultaneously reproduce data and image frames at high speed without using the time information, or to prompt. [Embodiment] (First Embodiment) A first embodiment of a data synchronous reproduction device, a data synchronous reproduction method, and a data synchronization control program according to the present invention will be described below. <Configuration Description> Fig. 1 is a block diagram showing an online data management system including the data reproducing apparatus of the present invention. .... .............. This online data management system is, for example, a steel, stainless steel, or aluminum blank (steel plate) that has been rolled and heated by a rolling mill to a thickness of several millimeters ( Mm) to tens of mm hot-rolled coil hot-rolling plant systems, or in order to finish the hot-rolling mill 10 323150 201242349 factory or cold-rolled mills to the final product, pickling annealing, plating, coating A system for capturing and managing the image data obtained by each monitoring object and the process data acquired from each monitoring object on the monitor in a production line factory system such as loading and cutting. In Fig. 1, the online data management system is composed of: the data door reproducing device of the present invention, a plurality of industrial television (Tv, industrial television) cameras 21 to 2 m (m is a natural number), and the camera switcher 3 The digital image conversion unit 4, the programmable logic controller (pLC) and the like control devices 51 to 5n (n is a natural number) are connected, and the rolling mill or the punch is photographed by a plurality of ITV cameras 21 to 2 m, A system for monitoring image data obtained by operating the cancer objects and control states of the respective monitoring objects 61 to 6p (p is a natural number) such as a motor or a piston of the machine, and the process data acquired by the control devices 51 to 5n . For example, the data synchronization reproduction device and the digital image conversion unit 4 are connected by a LAN (L〇Cal Area Network) 7 such as Ethernet (registered trademark), on the other hand, The data synchronous reproduction device 1 and the control units n 51 to 511 are connected by another control phase 8 separated from the circle. Further, in the control devices 51 to 5, and the [tree connection (4), the control network 8 can be replaced with the LAN 7. Further, the data synchronous reproduction device 1 of the present invention is a computer device in which a monitor (display) 12, a keyboard 13, a mouse 4, and the like are connected to the device body 11. In addition, the Zixiang step regeneration device 1 is used by the digital image conversion unit 4 to convert the image data of the plurality of m cameras 21 to 2m from the tortoise video signal, and the slave control unit 323150 11 201242349 The process data of the plurality of numerical data acquired from 51 to 5η is input thereto, and is usually displayed on the monitor 12 or is subjected to synchronous display processing. The composition or operation of the data synchronizing apparatus i of the present invention, the video data, the composition of the process materials, and the like are described later. The ITV camera 21 to 2m emits a plurality of analog image signals such as a PAL (Phase Alternation by Line) or an NTSC (National Television System Committee), by capturing a plurality of objects to be observed 61 to 6ρ. It can be a fixed camera, or a camera that can perform remote operations such as horizontal movement, tilt, zoom, etc. by transmitting control signals. In addition, the microphones may or may not be provided in the ITV cameras 21 to 2m. In addition, the ITV cameras 21 to 2m may be provided for each of the objects to be monitored 61 to 6p, or a plurality of units may be provided. The camera switcher 3 outputs a video signal that is switched from a plurality of ITV cameras 21 to 2 m video signals by a predetermined number (for example, four in the first embodiment) displayed on the monitor 12. In addition, in the case where the number of video signals displayed on the monitor 12 is not limited, or in the case where the number of ITV cameras 21 to 2m is less than the predetermined number, the digital video conversion unit 4 or the data synchronous reproduction device 1 is provided. Switching work at this time 'Of course, the camera switch 3 can be omitted. The digital video conversion unit 4 compresses and encodes the analog video signal of the NTSC or PAL format outputted from the plurality of ITV cameras 21 to 2m into digital video data such as MPEG-4, and outputs it to the data synchronous reproduction device 1. In addition, the position image converting unit 4 can be omitted when the video signals of the multiple ITV cameras 21 to 2m are subjected to A/D conversion, and the digital form of Beca can be rotated. The control machines 51 to 5n respectively control the motor, the heating, the oil pressure, and the respective monitoring objects 61 to the heart-moving author by the program, and respectively = the respective ι/(Κ input-output) units 511 to 5nl from the respective monitoring objects: Up to 6P to obtain the process data containing the numerical data obtained by the time series detection of the sampling interval. Fig. 2 is a block diagram of the example of the present invention. The structure of the 纠 Μ Μ Μ 与 与 监 监 监 本体 本体 本体 本体 本体 11 11 11 11 11 脑 脑 脑 脑 脑 脑 本体 本体 本体 本体 本体 本体 本体 键盘 键盘 键盘 键盘 键盘 键盘 键盘 键盘 键盘 键盘 键盘 键盘It is to be noted that the memory unit 113 such as (10) (1), the memory 112, and the memory, and the external unit are connected by the internal bus bar in. The part 113^1 functions as a video data reproducing program in various widely used programs of the present invention by executing the program stored in the memory unit 113, and functions as a reproduction unit of the ancestral image data, and at the same time Part: The step of saving the control unit and the kneading configuration of the data synchronization and regeneration setting unit of the present invention! ^, (1) is used in coffee (1) to perform various applications, such as the temporary calculation or expansion of the calculation area, etc. 323150 13 201242349 The memory unit 113 has a program storage unit 113a, a data record, and a hidden portion 113b. The program memory unit 113a stores a video data reproduction program that causes the CPU 111 to function as the video data reproduction unit of the present invention, and causes the CPU 111 to function as the data synchronization reproduction of the present invention. The control unit, the synchronized image frame selection unit # " °|, the synchronous storage control unit, and the screen configuration setting unit function data synchronization control program and other applications. Further, in the first embodiment, as the image reproduction/reproduction program, a video data reproduction program for the device-specific planning or a general-purpose video data reproduction program such as a QuickTime (registered trademark) player can be used. ^ ' The data storage unit 113b is a video data storage unit of the present invention, and stores image data of a plurality of image frames obtained by performing A/D conversion on a plurality of in cameras 21 to 2 m, and imaging objects 61 to 6p. Further, as the process data storage unit of the present invention, the process data including the plurality of numerical data obtained by the control devices 51 to 5n from the plurality of monitoring objects 61 to 6p in time series is stored. Further, in the first embodiment, the program memory unit 113a and the data memory unit n3b are provided in the memory unit 113, but the program memory unit 113a and the data memory unit U3b' are used as the respective memory units. Composition. The external device I/F unit 114 is an interface for connecting the external device such as the monitor 12 and the keyboard 13 and the mouse 14 to the device body 11. The control network I/F unit 115 is an interface for the control network 19 to be connected to the device body 11. 14 323150 201242349 The LAN/F unit 116 is a medium for connecting the LAN 7 to the device body 1A. Figs. 3A to 3C are diagrams each showing an example of the data structure of the image data and the process data stored in the data storage unit 113b of the data synchronous reproduction device 1 and the data structure of the image data and the process data. As shown in FIG. 3A, in the data storage unit 113b of the memory unit 113 of the data synchronous playback device 1, an image in which a plurality of ITV cameras 21 to 2m capture a plurality of image data of a plurality of objects to be monitored 61 to 6p is used. The data D1 and the process data D2 including the plurality of numerical data obtained by the control machines 51 to 5n from the plurality of monitoring objects 61 to 6p in time series are stored in two blocks § 1 in a data file £)f , S2. Here, the image data D1 and the process data D2 may of course be stored in another block of another file. Fig. 3B is a data structure diagram showing the image data D1 stored in the data storage unit ii3b. As shown in FIG. 3B, the image data D1 is a digital image data obtained by converting the analog video signal output from the plurality of I τ cameras 21 to 2 m into the MPEG-4 encoding method by the digital image conversion unit 4, for example. The image header information D11 is composed of a plurality of image frames D12 of the frame numbers #1 to #q (cl is a natural number) after the target objects 21 to 6p are captured by the respective ITV cameras 21 to 2m. In addition, for the sake of explanation, only one image data D1 is shown, but in fact, the plurality of ITV cameras 21 to 2m each have image data Dh / image header information D11. In the case of the first embodiment, 323150 15 201242349 3B shows at least a frame period Tf belonging to each unit frame time of the image frame D12 constituting the image data w, and a plurality of image frames of the cover data D1! ) The total number of frames of 12 is n. v, shirt like 4. In addition, the image header information D11 may of course be set to include camera identification information for identifying the ITV cameras 21 to 2m of the wheeled image data D1, or for including the stomach for identifying image data from the same camera 21 to 2m. ^However, when the time is different, the image data D1 is identified by the time of day. Furthermore, of course, the complex does not include a link information that links the image header information D1 1 to the corresponding process data D2. Here, in the first embodiment, the frame period Tf of the image frame D12 is set to, for example, one frame = ι / 3 〇 second. In addition, the 1/3 leap second system is an example. Of course, the frame period Tf of the image frame D12 is 1/60 second and 1 / 50 0 seconds. The image frame D12 is a digital image conversion unit 4 that compresses and encodes the analog video signal of the analog image captured by the camera 21 to 2m by a dynamic image compression method such as MPEG-4; of course, other compression coding forms' For example, the H.264 encoding method or Motino-JPEG without inter-frame prediction is acceptable. In short, as long as it is a digital image data transmitted by LAN7. In addition, it is of course possible to provide a decoding time stamp (.DTS) for general decoding reproduction or a time information for retransmission time (PTSJ) for a plurality of video frames D12, but in the first embodiment. In synchronization with the process data, the time information such as the decoding time stamp (DTS) and the reproduction time information (PTS) is not used. Thus, in the first embodiment, the video data D1 does not have the time of 323150 16 201242349. Information, but even if it has time information, it is not used in the synchronous reproduction with the process data D2. Therefore, in the first embodiment, when the image data D1 and the process data D2 are reproduced, the corresponding image data is used. The sampling start time Ts stored in the process data header information D21 of the process data D2 is used as the start time of the image data D1, that is, the frame start number is used for the reproduction start information of the image frame D12. Thus, the frame number is used. #1 Image frame M2 after frame number #2 to p image frame D12 frame reproduction start time, based on the image frame Dl2 as frame number #1 The sampling start time Ts1 used at the time and the frame number # of each video frame D12 are calculated as described later. Therefore, in the first embodiment, the synchronous reproduction processing with the over-distributed data D2 is performed. The time information of each image frame D12 is not required, and even if there is time information, etc., it is not used (reference). Therefore, since the time of each image frame D12 is not used, sfl, only the frame number is reproduced. Therefore, it is possible to perform high-speed reproduction and presentation. Fig. 3C is a data structure diagram showing the process data D2 stored in the data storage unit i13b. The process data D2 is controlled by the control devices 51 to 511 from a plurality of monitoring objects 61 to 6p Binary data composed of the numerical data D22 obtained by time series in each predetermined sampling interval Ts2, as shown in FIG. 3C, having process data header information D21, and a plurality of control machines 51 to 5n A plurality of numerical data]) 22 of the record number #1 to the natural number obtained from the objects to be monitored 61 to 6p. The process data header information D21, in the case of the first embodiment, 17 323150 201242349 stores at least the sampling start time Tsl belonging to the start time of the process data D2 acquisition, and the sampling belonging to the interval of the acquired value data! The interval Ts2 and the total number of records of the plurality of numerical data D22 obtained from the monitoring objects 61 to 6p at the predetermined sampling interval Ts2 are here. In the first embodiment, the sampling interval Ts2 of the process data header information D21 is For example, it is 1 millisecond (mSec), and this is an example, and it is also possible to be other than im seconds. Further, according to the sampling interval Ts2, the value of the number #1 is recorded from the process - the material D2 in the numerical data D22 obtained from the monitoring object "to the conversion time series" by the recording numbers #1 to #r, respectively. The data begins with a record number. (4) Each numerical data milk is composed of one or a plurality of items, such as item number #1 to #心为自然数, as shown in the figure. For example, item #1 is temperature. The sensing value and the item #2 are pressure sensing values. In addition, in the present invention, the cause is not related to the main part of the invention, and therefore it may be omitted. Thus, a plurality of image frames D12 constituting the image data])1. And the plurality of numerical data milks constituting the process capital #D2 are not synchronized at the time of recording. Furthermore, the 1/3 second of the image data frame period Tf is not the same as the llD seconds of the numerical data sample interval TS2. Therefore, in the present embodiment, the bee-synchronous regenerative device does not use the decoding time stamp and the reproduction time information (10), and the day (four)# of the image data D1, and the bedding material indicating the process male material D2. Time information, so in order to form a shadow In the data synchronous reproduction device 1 of the first embodiment, the data synchronization reproduction device 1 of the first embodiment is required to perform the synchronous reproduction processing of the data sheet D12 of the data D1 and the numerical data of the process data D2. Therefore, in the data synchronous reproduction device 1 of the first embodiment, 18 323150 201242349 The frame number and the record number are used without using or referring to the time information, and the image frame and the numerical data are used for synchronous reproduction processing. <Operation description> Next, the data synchronous reproduction device of the first embodiment is used. The data synchronization display processing in the first embodiment will be described with reference to the flowchart. (Description of the synchronous reproduction from the video data D1 to the process data D2) First, the data reproduction device 1 according to the first embodiment will be described with reference to the flowchart. The process data synchronization reproduction operation performed by the image data. Fig. 4 is a flow chart showing the procedure of the data synchronization display process performed by the data synchronization reproduction device 1 of the first embodiment. First, the user operates the data synchronization reproduction device 1 Click on the keyboard 13 or the mouse 14 (click, select) synchronous reproduction button (not shown) And the synchronous reproduction instruction of the image data D1 and the process data D2 is input to the device body 11 (S400, YES), and the CPU 111 starts the image data reproduction program and the data synchronization control program stored in the program memory unit 113a, and starts the process. In other words, the CPU 111 of the apparatus main body 11 first functions as a video data reproducing unit by executing the video data reproducing program, and reads the video header information D11 of the video data D1 stored in the data storage unit 113b. And the process data header information D21 of the process data D2 is temporarily stored in the memory 112, and then the frame period Tf included in the image header information D11 and the sampling interval Ts2 included in the process data header information D21 are obtained ( S410). Here, as described above, the CPU 111 obtains, for example, 1/30 second, 19 323150 201242349 as the frame period Tf, and acquires, for example, lm seconds as the sampling interval Ts2. Further, before the CPU 111 processes the S400, it is of course possible to obtain the frame period Tf and the sampling interval Ts2 by the S410 processing. Furthermore, the CPU 111 does not take the frame period Tf included in the image header information mi when the frame period Tf of the packet 3 in the image header information Du is known, and only obtains the packet 3 in the process data label. The sampling interval of the header information Mi. Then, the CPU 111 is used as a t-data reproducing unit of the present invention by the execution of the image data reproducing program, and the QS timer (not shown) is used, and the frame period of the image data W is 1/1. The timer interval is generated in the 3 second interval (S420). Then the CPU 111 is generated at the Tf 1/30 second interval belonging to the frame period: the ten-time event signal (10) 〇, ''is') It is reproduced as image data of the present invention. p functions as 'and reads the image frame D12 stored in the data storage unit (1) 相 phase 2 image data D1, and if the image frame D i 2 is encoded by 4 $, etc., the image frame ρ ΐ 2卩=式, etc. are decoded and reproduced in the frame number (10) = number of the 12th image image coffee, etc., and the image frame is designated to be reproduced. In addition, the image frame (10) is again = frame of the figure: number:, by the keyboard 13 or the mouse 14, in the display:: Γ == picture, face _ specify (four). Not pointed to = shape, from the image data D1: 疋 疋 from the frame number #丨_(four) box D12 ^ image 1 ^ </ 印 at this stage, image data a data. : Two:: Month 32315〇 201242349 Born. At the same time, the CPU 111 is executed as the data synchronous reproduction control unit of the present invention by executing the related program: Step First, the currently reproduced image frame D12_: coffee is obtained. Here, please treat 0, also =
樣地，CPU111在包含於爭偾戶商咨h h ^ 1J * 〜像‘頭#訊阳的圖框週期Tf 為已知之情形中’則使用已知的圖框週期Tf。 = ’cPUm會以現在再生中之影像驗M2的圖樞 編就、與圖框週期Tf為基礎，藉由以下式⑴計算For example, the CPU 111 uses the known frame period Tf in the case where the arbitrator's consultation h h ^ 1J * ~ the frame period Tf of "head # 阳阳 is known". = 'cPUm will be based on the image of M2 in the current reproduction, and based on the frame period Tf, calculated by the following formula (1)
始影像圖㈣相對時間」⑽〇) ’來作為本發明 步再生控制部， 叶J (:，起始影像圖框的相對時間」=圖框編號父圖框週期以… 接著，CPU111將從前述第⑴式求得「從起始影像圖 框的相對時間」，以如下式⑵所示方式，藉由以暫時儲存 在記，體丨丨2等之過程資料D2的取樣間隔Ts2進行除算， 而計算出與現在顯示中之影像圖框D12同步之數值資料 於2的記錄編號（S470)，作為本發明之資料同步再^控制 部。 上 「應同步之數值資料的記錄編號」=「從起始影像圖框的相 對時間」+取樣間隔Ts2…（2) 然後，CPU111以由前述第（2)式求得「應同步之數值 負料的5己錄編说」為基礎，從過程貧料D 2選擇對應之_x己錄 編號的數值資料D22並進行顯示（S480)。藉此，cpuiu不 323150 21 201242349 用參照時刻資訊，即可經由影像圖框D12的圖框編號、與 數值資料D22的記錄編號，使與現在顯示中之影像圖框D12 時間上同步的同步數值資料D22同步並再生。此時，CPU111 例如在以圖形形式等顯示過程資料D2之情形時，會將該記 錄編號之數值資料D22轉換成圖形形式等，且將包含在以 圖形顯示之範圍之值予以更新，而進行更新圖形的顯示。 另外，數值資料D22係由複數個項目#1至#3構成之情形 中，係使複數個項目#1至#3反映於圖形。 然後，CPU111會在由使用者輸入同步再生中止指示、 或是現在正再生之影像資料D1之最終影像圖框D12為止再 生結束（S490，“否”），於每次以屬於圖框週期Tf的1/30 秒間隔產生計時器事件訊號（S430 “是”），藉由前述S440 至S480的處理，進行圖框編號與記錄編號相對應之影像圖 框D12與數值資料D22的同步再生處理。 因此，在本第一實施形態之資料同步再生裝置1，係 不參照時刻資訊，而使影像資料D1的圖框編號與數值資料 D22的記錄編號相對應，且使構成影像資料D1的影像圖框 D12、與構成過程資料D2的數值資料D22同步而進行再生。 於是，CPU111在由使用者輸入同步再生中止指示、或 是現在再生中之影像資料D1最終影像圖框D12為止再生結 束之情形（S490.，. “是下，.則結束同步再生處理。. (從影像資料D1向過程資料D2同步再生之具體例） 接著，以圖示說明從影像資料D1向過程資料D2同步 再生之具體例。 22 323150 201242349 第5圖係為顯示從影像資料D1向過程資料D2同步再 生處理時之具體例。另外，第5圖省略了影像資料D1的影 像標頭資訊D1卜與過程資料D2的過程資料標頭資訊D21。 如第5圖所示，在本第一實施形態之資料同步再生裝 置1中，例如將影像資料D1中從起始影像圖框算起第三個 圖框之圖框編號#3的影像圖框再生時，因本第一實施形 態，圖框週期Tf為1/30秒，故CPU111藉由前述式（1)計 算出「從圖框編號#1之起始影像圖框D12的相對時間」為 3x1/30=0. 1秒。接著，CPU111因取樣間隔Ts2為lm秒， 故計算出「從起始數值資料的記錄編號」為0. 1秒/lm秒 = 100，而使記錄編號#100的數值資料D22再生。 因此，如依本第一實施形態之資料同步再生裝置1， 構成影像資料D1的影像圖框D12與構成過程資料D2的數 值資料D22，於記錄時不用取同步，而且，影像圖框D12 的圖框週期Tf與數值資料D22的取樣時間Ts2即使不一 致，亦不使用影像圖框D12及數值資料D22的時刻資訊， 而是使用影像圖框D12的圖框編號與數值資料D22的記錄 編號等，即可進行同步再生影像圖框D12與數值資料D22。 結果，如依本第一實施形態之資料同步再生裝置1， 於影像資料D1與過程資料D2的同步再生處理中，因變得 無需參照雙方資料的時刻資訊，故使得無需解析尋找影像 資料D1及過程資料D2的語法（構造）或標頭資訊，而可以 高速地執行同步再生處理。The initial image (4) relative time" (10) 〇) 'As the step reproduction control unit of the present invention, the leaf J (:, relative time of the start image frame) = frame number parent frame period is... Next, the CPU 111 will be as described above The equation (1) finds "relative time from the start image frame", and divides by the sampling interval Ts2 of the process data D2 temporarily stored in the record, the volume 2, etc., as shown in the following equation (2). The record number (S470) of the numerical data synchronized with the image frame D12 currently displayed is calculated as the data synchronization control unit of the present invention. The "record number of the numerical data to be synchronized" = "from The relative time of the initial image frame + the sampling interval Ts2 (2) Then, the CPU 111 is based on the "5-recorded description of the numerical value of the negative-synchronized material" which is obtained from the above formula (2). D 2 selects the corresponding numerical data D22 of the _x recorded number and displays it (S480). By this, cpuiu does not use 323150 21 201242349, and the frame number of the image frame D12 and the numerical data D22 can be obtained by using the reference time information. Record number to make it display now In the image frame D12, the synchronized numerical data D22 synchronized in time is synchronized and reproduced. At this time, the CPU 111 converts the numerical data D22 of the record number into a graphic form, for example, when the process data D2 is displayed in a graphical form or the like. And the update graphic is displayed by updating the value included in the range of the graphic display. In addition, the numerical data D22 is composed of a plurality of items #1 to #3, and the plurality of items #1 to # are caused. 3. The CPU 111 then ends the reproduction by the user inputting the synchronous reproduction suspension instruction or the final image frame D12 of the image data D1 being reproduced now (S490, NO), belonging to each time. The timer event signal is generated at intervals of 1/30 second of the frame period Tf (S430: YES), and the image frame D12 and the numerical data D22 corresponding to the record number are performed by the processing of the foregoing S440 to S480. Therefore, in the data synchronous playback device 1 of the first embodiment, the frame number of the video data D1 and the numerical data D22 are not referred to without referring to the time information. Corresponding to the record number, the image frame D12 constituting the image data D1 is reproduced in synchronization with the numerical data D22 constituting the process data D2. Then, the CPU 111 inputs the synchronous reproduction stop instruction or the current reproduction by the user. In the case where the reproduction of the image data D1 is completed in the final image frame D12 (S490., "Yes, the end of the synchronous reproduction processing is completed. (Specific example of synchronous reproduction from the image data D1 to the process data D2) A specific example of synchronous reproduction from the image data D1 to the process data D2 will be described. 22 323150 201242349 Fig. 5 is a view showing a specific example of the synchronous reproduction processing from the image data D1 to the process data D2. Further, Fig. 5 omits the process header information D21 of the image header information D1 of the image data D1 and the process data D2. As shown in Fig. 5, in the data synchronous reproduction device 1 of the first embodiment, for example, the image frame of the frame number #3 of the third frame is counted from the start image frame in the image data D1. At the time of reproduction, in the first embodiment, since the frame period Tf is 1/30 second, the CPU 111 calculates "relative time from the start image frame D12 of the frame number #1" by the above formula (1). 3x1/30=0. 1 second. Next, since the CPU 111 calculates the sampling interval Ts2 to be lm seconds, "the recording number from the starting value data" is calculated to be 0.1 second/lm seconds = 100, and the numerical data D22 of the recording number #100 is reproduced. Therefore, according to the data synchronous reproduction device 1 of the first embodiment, the image frame D12 constituting the image data D1 and the numerical data D22 constituting the process data D2 are not synchronized during recording, and the image frame D12 is not shown. The frame period Tf and the sampling time Ts2 of the numerical data D22 do not use the time information of the image frame D12 and the numerical data D22, but use the frame number of the image frame D12 and the record number of the numerical data D22, that is, It is possible to synchronously reproduce the image frame D12 and the numerical data D22. As a result, according to the data synchronous reproduction device 1 of the first embodiment, in the synchronous reproduction processing of the image data D1 and the process data D2, since it is not necessary to refer to the time information of both materials, it is not necessary to analyze and search for the image data D1. The syntax (construction) or header information of the process material D2 can perform synchronous reproduction processing at high speed.
另外，在前述第一實施形態說明中，雖說明了於由OS 23 323150 201242349 計時器於各個圖框週期Tf每次發生計時器事件，藉由前述 式（1)及式（2)，計算「從起始影像圖框的相對時間」，並根 據「從起始影像圖框的相對時間」逐一計算應同步再生之 數值資料D22的記錄編號，但本發明並不以此為限；在藉 由前述式（1)及式（2)，一次計算出應同步再生之數值資料 D22的記錄編號之情形下，之後，由0S計時器於各個圖框 週期Tf每次發生計時器事件時，將應同步再生之數值資料 D22的記錄編號以+ 1遞增之方式當然亦可。如依此進行， 只要藉由S450至S470之處理計算出最初應同步再生之數 值資料D22的記錄編號而進行同步再生；則以後，不必執 行S450至S470之處理，只要將最初算出之應同步再生之 數值資料D22的記錄編號以+ 1遞增之處理，即可使構成影 像資料D1的影像圖框D12、與構成過程資料D2的數值資 料D22之同步再生處理變得可能，亦使更高速且處理負更 輕之同步再生處理變得可能。 (說明從過程資料D2向影像資料D1的同步再生動作） 接著，參照流程圖說明有關本第一實施形態之資料同 步再生裝置1中從過程資料D2向影像資料D1的同步再生 處理。 第6圖係為顯示藉由本第一實施形態之資料同步再生 裝置.1之資料.同步顯示處理順序之流程圖。.............. 使用者在顯示於監視器12之過程資料D2的顯示區域 中，例如，藉由滑鼠14或鍵盤13等移動捲棒或游標等， 以指定在過程資料D2中之數值資料D22，且來自指定之數 24 323150 201242349 值資料D22與影像圖框D12的同步A 4 _ 丹生才日示輸入裝詈太鞞 U時（謂’ “是”）.11會藉由執行資料同步 式來作為資料同步再生控制部發揮功能； 工， 指定之數值資料D22的記錄編號、與從過程資料 ^ D21的取樣間隔Ts2(S610)。 下 或於同時’CPU111係作為資料同步再生控制部發揮功 能’而從影像資料D1之影像標頭資訊Du取得圖框週期 n cpimi |這些取樣件隔Ts2及影像圖框 週期Tf為已儲存，且為已知之情況中，當然亦可省略這些 的取得處理。 — 接著’ CPU111發揮作為資料同步再生控制部之功能， 而根據取樣間隔Ts2、與藉由捲棒或游標等指定之數值資 料D22的記錄編號，如下述式（3)所示，計算在過程資料 D2中「從起始數值資料的相對時間」（smo)。 「從起始數值資料的相對時間」=現在記錄編號X取樣間隔Further, in the description of the first embodiment, it is described that the timer event occurs every time in the frame period Tf by the timer of the OS 23 323150 201242349, and the equations (1) and (2) are calculated. From the relative time of the starting image frame, and according to the "relative time from the starting image frame", the record number of the numerical data D22 to be synchronously reproduced is calculated one by one, but the invention is not limited thereto; In the case of the above equations (1) and (2), the record number of the numerical data D22 to be synchronously reproduced is calculated once, and then, each time a timer event occurs in each frame period Tf by the OS timer, It is of course also possible to increase the record number of the synchronously reproduced numerical data D22 by +1. According to this, the synchronous reproduction is performed by calculating the record number of the numerical data D22 that should be synchronously reproduced at the first time by the processing of S450 to S470; thereafter, it is not necessary to perform the processing of S450 to S470, as long as the initially calculated one should be synchronously reproduced. The process of incrementing the record number of the numerical data D22 by +1 makes it possible to synchronize the image frame D12 constituting the image data D1 with the numerical data D22 constituting the process data D2, and also enables higher speed processing. Negative and lighter synchronized regeneration processing becomes possible. (Synchronous reproduction operation from the process data D2 to the video data D1) Next, the synchronous reproduction processing from the process data D2 to the video data D1 in the data synchronization reproducing apparatus 1 of the first embodiment will be described with reference to a flowchart. Fig. 6 is a flow chart showing the sequence of the synchronous display processing by the data synchronous reproducing apparatus of the first embodiment. . . ....... The user moves the roll bar or cursor in the display area of the process data D2 displayed on the monitor 12, for example, by the mouse 14 or the keyboard 13 or the like. Specify the numerical data D22 in the process data D2, and the synchronization from the specified number 24 323150 201242349 value data D22 and the image frame D12 A 4 _ Dan Sheng only shows the input device is too 鞞 U (say 'Yes') The .11 functions as a data synchronous reproduction control unit by executing the data synchronization type; the recording number of the designated numerical data D22 and the sampling interval Ts2 of the secondary processing data D21 (S610). Or at the same time, 'CPU 111 functions as a data synchronous reproduction control unit' and obtains a frame period n cpimi from the image header information Du of the image data D1 | These sample pieces Ts2 and the image frame period Tf are stored, and In the case of the known one, of course, the acquisition processing of these may be omitted. - Then, the CPU 111 functions as a data synchronous reproduction control unit, and calculates the process data as shown in the following equation (3) based on the sampling interval Ts2 and the record number of the numerical data D22 specified by a scroll bar or a cursor. "relative time from the starting value data" (smo) in D2. "relative time from the starting value data" = now record number X sampling interval
Ts2…（3) 接著，CPU111如下述式（4)所示，將藉由式（3)計算之 「從起始數值資料的相對時間」，用影像圖框D12每一個圖 框時間的圖框週期Tf進行除算，計算出與現在數值資料同 步之「應同步影像圖框的圖框編號」（S64〇)。 「應同步影像圖框的圖框編號」=從起始相對時間·;·圖框週 期Tf…⑷ 於是，CPU111作為影像資料再生部發揮功能，根據藉 由前述式（4)計算之圖框編號，從儲存在資料記憶部113b 25 323150 201242349 的影像資料D1中，讀出符合圖框編號的影像圖框D12並進 行再生（S640)。藉此，如依本第一實施形態，藉由數值資 料D22的記錄編號、與影像圖框D12的圖框編號，指定數 值資料D22之影像圖框D12的同步處理變得可能。 (從過程資料D2向影像資料01的同步再生具體例） 接著，圖示說明從過程資料D2向影像資料D1同步再 生的具體例。 第7圖係為顯示從過程資料D2向影像資料D1同步再 生處理時之具體例。另外，第7圖，亦與第5圖同樣地， 省略表示影像資料D1的影像標頭資訊D11、與過程資料D2 的過程資料標頭資訊D21。 換言之，在本第一實施形態之資料同步再生裝置1 中，例如第7圖所示地，過程資料D2中，使用者在顯示於 監視器12之過程資料D2的顯示區域中，藉由滑鼠14或鍵 盤13等移動捲棒或游標等，將例如從起始數值D22算起第 134號之記錄編號#134的數值資料D22設為指定資料。 如此一來，在本第一實施形態中，因取樣間隔Ts2為 1mm秒，故藉由前述式（3)，「從起始數值資料的相對時間」 為第134個xlm秒= 134m秒。然後，應與第134個數值資料 D22同步之影像圖框D12的圖框編號，因圖框週期Tf為 1/30秒，故藉由前述.式（4)為：134m秒K1/30秒）=4. 02 = 4，故由起始影像圖框D12算起第4個之圖框編號#4的影 像圖框D12，係作為與記錄編號#134號的數值資料D22進 行同步再生。 26 323150 201242349 •因此，如依本第一實施形態之資料同步再生裝置l， ♦ 不必使用影像圖框D12或數值資料D22的時刻資訊，而使 * 用影像圖框D12的圖框編號與數值資料D22的記錄編號 等，只要指定數值資料D22，就可使對應影像資料D1的影 像圖框D12進行同步再生。 另外，在本第一實施形態之資料同步再生裝置1中， 雖於記憶部113的記憶部113b儲存包含控制機器51至5η 從複數個監視對象物61至6ρ依時間序列取得之複數個數 值資料的過程資料D2，但包含於過程資料D2之資料，不 限定為數值資料，亦可為位元資料或文字資料。 (顯示晝面具體例） 接著，說明有關顯示於本第一實施形態之資料同步再 生裝置1之監視器12之顯示晝面的具體例。 第8圖至第12圖係分別為顯示於本第一實施形態之 資料同步再生裝置1之監視器12之顯示晝面121至125 的具體例圖。另外，顯示於第8圖至第12圖之顯示晝面 121至125,係為藉由本第一實施形態之資料同步再生裝置 1的CPU111執行儲存於程式記憶部113a的資料同步控制 程式來作為晝面配置設定部發揮功能而進行設定或變更之 顯示晝面例。換言之，顯示於第8圖至第12圖的顯示晝面 121至125係為CPU111發揮作為晝面配置設定部之功能， 在監視器12上設定根據使用者指示而顯示影像資料的影 像資料再生區域、與顯示過程資料之過程資料再生區域， 並且在影像資料再生區域中，在預定條件内，設定並顯示 27 323150 201242349 應再生之影像資料數量及大小的顯示晝面例。 在顯示於第8圖之顯示畫面121中，發揮作為晝面配 置設定部功能而在顯示晝面121中央較上側設置影像資料 顯示區域121a，另一方面，於顯示晝面121中央較下側設 置過程資料顯示區域121b。然後，在該顯示晝面121，於 影像資料顯示區域121a設置4個影像資料顯示視窗121al 至121a4，且在這4個影像資料顯示視窗121al至121a4 顯示，攝影機切換器3由使用者指示或自動地切換，而從 複數台ITV攝影機21至2m中，例如攝影機編號#1至#4 (camera 1至4)之4台ITV攝影機拍攝所得的動態影像影 像資料D1。 再者，在該顯示晝面121中，為攝影機切換器3所切 換之機編號#1至#4(camera 1至4)之4台ITV攝影機所拍 攝之監視對象物的過程資料D2,係再生於過程資料顯示區 域121b。在此，關於過程資料顯示區域121b之圖上水平 方向之橫轴係表示時間軸，另一方面，圖上垂直方向之縱 軸係表示構成過程資料D2之數值資料D22的值（準位）。 然後，分別再生於4個影像資料顯示視窗121al至 121a4之影像資料D1，與在過程資料顯示區域121b所再生 之過程資料D2,係藉由作為資料同步再生控制部發揮功能 的CPU 11L，.奴前述地，_藉由影像圖框D12..的圖框編號_、與 數值資料D22的記錄編號進行同步而再生。 另外，在該顯示晝面121的過程資料顯示區域121b， 為了變換再生之過程資料D2時刻，而在圖上顯示會向水平 28 323150 201242349 方向移動之過程資料時刻變更棒（bar)121b2等。使用者藉 由鍵盤13或滑鼠14在顯示畫面121上操作游標（圖中未示） 來操作過程資料時刻變更棒121b2，就可執行過程資料⑽ 之時間轴的放大/縮小或放大顯示。 再者在第8圖中，121 b3係為指定顯示在過程資料 顯示區域121b之過程資料抽出記錄（快照）開始位置的抽 ^記錄開始位置指定棒；121b4係為用以指定顯示在過程 資料顯示區域121b之過程資料抽出記錄結束位置的抽出 圮錄結束位置指定棒；前述抽出記錄開始位置指定棒及抽 出記錄結束位置指定棒為使用在後述之第二實施形態的抽 出圮錄（快照）之指定棒，在第一實施形態不使用。如前述 藉由使用者使用滑鼠14或鍵盤13等，可使諸指定棒在過 私資料顯示區域121 b中移動。 在顯示於第9圖之顯示晝面122中，為了放大並顯示 過程資料D2，在顯示晝面122全體，顯示了過程資料顯示 區域122b之放大狀態。因此’在顯示於第9圖之顯示晝面 122中’無法顯示在第8圖之顯示畫面121上存在於顯示 旦面121中央上半側之影像資料顯示區域121 a，故顯示影 像資料顯示區域122a重疊於過程資料顯示區域122b，且 於該資料顯示區域122a’設置4個影像資料顯示視窗122ai 至 122a4。 於第10圖所示之顯示晝面123,與顯示於第8圖之顯 示晝面121同樣地，於顯示畫面12 3中央較上側設置影像 資料顯示區域123a，另一方面，於顯示晝面123中央較下 323150 29 201242349 側設置過程資料顯示區域123b。然後，在該顯示晝面123， 於影像資料顯示區域123a設置2個影像資料顯示區域 123al、123a2，在影像資料顯示區域123al顯示來自攝影 機編號#1之ITV攝影機21的動態影像影像資料D1，另一 方面，在影像資料顯示區域123a2顯示來自相同攝影機編 號#1之ITV攝影機21 (camera 1)的靜止圖像之影像資料 D1。再者，在該顯示畫面123，在過程資料顯示區域123b， 係顯示與來自顯示於影像資料顯示區域123al之攝影機編 號#1之ITV攝影機21的動態影像影像資料D1同步，而且， 顯示控制機器從攝影機編號#1之ITV攝影機21所拍攝之 監視對象物取得的過程資料D2。此外，過程資料顯示區域 123b與顯示於第8圖、第9圖之顯示晝面121、122之過 程資料顯示區域121b、122b沒有絲毫不同。 在顯示於第11圖之顯示畫面124,與顯示於第8圖顯 示晝面121同樣地，係於顯示晝面124中央較上侧設置影 像資料顯示區域124a，另一方面，於顯示晝面124中央較 下侧設置過程資料顯示區域124b。然後，在該顯示畫面 124，於影像資料顯示區域124a，與顯示於第10圖的顯示 晝面123同樣地，設置2個影像資料顯示區域124al、 124a2,在影像資料顯示區域124al顯示來自攝影機編號#1 之I.TV攝影機.21.攸動.態影腺影像資料D.1，另一方面v在.. 影像資料顯示區域124a2顯示來自相同攝影機編號#1之 I TV攝影機21 (camera 1)而拍攝時刻係分開的4個靜止圖 像之影像資料D1。 30 323150 201242349 再者，於過程資料D2，包含例如有正滾軋之軋製材批 號等的文字資料時，於過程資料顯示區域124b顯示文字資 料 124C 。 此外，過程資料顯示區域124b係與顯示於第8圖至 第10圖之顯示晝面121至123之過程資料顯示區域121b 至123b沒有絲毫不同。 顯示於第12圖之顯示畫面125,與顯示於第8圖之顯 示晝面121同樣地，於顯示晝面125中央較上侧設置影像 資料顯示區域125a，另一方面，於顯示晝面125中央較下 側設置過程資料顯示區域125b。然後，在該顯示晝面125， 於影像資料顯示區域125a，顯示有例如用以從4台攝影機 影像選擇2台的攝影機影像的攝影機影像指定按鈕125al， 藉由該攝影機影像指定按鈕125al所選擇之來自攝影機編 號#1、#3之2台ITV攝影機21、23(Camera 1、3)的動態 影像資料則顯示於影像資料顯示區域125al、125a3。依此 方式，則該顯示晝面125的影像資料顯示區域125a2、125a3 之視窗大小，相較於顯示於第10圖之顯示晝面123中之影 像資料顯示區域123a卜123a2的視窗，雖然較小，因相較 於顯示於第8圖之顯示晝面121中之影像資料顯示區域 123al至121a4的視窗，則為較大，故容易看見影像資料 D1。再者，在該顯示晝面125，過程資料顯示區域125b與 顯示於第8圖至第11圖之顯示畫面121至124之過程資料 顯示區域121b至124b沒有絲毫不同。 如前述說明，依照本第一實施形態之資料再生裝置 31 323150 201242349 1，不用參照影像資料m &過程資料D2的時刻資訊， 構成影像資料D1之影像圖框D12的圖框編號及圖框週期Ts2 (3) Next, the CPU 111 uses the "relative time from the starting value data" calculated by the equation (3) as shown in the following formula (4), and uses the frame of each frame time of the image frame D12. The period Tf is divided, and the "frame number of the image frame to be synchronized" synchronized with the current numerical data is calculated (S64). "Frame number of the image frame to be synchronized" = from the start relative time · frame period Tf (4) Then, the CPU 111 functions as a video data reproducing unit, and based on the frame number calculated by the above formula (4) The image frame D12 matching the frame number is read from the image data D1 stored in the data storage unit 113b 25 323150 201242349 and reproduced (S640). As a result, according to the first embodiment, it is possible to specify the synchronization processing of the image frame D12 of the digital data D22 by the recording number of the numerical data D22 and the frame number of the video frame D12. (Specific Example of Synchronous Reproduction from Process Data D2 to Video Data 01) Next, a specific example of synchronous reproduction from the process data D2 to the video data D1 will be described. Fig. 7 is a view showing a specific example when the process data D2 is synchronized to the image data D1. Further, in the same manner as in the fifth drawing, the image header information D11 indicating the image data D1 and the process data header information D21 of the process data D2 are omitted. In other words, in the data synchronous playback device 1 of the first embodiment, for example, as shown in Fig. 7, in the process data D2, the user displays the mouse in the display area of the process data D2 displayed on the monitor 12 by the mouse. 14 or the keyboard 13 or the like moves the roll bar or the cursor, etc., and the numerical data D22 of the record number #134 of No. 134 from the start value D22 is set as the designated material, for example. As described above, in the first embodiment, since the sampling interval Ts2 is 1 mm second, the relative time from the starting value data is 134 x lm seconds = 134 m seconds by the above formula (3). Then, the frame number of the image frame D12 which should be synchronized with the 134th numerical data D22, because the frame period Tf is 1/30 second, the equation (4) is: 134 m seconds K1/30 seconds) =4. 02 = 4, the image frame D12 of the fourth frame number #4 from the start image frame D12 is synchronously reproduced as the numerical data D22 of the record number #134. 26 323150 201242349 • Therefore, according to the data synchronous reproducing apparatus 1 according to the first embodiment, ♦ it is not necessary to use the time information of the image frame D12 or the numerical data D22, and the frame number and numerical data of the image frame D12 are used. When the numerical data D22 is specified by the recording number of D22 or the like, the video frame D12 corresponding to the video data D1 can be synchronously reproduced. Further, in the data synchronous playback device 1 of the first embodiment, the plurality of numerical data obtained by the control devices 51 to 5n from the plurality of monitoring objects 61 to 6ρ in time series are stored in the storage unit 113b of the storage unit 113. The process data D2, but the data contained in the process data D2, is not limited to numerical data, and may also be bit data or text data. (Specific example of display face) Next, a specific example of the display face of the monitor 12 displayed on the data synchronous/reproducing device 1 of the first embodiment will be described. Fig. 8 to Fig. 12 are diagrams showing specific examples of the display faces 121 to 125 of the monitor 12 of the data synchronous reproduction device 1 of the first embodiment. Further, the display screens 121 to 125 shown in Figs. 8 to 12 are the data synchronization control program stored in the program storage unit 113a by the CPU 111 of the data synchronous reproduction device 1 of the first embodiment. An example of the display and setting of the surface layout setting unit to perform setting or change. In other words, the display screens 121 to 125 shown in FIGS. 8 to 12 are functions in which the CPU 111 functions as a face configuration setting unit, and the image data reproduction area in which the image data is displayed in accordance with the user's instruction is set on the monitor 12. And the process data reproduction area for displaying the process data, and in the image data reproduction area, within a predetermined condition, the display and display of the number and size of the image data to be reproduced 27 323150 201242349 are set and displayed. In the display screen 121 shown in FIG. 8, the image data display area 121a is provided on the upper side of the center of the display screen 121 as a function of the face arrangement setting unit, and is provided on the lower side of the center of the display side 121. The process data display area 121b. Then, on the display screen 121, four image data display windows 121a1 to 121a4 are provided in the image data display area 121a, and displayed in the four image data display windows 121a1 to 121a4, the camera switcher 3 is instructed by the user or automatically By switching from the plurality of ITV cameras 21 to 2m, for example, four ITV cameras of camera numbers #1 to #4 (camera 1 to 4) capture the obtained moving image data D1. Further, in the display screen 121, the process data D2 of the monitoring object imaged by the four ITV cameras of the machine numbers #1 to #4 (camera 1 to 4) switched by the camera switch 3 is reproduced. In the process data display area 121b. Here, the horizontal axis in the horizontal direction on the map of the process data display area 121b represents the time axis, and on the other hand, the vertical axis in the vertical direction on the figure indicates the value (level) of the numerical data D22 constituting the process data D2. Then, the image data D1 reproduced in the four image data display windows 121a1 to 121a4 and the process data D2 reproduced in the process data display area 121b are respectively used by the CPU 11L, which functions as the data synchronization reproduction control unit. As described above, the frame number _ of the image frame D12.. is reproduced in synchronization with the record number of the numerical data D22. Further, in the process data display area 121b of the display screen 121, in order to change the process data D2 at the time of reproduction, a process data time change bar (bar) 121b2 which moves in the direction of the horizontal 28 323150 201242349 is displayed on the map. The user operates the process data time change bar 121b2 by operating the cursor (not shown) on the display screen 121 by the keyboard 13 or the mouse 14, and the time axis of the process data (10) can be enlarged/reduced or enlarged. Further, in Fig. 8, 121 b3 is a drawing start position specifying bar for designating the start position of the process data extraction record (snapshot) displayed in the process material display area 121b; 121b4 is for specifying the display on the process data display. In the process area of the area 121b, the extraction/recording end position specifying bar of the recording end position is extracted; and the extraction recording start position designation bar and the extraction recording end position designation bar are designated by using the extraction recording (snapshot) of the second embodiment to be described later. The rod is not used in the first embodiment. The designated bars are moved in the unauthorized material display area 121b by the user using the mouse 14 or the keyboard 13 or the like as described above. In the display screen 122 shown in Fig. 9, in order to enlarge and display the process data D2, the enlarged state of the process data display area 122b is displayed on the entire display screen 122. Therefore, 'in the display screen 122 shown in FIG. 9', the image data display area 121a existing on the upper half of the display surface 121 on the display screen 121 of FIG. 8 cannot be displayed, so that the image data display area is displayed. 122a is superimposed on the process material display area 122b, and four image data display windows 122ai to 122a4 are provided in the material display area 122a'. The display screen 123 shown in FIG. 10 is similar to the display screen 121 shown in FIG. 8, and the image data display area 123a is provided on the upper side of the display screen 123, and the display surface 123 is displayed on the upper side. The process data display area 123b is set on the side of the lower center 323150 29 201242349. Then, on the display screen 123, two image data display areas 123a1 and 123a2 are provided in the image data display area 123a, and the motion picture image data D1 of the ITV camera 21 from the camera number #1 is displayed in the image data display area 123al. On the other hand, the video material D1 of the still image from the ITV camera 21 (camera 1) of the same camera number #1 is displayed in the video material display area 123a2. Further, on the display screen 123, in the process data display area 123b, the video image data D1 from the ITV camera 21 of the camera number #1 displayed in the video material display area 123al is displayed, and the display control device is displayed. The process data D2 obtained by the monitoring target image captured by the ITV camera 21 of the camera number #1. Further, the process data display area 123b is not different from the process data display areas 121b, 122b displayed on the display faces 121, 122 of Figs. 8 and 9. In the display screen 124 shown in FIG. 11, the image data display area 124a is provided on the upper side in the center of the display pupil plane 124, and the display screen 124 is displayed on the display side 124 in the same manner as the display screen 121 shown in FIG. The process data display area 124b is disposed at the lower side of the center. Then, on the display screen 124, in the video material display area 124a, two video material display areas 124a1 and 124a2 are provided in the same manner as the display screen surface 123 shown in FIG. 10, and the camera number is displayed in the video material display area 124al. #1的I.TV Camera. 21.攸. The state of the gland image data D.1, on the other hand v.. The image data display area 124a2 displays the I TV camera 21 (camera 1) from the same camera number #1. The shooting time is the image data D1 of the four still images separated. 30 323150 201242349 Further, when the process data D2 includes, for example, a text material such as a rolled material batch number being rolled, the character data 124C is displayed in the process data display area 124b. Further, the process data display area 124b is not different from the process data display areas 121b to 123b displayed on the display faces 121 to 123 of Figs. 8 to 10 . The display screen 125 shown in Fig. 12 is provided with the image data display area 125a on the upper side in the center of the display screen surface 125, and on the other side in the display screen surface 125, similarly to the display screen surface 121 shown in Fig. 8. The process data display area 125b is set on the lower side. Then, on the display screen 125, in the image data display area 125a, for example, a camera image designation button 125al for selecting two camera images from four camera images is displayed, which is selected by the camera image designation button 125al. The moving image data of the two ITV cameras 21 and 23 (Camera 1, 3) from the camera numbers #1 and #3 are displayed on the image data display areas 125a1 and 125a3. In this manner, the size of the window of the image data display areas 125a2 and 125a3 of the display screen 125 is smaller than that of the image data display area 123a 123a2 displayed in the display surface 123 of FIG. Since it is larger than the window of the image data display areas 123al to 121a4 displayed in the display pupil 121 of Fig. 8, the image data D1 is easily seen. Further, in the display screen 125, the process material display area 125b is not different from the process material display areas 121b to 124b displayed on the display screens 121 to 124 of Figs. 8 to 11 . As described above, the data reproducing apparatus 31 323150 201242349 1 according to the first embodiment does not refer to the time information of the image data m & process data D2, and constitutes the frame number and frame period of the image frame D12 of the image data D1.
Tf、與構成過程資料D2之數值資料卿的記錄編號及取樣 間隔Ts2 $ ’即可使影像圖框奶與數值資料峨的同步 再生，且可在監視器12顯示如顯示於第8圖至第a圖之 顯示晝面121至125所示的顯示晝面。結果，依照本第一 實施形態之資料同步再生裝置丨，於影像資料^與數值資 料D22的同步再生處理，因無需參照雙方資料的時刻資 訊’故可減少樓案數量及檔案記憶容量，且用與以往相同 記憶容量的記憶裝置，相較於以往，.更長時間的記憶斑同 步再生變得可能。 再者’於影像保存時，因可利用MPEG_4等影像圖框 壓縮、解碼技術，故於影像再生時’可使用⑻主 冊商標）播放II等通用性影像資料再生程式，藉此可減少開 發成本0 就可高速的同步再生資料 而且，不必使用時刻資訊， 與影像圖框，或進行提示。 (第二實施形態） 在前述第一實施形態，已說明了有關不參照時刻資 訊’而使用影像圖框D12的圖框編號、與數值資料D22的 記錄編號之影像資料D1與過程資料D2的同步再生處理； 但在第二實施形態，係在第一實施形態之功能上追力^ :再 藉由從過程資料D2指定範圍資料數值D22的抽出記錄，亦 即藉由指定應快照記錄之數值資料D22的範圍，可自動地 323150 32 201242349 儲存與該指定範圍數值資料D22同步的影像資料D12之方 式而構成的功能。因此’在本第二實施形態之資料同步再 生裝置，相對於第一實施形態之資料同步再生裝置1的功 能，係再追加了快照記錄之功能者；於儲存在程式記憶部 113a之資料同步控制程式中’係設為包含有屬於該快照記 錄功能之作為同步保存控制部而發揮功能的程式者。另 外，第二實施形態之資料再生裝置之構成因係與第一實施 形態相同，故請參照顯示於第1圖及第2圖之第一實施形 態之構成，僅說明具特徵之動作。 換言之’在第二實施形態之資料同步再生裝置1，在 顯不於監視益12之過程資料顯不區域]_21b中，使用者夢· 由使用滑鼠14或鍵盤13荨而移動抽出記錄開始位置指定 棒121b3及抽出s己錄終了位置指定棒I21b4，而如第§圖 所示地，進行指定從過程資料D2抽出進行另外記錄之過程 資料D2 ’的範圍。然後’當使用者點選保存按鈕（圖中未示） 等時’ cpuiii就執行儲存在程式記憶部U3a的資料同步 控制程式’首先’作為同步影像圖框選擇部發揮功能，將 使用者所指定範圍之數值資料D22的記錄編號，與2述第 一實施形態同步再生情形同樣地，藉由前述數學式、數 學式（4)等，轉換成同步於其指定範圍數值資料])^範圍之 影像圖框D12的圖框編號。 接著，CPU111藉由執行資料同步控制程式而作為同步 保存控制部發揮功能’使依制者所指定範_數值㈣ D22、與同步於該指定範圍數值資料奶之影像圖框⑽ 323150 33 201242349 相對應形成與影像資料D1與過程資料D2的資料檔案Df 分開的另外資料檔案Df，亦即，從影像資料D1及過程資 料D2的資料檔案Df抽出由使用者所指定範圍的數值資料 D22、與同步於該指定範圍數值資料D22的影像資料D12 之形態，儲存在資料記憶部113b。 因此，在第二實施形態之資料同步再生裝置1，可藉 由郵件程式（mai 1 program)將該稽案附加於電子郵件等， 經由網際網路或内部網路等網路，傳送至其他電腦裝置。 藉此，接收到儲存為使用者指定範圍的數值資料D22、 與同步於該範圍數值資料D22的影像圖框D12之檔案的其 他電腦裝置，只要具有與第一實施形態或第二實施形態之 資料同步再生裝置1同樣之影像資料D1與過程資料D2的 同步再生功能，即可從接收到的檔案同步再生使用者指定 範圍的數值資料D22、與同步於該範圍數值資料D22的影 像圖框D12，而使執行遠端診斷等變為可能。 (產業上之利用可能） 本發明可適用於監視工廠之線上資料管理系統。 【圖式簡單說明】 第1圖係為顯示包含本發明資料再生裝置之線上數據 管理系統之構成例圖； 第2 .圖係為顯示..關於本發.明資料同步再生.裝置的構成 例之方塊圖； 第3A圖係為顯示記憶於資料同步再生裝置之資料記 憶部的影像資料與過程資料之檔案形式例圖； 34 323150 201242349 :係為顯示影像資料之資料結構例圖； #、為顯示過程資料之資料結構例圖； 所執行之==由第一實施形態之資料同步再生裝置 ^枓冋步顯示處理順序的流程圖； 步再影像資_向過程資料-進行同 第6圖係為—第_實施形態之資料同步再生裝置之 貝料同步顯示處理順序的流程圖； 第7圖係為顯示從數值資料向影像資料進行再生 處理時之具體例圖； 第8圖係為顯示於第一實施形態之資料同步再生裝置 之監視器顯示晝面之一例圖； 、 第9圖係為顯示於第一實施形態之資料同步再生裝置 之監視器顯示晝面之另一例圖； 第10圖係為顯示於第一實施形態之資料同步再生裝 置之監視器顯示晝面之另一例圖； 第11圖係為顯示於第一實施形態之資料同步再生裝 置之監視器顯示晝面之另一例圖； 第12圖係為顯示於第一實施形態之資料同步再生裝 置之監視器顯示晝面之另一例圖； 【主要元件符號說明】 資料同步再生裝置 攝影機切換器4 數位影像轉換單元 LAN(Local Area Network，區域網路） 323150 35 201242349 11 13 21 至 2m 51 至 5n 61 至 6p 111 監視器 滑鼠 裝置本體 鍵盤. ι4 ΙΊΎ攝影機（m為自然數） 控制機器（η為自然數） 監視對象物（ρ為自然數） cm影像資料再生部、資料同步再生控制部、 同步影像圖框選擇部、，保存㈣部、畫面 配置設定部） 112 113a 113b 114 115 116 D1 D12 記憶體 113 程式記憶部 資料記憶部（影像資料 外部機器I/F部 控制網路I/F部 LAN Ι/p 部 （I? 影像資料 D2 影像圖框 D22 記憶部 ’己憶部、過程資料記憶部） 内部匯流排 過程資料 數值資料 323150 36Tf, the record number of the numerical data constituting the process data D2, and the sampling interval Ts2 $ ' can synchronously reproduce the image frame milk and the numerical data ,, and can be displayed on the monitor 12 as shown in Fig. 8 to The display of the figure a shows the faces shown by the faces 121 to 125. As a result, according to the data synchronous reproduction device of the first embodiment, the synchronous reproduction processing of the image data and the numerical data D22 can reduce the number of cases and the file memory capacity without referring to the time information of both materials. Compared with the conventional memory device, the memory device of the same memory capacity has a longer time. Furthermore, in the case of image storage, since image frame compression and decoding techniques such as MPEG_4 can be used, it is possible to use a general image data reproduction program such as II (U.S. main book trademark) during image reproduction, thereby reducing development costs. 0 It is possible to synchronize data at high speed and without having to use time information, with image frames, or to make a prompt. (Second Embodiment) In the first embodiment described above, the synchronization of the frame number of the video frame D12 and the video data D1 of the recording number of the numerical data D22 with the process data D2 has been described without referring to the time information '. Reproduction processing; however, in the second embodiment, the function is searched for in the function of the first embodiment: by extracting the record of the range data value D22 from the process data D2, that is, by specifying the numerical data to be recorded by the snapshot. The range of D22 can be automatically 323150 32 201242349 The function of storing the image data D12 synchronized with the specified range numerical data D22. Therefore, in the data synchronous reproduction apparatus of the second embodiment, the function of the data synchronization reproduction apparatus 1 of the first embodiment is added with the function of snapshot recording; and the data synchronization control stored in the program storage unit 113a In the program, the program is set to include a program that functions as the synchronization save control unit belonging to the snapshot recording function. Further, since the configuration of the data reproducing apparatus of the second embodiment is the same as that of the first embodiment, the configuration of the first embodiment shown in Figs. 1 and 2 will be described, and only the characteristic operation will be described. In other words, in the data synchronous reproducing apparatus 1 of the second embodiment, in the process data display area not shown in the monitoring benefit 12, the user dreams to move the extracted recording start position by using the mouse 14 or the keyboard 13荨. The designated bar 121b3 and the extracted sever have recorded the position specifying bar I21b4, and as shown in Fig. §, the range of the process data D2' designated to be extracted from the process data D2 for additional recording is performed. Then, 'when the user clicks the save button (not shown), etc.' cpuiii executes the data synchronization control program 'first' stored in the program memory unit U3a as the synchronous image frame selection unit, and the user specifies The recording number of the numerical data D22 of the range is converted into an image synchronized with the numerical data of the specified range by the mathematical expression, the mathematical expression (4), and the like in the same manner as the synchronous reproduction of the first embodiment. The frame number of frame D12. Next, the CPU 111 functions as a synchronous storage control unit by executing the data synchronization control program. 'The specified value_4 (D) D22 of the controller is associated with the image frame (10) 323150 33 201242349 synchronized with the specified range of data milk. Forming another data file Df separate from the data file D1 of the image data D1 and the process data D2, that is, extracting the numerical data D22 of the range specified by the user from the data file D1 of the image data D1 and the process data D2, and synchronizing with The form of the image data D12 of the specified range numerical data D22 is stored in the data storage unit 113b. Therefore, in the data synchronous playback device 1 of the second embodiment, the account can be attached to an e-mail or the like via a mail program (mai 1 program), and transmitted to another computer via a network such as the Internet or an internal network. Device. Thereby, the other computer device that receives the value data D22 stored in the range specified by the user and the file frame D12 synchronized with the range value data D22 has the data of the first embodiment or the second embodiment. The synchronous reproduction function of the same image data D1 and the process data D2 of the synchronous reproduction device 1 can synchronously reproduce the numerical data D22 of the user-specified range and the image frame D12 synchronized with the range numerical data D22 from the received file. It is possible to perform remote diagnosis and the like. (Industrial Applicability) The present invention is applicable to an online data management system for monitoring factories. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a diagram showing an example of a configuration of an online data management system including a data reproducing apparatus of the present invention. Fig. 2 is a diagram showing a configuration example of a synchronous reproduction of the present invention. Figure 3A is a diagram showing an example of the file format of the image data and process data stored in the data memory of the data synchronous reproduction device; 34 323150 201242349: an example of a data structure for displaying image data; An example of the structure of the data showing the process data; executed == a flow chart showing the processing sequence by the data synchronous reproduction device of the first embodiment; the step re-image resource _ to the process data - the same as the sixth figure The flow chart of the process of synchronous display of the material synchronous display of the data synchronous reproduction device of the first embodiment; FIG. 7 is a view showing a specific example of the process of reproducing the data from the numerical data to the image data; FIG. 9 is a view showing an example of a monitor display surface of the data synchronous playback device according to the first embodiment; and FIG. 9 is a monitor of the data synchronous playback device shown in the first embodiment. FIG. 10 is another example of the monitor display surface of the data synchronous reproduction device of the first embodiment; FIG. 11 is a data synchronization shown in the first embodiment. FIG. 12 is another example of the monitor display surface of the data synchronous reproduction device of the first embodiment; [Key element symbol description] Data synchronous reproduction device Camera Switcher 4 Digital Image Conversion Unit LAN (Local Area Network) 323150 35 201242349 11 13 21 to 2m 51 to 5n 61 to 6p 111 Monitor Mouse Device Body Keyboard. ι4 ΙΊΎ Camera (m is a natural number) Control device (n is a natural number) Object to be monitored (ρ is a natural number) cm Image data reproduction unit, data synchronization reproduction control unit, synchronization image frame selection unit, save (four) unit, screen layout setting unit) 112 113a 113b 114 115 116 D1 D12 Memory 113 Program Memory Data Memory (Image Data External Device I/F Control Network I/F LAN Ι/p) (I? Image data D2 image frame D22 Memory Department ‘Remembrance Department, Process Data Memory Department Internal Busbar Process Data Numerical Data 323150 36