TW202129495A - Debugging system and early warning system - Google Patents
Debugging system and early warning system Download PDFInfo
- Publication number
- TW202129495A TW202129495A TW109102620A TW109102620A TW202129495A TW 202129495 A TW202129495 A TW 202129495A TW 109102620 A TW109102620 A TW 109102620A TW 109102620 A TW109102620 A TW 109102620A TW 202129495 A TW202129495 A TW 202129495A
- Authority
- TW
- Taiwan
- Prior art keywords
- debugging
- communication interface
- learning device
- learning
- error information
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/0793—Remedial or corrective actions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/07—Responding to the occurrence of a fault, e.g. fault tolerance
- G06F11/0703—Error or fault processing not based on redundancy, i.e. by taking additional measures to deal with the error or fault not making use of redundancy in operation, in hardware, or in data representation
- G06F11/079—Root cause analysis, i.e. error or fault diagnosis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/325—Display of status information by lamps or LED's
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/32—Monitoring with visual or acoustical indication of the functioning of the machine
- G06F11/324—Display of status information
- G06F11/327—Alarm or error message display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/453—Help systems
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Quality & Reliability (AREA)
- Software Systems (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- Human Computer Interaction (AREA)
- Debugging And Monitoring (AREA)
Abstract
Description
本揭示內容是關於一種除錯系統及一種預警系統,且特別是關於一種自動化除錯系統及預警系統。 The present disclosure relates to a debugging system and an early warning system, and particularly to an automated debugging system and an early warning system.
一般而言,當機台或電腦等電子設備發生問題時,電子設備將發出告警訊息以通知現場操作人員,接著操作人員能根據告警訊息進行障礙排除。 Generally speaking, when there is a problem with electronic equipment such as a machine or computer, the electronic equipment will send an alarm message to notify the on-site operator, and then the operator can remove the obstacle based on the alarm message.
然而,操作人員有更替時,如輪班制或有新進人員等,往往會有經驗不足或不熟悉電子設備等因素,而有不知如何障礙排除或障礙排除的操作步驟錯誤的問題發生。 However, when operating personnel are replaced, such as shifts or new recruits, there are often factors such as inexperience or unfamiliarity with electronic equipment, and the problem of how to eliminate the obstacles or the wrong operation steps occurs.
因此,有關上述的問題,是本領域的重要課題之一。 Therefore, the above-mentioned problems are one of the important issues in this field.
本揭示內容的一態樣係關於一種除錯系統,包含通訊介面裝置和學習裝置。通訊介面裝置通訊連接受控裝置與學習裝置。通訊介面裝置包含擷取單元。擷取單元擷取受控裝置之操作畫面。於受控裝置發生異常時由操作畫面提取異常錯 誤資訊。學習裝置包含至少一除錯子集。至少一除錯子集中任一者分別包含錯誤模型與對應錯誤模型的自動除錯步驟或除錯說明。學習裝置通過通訊介面裝置接收異常錯誤資訊,且於比對異常錯誤資訊相符於至少一除錯子集各自的錯誤模型時,學習裝置輸出對應的自動除錯步驟或除錯說明至受控裝置。 One aspect of the present disclosure relates to a debugging system including a communication interface device and a learning device. The communication interface device communicatively connects the controlled device and the learning device. The communication interface device includes a capturing unit. The capturing unit captures the operation screen of the controlled device. When the controlled device is abnormal, the abnormal error is extracted from the operation screen Misinformation. The learning device includes at least one debug subset. Any one of at least one debugging subset includes an error model and an automatic debugging step or a debugging description of the corresponding error model, respectively. The learning device receives the abnormal error information through the communication interface device, and when the abnormal error information is compared with the respective error models of at least one debug subset, the learning device outputs the corresponding automatic debugging steps or debugging instructions to the controlled device.
本揭示內容的另一態樣係關於一種預警系統,包含通訊介面裝置及學習裝置。通訊介面裝置連接至受控裝置。通訊介面裝置包含擷取單元。擷取單元擷取受控裝置之操作畫面。於受控裝置發生異常時由操作畫面提取異常錯誤資訊。學習裝置連接通訊介面裝置。學習裝置通過通訊介面裝置偵測異常錯誤資訊。學習裝置收集當異常錯誤資訊生成前的受控裝置的一或多個過往操作畫面或受控裝置所執行的一或多個過往操作指令。學習裝置根據收集到的一或多個過往操作畫面或一或多個過往操作指令產生至少一預警模型。學習裝置依據受控裝置的當前操作畫面及當前輸入指令判斷符合至少一預警模型時,學習裝置輸出警告通知。 Another aspect of the present disclosure relates to an early warning system including a communication interface device and a learning device. The communication interface device is connected to the controlled device. The communication interface device includes a capturing unit. The capturing unit captures the operation screen of the controlled device. When the controlled device is abnormal, the abnormal error information is extracted from the operation screen. The learning device is connected to the communication interface device. The learning device detects abnormal error information through the communication interface device. The learning device collects one or more past operation screens of the controlled device or one or more past operation commands executed by the controlled device before the abnormal error information is generated. The learning device generates at least one early warning model according to the collected one or more past operation screens or one or more past operation instructions. When the learning device determines that the at least one early warning model is met according to the current operation screen of the controlled device and the current input command, the learning device outputs a warning notification.
100a、100b、100c:除錯系統 100a, 100b, 100c: debugging system
120:受控裝置 120: controlled device
140:通訊介面裝置 140: Communication interface device
142:擷取單元 142: Capture Unit
150:遠端電腦 150: remote computer
160:學習裝置 160: learning device
162:儲存單元 162: storage unit
180:操控裝置 180: control device
190:顯示裝置 190: display device
200:除錯方法 200: debugging method
S210、S220、S230、S240、S250、S260、S270、S280、 S290:操作 S210, S220, S230, S240, S250, S260, S270, S280, S290: Operation
T1、T2、T3:提示視窗 T1, T2, T3: prompt window
B1、B2、B3、B4、B5:按鈕 B1, B2, B3, B4, B5: buttons
V1、V2:視窗 V1, V2: Windows
M1、M2:範圍 M1, M2: range
MR:影像 MR: image
500:預警方法 500: Early Warning Method
600:預警模型建立方法 600: Early warning model establishment method
S510、S520、S610、S620、S630:操作 S510, S520, S610, S620, S630: Operation
第1A圖係根據本揭示內容之部分實施例繪示一種除錯系統的示意圖。 FIG. 1A is a schematic diagram of a debugging system according to some embodiments of the present disclosure.
第1B圖係根據本揭示內容之部分實施例繪示另一種除錯系統的示意圖。 FIG. 1B is a schematic diagram showing another debugging system according to some embodiments of the present disclosure.
第1C圖係根據本揭示內容之其他部分實施例繪示另一種除錯系統的示意圖。 FIG. 1C is a schematic diagram of another debugging system according to other embodiments of the present disclosure.
第2圖係根據本揭示內容之部分實施例繪示一種除錯方法的流程圖。 FIG. 2 is a flowchart of a debugging method according to some embodiments of the present disclosure.
第3圖係根據本揭示內容之部分實施例繪示一種操作畫面示意圖。 FIG. 3 is a schematic diagram of an operation screen according to some embodiments of the present disclosure.
第4圖係根據本揭示內容之部分實施例繪示另一種操作畫面示意圖。 FIG. 4 is a schematic diagram of another operation screen according to some embodiments of the present disclosure.
第5圖係根據本揭示內容之部分實施例繪示一種預警方法的流程圖。 FIG. 5 is a flowchart of an early warning method according to some embodiments of the present disclosure.
第6圖係根據本揭示內容之部分實施例繪示一種預警模型建立方法的流程圖。 FIG. 6 is a flowchart of a method for establishing an early warning model according to some embodiments of the present disclosure.
下文係舉實施例配合所附圖式作詳細說明,以更好地理解本案的態樣,但所提供之實施例並非用以限制本揭露所涵蓋的範圍,而結構操作之描述非用以限制其執行之順序,任何由元件重新組合之結構,所產生具有均等功效的裝置,皆為本揭露所涵蓋的範圍。此外,根據業界的標準及慣常做法,圖式僅以輔助說明為目的,並未依照原尺寸作圖,實際上各種特徵的尺寸可任意地增加或減少以便於說明。下述說明中相同元件將以相同之符號標示來進行說明以便於理解。 The following is a detailed description of the embodiments in conjunction with the accompanying drawings to better understand the aspect of the case, but the provided embodiments are not intended to limit the scope covered by the disclosure, and the description of the structural operations is not intended to limit The order of execution, and any structure that recombines components, produces a device with an equal effect, all within the scope of this disclosure. In addition, according to industry standards and common practices, the drawings are only for the purpose of supplementary explanation, and are not drawn in accordance with the original dimensions. In fact, the dimensions of various features can be arbitrarily increased or decreased for ease of explanation. In the following description, the same elements will be described with the same symbols to facilitate understanding.
在全篇說明書與申請專利範圍所使用之用詞(terms),除有特別註明外,通常具有每個用詞使用在此領 域中、在此揭露之內容中與特殊內容中的平常意義。某些用以描述本揭露之用詞將於下或在此說明書的別處討論,以提供本領域技術人員在有關本揭露之描述上額外的引導。 Unless otherwise specified, the terms used in the entire specification and the scope of the patent application usually have each term used here. The ordinary meaning in the domain, in the content disclosed here, and in the special content. Some terms used to describe the present disclosure will be discussed below or elsewhere in this specification to provide those skilled in the art with additional guidance on the description of the present disclosure.
此外,在本文中所使用的用詞『包含』、『包括』、『具有』、『含有』等等,均為開放性的用語,即意指『包含但不限於』。此外,本文中所使用之『及/或』,包含相關列舉項目中一或多個項目的任意一個以及其所有組合。 In addition, the terms "include", "include", "have", "contain", etc. used in this article are all open terms, meaning "including but not limited to". In addition, the "and/or" used in this article includes any one of one or more of the related listed items and all combinations thereof.
於本文中,當一元件被稱為『連接』或『耦接』時,可指『電性連接』或『電性耦接』。『連接』或『耦接』亦可用以表示二或多個元件間相互搭配操作或互動。 In this text, when an element is referred to as "connection" or "coupling", it can refer to "electrical connection" or "electrical coupling". "Connected" or "coupled" can also be used to mean that two or more components cooperate or interact with each other.
此外,雖然本文中使用『第一』、『第二』、…等用語描述不同元件,該用語僅是用以區別以相同技術用語描述的元件或操作。除非上下文清楚指明,否則該用語並非特別指稱或暗示次序或順位,亦非用以限定本發明。 In addition, although terms such as “first”, “second”, etc. are used to describe different elements in this document, the terms are only used to distinguish elements or operations described in the same technical terms. Unless the context clearly indicates, the terms do not specifically refer to or imply order or sequence, nor are they used to limit the present invention.
第1A圖係根據本揭示內容之部分實施例繪示一種除錯系統100a的示意圖。如第1A圖所示,除錯系統100a包含受控裝置120、通訊介面裝置140、學習裝置160和操控裝置180。通訊介面裝置140連接受控裝置120、學習裝置160和操控裝置180。通訊介面裝置140包含擷取單元142。學習裝置160包含儲存單元162。於一實施例中,學習裝置160可以是與受控裝置120設置在不同位置(例如不同機房或同一機房的不同區塊)的遠端電腦。
FIG. 1A is a schematic diagram of a
具體而言,通訊介面裝置140可為KVM切換器或iKVM切換器(網路型切換器)。擷取單元142可由通訊介面
裝置140中的處理器,或者能夠用以擷取受控裝置120之操作畫面的硬體或軟體所實現。
Specifically, the
受控裝置120可為機台、電腦、生產線上的機具等等,透過VGA端子(Video Graphics Array connector)及/或通用序列匯流排(Universal Serial Bus,USB)連接通訊介面裝置140。其中,受控裝置120也可為各類電子裝置之連接後組合而成,以進一步藉由VGA端子、USB連接至通訊介面裝置140。
The controlled
操控裝置180可為鍵盤、滑鼠、觸控板、觸控螢幕、機台按鈕等等輸入裝置,透過序列埠(Serial port)及/或通用序列匯流排連接通訊介面裝置140。
The
學習裝置160可為電腦、平板、手機等等,透過VGA端子、DVI、HDMI、DP(Display Port)等連接介面及/或通用序列匯流排連接通訊介面裝置140。在部分實施例中,學習裝置160透過區域網路(Local Area Network,LAN)或網際網路(Internet)連接通訊介面裝置140。此外,學習裝置160可以位於相當於受控裝置120的近端或遠端,本發明並非為限制。
The
儲存單元162可包含一或多個記憶體。記憶體可由唯讀記憶體(read only memory,ROM)、快閃記憶體、軟碟、硬碟、光碟、快閃碟、隨身碟、磁帶、可從網路讀取的資料庫,或任何本揭示內容所屬技術領域中具有通常知識者所能想到具相同功能的記錄媒體所實現。
The
第1B圖係根據本揭示內容之部分實施例繪示另
一種除錯系統100b的示意圖。於第1B圖所示實施例中,與第1A圖的實施例中相似的元件係以相同的元件符號表示,其內容已於先前段落說明者,於此不再贅述。和第1A圖所示實施例相比,在本實施例中,除錯系統100b更包含遠端電腦150。操控裝置180連接遠端電腦150,遠端電腦150連接通訊介面裝置140。具體而言,操控裝置180可透過各種序列埠及/或通用序列匯流排連接遠端電腦150。遠端電腦150可透過區域網路或網際網路連接通訊介面裝置140。
Figure 1B is based on some embodiments of the present disclosure.
A schematic diagram of a
值得注意的是,上述硬體裝置或連線方式僅為方便說明舉例,但本揭示不以此為限。此外,雖然第1B圖中繪示一個受控裝置120、一個遠端電腦150、一個學習裝置160、一個通訊介面裝置140以及一個操控裝置180,但其數量僅為方便說明起見之示例,並非用以限制本揭示內容。也就是說,在其他部分實施例中,除錯系統中通訊介面裝置可連接複數個受控裝置及/或複數個學習裝置。
It is worth noting that the above-mentioned hardware devices or connection methods are only examples for convenience of illustration, but the present disclosure is not limited thereto. In addition, although Figure 1B shows a controlled
第1C圖係根據本揭示內容之部分實施例繪示另一種除錯系統100c的示意圖。於第1C圖所示實施例中,與第1A圖的實施例中相似的元件係以相同的元件符號表示,其內容已於先前段落說明者,於此不再贅述。和第1A圖所示實施例相比,在本實施例中,除錯系統100c所包含的操控裝置180連接學習裝置160。具體而言,操控裝置180可透過各種序列埠及/或通用序列匯流排連接學習裝置160。於此實施例中,學習裝置160可以是與受控裝置120設置在不同位置(例如不同機房或同一機房的不同區塊)的遠端電腦。
FIG. 1C is a schematic diagram illustrating another
值得注意的是,上述硬體裝置或連線方式僅為方便說明舉例,但本揭示不以此為限。此外,雖然第1A圖和第1C圖中繪示一個受控裝置120、一個學習裝置160一個通訊介面裝置140以及一個操控裝置180,但其數量僅為方便說明起見之示例,並非用以限制本揭示內容。也就是說,在其他部分實施例中,除錯系統中通訊介面裝置可連接複數個受控裝置及/或複數個學習裝置。
It is worth noting that the above-mentioned hardware devices or connection methods are only examples for convenience of illustration, but the present disclosure is not limited thereto. In addition, although Figures 1A and 1C show a
第2圖係根據本揭示內容之部分實施例繪示一種除錯方法200的流程圖。為便於說明起見,除錯系統100a、100b或100c當中各個元件的具體操作將搭配第1A圖、第1B圖或第1C圖所示實施例進行說明,但不以此為限,任何熟習此技藝者,在不脫離本案之精神和範圍內,當可對作各種更動與潤飾。
FIG. 2 is a flowchart of a
下列段落將先說明,第2圖應用在第1A圖所示之除錯系統100a的應用範例。首先,於一實施例中,通訊介面裝置140偵測受控裝置120是否發生異常(如操作S210所示)。若受控裝置120沒有發生異常時,則通訊介面裝置140持續偵測受控裝置120是否有發生異常(即重複進行操作S210)。具體而言,當受控裝置120出現錯誤訊息、跳出錯誤視窗或發出警示音等情形時,通訊介面裝置140則判定受控裝置120有發生異常。
The following paragraphs will first explain the application example of Fig. 2 applied to the
當受控裝置120發生異常時,擷取單元142擷取受控裝置120之操作畫面(如操作S220所示)。接著,擷取單元142由操作畫面提取異常錯誤資訊(如操作S230所示)。具體而言,擷取單元142可用以提取操作畫面中的文字及/或圖像作
為異常錯誤資訊。
When the controlled
接著,學習裝置160通過通訊介面裝置140接收異常錯誤資訊(如操作S240所示)。
Then, the
接著,學習裝置160比對異常錯誤資訊是否相符於至少一除錯子集中各自的錯誤模型(如操作S250所示)。具體而言,學習裝置160包含至少一除錯子集,且除錯子集中任一者分別包含錯誤模型與對應該錯誤模型的自動除錯步驟或除錯說明。於一實施例中,各除錯子集是儲存於儲存單元162中。
Then, the
於此,當異常錯誤資訊相符於錯誤模型時,學習裝置160輸出對應的自動除錯步驟或除錯說明至受控裝置120(如操作S260所示)。具體而言,在部分實施例中,當異常錯誤資訊相符於錯誤模型時,學習裝置160將直接輸出對應的自動除錯步驟至受控裝置120進行除錯,其中自動除錯步驟可包含一或多個自動除錯指令。自動除錯指令可為一或多個鍵盤按鍵輸入或滑鼠點擊按鈕的順序。如此一來,當除錯系統100a偵測到受控裝置120發生異常時,便能根據異常錯誤資訊和錯誤模型的比對結果,輸出對應的自動除錯指令至受控裝置120,以進行自動障礙排除。
Here, when the abnormal error information matches the error model, the
在其他部分實施例中,當異常錯誤資訊相符於錯誤模型時,學習裝置160輸出除錯說明至受控裝置120,其中除錯說明可為包含文字或圖像的提示視窗。進一步詳細而言,當學習裝置160輸出除錯說明至受控裝置120之後,學習裝置160將等待自操控裝置180接收到對應於除錯說明的確認指
令,根據確認指令輸出對應除錯說明的一或多個自動除錯指令至受控裝置120。例如,除錯說明包含自動除錯說明(如第3圖中提示視窗T1所示),自動除錯說明對應一或多個自動除錯指令。當學習裝置160自操控裝置180接收到確認指令(如,點擊第3圖中按鈕B1的操作)時,學習裝置160輸出對應此確認指令的所有自動除錯指令至受控裝置120進行除錯。
In other embodiments, when the abnormal error information matches the error model, the
又例如,除錯說明包含逐步除錯說明,逐步除錯說明包含複數個除錯提示(如第4圖中提示視窗T2、T3所示)。除錯提示每一者分別對應一或多個自動除錯指令中之一者。而確認指令包含複數個逐步確認指令(如,依序點擊第4圖中按鈕B2、B5的操作)。當學習裝置160自操控裝置180接收到逐步確認指令中之一者時,學習裝置160輸出對應此逐步確認指令的自動除錯指令。
For another example, the debugging instructions include step-by-step debugging instructions, and the step-by-step debugging instructions include multiple debugging prompts (as shown in the prompt windows T2 and T3 in Figure 4). Each of the debugging prompts corresponds to one of one or more automatic debugging instructions. The confirmation instruction includes a plurality of step-by-step confirmation instructions (for example, the operations of clicking buttons B2 and B5 in Figure 4 in sequence). When the
在部分實施例中,除錯提示可包含引導指標(如第4圖所示提示視窗T2、T3)、引導點擊範圍(如第4圖所示範圍M1或M2)、或記憶回放影片(如第4圖所示影像MR)。引導指標、引導點擊範圍或記憶回放影片以子母畫面或以疊加方式顯示於操控裝置180對應的顯示裝置上。例如,在第4圖中所示之視窗V1內播放過往操作畫面,而在視窗V2內顯示當前操作畫面並設置對應當前操作畫面的一些指令執行按鈕B2~B5。
In some embodiments, the debugging prompt may include guidance indicators (such as the prompt windows T2 and T3 shown in Figure 4), a guidance click range (such as the range M1 or M2 shown in Figure 4), or a memory playback video (such as the section M1 or M2). Picture 4 shows the image MR). The guide indicator, the guide click range or the memory playback video are displayed on the display device corresponding to the
值得注意的是,第3圖和第4圖中所繪示的操作畫面可透過顯示裝置190顯示,並給使用者觀看。其中,顯示裝置190可為各種顯示器、電腦螢幕、平板、手機等等,本發明
並不以此為限。此外,顯示裝置190可根據使用者進行操作的位置不同,或對應於操控裝置180的連接關係,而連接於受控裝置120、通訊介面裝置140,或者學習裝置160。
It is worth noting that the operation screens shown in FIGS. 3 and 4 can be displayed through the
如此一來,當除錯系統100a偵測到受控裝置120發生異常時,便能根據異常錯誤資訊和錯誤模型的比對結果,輸出對應的自動除錯說明或逐步除錯說明,讓使用者可以透過確認指令選擇除錯系統100a給予的所有自動除錯指令以進行自動障礙排除,或者透過逐步確認指令根據除錯提示決定是否選擇當前除錯系統100a給予的下一步自動除錯指令。換言之,使用者也可以拒絕除錯系統100a給予的自動除錯指令,改為自行透過操控裝置180進行手動障礙排除(具體內容請參考下述操作S270~S290的說明)。
In this way, when the
當使用者拒絕除錯系統100a給予的自動除錯指令,或者當異常錯誤資訊不相符於錯誤模型時,使用者得透過操作操控裝置180產生排除異常錯誤資訊之除錯操控輸入訊號,以進一步傳送至受控裝置120(如操作S270所示)。換言之,使用者可透過操作操控裝置180來針對受控裝置120進行手動除錯。
When the user rejects the automatic debugging command given by the
接著,學習裝置160透過通訊介面裝置140接收操控裝置180產生的除錯操控輸入訊號(如操作S280所示)。在部分實施例中,操作S280和操作S270可同時進行。具體而言,使用者透過操控裝置180產生除錯操控輸入訊號,通訊介面裝置140接收這些除錯操控輸入訊號並傳送至受控裝置120和學習裝置160。
Then, the
接著,學習裝置160根據除錯操控輸入訊號以及異常錯誤資訊自至少一除錯子集中更新或建立新增除錯子集(如操作S290所示)。具體而言,在受控裝置120發生異常之後,通訊介面裝置140開始擷錄排除錯誤過程中操作畫面的影片以及自操控裝置180產生的除錯操控輸入訊號,例如鍵盤輸入數據、滑鼠點擊座標等資料。此外,通訊介面裝置140也記錄了對應於操作畫面影片的這些除錯操控輸入訊號之產生的時間。接著,學習裝置160透過場景轉換演算法(Scene change detection)分析介面轉換並作為分割點,並將每個分割點之間的影像和輸入資料作為一筆訓練資料進行訓練(training),以更新或建立新增除錯子集(即,新的錯誤模型,以及相對於此錯誤模型的自動除錯步驟或除錯說明)。舉例來說,分割點可為操作畫面影片中視窗的切換,或者可為預設的鍵盤快速鍵輸入、滑鼠點擊特定按鈕。
Then, the
如此一來,當使用者拒絕除錯系統100a給予的自動除錯指令,或者當異常錯誤資訊不相符於錯誤模型時,使用者可透過操控裝置180進行手動障礙排除,且通訊介面裝置140會將此過程中的操作畫面影片和除錯操控輸入訊號記錄並進行訓練,使得學習裝置160能夠進行機器學習,以更新或建立新的錯誤模型及其對應的自動除錯指令。
In this way, when the user rejects the automatic debugging command given by the
下列段落將接著說明第2圖應用在第1B圖所示之除錯系統100b的應用範例。當第2圖應用在第1B圖所示之除錯系統100b時,在操作S270中,操控裝置180產生排除異常錯誤資訊之除錯操控輸入訊號,以進一步透過遠端電腦150和通訊
介面裝置140傳送至受控裝置120。換言之,使用者可透過連接於遠端電腦150上的操控裝置180在遠端針對受控裝置120進行手動除錯。於此實施例中,遠端電腦150是經由通訊介面裝置140取得受控裝置120的畫面,因此使用者得以於遠端以操控裝置180對受控裝置120進行操控。
The following paragraphs will then describe the application example of Fig. 2 applied to the
當第2圖應用在第1B圖所示之除錯系統100b時,在操作S280b中,學習裝置160分析操控裝置180產生的除錯操控輸入訊號。如此一來,當使用者拒絕除錯系統100b給予的自動除錯指令,或者當異常錯誤資訊不相符於錯誤模型時,使用者可透過連接於遠端電腦150的操控裝置180進行手動障礙排除,並透過通訊介面裝置140將除錯操控輸入訊號傳送置受控裝置120進行除錯。而學習裝置160能夠透過通訊介面裝置140記錄除錯操控輸入訊號並進行訓練進行機器學習,以更新或建立新的錯誤模型及其對應的自動除錯指令。
When FIG. 2 is applied to the
下列段落將接著說明第2圖應用在第1C圖所示之除錯系統100c的應用範例。當第2圖應用在第1C圖所示之除錯系統100c時,在操作S270中,操控裝置180產生排除異常錯誤資訊之除錯操控輸入訊號並透過學習裝置160和通訊介面裝置140傳送至受控裝置120。換言之,使用者可透過連接於學習裝置160上的操控裝置180在遠端針對受控裝置120進行手動除錯。
The following paragraphs will then describe the application example of FIG. 2 applied to the
當第2圖應用在第1B圖所示之除錯系統100c時,在操作S280中,學習裝置160分析操控裝置180產生的除錯操控輸入訊號。如此一來,當使用者拒絕除錯系統100c給予的自
動除錯指令,或者當異常錯誤資訊不相符於錯誤模型時,使用者可透過連接於學習裝置160的操控裝置180進行手動障礙排除,使得學習裝置160能夠記錄除錯操控輸入訊號並進行訓練進行機器學習,以更新或建立新的錯誤模型及其對應的自動除錯指令,並透過通訊介面裝置140將除錯操控輸入訊號傳送置受控裝置120進行除錯。
When FIG. 2 is applied to the
請參考第5圖。第5圖係根據本揭示內容之部分實施例繪示一種預警方法500的流程圖。如第5圖所示,預警方法500包含操作S510以及S520。
Please refer to Figure 5. FIG. 5 is a flowchart of an
首先,在操作S510中,學習裝置160依據受控裝置120的當前操作畫面及當前輸入指令判斷是否符合至少一預警模型。當不符合時,繼續進行操作S510。當符合時,進行操作S520,學習裝置160輸出警告通知。具體而言,警告通知可為包含文字或圖像的警告視窗、機台上閃爍的警示燈,或者發出警示音。
First, in operation S510, the
請參考第6圖。第6圖係根據本揭示內容之部分實施例繪示一種預警模型建立方法600的流程圖。如第6圖所示,預警模型建立方法600包含操作S610、S620以及S630。
Please refer to Figure 6. FIG. 6 is a flowchart of a
首先,在操作S610中,擷取單元142擷取受控裝置120之過往操作畫面或過往操作指令。接著,在操作S620中,偵測受控裝置120是否發生異常。操作S620相似於操作S210,在此不再贅述。當受控裝置120沒有發生異常時,繼續進行操作S610與操作S620。當受控裝置120發生異常時,即經操作S620判斷受控裝置120有異常時,進行操作S630,學
習裝置160根據收集到的一或多個過往操作畫面或一或多個過往操作指令產生至少一預警模型。
First, in operation S610, the capturing
具體而言,通訊介面裝置140的擷取單元142隨時在記錄受控裝置120的操作畫面及操控裝置180產生的操作指令。當受控裝置120發生異常時,學習裝置160透過透過通訊介面裝置140接收在受控裝置120發生異常前一段期間內的過往操作畫面,及/或此期間內操控裝置180產生的過往操作指令,例如鍵盤輸入數據、滑鼠點擊座標等資料。此外,通訊介面裝置140也記錄了相對於操作畫面這些操作指令所產生的時間。接著,學習裝置160透過場景轉換演算法分析介面轉換並作為分割點,並將每個分割點之間的影像和操作指令作為一筆訓練資料進行訓練,以建立預警模型。舉例來說,分割點可為操作畫面影片中視窗的切換,或者可為預設的鍵盤快速鍵輸入、滑鼠點擊特定按鈕。
Specifically, the
在部分實施例中,學習裝置160所包含的儲存單元162用以暫存受控裝置120運行時之操作畫面。當學習裝置160通過通訊介面裝置140偵測異常錯誤資訊時,學習裝置160由儲存單元162所暫存的操作畫面提取異常錯誤資訊生成前的受控裝置120的一或多個過往操作畫面或一或多個過往操作指令。
In some embodiments, the
此外,學習裝置160更用以分析異常錯誤資訊生成前的一或多個過往操作畫面以得到過往錯誤畫面特徵,並在學習裝置160輸出之警告通知時,在警告通知內包含此過往錯誤畫面特徵的提示。又,學習裝置160更用以分析異常錯誤資
訊生成前的一或多個過往操作指令以得到過往錯誤操作指令,並在學習裝置160輸出之警告通知時,在警告通知內包含此過往錯誤操作指令的提示。
In addition, the
如此一來,藉由針對過往出現的異常錯誤訊息前的操作畫面及操作指令進行機器學習,並透過判斷受控裝置120的當前操作畫面及當前輸入指令是否符合預警模型,便能在可能出現異常錯誤資訊之前發出警告通知,以避免反覆產生同樣的異常錯誤資訊。
In this way, by performing machine learning on the operation screen and operation instructions before abnormal error messages that have occurred in the past, and by judging whether the current operation screen and current input instructions of the controlled
雖然本文將所公開的方法示出和描述為一系列的步驟或事件,但是應當理解,所示出的這些步驟或事件的順序不應解釋為限制意義。例如,部分步驟可以以不同順序發生和/或與除了本文所示和/或所描述之步驟或事件以外的其他步驟或事件同時發生。另外,實施本文所描述的一個或多個態樣或實施例時,並非所有於此示出的步驟皆為必需。此外,本文中的一個或多個步驟亦可能在一個或多個分離的步驟和/或階段中執行。 Although the disclosed methods are shown and described herein as a series of steps or events, it should be understood that the order of these steps or events shown should not be construed in a limiting sense. For example, some steps may occur in a different order and/or simultaneously with other steps or events other than the steps or events shown and/or described herein. In addition, when implementing one or more aspects or embodiments described herein, not all the steps shown here are necessary. In addition, one or more steps in this document may also be executed in one or more separate steps and/or stages.
需要說明的是,在不衝突的情況下,在本揭示內容各個圖式、實施例及實施例中的特徵與電路可以相互組合。圖式中所繪示的電路僅為示例之用,係簡化以使說明簡潔並便於理解,並非用以限制本案。此外,上述各實施例中的各個裝置、單元及元件可以由各種類型的數位或類比電路實現,亦可分別由不同的積體電路晶片實現,或整合至單一晶片。上述僅為例示,本揭示內容並不以此為限。 It should be noted that, in the case of no conflict, the features and circuits in the various drawings, embodiments, and embodiments of the present disclosure can be combined with each other. The circuit shown in the drawing is only an example, and is simplified to make the description concise and easy to understand, and is not intended to limit the case. In addition, the various devices, units, and components in the foregoing embodiments can be implemented by various types of digital or analog circuits, and can also be implemented by different integrated circuit chips, or integrated into a single chip. The foregoing is only an example, and the present disclosure is not limited thereto.
綜上所述,本案透過應用上述各個實施例中,藉
由學習裝置160根據通訊介面裝置140所記錄的操作畫面及除錯操控輸入訊號,進行分割、訓練後產生除錯子集,便能透過比對當前的異常錯誤資訊與錯誤模型來輸出相應的自動除錯步驟或除錯說明,達到結合自動和手動障礙排除,並同時進行機器學習。
In summary, this case applies the above-mentioned various embodiments, borrowing
The
雖然本揭示內容已以實施方式揭露如上,然其並非用以限定本揭示內容,所屬技術領域具有通常知識者在不脫離本揭示內容之精神和範圍內,當可作各種更動與潤飾,因此本揭示內容之保護範圍當視後附之申請專利範圍所界定者為準。 Although the content of this disclosure has been disclosed in the above manner, it is not intended to limit the content of this disclosure. Those with ordinary knowledge in the technical field can make various changes and modifications without departing from the spirit and scope of this disclosure. Therefore, this The scope of protection of the disclosed content shall be subject to the scope of the attached patent application.
200:除錯方法 200: debugging method
S210、S220、S230、S240、S250、S260、S270、S280、S290:操作 S210, S220, S230, S240, S250, S260, S270, S280, S290: Operation
Claims (15)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109102620A TWI741488B (en) | 2020-01-22 | 2020-01-22 | Debugging system and early warning system |
CN202010498637.3A CN113157471B (en) | 2020-01-22 | 2020-06-04 | Debug system and early warning system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW109102620A TWI741488B (en) | 2020-01-22 | 2020-01-22 | Debugging system and early warning system |
Publications (2)
Publication Number | Publication Date |
---|---|
TW202129495A true TW202129495A (en) | 2021-08-01 |
TWI741488B TWI741488B (en) | 2021-10-01 |
Family
ID=76882232
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW109102620A TWI741488B (en) | 2020-01-22 | 2020-01-22 | Debugging system and early warning system |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113157471B (en) |
TW (1) | TWI741488B (en) |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TW563017B (en) * | 2002-06-25 | 2003-11-21 | Mitac Int Corp | Device and method for executing single-step interrupt debugging in first stage of computer booting through PCMCIA interface |
US7113950B2 (en) * | 2002-06-27 | 2006-09-26 | Microsoft Corporation | Automated error checking system and method |
CN100377097C (en) * | 2002-08-26 | 2008-03-26 | 联发科技股份有限公司 | Error eliminating device |
CN100407163C (en) * | 2004-12-06 | 2008-07-30 | 明基电通股份有限公司 | Electronic appliance with error eliminating function and method thereof |
WO2014000297A1 (en) * | 2012-06-30 | 2014-01-03 | 华为技术有限公司 | Virtual port monitoring method and device |
US9094336B2 (en) * | 2013-03-15 | 2015-07-28 | Ixia | Methods, systems, and computer readable media for assisting with the debugging of conditions associated with the processing of test packets by a device under test |
US10243862B2 (en) * | 2013-03-15 | 2019-03-26 | Gigamon Inc. | Systems and methods for sampling packets in a network flow |
US11100423B2 (en) * | 2016-01-27 | 2021-08-24 | Microsoft Technology Licensing, Llc | Artificial intelligence engine hosted on an online platform |
-
2020
- 2020-01-22 TW TW109102620A patent/TWI741488B/en active
- 2020-06-04 CN CN202010498637.3A patent/CN113157471B/en active Active
Also Published As
Publication number | Publication date |
---|---|
TWI741488B (en) | 2021-10-01 |
CN113157471A (en) | 2021-07-23 |
CN113157471B (en) | 2024-05-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20120112995A1 (en) | Information Processing Apparatus, Information Processing Method, and Computer-Readable Storage Medium | |
WO2022095303A1 (en) | Method, computing device, and computer storage medium used for vehicle interaction | |
TW201518933A (en) | Testing device and testing method thereof | |
EP3493064A1 (en) | A method and system for automated testing of a graphical user interface for customer devices | |
CN109669831A (en) | A kind of test method and electronic equipment | |
CN107211112A (en) | Image processing equipment, image processing system, image processing method and program | |
US20210375231A1 (en) | System including a plurality of display apparatus and control method thereof | |
KR101938203B1 (en) | Apparatus for integrally managing of error generating of hardware and software in computer system | |
TW201228288A (en) | Remote management system, kvm switch, and remote managing method | |
TWI741488B (en) | Debugging system and early warning system | |
JP2009116535A (en) | Automatic test system, automatic test method and program | |
JPWO2010016251A1 (en) | Video processing device | |
CN110058695A (en) | Draw this interaction content generation method, editing machine, electronic equipment and storage medium | |
CN110297992A (en) | A kind of word methods of exhibiting, device, mobile terminal and storage medium | |
CN212752277U (en) | Intelligent communication equipment inspection, detection and training terminal and system | |
CN212012863U (en) | Multistage storage type video recorder | |
CN113316011B (en) | Control method, system, equipment and storage medium of electronic whiteboard system | |
KR102485368B1 (en) | Electronic apparatus, method for controlling thereof and the computer readable recording medium | |
JP7225082B2 (en) | Information processing device, information processing method and program | |
US10979777B2 (en) | Processing system for performing reverse video content output generation | |
WO2021154510A1 (en) | Annotated decode of oscilloscope signals | |
CN110825572A (en) | Method, device and system for detecting I2C equipment address and electronic equipment | |
TWI844450B (en) | Electronic device, interactive pronunciation correction system and method thereof | |
TWI547859B (en) | Method of removing external devices related computer system and non-transitory computer-readable medium | |
CN114945104B (en) | Television software probability problem reproduction method and device and television |