TWI522895B - Interface operating method and portable electronic apparatus using the same - Google Patents
Interface operating method and portable electronic apparatus using the same Download PDFInfo
- Publication number
- TWI522895B TWI522895B TW102144500A TW102144500A TWI522895B TW I522895 B TWI522895 B TW I522895B TW 102144500 A TW102144500 A TW 102144500A TW 102144500 A TW102144500 A TW 102144500A TW I522895 B TWI522895 B TW I522895B
- Authority
- TW
- Taiwan
- Prior art keywords
- group
- shortcut
- icon
- icons
- finger
- Prior art date
Links
Description
本發明是關於一種介面操作方法，特別是一種應用懸浮觸控技術（floating touch）操作可攜式電子裝置之系統介面之介面操作方法。本發明更包括應用該方法之可攜式電子裝置。The present invention relates to an interface operation method, and more particularly to an interface operation method for operating a system interface of a portable electronic device using a floating touch. The invention further includes a portable electronic device to which the method is applied.
可攜式電子裝置已經成為現代人日常生活中之基本配備，例如智慧型手機、平板電腦等。為了提供使用者更佳之視覺效果及使用感受，這類可攜式電子裝置在設計上，也開始採用大尺寸之螢幕，以智慧型手機為例，目前已經出現螢幕大於5吋以上之產品。然而，隨著螢幕尺寸增大，使用者已無法僅以單手同時握持智慧型手機並對螢幕執行觸控操作，而必須以一手握持智慧型手機並以另一手操作藉助。舉例來說，慣用右手之使用者以右手握持並以拇指操作智慧型手機時，對於具有大尺寸螢幕之智慧型手機來說，常會因為拇指長度小於螢幕尺寸，使得拇指難以點擊到螢幕左上角之圖示捷徑，造成操作上之困擾。Portable electronic devices have become the basic equipment in modern people's daily life, such as smart phones, tablets and so on. In order to provide users with better visual effects and usage feelings, such portable electronic devices are also designed to adopt large-size screens. For example, smart phones have been produced with more than 5 inches of screens. However, as the size of the screen increases, the user can no longer hold the smart phone with one hand and perform the touch operation on the screen, but must hold the smart phone in one hand and operate with the other hand. For example, when a right-handed user holds a smart phone with a right hand and a thumb, for a smart phone with a large screen, the thumb is often smaller than the screen size, making it difficult for the thumb to click to the upper left corner of the screen. The shortcuts of the illustrations cause operational problems.
此外，目前已經有部分可攜式電子裝置應用懸浮操作之技術，也就是在使用者之手部不需觸碰螢幕之狀態下，僅在螢幕上方執行某些手勢，即可操作可攜式電子裝置。但懸浮操作大多僅應用於可攜式電子裝置之網頁、照片瀏覽或頁面切換等功能，尚未提供其他方面之技術應用。In addition, some portable electronic devices have been used in the technology of floating operation, that is, in the state where the user's hand does not need to touch the screen, only some gestures can be performed on the screen to operate the portable electronic Device. However, most of the floating operations are only applied to webpages, photo browsing or page switching of portable electronic devices, and other technical applications have not yet been provided.
本發明之主要目的是提供一種應用懸浮觸控技術操作可攜式電子裝置之系統介面之介面操作方法。The main object of the present invention is to provide an interface operation method for operating a system interface of a portable electronic device by using a floating touch technology.
本發明之另一主要目的是提供一種應用前述方法之可攜式電子裝置。Another main object of the present invention is to provide a portable electronic device using the foregoing method.
為達成上述之目的，本發明之介面操作方法應用於可攜式電子裝置，可攜式電子裝置藉由螢幕顯示系統介面，且系統介面包括複數捷徑圖示。該方法包括以下步驟：偵測使用者之手指於該螢幕上方執行之懸浮手勢；判斷懸浮手勢是否對應執行一操作指令；若是，依據懸浮手勢之手指長度決定系統介面之操作範圍，且定義該操作範圍外之所有捷徑圖示為第一圖示群組；以及依據懸浮手勢之延伸方向，自第一圖示群組中決定一目標圖示，並移動目標圖示至操作範圍內且對應手指之指尖位置處。To achieve the above objective, the interface operation method of the present invention is applied to a portable electronic device, the portable electronic device through the screen display system interface, and the system interface includes a plurality of shortcut icons. The method includes the following steps: detecting a hovering gesture performed by a user's finger on the top of the screen; determining whether the hovering gesture corresponds to executing an operation instruction; if so, determining an operating range of the system interface according to a finger length of the hovering gesture, and defining the operation All shortcuts outside the range are illustrated as a first icon group; and a target icon is determined from the first group of icons according to the extending direction of the hovering gesture, and the target icon is moved to the operating range and corresponds to the finger At the fingertips.
本發明之可攜式電子裝置包括手勢偵測模組、手勢分析模組、介面控制模組以及螢幕。螢幕用以顯示包括複數捷徑圖示之系統介面；手勢偵測模組用以偵測使用者之手指於螢幕上方執行之懸浮手勢；手勢分析模組用以判斷該懸浮手勢是否對應執行一操作指令；若該懸浮手勢對應操作指令，手勢分析模組則依據該懸浮手勢之手指長度決定系統介面之操作範圍，且定義位於操作範圍外之所有捷徑圖示為第一圖示群組；介面操作模組用以依據手指之延伸方向，自第一圖示群組中決定一目標圖示，並移動目標圖示至操作範圍內且對應手指之指尖位置處。The portable electronic device of the present invention comprises a gesture detection module, a gesture analysis module, an interface control module and a screen. The screen is used to display a system interface including a plurality of shortcut icons; the gesture detection module is configured to detect a hovering gesture performed by a user's finger on the screen; and the gesture analysis module is configured to determine whether the hovering gesture corresponds to executing an operation instruction If the hovering gesture corresponds to the operation instruction, the gesture analysis module determines the operating range of the system interface according to the length of the finger of the hovering gesture, and defines all shortcut icons outside the operating range as the first icon group; the interface operation mode The group is configured to determine a target icon from the first group of icons according to the extending direction of the finger, and move the target icon to the operating range and corresponding to the fingertip position of the finger.
藉由本發明之設計，在使用者以單手握持並操作可攜式電子裝置之狀態下，使用者僅需要以單一手指在可攜式電子裝置之螢幕上方執行對應之懸浮手勢，即可移動系統介面上對應之捷徑圖示以便使用者點擊執行，不會因手指長度之限制而無法點擊到較遠處之捷徑圖示。With the design of the present invention, the user can move by performing a corresponding hovering gesture on the screen of the portable electronic device with a single finger while the user holds and operates the portable electronic device with one hand. The corresponding shortcut icon on the system interface allows the user to click and execute, without being able to click on the shortcut icon farther away due to the limitation of the length of the finger.
為能讓 貴審查委員能更瞭解本發明之技術內容，特舉較佳具體實施例說明如下。In order to enable the reviewing committee to better understand the technical contents of the present invention, the preferred embodiments are described below.
請參考圖1是本發明之可攜式電子裝置1之系統方塊圖。1 is a system block diagram of a portable electronic device 1 of the present invention.
在本發明之一實施例中，可攜式電子裝置1可以是智慧型手機、平板電腦或其他可支援懸浮觸控技術之電子裝置，但本發明不以此為限。可攜式電子裝置1藉由儲存單元（例如硬碟或記憶體）儲存作業系統及複數應用程式；而裝置內部之處理單元（例如中央處理器）用以執行該作業系統，並透過螢幕顯示一系統介面。於該系統介面會提供複數捷徑圖示，各捷徑圖示供使用者點擊以通知處理單元對應執行一應用程式。由於前述可攜式電子裝置1之內部元件及功能為習知技術，在此不多加贅述。In an embodiment of the present invention, the portable electronic device 1 can be a smart phone, a tablet computer, or other electronic device that can support the floating touch technology, but the invention is not limited thereto. The portable electronic device 1 stores an operating system and a plurality of applications by a storage unit (for example, a hard disk or a memory); and a processing unit (for example, a central processing unit) inside the device is configured to execute the operating system and display a screen through the screen. System interface. A plurality of shortcut icons are provided in the system interface, and each shortcut icon is provided for the user to click to notify the processing unit to execute an application. Since the internal components and functions of the portable electronic device 1 are conventional technologies, they are not described herein.
如圖1所示，本發明之可攜式電子裝置1包括手勢偵測模組10、手勢分析模組20、介面控制模組30及螢幕40，而介面控制模組30電性連接手勢偵測模組10、手勢分析模組20及螢幕40。手勢偵測模組10用以偵測使用者之手指於螢幕40上方執行之懸浮手勢。該手勢偵測模組10可以是可攜式電子裝置本身配置之鏡頭模組，藉由擷取鏡頭模組前方或螢幕40上方之影像來進行懸浮手勢之偵測，但本發明不以此為限；舉例來說，手勢偵測模組10也可以使用各式之近端感應器（例如光感應器）來取代。而螢幕40可以是一個觸控顯示面板，手勢偵測模組10即為觸控偵測器，可偵測相對於觸控顯示面板之觸控輸入。As shown in FIG. 1 , the portable electronic device 1 of the present invention includes a gesture detection module 10 , a gesture analysis module 20 , an interface control module 30 , and a screen 40 , and the interface control module 30 is electrically connected to the gesture detection. The module 10, the gesture analysis module 20 and the screen 40. The gesture detection module 10 is configured to detect a hovering gesture performed by a user's finger above the screen 40. The gesture detection module 10 can be a lens module configured by the portable electronic device itself, and can detect the hovering gesture by capturing an image in front of the lens module or above the screen 40, but the present invention does not For example, the gesture detection module 10 can also be replaced with various types of near-end sensors (such as light sensors). The screen 40 can be a touch display panel, and the gesture detection module 10 is a touch detector that can detect touch input relative to the touch display panel.
手勢分析模組20用以分析手勢偵測模組10之偵測結果，以判斷該懸浮手勢是否對應執行本發明之介面操作方法之一操作指令。手勢分析模組20可儲存已預先定義之懸浮手勢之態樣，以便與使用者執行之懸浮手勢進行比對分析。由於本發明之設計是對應使用者以單手握持可攜式電子裝置1之狀態，因此所定義之懸浮手勢會以單手握持時之單一手指（例如拇指）操作手勢為主。在本發明之一實施例中，懸浮手勢定義為使用者之拇指於螢幕40上方，以一移動速度朝任一個延伸方向實質上由短而長地線性延伸，且此拇指於螢幕40上方停留一持續時間，但本發明不以此為限。The gesture analysis module 20 is configured to analyze the detection result of the gesture detection module 10 to determine whether the suspension gesture corresponds to one of the operation instructions of the interface operation method of the present invention. The gesture analysis module 20 can store the pre-defined hover gestures for comparison analysis with the hover gestures performed by the user. Since the design of the present invention corresponds to the state in which the user holds the portable electronic device 1 with one hand, the defined hovering gesture is dominated by a single finger (eg, thumb) operation gesture when held in one hand. In one embodiment of the present invention, the hovering gesture is defined as a user's thumb extending above the screen 40 at a moving speed substantially linearly extending shortly and longly toward any one of the extending directions, and the thumb stays above the screen 40. Duration, but the invention is not limited thereto.
手勢分析模組20可藉由影像辨識、位置比對分析等技術，來取得該懸浮手勢之移動速度、持續時間、延伸方向及手指長度等參數，以供比對分析之用。其中移動速度是該手指執行線性延伸時之速度；持續時間是該手指執行線性延伸之過程前後，停留在螢幕40上之時間；延伸方向是手指執行線性延伸時之移動方向；手指長度則是該手指執行線性延伸後，手指自螢幕40之邊緣位置至手指之指尖位置之最大距離。The gesture analysis module 20 can obtain parameters such as moving speed, duration, extending direction, and finger length of the hovering gesture by means of image recognition, position comparison analysis, and the like for comparison analysis. Wherein the moving speed is the speed at which the finger performs linear extension; the duration is the time that the finger stays on the screen 40 before and after the linear extension process; the extending direction is the moving direction when the finger performs linear extension; the length of the finger is The maximum distance from the edge of the screen 40 to the fingertip position of the finger after the finger performs a linear extension.
在本實施例中，手勢分析模組20藉由比對使用者之手指之移動速度及持續時間是否滿足對應之設定參數，以判斷該懸浮手勢是否為對應執行操作指令之手勢。手勢分析模組20針對已定義之懸浮手勢設定了移動速度及持續時間等設定參數值，做為所測得懸浮手勢之手指之移動速度及持續時間等參數之比對基準。在本發明之一實施例中，移動速度之設定參數值不小於5 cm/s，而持續時間之設定參數值不小於0.5秒，但本發明不以此為限。In this embodiment, the gesture analysis module 20 determines whether the hovering gesture is a gesture corresponding to executing an operation instruction by comparing whether the movement speed and duration of the user's finger satisfy the corresponding setting parameter. The gesture analysis module 20 sets a set parameter value such as a moving speed and a duration for the defined hovering gesture as a comparison benchmark of the measured moving speed and duration of the finger of the hovering gesture. In an embodiment of the present invention, the setting parameter value of the moving speed is not less than 5 cm/s, and the setting parameter value of the duration is not less than 0.5 second, but the invention is not limited thereto.
介面控制模組30可以依據手勢分析模組20分析該懸浮手勢後所取得之手指長度，來決定系統介面之操作範圍，此操作範圍可供該手指之指尖移動至此操作範圍內之任意位置。由於手指延伸後實質上呈一直線，且手指能以其根部為軸心、前述手指長度為徑長來移動，因此介面控制模組30能依據手指自螢幕40邊緣延伸而出之位置以及手指長度，在螢幕40上形成一個近似局部圓或橢圓之弧線；而該弧線內所涵蓋之範圍定義為該操作範圍，並將該操作範圍對應至系統介面。藉此，介面控制模組30能以該操作範圍來區分於系統介面上呈現之複數捷徑圖示，將位於該操作範圍外之所有該捷徑圖示定義為第一圖示群組，且位於該操作範圍內之所有該捷徑圖示定義為第二圖示群組。The interface control module 30 can determine the operating range of the system interface according to the length of the finger obtained by the gesture analysis module 20 after analyzing the hovering gesture. The operating range can be used to move the fingertip of the finger to any position within the operating range. Since the finger is substantially in a straight line after the finger is extended, and the finger can move with the root as the axis and the length of the finger as the path length, the interface control module 30 can be based on the position of the finger extending from the edge of the screen 40 and the length of the finger. An arc of approximately local circle or ellipse is formed on the screen 40; the range covered within the arc is defined as the operating range, and the operating range is mapped to the system interface. Thereby, the interface control module 30 can distinguish the plurality of shortcut icons presented on the system interface by the operation range, and define all the shortcut icons located outside the operation range as the first graphic group, and All of the shortcut icons within the operating range are defined as a second group of icons.
而針對該弧線所經過之各捷徑圖示，介面控制模組30可以藉由判斷各捷徑圖示之中心點是否跨過該弧線，或是判斷各捷徑圖示位於該弧線內外之面積比例大小，來區分各捷徑圖示屬於第一圖示群組或第二圖示群組。由於此判斷技術亦為習知，在此不多加贅述。For each shortcut icon that the arc passes through, the interface control module 30 can determine whether the center point of each shortcut icon crosses the arc or determine the proportion of the area of each shortcut in and out of the arc. To distinguish the shortcut icons from the first icon group or the second group. Since this judgment technique is also known, it will not be repeated here.
而介面控制模組30在決定操作範圍後，進一步依據手勢分析模組20分析該懸浮手勢後所取得之手指之延伸方向，自第一圖示群組中決定一目標圖示，並將該目標圖示移動至操作範圍內且對應使用者之手指之指尖位置處，方便使用者點擊該目標圖示以執行對應之應用程式。After the operation control range is determined, the interface control module 30 further determines the extension direction of the finger obtained after the suspension gesture is analyzed according to the gesture analysis module 20, and determines a target icon from the first graphic group, and the target is determined. The illustration moves to the operating range and corresponds to the fingertip position of the user's finger, so that the user can click on the target icon to execute the corresponding application.
前述手勢分析模組20及介面控制模組30可各自以硬體晶片、軟體及韌體其中之一或前述二者以上之組合所構成，以執行該模組本身所欲達到之功能。The gesture analysis module 20 and the interface control module 30 can each be composed of one of a hard body chip, a soft body and a firmware, or a combination of the foregoing, to perform the function desired by the module itself.
請參考圖2是本發明之介面控制方法之流程圖。需注意的是，以下雖配合圖1所示之可攜式電子裝置1為例說明本發明之介面顯示方法，但本發明並不以應用於可攜式電子裝置1為限。如圖2所示，本發明之介面顯示方法包括步驟S1至步驟S4。以下將詳細說明該方法之各個步驟：Please refer to FIG. 2, which is a flow chart of the interface control method of the present invention. It should be noted that the interface display method of the present invention is described below with reference to the portable electronic device 1 shown in FIG. 1 , but the present invention is not limited to the portable electronic device 1 . As shown in FIG. 2, the interface display method of the present invention includes steps S1 to S4. The various steps of the method are described in detail below:
步驟S1：偵測使用者之手指於螢幕40上方執行之懸浮手勢。Step S1: detecting a hovering gesture performed by the user's finger on the screen 40.
以下請一併參考圖3。圖3是使用者於本發明之可攜式電子裝置1之螢幕40上方執行懸浮手勢之示意圖。如圖1及圖3所示，假設使用者以單手（以右手為例）握持可攜式電子裝置1，並以單一手指（以姆指為例）對可攜式電子裝置1之螢幕40執行點擊、滑移或懸浮手勢等操作。當使用者於螢幕40上方以用姆指執行一懸浮手勢時，可攜式電子裝置1可藉由手勢偵測模組10偵測到該懸浮手勢，並將偵測結果資訊傳送至手勢分析模組20。Please refer to Figure 3 below. FIG. 3 is a schematic diagram of a user performing a hovering gesture on the screen 40 of the portable electronic device 1 of the present invention. As shown in FIG. 1 and FIG. 3, it is assumed that the user holds the portable electronic device 1 with one hand (for example, the right hand), and uses a single finger (for example, the thumb) to display the screen of the portable electronic device 1. 40 Perform operations such as clicking, sliding, or hovering gestures. When the user performs a hovering gesture with the thumb on the screen 40, the portable electronic device 1 can detect the hovering gesture by the gesture detecting module 10, and transmit the detection result information to the gesture analysis mode. Group 20.
步驟S2：判斷懸浮手勢是否對應執行一操作指令。Step S2: determining whether the hovering gesture corresponds to executing an operation instruction.
在手勢分析模組20接收到手勢偵測模組10所偵測到該懸浮手勢之偵測結果資訊後，手勢分析模組20開始取得該懸浮手勢之相關參數，並且分析該懸浮手勢是否與對應執行系統介面之操作指令之已定義懸浮手勢相符。手勢分析模組20藉由比對所偵測到之該懸浮手勢之移動軌跡是否與已定義之懸浮手勢相符，並且比對所偵測到之該懸浮手勢之移動速度及持續時間是否均滿足對應之設定參數，來判斷該懸浮手勢是否能對應執行該操作指令。若該懸浮手勢能對應執行該操作指令，則續行步驟S3；若否，則回到步驟S1，重新偵測使用者執行之懸浮手勢。After the gesture analysis module 20 receives the detection result information of the hover gesture detected by the gesture detection module 10, the gesture analysis module 20 starts to obtain the relevant parameters of the hover gesture, and analyzes whether the hover gesture corresponds to The defined hover gestures of the operating instructions of the execution system interface match. The gesture analysis module 20 matches whether the detected movement trajectory of the hovering gesture matches the defined hovering gesture, and compares the detected moving speed and duration of the hovering gesture to satisfy the corresponding A parameter is set to determine whether the hovering gesture can correspond to the execution of the operation instruction. If the hovering gesture can correspondingly execute the operation instruction, proceed to step S3; if not, return to step S1 to re-detect the hovering gesture performed by the user.
如圖3所示，假設使用者以右手握持可攜式電子裝置1，並以右手姆指自彎曲狀態下（如圖中虛線所示之拇指）朝一延伸方向L1實質上線性延伸，以形成一懸浮手勢；而此懸浮手勢符合可對應執行該操作指令之已定義之懸浮手勢。當姆指執行線性延伸時會產生一移動速度；姆指自彎曲狀態延伸至伸直狀態（如圖中實線所示之拇指），且維持該伸直狀態並停留在螢幕40上經過一持續時間。因此，以前述設定參數值為例，當手勢分析模組20經分析判斷拇指之移動速度超過5cm/s，且持續時間超過0.5秒時，即可認定該懸浮手勢可對應執行該操作指令。As shown in FIG. 3, it is assumed that the user holds the portable electronic device 1 with his right hand, and the user's right hand fingers extend substantially linearly from a bending state (the thumb shown by a broken line in the figure) toward an extending direction L1. A hovering gesture; and the hovering gesture conforms to a defined hovering gesture that can correspond to the execution of the operational command. When the thumb performs a linear extension, a moving speed is generated; the thumb extends from the bent state to the straightened state (the thumb shown by the solid line in the figure), and maintains the straight state and stays on the screen 40 after a continuation time. Therefore, taking the value of the set parameter as an example, when the gesture analysis module 20 determines that the moving speed of the thumb exceeds 5 cm/s and the duration exceeds 0.5 seconds, it can be determined that the hovering gesture can correspondingly execute the operation instruction.
步驟S3：依據懸浮手勢之手指長度決定系統介面之操作範圍；且定義位於操作範圍外之所有捷徑圖示為第一圖示群組。Step S3: determining the operating range of the system interface according to the length of the finger of the hovering gesture; and defining all the shortcut icons outside the operating range as the first graphic group.
若經前述步驟S2判斷目前偵測到之懸浮手勢可對應執行該操作指令，則手勢分析模組20會通知介面控制模組30依據所取得之拇指長度，來決定系統介面之操作範圍。如圖3所示，當拇指自彎曲狀態延伸至伸直狀態後，姆指會呈現最大長度，因此手勢分析模組20可以計算姆指自螢幕40邊緣延伸而出之位置點P至拇指指尖之距離，做為拇指之手指長度；而介面控制模組30則以位置點P為軸心，手指長度為徑長於螢幕40上形成一個弧線S，並定義弧線S內所涵蓋之範圍定義為操作範圍。If it is determined in the foregoing step S2 that the currently detected hovering gesture can be executed corresponding to the operation instruction, the gesture analysis module 20 notifies the interface control module 30 to determine the operating range of the system interface according to the obtained thumb length. As shown in FIG. 3, when the thumb extends from the curved state to the extended state, the thumb will exhibit the maximum length, so the gesture analysis module 20 can calculate the position point P from the edge of the screen 40 extending from the edge of the screen 40 to the tip of the thumb. The distance is used as the length of the finger of the thumb; and the interface control module 30 takes the position point P as the axis, the length of the finger is longer than the curve 40 to form an arc S, and the range defined in the arc S is defined as the operation. range.
據此，介面控制模組30即以該操作範圍來區分於系統介面上呈現之複數捷徑圖示，將位於該操作範圍外之所有該捷徑圖示定義為第一圖示群組A，且位於該操作範圍內之所有該捷徑圖示定義為第二圖示群組B。Accordingly, the interface control module 30 distinguishes the plurality of shortcut icons presented on the system interface by the operation range, and defines all the shortcut icons located outside the operation range as the first graphic group A, and is located at All of the shortcut icons within the operating range are defined as the second illustrated group B.
步驟S4：依據懸浮手勢之手指之延伸方向，自第一圖示群組中決定一目標圖示，並移動目標圖示至操作範圍內且對應手指之指尖位置處。Step S4: Determine a target icon from the first graphic group according to the extending direction of the finger of the hovering gesture, and move the target icon to the fingertip position of the corresponding finger within the operating range.
經前述步驟S3決定操作範圍後，介面控制模組30會進一步依據拇指之延伸方向L1，自第一圖示群組A中選擇一個捷徑圖示做為目標圖示。在本發明之一實施例中，目標圖示初始設定為第一圖示群組A中，位於手指之延伸方向L1上且最接近該操作範圍之捷徑圖示A1，但本發明不以此為限。After the operation range is determined by the foregoing step S3, the interface control module 30 further selects a shortcut icon from the first graphic group A as the target icon according to the extending direction L1 of the thumb. In an embodiment of the present invention, the target icon is initially set as the shortcut icon A1 in the extending direction L1 of the finger and closest to the operating range in the first graphic group A, but the present invention does not limit.
以下請一併參考圖4。圖4是應用本發明之介面控制方法第一實施例移動目標圖示之示意圖。如圖3及圖4所示，而在決定捷徑圖示A1為目標圖示後，介面控制模組30會將系統介面切換為一動態介面模式，令目標圖示自操作範圍外移動至操作範圍內。此處介面控制模組30可自手勢分析模組20取得使用者之拇指之指尖位置座標，以對應移動目標圖示拇指之指尖位置處，方便使用者點擊該目標圖示（即捷徑圖示A1）。Please refer to Figure 4 below. 4 is a schematic diagram of a moving object illustration of a first embodiment of an interface control method to which the present invention is applied. As shown in FIG. 3 and FIG. 4, after the shortcut icon A1 is determined as the target icon, the interface control module 30 switches the system interface to a dynamic interface mode, so that the target icon moves from the outside of the operating range to the operating range. Inside. Here, the interface control module 30 can obtain the fingertip position coordinate of the thumb of the user from the gesture analysis module 20, so as to correspond to the fingertip position of the thumb of the moving target icon, so that the user can click the target icon (ie, the shortcut map). Show A1).
本發明之設計主要是讓使用者單手握持可攜式電子裝置時，在手指長度限制下仍然能夠點擊到超過手指長度可觸及之處之捷徑圖示（即第一圖示群組A中之任一捷徑圖示），並且目標圖示在移動後會遮蔽住第二圖示群組B中之至少一部分捷徑圖示。因此在此動態介面模式下，介面控制模組30會暫時取消第二圖示群組B中所有捷徑圖示之捷徑功能，並將第二圖示群組B中所有捷徑圖示以色彩淡化或灰階等方式呈現，避免使用者在點擊目標圖示之過程中，非本意誤觸第二圖示群組B中之任一捷徑圖示。The design of the present invention is mainly to allow the user to hold the portable electronic device with one hand, and still click the shortcut icon beyond the finger length limit under the finger length limitation (ie, the first graphic group A) Any of the shortcut icons), and the target icon will block at least a portion of the shortcut icons in the second icon group B after moving. Therefore, in the dynamic interface mode, the interface control module 30 temporarily cancels the shortcut function of all shortcut icons in the second graphic group B, and fades all shortcut icons in the second graphic group B. The grayscale and the like are presented to prevent the user from accidentally touching any shortcut icon in the second graphic group B during the process of clicking the target icon.
當使用者移動拇指，而使得拇指由圖4之延伸方向L1改變為另一延伸方向時，原本圖4中做為目標圖示之捷徑圖示A1已不在改變後之延伸方向上，因此介面控制模組30會依據改變後之延伸方向，自第一圖示群組A中重新決定另一個捷徑圖示做為新的目標圖示，並依據前述步驟S4移動至操作範圍內且對應拇指之指尖位置處。也就是說，隨著使用者之拇指之延伸方向改變，所決定之目標圖示也會有所不同。When the user moves the thumb and changes the thumb from the extending direction L1 of FIG. 4 to the other extending direction, the shortcut icon A1 as the target image in FIG. 4 is not in the extending direction after the change, so the interface control The module 30 will re-determine another shortcut icon from the first graphic group A as a new target image according to the changed extending direction, and move to the operating range and the finger corresponding to the thumb according to the foregoing step S4. At the tip position. That is to say, as the direction of extension of the user's thumb changes, the determined target icon will also be different.
此外，為了更方便使用者點擊移動後之目標圖示，並較清楚辨識目前所決定之目標圖示為何，在本發明之一實施例中，介面控制模組30會放大目標圖示之尺寸。In addition, in order to make it easier for the user to click on the moving target icon and to clearly identify the currently determined target icon, in an embodiment of the present invention, the interface control module 30 enlarges the size of the target icon.
請一併參考圖5A及圖5B。圖5A是應用本發明之介面控制方法第二實施例改變所決定之目標圖示前之示意圖；圖5B是應用本發明之介面控制方法第二實施例改變所決定之目標圖示後之示意圖。本實施例主要說明在第一圖示群組中，針對手指之同一延伸方向上存在著複數個捷徑圖示時之對應操作方式。Please refer to FIG. 5A and FIG. 5B together. 5A is a schematic view of the second embodiment of the interface control method to which the present invention is applied, and FIG. 5B is a schematic diagram of the second embodiment of the interface control method of the present invention. This embodiment mainly describes a corresponding operation mode when there are a plurality of shortcut icons in the same extending direction of the finger in the first illustrated group.
本發明主要是以使用者所執行之懸浮手勢做為指令執行依據，而執行懸浮手勢之手指原本就與螢幕40之間保持一間距。因此，手勢偵測模組10可以偵測到手指與螢幕40之間之間距變化；當偵測到手指與螢幕40之間之間距改變時，手勢偵測模組10會將偵測結果通知介面控制模組30。舉例來說，當使用者將手指朝遠離螢幕40之方向或朝接近螢幕40之方向移動時，即造成手指與螢幕40之間之間距改變。介面控制模組30會依據該間距之改變，針對第一圖示群組中同一延伸方向上所存在之複數個捷徑圖示間進行切換。The present invention mainly uses the hovering gesture performed by the user as the instruction execution basis, and the finger performing the hovering gesture originally maintains a space with the screen 40. Therefore, the gesture detection module 10 can detect the change of the distance between the finger and the screen 40; when detecting the change between the finger and the screen 40, the gesture detection module 10 notifies the detection result interface. Control module 30. For example, when the user moves the finger away from the screen 40 or toward the screen 40, the distance between the finger and the screen 40 is changed. The interface control module 30 switches between the plurality of shortcut icons existing in the same extension direction in the first graphic group according to the change of the spacing.
如圖5A所示，在本實施例中，假設第一圖示群組A中，位在手指執行懸浮操作之延伸方向L3上存在有二個捷徑圖示A3及A4，而依據初始設定是以最接近操作範圍之捷徑圖示A3為目標圖示。As shown in FIG. 5A, in the present embodiment, it is assumed that in the first illustrated group A, there are two shortcut icons A3 and A4 in the extending direction L3 of the finger performing the floating operation, and according to the initial setting, The shortcut icon A3 closest to the operating range is the target icon.
當使用者想要執行的是捷徑圖示A4所對應之應用程式時，使用者可以朝遠離螢幕40之方向移動拇指，增加拇指與螢幕40之間之間距；此時介面控制模組30會依據間距改變之定義，重新決定以捷徑圖示A4為目標圖示，並移動新的目標圖示至操作範圍內且對應拇指之指尖位置處，如圖5B所示。相反地，在圖5B之狀態下，當使用者朝接近螢幕40之方向移動拇指，縮小拇指與螢幕40之間之間距時，介面控制模組30也會再次決定以捷徑圖示A3為目標圖示，回到圖5A之狀態。而在較佳實施例中，介面控制模組30會量測拇指與螢幕40之間之間距改變時的持續時間，若持續時間未超過一預定時間，則不視為間距改變，當然也不會改變選取的目標圖示。這是為了避免使用者在選取目標圖示後欲進行點選而造成間距再度改變的誤判。When the user wants to execute the application corresponding to the shortcut icon A4, the user can move the thumb away from the screen 40 to increase the distance between the thumb and the screen 40; at this time, the interface control module 30 will The definition of the pitch change is re-determined with the shortcut icon A4 as the target icon, and the new target icon is moved to the operating range and corresponding to the fingertip position of the thumb, as shown in FIG. 5B. Conversely, in the state of FIG. 5B, when the user moves the thumb toward the screen 40 to reduce the distance between the thumb and the screen 40, the interface control module 30 again determines the shortcut map A3 as the target map. Return to the state of Figure 5A. In the preferred embodiment, the interface control module 30 measures the duration of the change between the thumb and the screen 40. If the duration does not exceed a predetermined time, the interval is not considered to be changed. Change the selected target icon. This is to avoid the user's misjudgment that the spacing is changed again after the target image is selected.
請參考圖6是應用本發明之介面控制方法第三實施例改變第一圖示群組呈現方式之示意圖。如圖6所示，為了提供使用者不同之操作感受，在本發明之一實施例中，當介面控制模組30決定該操作範圍及目標圖示後，介面控制模組30會將第一圖示群組A中除了目標圖示（以捷徑圖示A4為例）外之其他捷徑圖示，隨著目標圖示一併移動至操作範圍內並自動排列。例如該些捷徑圖示會沿著形成操作範圍之弧線S之相似弧線S1依序排列（圖6中第一圖示群組A中之所有捷徑圖示彼此交疊排列，並將目標圖示以最上層形式呈現並放大其尺寸）。而隨著拇指之延伸方向改變，可切換位在弧線S1上之任一捷徑圖示做為目標圖示。藉此，依據延伸方向所對應之目標圖示不同，第一圖示群組A之其他捷徑圖示會集中排列在目標圖示之一側，或分散排列在目標圖示之兩側。Please refer to FIG. 6 , which is a schematic diagram showing a third embodiment of the interface control method to which the present invention is applied. As shown in FIG. 6 , in order to provide different operating feelings for the user, in an embodiment of the present invention, after the interface control module 30 determines the operating range and the target icon, the interface control module 30 will display the first image. In addition to the target icon (taking the shortcut icon A4 as an example), other shortcut icons in group A are moved to the operating range along with the target icon and automatically arranged. For example, the shortcut icons are sequentially arranged along a similar arc S1 forming an arc S of the operating range (all the shortcut icons in the first illustrated group A in FIG. 6 are arranged to overlap each other, and the target icon is The topmost form renders and enlarges its size). As the direction of extension of the thumb changes, any shortcut icon that can be switched on the arc S1 is taken as the target icon. Thereby, according to different target icons corresponding to the extending direction, the other shortcut icons of the first graphic group A are arranged in one side of the target graphic or distributed on both sides of the target graphic.
以下請一併參考圖7A至圖7C。圖7A至圖7C是應用本發明之介面控制方法第四實施例改變第一圖示群組A呈現方式之示意圖。本實施例主要說明當系統介面上捷徑圖示數量較多時之一種呈現方式。如圖7A及圖7B所示，在本實施例中，假設系統介面所呈現之捷徑圖示由圖3中之3×3增加為5×5；而應用本發明之方法，使用者之拇指沿著延伸方向L4延伸而執行懸浮手勢時，同樣地以弧線S形成了操作範圍，將該些捷徑圖示區分為第一圖示群組A及第二圖示群組B。捷徑圖示A5及A6位於延伸方向L4上，而依據初始設定是以最接近操作範圍之捷徑圖示A5為目標圖示。Please refer to FIG. 7A to FIG. 7C together. 7A to 7C are diagrams showing a fourth embodiment of the interface control method to which the present invention is applied to change the presentation manner of the first pictorial group A. This embodiment mainly describes a presentation mode when the number of shortcut icons on the system interface is large. As shown in FIG. 7A and FIG. 7B, in the present embodiment, it is assumed that the shortcut icon presented by the system interface is increased from 3×3 to 5×5 in FIG. 3; and the thumb of the user is applied by the method of the present invention. When the extending direction L4 is extended and the hovering gesture is performed, the operating range is formed by the arc S, and the shortcut icons are divided into the first pictorial group A and the second pictorial group B. The shortcut icons A5 and A6 are located in the extending direction L4, and are based on the initial setting as the shortcut icon A5 closest to the operating range.
而在判斷該懸浮手勢可對應執行系統介面之操作指令後，介面控制模組30將第一圖示群組A中之至少一部分捷徑圖示，隨著目標圖示一併移動至操作範圍內並自動排列。例如在本實施例中，將第一圖示群組A中除了目標圖示以外之捷徑圖示分成兩部分，其中目標圖示（即捷徑圖示A5）與第一圖示群組A中隨著移動至操作範圍內之部分捷徑圖示是沿著相似弧線S之弧線S1依序排列；而第一圖示群組A中位於操作範圍外之其他捷徑圖示則是沿著相似弧線S之弧線S2依序排列，使得第一圖示群組A分為兩列。目標圖示會對應到拇指之指尖位置，而使用者可以藉由移動拇指改變延伸方向，以切換在同一列中不同之捷徑圖示。After determining that the hovering gesture can correspond to the operation instruction of the system interface, the interface control module 30 displays at least a part of the shortcut icons in the first graphic group A, and moves together with the target icon into the operating range. Automatically arranged. For example, in this embodiment, the shortcut icon other than the target icon in the first graphic group A is divided into two parts, wherein the target graphic (ie, the shortcut icon A5) and the first graphic group A are included. Some shortcut icons moving to the operating range are sequentially arranged along the arc S1 of the similar arc S; and other shortcut icons in the first group A are located outside the operating range along the similar arc S The arcs S2 are arranged in order such that the first illustrated group A is divided into two columns. The target icon will correspond to the fingertip position of the thumb, and the user can change the direction of extension by moving the thumb to switch between different shortcut icons in the same column.
同樣地，當手勢偵測模組10偵測到手指與螢幕40之間之間距改變時，會通知介面控制模組30改變介面中各捷徑圖示之呈現態樣。當使用者想要執行的是捷徑圖示A6所對應之應用程式時，使用者可以自圖7B之狀態下朝遠離螢幕40之方向移動拇指，增加拇指與螢幕40之間之間距。此時介面控制模組30會重新決定以捷徑圖示A6為目標圖示，並移動新的目標圖示至操作範圍內且對應拇指之指尖位置處；而操作範圍外之另一列捷徑圖示也會一併移動至操作範圍內，如圖7C所示。Similarly, when the gesture detection module 10 detects a change in the distance between the finger and the screen 40, the interface control module 30 is notified to change the appearance of each shortcut icon in the interface. When the user wants to execute the application corresponding to the shortcut icon A6, the user can move the thumb away from the screen 40 from the state of FIG. 7B to increase the distance between the thumb and the screen 40. At this time, the interface control module 30 will re-determine the shortcut icon A6 as the target icon, and move the new target icon to the operating range and corresponding to the fingertip position of the thumb; and another shortcut shortcut icon outside the operating range It will also move to the operating range as shown in Figure 7C.
相反地，在圖7C之狀態下，使用者朝接近螢幕40之方向移動拇指，縮小拇指與螢幕40之間之間距時，介面控制模組30也會控制該些捷徑圖示回到圖7B之狀態。如此，使用者可執行不同捷徑圖示列之切換操作，以供使用者選擇想要點擊執行之捷徑圖示。Conversely, in the state of FIG. 7C, when the user moves the thumb toward the screen 40 to reduce the distance between the thumb and the screen 40, the interface control module 30 also controls the shortcut icons to return to FIG. 7B. status. In this way, the user can perform a switching operation of different shortcut chart columns for the user to select a shortcut icon for clicking and executing.
藉由本發明之設計，使用者能夠以單手握持並操作具有大尺寸螢幕之可攜式電子裝置1；配合懸浮手勢之執行，使用者不會受到手指長度之限制，而能順利點擊到螢幕上任何位置之捷徑圖示，提高了操作上之便利性。用同一隻手之手指點擊到系統介面上超過手指長度之捷徑圖示。With the design of the present invention, the user can hold and operate the portable electronic device 1 with a large-size screen with one hand; with the execution of the hovering gesture, the user can be smoothly clicked to the screen without being restricted by the length of the finger. The shortcut icon on any position improves the convenience of operation. Use the finger of the same hand to click on the shortcut icon that exceeds the length of the finger on the system interface.
需注意的是，上述僅為實施例，而非限制於實施例。譬如 此不脫離本發明基本架構者，皆應為本專利所主張之權利範圍，而應以專利申請範圍為準。It should be noted that the above is only an embodiment, and is not limited to the embodiment. For example, those who do not depart from the basic structure of the present invention should be bound by the scope of the patent, and the scope of the patent application shall prevail.
1‧‧‧可攜式電子裝置
10‧‧‧手勢偵測模組
20‧‧‧手勢分析模組
30‧‧‧介面控制模組
40‧‧‧螢幕
L1、L3、L4‧‧‧延伸方向
P‧‧‧位置點
S、S1、S2‧‧‧弧線
A‧‧‧第一圖示群組
B‧‧‧第二圖示群組
A1、A3、A4、A5、A6‧‧‧捷徑圖示
S1~S4‧‧‧步驟1‧‧‧Portable electronic device
10‧‧‧ gesture detection module
20‧‧‧Gesture Analysis Module
30‧‧‧Interface Control Module
40‧‧‧ screen
L1, L3, L4‧‧‧ extension direction
P‧‧‧Location
S, S1, S2‧‧‧ arc
A‧‧‧first icon group
B‧‧‧Second icon group
A1, A3, A4, A5, A6‧‧‧ shortcut icon
S1~S4‧‧‧ steps
圖1是本發明之可攜式電子裝置之系統方塊圖。圖2是本發明之介面操作方法之流程圖。圖3是使用者於本發明之可攜式電子裝置之螢幕上方執行懸浮手勢之示意圖。圖4是應用本發明之介面控制方法第一實施例移動目標圖示之示意圖。圖5A是應用本發明之介面控制方法第二實施例改變所決定之目標圖示前之示意圖。圖5B是應用本發明之介面控制方法第二實施例改變所決定之目標圖示後之示意圖。圖6是應用本發明之介面控制方法第三實施例改變第一圖示群組呈現方式之示意圖。圖7A至圖7C是應用本發明之介面控制方法第四實施例改變第一圖示群組呈現方式之示意圖。1 is a block diagram of a system of a portable electronic device of the present invention. 2 is a flow chart of the interface operation method of the present invention. 3 is a schematic diagram of a user performing a hovering gesture on top of a screen of the portable electronic device of the present invention. 4 is a schematic diagram of a moving object illustration of a first embodiment of an interface control method to which the present invention is applied. Fig. 5A is a schematic view of the front view of the object determined by the second embodiment of the interface control method to which the present invention is applied. FIG. 5B is a schematic diagram of the second embodiment of the interface control method to which the present invention is applied to change the determined target image. FIG. 6 is a schematic diagram showing a third embodiment of an interface control method to which the present invention is applied to change a first illustrated group presentation manner. 7A to 7C are schematic diagrams showing a fourth embodiment of the interface control method according to the fourth embodiment of the present invention.
S1~S4‧‧‧步驟 S1~S4‧‧‧ steps
Claims (11)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW102144500A TWI522895B (en) | 2013-12-04 | 2013-12-04 | Interface operating method and portable electronic apparatus using the same |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| TW102144500A TWI522895B (en) | 2013-12-04 | 2013-12-04 | Interface operating method and portable electronic apparatus using the same |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TW201523428A TW201523428A (en) | 2015-06-16 |
| TWI522895B true TWI522895B (en) | 2016-02-21 |
Family
ID=53935694
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW102144500A TWI522895B (en) | 2013-12-04 | 2013-12-04 | Interface operating method and portable electronic apparatus using the same |
Country Status (1)
| Country | Link |
|---|---|
| TW (1) | TWI522895B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2017174144A (en) * | 2016-03-23 | 2017-09-28 | 株式会社スクウェア・エニックス | Program, computer device, program execution method and system |
-
2013
- 2013-12-04 TW TW102144500A patent/TWI522895B/en active
Also Published As
| Publication number | Publication date |
|---|---|
| TW201523428A (en) | 2015-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6031080B2 (en) | Virtual touchpad operating method and terminal for performing the same | |
| US8760425B2 (en) | Method and apparatus for enabling touchpad gestures | |
| US10318146B2 (en) | Control area for a touch screen | |
| US9223471B2 (en) | Touch screen control | |
| CN113168285A (en) | Modeless enhancements to virtual trackpads on multi-screen computing devices | |
| WO2013094371A1 (en) | Display control device, display control method, and computer program | |
| US9354780B2 (en) | Gesture-based selection and movement of objects | |
| CN113168284A (en) | Modeless enhancements to virtual trackpads on multi-screen computing devices | |
| US8775958B2 (en) | Assigning Z-order to user interface elements | |
| KR20160005013A (en) | Delay warp gaze interaction | |
| KR20140010003A (en) | Using movement of a computing device to enhance interpretation of input events produced when interacting with the computing device | |
| US9170726B2 (en) | Apparatus and method for providing GUI interacting according to recognized user approach | |
| US20120011467A1 (en) | Window Opening and Arranging Method | |
| JP5846129B2 (en) | Information processing terminal and control method thereof | |
| US20150002433A1 (en) | Method and apparatus for performing a zooming action | |
| US10599326B2 (en) | Eye motion and touchscreen gestures | |
| US10564762B2 (en) | Electronic apparatus and control method thereof | |
| TWI522895B (en) | Interface operating method and portable electronic apparatus using the same | |
| KR101692848B1 (en) | Control method of virtual touchpad using hovering and terminal performing the same | |
| KR20150098366A (en) | Control method of virtual touchpadand terminal performing the same | |
| US11221754B2 (en) | Method for controlling a display device at the edge of an information element to be displayed | |
| KR101436586B1 (en) | Method for providing user interface using one point touch, and apparatus therefor | |
| KR20130077137A (en) | Input apparatus having a touch screen and the input method thereof | |
| KR20110133014A (en) | Method for controlling screen of terminal unit with touch screen and pointing device | |
| KR20160107139A (en) | Control method of virtual touchpadand terminal performing the same |