201108032 六、發明說明： 【發明所屬之技術領域】 本發明涉及一種掌上型電子裝置及其螢幕晝面顯示 方法，尤其係關於一種掌上型電子裝置及其螢幕畫面自動 旋轉方法。 【先前技術】 重力感測器在近年來的應用相當廣泛，舉凡在數位相 機及數位遊戲機上，均極為人所熟悉。重力感測器在掌上 型電子裝置的應用，大多係實現掌上型電子裝置之螢幕苎 面會隨著掌上型電子裝置受到地心引力之方向改變，而二 %調整適合使用者觀看的晝面角度。然而，在掌上型電子 裝置中使用重力感測器存在如下問題：第一，使用重力感 測器來感測地心引力方向只有在掌上型電子裝置並絲 處於水準加速度運動下，才可以準確得知地心引力方向， -旦掌上型電子裝置正處於加速度運動狀態下，便難以準 確感測出地心引力方向，而無法準確將螢幕畫面旋轉至人 ^使用者觀看㈣度；第二，適合使用者觀看的螢幕畫: 向不-定係與地心引力方向有絕對關係，例如當使 m用掌上型電子裝置時，適合使用者觀看的畫面 查又」:引力無關，亦即，最適合使用者觀看的螢幕 旦面角度應係使用者眼睛正視的角度。因此，假如 重力感測器及人臉伯測技術，來 ^用 取適合一般使用者的調整方式。 糸為 201108032 【發明内容】 繁於以上内容，有必要提供一種掌上型電子裝置及盆 營幕畫面顯示方法，能夠根據使用者觀看角度自動旋轉掌 上型電子裝置的螢幕晝面至使用者的正視方向上。 、=種掌上型電子展置，該掌上型電子裂置包括：重力 感測器’用於即時監測並採集掌上型電子裝置所受的重力 貧訊；攝影機，用於攝取使用者的人臉晝面影像，·重力分 析模組，用於藉由解析重力資訊獲取掌上型電子裝置相對 於地心引力的重力加速度方向，將該重力加速度方向與顯 不螢幕的畫面方向作比對㈣斷是否需要改變螢幕畫面 的角度；影像分析模組，用於解析人臉晝面影像來獲取使 用者正視角度，根據使用者正視角度與顯示營幕的勞幕畫 面角度作比對來判斷是否需要改變勞幕畫面的角度；勞幕 轉換模組，用於當需要轉換營幕畫面時產生螢^轉 艮據螢幕轉換指令藉由顯示單元控制顯示螢幕轉‘ 螢幕晝面至使用者的正視角度。 -種掌上㈣子裝置的f幕晝面自純轉方法，該 上型電子裝置包括顯示單元及顯示螢幕，該方法包括如下 =:(a)感測掌上型電子裳置所受的外力運動；⑴判 有電子裝置的攝影機是否被開啟；（c)若攝影機沒 有被開啟’則執行如下步驟：U1)採集掌上型電子裝置 所受的重力資訊；（c2)藉由解析重力資訊獲取掌上型電 子裝置相對於地心引力的番 亍速度方向；（e3)獲取顯 不營幕的㈣畫面方向；（⑷將重力加速度方向與螢幕 201108032 晝面方向作比對；（d)若攝影機被開啟，則執行如下步驟： (dl)攝取使用者的人臉晝面影像；（d2)藉由解析人臉 晝面影像獲取使用者的正視方向；（d3)獲取顯示螢幕的 螢幕畫面方向；（d4)將使用者的正視方向與螢幕畫面方 向作比對；（e)根據（c4)或（d4)的比對結果來判斷是 否需要轉換螢幕畫面的角度；（f)若不需要轉換螢幕晝面 角度，則轉向步驟（a);及（g)若需要轉換螢幕畫面角 度，則產生螢幕轉換指令並根據該螢幕轉換指令藉由顯示 單元控制顯示螢幕轉換螢幕晝面角度。 相較於習知技術，所述之掌上型電子裝置及其螢幕晝 面顯示方法利用重力感測技術及人臉偵測技術，能夠根據 使用者觀看角度自動旋轉掌上型電子裝置的螢幕畫面至 使用者的正視方向上。 【實施方式】 如圖1所示，係本發明掌上型電子裝置1較佳實施例 的架構圖。該掌上型電子裝置1包括周邊裝置10、應用介 面單元20及螢幕晝面旋轉單元30。所述周邊裝置10包括 重力感測器（G-Sensor) 101、攝影機102、顯示螢幕103 及鍵盤104。所述之應用介面單元20包括重力資訊接收介 面201、影像資訊接收介面202及顯示單元203。所述之 螢幕畫面旋轉單元30包括重力分析模組301、影像分析模 組302、螢幕轉換模組303及驅動模組304。該螢幕畫面 旋轉單元30可安裝於作業系統（0S)中，也可儲存於記 憶體中，當使用者開啟掌上型電子裝置1的螢幕畫面自動 201108032 旋轉功能時，由作業系統從記憶體中讀取並運行螢幕畫面 紅轉單元30。於本實施例中，螢幕晝面旋轉單元3〇直.接 安裝並運行於作業系統中。所述之掌上型電子裝置丄係為 筆§己型電腦、手機、音樂播放裝置、個人數位處理裝置 (PDA)之' —種。BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a palm-sized electronic device and a screen display method thereof, and more particularly to a palm-type electronic device and a method for automatically rotating the screen image thereof. [Prior Art] Gravity sensors have been widely used in recent years, and are well known in digital cameras and digital game machines. In the application of the handheld electronic device, most of the screens of the handheld electronic device are changed in accordance with the direction of the gravity of the handheld electronic device, and the adjustment of the angle of the face suitable for the user is adjusted by 2%. . However, the use of a gravity sensor in a palm-sized electronic device has the following problems: First, the use of a gravity sensor to sense the direction of gravity of the earth can be accurately known only when the palm-type electronic device is under the leveling acceleration motion. Gravity direction, - Once the handheld electronic device is in the state of acceleration motion, it is difficult to accurately sense the gravitational direction of the gravitational force, and it is impossible to accurately rotate the screen to the user's viewing level (four degrees); second, suitable for use The screen paintings that are viewed by the viewer: There is an absolute relationship between the non-fixed system and the direction of gravity. For example, when the m-type electronic device is used, the screen suitable for the user to view is ": gravity-independent, that is, the most suitable for use. The angle of the screen viewed by the user should be the angle at which the user's eyes face up. Therefore, if the gravity sensor and the face detection technology are used, the adjustment method suitable for the general user is used.糸为201108032 [Summary of the Invention] In the above content, it is necessary to provide a palm-type electronic device and a display screen display method of the camping screen, which can automatically rotate the screen surface of the handheld electronic device to the user's front view direction according to the viewing angle of the user. on. , = handheld electronic display, the handheld electronic split includes: gravity sensor 'for the purpose of monitoring and collecting the gravity of the handheld electronic device; camera, for ingesting the user's face昼The surface image, the gravity analysis module, is configured to obtain the gravity acceleration direction of the palm-shaped electronic device relative to the gravity of the earth by analyzing the gravity information, and compare the direction of the gravity acceleration with the screen direction of the display screen. Change the angle of the screen; the image analysis module is used to parse the face image of the face to obtain the user's front view angle, and compare the angle of the user's front view with the angle of the screen of the display screen to determine whether the screen needs to be changed. The angle of the screen; the screen switching module is used to generate a flashing switch when the screen screen needs to be converted. The screen switching command is used to control the display screen to display the front view angle of the screen to the user. a method for self-purity of a palm-screen (four) sub-device, the display-type electronic device comprising a display unit and a display screen, the method comprising the following =: (a) sensing an external force motion of the palm-shaped electronic skirt; (1) Whether the camera with the electronic device is turned on; (c) If the camera is not turned on, the following steps are performed: U1) acquisition of gravity information received by the handheld electronic device; (c2) acquisition of handheld electronic information by analyzing gravity information (4) the direction of the pan-tilt speed of the device relative to the gravitational force; (e3) the direction of the (4) picture of the display screen; (4) comparing the direction of gravity acceleration with the direction of the screen 201108032; (d) if the camera is turned on, Perform the following steps: (dl) ingesting the face image of the user; (d2) obtaining the front view direction of the user by parsing the face image of the face; (d3) obtaining the screen orientation of the display screen; (d4) The user's front view direction is compared with the screen picture direction; (e) according to the comparison result of (c4) or (d4) to determine whether it is necessary to convert the angle of the screen picture; (f) if it is not necessary to convert the screen face angle Then, the process proceeds to step (a); and (g) if the screen screen angle needs to be converted, a screen switching command is generated, and the display screen is controlled to display the screen transition angle according to the screen switching command. Compared with the conventional technology, The handheld electronic device and the screen display method thereof use the gravity sensing technology and the face detection technology to automatically rotate the screen of the handheld electronic device to the user's front view direction according to the viewing angle of the user. 1 is a block diagram of a preferred embodiment of the handheld electronic device 1 of the present invention. The handheld electronic device 1 includes a peripheral device 10, an application interface unit 20, and a screen face rotation unit 30. The device 10 includes a gravity sensor (G-Sensor) 101, a camera 102, a display screen 103, and a keyboard 104. The application interface unit 20 includes a gravity information receiving interface 201, an image information receiving interface 202, and a display unit 203. The screen rotation unit 30 includes a gravity analysis module 301, an image analysis module 302, a screen conversion module 303, and a drive module 304. The screen rotation unit 30 can be installed in the operating system (OS), or can be stored in the memory. When the user turns on the screen display automatic 201108032 rotation function of the handheld electronic device 1, the operating system reads from the memory. And running the screen red turn unit 30. In this embodiment, the screen face rotation unit 3 is directly installed and operated in the operating system. The handheld electronic device is a pen type computer and mobile phone. , music playback device, personal digital processing device (PDA) '- kind.
所述之重力感測器101用於即時監測並採集掌上型電 子裝置1所受的重力資訊，及將重力資訊藉由重力資訊接 收介面201傳送至重力分析模組3〇1。所述之攝影機1〇2 用於攝取使用者的人臉晝面影像，並藉由影像資訊接收介 面202將人臉晝面影像傳送至影像分析模組3〇2。所述之 顯示螢幕103用於顯示使用者操作使用掌上型電子裝置工 時產生的螢幕晝面。所述之鍵盤1〇4供使用者操作使用掌 上型電子裝置1時輸入操作指令，例如通知攝影機1〇2攝 取使用者人臉畫面的影像攝取指令。 所述之重力分析模組3G1用於藉由解析重力資訊來判 斷掌上型電子襄置㈠目對與地心引力的重力加速度方向， 將該重力加速度方向與螢幕畫面方向作比對來判斷是否 畫面的角度，當需要改變螢幕晝面的角度時 ^ it 並㈣縣轉換指令傳送給螢幕轉換 二=分Γ組302 ·解析人臉晝面的影像資 訊獲取錢者正視角度，根較用者 要轉換顯示螢幕103的螢幕畫面，♦ 】斲疋否而 ^ ^ ^ 田耑要轉換螢幕晝面時 產生螢幕㈣^ ’並㈣㈣轉換指令傳送給螢幕轉換 201108032 模組303。 所述之螢幕轉換模組303根據螢幕轉換指令藉由顯示 單元203控制顯示螢幕103轉換螢幕晝面至使用者合適的 正視角度。所述之轉換螢幕畫面的角度係指改變顯示螢幕 103上所顯示的文字及圖示的方向或角度，使螢幕晝面的 顯示方向轉換至使用者合適的正視方向。 所述之驅動模組304用於驅動掌上型電子裝置1的周 邊裝置10,包括驅動重力感測器101監測掌上型電子裝置 1所受的重力資訊，驅動攝影機102開啟攝影功能而獲取 使用者的人臉畫面影像，驅動顯示螢幕103顯示螢幕晝 面，及驅動鍵盤104接收影像攝取指令。 如圖2所示，係本發明掌上型電子裝置的螢幕晝面自 動旋轉方法較佳實施例的流程圖。步驟S201，當使用者使 用掌上型電子裝置1時，重力感測器101即時感測到掌上 型電子裝置1所受的外力運動。步驟S202，驅動模組304 判斷攝影機102是否被開啟，而啟動掌上型電子裝置1的 攝影功能。 步驟S203，若攝影機102沒有被開啟，重力感測器 101採集掌上型電子裝置1所受的重力資訊，並將重力資 訊藉由重力資訊接收介面201傳送至重力分析模組301。 步驟S204,重力分析模組301解析重力感測器101採集到 的重力資訊，藉此獲取掌上型電子裝置1相對於地心引力 的重力加速度方向。步驟S205，重力分析模組301獲取該 重力加速度方向及顯示螢幕103的螢幕晝面方向。步驟 201108032 S206’重力分析模組3〇1將該重力加速度方向與 1〇3的螢幕晝面方向作比對來判斷是否需要轉換：：幕 的角度。 、苯幕晝面The gravity sensor 101 is configured to monitor and collect the gravity information received by the palm-type electronic device 1 in real time, and transmit the gravity information to the gravity analysis module 3〇1 through the gravity information receiving interface 201. The camera 1〇2 is used to capture a facial image of the user, and the facial image is transmitted to the image analysis module 3〇2 by the image information receiving interface 202. The display screen 103 is used to display a screen surface generated by a user operating a handheld electronic device. The keyboard 1〇4 is used for inputting an operation command when the user operates the palm-type electronic device 1, for example, notifying the camera 1 to take an image capturing instruction of the user's face screen. The gravity analysis module 3G1 is configured to determine the direction of the gravity acceleration of the palm-shaped electronic device (1) and the gravity of the earth by analyzing the gravity information, and compare the direction of the gravity acceleration with the direction of the screen to determine whether the screen is The angle, when it is necessary to change the angle of the screen surface ^ it and (four) county conversion command is transmitted to the screen conversion two = branch group 302 · Analyze the image information of the face of the face to obtain the front view angle of the money, the root is more than the user to convert Display the screen screen of the screen 103, ♦ 】 而 No ^ ^ ^ The screen is generated when the screen is converted to the screen (4) ^ ' and (4) (4) The conversion command is transmitted to the screen conversion 201108032 module 303. The screen conversion module 303 controls the display screen 103 to switch the screen surface to the appropriate angle of view of the user by the display unit 203 according to the screen switching command. The angle of the converted screen screen refers to changing the direction and angle of the text and the icon displayed on the display screen 103, so that the display direction of the screen surface is switched to the appropriate front view direction of the user. The driving module 304 is configured to drive the peripheral device 10 of the handheld electronic device 1, including driving the gravity sensor 101 to monitor the gravity information received by the handheld electronic device 1, and driving the camera 102 to turn on the photography function to obtain the user's The face image, the drive display screen 103 displays the screen face, and the drive keyboard 104 receives the image capture command. As shown in FIG. 2, it is a flow chart of a preferred embodiment of the method for automatically rotating the screen surface of the handheld electronic device of the present invention. In step S201, when the user uses the handheld electronic device 1, the gravity sensor 101 immediately senses the external force motion of the handheld electronic device 1. In step S202, the driving module 304 determines whether the camera 102 is turned on, and activates the photographing function of the palm-type electronic device 1. In step S203, if the camera 102 is not turned on, the gravity sensor 101 collects the gravity information received by the handheld electronic device 1, and transmits the gravity information to the gravity analysis module 301 through the gravity information receiving interface 201. In step S204, the gravity analysis module 301 analyzes the gravity information collected by the gravity sensor 101, thereby obtaining the gravity acceleration direction of the palm-type electronic device 1 with respect to the gravity. In step S205, the gravity analysis module 301 acquires the direction of the gravitational acceleration and the direction of the screen surface of the display screen 103. Step 201108032 The S206' gravity analysis module 3〇1 compares the direction of gravity acceleration with the direction of the screen surface of 1〇3 to determine whether it is necessary to convert: the angle of the curtain. Benzene surface
步驟S208’若攝影機102被開啟，攝影機1〇 用者的人臉晝面影像，並藉由影像#訊接收介面取使 臉晝面的影像#訊傳送至影像分析模組观。步將人 影像分析模組3〇2解析人臉晝面影像資訊，藉此解’ 用者的正視方向，其解析方法請參照下圖3及圖 使 描述。步驟S2U)，影像分析模組3〇2判斷是否解析出=細 者的正視方向。若沒有騎岐料的正視方向，流種= 向步驟S203。若解析出使用者的正視方向，步驟， 則影像分析模組302獲取使用者正視方向及顯示螢幕ι〇3 的螢幕晝面方向。然後，影像分析模組3〇2將使用者正視 方向與螢幕晝面方向作比對，流程轉向步驟S2〇6以便判 斷是否需要轉換螢幕晝面的角度。 在上述步驟S206中，若需要轉換螢幕晝面的角度， 則流程轉向步驟S207’螢幕轉換模組303產生螢幕轉換指 令並根據該螢幕轉換指令藉由顯示單元203控制顯示螢幕 103轉換螢幕畫面的角度。若不需要轉換螢幕畫面的角度 時’則流程轉向步驟S201繼續感測到掌上型電子裝置1 所受的外力運動。所述之轉換螢幕晝面的角度係指改變顯 示榮幕103上所顯示的文字及圖示的方向或角度，使螢幕 晝面的顯示方向轉換至使用者合適的正視方向。 如圖3所示，係使用者站立時獲取並解析人臉晝面影 201108032 像資訊的一種示意圖。當掌上型電子裝置1經由攝影機102 攝取使用者人臉晝面33後，影像分析模組302可利用膚 色偵測技術找出較接近人體膚色的顏色區塊來取得人臉 晝面影像31。影像分析模組302利用眼睛32部位顏色與 眼睛32周圍膚色的差別特性及眼睛32係兩個對稱分佈在 臉部中心線34兩側的特性來取得眼睛32的位置，並經由 連接雙眼位置可得到一條雙眼連接線35，該雙眼連接線 35與臉部中心線34交於雙眼中點36。影像分析模組302 ^ 從雙眼中點36以雙眼連接線35做為分界線，沿著臉部中 心線34的延伸線，分別往雙眼連接線35兩側找到嘴巴37 的位置。影像分析模組302沿著臉部中心線34，連接雙眼 中點36與嘴巴37而得到眼鼻嘴連接線38,藉由雙眼連接 線35與眼鼻嘴連接線38構成的T字形39,就可以得知使 用者此時的正視角度。 如圖4所示，係使用者橫臥時獲取並解析人臉晝面影 • 像資訊的另一種示意圖。當使用者正視角度與掌上型電子 裝置1的攝影機102角度不一致時，仍可使用如圖3所述 之判斷使用者正視角度的方法來得到使用者的正視角度。 以上所述僅為本發明之較佳實施例而已，且已達廣泛 之使用功效，凡其他未脫離本發明所揭示之精神下所完成 之均等變化或修飾，均應包含在下述之申請專利範圍内。 【圖式簡單說明】 圖1係本發明掌上型電子裝置較佳實施例的架構圖。 圖2係本發明掌上型電子裝置的螢幕晝面自動旋轉方 201108032 法較佳實施例的流程圖。 圖3係使用者站立時獲取並解析人臉晝面影像資訊的 示意圖。 圖4係使用者橫臥時獲取並解析人臉晝面影像資訊的 示意圖。 【主要元件符號說明】Step S208' If the camera 102 is turned on, the camera 1 detects the user's face image and transmits the image of the face to the image analysis module by the image receiving interface. The human image analysis module 3〇2 analyzes the face image information of the face to solve the front view direction of the user. For the analysis method, please refer to FIG. 3 and FIG. In step S2U), the image analysis module 3〇2 determines whether or not the positive direction of the fine object is resolved. If there is no forward viewing direction of the riding material, the flow type = to step S203. If the front view direction of the user is analyzed, the image analysis module 302 acquires the front view direction of the user and displays the screen orientation of the screen 〇3. Then, the image analysis module 3〇2 compares the user's front view with the face of the screen, and the flow proceeds to step S2〇6 to determine whether it is necessary to convert the angle of the face of the screen. In the above step S206, if it is necessary to convert the angle of the screen surface, the flow moves to step S207. The screen conversion module 303 generates a screen switching command and controls the display screen 103 to switch the angle of the screen screen according to the screen switching command. . If it is not necessary to convert the angle of the screen screen, then the flow proceeds to step S201 to continue sensing the external force motion of the palm-type electronic device 1. The angle of the screen surface of the screen is changed to change the direction and angle of the text and the icon displayed on the screen 103, so that the display direction of the screen surface is switched to the appropriate front view direction of the user. As shown in FIG. 3, the user obtains and parses the face and face image of the 201108032 image. After the handheld electronic device 1 captures the user's face 33 through the camera 102, the image analysis module 302 can use the skin color detection technology to find a color block that is closer to the skin color of the human body to obtain the face image 31. The image analysis module 302 uses the difference characteristics of the color of the eye 32 and the skin color around the eye 32 and the characteristics of the two sides of the eye 32 which are symmetrically distributed on both sides of the face center line 34 to obtain the position of the eye 32, and can be connected via the binocular position. A binocular connection line 35 is obtained which intersects the facial centerline 34 at the midpoint 36 of both eyes. The image analysis module 302 ^ uses the binocular connection line 35 as a boundary line from the midpoint 36 of the eye, and finds the position of the mouth 37 on both sides of the binocular connection line 35 along the extension line of the center line 34 of the face. The image analysis module 302 connects the binocular midpoint 36 and the mouth 37 along the facial center line 34 to obtain the eye nose and mouth connection line 38, and the T-shaped shape 39 formed by the binocular connection line 35 and the eye-nose nozzle connection line 38, It is possible to know the front view angle of the user at this time. As shown in Fig. 4, it is another schematic diagram of the information obtained when the user is lying and parsing the face. When the user's front view angle is inconsistent with the angle of the camera 102 of the palm-type electronic device 1, the method of determining the user's front view angle as shown in Fig. 3 can be used to obtain the front view angle of the user. The above is only the preferred embodiment of the present invention, and has been used in a wide range of applications. Any other equivalent changes or modifications which are not departing from the spirit of the present invention should be included in the following claims. Inside. BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a block diagram of a preferred embodiment of a palm-sized electronic device of the present invention. 2 is a flow chart of a preferred embodiment of the method of automatically rotating the screen surface of the handheld electronic device of the present invention. Figure 3 is a schematic diagram of acquiring and parsing facial image information when the user is standing. Figure 4 is a schematic diagram of acquiring and parsing facial image information when the user is lying down. [Main component symbol description]
掌上型電子裝置 1 周邊裝置 10 重力感測器 101 攝影機 102 顯示螢幕 103 鍵盤 104 應用介面單元 20 重力資訊接收介面 201 影像資訊接收介面 202 顯示單元 203 螢幕晝面旋轉單元 30 重力分析模組 301 影像分析模組 302 螢幕轉換模組 303 驅動模組 304 11Palm-type electronic device 1 Peripheral device 10 Gravity sensor 101 Camera 102 Display screen 103 Keyboard 104 Application interface unit 20 Gravity information receiving interface 201 Image information receiving interface 202 Display unit 203 Screen surface rotation unit 30 Gravity analysis module 301 Image analysis Module 302 screen conversion module 303 drive module 304 11