TWI777274B - Method, program, and readable medium for navigation based on reality images - Google Patents

Method, program, and readable medium for navigation based on reality images Download PDF

Info

Publication number
TWI777274B
TWI777274B TW109136044A TW109136044A TWI777274B TW I777274 B TWI777274 B TW I777274B TW 109136044 A TW109136044 A TW 109136044A TW 109136044 A TW109136044 A TW 109136044A TW I777274 B TWI777274 B TW I777274B
Authority
TW
Taiwan
Prior art keywords
navigation
node
image
coordinates
real
Prior art date
Application number
TW109136044A
Other languages
Chinese (zh)
Other versions
TW202217243A (en
Inventor
陳世中
吳崇民
陳沛仲
陳凱榆
陳有圳
黃基哲
林誠翊
Original Assignee
南臺學校財團法人南臺科技大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 南臺學校財團法人南臺科技大學 filed Critical 南臺學校財團法人南臺科技大學
Priority to TW109136044A priority Critical patent/TWI777274B/en
Publication of TW202217243A publication Critical patent/TW202217243A/en
Application granted granted Critical
Publication of TWI777274B publication Critical patent/TWI777274B/en

Links

Images

Landscapes

  • User Interface Of Digital Computer (AREA)
  • Navigation (AREA)

Abstract

The present invention relates to a method, a program, and a readable medium for navigation based on reality images. The method includes: setting a launch point and arbitrarily setting at least one node point; calculating a navigating path from the launch point; establishing navigation messages respectively corresponding to a launch-point position coordinate and at least one node-point position coordinate; photographing a navigation reality image along the navigating path and showing the navigation reality image on a display unit; the display unit showing the navigation reality image and a corresponding one of the navigation messages while a navigated position coordinate is approaching the at least one node-point position coordinate so that, with the guidance of the corresponding navigation message, users can be navigated to pass through the at least one node-point position coordinate sequentially along the navigation path. This method allows users to change the navigation path freely by adding the least one node point, depending on which places they want to pass through, and therefore is convenient to use.

Description

在實境影像中執行導航的方法、程式及可讀取媒體 Method, program and readable medium for performing navigation in reality imagery

本發明係關於一種導航的方法、電腦程式及電腦可讀取媒體,特別係指一種在實境影像中執行導航的方法、程式及可讀取媒體。 The present invention relates to a navigation method, a computer program, and a computer-readable medium, and in particular, to a method, program, and computer-readable medium for performing navigation in a real image.

當人的腦部神經發展產生障礙時,或是腦部退化之後,例如自閉症或失智症的患者,常會有迷路的情況。為了避免患者迷路,最直接的方式是讓患者攜帶繪製好的地圖,並在地圖上標示出醒目的地標,以讓患者找到回家或前往特定地點的路。 When people's brain nerve development is hindered, or after brain degeneration, such as patients with autism or dementia, they often get lost. In order to prevent the patient from getting lost, the most direct way is to have the patient carry a drawn map with prominent landmarks marked on the map so that the patient can find the way home or to a specific place.

一般的地圖無法立即顯示患者的所在位置,對於患者來說可能仍較難以判讀,因此患者的家人或醫護人員可以讓患者攜帶可以實時導航的裝置,具體例如中國專利公告號第CN 102121831 B號提供的一種實時街景導航方法及設備,主要是在行駛過程中終端的採集裝置實時採集所處位置的實時街景並在顯示屏上顯示,在導航路線信息的各導航點中,實時確定與接收到的GPS信息中地理座標相匹配的當前導航點,並在顯示屏上顯示的導航路線中顯示當前導航點。 General maps cannot immediately display the patient's location, and it may still be difficult for the patient to interpret. Therefore, the patient's family or medical staff can allow the patient to carry a device that can navigate in real time. For example, China Patent Publication No. CN 102121831 B provides A real-time street view navigation method and device, mainly in the process of driving, the collection device of the terminal collects the real-time street view of the location in real time and displays it on the display screen, and in each navigation point of the navigation route information, the real-time determination and reception are carried out. The current navigation point that matches the geographic coordinates in the GPS information, and displays the current navigation point in the navigation route displayed on the display.

除了前述專利案的方式,Google於2018年也在Google Maps應用程式中推出了AR實景導航功能,用戶選擇「Live View」模式後,會切換至手機當前鏡頭拍攝的實景即時畫面,並且會顯示指示方向的AR標誌。 In addition to the method of the aforementioned patent case, Google also launched the AR real-time navigation function in the Google Maps application in 2018. After the user selects the "Live View" mode, it will switch to the real-time real-time image captured by the current lens of the mobile phone, and an indicator will be displayed. AR sign for directions.

然而,無論是前述專利案,還是Google Maps的「Live View」模式,都無法自由設定導航的路線中要經過哪些場所,使用上仍十分不便。 However, neither the aforementioned patent case nor the "Live View" mode of Google Maps can freely set which places to pass through in the navigation route, which is still very inconvenient to use.

爰此,本發明人提出一種在實境影像中自由建立導航訊息並執行導航的方法,包含下列步驟:在一座標範圍內,設定一出發點及任意設定至少一節點,紀錄該出發點的一出發點座標及該至少一節點的一節點座標;由該出發點執行一導航路徑,該導航路徑連接該出發點及該至少一節點,並在沿該導航路徑行進時,持續地或定時地獲取行進當下的一導航座標;根據該導航路徑,再對應上述出發點座標及該至少一節點座標,分別建立一導航訊息;在該導航路徑中,由一影像擷取單元拍攝一導航實景影像,該導航實景影像顯示在一顯示單元;在該導航座標接近該至少一節點座標時,該顯示單元同時顯示該導航實景影像與該導航訊息,藉由該至少一節點座標所對應的該導航訊息的指引,使該導航路徑通過該至少一節點座標,完成導航。 Therefore, the present inventor proposes a method for freely establishing navigation information and executing navigation in a real image, including the following steps: within a coordinate range, setting a starting point and arbitrarily setting at least one node, and recording a starting point coordinate of the starting point and a node coordinate of the at least one node; a navigation path is executed from the starting point, the navigation path connects the starting point and the at least one node, and when traveling along the navigation path, continuously or regularly obtains a current navigation coordinates; according to the navigation path, and then corresponding to the coordinates of the starting point and the at least one node coordinate, a navigation message is respectively established; in the navigation path, an image capture unit captures a real navigation image, and the real navigation image is displayed on a a display unit; when the navigation coordinate is close to the at least one node coordinate, the display unit simultaneously displays the navigation real-world image and the navigation information, and makes the navigation path pass through the guidance of the navigation information corresponding to the at least one node coordinate The at least one node coordinate completes the navigation.

進一步,紀錄對應該至少一節點的一節點影像,當該導航座標接近該至少一節點座標時,一處理單元比對該節點影像及該導航實景影像;若該節點影像及該導航實景影像的相同程度高於一閾值,則該處理單元控制該顯示單元同時顯示該導航實景影像與該導航訊息。 Further, a node image corresponding to the at least one node is recorded, and when the navigation coordinate is close to the at least one node coordinate, a processing unit compares the node image and the navigation real image; if the node image and the navigation real image are the same If the level is higher than a threshold, the processing unit controls the display unit to simultaneously display the navigation real image and the navigation information.

其中,該節點的數量為複數個,該等節點依照一建立時間順序排列,該導航路徑根據該建立時間順序,依序通過上述每一節點。 Wherein, the number of the nodes is plural, the nodes are arranged according to an establishment time sequence, and the navigation path passes through each of the above nodes in sequence according to the establishment time sequence.

其中,該節點的數量為複數個,該等節點依照一任選順序排列,該導航路徑根據該任選順序,依序通過上述每一節點。 Wherein, the number of the nodes is plural, the nodes are arranged according to an optional order, and the navigation path passes through each of the above nodes in sequence according to the optional order.

其中,該導航訊息包含下列之一或其組合:一靜態方向指引訊息、一聲音指引訊息、一多媒體訊息、一動態方向指引訊息及一振動訊息。 Wherein, the navigation message includes one or a combination of the following: a static direction guidance message, a voice guidance message, a multimedia message, a dynamic direction guidance message and a vibration message.

進一步,建立一附加訊息,該附加訊息根據該導航座標而選擇性地顯示在該顯示單元,該附加訊息包含下列之一或其組合:一附加聲音訊息、一附加多媒體訊息及一附加振動訊息。 Further, an additional message is created, the additional message is selectively displayed on the display unit according to the navigation coordinates, and the additional message includes one or a combination of the following: an additional sound message, an additional multimedia message and an additional vibration message.

其中,該附加訊息係在下列條件之一下顯示在該顯示單元:該導航座標接近該節點座標、該導航座標位於相鄰的二節點座標之間,以及該導航座標與最接近的該節點座標偏離達一預設值。 Wherein, the additional information is displayed on the display unit under one of the following conditions: the navigation coordinate is close to the node coordinate, the navigation coordinate is located between two adjacent node coordinates, and the navigation coordinate deviates from the closest node coordinate to a preset value.

進一步,紀錄所述節點的一節點名稱,在該導航座標依序接近上述每一節點座標時,該顯示單元同時顯示對應每一節點座標的該節點名稱。 Further, a node name of the node is recorded, and when the navigation coordinate is close to each of the above-mentioned node coordinates in sequence, the display unit simultaneously displays the node name corresponding to each node coordinate.

本發明人又提出一種電腦程式,安裝於一電腦,該電腦程式用於執行前述在實境影像中自由建立導航訊息並執行導航的方法。 The present inventor further proposes a computer program installed in a computer, the computer program is used for executing the aforementioned method of freely creating navigation information in a real image and executing navigation.

本發明人再提出一種電腦可讀取媒體,記錄有一電腦程式,該電腦程式安裝於一電腦後,用於執行前述在實境影像中自由建立導航訊息並執行導航的方法。 The inventor further proposes a computer-readable medium recording a computer program, which is installed in a computer and used to execute the aforementioned method for freely creating navigation information in a real-world image and executing navigation.

根據上述技術特徵可達成以下功效: According to the above technical features, the following effects can be achieved:

1.可以任意設定節點,也就是自由設定導航路徑中要經過哪些場所,方便應用於不同情況。 1. The nodes can be set arbitrarily, that is, the places to be passed in the navigation path can be freely set, which is convenient for different situations.

2.藉由導航實景影像與適時的導航訊息,使用者可以更輕鬆的得知該往哪個方向前進。 2. By navigating live images and timely navigation information, users can more easily know which direction to go.

3.節點可以依照建立時間順序排列,或是依照任選順序排列,方便使用者依實際需求選擇。 3. Nodes can be arranged in the order of creation time, or arranged in an optional order, which is convenient for users to choose according to actual needs.

4.導航訊息除了是如箭頭的靜態、動態方向指引,也可以是聲音、多媒體或振動,以更好的讓使用者注意到是否該轉彎了。 4. In addition to the static and dynamic direction guidance such as arrows, the navigation information can also be sound, multimedia or vibration, so as to better let the user notice whether it is time to turn.

5.除了導航訊息,可以再建立附加訊息,藉由聲音、多媒體或振動,維持使用者的專注力。 5. In addition to the navigation information, additional information can be created to maintain the user's concentration through sound, multimedia or vibration.

6.當導航座標與最接近的節點座標偏離達預設值時,可以藉由附加訊息,提醒使用者依照導航路徑行走。 6. When the deviation between the navigation coordinates and the closest node coordinates reaches the preset value, the user can be reminded to follow the navigation path through additional information.

7.當導航座標接近節點座標時,顯示單元會同時顯示節點名稱,方便使用者確認走到哪裡。 7. When the navigation coordinates are close to the node coordinates, the display unit will display the node name at the same time, which is convenient for the user to confirm where to go.

8.除了藉由導航座標確認使用者是否接近節點,也可以藉由節點的節點影像與導航實景影像再次確定使用者是否接近節點、方向是否正確。 8. In addition to confirming whether the user is approaching the node by the navigation coordinates, the node image of the node and the navigation real image can also be used to confirm whether the user is approaching the node and whether the direction is correct.

1:平板電腦 1: Tablet PC

2a:第一節點 2a: first node

21a:第一節點名稱 21a: first node name

2b:第二節點 2b: Second Node

21b:第二節點名稱 21b: Second node name

2c:第三節點 2c: Third Node

21c:第三節點名稱 21c: Third node name

2d:第四節點 2d: Fourth node

21d:第四節點名稱 21d: Fourth node name

3:導航訊息 3: Navigation message

[第一圖]係本發明實施例之流程方塊圖一,示意執行在實境影像中自由建立導航訊息並執行導航的方法。 [FIGURE 1] is a block diagram 1 of a flow chart according to an embodiment of the present invention, which illustrates a method for freely creating navigation information in a real-world image and executing navigation.

[第二圖]係本發明實施例之實施示意圖一,示意設定第一節點,並記錄第一節點名稱。 [Fig. 2] is the first implementation diagram of the embodiment of the present invention, which shows the setting of the first node and the recording of the name of the first node.

[第三圖]係本發明實施例之實施示意圖二,示意設定第二節點,並記錄第二節點名稱。 [Figure 3] is the second implementation diagram of the embodiment of the present invention, which shows the setting of the second node and the recording of the name of the second node.

[第四圖]係本發明實施例之實施示意圖三,示意節點依照建立時間順序排列。 [FIG. 4] is a schematic diagram 3 of the implementation of the embodiment of the present invention, which shows that the nodes are arranged in the order of establishment time.

[第五圖]係本發明實施例之實施示意圖四,示意節點依照任選順序排列。 [Fig. 5] is a fourth schematic diagram of the implementation of the embodiment of the present invention, showing that the nodes are arranged in an optional order.

[第六圖]係本發明實施例之實施示意圖五,示意顯示導航訊息。 [Fig. 6] is a schematic diagram 5 of the implementation of the embodiment of the present invention, which schematically displays navigation information.

[第七圖]係本發明實施例之實施示意圖六,示意顯示節點名稱。 [Figure 7] is a sixth schematic diagram of the implementation of the embodiment of the present invention, which schematically shows the node name.

[第八圖]係本發明實施例之流程方塊圖二,示意根據導航座標判斷是否接近節點。 [Fig. 8] is a second block diagram of the flow chart of the embodiment of the present invention, which shows whether the node is approached according to the navigation coordinates.

[第九圖]係本發明實施例之流程方塊圖三,示意搭配節點影像判斷是否接近節點。 [Fig. 9] is a block diagram 3 of the flow chart of the embodiment of the present invention, which illustrates the determination of whether the node is close to the node with the image of the node.

綜合上述技術特徵,本發明在實境影像中執行導航的方法、程式及可讀取媒體的主要功效將可於下述實施例清楚呈現。 In view of the above technical features, the method, program and readable medium of the present invention for performing navigation in a real image will be clearly presented in the following embodiments.

請參閱第一圖及第二圖,係揭示本發明實施例在實境影像中自由建立導航訊息並執行導航的方法,可以是藉由一電腦程式安裝於一電腦後而執行,也可以是記錄有該電腦程式的一電腦可讀取媒體,藉由該電腦程式安裝於該電腦後而執行,在本發明之較佳實施例中,以一平板電腦1作為該電腦[該平板電腦1請搭配第四圖]。 Please refer to the first and second figures, which illustrate a method for freely creating navigation information in a real-world image and executing navigation according to an embodiment of the present invention, which may be executed by a computer program installed on a computer, or may be recorded A computer-readable medium having the computer program is executed after the computer program is installed on the computer. In the preferred embodiment of the present invention, a tablet computer 1 is used as the computer [the tablet computer 1 should be matched with Fourth image].

該在實境影像中自由建立導航訊息並執行導航的方法包含下列步驟:在一座標範圍內,由一第一使用者在該平板電腦1中設定一出發點及任意設定複數節點[該平板電腦1請搭配第四圖],該平板電腦1紀錄該出發點的一出發點座標,並紀錄所述節點各自的一節點座標及一節點名稱。在本發明之較佳實施方式中,所述節點的數量為複數個,且是藉由該平板電腦1來執行該在實境影像中自由建立導航訊息並執行導航的方法,於實際實施時不限於此。所述節點的數量及位置,都可以在該座標範圍內任意設定,也就是可以自由設定一導航路徑中要經過哪些場所,方便應用於不同情況。 The method for freely creating navigation information in a real image and executing navigation includes the following steps: within a coordinate range, a first user sets a starting point in the tablet computer 1 and arbitrarily sets a plurality of nodes [the tablet computer 1 Please refer to the fourth figure], the tablet computer 1 records a starting point coordinate of the starting point, and records a node coordinate and a node name of each of the nodes. In a preferred embodiment of the present invention, the number of the nodes is plural, and the tablet computer 1 is used to execute the method of freely creating navigation information in the real image and executing the navigation. limited to this. The number and position of the nodes can be arbitrarily set within the coordinate range, that is, the places to be passed in a navigation path can be freely set, which is convenient for different situations.

請參閱第二圖,該第一使用者持取該平板電腦1[該平板電腦1請搭配第四圖],先將走廊三樓設定為一第一節點2a,並在該平板電腦1中輸入「走廊三樓」以做為對應該第一節點2a的一第一節點名稱21a。 Referring to the second figure, the first user holds the tablet computer 1 [please match the tablet computer 1 with the fourth figure], firstly sets the third floor of the corridor as a first node 2a, and inputs the input in the tablet computer 1 "Corridor 3rd Floor" is used as a first node name 21a corresponding to the first node 2a.

請參閱第三圖,接著該第一使用者持取該平板電腦1走至三樓樓梯口[該平板電腦1請搭配第四圖],將三樓樓梯口設定為一第二節點2b,並在該平板電腦1中輸入「三樓樓梯口」以做為對應該第二節點2b的一第二節點名稱21b。 Please refer to the third picture, then the first user holds the tablet computer 1 and walks to the stairwell on the third floor [please match the tablet computer 1 with the fourth picture], sets the stairwell on the third floor as a second node 2b, and In the tablet computer 1, input "the third floor stairway" as a second node name 21b corresponding to the second node 2b.

請參閱第二圖至第四圖,該第一使用者可以繼續走到二樓教室,將二樓教室設定為一第三節點2c[該第三節點2c請搭配第六圖],在該平板電腦1中輸入「二樓教室」以做為對應該第三節點2c的一第三節點名稱21c,並繼續走到廁所,將廁所設定為一第四節點2d[該第四節點2d請搭配第七圖],在該平板電腦1中輸入「廁所」以做為對應該第四節點2d的一第四節點名稱21d。 Please refer to the second to the fourth picture, the first user can continue to go to the classroom on the second floor, and set the classroom on the second floor as a third node 2c [the third node 2c should be matched with the sixth picture], on the tablet Enter "Classroom on the second floor" into the computer 1 as a third node name 21c corresponding to the third node 2c, and continue to go to the toilet, and set the toilet as a fourth node 2d [Please match the fourth node 2d with the first node. Fig. 7], input "toilet" in the tablet computer 1 as a fourth node name 21d corresponding to the fourth node 2d.

由於該第一使用者是依序建立該第一節點2a、該第二節點2b、該第三節點2c及該第四節點2d,所述節點可以根據該第一使用者建立所述節點的時間,而依照一建立時間順序排列,也就是在該平板電腦1上顯示的該節點名稱依序為該第一節點名稱21a、該第二節點名稱21b、該第三節點名稱21c及該第四節點名稱21d。 Since the first user establishes the first node 2a, the second node 2b, the third node 2c and the fourth node 2d in sequence, the nodes can be based on the time when the first user established the node , and according to a creation time sequence, that is, the node names displayed on the tablet computer 1 are the first node name 21a, the second node name 21b, the third node name 21c and the fourth node name in sequence Name 21d.

請參閱第五圖,所述節點也可以根據該第一使用者對所述節點前後順序進行的調整,而依照一任選順序排列,方便該第一使用者依照實際需求做選擇。以第五圖為例,該第一使用者可以將該第三節點名稱21c及該第四節點名稱21d調換,而使該平板電腦1上顯示的該節點名稱依序為該第一節點名稱21a、該第二節點名稱21b、該第四節點名稱21d及該第三節點名稱21c。 Referring to the fifth figure, the nodes can also be arranged in an optional order according to the adjustment of the first user's order of the nodes before and after, so that the first user can make selections according to actual needs. Taking the fifth figure as an example, the first user can exchange the third node name 21c and the fourth node name 21d, so that the node name displayed on the tablet computer 1 is the first node name 21a in sequence , the second node name 21b, the fourth node name 21d and the third node name 21c.

請參閱第一圖、第六圖及第七圖,該第一使用者完成前述設定後,換一第二使用者持取該平板電腦1,由該出發點執行該導航路徑,該導航路徑連接該出發點及所述節點,並在沿該導航路徑行進時,持續地或定時地獲取行進當下的中的一導航座標。 Please refer to Figure 1, Figure 6 and Figure 7, after the first user completes the aforementioned settings, a second user holds the tablet computer 1, and executes the navigation path from the starting point, and the navigation path connects the The starting point and the node, and when traveling along the navigation path, continuously or periodically obtain a navigation coordinate in the current travel.

根據該導航路徑,再對應上述出發點座標及該節點座標,分別建立一導航訊息3。該導航訊息3包含下列之一或其組合:一靜態方向指引訊息、一聲音指引訊息、一多媒體訊息、一動態方向指引訊息及一振動訊息。 According to the navigation path, and corresponding to the coordinates of the starting point and the node, a navigation message 3 is created respectively. The navigation message 3 includes one or a combination of the following: a static direction guidance message, a voice guidance message, a multimedia message, a dynamic direction guidance message and a vibration message.

在該導航路徑中,由一影像擷取單元拍攝一導航實景影像,該導航實景影像顯示在一顯示單元。該影像擷取單元可以是該平板電腦1的照相機,該顯示單元則可以是該平板電腦1的顯示螢幕,於實際實施時,也可以是獨立的攝影機與螢幕。 In the navigation path, an image capturing unit captures a real navigation image, and the real navigation image is displayed on a display unit. The image capturing unit may be the camera of the tablet computer 1 , the display unit may be the display screen of the tablet computer 1 , or may be an independent camera and screen in actual implementation.

請參閱第六圖及第八圖,根據所述節點的該建立時間順序或該任選順序建立該導航路徑,使該導航路徑根據該建立時間順序或該任選順序,依序通過上述每一節點。接著,開始執行導航,並拍攝該導航實景影像,在該導航座標依序接近符合該建立時間順序或該任選順序的上述每一節點座標時,該顯示單元同時顯示該導航實景影像與該導航訊息3,以及對應每一節點座標的該節點名稱。 Please refer to Fig. 6 and Fig. 8, the navigation path is established according to the establishment time sequence or the optional sequence of the nodes, so that the navigation route passes through each of the above in sequence according to the establishment time sequence or the optional sequence node. Next, start to perform navigation, and shoot the navigation real image, when the navigation coordinates are sequentially close to the coordinates of each node in accordance with the establishment time sequence or the optional sequence, the display unit simultaneously displays the navigation real image and the navigation Message 3, and the node name corresponding to each node coordinate.

判斷該導航座標是否接近該節點座標時,可以藉由在該座標範圍中,該導航座標與該節點座標的兩點間距離是否小於一誤差範圍來判斷,而兩 點間距離係由以下公式計算得到:

Figure 109136044-A0305-02-0009-1
,其中, 該節點座標為(x0,y0,z0),該導航座標為(x1,y1,z1)。當有兩個以上的該節點座標,且這兩個以上的該節點座標藉由以上公式計算出與該導航座標間的距離均小 於該誤差範圍時,則根據該建立時間順序或該任選順序,判斷這兩個以上的該節點座標各自對應之所述節點的先後順序,根據優先的所述節點對應之該節點座標顯示該導航訊息3。 When judging whether the navigation coordinate is close to the node coordinate, it can be judged by whether the distance between the two points between the navigation coordinate and the node coordinate is less than an error range in the coordinate range, and the distance between the two points is calculated by the following formula get:
Figure 109136044-A0305-02-0009-1
, where the node coordinates are (x 0 , y 0 , z 0 ), and the navigation coordinates are (x 1 , y 1 , z 1 ). When there are more than two coordinates of the node, and the distance between the coordinates of the node and the navigation coordinates calculated by the above formula is less than the error range, then according to the establishment time sequence or the optional sequence , judging the sequence of the nodes corresponding to the two or more node coordinates, and displaying the navigation message 3 according to the node coordinates corresponding to the priority node.

藉由每一節點座標所對應的該導航訊息3的指引,使該導航路徑逐一通過上述所有節點座標,完成導航。 With the guidance of the navigation message 3 corresponding to each node coordinate, the navigation path is made to pass through all the above node coordinates one by one to complete the navigation.

請參閱第五圖至第七圖,以該導航路徑根據該任選順序依序通過上述每一節點為例,該第二使用者從該第二節點2b要往該第四節點2d前進時[該第二節點2b請搭配第三圖],由於該第四節點2d位於該第二節點2b的左側,因此該導航訊息3例如可以是向左轉的箭頭,而抵達該第四節點2d時,則是在該導航實景影像上顯示該第四節點名稱21d,也就是顯示「廁所」的文字。實際實施時,該導航訊息3也可以是指示牌的圖案、「請左轉」的語音提示,甚至是該平板電腦1的左側振動等等。 Please refer to Figures 5 to 7, taking the navigation path passing through each of the above nodes in sequence according to the optional sequence as an example, when the second user is going from the second node 2b to the fourth node 2d [ The second node 2b should be matched with the third picture], since the fourth node 2d is located on the left side of the second node 2b, the navigation message 3 may be, for example, an arrow turning left, and when reaching the fourth node 2d, Then, the name 21d of the fourth node, that is, the text of "toilet" is displayed on the navigation real image. In actual implementation, the navigation message 3 may also be a pattern of a sign, a voice prompt of "please turn left", or even the vibration of the left side of the tablet computer 1, and so on.

請參閱第一圖及第九圖,判斷該導航座標是否接近該節點座標時,除了藉由該導航座標與該節點座標的兩點間距離是否小於一誤差範圍來判斷,還可以再搭配節點影像來輔助判斷。同樣根據所述節點的該建立時間順序或該任選順序建立該導航路徑,事先紀錄分別對應所述節點的一節點影像。接著,開始執行導航,並拍攝該導航實景影像,當該導航座標接近符合該建立時間順序或該任選順序的該節點座標,也就是該導航座標與該節點座標的兩點間距離小於該誤差範圍時,一處理單元會比對該節點影像及該導航實景影像,該處理單元例如是該平板電腦1的處理器[該平板電腦1請搭配第四圖]。 Please refer to the first and ninth figures. When judging whether the navigation coordinate is close to the node coordinate, in addition to judging by whether the distance between the two points of the navigation coordinate and the node coordinate is less than an error range, the node image can also be matched. to aid judgment. The navigation path is also established according to the establishment time sequence or the optional sequence of the nodes, and a node image corresponding to the nodes is recorded in advance. Next, start to perform navigation, and shoot the navigation real scene image, when the navigation coordinates are close to the node coordinates that conform to the establishment time sequence or the optional sequence, that is, the distance between the navigation coordinates and the node coordinates is less than the error. In the range, a processing unit compares the node image and the navigation real image, for example, the processing unit is the processor of the tablet computer 1 [please match the tablet computer 1 with the fourth picture].

若該節點影像及該導航實景影像的相同程度高於一閾值,則該處理單元控制該顯示單元同時顯示該導航實景影像與該導航訊息3[該導航訊息3 請搭配第六圖];若該節點影像及該導航實景影像的相同程度不高於該閾值,例如:該第二使用者雖然位於該節點座標,但該第二使用者面向錯誤方向,此時該處理單元就可以先不控制該顯示單元同時顯示該導航實景影像與該導航訊息3,而是控制該平板電腦1發出提示等等,通知該第二使用者方向錯誤,等到該第二使用者轉到正確方向,使該節點影像及該導航實景影像的相同程度高於該閾值,該處理單元再控制該顯示單元同時顯示該導航實景影像與該導航訊息3,避免該第二使用者走錯。 If the same degree of the node image and the navigation real image is higher than a threshold, the processing unit controls the display unit to simultaneously display the navigation real image and the navigation message 3 [the navigation message 3 Please match the sixth image]; if the same degree of the node image and the navigation real image is not higher than the threshold, for example: although the second user is located at the node coordinates, but the second user is facing the wrong direction, then The processing unit may not control the display unit to simultaneously display the navigation live image and the navigation message 3, but control the tablet computer 1 to issue a prompt, etc. to notify the second user that the direction is wrong, and wait until the second user Turn to the correct direction, so that the same degree of the node image and the navigation real image is higher than the threshold, the processing unit then controls the display unit to display the navigation real image and the navigation message 3 at the same time, so as to prevent the second user from going wrong .

藉由該導航座標與該節點座標的兩點間距離,以及該節點影像及該導航實景影像的相同程度,可以再次確認該第二使用者是否真的接近所述節點、方向是否正確,避免還沒到所述節點就顯示該導航訊息3,造成該第二使用者的不便。 According to the distance between the two points of the navigation coordinates and the node coordinates, and the degree of the same degree of the node image and the navigation real image, it can be confirmed again whether the second user is really close to the node and whether the direction is correct, so as to avoid further errors. The navigation message 3 is displayed before reaching the node, causing inconvenience to the second user.

透過該導航實景影像與適時的該導航訊息3,該第二使用者可以更輕鬆的得知該往哪個方向前進,並且可以更容易的注意到是否該轉彎了,而藉由該節點名稱的顯示,該第二使用者可以更輕鬆的得知現在走到哪裡,輔助使用者進行該導航路徑的記憶或回想。 Through the navigation real image and the timely navigation information 3, the second user can more easily know which direction to go, and can more easily notice whether it is time to turn, and through the display of the node name , the second user can more easily know where to go now, and assist the user to memorize or recall the navigation path.

除了該導航訊息3,也可以建立一附加訊息,該附加訊息根據該導航座標而選擇性地顯示在該顯示單元,該附加訊息包含下列之一或其組合:一附加聲音訊息、一附加多媒體訊息及一附加振動訊息。該附加訊息係在下列條件之一下顯示在該顯示單元:該導航座標接近該節點座標、該導航座標位於相鄰的二節點座標之間,以及該導航座標與最接近的該節點座標偏離達一預設值。 In addition to the navigation message 3, an additional message can also be created. The additional message is selectively displayed on the display unit according to the navigation coordinates. The additional message includes one or a combination of the following: an additional audio message, an additional multimedia message and an additional vibration message. The additional information is displayed on the display unit under one of the following conditions: the navigator coordinate is close to the node coordinate, the navigator coordinate is located between two adjacent node coordinates, and the navigator coordinate deviates from the closest node coordinate by up to one default value.

舉例來說,當該導航座標接近符合該建立時間順序或該任選順序的該節點座標時,例如該第二使用者抵達路口時,可以藉由該附加訊息通知該第二使用者前方為路口,以讓該第二使用者小心通過路口。當該導航座標位於相鄰的二節點座標之間時,可以藉由該附加訊息鼓勵該第二使用者,例如展示加油打氣的多媒體動畫等等,以讓該第二使用者有意願繼續前進。當該導航座標與最接近的該節點座標偏離達該預設值時,可以藉由該附加訊息通知該第二使用者已經偏離該導航路線了,以讓該第二使用者回到該導航路線上。當該導航座標接近不符合該建立時間順序或該任選順序的該節點座標時,例如根據該任選順序[請搭配第五圖],從該第二節點2b離開後應該要前往該第四節點2d[請搭配第三圖及第七圖],但該第二使用者跳過該第四節點2d、直接接近該第三節點2c時[請搭配第六圖],可以藉由該附加訊息通知該第二使用者要依照該導航路徑行走。 For example, when the navigation coordinates are close to the node coordinates that conform to the creation time sequence or the optional sequence, such as when the second user arrives at an intersection, the second user can be notified that there is an intersection ahead by the additional message , so that the second user carefully passes through the intersection. When the navigation coordinates are located between the coordinates of two adjacent nodes, the second user can be encouraged by the additional information, such as showing a multimedia animation of cheering up, so that the second user is willing to move forward. When the navigation coordinate and the closest node coordinate deviate by the preset value, the second user can be notified by the additional message that the navigation route has been deviated, so that the second user can return to the navigation route superior. When the navigation coordinates are close to the node coordinates that do not conform to the establishment time sequence or the optional sequence, for example, according to the optional sequence [please match the fifth picture], after leaving the second node 2b, you should go to the fourth node 2b Node 2d [please match the third and seventh images], but when the second user skips the fourth node 2d and directly approaches the third node 2c [please match the sixth image], the additional information can be used Notify the second user to follow the navigation path.

於實際實施時,該第一使用者例如可以是看護或是護理人員等等,該第二使用者則例如可以是失智症患者或是自閉症患者等等。在該第二使用者為老人的情況下,該平板電腦1也可以結合於老人專用的助行器、助行車及輪椅等行動輔具上。在該第二使用者為自閉症患者的情況下,藉由該附加訊息,可以較佳的維持該第二使用者的專注力。 In actual implementation, the first user may be, for example, a nurse or a nursing staff, and the second user may be, for example, a dementia patient or an autistic patient. When the second user is an elderly person, the tablet computer 1 can also be combined with mobility aids such as a walker, a walker, and a wheelchair for the elderly. When the second user is an autistic patient, the additional information can better maintain the concentration of the second user.

綜合上述實施例之說明,當可充分瞭解本發明之操作、使用及本發明產生之功效,惟以上所述實施例僅係為本發明之較佳實施例,當不能以此限定本發明實施之範圍,即依本發明申請專利範圍及發明說明內容所作簡單的等效變化與修飾,皆屬本發明涵蓋之範圍內。 Based on the descriptions of the above embodiments, one can fully understand the operation, use and effects of the present invention, but the above-mentioned embodiments are only preferred embodiments of the present invention, which should not limit the implementation of the present invention. Scope, that is, simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the contents of the description of the invention, all fall within the scope of the present invention.

Claims (10)

一種在實境影像中自由建立導航訊息並執行導航的方法,包含下列步驟:在一座標範圍內,設定一出發點及任意設定至少一節點,紀錄該出發點的一出發點座標及該至少一節點的一節點座標;由該出發點執行一導航路徑,該導航路徑連接該出發點及該至少一節點,並在沿該導航路徑行進時,持續地或定時地獲取行進當下的一導航座標;根據該導航路徑,再對應上述出發點座標及該至少一節點座標,分別建立一導航訊息;在該導航路徑中,由一影像擷取單元拍攝一導航實景影像,該導航實景影像顯示在一顯示單元;在該導航座標接近該至少一節點座標時,該顯示單元同時顯示該導航實景影像與該導航訊息,藉由該至少一節點座標所對應的該導航訊息的指引,使該導航路徑通過該至少一節點座標,完成導航。 A method for freely establishing navigation information and performing navigation in a real image, comprising the following steps: within a coordinate range, setting a starting point and arbitrarily setting at least one node, recording a starting point coordinate of the starting point and a node of the at least one node Node coordinates; a navigation path is executed from the starting point, the navigation path connects the starting point and the at least one node, and when traveling along the navigation path, the next navigation coordinate is continuously or periodically acquired; according to the navigation path, Then, corresponding to the coordinates of the starting point and the coordinates of the at least one node, a navigation message is created respectively; in the navigation path, an image capture unit captures a real navigation image, and the real navigation image is displayed on a display unit; in the navigation coordinates When approaching the at least one node coordinate, the display unit simultaneously displays the navigation real scene image and the navigation information, and makes the navigation path pass through the at least one node coordinate according to the guidance of the navigation information corresponding to the at least one node coordinate, and completes the navigation. 如請求項1之在實境影像中自由建立導航訊息並執行導航的方法,進一步,紀錄對應該至少一節點的一節點影像,當該導航座標接近該至少一節點座標時,一處理單元比對該節點影像及該導航實景影像;若該節點影像及該導航實景影像的相同程度高於一閾值,則該處理單元控制該顯示單元同時顯示該導航實景影像與該導航訊息。 According to the method for freely creating navigation information in a real image and executing navigation according to claim 1, further, record a node image corresponding to the at least one node, and when the navigation coordinate is close to the at least one node coordinate, a processing unit compares The node image and the navigation real image; if the same degree of the node image and the navigation real image is higher than a threshold, the processing unit controls the display unit to display the navigation real image and the navigation information at the same time. 如請求項1之在實境影像中自由建立導航訊息並執行導航的方法,其中,該節點的數量為複數個,該等節點依照一建立時間順序排列,該導航路徑根據該建立時間順序,依序通過上述每一節點。 The method for freely creating navigation information in a real-world image and performing navigation as claimed in claim 1, wherein the number of the nodes is plural, the nodes are arranged according to a creation time sequence, and the navigation path is arranged in accordance with the creation time sequence, in accordance with the creation time sequence. sequence through each of the above nodes. 如請求項1之在實境影像中自由建立導航訊息並執行導航的方法,其中,該節點的數量為複數個,該等節點依照一任選順序排列,該導航路徑根據該任選順序,依序通過上述每一節點。 The method for freely creating navigation information in a real-world image and performing navigation as claimed in claim 1, wherein the number of the nodes is plural, the nodes are arranged in an optional order, and the navigation path is arranged in accordance with the optional order, according to sequence through each of the above nodes. 如請求項1之在實境影像中自由建立導航訊息並執行導航的方法,其中,該導航訊息包含下列之一或其組合:一靜態方向指引訊息、一聲音指引訊息、一多媒體訊息、一動態方向指引訊息及一振動訊息。 The method for freely creating navigation information and executing navigation in a real image according to claim 1, wherein the navigation information includes one or a combination of the following: a static direction guidance message, a voice guidance message, a multimedia message, a dynamic Directional guidance messages and a vibration message. 如請求項1之在實境影像中自由建立導航訊息並執行導航的方法,進一步,建立一附加訊息,該附加訊息根據該導航座標而選擇性地顯示在該顯示單元,該附加訊息包含下列之一或其組合:一附加聲音訊息、一附加多媒體訊息及一附加振動訊息。 According to the method for freely creating navigation information and executing navigation in a real image according to claim 1, further, create an additional message, the additional message is selectively displayed on the display unit according to the navigation coordinates, and the additional message includes the following One or a combination thereof: an additional audio message, an additional multimedia message, and an additional vibration message. 如請求項6之在實境影像中自由建立導航訊息並執行導航的方法,其中,該附加訊息係在下列條件之一下顯示在該顯示單元:該導航座標接近該節點座標、該導航座標位於相鄰的二節點座標之間,以及該導航座標與最接近的該節點座標偏離達一預設值。 The method for freely creating navigation information and performing navigation in a real-world image as claimed in claim 6, wherein the additional information is displayed on the display unit under one of the following conditions: the navigation coordinates are close to the node coordinates, and the navigation coordinates are located in a phase Between the coordinates of two adjacent nodes, and the navigation coordinates are deviated from the coordinates of the closest node by a predetermined value. 如請求項1之在實境影像中自由建立導航訊息並執行導航的方法,進一步,紀錄所述節點的一節點名稱,在該導航座標依序接近上述每一節點座標時,該顯示單元同時顯示對應每一節點座標的該節點名稱。 According to the method for freely creating navigation information in a real image and executing navigation according to claim 1, further, a node name of the node is recorded, and when the navigation coordinates are sequentially approached to the coordinates of each of the above nodes, the display unit simultaneously displays The node name corresponding to each node coordinate. 一種電腦程式,安裝於一電腦,該電腦程式用於執行如請求項1至8任一項之在實境影像中自由建立導航訊息並執行導航的方法。 A computer program, installed in a computer, is used for executing the method for freely creating navigation information in a real image and executing navigation according to any one of claim items 1 to 8. 一種電腦可讀取媒體,記錄有一電腦程式,該電腦程式安裝於一電腦後,用於執行如請求項1至8任一項之在實境影像中自由建立導航訊息並執行導航的方法。 A computer-readable medium records a computer program, which is installed in a computer and used to execute the method of freely creating navigation information in a real image and executing navigation according to any one of claim items 1 to 8.
TW109136044A 2020-10-16 2020-10-16 Method, program, and readable medium for navigation based on reality images TWI777274B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW109136044A TWI777274B (en) 2020-10-16 2020-10-16 Method, program, and readable medium for navigation based on reality images

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW109136044A TWI777274B (en) 2020-10-16 2020-10-16 Method, program, and readable medium for navigation based on reality images

Publications (2)

Publication Number Publication Date
TW202217243A TW202217243A (en) 2022-05-01
TWI777274B true TWI777274B (en) 2022-09-11

Family

ID=82558517

Family Applications (1)

Application Number Title Priority Date Filing Date
TW109136044A TWI777274B (en) 2020-10-16 2020-10-16 Method, program, and readable medium for navigation based on reality images

Country Status (1)

Country Link
TW (1) TWI777274B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI412729B (en) * 2010-12-16 2013-10-21 Chunghwa Telecom Co Ltd Method and system of real navigation display
TWI416073B (en) * 2009-11-16 2013-11-21 Ind Tech Res Inst Road image processing method and system of moving camera
US20200103247A1 (en) * 2018-09-27 2020-04-02 Phiar Technologies, Inc. Augmented reality navigation systems and methods
CN111126304A (en) * 2019-12-25 2020-05-08 鲁东大学 Augmented reality navigation method based on indoor natural scene image deep learning

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI416073B (en) * 2009-11-16 2013-11-21 Ind Tech Res Inst Road image processing method and system of moving camera
TWI412729B (en) * 2010-12-16 2013-10-21 Chunghwa Telecom Co Ltd Method and system of real navigation display
US20200103247A1 (en) * 2018-09-27 2020-04-02 Phiar Technologies, Inc. Augmented reality navigation systems and methods
CN111126304A (en) * 2019-12-25 2020-05-08 鲁东大学 Augmented reality navigation method based on indoor natural scene image deep learning

Also Published As

Publication number Publication date
TW202217243A (en) 2022-05-01

Similar Documents

Publication Publication Date Title
US9212927B2 (en) Map view
US9404753B2 (en) Navigating on images
WO2016002285A1 (en) Information processing device, information processing method, and program
US9605969B2 (en) Meeting coordination utilizing profile and proximity information of primary parties and affiliated secondary parties
US7480567B2 (en) Displaying a map having a close known location
JP2004028661A (en) Image display device
Ishikawa et al. Relationships between methods for presenting information on navigation tools and users' wayfinding behavior
Coughlan et al. Crosswatch: a system for providing guidance to visually impaired travelers at traffic intersection
JP2007129407A (en) Camera system, map information display system
CN106525065A (en) Electronic map navigation method and device
CN103487059B (en) A kind of Position Fixing Navigation System, device and method
WO2016002284A1 (en) Information-processing device, information processing method, and program
JP2006287435A (en) Information processing apparatus, system thereof, method thereof, program thereof, and recording medium with the program recorded thereon
Somyat et al. NavTU: android navigation app for Thai people with visual impairments
TWI777274B (en) Method, program, and readable medium for navigation based on reality images
JP2010039256A (en) Display system, display method, and moving body
JP2009025238A (en) Route search device, navigation system, route search method, route search program, and recording medium
Liu et al. Informing the design of an automated wayfinding system for individuals with cognitive impairments
JP2007163370A (en) Moving support device, moving support method, moving support program, moving support system, and material collection support device for support content
ES2706824T3 (en) A video region indicator indicating that video content is available
US9710486B2 (en) Determination of a filtered map interaction descriptor
TW201137313A (en) Real-time image navigation system and method
JP2020087469A (en) Transportation support relating to user having customary or urgent travel needs
JP2009036676A (en) Information processor, and additional information providing method and program
JP2006064671A (en) Information-providing device and portable information terminal

Legal Events

Date Code Title Description
GD4A Issue of patent certificate for granted invention patent