TWI611693B - Intelligent Self-Shooting Method and System Thereof - Google Patents
Intelligent Self-Shooting Method and System Thereof Download PDFInfo
- Publication number
- TWI611693B TWI611693B TW106103933A TW106103933A TWI611693B TW I611693 B TWI611693 B TW I611693B TW 106103933 A TW106103933 A TW 106103933A TW 106103933 A TW106103933 A TW 106103933A TW I611693 B TWI611693 B TW I611693B
- Authority
- TW
- Taiwan
- Prior art keywords
- user
- heart rate
- heartbeat
- facial expression
- selfie
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/61—Control of cameras or camera modules based on recognised objects
- H04N23/611—Control of cameras or camera modules based on recognised objects where the recognised objects include parts of the human body
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Studio Devices (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Image Processing (AREA)
Abstract
一種根據使用者心理狀態以捕捉使用者的表情臉譜的智能自拍方法，其包含：設定使用者年齡；設定自拍的拍攝時間長度；偵測使用者的心跳次數，並且根據使用者的心跳次數繪製心率圖、根據心跳次數及心率圖捕捉使用者的臉部表情；選擇拍攝使用者的心理狀態；以及偵測自拍的拍攝時間是否結束，若否，判斷在此自拍的拍攝時間內是否捕捉到使用者的心跳次數在每分鐘內增加一數值，若是，則根據增加的心跳次數繪製另一心率圖、並捕捉使用者相對應於此心跳次數及此心率圖的表情臉譜，進行自拍得到使用者在此特定心理狀態下最自然的相片。 An intelligent self-timer method for capturing a user's facial expression and facial expression according to a user's psychological state, including: setting a user's age; setting a self-timer's shooting duration; detecting a user's heartbeat frequency, and drawing a heart rate according to the user's heartbeat frequency Figure, capture the user's facial expression according to the number of heartbeats and heart rate chart; choose to capture the user's psychological state; and detect whether the shooting time of the selfie is over; if not, determine whether the user is captured within the shooting time of the selfie The number of heartbeats is increased by one value per minute. If it is, another heart rate chart is drawn according to the increased number of heartbeats, and the user's facial expressions corresponding to this heartbeat number and this heart rate chart are captured, and a self-timer is obtained to obtain the user The most natural photo in a specific state of mind.
Description
本發明是揭露一種智能自拍方法，特別是有關於一種根據使用者的心理狀態以捕捉使用者在特定心理狀態下的表情臉譜的智能自拍方法及其系統。 The invention discloses an intelligent self-timer method, and more particularly, it relates to an intelligent self-timer method and system based on the user's psychological state to capture the user's facial expression and facial expression under a specific psychological state.
辨識臉部微笑的自動拍照技術是一種透過數位相機或是手機內建的韌體運算與辨識技術，其鎖定使用者本身的臉部所呈現微笑特徵的三角位置，並於偵測到使用者臉部的微笑特徵時自動進行拍照，但是這些辨識系統不夠彈性，且無法為使用者進行客制化的相片。 The automatic photographing technology that recognizes the smile on the face is a firmware calculation and recognition technology built into the digital camera or mobile phone. It locks the triangle position of the smile feature on the user ’s face and detects the user ’s face. The smile feature of the camera is automatically taken, but these recognition systems are not flexible enough and cannot be customized for users.
然而，目前數位相機或是手機的辨識臉部微笑的自動拍照技術僅限定於偵測特定的表情，例如微笑表情，對於特定表情以外的其它表情則並無支援，若被拍攝者的表情不斷變化，例如吐舌頭、噘嘴或是皺眉頭等等，以目前的數位相機或是手機內建的相機則是無法連續地自動拍攝到被拍攝者的各種表情，僅能針對微笑表情進行拍攝，因此限制了數位相機或是手機的應用。 However, at present, the digital camera or mobile phone's automatic photo recognition technology for identifying face smiles is limited to detecting specific expressions, such as smiling expressions. There is no support for other expressions other than specific expressions. If the subject ’s expression changes continuously , Such as tongue sticking, pouting or frowning, etc. With current digital cameras or cameras built in mobile phones, it is not possible to automatically capture the various expressions of the subject continuously, only shooting with smiling expressions, so Limited applications for digital cameras or mobile phones.
本發明的主要目的在於透過智能型配件來偵測的使用者的心跳次數、心率圖以及透過智能型裝置內的相機臉部辨識來捕捉使用者的表情臉譜。 The main purpose of the present invention is to detect the user's heartbeat frequency, heart rate graph through smart accessories, and capture the user's facial expression through camera face recognition in the smart device.
本發明的另一目的是透過心跳次數及所繪製心率圖與預設的原始心率圖來判斷使用者目前的心理狀態是否符合拍照標準。 Another object of the present invention is to determine whether the current psychological state of the user meets the photographing standard through the number of heartbeats and the drawn heart rate graph and a preset original heart rate graph.
本發明的再一目的是使用者以自拍的方式，在使用者特定心理狀態下的拍攝多張相片作為使用者在該特定心理狀態下的預設常用表情臉譜，以供智能自拍系統在之後使用者進行自拍時，將使用者於當下的心理狀態所呈現的表情與內存於自拍系統的預設表情臉譜來進行比對，以拍出使用者於當下心理狀態最自然的相片。 It is still another object of the present invention that a user takes multiple photos in a user's specific mental state in a self-timer manner as a preset common facial expression of the user in the specific mental state for the intelligent self-timer system to use later When a person takes a self-portrait, the expressions presented by the user's current psychological state are compared with preset facial expressions stored in the self-timer system to take the most natural picture of the user's current psychological state.
根據上述目的，本發明揭露一種根據使用者心理狀態以自行擷取該使用者在此心理狀態下的表情臉譜的智能自拍方法，其步驟包含：設定使用者年齡；設定進行自拍步驟的拍攝時間長度；同時偵測使用者的第一心跳次數，並且根據使用者的第一心跳次數繪製第一心率圖、並根據第一心跳次數及第一心率圖捕捉使用者的臉部表情；選擇拍攝使用者的心理狀態；以及偵測自拍的拍攝時間是否結束，若否，則判斷在此自拍的拍攝時間內是否有捕捉到使用者的第二心跳次數在每分鐘內增加一數值，若是，則相對應於此第二心跳次數繪製第二心率圖、並捕捉使用者相對應於第二心跳次數及第二心率圖的表情臉譜，並對使用者進行自行拍攝步驟以得到使用者在此特定心理狀態下的多張相片。若偵測自拍步驟的拍攝時間已經結束，則結束智能自拍步驟。此外，若判斷在此自拍步驟的拍攝時間內沒有捕捉到使用者的第二心跳次數在每分鐘內增加一數值，則重新回到偵測自拍步驟的拍攝時間是否結束，若是，則結束智能自拍步驟；若否，則重覆判斷在自拍的拍攝時間內是否有擷取到使用者每分鐘心跳次數增加一數 值。因此本發明是利用使用者在不同的心理狀態下會產生不同的心跳次數以及產生不同的心率圖，進一步的啟動智能自拍功能，而捕捉到使用者在此心理狀態下的表情臉譜，以拍攝到使用者最自然的表情臉譜的相片。 According to the above purpose, the present invention discloses a smart self-timer method for self-extracting a user ’s facial expression and facial expression according to a user ’s psychological state, the steps of which include: setting a user ’s age; and setting a shooting time length for performing a self-timer step ; Simultaneously detect the first number of heartbeats of the user, and draw a first heart rate chart according to the first number of heartbeats of the user, and capture the user's facial expression based on the first number of heartbeats and the first heart rate chart; choose to photograph the user And detect whether the shooting time of the selfie is over; if not, determine whether the second heartbeat captured by the user during the shooting time of the selfie is increased by a value every minute, and if yes, corresponding Draw a second heart rate chart at this second heartbeat number, and capture the user's facial expression corresponding to the second heartbeat number and second heart rate chart, and perform a self-shooting step on the user to obtain the user in this specific mental state Multiple photos. If it is detected that the shooting time of the self-timer step has ended, the smart self-timer step is ended. In addition, if it is determined that the second heartbeat of the user is not captured within the shooting time of this self-timer step and increases by a value every minute, then it returns to detecting whether the shooting time of the self-timer step is over, and if so, the smart self-timer is ended. Steps; if not, it is repeatedly judged whether there is an increase in the number of heartbeats per minute by the user within the shooting time of the selfie value. Therefore, the present invention uses the user to generate different heartbeat times and generate different heart rate graphs in different psychological states, and further activates the intelligent self-timer function to capture the facial expressions of the user in this psychological state to capture A photo of the user ’s most natural facial expression.
根據上述目的，本發明還揭露一種利用使用者的參考表情臉譜以捕捉使用者在特定心理狀態下的表情臉譜的智能自拍方法，其步驟包含有：設定使用者年齡、設定進行自拍步驟的拍攝時間長度、偵測使用者的第一心跳次數及根據使用者的第一心跳次數繪製第一心率圖、選擇具有特定心理狀態的第一參考臉譜、自行拍攝具有此特定心理狀態的多張相片、針對具有此特定心理狀態的這些相片以辨識使用者的臉部部位以得到至少兩個共同點、判斷是否可由這些相片找到一些共同點，若否，則重新找尋；若是，則將具有這些共同點的這些相片儲存，並取代第一參考表情臉譜以做為下次拍攝特定心理狀態時的第二參考表情臉譜、偵測自拍的拍攝時間是否結束，若否，則判斷在自拍的拍攝時間內是否有擷取到使用者的第二心跳次數在每分鐘內增加數值，若有，則相對應於第二心跳次數繪製第二心率圖並捕捉使用者相對應於第二心跳次數及第二心率圖的臉部表情以及將捕捉到的使用者的表情臉譜與在特定心理狀態下的第二參考表情臉譜進行比對，若使用者的該臉部表情與特定心理狀態的第二參考表情臉譜具有至少兩個共同點則進行自拍步驟以拍攝使用者在特定心理狀態下的相片。 According to the above purpose, the present invention also discloses a smart selfie method using a user's reference facial profile to capture the facial expression of the user in a specific psychological state. The steps include: setting the user's age and setting the shooting time for the selfie step. Length, detecting the first number of heartbeats of the user and drawing the first heart rate chart according to the first number of heartbeats of the user, selecting a first reference facial profile with a specific mental state, taking multiple photos with this specific mental state by himself, targeting These photos with this particular mental state are used to identify the user's face to obtain at least two common points, determine whether some common points can be found by these photos, and if not, search again; if so, then they will have these common points These photos are stored and replaced with the first reference facial expression Facebook as the second reference facial expression next time when shooting a specific mental state, to detect whether the shooting time of the selfie is over, and if not, determine whether there is any time during the shooting time of the selfie The number of second heartbeats captured by the user is increased by every minute. Draw a second heart rate chart corresponding to the second heartbeat number and capture the user's facial expressions corresponding to the second heartbeat number and the second heart rate chart, and capture the captured user's facial expression and the first time in a specific psychological state. The two reference facial expressions are compared. If the facial expression of the user and the second reference facial expression of the specific psychological state have at least two points in common, a self-timer step is performed to take a photo of the user in the specific psychological state.
根據上述的智能自拍方法，本發明還揭露一種根據使用者心理狀態以自行擷取使用者在一心理狀態下的表情臉譜的智能自拍系統，其包括：智能型配件及智能型裝置。其中，智能型配件至少包括：感測器，用來感測使用者在一心理狀態下的多個心跳次數，並根據這些心跳次數繪製心率圖、第一傳輸模組，用以傳送心率圖、以及第一記憶體，用以暫時儲存心率圖。智能型裝置至少包括：應用程式，用以設定使用者的年齡、自拍的拍 攝時間長度、使用者在自拍時的該心理狀態、第二傳輸模組，與第一傳輸模組配對，並接收由第一傳輸模組所傳送的使用者的心率圖；攝像單元，根據使用者的該心率圖，以捕捉使用者在該心理狀態時的臉部表情以及第二記憶體，用以儲存使用者的該心理狀態時的臉部表情的多張相片。 According to the above-mentioned intelligent self-timer method, the present invention also discloses an intelligent self-timer system that automatically captures the user's facial expressions and facial expressions in a psychological state according to the user's psychological state, which includes: intelligent accessories and intelligent devices. Among them, the intelligent accessory includes at least: a sensor for sensing a plurality of heartbeat times of a user in a psychological state, and drawing a heart rate chart according to these heartbeat times, a first transmission module for transmitting the heart rate chart, And a first memory for temporarily storing the heart rate chart. Smart devices include at least: apps to set the user ’s age, selfies The length of shooting time, the user's psychological state when taking a selfie, the second transmission module is paired with the first transmission module and receives the heart rate chart of the user transmitted by the first transmission module; the camera unit, according to the use The heart rate chart of the user captures the facial expression of the user in the psychological state and the second memory, and stores multiple photos of the facial expression of the user in the psychological state.
本發明還揭露一種利用使用者的參考表情臉譜以捕捉使用者在一特定心理狀態下的表情臉譜的智能自拍系統，其包括：智能型配件及智能型裝置，其中，智能型配件，至少包括感測器，用來偵測使用者在特定心理狀態下的第一心跳次數，並根據第一心跳次數繪製第一心率圖以及偵測該使用者在特定心理狀態下並在一段時間後的第二心跳次數，並根據第二心跳次數繪製第二心率圖，當該第二心跳次數相較於第一心跳次數超過一數值，且第二心率圖符合特定心理狀態，則傳送第二心率圖、第一傳輸模組，用以傳送第二心跳次數及第二心率圖。智能型裝置，至少包括：應用程式，用以設定使用者的年齡、自拍的拍攝時間長度或使用者在自拍時的心理狀態、並儲存該使用者在心理狀態下的多張相片、第二傳輸模組，與第一傳輸模組配對，並接收由第一傳輸模組所傳送的使用者在特定心理狀態下的第二心率圖及第二心跳次數、攝像單元，根據第二心跳次數及第二心率圖來捕捉使用者在特定心理狀態下的表情臉譜、以及第二記憶體，用以儲存根據第二心跳次數及第二心率圖，且在特定心理狀態下所捕捉具有使用者的臉部表情的多張相片。 The invention also discloses an intelligent self-timer system using a user's reference facial expression profile to capture the facial expression facial expression of the user in a specific psychological state, which includes a smart accessory and a smart device, wherein the smart accessory includes at least a sensor Detector for detecting the first number of heartbeats of a user in a specific psychological state, drawing a first heart rate chart according to the first number of heartbeats, and detecting the second time of the user in a specific psychological state and after a period of time The number of heartbeats, and a second heart rate chart is drawn according to the number of second heartbeats. When the number of second heartbeats exceeds a value of the first heartbeat, and the second heart rate chart meets a specific psychological state, the second heart rate chart, the first A transmission module is used for transmitting the second number of heartbeats and the second heart rate graph. An intelligent device includes at least: an application for setting the user's age, the length of time the selfie was taken, or the user's psychological state during the selfie, and storing multiple photos of the user in the psychological state, the second transmission The module is paired with the first transmission module, and receives the second heart rate chart and the second heartbeat number of the user in a specific psychological state transmitted by the first transmission module, and the camera unit, according to the second heartbeat number and the first Two heart rate maps to capture the user ’s facial expressions in a specific mental state, and a second memory to store the user ’s face based on the second heartbeat number and the second heart rate map, and captured in a specific psychological state Multiple photos of emoticons.
1‧‧‧智能自拍系統 1‧‧‧ Smart Selfie System
10‧‧‧智能型配件 10‧‧‧ Smart Accessories
12‧‧‧感測器 12‧‧‧ Sensor
14‧‧‧第一傳輸模組 14‧‧‧The first transmission module
16‧‧‧第一記憶體 16‧‧‧First memory
20‧‧‧智能型裝置 20‧‧‧ Smart Device
22‧‧‧攝像單元 22‧‧‧ Camera Unit
24‧‧‧第二傳輸模組 24‧‧‧Second Transmission Module
26‧‧‧第二記憶體 26‧‧‧Second memory
28‧‧‧應用程式(App) 28‧‧‧App
30‧‧‧選擇並設定使用者年齡 30‧‧‧Select and set user age
32‧‧‧設定進行自拍的拍攝時間長度 32‧‧‧ Set the length of time to take a selfie
34‧‧‧偵測使用者的心跳次數，並根據使用者的心跳次數繪製心率圖 34‧‧‧ Detects the number of heartbeats of the user and draws a heart rate chart based on the number of heartbeats of the user
36‧‧‧捕捉使用者的臉部表情 36‧‧‧Capturing the user's facial expressions
38‧‧‧使用者選擇要自拍時的心理狀態 38‧‧‧ Psychological state when the user chooses to take a selfie
40‧‧‧偵測自拍的拍攝時間是否結束 40‧‧‧ Detect if the shooting time of the selfie is over
42‧‧‧結束智能自拍 42‧‧‧ End Smart Selfie
44‧‧‧判斷在自拍的拍攝時間內是否有擷取到使用者每分鐘心跳次數增加一數值 44‧‧‧ Judgment whether the number of heartbeats per minute has been increased by the user within the shooting time of the selfie
442‧‧‧在使用者自定的拍攝時間內，並在特定的心理狀態下，根據所增加的心跳次數來繪製使用者的心率圖，且同時根據心率圖及心跳次數來捕捉在此特定心理狀態下使用者的臉部表情 442‧‧‧ draws the user's heart rate chart according to the increased number of heartbeats within the user-defined shooting time and under a specific psychological state, and simultaneously captures this specific mentality based on the heart rate chart and the number of heartbeats Facial expression of the user in the state
444‧‧‧使用者進行智能自拍，以拍攝使用者最自然的臉部表情的相片 444‧‧‧ users take smart selfies to take pictures of users ’most natural facial expressions
50‧‧‧設定使用者年齡 50‧‧‧ Set user age
52‧‧‧設定進行自拍的拍攝時間長度 52‧‧‧ Sets the length of time to take a selfie
54‧‧‧偵測使用者的第一心跳次數，並且根據第一心跳次數繪製第一心率圖，並根據第一心跳次數及第一心率圖來捕捉使用者的臉部表情 54‧‧‧ Detects the user's first heartbeat count, draws a first heart rate graph based on the first heartbeat count, and captures the user's facial expression based on the first heartbeat count and the first heart rate graph
56‧‧‧使用者選擇要自拍時的心理狀態 56‧‧‧ Psychological state when the user chooses to take a selfie
58‧‧‧偵測自拍的拍攝時間是否結束 58‧‧‧ Detect if the shooting time of the selfie is over
60‧‧‧結束智能自拍 60‧‧‧ End Smart Selfie
62‧‧‧判斷在自拍時的拍攝時間內是否有擷取到使用者的第二心跳次數在每分鐘增加一數值 62‧‧‧ Determines whether the second heartbeat of the user is captured during the shooting time during the self-timer and is increased by a value every minute
622‧‧‧根據第二心跳次數繪製第二心率圖，並且利用第二心跳次數及第二心率圖捕捉使用者相對應於第二心跳次數及第二心率圖的表情臉譜 622‧‧‧ draws a second heart rate chart according to the second heart rate, and uses the second heart rate and the second heart rate map to capture a user's facial expression corresponding to the second heart rate and the second heart rate map
624‧‧‧進行智能自拍，得到使用者在特定心理狀態下的臉部表情的相片 624‧‧‧ take a smart selfie to get photos of the user's facial expressions in a specific mental state
70‧‧‧使用者選擇要自拍時的心理狀態 70‧‧‧ Psychological state when the user chooses to take a selfie
72‧‧‧使用者利用智能型裝置透過應用程式的預設表***拍出多張具有此特定心理狀態的相片 72‧‧‧ The user uses a smart device to take multiple photos with this specific mental state through the app's preset facial expressions.
74‧‧‧使用者由多張具有特定心理狀態的相片中挑選出喜歡的具有此特定心理狀態的相片 74‧‧‧User chooses photos with specific mental state from multiple photos with specific mental state
76‧‧‧應用程式將多張具有該特定心理狀態的相片中擷取至少兩個共同點 76‧‧‧ App captures at least two things in common from multiple photos with that particular mental state
78‧‧‧智能型裝置中的應用程式將具有特定心理狀態且具有至少兩個共同點的多張相片供使用者確認 78‧‧‧ An application on a smart device will have multiple photos with a specific mental state and at least two things in common for users to confirm
80‧‧‧經使用者確認後將具有特定心理狀態且具有至少兩個共同點的多張相片儲存於智能型裝置的記憶體中 80‧‧‧ After confirmation by the user, multiple photos with a specific mental state and at least two points in common are stored in the memory of the smart device
82‧‧‧完成特定心理狀態的參考表情臉譜的製作與設定 82‧‧‧Complete the creation and setting of reference facial expressions for specific mental states
90‧‧‧選擇並設定使用者年齡 90‧‧‧Select and set user age
92‧‧‧設定自拍的拍攝時間長度 92‧‧‧ Set the length of time you want to take a selfie
94‧‧‧偵測使用者的心跳次數及根據使用者心跳次數繪製心率圖 94‧‧‧ Detects the number of heartbeats of the user and draws a heart rate chart based on the number of heartbeats of the user
96‧‧‧捕捉使用者的臉部表情 96‧‧‧ Capture user's facial expressions
98‧‧‧使用者選擇要自拍時的心理狀態 98‧‧‧ Psychological state when the user chooses to take a selfie
100‧‧‧偵測自拍的拍攝時間是否結束 100‧‧‧ Detect if the shooting time of the selfie is over
102‧‧‧判斷在自拍的拍攝時間內是否有擷取到每分鐘心跳數增加一數值 102‧‧‧ Judgment whether there is an increase in the number of heartbeats per minute during the shooting time of the selfie
1022‧‧‧智能型配件根據此增加的數值的心跳次數繪製另一心率圖 1022‧‧‧ The smart accessory draws another heart rate graph based on the increased number of heartbeats
1024‧‧‧根據捕捉到的使用者的臉部表情與使用者預儲存於智能型裝置內的該特定心理狀態的多張表情臉譜比對，若使用者的臉部表情與具有此特定心理狀態的多張表情臉譜有至少兩個共同點，則對使用者進行自拍，以拍攝得到使用者在此特定心理狀態下的相片 1024‧‧‧ According to the captured facial expression of the user and multiple facial expressions of the specific mental state pre-stored in the smart device by the user, if the facial expression of the user and this specific mental state are compared Of the multiple facial expressions of Facebook have at least two things in common, take a selfie of the user to take a picture of the user in this particular mental state
104‧‧‧結束智能自拍 104‧‧‧ End Smart Selfie
圖1是根據本發明所揭露的技術，表示智能自拍系統的方塊示意圖。 FIG. 1 is a block diagram illustrating a smart selfie system according to the disclosed technology.
圖2是根據本發明所揭露的技術，表示根據使用者的心理狀態以自拍的方式捕捉使用者在特定心理狀態下的表情臉譜的智能自拍方法的步驟流程圖。 FIG. 2 is a flowchart illustrating the steps of a smart selfie method that captures a user ’s facial expressions and facial expressions in a specific psychological state in a self-timer manner according to the psychological state of the user according to the disclosed technology.
圖3是根據本發明所揭露的技術，表示使用者以自拍的方式擷取使用者在開心的心理狀態下的表情臉譜的智能自拍方法的實施例的步驟流程圖。 FIG. 3 is a flow chart showing the steps of an embodiment of a smart selfie method in which a user captures the facial expressions of the user in a happy psychological state in a self-timer according to the technology disclosed in the present invention.
圖4是根據本發明所揭露的技術，表示不同的心理狀態所呈現的不同心率圖段。 FIG. 4 shows different heart rate segments presented by different mental states according to the technology disclosed in the present invention.
圖5是根據本發明所揭露的技術，表示使用者在特定心理狀態的參考臉譜的製作以及設定步驟流程圖。 FIG. 5 is a flowchart illustrating steps of making and setting a reference Facebook for a user in a specific psychological state according to the technology disclosed in the present invention.
圖6是根據本發明所揭露的技術，根據圖2及圖5或者圖3及圖5的步驟流程圖，對於使用者在特定心理狀態下的自拍的步驟流程圖。 FIG. 6 is a flowchart of steps taken by a user in a specific psychological state according to the steps of FIG. 2 and FIG. 5 or FIG. 3 and FIG. 5 according to the technology disclosed by the present invention.
首先請參考圖1。圖1是根據本發明所揭露的技術，表示智能自拍系統的方塊示意圖。在圖1中，智能自拍系統1包括了智能型配件10及智能型裝置20，其中，智能型配件10至少具有感測器12、第一傳輸模組14及第一記憶體16。智能型裝置20至少具有攝像單元22、第二傳輸模組24、第二記憶體26及應用程式(App)28，且智能型裝置20可以是智能型平板或是智能型手機。 Please refer to Figure 1 first. FIG. 1 is a block diagram illustrating a smart selfie system according to the disclosed technology. In FIG. 1, the smart selfie system 1 includes a smart accessory 10 and a smart device 20. The smart accessory 10 includes at least a sensor 12, a first transmission module 14, and a first memory 16. The smart device 20 has at least a camera unit 22, a second transmission module 24, a second memory 26, and an application 28. The smart device 20 may be a smart tablet or a smart phone.
本發明的智能自拍系統1的智能型配件10中，其感測器12是用來感測使用者的心跳次數並且根據心跳次數來繪製心率圖。另外，在本發明中，智能型裝置20利用第二傳輸模組24與智能型配件10的第一傳輸模組14進行配對，使得智能型配件10的感測器12所感測到的訊號可以透過第一傳輸模組14傳送並由智能型裝置20的第二傳輸模組24接收，並將這些訊號儲存於第二記憶體26內；亦或者，在智能型裝置20尚未開啟第二傳輸模組24時，智能型配件10可以將感測到的訊號暫時儲存於第一記憶體16中，待智能型裝置20開啟第二傳輸模組24之後，智能型配件10再藉由第一傳輸模組14傳 送至智能型裝置20並予以儲存至第二記憶體26內，其中第一傳輸模組14及第二傳輸模組24可以是藍牙傳輸模組，藉此，智能型配件10可以將所偵測到的訊號透過藍牙傳輸模組(即第一傳輸模組14)傳送到使用者的智能型裝置20，並由智能型裝置20的第二傳輸模組24來接收。在本發明的實施例中，智能型配件10可以是智能型手環或是智能型手錶，且一般都配戴在使用者的手腕上。 In the smart accessory 10 of the smart self-timer system 1 of the present invention, the sensor 12 is used to sense the number of heartbeats of the user and draw a heart rate chart according to the number of heartbeats. In addition, in the present invention, the smart device 20 uses the second transmission module 24 to pair with the first transmission module 14 of the smart accessory 10, so that the signal sensed by the sensor 12 of the smart accessory 10 can be transmitted through The first transmission module 14 transmits and is received by the second transmission module 24 of the smart device 20, and these signals are stored in the second memory 26; or, the second transmission module is not turned on by the smart device 20 At 24 o'clock, the smart accessory 10 can temporarily store the sensed signal in the first memory 16. After the smart device 20 turns on the second transmission module 24, the smart accessory 10 uses the first transmission module. 14 Passes Sent to the smart device 20 and stored in the second memory 26, wherein the first transmission module 14 and the second transmission module 24 may be Bluetooth transmission modules, whereby the intelligent accessory 10 can detect the detected The received signal is transmitted to the user's smart device 20 through the Bluetooth transmission module (ie, the first transmission module 14), and is received by the second transmission module 24 of the smart device 20. In the embodiment of the present invention, the smart accessory 10 may be a smart bracelet or a smart watch, and is generally worn on a user's wrist.
要說明的是，目前的智能型配件10，如智能型手環或是智能型手錶都還具有感測其他數據的功能，例如走路的步數、跑步的公里數或是仰臥起坐的次數等等，本發明所揭露的智能型配件10亦可以包含上述這些數據的感測功能，但在本發明中，主要是針對感測使用者的心跳次數來繪製心率圖，其他功能在此不予以討論以及詳加陳述。又，本發明所揭露的智能型配件10及智能型裝置20所包含的元件並非僅限於圖1中所揭示的元件，其他的元件例如主機板、顯示螢幕、處理器及/或按鍵以及各個元件的功能及連接關係並非本發明主要討論的內容，也並非本發明主要的技術特徵，因此，不在本發明中多加陳述。 It should be noted that the current smart accessories 10, such as smart bracelets or smart watches, also have the function of sensing other data, such as the number of steps walked, the number of kilometers run, or the number of sit-ups. The smart accessory 10 disclosed in the present invention may also include the sensing function of the above data, but in the present invention, the heart rate chart is mainly drawn for sensing the number of heartbeats of the user, and other functions are not discussed here. And a detailed statement. In addition, the components included in the smart accessory 10 and the smart device 20 disclosed in the present invention are not limited to the components disclosed in FIG. 1, and other components such as a motherboard, a display screen, a processor and / or keys, and various components The functions and connection relationships are not the main content of the present invention, nor are they the main technical features of the present invention. Therefore, they are not described in the present invention.
請參考圖2。圖2是根據本發明所揭露的技術，表示根據使用者以自拍的方式捕捉使用者在特定心理狀態下的表情臉譜的智能自拍方法的步驟流程圖。在圖2中，步驟30，選擇並設定使用者年齡。步驟32，設定自拍的拍攝時間長度。在步驟32中，使用者可以將拍攝時間設定為1分鐘、3分鐘、10分鐘、60分鐘或是更長的時間，因此在本發明中，對於自拍的拍攝時間長度可視使用者的需要來設定，在此不加以限制。 Please refer to Figure 2. FIG. 2 is a flow chart showing the steps of a smart selfie method according to a technique disclosed by the present invention that captures a user's facial expressions and facial expressions in a specific mental state in a self-timer manner. In FIG. 2, in step 30, the user age is selected and set. Step 32: Set a shooting time length for the selfie. In step 32, the user can set the shooting time to 1 minute, 3 minutes, 10 minutes, 60 minutes, or longer. Therefore, in the present invention, the length of the shooting time of the selfie can be set according to the needs of the user. No restrictions here.
接著，步驟34，偵測使用者的心跳次數，並根據使用者的心跳次數繪製心率圖。在此要說明的是，步驟34與步驟30有關，在平常情況下，成人的正常心跳次數是每分鐘60至100次，但是不同年齡也有不同的正常心 跳次數，因此為了更準確的捕捉到使用者在該心理狀態下最自然的臉部表情，需要讓使用者針對自己的年齡來進行設定。 Next, in step 34, the number of heartbeats of the user is detected, and a heart rate chart is drawn according to the number of heartbeats of the user. It should be noted here that step 34 is related to step 30. Under normal circumstances, the normal heartbeat of an adult is 60 to 100 times per minute, but different ages have different normal heartbeats. The number of jumps, so in order to more accurately capture the most natural facial expressions of the user in this psychological state, the user needs to be set according to his age.
接著步驟36，捕捉使用者的臉部表情。在步驟36中，利用智能型裝置20(如圖1所示)來捕捉使用者的臉部表情，其中臉部表情可以是一般表情、開心、生氣、難過、噘嘴、親吻、或是做鬼臉等等，但不限於此。緊接著，進行步驟38，使用者選擇要自拍時的心理狀態。接著，進行步驟40，偵測自拍的拍攝時間是否結束，若是，則進行步驟42，結束智能自拍。若否，則繼續進行步驟44，判斷在自拍的拍攝時間內是否有擷取到使用者每分鐘心跳次數增加一數值，若有，則繼續進行步驟442。在步驟442中，在使用者自定的拍攝時間內，並在特定心理狀態下，根據所增加的心跳次數來繪製使用者的心率圖，且同時根據心率圖及心跳次數來捕捉在此特定心理狀態下使用者的臉部表情。另外，使用者每分鐘心跳次數增加的數值範圍可以是10%-50%，具體的來說其數值可以是10%、20%、25%、30%、35%、40%、45%或是50%。接著，進行步驟444，使用者進行智能自拍，以拍攝使用者最自然的臉部表情的相片。要說明的是，在步驟44中，若在自拍步驟的拍攝時間內沒有擷取到使用者每分鐘心跳次數增加一數值，則返回到步驟40，重新偵測自拍的拍攝時間是否結束，然後，再繼續步驟44至步驟444或是直接至步驟42結束智能自拍。 Then, step 36, the facial expression of the user is captured. In step 36, the smart device 20 (as shown in FIG. 1) is used to capture the facial expressions of the user. The facial expressions can be general expressions, happy, angry, sad, pouting, kissing, or making faces Wait, but not limited to this. Next, proceed to step 38, where the user selects a psychological state when taking a selfie. Then, step 40 is performed to detect whether the shooting time of the self-timer is over. If so, step 42 is performed to end the smart self-timer. If not, proceed to step 44 to determine whether there is an increase in the number of heartbeats per minute by the user during the shooting time of the selfie. If so, proceed to step 442. In step 442, the user's heart rate chart is drawn according to the increased number of heartbeats within the user-defined shooting time and under a specific psychological state, and at the same time, the specific mentality is captured according to the heart rate chart and the number of heartbeats. The facial expression of the user in the state. In addition, the user can increase the number of heartbeats per minute from 10% to 50%. Specifically, the value can be 10%, 20%, 25%, 30%, 35%, 40%, 45%, or 50%. Next, step 444 is performed, and the user performs a smart selfie to take a picture of the user's most natural facial expression. It should be noted that, in step 44, if the user does not capture an increase in the number of heartbeats per minute during the shooting time of the self-timer step, return to step 40, and re-detect whether the shooting time of the self-timer is over, and then, Then continue to step 44 to step 444 or directly go to step 42 to end the smart self-timer.
另外，要進一步說明的是，於步驟442中，智能型配件10將偵測到增加一數值的心跳次數，並根據此心跳次數所繪製的心率圖透過第一傳輸模組14傳送，並由智能型裝置20的第二傳輸模組24接收，使得智能型裝置20的攝像單元22可以根據此心率圖及心跳次數來捕捉使用者在此特定心理狀態下的臉部表情。 In addition, it should be further explained that, in step 442, the smart accessory 10 will detect an increase in the number of heartbeats, and the heart rate chart drawn according to the number of heartbeats will be transmitted through the first transmission module 14 and transmitted by the intelligent The second transmission module 24 of the smart device 20 receives, so that the camera unit 22 of the smart device 20 can capture the facial expression of the user in this specific mental state according to the heart rate graph and the number of heartbeats.
接著請參考圖3，圖3是用來進一步說明圖2中，使用者以自拍的方式捕捉使用者在開心的心理狀態下的表情臉譜的智能自拍方法的實施例的步驟流程圖。 Next, please refer to FIG. 3. FIG. 3 is a flowchart illustrating the steps of an embodiment of the smart selfie method for capturing a user ’s expression and facial expression in a happy psychological state by taking a selfie in FIG. 2.
在圖3中，步驟50，設定使用者年齡。接著步驟52，設定進行自拍的拍攝時間長度，例如3分鐘。步驟54，偵測使用者的第一心跳次數，並根據第一心跳次數繪製第一心率圖以及根據第一心跳次數及第一心率圖來捕捉使用者的臉部表情。步驟56，使用者選擇要自拍時的心理狀態。接著進行步驟58，偵測自拍的拍攝時間是否結束，若是，則進行步驟60，結束智能自拍步驟。若否，則進行步驟62，判斷在自拍步驟時的拍攝時間內是否有擷取到使用者的第二心跳次數在每分鐘增加一數值，若是，則進行步驟622，相對應於此增加的第二心跳次數繪製第二心率圖及捕捉使用者相對應於第二心跳次數及第二心率圖的表情臉譜。接著，進行步驟624。進行智能自拍步驟，得到使用者在特定心理狀態下的臉部表情的相片。而在上述的步驟62，若判斷在自拍步驟時的拍攝時間內沒有擷取到使用者的第二心跳次數在每分鐘內增加一數值時，則返回步驟58，重新進行偵測自拍步驟的拍攝時間是否結束，並進行步驟62、步驟622至步驟624或者直接進入步驟60，結束智能自拍。 In FIG. 3, in step 50, the user age is set. Following step 52, the length of time for which the self-timer is taken is set, for example, 3 minutes. Step 54: Detect the first heartbeat number of the user, draw a first heart rate chart according to the first heartbeat number, and capture a facial expression of the user according to the first heartbeat number and the first heart rate chart. Step 56: The user selects a psychological state when taking a selfie. Then, step 58 is performed to detect whether the shooting time of the self-timer is over. If so, step 60 is performed to end the smart self-timer step. If not, go to step 62 to determine whether the second heartbeat of the user is captured every minute during the shooting time during the self-timer step. If yes, go to step 622, corresponding to the increased number of times. Draw a second heart rate graph and capture the facial expression of the user corresponding to the second heart rate and the second heart rate graph. Then, step 624 is performed. The intelligent self-timer step is performed to obtain a photo of a user's facial expression in a specific psychological state. In step 62 above, if it is determined that the second heartbeat number of the user is not captured within the shooting time during the self-timer step, a value is increased every minute, then return to step 58 to re-detect the self-timer step shooting If the time is over, go to step 62, step 622 to step 624 or directly go to step 60 to end the smart self-timer.
因此，根據圖1及配合2及圖3來舉例說明。首先當使用者取得智能型配件10時，先在使用者的智能型配件10，例如智能型手環或是智能型手錶，來設定使用者年齡，例如36歲。接著，智能型裝置20與智能型配件10進行配對，以供後續將訊號由智能型配件10傳送至智能型裝置20。緊接著，使用者在智能型裝置20上設定進行自拍步驟的拍攝時間長度，例如3分鐘。接下來，使用者的智能型配件10會偵測使用者目前的心跳次數，在此定義為第一心跳次數，例如72下，並且根據此第一心跳次數繪製出第一心率圖。 要說明的是，此第一心率圖可以顯示在智能型配件10的顯示螢幕上或是設定不顯示於智能型配件10的顯示螢幕上，亦或是智能型配件10不具有螢幕但第一心率圖是由智能型配件10中的處理器(未在圖中表示)繪製，在此不加以限制。 Therefore, an example will be described with reference to FIG. 1 and fit 2 and FIG. 3. First, when the user obtains the smart accessory 10, the user's smart accessory 10, such as a smart bracelet or a smart watch, is first used to set the user's age, such as 36 years. Then, the smart device 20 is paired with the smart accessory 10 for subsequent transmission of signals from the smart accessory 10 to the smart device 20. Next, the user sets the shooting time length of the self-timer step on the smart device 20, for example, 3 minutes. Next, the user's smart accessory 10 detects the current number of heartbeats of the user, which is defined as the first number of heartbeats, for example, 72 times, and draws a first heart rate chart according to the first number of heartbeats. It should be noted that the first heart rate chart may be displayed on the display screen of the smart accessory 10 or set to be not displayed on the display screen of the smart accessory 10, or the smart accessory 10 does not have a screen but the first heart rate The diagram is drawn by a processor (not shown in the figure) in the smart accessory 10, which is not limited herein.
緊接著，使用者可以在智能型裝置20的應用程式28來選擇自拍時的心理狀態，若使用者選擇的心理狀態是”開心”，則此時智能自拍系統會開始偵測自拍的拍攝時間(3分鐘)是否結束，若否，則判斷使用者在此自拍的拍攝時間(3分鐘)內，智能型配件10是否有擷取到使用者的第二心跳次數在每分鐘增加一數值，舉例來說，當使用者在觀看棒球比賽時，先設定自拍的拍攝時間為3分鐘，在這3分鐘內，可能由於比賽的變化，例如打擊者擊出再見全壘打，而使得使用者由於興奮而造成使用者的心跳次數由原來的72下增加至100下，因此智能型配件10除了可以感測到使用者增加的心跳次數之外也同時計算出使用者的第二心跳次數在每分鐘增加38%以上，並與預設於智能型配件10中設定的心跳次數在每分鐘增加的數值若為20%，則智能型配件10可根據此第二心跳次數(100下)來繪製第二心率圖，並且將第二心率圖與儲存於智能型配件10的第一記憶體16內的原始心率圖相比較，得到使用者目前的心理狀態符合”開心”的拍照標準，因此，智能型裝置20的攝像單元22可以根據第二心跳次數(100下)及第二心率圖來捕捉使用者目前的表情臉譜。接著，使用者可以進行自拍，以拍攝到使用者在觀看棒球比賽時，並在打擊者擊出再見全壘打時所表現出來最自然的開心的臉部表情。 Next, the user can select the psychological state of the self-timer in the application 28 of the smart device 20. If the psychological state selected by the user is "happy", the intelligent self-timer system will start to detect the shooting time of the self-timer ( 3 minutes), if not, determine whether the user ’s second heartbeat has been captured by the smart accessory 10 within one minute of the user ’s self-timer shooting time (3 minutes). For example, Say, when the user is watching a baseball game, first set the shooting time of the selfie to 3 minutes. Within these 3 minutes, the user may be excited because of changes in the game, such as the hitter hitting the goodbye home run. As a result, the number of heartbeats of the user is increased from the original 72 to 100 times. Therefore, in addition to sensing the increased number of heartbeats of the user, the intelligent accessory 10 also calculates that the number of second heartbeats of the user increases by 38 per minute. If the value increases by more than 20% and the value of the heartbeat preset in the smart accessory 10 is increased by 20% per minute, the smart accessory 10 can be based on the second heartbeat (100 times). Make a second heart rate chart, and compare the second heart rate chart with the original heart rate chart stored in the first memory 16 of the smart accessory 10 to obtain that the current psychological state of the user meets the "happy" photographic standard. Therefore, The camera unit 22 of the smart device 20 can capture the current facial expression of the user according to the second number of heartbeats (100 times) and the second heart rate graph. Then, the user can take a selfie to capture the most natural and happy facial expressions displayed by the user when watching the baseball game and when the hitter hits the goodbye home run.
在此要說明的是，上述實施例中所指的原始心率圖，是利用智能型配件10先將使用者在不同的心理狀態下的心率圖記錄下來，並儲存於智能型配件10的第一記憶體16中，如圖4所示。在圖4中，表示不同的心理狀 態所呈現的不同心率圖，其中，橫軸代表的是時間，縱軸代表的是心跳次數。如果是一般情緒則如圖4(a)所示、開心則是如圖4(b)、生氣則是如圖4(c)及難過則是如圖4(d)所示。智能型配件10可以先記錄使用者在不同心理狀態下的心率圖，並且暫時儲存於智能型配件10的第一記憶體16中，當使用者在進行自拍步驟時，若有出現與圖4中相同的心率圖段就可以判斷是符合該心理狀態的拍照標準。另外要再進一步解釋的是，由於每一個人對於一般情緒、開心、生氣或是難過的認知以及定義不同，因此在圖4中僅是舉例說明而已，並非是將所有人的一般情緒、開心、生氣或是難過等這些情緒狀態都視為相同的心率圖示。 It is to be noted here that the original heart rate chart referred to in the above embodiment is that the intelligent accessory 10 is used to first record the heart rate chart of the user in different psychological states, and stored in the first part of the intelligent accessory 10 The memory 16 is shown in FIG. 4. In Figure 4, different mental states are shown Different heart rate graphs presented by the state, where the horizontal axis represents time and the vertical axis represents the number of heartbeats. If it is a general emotion, it is shown in FIG. 4 (a), when it is happy, it is shown in FIG. 4 (b), when it is angry, it is shown in FIG. 4 (c), and when it is sad, it is shown in FIG. 4 (d). The smart accessory 10 can first record the heart rate graph of the user in different mental states, and temporarily store it in the first memory 16 of the smart accessory 10. When the user performs the self-timer step, if it appears in FIG. 4 The same heart rate segment can be judged to be in compliance with the photographic standard of the mental state. In addition, it should be further explained that because everyone has different perceptions and definitions of general emotions, happiness, anger, or sadness, it is only an example in Figure 4, not the general emotions, happiness, and anger of everyone. Or sadness, etc. These emotional states are treated as the same heart rate icon.
接著請參考圖5。圖5是根據本發明所揭露的技術，表示使用者在特定心理狀態的參考臉譜的製作以及設定步驟流程圖。在圖5中，步驟70，使用者選擇自拍時的特定心理狀態。接著，步驟72，使用者利用智能型裝置20透過應用程式28的預設表***拍出多張具有此特定心理狀態的相片。在此步驟中，預設表情可以是一般表情、開心、生氣、難過、做鬼臉或噘嘴等等不在此限制。 Please refer to FIG. 5. FIG. 5 is a flowchart illustrating steps of making and setting a reference Facebook for a user in a specific psychological state according to the technology disclosed in the present invention. In FIG. 5, in step 70, the user selects a specific mental state when taking a selfie. Next, in step 72, the user uses the smart device 20 to take a plurality of photos with this specific mental state through the preset facial expressions of the application 28. In this step, the preset expressions can be general expressions, happy, angry, sad, grimace or pouting, etc. are not limited here.
緊接著於步驟74，使用者由多張具有特定心理狀態的相片中挑選出喜歡的具有此特定心理狀態的相片。在此步驟中，是由使用者透過智能型裝置20讀取由步驟72所拍攝得到的多張相片，而這些相片都是具有相同的特定心理狀態，例如一般表情、開心、生氣、難過、做鬼臉或噘嘴的其中一種心理狀態。接著於步驟76，應用程式28(如圖1所示)將多張具有該特定心理狀態的相片中擷取至少兩個共同點。在步驟76中，使用者先利用在智能型裝置20的應用程式28來選擇藉由步驟74所拍攝的多張具有相同的特定心理狀態的想要或是喜歡的相片，例如開心。然後，應用程式28會根據使用者所選出的這些相片來比對，並且在這些相片中擷取出至少兩個共同 點，以”開心”的心理狀態為例子來說明，當使用者是”開心”的心理狀態時，其使用者的臉部部位可能會出現嘴角上揚、眉毛上揚、瞇眼睛、露出牙齒及/或露出酒窩，只要這些相片中包含至少兩個相同的表情，例如相片中都包含了瞇眼睛及露出酒窩，就可以視為具有相同共同點的相片。要說明的是，每一個人在特定心理狀態所呈現出來的表情不盡相同，但是就同一個人來說，其相同的心理狀態下的臉部部位的變化不會差異太大，因此很容易在多張的相片中取得使用者在該特定心理狀態下的臉部部位的共同點。 Immediately after step 74, the user selects a favorite photo with a specific mental state from a plurality of photos with a specific mental state. In this step, the user reads multiple photos taken in step 72 through the smart device 20, and these photos have the same specific mental state, such as general expression, happy, angry, sad, doing Grimace or pouting. Then at step 76, the application 28 (as shown in FIG. 1) captures at least two points in common from a plurality of photos with the specific mental state. In step 76, the user first uses the application 28 on the smart device 20 to select a plurality of desired or liked photos with the same specific mental state, such as happy, taken in step 74. The application 28 then compares the photos selected by the user and extracts at least two common photos from these photos. Take the "happy" mental state as an example to explain that when the user is in the "happy" mental state, the user's face may have raised mouth corners, raised eyebrows, squinted eyes, exposed teeth, and / or If the dimples are exposed, as long as these photos contain at least two identical expressions, for example, the photos include squinting eyes and exposed dimples, they can be considered as photos that have the same thing in common. It should be noted that the expressions of each person in a particular psychological state are different, but for the same person, the changes in the face parts under the same psychological state will not be much different, so it is easy to change In the photos of Zhang, the common points of the user's face parts in the specific mental state are obtained.
接著請繼續步驟78，智能型裝置20中的應用程式28將具有特定心理狀態且具有至少兩個共同點的多張相片供使用者確認。步驟80，經使用者確認後將具有特定心理狀態且具有至少兩個共同點的多張相片儲存於智能型裝置20的第二記憶體26中。步驟82，完成特定心理狀態的參考表情臉譜的製作與設定。在此要說明的是，使用者可以根據上述步驟70至步驟82設定其他的參考表情臉譜，例如一般表情、開心、生氣、難過、做鬼臉或噘嘴，這樣在使用者的智能型裝置20就可以預儲存多種不同心理狀態下的參考表情臉譜。 Then proceed to step 78. The application 28 in the smart device 20 will provide multiple photos with specific mental state and at least two points in common for the user to confirm. In step 80, after the user confirms, a plurality of photos having a specific mental state and having at least two points in common are stored in the second memory 26 of the smart device 20. Step 82: Complete the creation and setting of the reference facial expression Facebook of the specific psychological state. It should be noted that the user can set other reference facial expressions according to the above steps 70 to 82, such as general expressions, happy, angry, sad, grimace or pouting, so that the user's smart device 20 will It can pre-store a variety of reference facial expressions under different mental states.
接著，請參閱圖6，圖6是根據圖2及圖5或者圖3及圖5的步驟流程圖，對於使用者在特定心理狀態下的自拍的步驟流程圖。在圖6中，步驟90，選擇並設定使用者年齡。接著，如步驟92，使用者設定智能型裝置20進行自拍的拍攝時間長度。接著，繼續步驟94，利用智能型配件10偵測使用者的心跳次數及根據使用者心跳次數繪製心率圖。步驟96，智能型裝置20根據心跳次數及心率圖來捕捉使用者的臉部表情。步驟98，使用者選擇要自拍時的心理狀態。步驟100，智能型裝置20偵測自拍步驟的拍攝時間是否結束，若是，則進行步驟104，結束智能自拍步驟。若否，則繼續進行步驟102，判斷在自拍步驟的拍攝時間內是否有擷取到每分鐘心跳次數增加一數值， 若有，則繼續步驟1022，在使用者自定的拍攝時間內、並在特定的心理狀態下，根據所增加的數值的心跳次數來繪製使用者的心率圖，且同時根據此心跳次數及心率圖來捕捉使用者在此特定心理狀態下使用的臉部表情。緊接著進行步驟1024，根據捕捉到的使用者的臉部表情與使用者預儲存於智能型裝置20內的該特定心理狀態的多張表情臉譜比對，若使用者的臉部表情與具有該特定心理狀態的多張表情臉譜有至少兩個共同點，則對使用者進行自拍，以拍攝得到使用者在該特定心理狀態下的相片。 Next, please refer to FIG. 6. FIG. 6 is a flowchart of steps for a user to take a selfie in a specific mental state according to the flowcharts of FIG. 2 and FIG. 5 or FIG. 3 and FIG. In FIG. 6, in step 90, the user age is selected and set. Next, in step 92, the user sets a shooting time length for the smart device 20 to perform a self-timer. Next, proceed to step 94, using the intelligent accessory 10 to detect the number of times of the user's heartbeat and draw a heart rate chart according to the number of times of the user's heartbeat. Step 96: The smart device 20 captures the facial expression of the user according to the number of heartbeats and the heart rate graph. Step 98: The user selects a mental state when taking a selfie. In step 100, the smart device 20 detects whether the shooting time of the self-timer step is ended, and if so, proceeds to step 104 to end the smart self-timer step. If not, proceed to step 102 to determine whether there is an increase in the number of heartbeats per minute during the shooting time of the self-timer step, If yes, continue to step 1022, draw the user's heart rate chart according to the increased number of heartbeats within the user's self-defined shooting time, and under a specific psychological state, and at the same time based on this heartbeat number and heart rate Map to capture facial expressions used by the user in this particular mental state. Next, step 1024 is performed, according to the captured facial expression of the user and multiple facial expressions of the specific mental state pre-stored in the smart device 20 by the user. If the facial expression of the user matches The multiple facial expressions of a specific psychological state have at least two things in common, and then the user is taken a selfie to take a picture of the user in the specific psychological state.
在上述的步驟90至步驟1022均與前述圖2及圖3的步驟流程圖相同，在此不再多加陳述，而圖6與圖2及圖3的區別在於：步驟1024，智能型裝置20根據捕捉到的使用者的臉部表情與使用者預儲存於智能型裝置20內的該特定心理狀態的多張表情臉譜比對，若使用者的臉部表情與具有該特定心理狀態的多張表情臉譜有至少兩個共同點，則對使用者進行自拍，以拍攝得到使用者在該特定心理狀態下的相片。在此步驟1024中，使用者預儲存於智能型裝置20內的該特定心理狀態的多張表情臉譜是根據圖5的步驟流程圖來完成的，因此，使用者在進行自拍步驟的時候，智能型裝置20可以根據使用者目前的心跳次數及心率圖來捕捉使用者的表情臉譜之外，進一步的可以利用捕捉到的表情臉譜與預儲存在智能型裝置20內的多張該特定心理狀態的相片來比對，經由比對之後再進行自拍，而可以拍攝到使用者在該特定心理狀態下最自然的相片。 Steps 90 to 1022 described above are the same as the flowcharts of steps 2 and 3 described above, and will not be further described here. The difference between FIG. 6 and FIG. 2 and FIG. 3 is that in step 1024, the intelligent device 20 The captured facial expression of the user is compared with multiple facial expressions of the specific mental state pre-stored in the smart device 20 by the user. If the facial expression of the user and the multiple facial expressions having the specific mental state are compared Facebook has at least two things in common, then the user is taken a selfie to take a picture of the user in that particular mental state. In this step 1024, the multiple facial expressions of the specific mental state pre-stored in the smart device 20 by the user are completed according to the step flowchart of FIG. 5. Therefore, when the user performs the selfie step, the smart The device 20 can capture the user's facial expression according to the user's current heartbeat and heart rate graph. Further, the captured facial expression can be used with a plurality of pre-stored intelligent mental device 20 images of the specific mental state. The photos are compared, and then the selfie is taken after the comparison, and the most natural photos of the user in this particular mental state can be taken.
30‧‧‧選擇並設定使用者年齡 30‧‧‧Select and set user age
32‧‧‧設定進行自拍步驟的拍攝時間長度 32‧‧‧ Set the length of shooting time for the selfie step
34‧‧‧偵測使用者的心跳次數，並根據使用者的心跳次數繪製心率圖 34‧‧‧ Detects the number of heartbeats of the user and draws a heart rate chart based on the number of heartbeats of the user
36‧‧‧捕捉使用者的臉部表情 36‧‧‧Capturing the user's facial expressions
38‧‧‧使用者選擇要自拍時的心理狀態 38‧‧‧ Psychological state when the user chooses to take a selfie
40‧‧‧偵測自拍的拍攝時間是否結束 40‧‧‧ Detect if the shooting time of the selfie is over
42‧‧‧結束智能自拍 42‧‧‧ End Smart Selfie
44‧‧‧判斷在自拍的拍攝時間內是否有擷取到使用者每分鐘心跳次數增加一數值 44‧‧‧ Judgment whether the number of heartbeats per minute has been increased by the user within the shooting time of the selfie
442‧‧‧在使用者自定的拍攝時間內，並在特定的心理狀態下，根據所增加的心跳次數來繪製使用者的心率圖，且同時根據心率圖及心跳次數來捕捉在此特定心理狀態下使用者的臉部表情 442‧‧‧ draws the user's heart rate chart according to the increased number of heartbeats within the user-defined shooting time and under a specific psychological state, and simultaneously captures this specific mentality based on the heart rate chart and the number of heartbeats Facial expression of the user in the state
444‧‧‧使用者進行智能自拍，以拍攝使用者最自然的臉部表情的相片 444‧‧‧ users take smart selfies to take pictures of users ’most natural facial expressions
Claims (10)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| ??201611034222.0 | 2016-11-21 | ||
| CN201611034222.0A CN107040712B (en) | 2016-11-21 | 2016-11-21 | Intelligent self-timer method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| TWI611693B true TWI611693B (en) | 2018-01-11 |
| TW201820848A TW201820848A (en) | 2018-06-01 |
Family
ID=59531288
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| TW106103933A TWI611693B (en) | 2016-11-21 | 2017-02-07 | Intelligent Self-Shooting Method and System Thereof |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN107040712B (en) |
| TW (1) | TWI611693B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111277755B (en) * | 2020-02-12 | 2021-12-07 | 广州小鹏汽车科技有限公司 | Photographing control method and system and vehicle |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200939745A (en) * | 2008-03-14 | 2009-09-16 | Hon Hai Prec Ind Co Ltd | Camera and self-timer shooting method thereof |
| CN103809424A (en) * | 2013-10-17 | 2014-05-21 | 谢永生 | Heartbeat detection watch |
| US20150019682A1 (en) * | 2013-07-09 | 2015-01-15 | Lg Electronics Inc. | Mobile terminal and control method thereof |
| US20160050169A1 (en) * | 2013-04-29 | 2016-02-18 | Shlomi Ben Atar | Method and System for Providing Personal Emoticons |
| US20160195922A1 (en) * | 2015-01-05 | 2016-07-07 | Kinpo Electronics, Inc. | Wearable apparatus, display method thereof, and control method thereof |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5092357B2 (en) * | 2006-11-07 | 2012-12-05 | ソニー株式会社 | Imaging display device and imaging display method |
| US20150178915A1 (en) * | 2013-12-19 | 2015-06-25 | Microsoft Corporation | Tagging Images With Emotional State Information |
| KR102367550B1 (en) * | 2014-09-02 | 2022-02-28 | 삼성전자 주식회사 | Controlling a camera module based on physiological signals |
| JP2016126472A (en) * | 2014-12-26 | 2016-07-11 | 株式会社東芝 | Cardiac rate detecting device, and face recognition system using the same |
| CN105812666A (en) * | 2016-03-30 | 2016-07-27 | 上海斐讯数据通信技术有限公司 | Shooting method of intelligent terminal and intelligent terminal |
| CN105898072B (en) * | 2016-05-31 | 2020-02-21 | 联想(北京)有限公司 | Electronic equipment and control method thereof |
-
2016
- 2016-11-21 CN CN201611034222.0A patent/CN107040712B/en active Active
-
2017
- 2017-02-07 TW TW106103933A patent/TWI611693B/en active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW200939745A (en) * | 2008-03-14 | 2009-09-16 | Hon Hai Prec Ind Co Ltd | Camera and self-timer shooting method thereof |
| US20160050169A1 (en) * | 2013-04-29 | 2016-02-18 | Shlomi Ben Atar | Method and System for Providing Personal Emoticons |
| US20150019682A1 (en) * | 2013-07-09 | 2015-01-15 | Lg Electronics Inc. | Mobile terminal and control method thereof |
| CN103809424A (en) * | 2013-10-17 | 2014-05-21 | 谢永生 | Heartbeat detection watch |
| US20160195922A1 (en) * | 2015-01-05 | 2016-07-07 | Kinpo Electronics, Inc. | Wearable apparatus, display method thereof, and control method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| TW201820848A (en) | 2018-06-01 |
| CN107040712B (en) | 2019-11-26 |
| CN107040712A (en) | 2017-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10880495B2 (en) | Video recording method and apparatus, electronic device and readable storage medium | |
| RU2634909C2 (en) | Method and device for photographing images | |
| US10115019B2 (en) | Video categorization method and apparatus, and storage medium | |
| CN104699958B (en) | A kind of method and device for recommending menu according to user's body situation | |
| WO2017084182A1 (en) | Method and apparatus for image processing | |
| WO2017016149A1 (en) | Contact information recommendation method and apparatus | |
| US20100086204A1 (en) | System and method for capturing an emotional characteristic of a user | |
| JP6391708B2 (en) | Method and apparatus for acquiring iris image, and iris identification device | |
| CN105279499B (en) | Age recognition methods and device | |
| EP3174283A1 (en) | Preview image display method and apparatus, computer program and recording medium | |
| EP3173969A1 (en) | Method, apparatus and terminal device for playing music based on a target face photo album | |
| CN105208284B (en) | Shoot based reminding method and device | |
| JP2010034685A (en) | Digital camera | |
| EP3328062A1 (en) | Photo synthesizing method and device | |
| US9571725B2 (en) | Electronic device and image capture method thereof | |
| JPWO2015145769A1 (en) | Imaging apparatus, information processing apparatus, photographing assistance system, photographing assistance program, and photographing assistance method | |
| CN110969120B (en) | Image processing method and device, electronic equipment and readable storage medium | |
| US20170244891A1 (en) | Method for automatically capturing photograph, electronic device and medium | |
| CN109145878B (en) | Image extraction method and device | |
| TWI611693B (en) | Intelligent Self-Shooting Method and System Thereof | |
| JP6323548B2 (en) | Imaging assistance system, imaging apparatus, information processing apparatus, imaging assistance program, and imaging assistance method | |
| CN108021637A (en) | A kind of topic searching method, device, facility for study and storage medium | |
| KR20150109254A (en) | Imaging apparatus, imaging method and recording medium having program for performing self-timer shooting | |
| US10812707B2 (en) | Computing device haptic timer for photography | |
| JP2010034686A (en) | Digital camera |