US10726715B2 - Electronic device and method for performing operations according to proximity of external object - Google Patents
Electronic device and method for performing operations according to proximity of external object Download PDFInfo
- Publication number
- US10726715B2 US10726715B2 US15/350,005 US201615350005A US10726715B2 US 10726715 B2 US10726715 B2 US 10726715B2 US 201615350005 A US201615350005 A US 201615350005A US 10726715 B2 US10726715 B2 US 10726715B2
- Authority
- US
- United States
- Prior art keywords
- electronic device
- proximity
- external object
- sensor
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
- 238000000034 method Methods 0.000 title claims abstract description 112
- 230000004044 response Effects 0.000 claims abstract description 8
- 230000001133 acceleration Effects 0.000 claims description 29
- 230000008859 change Effects 0.000 claims description 10
- 230000006870 function Effects 0.000 description 94
- 230000005236 sound signal Effects 0.000 description 49
- 238000004891 communication Methods 0.000 description 35
- 230000008569 process Effects 0.000 description 14
- 230000001413 cellular effect Effects 0.000 description 10
- 238000012545 processing Methods 0.000 description 10
- 238000010586 diagram Methods 0.000 description 6
- 230000014509 gene expression Effects 0.000 description 5
- 208000016339 iris pattern Diseases 0.000 description 4
- 238000013459 approach Methods 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000036541 health Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000012544 monitoring process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000002591 computed tomography Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000005286 illumination Methods 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 238000005070 sampling Methods 0.000 description 2
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 238000002583 angiography Methods 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 239000008280 blood Substances 0.000 description 1
- 210000004369 blood Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000010267 cellular communication Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000007812 deficiency Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- -1 electricity Substances 0.000 description 1
- 238000002567 electromyography Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 239000004744 fabric Substances 0.000 description 1
- 239000000446 fuel Substances 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006698 induction Effects 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000008520 organization Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 229910052724 xenon Inorganic materials 0.000 description 1
- FHNFHKCVQCLJFQ-UHFFFAOYSA-N xenon atom Chemical compound [Xe] FHNFHKCVQCLJFQ-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
- G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1686—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being an integrated camera
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72448—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
- H04M1/72454—User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2200/00—Indexing scheme relating to G06F1/04 - G06F1/32
- G06F2200/16—Indexing scheme relating to G06F1/16 - G06F1/18
- G06F2200/163—Indexing scheme relating to constructional details of the computer
- G06F2200/1637—Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/90—Additional features
- G08C2201/91—Remote control based on location and proximity
-
- G—PHYSICS
- G08—SIGNALLING
- G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
- G08C2201/00—Transmission systems of control signals via wireless link
- G08C2201/90—Additional features
- G08C2201/93—Remote control using other portable devices, e.g. mobile phone, PDA, laptop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/60—Substation equipment, e.g. for use by subscribers including speech amplifiers
- H04M1/6008—Substation equipment, e.g. for use by subscribers including speech amplifiers in the transmitter circuit
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Definitions
- Various embodiments of the present disclosure relate to an electronic device, method and computer-readable recording medium for performing operations according to proximity of an external object.
- an electronic device connects to an external device through short-range communication to sense proximity of a user having the external device and determines proximity of the user by using a distance to the connected external device to perform a corresponding operation.
- the electronic device may include a sensor capable of sensing proximity of an external object and perform a set operation according to a state sensed by the sensor.
- the electronic device may include a proximity sensor capable of sensing proximity of a body of a user and perform a corresponding function if a signal is output from the proximity sensor.
- the electronic device senses proximity of a user having the external device or performs an operation corresponding to a state sensed by the proximity sensor included in the electronic device.
- an electronic device includes a plurality of sensors and a processor, in which the processor determines a proximity state of an external object with respect to the electronic device, which indicates whether the external object exists around the electronic device, by using a first sensor set from among the plurality of sensors, determines a detailed proximity state of the external object with respect to the electronic device, which indicates whether the external object exists in a proximity region of the electronic device, by using a second sensor set from among the plurality of sensors if the external object is in a first proximity state with respect to the electronic device, and determines a detailed proximity state of the external object with respect to the electronic device by using a third sensor set from among the plurality of sensors if the external object is in a second proximity state with respect to the electronic device.
- an electronic device includes a plurality of sensors and a processor, in which the processor determines a proximity state of an external object with respect to the electronic device, which indicates whether the external object exists around the electronic device, by using at least one of the plurality of sensors in a first mode, determines a detailed proximity state of the external object with respect to the electronic device, which indicates whether the external object exists in a proximity region of the electronic device, by using the at least one sensor in a second mode if the external object is in a first proximity state with respect to the electronic device, and determines a detailed proximity state of the external object with respect to the electronic device by using the at least one sensor in a third mode if the external object is in a second proximity state with respect to the electronic device.
- a method for operating an electronic device includes sensing first proximity of an external object with respect to the electronic device by using a first sensor included in the electronic device, determining a second sensor by using context information of the electronic device, sensing second proximity of the external object with respect to the electronic device by using the determined second sensor, and performing a function of the electronic device based on the sensed second proximity.
- FIG. 1 illustrates a network environment including an electronic device according to various embodiments of the present disclosure
- FIG. 2 is a block diagram illustrating an electronic device according to various embodiments of the present disclosure
- FIG. 3 is a block diagram illustrating a programming module according to various embodiments of the present disclosure
- FIG. 4 is a flowchart illustrating a method for determining proximity of an external object by using at least one sensor according to various embodiments of the present disclosure
- FIG. 5 is a flowchart illustrating a method for determining proximity of an external object by using at least one sensor in a plurality of modes according to various embodiments of the present disclosure
- FIG. 6 is a flowchart illustrating a method for performing operations based on proximity of an external object by using at least one sensor according to various embodiments of the present disclosure
- FIG. 7 is a flowchart illustrating a method for performing operations based on proximity of an external object by using at least one sensing method according to various embodiments of the present disclosure
- FIGS. 8A, 8B and 8C illustrate examples for describing an operation of sensing proximity of an external object and unlocking a lock screen according to various embodiments of the present disclosure
- FIG. 9 is a flowchart illustrating a method for determining first proximity of an external object by using a microphone according to various embodiments of the present disclosure
- FIGS. 10A and 10B illustrate examples for describing impulse signals according to various embodiments of the present disclosure
- FIG. 11 is a flowchart illustrating a method for determining first proximity of an external object by using an antenna according to various embodiments of the present disclosure
- FIG. 12 is a structural diagram illustrating an antenna module according to various embodiments of the present disclosure.
- FIG. 13 is a flowchart illustrating a method for determining first proximity of an external object by using an acceleration sensor according to various embodiments of the present disclosure
- FIG. 14 is a flowchart illustrating a method for determining first proximity of an external object by using a camera module according to various embodiments of the present disclosure
- FIGS. 15A and 15B illustrate examples for describing a method for determining first proximity of an external object by using a front camera according to various embodiments of the present disclosure
- FIG. 16 is a flowchart illustrating a method for determining second proximity of an external object by using a display according to various embodiments of the present disclosure
- FIGS. 17A and 17B illustrate examples for describing a method for determining second proximity of an external object by using a display according to various embodiments of the present disclosure
- FIG. 18 is a flowchart illustrating a method for determining second proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure
- FIGS. 19A and 19B illustrate examples for describing a method for determining second proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure
- FIG. 20 is a flowchart illustrating a method for determining proximity intention of an external object based on iris recognition by using a camera module according to various embodiments of the present disclosure
- FIGS. 21A and 21B illustrate examples for describing a method for determining proximity intention of an external object by using a camera module according to various embodiments of the present disclosure
- FIG. 22 is a flowchart illustrating a method for determining proximity intention of an external object based on face recognition by using a camera module according to various embodiments of the present disclosure
- FIG. 23 is a flowchart illustrating a method for determining proximity intention of an external object by using a touch panel according to various embodiments of the present disclosure
- FIGS. 24A, 24B, 24C, 24D and 24E illustrate examples for describing a method for performing a function of an electronic device in association with proximity of an external object by using a touch panel according to various embodiments of the present disclosure
- FIG. 25 is a flowchart illustrating a method for performing a function of an electronic device in association with proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure
- FIGS. 26A and 26B illustrate examples for describing a method for performing a function of an electronic device in association with proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure
- FIG. 27 is a flowchart illustrating a process of sensing proximity of an external object and outputting data corresponding to occurrence of an event according to various embodiments of the present disclosure
- FIG. 28 is a flowchart illustrating a process of sensing proximity of an external object and outputting data corresponding to context information according to various embodiments of the present disclosure
- FIG. 29 is a flowchart illustrating a process of sensing proximity of an external object and outputting voice content according to various embodiments of the present disclosure
- FIGS. 30A and 30B illustrate examples for describing an operation of sensing proximity of an external object and outputting voice content according to various embodiments of the present disclosure.
- FIG. 31 illustrating a flowchart of an operation of sensing proximity of an external device and performing connection with an external device based on connection history information according to various embodiments of the present disclosure.
- FIGS. 1 through 31 discussed below, and the various embodiments used to describe the principles of the present disclosure in this patent document are by way of illustration only and should not be construed in any way to limit the scope of the disclosure. Those skilled in the art will understand that the principles of the present disclosure may be implemented in any suitably arranged electronic devices.
- an expression such as “having,” “may have,” “comprising,” or “may comprise” indicates existence of a corresponding characteristic (e.g., a numerical value, a function, an operation, or an element like a part) and does not exclude existence of additional characteristic.
- an expression such as “A or B,” “at least one of A or/and B,” or “one or more of A or/and B” may include all possible combinations of together listed items.
- “A or B,” “at least one of A and B,” or “one or more of A or B” may indicate the entire of (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.
- first, second, primarily,” or “secondary,” used herein may represent various elements regardless of order and/or importance and do not limit corresponding elements.
- a first user device and a second user device may represent different user devices regardless of order or importance.
- a first element may be named as a second element without departing from the right scope of the various exemplary embodiments of the present disclosure, and similarly, a second element may be named as a first element.
- an element such as a first element
- another element such as a second element
- the element can be directly connected to the other element or can be connected to the other element through another element (e.g., a third element).
- an element such as a first element
- another element such as a second element
- An expression “configured to (or set)” used in the present disclosure may be replaced with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of” according to a situation.
- a term “configured to (or set)” does not always mean only “specifically designed to” by hardware.
- an expression “apparatus configured to” may mean that the apparatus “can” operate together with another apparatus or component.
- a phrase “a processor configured (or set) to perform A, B, and C” may be a dedicated processor (e.g., an embedded processor) for performing a corresponding operation or a generic-purpose processor (such as a CPU or an application processor) that can perform a corresponding operation by executing at least one software program stored at a memory device.
- a dedicated processor e.g., an embedded processor
- a generic-purpose processor such as a CPU or an application processor
- An electronic device may include at least one of, for example, a smartphone, a tablet personal computer (PC), a mobile phone, a video phone, an electronic-book (e-book) reader, a destkop PC, a laptop PC, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical equipment, a camera, and a wearable device.
- a smartphone a tablet personal computer (PC)
- a mobile phone a video phone
- e-book electronic-book reader
- destkop PC destkop PC
- laptop PC a netbook computer
- workstation a server
- PDA personal digital assistant
- PMP portable multimedia player
- MP3 player MP3 player
- examples of the wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, head-mounted device (HMD), etc.), a fabric or cloth-integrated type (e.g., electronic clothing, etc.), a body-attached type (e.g., a skin pad, a tattoo, etc.), a body implanted type (e.g., an implantable circuit, etc.), and so forth.
- an accessory type e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, head-mounted device (HMD), etc.
- a fabric or cloth-integrated type e.g., electronic clothing, etc.
- a body-attached type e.g., a skin pad, a tattoo, etc.
- a body implanted type e.g., an implantable circuit, etc.
- an electronic device may be a home appliance.
- the electronic device may include, for example, a television (TV), a digital video disk (DVD) player, audio equipment, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a laundry machine, an air cleaner, a set-top box, a home automation control panel, a security control panel, a TV box (e.g., HomeSyncTM of Samsung, TVTM of Apple, or TVTM of Google), a game console, an electronic dictionary, an electronic key, a camcorder, and an electronic frame.
- TV television
- DVD digital video disk
- the electronic device may include at least one of various medical equipment (for example, magnetic resonance angiography (MRA), magnetic resonance imaging (MM), computed tomography (CT), an imaging device, or an ultrasonic device), a navigation system, a global positioning system (GPS) receiver, an event data recorder (EDR), a flight data recorder (FDR), a vehicle infotainment device, electronic equipment for ships (e.g., a navigation system and gyro compass for ships), avionics, a security device, a vehicle head unit, an industrial or home robot, an automatic teller's machine (ATM), a point of sales (POS), Internet of things (e.g., electric bulbs, various sensors, electricity or gas meters, sprinkler devices, fire alarm devices, thermostats, streetlights, toasters, exercise machines, hot-water tanks, heaters, boilers, and so forth).
- MRA magnetic resonance angiography
- MM magnetic resonance imaging
- CT computed tomography
- an imaging device or an ultrasonic
- the electronic device may include a part of a furniture or building/structure, an electronic board, an electronic signature receiving device, a projector, and various measuring instruments (e.g., a water, electricity, gas, electric wave measuring device, etc.).
- the electronic device according to various embodiments of the present disclosure may be one of the above-listed devices or a combination thereof.
- the electronic device according to some embodiments may be a flexible electronic device.
- the electronic device according to various embodiments of the present disclosure is not limited to the above-listed devices and may include new electronic devices according to technical development.
- the term “user” used in various embodiments of the present disclosure may refer to a person who uses the electronic device or a device using the electronic device.
- the electronic device 101 may include a bus 110 , a processor 120 , a memory 130 , an input/output (I/O) interface 150 , a display 160 , and a communication interface 170 .
- the electronic device 101 may omit at least one of the foregoing elements or may further include other elements.
- the bus 110 may include a circuit for connecting, e.g., the elements 110 to 170 and delivering communication (e.g., a control message and/or data) between the elements 110 to 170 .
- communication e.g., a control message and/or data
- the processor 120 may include one or more of a central processing unit (CPU), an application processor (AP), and a communication processor (CP).
- the processor 120 performs operations or data processing for control and/or communication of, for example, at least one other elements of the electronic device 101 .
- the memory 130 may include a volatile and/or nonvolatile memory.
- the memory 130 may store, for example, commands or data associated with at least one other elements of the electronic device 101 .
- the memory 130 may store software and/or a program 140 .
- the program 140 may include at least one of, for example, a kernel 141 , middleware 143 , an application programming interface (API) 145 , and/or an application program (or “application”) 147 , and the like.
- At least some of the kernel 141 , the middleware 143 , and the API 145 may be referred to as an operating system (OS).
- OS operating system
- the kernel 141 may control or manage, for example, system resources (e.g., the bus 110 , the processor 120 , the memory 130 , etc.) used to execute operations or functions implemented in other programs (e.g., the middleware 143 , the API 145 , or the application program 147 ).
- the kernel 141 provides an interface through which the middleware 143 , the API 145 , or the application program 147 accesses separate components of the electronic device 101 to control or manage the system resources.
- the middleware 143 may work as an intermediary for allowing, for example, the API 145 or the application program 147 to exchange data in communication with the kernel 141 .
- the middleware 143 may process one or more task requests received from the application program 147 based on priorities. For example, the middleware 143 may give a priority for using a system resource (e.g., the bus 110 , the processor 120 , the memory 130 , etc.) of the electronic device 101 to at least one of the application programs 147 . For example, the middleware 143 may perform scheduling or load balancing with respect to the one or more task requests by processing the one or more task requests based on the priority given to the at least one of the application programs 147 .
- a system resource e.g., the bus 110 , the processor 120 , the memory 130 , etc.
- the API 145 is an interface used for the application 147 to control a function provided by the kernel 141 or the middleware 143 , and may include, for example, at least one interface or function (e.g., a command) for file control, window control, image processing or character control.
- a command e.g., a command for file control, window control, image processing or character control.
- the I/O interface 150 serves as an interface for delivering, for example, a command or data input from a user or another external device to other component(s) of the electronic device 101 .
- the I/O interface 150 may also output a command or data received from other component(s) of the electronic device 101 to a user or another external device.
- the display 160 may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a microelectromechanical system (MEMS) display, or an electronic paper display.
- the display 160 may, for example, display various contents (e.g., a text, an image, video, an icon, a symbol, etc.) to users.
- the display 160 may include a touch screen, and receives a touch, a gesture, proximity, or a hovering input, for example, by using an electronic pen or a part of a body of a user.
- the communication interface 170 establishes communication between the electronic device 101 and an external device (e.g., a first external electronic device 102 , a second external electronic device 104 , or a server 106 ).
- an external device e.g., a first external electronic device 102 , a second external electronic device 104 , or a server 106 .
- the communication interface 170 may be connected to a network 162 through wireless communication or wired communication to communicate with an external device (e.g., the second external electronic device 104 or the server 106 ).
- Wired communication may use, for example, as a cellular communication protocol, at least one of, for example, long-term evolution (LTE), LTE advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA), universal mobile telecommunications system (UMTS), wireless broadband (WiBro), global system for mobile communications (GSM), and so forth.
- the wireless communication may include, for example, short-range communication 164 .
- the short-range communication 164 may include, for example, at least one of wireless fidelity (WiFi), Bluetooth®, near field communication (NFC), a global navigation satellite system (GNSS), and the like.
- the GNSS may include, for example, at least one of a global positioning system (GPS), a global navigation satellite system (Glonass®), a Beidou navigation satellite system (Beidou®), and Galileo®, the European global satellite-based navigation system.
- GPS global positioning system
- the wired communication may include, for example, at least one of a USB (universal serial bus), a high definition multimedia interface (HDMI), a recommended standard (RS)-232, a plain old telephone service (POTS), and so forth.
- the network 162 may include a telecommunications network, for example, at least one of a computer network (e.g., a local area network (LAN) or a wide area network (WAN)), Internet, and a telephone network.
- Each of the first external electronic device 102 and the second external electronic device 104 may be a device of the same type as or a different type than the electronic device 101 .
- the server 106 may include a group of one or more servers. According to various embodiments of the present disclosure, some or all of operations performed by the electronic device 101 may be performed in another electronic device or a plurality of electronic devices (e.g., the electronic device 102 or 104 , or the server 106 ).
- the electronic device 101 may request another device (e.g., the electronic devices 102 or 104 , or the server 106 ) to perform at least some functions associated with the function or the service instead of or in addition to executing the function or the service.
- the another electronic device e.g., the electronic device 102 or 104 , or the server 106
- the electronic device 101 may then process or further process the received result to provide the requested function or service.
- cloud computing, distributed computing, or client-server computing may be used.
- FIG. 2 is a block diagram of an electronic device 201 according to various embodiments of the present disclosure.
- the electronic device 201 may form the entire electronic device 101 illustrated in FIG. 1 or a part of the electronic device 101 illustrated in FIG. 1 .
- the electronic device 201 may include one or more processors (e.g., application processors (APs)) 210 , a communication module 220 , a subscriber identification module (SIM) 224 , a memory 230 , a sensor module 240 , an input device 250 , a display 260 , an interface 270 , an audio module 280 , a camera module 291 , a power management module 295 , a battery 296 , an indicator 297 , and a motor 298 .
- APs application processors
- SIM subscriber identification module
- the processor 210 controls multiple hardware or software components connected to the processor 210 by driving an operating system (OS) or an application program, and performs processing and operations with respect to various data.
- the processor 210 may be implemented with, for example, a system on chip (SoC).
- SoC system on chip
- the processor 210 may further include a graphic processing unit (GPU) and/or an image signal processor.
- the processor 210 may include at least some of the elements illustrated in FIG. 2 (e.g., the cellular module 221 ).
- the processor 210 loads a command or data received from at least one of other elements (e.g., a non-volatile memory) into a volatile memory to process the command or data, and stores various data in the non-volatile memory.
- the processor 210 determines a proximity state of an external object with respect to the electronic device 201 by using a first sensor set from among a plurality of sensors, determines a detailed proximity state of the external object with respect to the electronic device 201 by using a second sensor set from among the plurality of sensors if the external object is in a first proximity state with respect to the electronic device 201 , and determines a detailed proximity state of the external object with respect to the electronic device 201 by using a third sensor set from among the plurality of sensors if the external object is in a second proximity state with respect to the electronic device 201 .
- the respective sensor sets may include a single sensor or a plurality of sensors.
- the plurality of sensors may include an identical type of sensors or two or more different sensors.
- the plurality of sensors may include a plurality of microphones, and may include a proximity sensor 240 G and an acceleration sensor 240 E.
- the external object may be a person or a device, and the person may be a known person or an unknown person, and the device may be an authorizable device (or a registered device) or a new device.
- the external object may be one or two or more objects.
- the proximity state refers to a state where a person or an external device exists around the electronic device 201
- the detailed proximity state refers to a state where the person or device is located in a maximum proximity region to use the electronic device 201 .
- the maximum proximity region may include a distance in which a person may use the electronic device 201 or a distance in which the external device may be connected with the electronic device 201 .
- the first proximity state or the second proximity state may include a state where the external object is recognized within a specific region.
- the processor 210 may determine the first proximity state or the second proximity state if an impulse signal input through the microphone 288 is a waveform over a specific sound pressure, a pattern that is the same as a preset threshold pattern, or an impulse signal over a specific number of times.
- the processor 210 determines a proximity state of an external object with respect to the electronic device 201 by using at least one of a plurality of sensors in a first mode, determines a detailed proximity state of the external object with respect to the electronic device 201 by using at least one sensor in a second mode if the external object is in a first proximity state with respect to the electronic device 201 , and determines a detailed proximity state of the external object with respect to the electronic device 201 by using at least one sensor in a third mode if the external object is in a second proximity state with respect to the electronic device 201 .
- the first mode may include a method for determining a proximity state of the external object by using one microphone
- the second mode may include a method for determining a detailed proximity state of the external object by using a plurality of microphones.
- the first mode may include a method for measuring an acceleration by using some of x, y, and z axes of an acceleration sensor
- the second mode may include a method for measuring an acceleration by using other some axes of the acceleration sensor.
- the processor 210 senses first proximity of the external object by using a first sensor set among a plurality of sensors, determines context information of the electronic device 201 to determine a second sensor set among the plurality of sensors, senses second proximity of the external object by using the determined second sensor set, determines a proximity intention of the external object by using a third sensor set among the plurality of sensors, and performs a function of the electronic device 201 corresponding to the determined proximity intention.
- the processor 210 determines a type or a number of external objects as well as a distance to the external object. For example, if the first sensor set includes the camera module 291 , the processor 210 may perform face recognition from a scene that is input through the camera module 291 to determine whether the external object is a person or one or more faces are recognized. For example, if the first sensor set includes the RF module 229 , the processor 210 may sense a beacon signal that is input through the RF module 229 to determine whether the external object is an external device or one or more external devices exist.
- the first sensor set may include the microphone 288 , an antenna (not shown), the acceleration sensor 240 E, the camera module 291 , and the RF module 229 .
- the second sensor set may include the display (e.g., a sensor-in-pixel) 260 , the camera module 291 , and the microphone 288 .
- the third sensor set may include the camera module 291 , the display 260 , the input device 250 , the gyro sensor 240 B, the acceleration sensor 240 E, and the grip sensor 240 F.
- the processor 210 receives a first audio signal from the microphone 288 , analyzes the received first audio signal, and determines whether the received first audio signal is a first proximity signal. To determine whether the received first audio signal is the first proximity signal, the processor 210 compares the first audio signal with a previously stored threshold signal to determine whether the first audio signal matches the previously stored threshold signal. If a difference between the first audio signal and the previously stored threshold signal is less than a preset threshold difference, the processor 210 determines that the first audio signal and the threshold signal match each other.
- the processor 210 determines first proximity of the external object.
- the first proximity may indicate that the external object is recognized in the first proximity region of the electronic device 201 .
- the processor 210 determines context information such as location information, orientation state information, time information, schedule information, or contact information to determine the second sensor set.
- the processor 210 determines at least one available sensor corresponding to each of the house, the company, the school, and so forth as the second sensor set. For example, if the corresponding available sensors are the camera module 291 and the display 260 when the location of the electronic device 201 is the company, the processor 210 may determine the camera module 291 or the display 260 as the second sensor set.
- the processor 210 determines at least one of the display 260 , the camera module 291 , and the microphone 288 as the second sensor set if an orientation value of the electronic device 201 is included in a threshold orientation range. For example, according to whether the orientation value of the electronic device 201 is in a range of 0° to 10°, in a range of 170° to 180°, or in a range of 11° to 169°, at least one sensor may be determined as the second sensor set. If the orientation value of the electronic device 201 is in a range of 0° to 10° or in a range of 170° to 180°, the processor 210 determines that the electronic device 201 is placed in a particular location.
- the processor 210 determines the camera module 291 and the microphone 288 as the second sensor set. If the orientation value of the electronic device 201 is in a range of 11° to 169°, the processor 210 determines that the user holds the electronic device 201 by hand. If determining so, the processor 210 determines the display 260 and the camera module 291 as the second sensor set. According to various embodiments, the orientation value of the electronic device 201 is not limited to the above description and may be set variously.
- the processor 210 determines at least one of the display 160 , the camera module 291 , and a plurality of microphones being set according to a previously designated time or a preset schedule as the second sensor set. For example, if an alarm is set for 3:00 pm, the processor 210 determines the microphone 288 and the acceleration sensor 240 E as the second sensor set to sense proximity of an external object at the time set for the alarm.
- the processor 210 determines that the external object is located in a maximum proximity distance of the electronic device 201 and determines the display 260 and the camera module 291 as the second sensor set.
- sensors are not limited to the foregoing disclosure, and various sensors may be used for proximity of the external object.
- the processor 210 determines second proximity of the external object if the external object is recognized in a specific region of a scene input through the camera.
- the second proximity may indicate that the external object is recognized in the second proximity region of the electronic device 201 .
- the processor 210 recognizes that the external object is in proximity to the electronic device 201 to use the electronic device 201 .
- the processor 210 determines a third sensor set from among a plurality of sensors based on the second proximity and determines proximity intention of the external object by using the determined third sensor set.
- the processor 210 determines at least one of the camera module 291 , the display 260 , the input device 250 , the gyro sensor 240 B, the acceleration sensor 240 E, and the grip sensor 240 F, which is used to determine proximity intention of the external object, as the third sensor set.
- the processor 210 performs iris recognition by using the camera module 291 and determines proximity intention of the external object as proximity for user authentication if the iris is recognized.
- the processor 210 performs user authentication based on iris recognition, and performs a function of the electronic device 201 that is set corresponding to user authentication if the external object is identified as the user of the electronic device 201 . If the set function of the electronic device 201 is a function of unlocking the lock screen of the electronic device 201 , the processor 210 unlocks the lock screen of the electronic device 201 once identifying the external object as the user of the electronic device 201 .
- the processor 210 senses first proximity of the external object by using a first sensing method, determines context information of the electronic device 201 to determine a second sensing method, senses second proximity of the external object by using the determined second sensing method, determines a proximity intention of the external object by using a third sensing method, and performs a function of the electronic device 201 corresponding to the determined proximity intention.
- the processor 210 analyzes a first audio signal input through one microphone to determine whether the external object is recognized in the first proximity region.
- the processor 210 determines context information such as location information, orientation state information, time information, schedule information, or contact information to determine the second sensing method based on the determined context information. For example, if the orientation value of the electronic device 201 is greater than or equal to a threshold orientation value or if a surrounding noise of the electronic device 201 is less than a threshold value, the processor 210 may determine a method for sensing proximity of the external object by using a plurality of microphones as the second sensing method.
- context information such as location information, orientation state information, time information, schedule information, or contact information to determine the second sensing method based on the determined context information. For example, if the orientation value of the electronic device 201 is greater than or equal to a threshold orientation value or if a surrounding noise of the electronic device 201 is less than a threshold value, the processor 210 may determine a method for sensing proximity of the external object by using a plurality of microphones as the second sensing method.
- the processor 210 may determine a method for sensing proximity of the external object by using the display 260 as the second sensing method.
- the processor 210 analyzes a plurality of audio signals input through a plurality of microphones to determine whether the external object is recognized in the second proximity region.
- the processor 210 analyzes a plurality of audio signals to determine a proximity direction and a proximity distance of the external object, calculates a location corresponding to the determined proximity direction and proximity distance, and determines whether the calculated location is included in the second proximity region. If the calculated location is included in the second proximity region, the processor 210 determines second proximity of the external object.
- the processor 210 analyzes a light-receiving signal input through the display 260 and determines that the external object is included in the second proximity distance if the sensed amount of light is less than a threshold value or the number of sensed sensors (e.g., the number of pixels in the display 260 ) is greater than or equal to a threshold value.
- the processor 210 determines a third sensing method based on the second proximity of the external object and determines proximity intention of the external object by using the determined third sensing method.
- the processor 210 senses motion of the external object by using the camera module 291 to determine whether the external object is approaching the electronic device 201 . If the external object is approaching the electronic device 201 , the processor 210 changes a screen direction of the electronic device 201 based on an approaching direction of the external object and displays the screen.
- the processor 210 senses a form in which the external object holds the electronic device 201 by using the touch panel 252 and determines proximity intention of the external object based on the sensed holding form. If the sensed holding form is determined as a preset holding form corresponding to a call function of the electronic device 201 , the processor 210 determines the proximity intention of the external object as the intention of using the call function of the electronic device 201 . The processor 210 displays a user interface corresponding to the call function on the display 260 .
- the communication module 220 may have a configuration that is the same as or similar to the communication interface 170 illustrated in FIG. 1 .
- the communication module 220 may include, for example, at least one of the cellular module 221 , a WiFi module 223 , a Bluetooth (BT) module 225 , a GNSS module 227 (e.g., a GPS module, a Glonass module, a Beidou® module, or a Galileo® module), a near field communication (NFC) module 228 , and a radio frequency (RF) module 229 .
- the communication module 220 may include an antenna (not shown).
- the cellular module 221 may provide, for example, a voice call, a video call, a text service, or an Internet service over a communication network. According to an embodiment, the cellular module 221 identifies and authenticates the electronic device 201 in a communication network by using the SIM 224 (e.g., a SIM card). According to an embodiment, the cellular module 221 performs at least one of functions that may be provided by the processor 210 . According to an embodiment, the cellular module 221 may include a communication processor (CP).
- CP communication processor
- Each of the WiFi module 223 , the BT module 225 , the GNSS module 227 , and the NFC module 228 may include, for example, a processor for processing data transmitted and received by a corresponding module.
- at least some (e.g., two or more) of the cellular module 221 , the WiFi module 223 , the BT module 225 , the GNSS module 227 , and the NFC module 228 may be included in one integrated chip (IC) or IC package.
- IC integrated chip
- the RF module 229 may, for example, transmit and receive a communication signal (e.g., an RF signal).
- the RF module 229 may include a transceiver, a power amplification module (PAM), a frequency filter, a low noise amplifier (LNA), or an antenna.
- PAM power amplification module
- LNA low noise amplifier
- at least one of the cellular module 221 , the WiFi module 223 , the BT module 225 , the GNSS module 227 , and the NFC module 228 may transmit and receive an RF signal through the separate RF module.
- the SIM 224 may, for example, include a card including an SIM and/or an embedded SIM, and may include unique identification information (e.g., an integrated circuit card identifier (ICCID) or subscriber information (e.g., an international mobile subscriber identity (IMSI)).
- unique identification information e.g., an integrated circuit card identifier (ICCID) or subscriber information (e.g., an international mobile subscriber identity (IMSI)
- IMSI international mobile subscriber identity
- the memory 230 may, for example, include an internal memory 232 and/or an external memory 234 .
- the internal memory 232 may, for example, include at least one of a volatile memory (e.g., dynamic random access memory (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), and a non-volatile memory (e.g., one time programmable read only memory (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), etc.), mask ROM, flash ROM, NAND flash memory, NOR flash memory, etc.), and a solid state drive (SSD).
- a volatile memory e.g., dynamic random access memory (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.
- a non-volatile memory e.g., one time programmable read only memory (OTPROM), programmable ROM (PROM), era
- the external memory 234 may further include flash drive, for example, compact flash (CF), secure digital (SD), micro-SD, mini-SD, extreme Digital (xD), a multi-media card (MMC), or a memory stick.
- flash drive for example, compact flash (CF), secure digital (SD), micro-SD, mini-SD, extreme Digital (xD), a multi-media card (MMC), or a memory stick.
- the external memory 234 may be functionally and/or physically connected with the electronic device 201 through various interfaces.
- the memory 230 may store any information used for performing a function of the electronic device 201 based on proximity of an external object determined by the processor 210 .
- the sensor module 240 measures physical quantity or senses an operation state of the electronic device 201 to convert the measured or sensed information into an electric signal.
- the sensor module 240 may, for example, include at least one of a gesture sensor 240 A, a gyro sensor 240 B, a pressure sensor 240 C, a magnetic sensor 240 D, an acceleration sensor 240 E, a grip sensor 240 F, a proximity sensor 240 G, a color sensor 240 H (e.g., RGB sensor), a biometric sensor 240 I, a temperature/humidity sensor 240 J, an illumination sensor 240 K, and a ultraviolet (UV) sensor 240 M.
- the sensor module 240 may include an E-nose sensor (not shown), an electromyography (EMG) sensor (not shown), an electroencephalogram (EEG) sensor (not shown), an electrocardiogram (ECG) sensor (not shown), an infrared (IR) sensor, an iris sensor, and/or a fingerprint sensor.
- the sensor module 240 may further include a control circuit for controlling at least one sensor included therein.
- the electronic device 201 may further include a processor configured to control the sensor module 240 as part of or separately from the processor 210 , to control the sensor module 240 during a sleep state of the processor 210 .
- the (digital) pen sensor 254 may include a recognition sheet which is a part of the touch panel 252 or a separate recognition sheet.
- the key 256 may also include a physical button, an optical key, or a keypad.
- the ultrasonic input device 258 senses ultrasonic waves generated by an input means through a microphone (e.g., the microphone 288 ) and checks data corresponding to the sensed ultrasonic waves.
- the display 260 may include a panel 262 , a hologram device 264 , or a projector 266 .
- the panel 262 may have a configuration that is the same as or similar to the display 160 illustrated in FIG. 1 .
- the panel 262 may be implemented to be flexible, transparent, or wearable.
- the panel 262 may be configured with the touch panel 252 in one module.
- the hologram device 264 shows a stereoscopic image in the air by using interference of light.
- the projector 266 displays an image onto an external screen through projection of light.
- the screen may be positioned inside or outside the electronic device 201 .
- the display 260 may further include a control circuit for controlling the panel 262 , the hologram device 264 , or the projector 266 .
- the display 260 may include a sensor pixel and receive a light-receiving signal.
- the interface 270 may include a high-definition multimedia interface (HDMI) 272 , a universal serial bus (USB) 274 , an optical communication 276 , or a D-subminiature 278 .
- the interface 270 may be included in the communication interface 170 illustrated in FIG. 1 .
- the interface 270 may include a mobile high-definition link (MHL) interface, an SD/multi-media card (MMC) interface, or an Infrared Data Association (IrDA) interface.
- MHL mobile high-definition link
- MMC SD/multi-media card
- IrDA Infrared Data Association
- the audio module 280 bi-directionally converts sound and an electric signal. At least one element of the audio module 280 may be included in the input/output interface 145 illustrated in FIG. 1 .
- the audio module 280 processes sound information input or output through the speaker 282 , the receiver 284 , the earphone 286 , or the microphone 288 .
- the camera module 291 is, for example, a device capable of capturing a still image or a moving image, and according to an embodiment, may include one or more image sensors (e.g., a front sensor or a rear sensor), a lens, an image signal processor (ISP), or a flash (e.g., an LED, a xenon lamp, etc.).
- the camera module 291 may include a plurality of cameras which may include an infrared camera, a motion recognition low-power camera, and so forth.
- the power management module 295 manages power of the electronic device 201 .
- the power management module 295 may include a power management integrated circuit (PMIC), a charger IC, or a battery fuel gauge.
- the PMIC may have a wired and/or wireless charging scheme.
- the wireless charging scheme includes a magnetic-resonance type, a magnetic induction type, and an electromagnetic type, and for wireless charging, an additional circuit, for example, a coil loop, a resonance circuit, or a rectifier may be further included.
- the battery gauge measures the remaining capacity of the battery 296 or the voltage, current, or temperature of the battery 296 during charging.
- the battery 296 may include a rechargeable battery and/or a solar battery.
- the indicator 297 displays a particular state, for example, a booting state, a message state, or a charging state, of the electronic device 201 or a part thereof (e.g., the processor 210 ).
- the motor 298 converts an electric signal into mechanical vibration or generates vibration or a haptic effect.
- the electronic device 201 may include a processing device (e.g., a GPU) for supporting a mobile TV.
- the processing device for supporting the mobile TV processes media data according to, a standard such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or MediaFlo®.
- DMB digital multimedia broadcasting
- DVD digital video broadcasting
- MediaFlo® MediaFlo®
- each of the foregoing elements described herein may be configured with one or more components, names of which may vary with a type of the electronic device.
- the electronic device may include at least one of the foregoing elements, some of which may be omitted or to which other elements may be added.
- some of the elements of the electronic device according to various embodiments may be integrated into one entity to perform functions of the corresponding elements in the same manner as before they are integrated.
- FIG. 3 is a block diagram of a programming module according to various embodiments of the present disclosure.
- a programming module 310 e.g., the program 140
- the OS may include Android®, iOS®, Windows®, Symbian®, Tizen®, or Bada®.
- the programming module 310 may include, for example, a kernel 320 , middleware 330 , an application programming interface (API) 360 , and/or an application 370 . At least a part of the programming module 310 may be preloaded on an electronic device or may be downloaded from an external device (e.g., the external device 102 or 104 or the server 106 ).
- API application programming interface
- the kernel 320 may, for example, include a system resource manager 321 and/or a device driver 323 .
- the system resource manager 321 may perform control, allocation, retrieval of system resources, and so forth.
- the system resource manager 321 may include a process management unit, a memory management unit, or a file system management unit.
- the device driver 323 may include, for example, a display driver, a camera driver, a Bluetooth® driver, a shared memory driver, a USB driver, a keypad driver, a WiFi driver, an audio driver, or an inter-process communication (IPC) driver.
- IPC inter-process communication
- the middleware 330 may include provide functions that the application 370 commonly requires or provide various functions to the application 370 through the API 360 to allow the application 370 to efficiently use a limited system resource in an electronic device.
- the middleware 330 e.g., the middleware 143
- the middleware 330 may include at least one of a runtime library 335 , an application manager 341 , a window manager 342 , a multimedia manager 343 , a resource manager 344 , a power manager 345 , a database manager 346 , a package manager 347 , a connectivity manager 348 , a notification manager 349 , a location manager 350 , a graphic manager 351 , and a security manager 352 .
- the runtime library 335 may include a library module that a compiler uses to add a new function through a programming language while the application 370 is executed.
- the runtime library 335 performs functions relating to an input/output, memory management, or calculation operation.
- the application manager 341 manages a life cycle of at least one application among the applications 370 .
- the window manager 342 manages a GUI resource using a screen.
- the multimedia manager 343 recognizes a format necessary for playing various media files and performs encoding or decoding on a media file by using a codec appropriate for a corresponding format.
- the resource manager 344 manages a resource such as source code, memory, or storage space of at least one application among the applications 370 .
- the power manager 345 manages a battery or power, for example, in operation with a basic input/output system (BIOS) and provides power information necessary for an operation of the electronic device.
- the database manager 346 performs a management operation to generate, search or change a database used for at least one application among the applications 370 .
- the package manager 347 manages the installation or update of an application distributed in a package file format.
- the connectivity manager 348 manages a wireless connection such as a WiFi or Bluetooth® connection.
- the notification manager 349 displays or notifies events such as arrival messages, appointments, and proximity alerts in a manner that is not disruptive to a user.
- the location manager 350 manages location information of an electronic device.
- the graphic manager 351 manages a graphic effect to be provided to a user or a user interface relating thereto.
- the security manager 352 provides a general security function necessary for system security or user authentication. According to an embodiment, if the electronic device (e.g., the electronic device 101 ) has a call function, the middleware 330 may further include a telephony manager for managing a voice or video call function of the electronic device.
- the middleware 330 may include a middleware module forming a combination of various functions of the above-mentioned internal elements.
- the middleware 330 may provide modules specified according to types of OS so as to provide distinctive functions. Additionally, the middleware 330 may delete some of existing elements or add new elements dynamically.
- the API 360 may be provided as a set of API programming functions with a different configuration according to the OS.
- the API set may be provided by each platform, and in the case of Tizen®, two or more API sets may be provided.
- the application 370 may include one or more applications capable of providing a function, for example, a home application 371 , a dialer application 372 , a short messaging service/multimedia messaging service (SMS/MMS) application 373 , an instant message (IM) application 374 , a browser application 375 , a camera application 376 , an alarm application 377 , a contact application 378 , a voice dial application 379 , an e-mail application 380 , a calendar application 381 , a media player application 382 , an album application 383 , a clock application 384 , a health care application (e.g., an application for measuring an exercise amount, a blood sugar, etc.), or an environment information providing application (e.g., an application for providing air pressure, humidity, or temperature information or the like).
- a health care application e.g., an application for measuring an exercise amount, a blood sugar, etc.
- an environment information providing application e.g., an application for providing air pressure
- the application 370 may include an application (hereinafter, an “information exchange application” for convenience) supporting information exchange between the electronic device (e.g., the electronic device 101 ) and an external electronic device (e.g., the electronic device 102 or 104 ).
- the information exchange application may include, for example, a notification relay application for transferring specific information to the external electronic device or a device management application for managing the external electronic device.
- the notification relay application may include a function for transferring notification information generated in another application (e.g., an SMS/MMS application, an e-mail application, a health care application, or an environment information application) of the electronic device to an external electronic device (e.g., the electronic device 102 or 104 ).
- the notification relay application may receive notification information from an external electronic device to provide the same to a user.
- the device management application may manage (e.g., install, remove, or update) at least one function (e.g., turn on/turn off of an external electronic device itself (or a part thereof) or control of brightness (or resolution) of a display) of an external device (e.g., the electronic device 102 or 104 ) communicating with the electronic device, a service provided by an application operating in an external electronic device or provided by the external electronic device (e.g., a call service or a message service).
- a function e.g., turn on/turn off of an external electronic device itself (or a part thereof) or control of brightness (or resolution) of a display
- an external device e.g., the electronic device 102 or 104
- a service provided by an application operating in an external electronic device or provided by the external electronic device e.g., a call service or a message service.
- the application 37 may include an application (e.g., device health care application of mobile medical equipment) designated according to an attribute of the external electronic device (e.g., the electronic device 102 or 104 ).
- the application 37 may include an application received from the external electronic device (e.g., the server 106 or the electronic device 102 or 104 ).
- the application 370 may include a preloaded application or a third party application that may be downloaded from the server. Names of elements of the programming module 310 according to the illustrated embodiment may vary depending on a type of an OS.
- At least a part of the programming module 310 may be implemented by software, firmware, hardware, or a combination of at least two of them.
- the at least a part of the programming module 310 may be implemented (e.g., executed) by a processor (e.g., the processor 210 ).
- the at least a part of the programming module 310 may include, for example, modules, programs, routines, sets of instructions, or processes for performing one or more functions.
- an electronic device includes a plurality of sensors and a processor, in which the processor determines a proximity state of an external object with respect to the electronic device, which indicates whether the external object exists around the electronic device, by using a first sensor set from among the plurality of sensors, determines a detailed proximity state of the external object with respect to the electronic device, which indicates whether the external object exists in a proximity region of the electronic device, by using a second sensor set from among the plurality of sensors if the external object is in a first proximity state with respect to the electronic device, and determines a detailed proximity state of the external object with respect to the electronic device by using a third sensor set from among the plurality of sensors if the external object is in a second proximity state with respect to the electronic device.
- an electronic device includes a plurality of sensors and a processor, in which the processor determines a proximity state of an external object with respect to the electronic device, which indicates whether the external object exists around the electronic device, by using at least one of the plurality of sensors in a first mode, determines a detailed proximity state of the external object with respect to the electronic device, which indicates whether the external object exists in a proximity region of the electronic device, by using the at least one sensor in a second mode if the external object is in a first proximity state with respect to the electronic device, and determines a detailed proximity state of the external object with respect to the electronic device by using the at least one sensor in a third mode if the external object is in a second proximity state with respect to the electronic device.
- FIG. 4 is a flowchart of a method for determining proximity of an external object by using at least one sensor according to various embodiments of the present disclosure. According to various embodiments, operations 400 to 430 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 determines the proximity state of the external object by using the first sensor set in operation 400 . For example, by using at least one of the camera module 291 , the microphone 288 , the antenna (not shown), and the acceleration sensor 240 E, the proximity state of the external object may be determined.
- the electronic device 201 determines whether the determined proximity state is the first proximity state or the second proximity state, performs operation 420 if the determined proximity state is the first proximity state, and performs operation 430 if the determined proximity state is the second proximity state.
- the first proximity state or the second proximity state may include a distance to the external object, the number of external objects, a type of the external object, and so forth.
- the distance to the external object may include a distance in the first proximity region (e.g., 2 meters, etc.) of the external object, the second proximity region (e.g., 1 meter, etc.) of the external object, a hovering sensing region of the external object, contact of the external object and so forth.
- the number of external objects may be equal to or greater than 1.
- the types of the external object may include a user or an electronic device, a recognizable user or unrecognizable user, a recognizable device or unrecognizable device, and so forth.
- the first proximity state may mean a state in which a specific user or person is located in the first proximity region and the second proximity state may mean a state in which the specific user contacts the electronic device 201 .
- the electronic device 201 determines a detailed proximity state of the external object by using the second sensor set. For example, if the specific user is located in the first proximity region, the electronic device 201 may determine whether a face is recognized in a specific region in a scene obtained using the camera module 291 and determine that the user is in proximity to the electronic device 201 to use a function of the electronic device 201 if a face of the user is recognized.
- the electronic device 201 determines detailed proximity of the external object based on a shake of the electronic device 201 measured using the acceleration sensor 240 E, and determines that the user is in proximity to the electronic device 201 to use a function of the electronic device 201 if a voice of the user is recognized using at least one microphone 288 .
- the electronic device 201 determines a detailed proximity state of the external object by using the third sensor set. For example, if the specific user contacts the electronic device 201 , the electronic device 201 senses a holding form by using the display 260 and determines that the user holds the electronic device 201 by hand to use a function of the electronic device 201 corresponding to the sensed holding form.
- FIG. 5 is a flowchart of a method for determining proximity of an external object by using at least one sensor in a plurality of modes according to various embodiments of the present disclosure.
- operations 500 to 530 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 determines a proximity state of the external object by using at least one sensor in the first mode. For example, the electronic device 201 analyzes an impulse signal input through one microphone to determine a location and a type of the external object and the number of external objects.
- the electronic device 201 determines whether the determined proximity state is the first proximity state or the second proximity state, performs operation 520 if the determined proximity state is the first proximity state, and performs operation 530 if the determined proximity state is the second proximity state.
- the electronic device 201 may analyze an impulse signal input through one microphone to determine whether the external object is located in the first proximity region or in the second proximity region or contacts the electronic device 201 .
- the electronic device 201 determines a detailed proximity state of the external object by using at least one sensor in the second mode. For example, the electronic device 201 may determine whether the external object is located in the second proximity region, based on an input time difference between a plurality of impulse signals input through a plurality of microphones, if the external object is located in the first proximity region.
- the electronic device 201 determines a detailed proximity state of the external object by using at least one sensor in the third mode. For example, the electronic device 201 may perform iris or face recognition by using the camera module 291 if the external object is located in the second proximity region to determine whether the user is in the third proximity region in which the user may hold the electronic device 201 by hand.
- FIG. 6 is a flowchart of a method for performing operations based on proximity of an external object by using at least one sensor according to various embodiments of the present disclosure.
- operations 600 to 650 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 senses first proximity of the external object by using the first sensor set among the plurality of sensors. For example, the electronic device 201 may determine whether the external object is located in the first proximity region, by using the microphone 288 , the camera module 291 , the antenna (not shown), the acceleration sensor 240 E, and so forth.
- the electronic device 201 determines context information of the electronic device 201 to determine the second sensor set among the plurality of sensors. For example, the electronic device 201 may determine location information, orientation state information, time information, and schedule information of the electronic device 201 to determine at least one of the display 260 and the camera module 291 as the second sensor set for sensing the second proximity of the external object.
- the electronic device 201 senses second proximity of the external object by using the determined second sensor set.
- the second proximity may include a case where the external object is located in the second proximity region or in a hovering sensing region or contacts the electronic device 201 .
- the electronic device 201 may determine whether the external object is located in the second proximity region by using a sensor pixel included in the display 260 . For example, if the determined second sensor set includes the camera module 291 , the electronic device 201 may recognize the external object in the scene input through the camera to determine whether the external object is located in the second proximity region.
- the electronic device 201 determines the third sensor set among the plurality of sensors based on the sensed second proximity. According to an embodiment, if the external object is located in the second proximity region, the electronic device 201 senses detailed proximity of the external object to determine the third sensor set for determining proximity intention of the external object. For example, the electronic device 201 may determine at least one of the camera module 291 for iris recognition or face recognition, the input device 250 or the display 260 for sensing a form of holding the external object, the grip sensor 240 E, and the proximity sensor 240 f as the third sensor set for determining proximity intention of the external object.
- the electronic device 201 determines proximity intention of the external object by using the determined third sensor set. According to an embodiment, the electronic device 201 determines whether the external object contacts the electronic device 201 and determines whether the proximity intention of the external object is for using a function of the electronic device 201 . For example, if the iris or face is recognized using the camera module 291 , the electronic device 201 may determine that the proximity intention of the external object is for user authentication.
- the electronic device 201 may determine that the proximity intention of the external object is for using a clock function, a call function, a message function, a photographing function, a music listening function, or the like.
- the electronic device 201 performs a function of the electronic device 201 corresponding to the determined proximity intention. For example, if the iris or face is recognized, the electronic device 201 may perform user authentication according to whether the recognized iris or face matches a user's iris or face. For example, according to whether the sensed holding form matches preset holding forms, the electronic device 201 may perform a function of the electronic device 201 that is set corresponding to the matching holding form.
- FIG. 7 is a flowchart of a method for performing operations based on proximity of an external object by using at least one sensing method according to various embodiments of the present disclosure.
- operations 700 to 750 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 senses first proximity of the external object by using the first sensing method. For example, the electronic device 201 may receive an impulse signal with respect to an external object by using one microphone, analyze the received impulse signal, and determine that the external object is located in the first proximity region if the received impulse signal is a waveform over a specific sound pressure, a pattern that is the same as a preset threshold pattern, or an impulse signal over a predetermined number of times.
- the electronic device 201 determines the context information of the electronic device 201 to determine the second sensing method. For example, if the orientation of the electronic device 201 is less than a threshold orientation value, the electronic device 201 may determine that the electronic device 201 is placed in a particular location and determine a sensing method using a plurality of microphones as the second sensing method.
- the electronic device 201 senses second proximity of the external object by using the determined second sensing method.
- the electronic device 201 may analyze impulse signals input through a plurality of microphones and determine a location or moving path of the external object by using an input time difference between times when the impulse signals are input.
- the electronic device 201 determines the third sensing method for determining proximity intention of the external object based on the sensed second proximity.
- the electronic device 201 senses detailed proximity (e.g., contact or hovering of the external object) to determine the proximity intention, if the location of the external object is in the second proximity region.
- the electronic device 201 may sense the detailed proximity of the external object by using one or two or more sensors.
- the electronic device 201 may determine iris recognition or face recognition using the camera module 291 as the third sensing method to sense the detailed proximity of the external object. For example, the electronic device 201 may also determine a method of using the touch panel 262 for sensing a holding form of the external object as well as the camera module 291 as the third sensing method.
- the electronic device 201 determines proximity intention of the external object by using the determined third sensing method. For example, if the iris or face is recognized in a scene input through the camera module 291 , the electronic device 201 may determine that the proximity intention of the external object is for user authentication. For example,
- the electronic device 201 performs a function of the electronic device 201 corresponding to the determined proximity intention. For example, the electronic device 201 may perform user authentication with respect to the external object based on the recognized iris or face.
- the above-described methods for sensing the external object are not limited to methods for sensing the first proximity and methods for sensing second proximity, and the methods for sensing the first proximity may be used for sensing the second proximity or vice versa.
- a method for operating an electronic device includes sensing first proximity of an external object with respect to the electronic device by using a first sensor included in the electronic device, determining a second sensor by using context information of the electronic device, sensing second proximity of the external object with respect to the electronic device by using the determined second sensor, and performing a function of the electronic device based on the sensed second proximity.
- FIGS. 8A, 8B and 8C illustrate examples for describing an operation of sensing proximity of an external object and unlocking a lock screen according to various embodiments of the present disclosure.
- the electronic device 201 switches to an active mode to display a lock screen on the display 260 and performs user authentication using face or iris recognition, contact, grip, or the like to display an unlock screen.
- the sleep mode may mean a state where the electronic device 201 supplies power only to components for performing minimum operations and does not supply power to the other components.
- the active mode may mean a state where the power is supplied to every component of the electronic device 201 .
- the electronic device 201 determines whether a user 800 is situated in a first proximity region 810 by using the first sensor set. If the user 800 is situated in the first proximity region 810 , the electronic device 201 determines the second sensor set for sensing the second proximity of the user 800 and determines whether the user 800 is situated in a second proximity region 820 by using the determined second sensor set.
- the electronic device 201 may determine whether the user 800 is situated in the first proximity region 810 by using a first camera. If the user 800 is situated in the first proximity region 810 , the electronic device 201 determines a location of the user 800 by using the first camera to determine whether the user 800 is situated in a second proximity region 820 . If the user 800 is situated in the second proximity region 820 , the electronic device 201 recognizes an iris or face of the user 800 by using a second camera to perform user authentication. If the recognized user 800 is identified as a registered user of the electronic device 201 , the electronic device 201 unlocks the lock screen to display a background screen of the electronic device 201 on the display 260 as shown in FIG. 8C .
- the electronic device 201 determines whether the user 800 is in a region for iris recognition and performs iris authentication by driving the second camera if the user 800 is situated in the region for iris recognition. If the user 800 is not situated in the region for iris recognition, the electronic device 201 may not drive the second camera.
- the electronic device 201 may sense whether the user 800 is situated in the second proximity region 820 , and if a touch on the electronic device 201 is sensed using the touch panel 252 , the gyro sensor 240 B, the acceleration sensor 240 E, or the like, the electronic device 201 may unlock the lock screen to display the background screen of the electronic device 201 on the display 260 as shown in FIG. 8C .
- the electronic device 201 determines information such as a grip form of the user 800 with respect to the electronic device 201 , a posture of the electronic device 201 , and a gaze of the user 800 , and in response to determining that the proximity of the user 800 is for using the electronic device 201 , the electronic device 201 may unlock the lock screen.
- FIG. 9 is a flowchart of a method for determining first proximity of an external object by using a microphone according to various embodiments of the present disclosure. According to various embodiments, operations 900 to 930 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 receives the first audio signal from the microphone 288 .
- the first audio signal may be an audio signal including footstep sound with respect to at least one user.
- the electronic device 201 analyzes the received audio signal to determine whether the received first audio signal is the first proximity signal.
- the electronic device 201 performs operation 930 if the first audio signal is the first proximity signal and terminates an operation if the first audio signal is not the first proximity signal.
- the electronic device 201 analyzes the first audio signal by using a filter designed based on analysis of frequency characteristics of the footstep sound and detects the footstep sound among various surrounding sounds. The electronic device 201 determines whether the audio signal corresponding to the detected footstep sound is a waveform over a specific sound pressure stored in the memory 230 , an identical pattern, or an impulse signal over a predetermined number of times, and determines proximity of the external object if the audio signal is a waveform over the specific sound pressure, the identical pattern, or the impulse signal over the predetermined number of times. This will be described in detail below with reference to FIG. 10 .
- FIGS. 10A and 10B illustrate examples for describing impulse signals according to various embodiments of the present disclosure.
- an impulse signal corresponding to user's footstep sound may be illustrated as shown in FIG. 10A
- an impulse signal corresponding to the footstep sound of the user approaching the electronic device 201 may be illustrated as shown in FIG. 10B . If the audio signal corresponding to the footstep sound matches the impulse signal shown in FIG. 10B , the electronic device 201 determines the first audio signal as the first proximity signal.
- the electronic device 201 determines the first proximity of the external object. For example, if the audio signal corresponding to the footstep sound matches the impulse signal shown in FIG. 10B , the electronic device 201 determines that the external object is located in the first proximity region.
- FIG. 11 is a flowchart of a method for determining first proximity of an external object by using an antenna according to various embodiments of the present disclosure. According to various embodiments, operations 1100 to 1130 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 senses a change of a neighboring broadcast signal or cellular signal, which occurs when the external object is in proximity to the electronic device 201 , and compares the sensed signal change with a unique signal change corresponding to proximity to sense the proximity of the external object. For example, a method for recognizing proximity of the external object by using the cellular signal or the like, which may sense a change of a signal from a received signal strength indicator (RSSI), a channel quality indicator (CQI), etc., by using the communication module 220 included in the electronic device 201 .
- RSSI received signal strength indicator
- CQI channel quality indicator
- the electronic device 201 receives a radio frequency (RF) signal via an antenna.
- RF radio frequency
- the electronic device 201 analyzes the received RF signal to determine an amplitude variation quantity.
- the electronic device 201 determines whether the determined amplitude variation quantity is greater than or equal to a threshold variation quantity. If the amplitude variation quantity is greater than or equal to the threshold variation quantity, the electronic device 201 performs operation 1130 ; otherwise, if the amplitude variation quantity is less than the threshold variation quantity, the electronic device 201 terminates an operation.
- the electronic device 201 determines the first proximity of the external object. For example, the electronic device 201 may determine that the external object is located in the first proximity region if the amplitude variation quantity is greater than or equal to the threshold variation.
- FIG. 12 is a structural diagram of an antenna module according to various embodiments of the present disclosure.
- the antenna module 120 may include an amplitude variation measurer 1210 and an analog-to-digital (A/D) converter 1220 in an antenna I/O stage 1200 thereof.
- A/D analog-to-digital
- the amplitude variation measurer 1210 may include a plurality of detectors for detecting an amplitude variation quantity of an analog signal input from the antenna I/O stage 1200 .
- the amplitude variation measurer 1210 may include an envelope detector.
- the A/D converter 1220 converts the detected amplitude variation quantity into a digital signal and outputs the digital signal to the processor 210 .
- the processor 210 compares the input digital signal with a pattern of a signal stored in the memory 230 . If the input digital signal matches the stored signal pattern, the processor 210 determines that the external object is in the first proximity region.
- FIG. 13 is a flowchart of a method for determining first proximity of an external object by using an acceleration sensor according to various embodiments of the present disclosure. According to various embodiments, operations 1300 to 1320 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 measures a vibration quantity of the electronic device 201 by using the acceleration sensor 240 E.
- the acceleration sensor 240 E may be a trip-axis acceleration sensor of an x axis, a y axis, and a z axis.
- the acceleration sensor 240 E may further include a vibration monitoring module therein to monitor nearby proximity vibration.
- the electronic device 201 monitors the nearby proximity vibration by using some of the three axes of the acceleration sensor 240 E to reduce current consumption of the electronic device 201 .
- the electronic device 201 determines whether the measured vibration quantity is greater than or equal to a threshold vibration quantity. If the vibration quantity is greater than or equal to a threshold variation quantity, the electronic device 201 performs operation 1320 ; otherwise, if the vibration quantity is less than the threshold vibration quantity, the electronic device 201 terminates an operation.
- the electronic device 201 determines the first proximity of the external object. For example, the electronic device 201 may determine that the external object is located in the first proximity region if the measured vibration quantity is greater than or equal to the threshold vibration quantity.
- the electronic device 201 monitors a proximity vibration quantity by using the acceleration sensor 240 E and switches the processor 210 to the sleep mode if a proximity vibration quantity over the threshold vibration quantity is measured.
- the electronic device 201 selects some of the three axes of the acceleration sensor 240 E and monitors the proximity vibration quantity by using the selected axes. For example, the electronic device 201 turns off a high-pass filter included in the acceleration sensor 240 E to determine an orientation of the electronic device 201 and selects some axes for monitoring based on the determined orientation. Once some axes are selected, the electronic device 201 turns on the high-pass filter included in the acceleration sensor 240 E and monitors the vibration quantity. Some of the three axes may be turned on or off by selection of the processor 210 or may be selected when the acceleration sensor 240 E starts measuring the vibration quantity.
- the electronic device 201 measures proximity vibration by turning off a particular filter of the acceleration sensor 240 E and using a method for reducing a sampling rate to monitor low-power proximity vibration, and if the proximity vibration is sensed, the electronic device 201 performs monitoring by turning on the particular filter or increasing the sampling rate.
- FIG. 14 is a flowchart of a method for determining first proximity of an external object by using a camera module according to various embodiments of the present disclosure.
- operations 1400 to 1420 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the camera module 291 may include a first camera.
- the electronic device 201 receives a first scene from the first camera.
- the electronic device 201 determines whether the external object is recognized in a specific region in the received first scene, and performs operation 1420 if the external object is recognized in the specific region and terminates an operation if the external object is not recognized in the specific region.
- the electronic device 201 determines the first proximity of the external object. For example, the electronic device 201 may determine that the external object is located in the first proximity region if the external object is recognized in the specific region.
- FIGS. 15A and 15B illustrate examples for describing a method for determining first proximity of an external object by using a front camera according to various embodiments of the present disclosure.
- the electronic device 201 may include two cameras (e.g., a first camera 1500 and a second camera 1510 ) on a front top end portion and analyzes the first scene input through the first camera 1500 to determine whether an external object 1520 is located in a first proximity region 1530 as shown in FIG. 15B .
- the first camera 1500 may have a wider viewing angle than the second camera 1510 .
- the electronic device 201 determines whether the external object is in proximity to the electronic device 201 by using at least one sensor with low power and determines detailed proximity of the external object by using at least one sensor to improve proximity accuracy after the first proximity.
- FIG. 16 is a flowchart of a method for determining second proximity of an external object by using a display according to various embodiments of the present disclosure. According to various embodiments, operations 1600 to 1630 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 determines whether the external object is located in the second proximity region to use the electronic device 201 .
- the electronic device 201 receives a light-receiving signal through the display 260 .
- the panel 262 of the display 260 may include a sensor-in-pixel including RGB pixels and sensing pixels for receiving the light-receiving signal.
- the electronic device 201 analyzes the received light-receiving signal to determine whether the external object is in proximity. For example, the electronic device 201 may determine whether a received light-receiving quantity is less than a preset threshold light-receiving quantity.
- the electronic device 201 performs operation 1630 if determining that the external object is in proximity and terminates an operation if determining that the external object is not in proximity. For example, if the received light-receiving quantity is less than the threshold light-receiving quantity, the electronic device 201 may determine that the external object is in proximity and perform operation 1620 ; otherwise, if the received light-receiving quantity is greater than or equal to the threshold light-receiving quantity, the electronic device 201 may determine that the external object is not in proximity and terminate operations.
- the electronic device 201 determines the second proximity of the external object. For example, the electronic device 201 may determine that the external object is located in the second proximity region if the received light-receiving quantity is less than the threshold light-receiving quantity.
- FIGS. 17A and 17B illustrate examples for describing a method for determining second proximity of an external object by using a display according to various embodiments of the present disclosure.
- the electronic device 201 may further include a front display 1700 and side displays 1701 and 1702 on both sides of the front display 1700 , and the front display 1700 and the side displays 1701 and 1702 may include sensors in pixel.
- the side display 1701 may include an RGB pixel 1710 and a sensing pixel 1720 .
- the sensing pixel 1720 receives a nearby light-receiving signal, measures a light-receiving quantity, generates an image pattern corresponding to the measured light-receiving quantity, and senses proximity or motion (e.g., a form of holding the electronic device 201 by the user) according to the generated image pattern.
- the sensing pixel 1720 may be driven independently of a light-emitting pixel (e.g., RGB pixels). For example, if the front display 1700 and the side displays 1701 and 1702 are turned off, the electronic device 201 may analyze a light-receiving signal input through a sensing pixel and measure a light-receiving quantity.
- a light-emitting pixel e.g., RGB pixels
- the electronic device 201 may receive a light-receiving signal not only from a first region 1730 through the front display 1700 but also from second regions 1740 - 1 and 1740 - 2 through the side displays 1701 and 1702 as shown in FIG. 17B .
- FIG. 18 is a flowchart of a method for determining second proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure. According to various embodiments, operations 1800 to 1830 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 receives a second audio signal set through a plurality of microphones.
- the plurality of microphones may include three microphones from which three audio signals may be received respectively.
- the electronic device 201 analyzes the received second audio signal set to determine a location of the external object. For example, a proximity impulse signal may be extracted by analyzing three audio signals and a location of the external object may be determined based on the extracted proximity impulse signal.
- the electronic device 201 determines whether the measured location of the external object is included in a specific region; if determining that the location of the external object is included in the specific region, the electronic device 201 performs operation 1830 and otherwise, if determining that the location of the external object is not included in the specific region, the electronic device 201 terminates an operation.
- the electronic device 201 determines the second proximity of the external object. For example, the electronic device 201 may determine that the external object is located in the second proximity region to use the electronic device 201 if the measured location of the external object is included in a specific region.
- FIGS. 19A and 19B illustrate examples for describing a method for determining second proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure.
- the electronic device 201 may include a first microphone 1901 , a second microphone 1902 , and a third microphone 1903 . If a user 1900 approaches the electronic device 201 , the electronic device 201 receives the first audio signal corresponding to proximity of the user 1900 through the first microphone 1901 , receives the second audio signal through the second microphone 1902 , and receives the third audio signal through the third microphone 1903 . The electronic device 201 analyzes the received first audio signal, second audio signal, and third audio signal to extract an impulse signal corresponding to footstep sound.
- the first audio signal input to the first microphone 1901 , the second audio signal input to the second microphone 1902 , and the third audio signal input through the third microphone 1903 may have differences in reception times therebetween.
- the electronic device 201 may calculate a location of the user 1900 (e.g., a location of a specific distance in a 12 o'clock direction, a location of a specific distance in a 3 o'clock direction, a moving path of the user 1900 , etc.) by using a reception time difference between impulse signals corresponding to footstep sound of an audio signal received through each microphone.
- FIG. 20 is a flowchart of a method for determining proximity intention of an external object based on iris recognition by using a camera module according to various embodiments of the present disclosure.
- operations 2000 to 2020 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 obtains an image through the camera module 291 .
- the electronic device 201 determines whether an iris is recognized in a specific region in the obtained image, and performs operation 2020 if the iris is recognized in the specific region and terminates an operation if the iris is not recognized in the specific region.
- the electronic device 201 performs user authentication based on iris recognition. For example, if the iris is recognized, the electronic device 201 may determine that the proximity intention of the external object is for user authentication. The electronic device 201 compares the recognized iris pattern with a previously stored iris pattern and if the recognized iris pattern matches the previously stored iris pattern, the electronic device 201 recognizes the external object as the user of the electronic device 201 .
- FIGS. 21A and 21B illustrate examples for describing a method for determining proximity intention of an external object by using a camera module according to various embodiments of the present disclosure.
- the electronic device 201 may include the camera module 291 for iris authentication.
- the camera module 291 may include a lens 2102 , a bandpass filter 2103 , and an image sensor 3104 , and may further include an infrared emitting diode (IRED) 2105 and an LED driver (not shown).
- IRED infrared emitting diode
- the lens 2102 receives a light signal corresponding to an iris 2101 of a user eye 2100 and the received light signal passes through the bandpass filter 2103 . If the light signal having a wavelength in a specific band is input to the image sensor 2104 , the image sensor 2104 converts the light signal into a digital signal.
- the IRED 2105 emits light having a specific wavelength under control of the LED driver, and thus reflected light is input through the camera module 291 .
- the IRED 2105 may include an IRED capable of emitting light of continuous waves or an IRED capable of emitting light as pulses in synchronization with an input frame of an image sensor.
- the bandpass filter 2103 outputs a light signal having a wavelength range including at least a part of a specific wavelength range emitted through the IRED 2105 .
- the bandpass filter 2103 selectively passes the light of the wavelength range emitted from the IRED 2105 by using a filter passing the light signal of the wavelength range of about 850 nm+/ ⁇ 50 nm including a center wavelength range of the IRED 2105 .
- the camera module 291 performs operations for iris recognition without malfunction due to light of nearby another IR wavelength range.
- the electronic device 201 may further include an iris recognition camera 2110 for iris recognition in addition to a front camera 2111 to perform iris recognition by using an image 2113 captured through the iris recognition camera 2110 instead of an image 2112 captured through the front camera 2111 .
- an iris recognition camera 2110 for iris recognition in addition to a front camera 2111 to perform iris recognition by using an image 2113 captured through the iris recognition camera 2110 instead of an image 2112 captured through the front camera 2111 .
- FIG. 22 is a flowchart of a method for determining proximity intention of an external object based on face recognition by using a camera module according to various embodiments of the present disclosure. According to various embodiments, operations 2200 to 2220 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 obtains an image through the camera module 291 .
- the electronic device 201 determines whether a face is recognized in a specific region in the obtained image, and performs operation 2220 if the face is recognized in the specific region and terminates an operation if the face is not recognized in the specific region.
- the electronic device 201 performs user authentication based on face recognition. For example, if the face is recognized, the electronic device 201 may determine that the proximity intention of the external object is for user authentication. The electronic device 201 extracts characteristics of the recognized face and compares the extracted characteristics of the face with previously stored face characteristics and if the characteristics match each other, the electronic device 201 recognizes the external object as the user of the electronic device 201 .
- FIG. 23 is a flowchart of a method for determining proximity intention of an external object by using a touch panel according to various embodiments of the present disclosure. According to various embodiments, operations 2300 to 2350 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 determines whether a touch of the external object is sensed through the touch panel 252 .
- the electronic device 201 performs operation 2320 if sensing the touch of the external object and terminates an operation if sensing no touch of the external object.
- the electronic device 201 senses a touch form of the external object.
- the electronic device 201 may sense a holding form in which a user's hand contacts the electronic device 201 by using the touch panel 252 , a contact sensor (not shown), the grip sensor 240 F, or the like.
- the electronic device 201 may sense the holding form based on proximity information regarding the user's body part.
- the electronic device 201 determines whether the sensed touch form matches a preset touch form. If the sensed touch form matches the preset touch form, the electronic device 201 performs operation 2340 ; otherwise, if the sensed touch form does not match the preset touch form, the electronic device 201 performs operation 2350 .
- the electronic device 201 may compare the sensed touch form with a touch form modeled using a plurality of sensors to determine proximity of the external object as proximity for using a function of the electronic device 201 based on whether the sensed touch form matches the modeled touch form.
- the electronic device 201 compares the sensed touch form with the touch form modeled using the plurality of sensors and determines that the sensed touch form matches the modeled touch form if a difference between the touch forms is less than a threshold value.
- the electronic device 201 performs a function of the electronic device 201 , which is set corresponding to the matching touch form. For example, if the touch form corresponds to a call function, the electronic device 201 provides a user interface (UI) for performing the call function of the electronic device 201 .
- UI user interface
- the electronic device 201 performs a preset function thereof.
- the electronic device 201 may compare the sensed touch form with a touch form modeled using a plurality of sensors to determine that the proximity of the external object is not the proximity for using a function of the electronic device 201 if the sensed touch form does not match the modeled touch form. In this case, the electronic device 201 switches to the sleep mode to reduce current consumption.
- FIGS. 24A, 24B, 24C, 24D and 24E illustrate examples for describing a method for performing a function of an electronic device in association with proximity of an external object by using a touch panel according to various embodiments of the present disclosure.
- the electronic device 201 senses the touch form of the external object by using the touch panel 252 , a bezel portion of the electronic device 201 , a touch sensor (not shown) on a rear surface of the electronic device 201 , the proximity sensor 240 G, the grip sensor 240 F, or the like.
- the electronic device 201 determines that a proximity intention of the external object is for using a function of the electronic device 201 , and if the function of the electronic device 201 being set corresponding to the touch form is a clock function, a user interface for performing the clock function may be provided.
- the electronic device 201 determines that the proximity intention of the external object is for using a function of the electronic device 201 , and if the function of the electronic device 201 being set corresponding to the touch form is a call function, a user interface for performing the call function may be provided.
- the electronic device 201 determines that the proximity intention of the external object is for using a function of the electronic device 201 , and if the function of the electronic device 201 being set corresponding to the touch form is a message transmission/reception function, a user interface for performing the message transmission/reception function may be provided.
- the electronic device 201 determines that the proximity intention of the external object is for using a function of the electronic device 201 , and if the function of the electronic device 201 being set corresponding to the touch form is a photographing function, a user interface for performing the photographing function may be provided.
- the electronic device 201 determines that the proximity intention of the external object is for using a function of the electronic device 201 , and if the function of the electronic device 201 being set corresponding to the touch form is a music play function, a user interface for performing the music play function may be provided.
- FIG. 25 is a flowchart of a method for performing a function of an electronic device in association with proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure.
- operations 2500 to 2520 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 analyzes a plurality of audio signal sets input through a plurality of microphones. For example, the electronic device 201 may analyze each of the plurality of audio signal sets to extract audio signals corresponding to footstep sound and analyze the extracted audio signals.
- the electronic device 201 a proximity direction of the external device.
- the electronic device 201 may analyze the extracted audio signals to calculate an input time difference between the extracted audio signals and determine the proximity direction of the external object by using the calculated input time difference.
- the electronic device 201 changes a screen position of the electronic device 201 in correspondence to the determined proximity direction.
- FIGS. 26A and 26B illustrate examples for describing a method for performing a function of an electronic device in association with proximity of an external object by using a plurality of microphones according to various embodiments of the present disclosure.
- the electronic device 201 analyzes respective audio signals input through a plurality of microphones to extract audio signals corresponding to user's footstep sound and senses a magnitude change of the extracted audio signals to determine first proximity of the user.
- the electronic device 201 determines the user's proximity direction based on an input time difference between the extracted audio signals. For example, if a user 2600 moving in a first proximity direction 2602 in a first proximity region 2601 is sensed, the electronic device 201 may change a direction of a screen displayed on the display 260 to correspond to the first proximity direction 2602 .
- the electronic device 201 may change a direction of a screen displayed on the display 260 to correspond to the second proximity direction 2612 .
- the electronic device 201 senses motion of the external object by using the camera module 291 , determines proximity of the external object corresponding to the sensed motion, and determines the proximity direction of the external object.
- the electronic device 201 rotates the screen displayed on the display 260 by 90°, if sensing user's proximity in a vertical side direction of the electronic device 201 in the first proximity region 2602 . If sensing user's proximity upward with respect to the electronic device 201 in the first proximity region 2602 , the electronic device 201 may rotate the screen displayed on the display 260 by 180°. Thus, the electronic device 201 displays the screen on the display 260 in a direction coinciding with a direction in which the user views.
- the electronic device 201 changes a size of the screen and displays the screen on the display 260 according to a proximity distance of the external object. For example, the electronic device 201 may enlarge and display the screen on the display 260 if the user is situated in the first proximity region corresponding to a long distance. If the user is situated in the second proximity region corresponding to a short distance, the electronic device 201 may reduce the size of the screen and display the screen on the display 260 .
- FIG. 27 is a flowchart of a process of sensing proximity of an external object and outputting data corresponding to occurrence of an event according to various embodiments of the present disclosure. According to various embodiments, operations 2700 to 2720 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 in operation 2700 , the electronic device 201 generates a notification corresponding to occurrence of an event and outputs the generated notification. For example, upon receiving a message, the electronic device 201 may generate and output a message reception notification.
- the electronic device 201 determines whether proximity of an external object is sensed within a preset time. If the proximity of the external object is sensed within the preset time, the electronic device 201 performs operation 2720 ; otherwise, if the proximity of the external object is not sensed within the preset time, the electronic device 201 terminates an operation.
- the electronic device 201 outputs data associated with the occurring event.
- the electronic device 201 may monitor proximity of the external object and load and output data (or an application) associated with a message if sensing the proximity of the external object.
- the proximity of the external object may include a case where the external object is located in a proximity region such as the first proximity region, the second proximity region, or a hovering sensing region or contacts the electronic device 201 .
- the electronic device 201 outputs data associated with the occurring event if sensing motion of the external object.
- the user approaching the electronic device 201 does not need to perform an operation for switching to a message screen to read a received message, and thus may immediately check data associated with the message without a delay.
- the electronic device 201 may further request user authentication after determining user's proximity.
- the electronic device may output data associated with a message based on a user's authentication result in response to the authentication request (e.g., log-in, a password, a pattern lock, etc.).
- the electronic device 201 may output the received notification, monitor proximity of the external object, and execute and output an application associated with the game upon sensing the proximity of the external object.
- FIG. 28 is a flowchart of a process of sensing proximity of an external object and outputting data corresponding to context information according to various embodiments of the present disclosure. According to various embodiments, operations 2800 to 2830 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 determines context information regarding the external object. For example, the electronic device 201 may collect context information associated with the user if the user of the electronic device 201 is designated. The context information associated with the user may be determined based on time, location, and motion information regarding the user.
- the electronic device 201 determines at least one data set based on the determined context information. For example, the electronic device 201 may determine a data set to be provided to the user based on the collected context information.
- the electronic device 201 determines whether proximity of an external object is sensed. If the proximity of the external object is sensed, the electronic device 201 performs operation 2830 ; otherwise, if the proximity of the external object is not sensed, the electronic device 201 terminates an operation.
- the electronic device 201 outputs the at least one determined data set.
- the electronic device 201 obtains user's proximity information or motion information by using at least some of a plurality of sensors and determines user's context information by associating the obtained proximity information or motion information with current time and location information.
- the motion information may include a pattern in which the user moves.
- the electronic device 201 may determine that the user is preparing for going to work or going out. For example, if the current time is weekend night time, the user is situated at home, and the motion of the user is less than threshold motion, then the electronic device 201 may determine that the user is sleeping.
- the electronic device 201 determines at least one data set to be provided to the user. If the user's context information indicates preparation for going to work or going out, the electronic device 201 may sense user's proximity and if sensing user's proximity, the electronic device 201 may load and output data (or an application) associated with ‘today weather’ or data (or an application) associated with ‘traffic condition’.
- the user does not need to perform an additional operation for being provided with a proper function or proper information according to a user's condition, such that the user may immediately check associated data without a delay.
- FIG. 29 is a flowchart of a process of sensing proximity of an external object and outputting voice content according to various embodiments of the present disclosure. According to various embodiments, operations 2900 to 2920 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 senses proximity of the external object, outputs voice content if the external object is situated in a proximity region and stops outputting the voice content if the external object is out of the proximity region.
- the electronic device 201 determines voice information to be output.
- the voice content may include news content, weather content, and so forth.
- the electronic device 201 determines whether proximity of an external object is sensed. If the proximity of the external object is sensed, the electronic device 201 performs operation 2920 ; otherwise, if the proximity of the external object is not sensed, the electronic device 201 determines proximity of the external object in operation 2910 .
- the electronic device 201 outputs the determined voice content.
- the electronic device 201 determines voice content to be output to the user and determines user's first proximity or second proximity to output the determined voice content. For example, the electronic device 201 may determine whether the user is situated in the first proximity region or the second proximity region. If sensing the user's first proximity or second proximity, the electronic device 201 plays and outputs the voice content. In another example, the electronic device 201 outputs a voice signal asking user's acceptance or rejection for playing the voice content, and then plays the voice content if receiving a voice signal corresponding to the user's acceptance.
- FIGS. 30A and 30B illustrate examples for describing an operation of sensing proximity of an external object and outputting voice content according to various embodiments of the present disclosure.
- the electronic device 201 if sensing a user 3001 entering a proximity region 3000 , the electronic device 201 outputs a voice signal 3002 asking whether to accept outputting the voice content like “Would you like to listen to the morning briefing?”. If a voice signal indicating acceptance for playing the voice content like “Yes” is input from the user, the electronic device 201 outputs the voice content. If a voice signal 3004 indicating stopping playing the voice content like “for a moment” is input from a user 3003 located in the proximity region 3000 , the electronic device 201 stops outputting the voice content. If a user 3005 is located outside the proximity region 3000 , the electronic device 201 stops playing the voice content and continuously determines whether the user is sensed within the proximity region 3000 .
- the electronic device 201 plays voice content 3011 like “It's a bit cold this morning and the temperature is ⁇ 3 degrees Celsius . . . ”. If a user 3013 is located outside the proximity region 3000 , the electronic device 201 temporarily stops outputting voice content 3012 that has been played like “Traffic condition this morning”. The electronic device 201 continuously determines whether the user is located in the proximity region 3000 , and if sensing a user 3014 again in the proximity region 3000 , the electronic device 201 plays again the stopped voice content and outputs voice content 3015 like “Traffic condition this morning shows the traffic jam on the highways, so we recommend you to use outer roads . . . ”.
- the electronic device 201 if a preset condition is satisfied, the electronic device 201 initializes the camera module 291 and switches the camera module 291 to the sleep mode. If receiving a first input, the electronic device 201 switches the camera module 291 from the sleep mode to an operation mode. For example, if determining that the external object is located within the second proximity region, the electronic device 201 may initialize the camera module 291 and switch the camera module 291 to the sleep mode. If performing user authentication or sensing detailed proximity of the user for determining a proximity intention, the electronic device 201 may switch the camera module 291 from the sleep mode to the operation mode. Thus, the user may use the camera module 291 faster than when an operation for operating the camera module 291 is performed by user's selection.
- the electronic device 201 supplies power to at least a part of the camera module 291 for initializing the camera module 291 .
- the electronic device 201 may deliver at least one of a program for operating at least a part of the camera module 291 and configuration information of the camera module 291 to the at least a part of the camera module 291 .
- the at least a part of the camera module 291 may be switched to an inoperable state to an operable state after the program is executed.
- the electronic device 201 stores a program (e.g., firmware, etc.) for operating at least a part of the camera module to initialize the camera module 291 in an internal memory (e.g., a first memory, a second memory, and/or a third memory) of the camera module.
- a program e.g., firmware, etc.
- the electronic device 201 may deliver a configuration value for the at least a part of the camera module 291 to the at least a part of the camera module 291 or store the configuration value in an internal memory of the camera module 291 .
- the program may apply configuration values to the at least a part of the camera module 291 or generate or correct an image/data associated with the image according to the configuration values.
- the configuration values of the camera module 291 may include at least one of an international standardization organization (ISO) configuration value, a white balance (WB)/AWB configuration value, a frame rate, a capture resolution, a preview resolution, a preview format configuration value, an automatic exposure (AE) configuration value, an autofocus (AF) configuration value, a noise reduction configuration value, a resizing/scaling configuration value, a color space conversion (CSC) configuration value, a gamma correction configuration value, a PAF configuration value, an HDRI configuration value, allocation information of a partial region of a memory for processing an input image, and so forth.
- ISO international standardization organization
- WB white balance
- AWB configuration value a frame rate
- a capture resolution a preview resolution
- a preview format configuration value a preview format configuration value
- AE automatic exposure
- AF autofocus
- noise reduction configuration value a noise reduction configuration value
- a resizing/scaling configuration value a color space conversion (CSC) configuration value
- FIG. 31 is a flowchart of an operation of sensing proximity of an external device and performing connection with an external device based on connection history information according to various embodiments of the present disclosure. According to various embodiments, operations 3100 to 3130 may be performed by at least one of the electronic device 101 , 104 , or 201 , the server 106 , the processor 120 or 210 , and the programming module 310 .
- the electronic device 201 senses first proximity of an external device by using a first sensor set. For example, the electronic device 201 may determine whether the external object is located in the first proximity region, by sensing a beacon signal output from the external device through the RF module 229 .
- the electronic device 201 determines whether connection history information of the sensed external device exists. If the connection history information exists, the electronic device 201 performs operation 3120 ; otherwise, if the connection history information does not exist, the electronic device 201 terminates the operation.
- the electronic device 201 senses second proximity of the external object by using a second sensor set. For example, the electronic device 201 may determine whether the external object is located in the second proximity region, by sensing a beacon signal output from the external device through the RF module 229 .
- the electronic device 201 performs connection with the external device based on the connection history information of the external device. For example, if connection history information with an external device the user carries or wears exists, the electronic device 201 may activate communication functions having a history of connection with the external device by using the connection history information, and connects to the external device by using the activated communication functions.
- the electronic device 201 terminates connection with the external device and resumes connection with the external device if sensing that the external device is located in the specific region.
- the electronic device 201 if the external device is located in the specific region, the electronic device 201 activates a communication function for connection with the external device, and unless the external device is not located in the specific region, the electronic device 201 deactivates the communication function to reduce unnecessary battery consumption.
- the electronic device 201 replaces the connection with a third proximity state or user authentication. For example, if the registered external device approaches and is connected again and the external device enters the second proximity distance, the electronic device 201 may skip user authentication and output a message or unlock screen.
- the electronic device 201 senses first proximity of the external object by using at least some of a plurality of sensors and determines a motion pattern or moving path of the sensed external object. If the determined motion pattern or moving path of the external object is not proximity of the external object for using a function of the electronic device 201 , the electronic device 201 may not perform an operation for sensing second proximity of the external object.
- the electronic device 201 determines first proximity, second proximity, detailed proximity, and so forth of the external object by using at least one electronic device (e.g., an access point (AP), a TV, an illumination, and so forth) functionally connected to the electronic device 201 .
- at least one electronic device e.g., an access point (AP), a TV, an illumination, and so forth
- a service meeting user's demands may be actively provided to the user, and an electronic device's function desired by the user may be rapidly performed.
- a service meeting user's demands may be actively provided to the user, and an electronic device's function desired by the user may be rapidly performed.
- a term “module” used herein may mean, for example, a unit including one of or a combination of two or more of hardware, software, and firmware.
- the “module” may be interchangeably used with a unit, a logic, a logical block, a component, or a circuit.
- the “module” may be a minimum unit or a portion of an integrated component.
- the “module” may be a minimum unit or a portion thereof performing one or more functions.
- the “module” may be implemented mechanically or electronically.
- the “module” according to the embodiments may include at least one of an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs), and a programmable-logic device performing certain operations already known or to be developed.
- ASIC application-specific integrated circuit
- FPGAs field-programmable gate arrays
- At least a part of an apparatus (e.g., modules or functions thereof) or a method (e.g., operations) may be implemented with a command stored in a computer-readable storage medium in the form of a programming module.
- the instructions When the instructions are executed by one or more processors (for example, the processor 120 ), the one or more processors may perform functions corresponding to the instructions.
- the computer-readable storage medium may be, for example, a memory included in the memory 130 .
- the computer readable recording medium includes hard disk, floppy disk, or magnetic media (e.g., a magnetic tape, optical media (e.g., compact disc read only memory (CD-ROM) or digital versatile disc (DVD), magneto-optical media (e.g., floptical disk), a hardware device (e.g., ROM, RAM, flash memory, etc.), and so forth.
- the program instructions include a machine language code created by a complier and a high-level language code executable by a computer using an interpreter.
- the foregoing hardware device may be configured to be operated as at least one software module to perform an operation of the present disclosure, or vice versa.
- Modules or programming modules according to various embodiments of the present disclosure may include one or more of the foregoing elements, have some of the foregoing elements omitted, or further include additional other elements. Operations performed by the modules, the programming modules or other elements according to various embodiments may be executed in a sequential, parallel, repetitive or heuristic manner. Also, some of the operations may be executed in different order or omitted, or may have additional different operations.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Environmental & Geological Engineering (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
Description
Claims (8)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150159236A KR102432620B1 (en) | 2015-11-12 | 2015-11-12 | Electronic device and method for performing action according to proximity of external object |
KR10-2015-0159236 | 2015-11-12 |
Publications (2)
Publication Number | Publication Date |
---|---|
US20170140644A1 US20170140644A1 (en) | 2017-05-18 |
US10726715B2 true US10726715B2 (en) | 2020-07-28 |
Family
ID=58692119
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/350,005 Active 2037-05-12 US10726715B2 (en) | 2015-11-12 | 2016-11-11 | Electronic device and method for performing operations according to proximity of external object |
Country Status (2)
Country | Link |
---|---|
US (1) | US10726715B2 (en) |
KR (1) | KR102432620B1 (en) |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210103427A1 (en) * | 2017-12-20 | 2021-04-08 | Ecolink Intelligent Technology, Inc. | Monitoring device having 360 degree sensing capabilities |
US11016572B2 (en) | 2018-03-29 | 2021-05-25 | Cirrus Logic, Inc. | Efficient detection of human machine interface interaction using a resonant phase sensing system |
US11079874B2 (en) * | 2019-11-19 | 2021-08-03 | Cirrus Logic, Inc. | Virtual button characterization engine |
US11092657B2 (en) | 2018-03-29 | 2021-08-17 | Cirrus Logic, Inc. | Compensation of changes in a resonant phase sensing system including a resistive-inductive-capacitive sensor |
US11204670B2 (en) | 2018-03-29 | 2021-12-21 | Cirrus Logic, Inc. | False triggering prevention in a resonant phase sensing system |
US11402946B2 (en) | 2019-02-26 | 2022-08-02 | Cirrus Logic, Inc. | Multi-chip synchronization in sensor applications |
US11507199B2 (en) | 2021-03-30 | 2022-11-22 | Cirrus Logic, Inc. | Pseudo-differential phase measurement and quality factor compensation |
US11536758B2 (en) | 2019-02-26 | 2022-12-27 | Cirrus Logic, Inc. | Single-capacitor inductive sense systems |
US11579030B2 (en) | 2020-06-18 | 2023-02-14 | Cirrus Logic, Inc. | Baseline estimation for sensor system |
US11619519B2 (en) | 2021-02-08 | 2023-04-04 | Cirrus Logic, Inc. | Predictive sensor tracking optimization in multi-sensor sensing applications |
US11808669B2 (en) | 2021-03-29 | 2023-11-07 | Cirrus Logic Inc. | Gain and mismatch calibration for a phase detector used in an inductive sensor |
US11821761B2 (en) | 2021-03-29 | 2023-11-21 | Cirrus Logic Inc. | Maximizing dynamic range in resonant sensing |
US11836290B2 (en) | 2019-02-26 | 2023-12-05 | Cirrus Logic Inc. | Spread spectrum sensor scanning using resistive-inductive-capacitive sensors |
US11835410B2 (en) | 2020-06-25 | 2023-12-05 | Cirrus Logic Inc. | Determination of resonant frequency and quality factor for a sensor system |
US11854738B2 (en) | 2021-12-02 | 2023-12-26 | Cirrus Logic Inc. | Slew control for variable load pulse-width modulation driver and load sensing |
US11868540B2 (en) | 2020-06-25 | 2024-01-09 | Cirrus Logic Inc. | Determination of resonant frequency and quality factor for a sensor system |
US11979115B2 (en) | 2021-11-30 | 2024-05-07 | Cirrus Logic Inc. | Modulator feedforward compensation |
Families Citing this family (125)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8677377B2 (en) | 2005-09-08 | 2014-03-18 | Apple Inc. | Method and apparatus for building an intelligent automated assistant |
US9318108B2 (en) | 2010-01-18 | 2016-04-19 | Apple Inc. | Intelligent automated assistant |
US8977255B2 (en) | 2007-04-03 | 2015-03-10 | Apple Inc. | Method and system for operating a multi-function portable electronic device using voice-activation |
US10002189B2 (en) | 2007-12-20 | 2018-06-19 | Apple Inc. | Method and apparatus for searching using an active ontology |
US9330720B2 (en) | 2008-01-03 | 2016-05-03 | Apple Inc. | Methods and apparatus for altering audio output signals |
US8676904B2 (en) | 2008-10-02 | 2014-03-18 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US20120309363A1 (en) | 2011-06-03 | 2012-12-06 | Apple Inc. | Triggering notifications associated with tasks items that represent tasks to perform |
US10276170B2 (en) | 2010-01-18 | 2019-04-30 | Apple Inc. | Intelligent automated assistant |
US8682667B2 (en) | 2010-02-25 | 2014-03-25 | Apple Inc. | User profiling for selecting user specific voice input processing information |
US9262612B2 (en) | 2011-03-21 | 2016-02-16 | Apple Inc. | Device access using voice authentication |
US10057736B2 (en) | 2011-06-03 | 2018-08-21 | Apple Inc. | Active transport based notifications |
US10134385B2 (en) | 2012-03-02 | 2018-11-20 | Apple Inc. | Systems and methods for name pronunciation |
US10417037B2 (en) | 2012-05-15 | 2019-09-17 | Apple Inc. | Systems and methods for integrating third party services with a digital assistant |
CN113470640B (en) | 2013-02-07 | 2022-04-26 | 苹果公司 | Voice trigger of digital assistant |
US10652394B2 (en) | 2013-03-14 | 2020-05-12 | Apple Inc. | System and method for processing voicemail |
US10748529B1 (en) | 2013-03-15 | 2020-08-18 | Apple Inc. | Voice activated device for use with a voice-based digital assistant |
WO2014197335A1 (en) | 2013-06-08 | 2014-12-11 | Apple Inc. | Interpreting and acting upon commands that involve sharing information with remote devices |
WO2014200728A1 (en) | 2013-06-09 | 2014-12-18 | Apple Inc. | Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant |
US10176167B2 (en) | 2013-06-09 | 2019-01-08 | Apple Inc. | System and method for inferring user intent from speech inputs |
WO2015020942A1 (en) | 2013-08-06 | 2015-02-12 | Apple Inc. | Auto-activating smart responses based on activities from remote devices |
US10296160B2 (en) | 2013-12-06 | 2019-05-21 | Apple Inc. | Method for extracting salient dialog usage from live data |
US9633004B2 (en) | 2014-05-30 | 2017-04-25 | Apple Inc. | Better resolution when referencing to concepts |
EP3480811A1 (en) | 2014-05-30 | 2019-05-08 | Apple Inc. | Multi-command single utterance input method |
US10170123B2 (en) | 2014-05-30 | 2019-01-01 | Apple Inc. | Intelligent assistant for home automation |
US9715875B2 (en) | 2014-05-30 | 2017-07-25 | Apple Inc. | Reducing the need for manual start/end-pointing and trigger phrases |
US9430463B2 (en) | 2014-05-30 | 2016-08-30 | Apple Inc. | Exemplar-based natural language processing |
US9338493B2 (en) | 2014-06-30 | 2016-05-10 | Apple Inc. | Intelligent automated assistant for TV user interactions |
US9818400B2 (en) | 2014-09-11 | 2017-11-14 | Apple Inc. | Method and apparatus for discovering trending terms in speech requests |
US10127911B2 (en) | 2014-09-30 | 2018-11-13 | Apple Inc. | Speaker identification and unsupervised speaker adaptation techniques |
US9668121B2 (en) * | 2014-09-30 | 2017-05-30 | Apple Inc. | Social reminders |
US10074360B2 (en) | 2014-09-30 | 2018-09-11 | Apple Inc. | Providing an indication of the suitability of speech recognition |
USD786269S1 (en) * | 2014-11-24 | 2017-05-09 | General Electric Company | Display screen or portion thereof with transitional icon |
US10152299B2 (en) | 2015-03-06 | 2018-12-11 | Apple Inc. | Reducing response latency of intelligent automated assistants |
US9886953B2 (en) | 2015-03-08 | 2018-02-06 | Apple Inc. | Virtual assistant activation |
US9721566B2 (en) | 2015-03-08 | 2017-08-01 | Apple Inc. | Competing devices responding to voice triggers |
US10460227B2 (en) | 2015-05-15 | 2019-10-29 | Apple Inc. | Virtual assistant in a communication session |
US10083688B2 (en) | 2015-05-27 | 2018-09-25 | Apple Inc. | Device voice control for selecting a displayed affordance |
US10200824B2 (en) | 2015-05-27 | 2019-02-05 | Apple Inc. | Systems and methods for proactively identifying and surfacing relevant content on a touch-sensitive device |
US9578173B2 (en) | 2015-06-05 | 2017-02-21 | Apple Inc. | Virtual assistant aided communication with 3rd party service in a communication session |
US20160378747A1 (en) | 2015-06-29 | 2016-12-29 | Apple Inc. | Virtual assistant for media playback |
US10740384B2 (en) | 2015-09-08 | 2020-08-11 | Apple Inc. | Intelligent automated assistant for media search and playback |
US10747498B2 (en) | 2015-09-08 | 2020-08-18 | Apple Inc. | Zero latency digital assistant |
US10671428B2 (en) | 2015-09-08 | 2020-06-02 | Apple Inc. | Distributed personal assistant |
US10331312B2 (en) | 2015-09-08 | 2019-06-25 | Apple Inc. | Intelligent automated assistant in a media environment |
US10691473B2 (en) | 2015-11-06 | 2020-06-23 | Apple Inc. | Intelligent automated assistant in a messaging environment |
US10956666B2 (en) | 2015-11-09 | 2021-03-23 | Apple Inc. | Unconventional virtual assistant interactions |
US10049668B2 (en) | 2015-12-02 | 2018-08-14 | Apple Inc. | Applying neural network language models to weighted finite state transducers for automatic speech recognition |
US10223066B2 (en) | 2015-12-23 | 2019-03-05 | Apple Inc. | Proactive assistance based on dialog communication between devices |
US11227589B2 (en) | 2016-06-06 | 2022-01-18 | Apple Inc. | Intelligent list reading |
US10049663B2 (en) | 2016-06-08 | 2018-08-14 | Apple, Inc. | Intelligent automated assistant for media exploration |
US10586535B2 (en) | 2016-06-10 | 2020-03-10 | Apple Inc. | Intelligent digital assistant in a multi-tasking environment |
DK179415B1 (en) | 2016-06-11 | 2018-06-14 | Apple Inc | Intelligent device arbitration and control |
DK201670540A1 (en) | 2016-06-11 | 2018-01-08 | Apple Inc | Application integration with a digital assistant |
CN107786721A (en) * | 2016-08-26 | 2018-03-09 | 华为终端(东莞)有限公司 | Control method, terminal, Intelligent worn device and the system of terminal |
US10474753B2 (en) | 2016-09-07 | 2019-11-12 | Apple Inc. | Language identification using recurrent neural networks |
US10043516B2 (en) | 2016-09-23 | 2018-08-07 | Apple Inc. | Intelligent automated assistant |
US10187765B2 (en) * | 2016-09-23 | 2019-01-22 | Apple Inc. | Networked sensor array |
US11204787B2 (en) | 2017-01-09 | 2021-12-21 | Apple Inc. | Application integration with a digital assistant |
DK201770383A1 (en) | 2017-05-09 | 2018-12-14 | Apple Inc. | User interface for correcting recognition errors |
US10417266B2 (en) | 2017-05-09 | 2019-09-17 | Apple Inc. | Context-aware ranking of intelligent response suggestions |
US10726832B2 (en) | 2017-05-11 | 2020-07-28 | Apple Inc. | Maintaining privacy of personal information |
DK180048B1 (en) | 2017-05-11 | 2020-02-04 | Apple Inc. | MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION |
US10395654B2 (en) | 2017-05-11 | 2019-08-27 | Apple Inc. | Text normalization based on a data-driven learning network |
US11301477B2 (en) | 2017-05-12 | 2022-04-12 | Apple Inc. | Feedback analysis of a digital assistant |
DK179745B1 (en) | 2017-05-12 | 2019-05-01 | Apple Inc. | SYNCHRONIZATION AND TASK DELEGATION OF A DIGITAL ASSISTANT |
DK201770428A1 (en) | 2017-05-12 | 2019-02-18 | Apple Inc. | Low-latency intelligent automated assistant |
DK179496B1 (en) | 2017-05-12 | 2019-01-15 | Apple Inc. | USER-SPECIFIC Acoustic Models |
DK201770411A1 (en) | 2017-05-15 | 2018-12-20 | Apple Inc. | Multi-modal interfaces |
US20180336892A1 (en) | 2017-05-16 | 2018-11-22 | Apple Inc. | Detecting a trigger of a digital assistant |
US20180336275A1 (en) | 2017-05-16 | 2018-11-22 | Apple Inc. | Intelligent automated assistant for media exploration |
DK179560B1 (en) | 2017-05-16 | 2019-02-18 | Apple Inc. | Far-field extension for digital assistant services |
US10403278B2 (en) | 2017-05-16 | 2019-09-03 | Apple Inc. | Methods and systems for phonetic matching in digital assistant services |
US10311144B2 (en) | 2017-05-16 | 2019-06-04 | Apple Inc. | Emoji word sense disambiguation |
EP3407175A1 (en) * | 2017-05-23 | 2018-11-28 | Vestel Elektronik Sanayi ve Ticaret A.S. | Hand-holdable electronic devices and method of determining an electromagnetic environment near to such a device |
JP6677220B2 (en) * | 2017-05-30 | 2020-04-08 | 京セラドキュメントソリューションズ株式会社 | Mobile terminals and electronic systems |
KR102350781B1 (en) * | 2017-06-15 | 2022-01-14 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
CN107368725B (en) * | 2017-06-16 | 2020-04-10 | Oppo广东移动通信有限公司 | Iris recognition method, electronic device, and computer-readable storage medium |
US10636424B2 (en) | 2017-11-30 | 2020-04-28 | Apple Inc. | Multi-turn canned dialog |
US10733982B2 (en) | 2018-01-08 | 2020-08-04 | Apple Inc. | Multi-directional dialog |
US10733375B2 (en) | 2018-01-31 | 2020-08-04 | Apple Inc. | Knowledge-based framework for improving natural language understanding |
US10789959B2 (en) | 2018-03-02 | 2020-09-29 | Apple Inc. | Training speaker recognition models for digital assistants |
US10592604B2 (en) | 2018-03-12 | 2020-03-17 | Apple Inc. | Inverse text normalization for automatic speech recognition |
US10818288B2 (en) | 2018-03-26 | 2020-10-27 | Apple Inc. | Natural assistant interaction |
US10909331B2 (en) | 2018-03-30 | 2021-02-02 | Apple Inc. | Implicit identification of translation payload with neural machine translation |
US11145294B2 (en) | 2018-05-07 | 2021-10-12 | Apple Inc. | Intelligent automated assistant for delivering content from user experiences |
US10928918B2 (en) | 2018-05-07 | 2021-02-23 | Apple Inc. | Raise to speak |
US10799704B2 (en) | 2018-05-17 | 2020-10-13 | At&T Intellectual Property I, L.P. | Proximity-based security for implanted medical devices |
US10984780B2 (en) | 2018-05-21 | 2021-04-20 | Apple Inc. | Global semantic word embeddings using bi-directional recurrent neural networks |
DK201870355A1 (en) | 2018-06-01 | 2019-12-16 | Apple Inc. | Virtual assistant operation in multi-device environments |
US11386266B2 (en) | 2018-06-01 | 2022-07-12 | Apple Inc. | Text correction |
US10892996B2 (en) | 2018-06-01 | 2021-01-12 | Apple Inc. | Variable latency device coordination |
DK180639B1 (en) | 2018-06-01 | 2021-11-04 | Apple Inc | DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT |
DK179822B1 (en) | 2018-06-01 | 2019-07-12 | Apple Inc. | Voice interaction at a primary device to access call functionality of a companion device |
US10944859B2 (en) | 2018-06-03 | 2021-03-09 | Apple Inc. | Accelerated task performance |
KR102532426B1 (en) * | 2018-06-25 | 2023-05-15 | 삼성전자주식회사 | Electronic device for providing visual effect based on location of user by using light emitting element and method thereof |
US11010561B2 (en) | 2018-09-27 | 2021-05-18 | Apple Inc. | Sentiment prediction from textual data |
US11462215B2 (en) | 2018-09-28 | 2022-10-04 | Apple Inc. | Multi-modal inputs for voice commands |
US10839159B2 (en) | 2018-09-28 | 2020-11-17 | Apple Inc. | Named entity normalization in a spoken dialog system |
US11170166B2 (en) | 2018-09-28 | 2021-11-09 | Apple Inc. | Neural typographical error modeling via generative adversarial networks |
US11475898B2 (en) | 2018-10-26 | 2022-10-18 | Apple Inc. | Low-latency multi-speaker speech recognition |
US11638059B2 (en) | 2019-01-04 | 2023-04-25 | Apple Inc. | Content playback on multiple devices |
US11348573B2 (en) | 2019-03-18 | 2022-05-31 | Apple Inc. | Multimodality in digital assistant systems |
JP7162560B2 (en) * | 2019-03-28 | 2022-10-28 | 日立造船株式会社 | Information processing device, information processing method, information processing program, and garbage incineration plant |
US11307752B2 (en) | 2019-05-06 | 2022-04-19 | Apple Inc. | User configurable task triggers |
US11475884B2 (en) | 2019-05-06 | 2022-10-18 | Apple Inc. | Reducing digital assistant latency when a language is incorrectly determined |
DK201970509A1 (en) | 2019-05-06 | 2021-01-15 | Apple Inc | Spoken notifications |
US11423908B2 (en) | 2019-05-06 | 2022-08-23 | Apple Inc. | Interpreting spoken requests |
US11140099B2 (en) | 2019-05-21 | 2021-10-05 | Apple Inc. | Providing message response suggestions |
DK201970511A1 (en) | 2019-05-31 | 2021-02-15 | Apple Inc | Voice identification in digital assistant systems |
US11496600B2 (en) | 2019-05-31 | 2022-11-08 | Apple Inc. | Remote execution of machine-learned models |
DK180129B1 (en) | 2019-05-31 | 2020-06-02 | Apple Inc. | User activity shortcut suggestions |
US11289073B2 (en) | 2019-05-31 | 2022-03-29 | Apple Inc. | Device text to speech |
US11360641B2 (en) | 2019-06-01 | 2022-06-14 | Apple Inc. | Increasing the relevance of new available information |
US11468890B2 (en) | 2019-06-01 | 2022-10-11 | Apple Inc. | Methods and user interfaces for voice-based control of electronic devices |
JP6901212B1 (en) * | 2019-08-05 | 2021-07-14 | 株式会社オプティム | Computer systems, advertising media management methods and programs |
US11460961B2 (en) * | 2019-08-23 | 2022-10-04 | Samsung Electronics Co., Ltd. | Method for determining proximity of at least one object using electronic device |
WO2021056255A1 (en) | 2019-09-25 | 2021-04-01 | Apple Inc. | Text detection using global geometry estimators |
TWI737113B (en) * | 2020-01-02 | 2021-08-21 | 東碩資訊股份有限公司 | Switch control system and method of smart appliances |
US11183193B1 (en) | 2020-05-11 | 2021-11-23 | Apple Inc. | Digital assistant hardware abstraction |
US11061543B1 (en) | 2020-05-11 | 2021-07-13 | Apple Inc. | Providing relevant data items based on context |
US11490204B2 (en) | 2020-07-20 | 2022-11-01 | Apple Inc. | Multi-device audio adjustment coordination |
US11438683B2 (en) | 2020-07-21 | 2022-09-06 | Apple Inc. | User identification using headphones |
KR20220098629A (en) * | 2021-01-04 | 2022-07-12 | 삼성전자주식회사 | Audio output device and method for determining whether to connect with an object |
US11838991B2 (en) * | 2021-05-26 | 2023-12-05 | Microsoft Technology Licensing, Llc | Peer-to-peer communication via smart wearables |
US11942090B2 (en) | 2021-06-04 | 2024-03-26 | Apple Inc. | Accessory device based authentication for digital assistant requests |
Citations (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001216269A (en) | 2000-01-31 | 2001-08-10 | Oki Electric Ind Co Ltd | User authentication device |
WO2004053665A1 (en) | 2002-12-09 | 2004-06-24 | Kokuyo Co., Ltd. | Information processing device, control device, container monitoring device, and program |
US20060197860A1 (en) | 2005-03-04 | 2006-09-07 | Samsung Electronics Co., Ltd. | Method and apparatus for controlling input/output interface |
US20080303797A1 (en) * | 2007-06-11 | 2008-12-11 | Honeywell International, Inc. | Stimuli sensitive display screen with multiple detect modes |
US20130088427A1 (en) * | 2011-10-11 | 2013-04-11 | Eric Liu | Multiple input areas for pen-based computing |
US20130207937A1 (en) * | 2012-02-13 | 2013-08-15 | Microsoft Corporation | Optical Stylus Interaction |
US20130328842A1 (en) | 2012-06-08 | 2013-12-12 | Apple Inc. | Electronic Device With Display Brightness Control |
KR20130141844A (en) | 2012-06-18 | 2013-12-27 | 엘지전자 주식회사 | Terminal and method for controlling the same |
US20140111423A1 (en) | 2012-10-23 | 2014-04-24 | Yoon-dong Park | Mobile systems including image sensors, methods of operating image sensors, and methods of operating mobile systems |
US20140123273A1 (en) * | 2012-10-26 | 2014-05-01 | Jonathan Arie Matus | Contextual Device Locking/Unlocking |
US20140118256A1 (en) * | 2012-10-29 | 2014-05-01 | Lenovo (Singapore) Pte, Ltd | Display directional sensing |
US20140132779A1 (en) | 2012-11-13 | 2014-05-15 | Lg Electronics Inc. | Mobile terminal and control method for the mobile terminal |
US20140168494A1 (en) * | 2012-12-13 | 2014-06-19 | Samsung Electronics Co., Ltd. | Electronic device and method for driving camera module in sleep mode |
US20140197922A1 (en) * | 2013-01-16 | 2014-07-17 | Cygnus Broadband, Inc. | System and method for positive identification on a mobile device |
US20140282877A1 (en) * | 2013-03-13 | 2014-09-18 | Lookout, Inc. | System and method for changing security behavior of a device based on proximity to another device |
US20140267025A1 (en) * | 2013-03-14 | 2014-09-18 | Samsung Electronics Co., Ltd. | Method and apparatus for operating sensors of user device |
US20140361979A1 (en) | 2013-06-05 | 2014-12-11 | Samsung Electronics Co., Ltd. | Grip sensor device and grip sensing method |
KR20140147647A (en) | 2013-06-20 | 2014-12-30 | 삼성전자주식회사 | Electronic device and method for controlling using grip sensing in the electronic device |
KR20150011046A (en) | 2013-07-18 | 2015-01-30 | 삼성전자주식회사 | Method And Apparatus For Performing Authentication Based On Biometrics |
-
2015
- 2015-11-12 KR KR1020150159236A patent/KR102432620B1/en active IP Right Grant
-
2016
- 2016-11-11 US US15/350,005 patent/US10726715B2/en active Active
Patent Citations (24)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2001216269A (en) | 2000-01-31 | 2001-08-10 | Oki Electric Ind Co Ltd | User authentication device |
WO2004053665A1 (en) | 2002-12-09 | 2004-06-24 | Kokuyo Co., Ltd. | Information processing device, control device, container monitoring device, and program |
US20060197860A1 (en) | 2005-03-04 | 2006-09-07 | Samsung Electronics Co., Ltd. | Method and apparatus for controlling input/output interface |
KR101160872B1 (en) | 2005-03-04 | 2012-07-02 | 삼성전자주식회사 | method for controlling the input/output interface and apparatus thereof |
US20080303797A1 (en) * | 2007-06-11 | 2008-12-11 | Honeywell International, Inc. | Stimuli sensitive display screen with multiple detect modes |
US20130088427A1 (en) * | 2011-10-11 | 2013-04-11 | Eric Liu | Multiple input areas for pen-based computing |
US20130207937A1 (en) * | 2012-02-13 | 2013-08-15 | Microsoft Corporation | Optical Stylus Interaction |
US20130328842A1 (en) | 2012-06-08 | 2013-12-12 | Apple Inc. | Electronic Device With Display Brightness Control |
KR20150013610A (en) | 2012-06-08 | 2015-02-05 | 애플 인크. | Electronic device with display brightness control |
KR20130141844A (en) | 2012-06-18 | 2013-12-27 | 엘지전자 주식회사 | Terminal and method for controlling the same |
KR20140051572A (en) | 2012-10-23 | 2014-05-02 | 삼성전자주식회사 | Mobile system including image sensor, method of operating image sensor and method of operating mobile system |
US20140111423A1 (en) | 2012-10-23 | 2014-04-24 | Yoon-dong Park | Mobile systems including image sensors, methods of operating image sensors, and methods of operating mobile systems |
US20140123273A1 (en) * | 2012-10-26 | 2014-05-01 | Jonathan Arie Matus | Contextual Device Locking/Unlocking |
US20140118256A1 (en) * | 2012-10-29 | 2014-05-01 | Lenovo (Singapore) Pte, Ltd | Display directional sensing |
US20140132779A1 (en) | 2012-11-13 | 2014-05-15 | Lg Electronics Inc. | Mobile terminal and control method for the mobile terminal |
KR20140061135A (en) | 2012-11-13 | 2014-05-21 | 엘지전자 주식회사 | Mobile terminal and control method for the mobile terminal |
US20140168494A1 (en) * | 2012-12-13 | 2014-06-19 | Samsung Electronics Co., Ltd. | Electronic device and method for driving camera module in sleep mode |
US20140197922A1 (en) * | 2013-01-16 | 2014-07-17 | Cygnus Broadband, Inc. | System and method for positive identification on a mobile device |
US20140282877A1 (en) * | 2013-03-13 | 2014-09-18 | Lookout, Inc. | System and method for changing security behavior of a device based on proximity to another device |
US20140267025A1 (en) * | 2013-03-14 | 2014-09-18 | Samsung Electronics Co., Ltd. | Method and apparatus for operating sensors of user device |
US20140361979A1 (en) | 2013-06-05 | 2014-12-11 | Samsung Electronics Co., Ltd. | Grip sensor device and grip sensing method |
KR20140142862A (en) | 2013-06-05 | 2014-12-15 | 삼성전자주식회사 | Apparatus and method for grip sensing |
KR20140147647A (en) | 2013-06-20 | 2014-12-30 | 삼성전자주식회사 | Electronic device and method for controlling using grip sensing in the electronic device |
KR20150011046A (en) | 2013-07-18 | 2015-01-30 | 삼성전자주식회사 | Method And Apparatus For Performing Authentication Based On Biometrics |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20210103427A1 (en) * | 2017-12-20 | 2021-04-08 | Ecolink Intelligent Technology, Inc. | Monitoring device having 360 degree sensing capabilities |
US11829683B2 (en) * | 2017-12-20 | 2023-11-28 | Ecolink Intelligent Technology, Inc. | Monitoring device having 360 degree sensing |
US11204670B2 (en) | 2018-03-29 | 2021-12-21 | Cirrus Logic, Inc. | False triggering prevention in a resonant phase sensing system |
US11016572B2 (en) | 2018-03-29 | 2021-05-25 | Cirrus Logic, Inc. | Efficient detection of human machine interface interaction using a resonant phase sensing system |
US11092657B2 (en) | 2018-03-29 | 2021-08-17 | Cirrus Logic, Inc. | Compensation of changes in a resonant phase sensing system including a resistive-inductive-capacitive sensor |
US11402946B2 (en) | 2019-02-26 | 2022-08-02 | Cirrus Logic, Inc. | Multi-chip synchronization in sensor applications |
US11536758B2 (en) | 2019-02-26 | 2022-12-27 | Cirrus Logic, Inc. | Single-capacitor inductive sense systems |
US11836290B2 (en) | 2019-02-26 | 2023-12-05 | Cirrus Logic Inc. | Spread spectrum sensor scanning using resistive-inductive-capacitive sensors |
US11079874B2 (en) * | 2019-11-19 | 2021-08-03 | Cirrus Logic, Inc. | Virtual button characterization engine |
US11579030B2 (en) | 2020-06-18 | 2023-02-14 | Cirrus Logic, Inc. | Baseline estimation for sensor system |
US11868540B2 (en) | 2020-06-25 | 2024-01-09 | Cirrus Logic Inc. | Determination of resonant frequency and quality factor for a sensor system |
US11835410B2 (en) | 2020-06-25 | 2023-12-05 | Cirrus Logic Inc. | Determination of resonant frequency and quality factor for a sensor system |
US11619519B2 (en) | 2021-02-08 | 2023-04-04 | Cirrus Logic, Inc. | Predictive sensor tracking optimization in multi-sensor sensing applications |
US11821761B2 (en) | 2021-03-29 | 2023-11-21 | Cirrus Logic Inc. | Maximizing dynamic range in resonant sensing |
US11808669B2 (en) | 2021-03-29 | 2023-11-07 | Cirrus Logic Inc. | Gain and mismatch calibration for a phase detector used in an inductive sensor |
US11507199B2 (en) | 2021-03-30 | 2022-11-22 | Cirrus Logic, Inc. | Pseudo-differential phase measurement and quality factor compensation |
US11979115B2 (en) | 2021-11-30 | 2024-05-07 | Cirrus Logic Inc. | Modulator feedforward compensation |
US11854738B2 (en) | 2021-12-02 | 2023-12-26 | Cirrus Logic Inc. | Slew control for variable load pulse-width modulation driver and load sensing |
Also Published As
Publication number | Publication date |
---|---|
KR20170055893A (en) | 2017-05-22 |
US20170140644A1 (en) | 2017-05-18 |
KR102432620B1 (en) | 2022-08-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10726715B2 (en) | Electronic device and method for performing operations according to proximity of external object | |
US11636861B2 (en) | Electronic device and method of operation thereof | |
US10423194B2 (en) | Electronic device and image capture method thereof | |
CN108701178B (en) | Authentication method and electronic device using the same | |
US9867162B2 (en) | Device and method for providing notification on wireless charging state | |
US10248086B2 (en) | Electronic device for controlling air condition based on location information and method of operating the same | |
US10075530B2 (en) | Method and electronic device for establishing connection with external electronic device | |
US10038790B2 (en) | Communication service operating method and electronic device supporting the same | |
US20170017531A1 (en) | Application operating method and electronic device using the same | |
KR102324074B1 (en) | Method for controlling sound output and an electronic device thereof | |
US10809791B2 (en) | Method for displaying content and electronic device thereof | |
US20170118402A1 (en) | Electronic device and camera control method therefor | |
KR102324964B1 (en) | Electronic device and method for processing input of external input device | |
US11320889B2 (en) | Function operating method and electronic apparatus supporting same | |
EP3016374A1 (en) | Electronic device for sensing lens and operating method thereof | |
US10321227B2 (en) | Electronic device for controlling microphone parameter | |
EP2985675B1 (en) | Method of controlling an electronic device according to a communication state of the electronic device | |
US20210311752A1 (en) | Electronic apparatus and operating method thereof | |
US20170010669A1 (en) | Method for operating electronic apparatus and electronic apparatus supporting the method | |
US10033921B2 (en) | Method for setting focus and electronic device thereof | |
KR20180076863A (en) | Method for Connecting an External Device and the Electronic Device supporting the same | |
US10062244B2 (en) | Method and apparatus for associating data with time information | |
US10621308B2 (en) | Electronic device and method for linking exercise schedule thereof | |
US11042855B2 (en) | Electronic device and remittance method thereof | |
US20170200024A1 (en) | Electronic device and method of securing the same |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: SAMSUNG ELECTRONICS CO., LTD, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HWANG, HO-CHUL;KIM, MOON-SOO;JANG, DONG-HO;AND OTHERS;REEL/FRAME:040299/0044 Effective date: 20161018 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1551); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY Year of fee payment: 4 |