WO2021022981A1 - 终端交互的方法及终端 - Google Patents

终端交互的方法及终端 Download PDF

Info

Publication number
WO2021022981A1
WO2021022981A1 PCT/CN2020/102021 CN2020102021W WO2021022981A1 WO 2021022981 A1 WO2021022981 A1 WO 2021022981A1 CN 2020102021 W CN2020102021 W CN 2020102021W WO 2021022981 A1 WO2021022981 A1 WO 2021022981A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
action
message
information
function
Prior art date
Application number
PCT/CN2020/102021
Other languages
English (en)
French (fr)
Inventor
苏达
吴思举
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP20849447.6A priority Critical patent/EP3986006A4/en
Priority to US17/626,692 priority patent/US11991594B2/en
Publication of WO2021022981A1 publication Critical patent/WO2021022981A1/zh

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02—Services making use of location information
    • H04W4/029—Location-based management or tracking services
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02—Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • G01S5/08—Position of single direction-finder fixed by determining direction of a plurality of spaced sources of known location
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00—Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02—Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42208—Display device provided on the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42221—Transmission circuitry, e.g. infrared [IR] or radio frequency [RF]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80—Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W64/00—Locating users or terminals or network equipment for network management purposes, e.g. mobility management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/14—Direct-mode setup
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W76/00—Connection management
    • H04W76/10—Connection setup
    • H04W76/15—Setup of multiple wireless link connections
    • G—PHYSICS
    • G08—SIGNALLING
    • G08C—TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00—Transmission systems of control signals via wireless link
    • G08C2201/30—User interface
    • G08C2201/32—Remote control based on movements, attitude of remote control device
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W84/00—Network topologies
    • H04W84/18—Self-organising networks, e.g. ad-hoc networks or sensor networks

Definitions

  • This application relates to the field of wireless communication, and in particular to a method and terminal for terminal interaction.
  • Indoor positioning has always been a hot topic.
  • Common indoor positioning solutions include triangulation based on wireless signal strength, fingerprint positioning and nearest neighbors.
  • the triangulation method is a classic positioning method, which uses the received signal strength coefficient (Received Signal Strength Indication, RSSI) and the signal attenuation model to calculate the distance between the signal sources, and the distance between the equipment and multiple signal sources is triangulated.
  • RSSI Received Signal Strength Indication
  • the nearest neighbor method is a relatively simple positioning method, which uses the distance from the device to each signal source and takes the position of the signal source with the highest signal strength as the current position of the device.
  • Existing common indoor communication technologies such as mobile hotspot Wi-Fi, Bluetooth (before Bluetooth 5.1 technology), Zigbee, etc. can only learn the signal strength (Received Signal Strength Indication, RSSI) between the receiving and sending devices. Get the relative position between devices directly. Therefore, in scenarios where multiple terminal devices work together, there has been a lack of convenient interaction methods based on location information.
  • This application provides a terminal interaction method and terminal to solve the problems of low switching efficiency and low positioning accuracy caused by manual operation of Bluetooth switching during multi-terminal interaction.
  • a terminal interaction method which includes: a first terminal establishes a connection with at least one second terminal through a Bluetooth module, and obtains location information of the second terminal; when the first terminal points to a When the direction of the second terminal is described, the first terminal recognizes the second terminal according to the location information and the current pointing direction; when the first terminal performs the first action, the first terminal recognizes the second terminal according to the The first action sends a first message to the second terminal, where the first message is used to instruct the second terminal to perform a first function, and the first function corresponds to the first action on a one-to-one basis.
  • the Bluetooth module included in the first terminal has a positioning function, that is, the position of other Bluetooth terminals can be determined by, for example, a lateral algorithm, and when subsequently interacting with other Bluetooth terminals, it is possible to identify whether there is a need in a certain direction based on the position information. If there is an interactive terminal, it can interact with multiple terminals over the air.
  • the first terminal, the second terminal, etc. involved in the embodiments of the present application are all Bluetooth devices, that is, include a Bluetooth module, which is used to actively connect, identify, or remotely control other Bluetooth devices.
  • the Bluetooth module can execute The direction finding algorithm involved in Bluetooth 5.1 technology performs precise positioning, and the Bluetooth device that passively accepts connection, identification or control, its Bluetooth module can support the direction finding algorithm in Bluetooth 5.1 technology, or it may not support the direction finding algorithm in Bluetooth 5.1 technology.
  • the direction finding algorithm is not limited in this application. For example, when the first terminal recognizes and remotely controls the second terminal, the Bluetooth module of the first terminal needs to support the direction finding algorithm in Bluetooth 5.1 technology, while the second terminal may not support the lateral algorithm; if the second terminal When the terminal recognizes and remotely controls the third terminal, the second terminal needs to support the Bluetooth 5.1 direction finding algorithm, while the third terminal may not support the direction finding algorithm.
  • the first terminal after the first terminal establishes a connection with the second terminal through the Bluetooth module for the first time, it can store the location information of the second terminal.
  • the first terminal needs to recognize the second terminal again, it can Identify the second terminal by using the direction in which the first terminal points and the location information of the second terminal.
  • the acquiring the location information of the second terminal includes: acquiring, by the Bluetooth module, through a wave-of-arrival AoA direction finding algorithm or a launch angle AoD direction finding algorithm Location information of the at least one second terminal.
  • the first terminal can perform the AoA direction finding algorithm or the AoD direction finding algorithm through the included Bluetooth module, which can realize precise positioning of other Bluetooth devices, and its position accuracy can reach within 1m.
  • the positioning accuracy is improved, thereby facilitating the first terminal to accurately identify the terminal that needs to interact.
  • the first terminal sending a first message to the second terminal according to the first action includes: the first terminal senses the first message through a motion sensor An action; the first terminal sends a first message to the second terminal according to the first action.
  • the method further includes: the first terminal pre-stores a mapping relationship between the first action and the first function.
  • the motion sensor includes one or more of the following: an acceleration sensor, a gyroscope sensor, a gravity sensor, a linear acceleration sensor, and a rotation vector sensor.
  • the method further includes: when the first action sensed by the first terminal is an up and down motion, the first terminal is The second terminal sends a first message, and the first message is used to instruct the second terminal to perform a function of changing the volume.
  • the method further includes: when the first action sensed by the first terminal is an action of double-clicking the screen, the first terminal points to the The second terminal sends a first message, and the first message is used to instruct the second terminal to perform a screen capture function.
  • the method further includes: the first terminal receives the screenshot information sent by the second terminal; when the first terminal points to the third terminal, The first terminal recognizes the third terminal; the first terminal sends the screenshot information to the third terminal.
  • the method further includes: the first terminal points to the third terminal and identifies the third terminal; The second terminal sends first indication information, where the first indication information is used to instruct the second terminal to send first information to the third terminal; the first terminal sends a second indication to the third terminal Information, the second indication information is used to instruct the third terminal to receive the first information sent by the second terminal.
  • the first terminal includes a smart bracelet, a watch, or a mobile phone
  • the second terminal is a speaker or a TV.
  • a terminal in a second aspect, includes: a Bluetooth module, configured to establish a connection with at least one second terminal, and obtain location information of the second terminal; a processing module, configured to act as the first terminal When the terminal points to a direction of the second terminal, the processing module recognizes the second terminal according to the location information and the current pointing direction; the sending module is used for when the first terminal performs the first action, The sending module sends a first message to the second terminal according to the first action, where the first message is used to instruct the second terminal to perform a first function, and the first function is the same as the first action One to one correspondence.
  • the Bluetooth module included in the first terminal has a positioning function, that is, the position of other Bluetooth terminals can be determined by, for example, a lateral algorithm, and when subsequently interacting with other Bluetooth terminals, it is possible to identify whether there is a need in a certain direction based on the position information. If there is an interactive terminal, it can interact with multiple terminals over the air.
  • the first terminal, the second terminal, etc. involved in the embodiments of the present application are all Bluetooth devices, that is, include a Bluetooth module, and the Bluetooth module can execute the direction finding algorithm involved in Bluetooth 5.1 for precise positioning.
  • the first terminal after the first terminal establishes a connection with the second terminal through the Bluetooth module for the first time, it can store the location information of the second terminal.
  • the first terminal needs to recognize the second terminal again, it can Identify the second terminal by using the direction in which the first terminal points and the location information of the second terminal.
  • the Bluetooth module determines the location information of the at least one second terminal through a wave-of-arrival AoA direction finding algorithm or a launch angle AoD direction finding algorithm.
  • the terminal further includes: a motion sensor, configured to sense a first motion of the first terminal; and the sending module is further configured to An action sends a first message to the second terminal.
  • the processing module is further configured to store a mapping relationship between the first action and the first function.
  • the motion sensor includes one or more of the following: an acceleration sensor, a gyroscope sensor, a gravity sensor, a linear acceleration sensor, and a rotation vector sensor.
  • the sending module is further configured to, when the first motion sensed by the first terminal is an up and down motion, send a message to the second The terminal sends a first message, where the first message is used to instruct the second terminal to perform the function of changing the volume.
  • the sending module is further configured to, when the first action sensed by the first terminal is an action of double tapping the screen, send a message to the second The terminal sends a first message, where the first message is used to instruct the second terminal to perform a screen capture function.
  • the terminal further includes: a receiving module, configured to receive screenshot information sent by the second terminal; and the processing module, also configured to serve as the first When a terminal points to a third terminal, the third terminal is identified; the sending module is further configured to send the screenshot information to the third terminal.
  • the processing module is configured to identify the third terminal when the first terminal points to the third terminal; a sending module is configured to Send first indication information to the second terminal, where the first indication information is used to instruct the second terminal to send the first information to the third terminal; the sending module is also used to send first information to the third terminal; The terminal sends second indication information, where the second indication information is used to instruct the third terminal to receive the first information sent by the second terminal.
  • the first terminal includes a smart bracelet, a watch, or a mobile phone
  • the second terminal is a speaker or a TV.
  • a terminal which includes at least one processor and a memory, the memory is used to store computer program instructions, and when the computer program instructions are executed in the at least one processor, the terminal implements The method described in any one of the implementations of the first aspect above.
  • a computer program storage medium is provided, the computer program has program instructions, and when the program instructions are directly or indirectly executed, the method described in any implementation of the first aspect can be enabled achieve.
  • the direction finding feature of Bluetooth 5.1 is used to perform multi-device interaction, which eliminates the process of manually switching Bluetooth connections and improves interaction efficiency. And through the interactive mode of multi-terminal collaborative work only through the air, terminal interaction is more convenient.
  • Figure 1 is a schematic diagram of AoA positioning.
  • Figure 2 is a schematic diagram of the application of the AoA direction finding algorithm.
  • Figure 3 is a schematic diagram of AoD positioning.
  • FIG. 4 is a schematic flowchart of a terminal interaction method provided by an embodiment of the application.
  • Fig. 5 is a schematic diagram of a Bluetooth terminal interaction provided by an embodiment of the application.
  • FIG. 6 is a schematic structural diagram of a terminal provided by an embodiment of the application.
  • the indoor positioning methods currently used all have obvious shortcomings: for example, the accuracy of the nearest neighbor method is poor; the fingerprint positioning method requires a large amount of data collection in advance, and changes in the indoor layout will have a greater impact on the measurement accuracy; the theory of the triangulation method The upper accuracy is the highest, but it is still subject to the influence of the indoor environment. The large signal interference and multipath effects make it difficult to guarantee the measurement accuracy. In addition, this method requires multiple data sources.
  • the positioning method applied in the multi-terminal interaction scenario requires high precision to realize accurate and efficient terminal interaction.
  • Bluetooth Special Interest Group announced the official announcement of Bluetooth 5.1 technology.
  • Bluetooth 5.1 technology provides a location search function.
  • the new function supports a variety of methods to determine the signal direction, including the AoA direction finding algorithm for the angle of arrival and the AoD direction finding algorithm for the launch angle.
  • the new Bluetooth function currently implemented can detect the signal direction within a 5-degree angle. So far, Bluetooth tracking and indoor positioning solutions usually provide positioning accuracy within a range of 3-4 meters.
  • developers can create products that can increase the position to within 1 meter, which is an application that could not be achieved before. Opened the door. SIG stated that the positioning accuracy of Bluetooth 5.1 technology can reach the centimeter level.
  • the embodiment of this application applies the positioning function of Bluetooth 5.1 technology to a method of multi-terminal interaction.
  • the terminal interaction method provided in the embodiments of the present application may also apply technologies that support direction finding algorithms or other high-precision positioning methods after Bluetooth 5.1 technology.
  • Figure 1 shows a schematic diagram of AoA positioning.
  • the AoA direction finding algorithm is mainly that when a signal passes through the antenna array of the receiver, the antenna array of the receiver receives the transmission signal from different angles and directions. Because the transmission signal received by each antenna has a phase difference, the The phase difference can be used to calculate the incident angle of the transmission signal.
  • the receiving end has two antennas with a spacing of d (denoted as A 0 and A 1 respectively ), the received electromagnetic wave is a plane wave, and the angle of arrival is ⁇ .
  • antenna A1 Take antenna A1 as the reference antenna, and receive signals within a reference period of 8 ⁇ s Perform frequency lock to generate a coherent local oscillator signal Since the signal arriving at antenna A 0 is ⁇ t later than the signal arriving at A 1 , the signal received by antenna A 0 is Demodulated with local oscillator signal So the angle of arrival Among them, the aforementioned e is the natural logarithm, ⁇ c is the angular frequency corresponding to the center frequency, j is the imaginary number, t is the time variable, and ⁇ t is the time difference between the arrival of the antenna A 0 and the arrival of the antenna A 1 .
  • the above description is an exemplary description to facilitate the understanding of the AoA lateral algorithm.
  • multiple antennas can be equipped, and the arrangement of the antenna array can be, for example, a line, For circular, spherical, etc., the corresponding calculation method of reaching angle is also more complicated.
  • the calculation method of the angle of arrival corresponding to the antenna arrays with different arrangements reference may be made to the existing calculation method, which will not be repeated here.
  • Figure 3 shows a schematic diagram of AoD positioning.
  • the AoD direction finding algorithm is the opposite of the AoA direction finding algorithm.
  • the transmitter uses multiple antennas to transmit signals, and the receiver uses the phase difference of the received transmission signal to calculate the angle of the transmission signal from the transmitter.
  • FIG. 4 shows a schematic flowchart of a terminal interaction method provided by an embodiment of the present application.
  • the terminal interaction method provided by the embodiment of the present application is based on the direction finding function involved in the Bluetooth 5.1 technology.
  • the Bluetooth module pre-establishes connections with other Bluetooth devices around and obtains location information such as the direction angle characteristics of other Bluetooth devices.
  • location information such as the direction angle characteristics of other Bluetooth devices.
  • the Bluetooth device can automatically identify and connect Bluetooth devices in a specific direction, and complete a gesture in combination The series of long-distance interactive operations.
  • the Bluetooth module of the first terminal needs to support the direction finding algorithm in Bluetooth 5.1 technology, while the second terminal may not support the lateral algorithm; if the second terminal When the terminal recognizes and remotely controls the third terminal, the second terminal needs to support the Bluetooth 5.1 direction finding algorithm, while the third terminal may not support the direction finding algorithm.
  • the terminal involved in the embodiments of the present application can be positioned through the Bluetooth module, and the positioning accuracy is much higher than that of the current terminal with built-in infrared transmitter.
  • the terminal interaction method provided by the embodiment of the present application mainly includes the following steps.
  • the first terminal determines the location information of at least one second terminal in advance through the Bluetooth module, and connects with the at least one second terminal.
  • the first terminal is a device with a built-in Bluetooth module, for example, it may be a wearable device (such as a bracelet, a watch, etc.) with a built-in Bluetooth module or a mobile phone.
  • the second terminal is also a device with a built-in Bluetooth module, for example, it may be a sound-producing device (such as a speaker) or a TV with a built-in Bluetooth module.
  • the first terminal before the first terminal interacts with the second terminal, it can scan the surrounding second terminals periodically through the Bluetooth module in advance, and establish a connection with the surrounding second terminals (that is, complete pairing) , And the first terminal and the second terminal may pre-store mutual connection information or trust information.
  • the Bluetooth module of the first terminal obtains position information such as the direction angle characteristic of the second terminal through the AoA direction finding algorithm or the AoD direction finding algorithm, and the direction in which the second terminal is located can be determined according to the position information, for example.
  • the second terminal may be one of multiple terminals located in a short-range range around the first terminal.
  • the first terminal and the second terminal may be two Bluetooth devices located in the same room.
  • the first terminal when the first terminal needs to interact with a certain second terminal, the first terminal can stay in the direction pointing to the second terminal for a certain period of time, and determine whether the current pointing direction exists according to the positioning information of the Bluetooth module The second terminal that needs to interact. When the first terminal recognizes that there is a qualified second terminal in the current direction, the first terminal may activate the remote control mode for the second terminal.
  • the remote control mode of the first terminal to the second terminal may be, for example, that the first terminal sends instruction information for instructing the second terminal to perform a specific function to the second terminal, and the second terminal determines to perform the specific function according to the instruction information Or, the first terminal executes a specific action to trigger the motion sensor, which in turn triggers the first terminal to send instruction information for executing the specific function to the second terminal, so that the second terminal executes the corresponding function.
  • identifying the second terminal by the first terminal may mean that the first terminal determines that the second terminal is a terminal that the first terminal needs to interact with based on the pre-acquired location information of the second terminal and the direction it is currently pointed to.
  • the direction of the first terminal pointing to the second terminal in the embodiment of the present application may be that the direction pointed by the first terminal is along the first terminal.
  • the direction of the connection with the second terminal, or based on the direction of the connection is within the error range allowed by the Bluetooth positioning technology.
  • the direction pointed by the first terminal should be within the range of the direction required by the first terminal to determine the position of the second terminal through the Bluetooth module.
  • the first terminal may be provided with a motion sensor, and the motion sensor may be, for example, an acceleration sensor, a gyroscope sensor, a gravity sensor, a linear acceleration sensor, or a rotation vector sensor.
  • the first terminal may sense a first action through the motion sensor, and the first action may be, for example, an action of the user moving the first terminal up and down, or an action of double-clicking on the screen of the first terminal by the user.
  • the first terminal is a smart bracelet
  • the user can make the first terminal perform the first action of moving up and down by waving up and down.
  • the first terminal can sense through the set acceleration sensor or gyroscope sensor. Should act.
  • the first terminal stores a one-to-one correspondence between the first action and the first function, where the first function is a function that the first terminal expects or requests the second terminal to perform, such as a volume adjustment function or a screenshot function Wait.
  • the first action corresponding to the up and down movement may be a volume adjustment function; or the first function corresponding to the first action of double-clicking the screen may be a screenshot function.
  • the first terminal senses that the first action is an up and down movement
  • the first terminal determines to request the second terminal to perform the function of volume adjustment.
  • the first terminal can send a first message to the second terminal for requesting
  • the second terminal performs the volume adjustment function.
  • the corresponding first function may be increasing the volume; when the first action sensed by the first terminal is downward movement
  • the corresponding first function can be to reduce the volume.
  • the first information may also be sent to the first terminal.
  • the first information may be, for example, screenshot image information after the second terminal executes the screenshot.
  • the first terminal can perform secondary pointing identification, that is, the first terminal can point to the third terminal, and identify the connection in an identification manner similar to that of the second terminal.
  • the first terminal may send the first information to the third terminal, where the third terminal may be, for example, a display device for displaying a screenshot image of the second terminal; or ,
  • the third terminal may be an audio playback device, such as a Bluetooth speaker, used for audio playback.
  • the second terminal may also directly send the first information to the third terminal.
  • the second terminal and the third terminal may be connected via Bluetooth.
  • the first terminal may send the first indication information to the second terminal to Instruct the second terminal to send the first information to the third terminal.
  • the first terminal may also send second indication information to the third terminal to instruct the third terminal to receive the first information sent by the second terminal.
  • the first information may be screenshot information, video information, picture information, etc., which is not limited in this application.
  • each terminal can form a Bluetooth-based Internet of Things (IoT), and the first terminal uses pointing actions to control the interaction between other IoT terminals, for example, projecting TV audio to Bluetooth speakers or Turn the door control video to the TV screen, etc.
  • IoT Internet of Things
  • the multi-device interaction is performed by using the direction finding feature of Bluetooth 5.1 technology, which eliminates the process of manually switching Bluetooth connections and improves the interaction efficiency. And through the interactive mode of multi-terminal collaborative work only through the air, terminal interaction is more convenient.
  • FIG. 6 shows a schematic structural diagram of a terminal provided by an embodiment of the present application.
  • the terminal 600 includes a Bluetooth module 610, a processing module 620, and a sending module 630.
  • the Bluetooth module 610 is used to establish a connection with at least one second terminal and obtain location information of the second terminal.
  • the processing module 620 is configured to, when the first terminal points in a direction of the second terminal, the processing module identifies the second terminal according to the location information and the current pointing direction.
  • the sending module 630 is configured to: when the first terminal performs a first action, the sending module sends a first message to the second terminal according to the first action, and the first message is used to indicate the first action.
  • the two terminals perform a first function, and the first function corresponds to the first action in a one-to-one correspondence.
  • the Bluetooth module 610 may also be used to determine the location information of the at least one second terminal through a wave-of-arrival AoA direction finding algorithm or a transmitting angle AoD direction finding algorithm.
  • the terminal 600 may further include a motion sensing unit, and the motion sensing unit is used to sense the first motion of the first terminal.
  • the motion sensing unit may include an acceleration sensor, a gyroscope sensor, a gravity sensor, a linear acceleration sensor, a rotation vector sensor, etc.
  • the sending module 630 may also be configured to send a first message to the second terminal according to the first action.
  • the processing module 620 may also be used to pre-store the mapping relationship between the first action and the first function.
  • the sending module 630 may be further configured to send a first message to the second terminal when the first action sensed by the first terminal is an action of double-clicking the screen, where the first message is used to instruct the first terminal
  • the second terminal performs the function of taking screenshots.
  • the terminal 600 may further include a receiving unit, and the receiving unit may be configured to receive screenshot information sent by the second terminal.
  • the disclosed system, device, and method may be implemented in other ways.
  • the device embodiments described above are only illustrative.
  • the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components can be combined or It can be integrated into another system, or some features can be ignored or not implemented.
  • the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.
  • each unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Telephone Function (AREA)
  • Mobile Radio Communication Systems (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种终端交互的方法及终端，涉及无线通信领域。该终端交互的方法包括：第一终端通过蓝牙模块与至少一个第二终端建立连接，并获取所述第二终端的位置信息；当所述第一终端指向一个所述第二终端的方向时，所述第一终端根据所述位置信息和当前指向的方向识别所述第二终端；当所述第一终端执行第一动作时，所述第一终端根据所述第一动作向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行第一功能，所述第一功能与所述第一动作一一对应。本申请实施例提供的终端交互的方法，通过利用蓝牙5.1技术的测向功能自动识别连接需要交互的终端，实现多终端隔空交互，避免采用手动切换蓝牙连接导致的切换效率低的问题。

Description

终端交互的方法及终端
本申请要求于2019年8月5日提交中国专利局、申请号为201910717178.0、申请名称为“终端交互的方法及终端”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及无线通信领域，具体地，涉及一种终端交互的方法及终端。
背景技术
室内定位一直以来都是热门话题。常见的室内定位解决方案有基于无线信号强度的三角测量法、指纹定位法和近邻法。其中，三角测量法属于经典定位方法，其利用接收的信号强度系数(Received Signal Strength Indication，RSSI)和信号衰减模型推算出信号源之间的距离，通过设备到多个信号源之间的距离三角测量出设备位置；指纹定位法，简单来说，就是事先把各个位置上的信号特征(如各Wi-Fi的信号强度)测量一遍，存入指纹数据库，定位时，将当前的信号特征与指纹库中的进行匹配，从而确定位置；近邻法是较为简单的一种定位方法，其通过对位设备到各个信号源的距离，取信号强度最大的那个信号源的位置为设备当前位置。现有的常用室内通讯技术如行动热点Wi-Fi、蓝牙(Bluetooth)(蓝牙5.1技术之前)、紫蜂(Zigbee)等只能获知收发设备间的信号强度(Received Signal Strength Indication，RSSI)，无法直接获取设备间的相对位置。因此，在多终端设备协同工作的场景，一直缺乏基于位置信息的便捷交互方式。
如何实现基于终端间的精确定位实现多终端交互成为亟待解决的问题。
发明内容
本申请提供一种终端交互的方法及终端，以解决多终端交互时，需要手动操作蓝牙切换导致的切换效率低和定位精度不高的问题。
第一方面，提供了一种终端交互的方法，包括：第一终端通过蓝牙模块与至少一个第二终端建立连接，并获取所述第二终端的位置信息；当所述第一终端指向一个所述第二终端的方向时，所述第一终端根据所述位置信息和当前指向的方向识别所述第二终端；当所述第一终端执行第一动作时，所述第一终端根据所述第一动作向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行第一功能，所述第一功能与所述第一动作一一对应。
应理解，第一终端包括的蓝牙模块具有定位功能，也即可以通过如侧向算法确定其他蓝牙终端的位置，并在后续与其他蓝牙终端进行交互时，基于位置信息识别某一方向上是否存在需要进行交互的终端，若存在，则可以进行多终端隔空交互。其中，本申请实施例所涉及的第一终端、第二终端等均为蓝牙设备，也即包括蓝牙模块，其中用于主动进行连 接、识别或者远程控制其他蓝牙设备的终端，其蓝牙模块可以执行蓝牙5.1技术中涉及的测向算法，进行精确定位，而被动接受连接、识别或者控制的蓝牙设备，其蓝牙模块可以支持蓝牙5.1技术中的测向算法，或者也可以不支持蓝牙5.1技术中的测向算法，本申请对此并不限定。例如，当第一终端对第二终端进行识别以及远程控制时，第一终端的蓝牙模块需要支持蓝牙5.1技术中的测向算法，而第二终端则可以不支持该侧向算法；若第二终端对第三终端进行识别以及远程控制时，则第二终端需要支持蓝牙5.1测向算法，而第三终端则可以不支持该测向算法。
根据本申请实施例提供的终端交互的方法，第一终端在首次通过蓝牙模块与第二终端建立连接后，可以存储第二终端的位置信息，当第一终端需要再次识别第二终端时，可以利用第一终端指向的方向和第二终端的位置信息识别第二终端。通过本申请实施例提供的终端交互的方法，多终端可以基于蓝牙精确定位技术进行交互，从而不需要手动操作蓝牙切换，提高终端交互的效率。
结合第一方面，在第一方面的某些实现方式中，所述获取所述第二终端的位置信息，包括：所述蓝牙模块通过波达角AoA测向算法或者发射角AoD测向算法获取所述至少一个第二终端的位置信息。
根据本申请实施例提供的终端交互的方法，第一终端可以通过包括的蓝牙模块进行AoA测向算法或者AoD测向算法，可以实现对其他蓝牙设备的精确定位，其位置精度可以达到1m以内，提高了定位精确度，从而便于第一终端对需要进行交互的终端的精确识别。
结合第一方面，在第一方面的某些实现方式中，所述第一终端根据所述第一动作向所述第二终端发送第一消息，包括：所述第一终端通过动作传感器感应第一动作；所述第一终端根据第一动作向所述第二终端发送第一消息。
结合第一方面，在第一方面的某些实现方式中，所述方法还包括：所述第一终端预先存储所述第一动作与所述第一功能之间的映射关系。
结合第一方面，在第一方面的某些实现方式中，所述动作传感器包括以下一种或多种：加速传感器、陀螺仪传感器、重力传感器、线性加速传感器、旋转向量传感器。
结合第一方面，在第一方面的某些实现方式中，所述方法还包括：当所述第一终端感应到的所述第一动作为上下运动的动作时，所述第一终端向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行改变音量的功能。
结合第一方面，在第一方面的某些实现方式中，所述方法还包括：当所述第一终端感应到的所述第一动作为双击屏幕的动作时，所述第一终端向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行截屏的功能。
结合第一方面，在第一方面的某些实现方式中，所述方法还包括：所述第一终端接收所述第二终端发送的截屏信息；当所述第一终端指向第三终端时，所述第一终端对所述第三终端进行识别；所述第一终端向所述第三终端发送所述截屏信息。
结合第一方面，在第一方面的某些实现方式中，所述方法还包括：所述第一终端指向所述第三终端并对所述第三终端进行识别；所述第一终端向所述第二终端发送第一指示信息，所述第一指示信息用于指示所述第二终端向所述第三终端发送第一信息；所述第一终端向所述第三终端发送第二指示信息，所述第二指示信息用于指示所述第三终端接收所述 第二终端发送的所述第一信息。
结合第一方面，在第一方面的某些实现方式中，所述第一终端包括智能手环、手表或者手机，所述第二终端为音箱或者电视机。
第二方面，提供了一种终端，所述终端包括：蓝牙模块，用于与至少一个第二终端建立连接，并获取所述第二终端的位置信息；处理模块，用于当所述第一终端指向一个所述第二终端的方向时，所述处理模块根据所述位置信息和当前指向的方向识别所述第二终端；发送模块，用于当所述第一终端执行第一动作时，所述发送模块根据所述第一动作向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行第一功能，所述第一功能与所述第一动作一一对应。
应理解，第一终端包括的蓝牙模块具有定位功能，也即可以通过如侧向算法确定其他蓝牙终端的位置，并在后续与其他蓝牙终端进行交互时，基于位置信息识别某一方向上是否存在需要进行交互的终端，若存在，则可以进行多终端隔空交互。其中，本申请实施例所涉及的第一终端、第二终端等均为蓝牙设备，也即包括蓝牙模块，且该蓝牙模块可以执行蓝牙5.1中涉及的测向算法，进行精确定位。
根据本申请实施例提供的终端交互的方法，第一终端在首次通过蓝牙模块与第二终端建立连接后，可以存储第二终端的位置信息，当第一终端需要再次识别第二终端时，可以利用第一终端指向的方向和第二终端的位置信息识别第二终端。通过本申请实施例提供的终端交互的方法，多终端可以基于蓝牙精确定位技术进行交互，从而不需要手动操作蓝牙切换，提高终端交互的效率。
结合第二方面，在第二方面的某些实现方式中，所述蓝牙所述蓝牙模块通过波达角AoA测向算法或者发射角AoD测向算法确定所述至少一个第二终端的位置信息。
结合第二方面，在第二方面的某些实现方式中，所述终端还包括：动作传感器，用于感应所述第一终端发生的第一动作；所述发送模块还用于根据所述第一动作向所述第二终端发送第一消息。
结合第二方面，在第二方面的某些实现方式中，所述处理模块还用于与现存储第一动作与所述第一功能之间的映射关系。
结合第二方面，在第二方面的某些实现方式中，所述动作传感器包括以下一种或多种：加速传感器、陀螺仪传感器、重力传感器、线性加速传感器、旋转向量传感器。
结合第二方面，在第二方面的某些实现方式中，所述发送模块还用于，当所述第一终端感应到的所述第一动作为上下运动的动作时，向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行改变音量的功能。
结合第二方面，在第二方面的某些实现方式中，所述发送模块还用于，当所述第一终端感应到的所述第一动作为双击屏幕的动作时，向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行截屏的功能。
结合第二方面，在第二方面的某些实现方式中，所述终端还包括：接收模块，用于接收所述第二终端发送的截屏信息；所述处理模块，还用于当所述第一终端指向第三终端时，对所述第三终端进行识别；所述发送模块，还用于向所述第三终端发送所述截屏信息。
结合第二方面，在第二方面的某些实现方式中，所述处理模块用于当所述第一终端指向所述第三终端时，对所述第三终端进行识别；发送模块，用于向所述第二终端发送第一 指示信息，所述第一指示信息用于指示所述第二终端向所述第三终端发送第一信息；所述发送模块，还用于向所述第三终端发送第二指示信息，所述第二指示信息用于指示所述第三终端接收所述第二终端发送的所述第一信息。
结合第二方面，在第二方面的某些实现方式中，所述第一终端包括智能手环、手表或者手机，所述第二终端为音箱或者电视机。
第三方面，提供了一种终端，包括至少一个处理器和存储器，所述存储器用于存储计算机程序指令，当所述计算机程序指令在所述至少一个处理器中执行时，使得所述终端实现上文中第一方面的任一种实现方式中所述的方法。
第四方面，提供了一种计算机程序存储介质，所述计算机程序具有程序指令，当所述程序指令被直接或者间接执行时，使得上文中第一方面的任一实现方式中所述的方法得以实现。
根据本申请实施例提供的终端交互的方法及终端，利用蓝牙5.1的测向特性进行多设备交互的方式，省去了手动切换蓝牙连接的过程，提高了交互效率。并且通过隔空才做多终端协同工作的交互模式，使终端交互更加便捷。
附图说明
图1为AoA定位的示意图。
图2为AoA测向算法应用的场景示意图。
图3为AoD定位的示意图。
图4为本申请实施例提供的一种终端交互方法的示意性流程图。
图5为本申请实施例提供的一种蓝牙终端交互的示意图。
图6为本申请实施例提供的一种终端的示意性结构图。
具体实施方式
下面将结合附图，对本申请中的技术方案进行描述。
目前所采用的室内定位方法都由较为明显的缺点：如近邻法精度差；指纹定位法需要提前进行大量的数据采集工作，且室内布局变动会对测量精度由较大的影响；三角测量法理论上精度最高，但仍然受制于室内环境的影响，信号干扰大以及多径效应使得测量精度也难以保证，此外，该方法还需要多个数据源。
而应用于多终端交互场景中的定位方法，需要有较高的精度，以实现准确高效的终端交互。
2019年1月29日，蓝牙技术联盟(Bluetooth Special Interest Group，SIG)宣布蓝牙5.1技术正式公布。蓝牙5.1技术提供了位置查找功能，新功能支持多种确定信号方向的方法，包括到达角AoA测向算法和发射角AoD测向算法。目前实现的新蓝牙功能可以检测5度角内的信号方向。迄今为止，蓝牙跟踪和室内定位解决方案通常提供3-4米范围内的定位精度，借助蓝牙5.1技术解决方案，开发人员能够打造将位置提高到1米以内的产品，从而为以前无法实现的应用打开了大门。SIG称，蓝牙5.1技术的定位精度可以达到厘米级，因此，为实现短程多终端的精准交互，本申请实施例将蓝牙5.1技术的定位功能应用于一种多终端交互的方法中。此外，应理解，本申请实施例提供的终端交互的方法还 可以应用蓝牙5.1技术之后的支持测向算法或其他高精确度定位方法的技术。
为便于理解，首先对蓝牙5.1技术中涉及的波达角或者到达角AoA测向算法和发射角AoD测向算法进行简单介绍。
1、AoA测向算法
图1示出了AoA定位的示意图。
其中，AoA测向算法主要为当信号穿过接收机的天线阵列时，接收机的天线阵列从不同的角度和方向接收该传输信号，由于每个天线接收到的传输信号存在相位差，通过该相位差可以推算出该传输信号的入射角。
作为一个示例，如图2所示，假设接收端有两个间距为d的天线(分别记为A 0和A 1)，接收到的电磁波为平面波，到达角为θ。以天线A1为参考天线，在8μs的参考时间(Reference Period)内对接收信号
Figure PCTCN2020102021-appb-000001
进行锁频，产生一个与之相干的本振信号
Figure PCTCN2020102021-appb-000002
由于到达天线A 0的信号比到达A 1的信号晚Δt，所以天线A 0接收到的信号为
Figure PCTCN2020102021-appb-000003
用本振信号解调的
Figure PCTCN2020102021-appb-000004
于是到达角
Figure PCTCN2020102021-appb-000005
其中，前述所说的e为自然对数，ω c为中心频率对应的角频率，j表示虚数，t表示时间变量，Δt表示到达天线A 0比到达天线A 1晚的时间差值。
应理解，以上描述是为了便于对AoA侧向算法的理解而做的示例性描述，实际中为了提高到达角的估计精度，还可以配备多个天线，天线阵列的排列方式例如可以由一字形、环形、球形等，相应的达到角的计算方法也更为复杂。对于采用不同排列方式的天线阵列对应的到达角的计算方法可以参见现有的计算方法，此处不再赘述。
2、AoD测向算法
图3示出了AoD定位的示意图。
AoD测向算法与AoA测向算法相反，主要通过发射机利用多个天线发射信号，接收机通过接收到的传输信号的相位差推算传输信号从发射机发出的角度。
作为一个示例，假设发射信号的相差为Ψ，波长为λ，两个天线的距离为d，接收到的电磁波为平面波，则发射角可以表示为θ＝arcsin((ψλ)/(2πd))。
以下结合附图对本申请实施例提供的一种终端交互的方法进行介绍。
图4示出了本申请实施例提供的一种终端交互方法的示意性流程图。
其中，本申请实施例提供的终端交互的方法基于蓝牙5.1技术中涉及的测向功能。由蓝牙模块预先与周围其他蓝牙设备建立连接并获取其他蓝牙设备的方向角特性等位置信息，当后续需要再次连接时，蓝牙设备可以自动对特定方向的蓝牙设备进行识别连接，并结合手势完成一系列远距离隔空交互操作。
应理解，本申请示例中所说的第一终端、第二终端和第三终端为蓝牙设备，也即包括蓝牙模块，其中用于主动进行连接、识别或者远程控制其他蓝牙设备的终端，其蓝牙模块可以执行蓝牙5.1技术中涉及的测向算法，进行精确定位，而被动接受连接、识别或者控制的蓝牙设备，其蓝牙模块可以支持蓝牙5.1技术中的测向算法，或者也可以不支持蓝牙5.1技术中的测向算法，本申请对此并不限定。例如，当第一终端对第二终端进行识别以及远程控制时，第一终端的蓝牙模块需要支持蓝牙5.1技术中的测向算法，而第二终端则可以不支持该侧向算法；若第二终端对第三终端进行识别以及远程控制时，则第二终端需要支持蓝牙5.1测向算法，而第三终端则可以不支持该测向算法。。换句话说，本申请实 施例中涉及的终端可以通过蓝牙模块进行定位，且定位的精度远高于目前通过内置红外线发射器的终端的定位精度。本申请实施例提供的终端交互方法主要包括以下步骤。
S401，第一终端通过蓝牙模块预先确定至少一个第二终端的位置信息，并与至少一个第二终端连接。
作为一种实现方式，第一终端是内置有蓝牙模块的设备，例如可以是内置蓝牙模块的可穿戴装备(如手环、手表等)或者也可以是手机。第二终端也为内置蓝牙模块的设备，例如可以是内置蓝牙模块的发声设备(如音箱)或者电视机等。
作为一种实现方式，第一终端在于第二终端进行交互之前，可以预先通过蓝牙模块对周围存在的第二终端进行周期性扫描，并与周围存在的第二终端建立连接(也即完成配对)，且第一终端和第二终端可以预先存储相互的连接信息或者信任信息。
作为一种实现方式，第一终端的蓝牙模块通过AoA测向算法或者AoD测向算法获取第二终端的方向角特性等位置信息，根据该位置信息例如可以确定第二终端所在的方向。其中，第二终端可以是位于第一终端周围短程范围中多个终端中的其中一个，例如，第一终端和第二终端可以分别为处于同一室内的两个蓝牙设备。
S402，当第一终端指向一个第二终端的方向时，第一终端对该第二终端进行识别。
作为一种实现方式，当第一终端需要与某一个第二终端进行交互时，第一终端可以在沿指向第二终端的方向停留一定时长，根据蓝牙模块的定位信息确定当前指向的方向是否存在需要交互的第二终端。当第一终端识别当前方向存在符合条件的第二终端时，第一终端可以激活对第二终端的远程控制模式。其中，第一终端对第二终端的远程控制模式例如可以是，第一终端向第二终端发送用于指示第二终端执行特定功能的指示信息，第二终端根据该指示信息确定执行该特定功能；或者，第一终端执行特定动作触发动作感应器，进而触发第一终端向第二终端发送执行特定功能的指示信息，使得第二终端执行相应的功能。此外，第一终端对第二终端进行识别可以指第一终端根据预先获取的该第二终端的位置信息和当前所指向的方向，确定第二终端为第一终端需要进行交互的终端。
应理解，由于基于蓝牙5.1技术的定位精确度可以达到厘米级，因此，本申请实施例所说的第一终端指向第二终端的方向可以是，第一终端所指向的方向为沿第一终端与第二终端之间连线的方向，或者以该连线的方向为基准，在蓝牙定位技术允许的误差范围内。换句话说，第一终端所指的方向应该在第一终端能够通过蓝牙模块确定第二终端位置所要求的方向范围内。
S403，当第一终端执行第一动作时，该第一终端根据第一动作向第二终端发送第一消息，该第一消息用于指示第二终端执行第一功能，该第一功能与第一动作一一对应。
作为一种实现方式，第一终端可以设置有动作传感器，该动作传感器例如可以是加速传感器、陀螺仪传感器、重力传感器、线性加速传感器或者旋转向量传感器等。第一终端可以通过该动作传感器感应第一动作，该第一动作例如可以是用户使第一终端上下运动的动作或者用户在第一终端的屏幕上进行双击的动作等。示例性的，当第一终端为智能手环时，用户通过上下挥手即可使得第一终端进行上下运动的第一动作，此时，第一终端可以通过设置的加速传感器或者陀螺仪传感器等感应该动作。
作为一种实现方式，第一终端存储有第一动作与第一功能的一一对应关系，其中，第一功能为第一终端期望或者请求第二终端执行的功能，例如音量调节功能或者截屏功能 等。示例性的，上下运动的第一动作对应的而第一功能可以是音量调节功能；或者双击屏幕的第一动对应的第一功能可以是截屏功能。当第一终端感应到第一动作为上下运动的动作时，该第一终端确定请求第二终端执行音量调节的功能，此时，第一终端可以向第二终端发送第一消息，用于请求第二终端执行音量调节功能，具体地，当第一终端感应到的第一动作为向上运动时，对应的第一功能可以是增大音量；当第一终端感应到的第一动作为向下运动时，对应的第一功能可以是减小音量。
作为一种实现方式，当第二终端执行第一功能后还可以向第一终端发送第一信息，该第一信息例如可以是第二终端执行截屏后的截屏图像信息。
作为一种实现方式，第一终端可以进行二次指向识别，也即第一终端可以指向第三终端，并采用与第二终端相似的识别方式进行识别连接。例如，第一终端接收第二终端发送的第一信息后，可以向第三终端发送该第一信息，其中，该第三终端例如可以是显示设备，用于显示第二终端的截屏图像；或者，第三终端可以是音频播放设备，如蓝牙音箱，用于进行音频播放等。示例性的，如图5所示，第一终端与第三终端识别连接后，还可以由第二终端直接向第三终端发送第一信息。具体地，第二终端和第三终端可以处于通过蓝牙连接的状态，当第一终端与第二终端、第三终端分别识别连接后，第一终端可以向第二终端发送第一指示信息，以指示第二终端向第三终端发送第一信息，此外，第一终端还可以向第三终端发送第二指示信息，以指示第三终端接收第二终端发送的第一信息。其中，第一信息例如可以是截屏信息、视频信息、图片信息等，本申请对此不做限定。应理解，此时，各个终端中间可以形成一个基于蓝牙的物联网(Internet of Things，IoT)，第一终端利用指向动作控制其他IoT终端之间的交互，例如，将电视音频投射到蓝牙音箱或者将门禁视频转到电视屏幕等。
根据本申请实施例提供的终端交互的方法，利用蓝牙5.1技术的测向特性进行多设备交互的方式，省去了手动切换蓝牙连接的过程，提高了交互效率。并且通过隔空才做多终端协同工作的交互模式，使终端交互更加便捷。
图6示出了本申请实施例提供的一种终端的示意性结构图。该终端600包括蓝牙模块610，处理模块620和发送模块630。
其中，蓝牙模块610，用于与至少一个第二终端建立连接，并获取所述第二终端的位置信息。
处理模块620，用于当所述第一终端指向一个所述第二终端的方向时，所述处理模块根据所述位置信息和当前指向的方向识别所述第二终端。
发送模块630，用于当所述第一终端执行第一动作时，所述发送模块根据所述第一动作向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行第一功能，所述第一功能与所述第一动作一一对应。
蓝牙模块610还可以用于通过波达角AoA测向算法或者发射角AoD测向算法确定所述至少一个第二终端的位置信息。
此外，该终端600还可以包括动作传感单元，该动作传感单元用于感应所述第一终端发生的第一动作。其中，该动作传感单元可以包括加速传感器、陀螺仪传感器、重力传感器、线性加速传感器、旋转向量传感器等。
发送模块630还可以用于根据所述第一动作向所述第二终端发送第一消息。
处理模块620还可以用于预先存储第一动作与所述第一功能之间的映射关系。
发送模块630还可以用于当所述第一终端感应到的所述第一动作为双击屏幕的动作时，向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行截屏的功能。
终端600还可以包括接收单元，该接收单元可以用于接收所述第二终端发送的截屏信息。
处理模块620还可以用于当所述第一终端指向第三终端时，对所述第三终端进行识别，并通过发送模块630向第三终端发送所述截屏信息。
本领域普通技术人员可以意识到，结合本文中所公开的实施例描述的各示例的单元及算法步骤，能够以电子硬件、或者计算机软件和电子硬件的结合来实现。这些功能究竟以硬件还是软件方式来执行，取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能，但是这种实现不应认为超出本申请的范围。
所属领域的技术人员可以清楚地了解到，为描述的方便和简洁，上述描述的***、装置和单元的具体工作过程，可以参考前述方法实施例中的对应过程，在此不再赘述。
在本申请所提供的几个实施例中，应该理解到，所揭露的***、装置和方法，可以通过其它的方式实现。例如，以上所描述的装置实施例仅仅是示意性的，例如，所述单元的划分，仅仅为一种逻辑功能划分，实际实现时可以有另外的划分方式，例如多个单元或组件可以结合或者可以集成到另一个***，或一些特征可以忽略，或不执行。另一点，所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口，装置或单元的间接耦合或通信连接，可以是电性，机械或其它的形式。
所述作为分离部件说明的单元可以是或者也可以不是物理上分开的，作为单元显示的部件可以是或者也可以不是物理单元，即可以位于一个地方，或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部单元来实现本实施例方案的目的。
另外，在本申请各个实施例中的各功能单元可以集成在一个处理单元中，也可以是各个单元单独物理存在，也可以两个或两个以上单元集成在一个单元中。
所述功能如果以软件功能单元的形式实现并作为独立的产品销售或使用时，可以存储在一个计算机可读取存储介质中。基于这样的理解，本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的部分可以以软件产品的形式体现出来，该计算机软件产品存储在一个存储介质中，包括若干指令用以使得一台计算机设备(可以是个人计算机，服务器，或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括：U盘、移动硬盘、只读存储器(Read-Only Memory，ROM)、随机存取存储器(Random Access Memory，RAM)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述，仅为本申请的具体实施方式，但本申请的保护范围并不局限于此，任何熟悉本技术领域的技术人员在本申请揭露的技术范围内，可轻易想到变化或替换，都应涵盖在本申请的保护范围之内。因此，本申请的保护范围应以所述权利要求的保护范围为准。

Claims (20)

  1. 一种终端交互的方法，其特征在于，包括：
    第一终端通过蓝牙模块与至少一个第二终端建立连接，并获取所述第二终端的位置信息；
    当所述第一终端指向一个所述第二终端的方向时，所述第一终端根据所述位置信息和当前指向的方向识别所述第二终端；
    当所述第一终端执行第一动作时，所述第一终端根据所述第一动作向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行第一功能，所述第一功能与所述第一动作一一对应。
  2. 根据权利要求1所述的方法，其特征在于，所述获取所述第二终端的位置信息，包括：
    所述蓝牙模块通过波达角AoA测向算法或者发射角AoD测向算法获取所述至少一个第二终端的位置信息。
  3. 根据权利要求1或2所述的方法，其特征在于，所述第一终端根据所述第一动作向所述第二终端发送第一消息，包括：
    所述第一终端通过动作传感器感应第一动作；
    所述第一终端根据第一动作向所述第二终端发送第一消息。
  4. 根据权利要求3所述的方法，其特征在于，所述方法还包括：
    所述第一终端预先存储所述第一动作与所述第一功能之间的映射关系。
  5. 根据权利要求3或4所述的方法，其特征在于，所述动作传感器包括以下一种或多种：
    加速传感器、陀螺仪传感器、重力传感器、线性加速传感器、旋转向量传感器。
  6. 根据权利要求1-5中任一项所述的方法，其特征在于，所述方法还包括：
    当所述第一终端感应到的所述第一动作为上下运动的动作时，所述第一终端向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行改变音量的功能。
  7. 根据权利要求1-5中任一项所述的方法，其特征在于，所述方法还包括：
    当所述第一终端感应到的所述第一动作为双击屏幕的动作时，所述第一终端向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行截屏的功能。
  8. 根据权利要求7所述的方法，其特征在于，所述方法还包括：
    所述第一终端接收所述第二终端发送的截屏信息；
    当所述第一终端指向第三终端时，所述第一终端对所述第三终端进行识别；
    所述第一终端向所述第三终端发送所述截屏信息。
  9. 根据权利要求1-7中任一项所述的方法，其特征在于，所述方法还包括：
    所述第一终端指向第三终端并对所述第三终端进行识别；
    所述第一终端向所述第二终端发送第一指示信息，所述第一指示信息用于指示所述第二终端向所述第三终端发送第一信息；
    所述第一终端向所述第三终端发送第二指示信息，所述第二指示信息用于指示所述第 三终端接收所述第二终端发送的所述第一信息。
  10. 根据权利要求1-9中任一项所述的方法，其特征在于，所述第一终端包括智能手环、手表或者手机，所述第二终端为音箱或者电视机。
  11. 一种终端，其特征在于，所述终端包括：
    蓝牙模块，用于与至少一个第二终端建立连接，并获取所述第二终端的位置信息；
    处理模块，用于当所述第一终端指向一个所述第二终端的方向时，所述处理模块根据所述位置信息和当前指向的方向识别所述第二终端；
    发送模块，用于当所述第一终端执行第一动作时，所述发送模块根据所述第一动作向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行第一功能，所述第一功能与所述第一动作一一对应。
  12. 根据权利要求11所述的终端，其特征在于，所述蓝牙模块通过波达角AoA测向算法或者发射角AoD测向算法确定所述至少一个第二终端的位置信息。
  13. 根据权利要求11或12所述的终端，其特征在于，所述终端还包括：
    动作传感器，用于感应所述第一终端发生的第一动作；
    所述发送模块还用于根据所述第一动作向所述第二终端发送第一消息。
  14. 根据权利要求11-13中任一项所述的终端，其特征在于，所述处理模块还用于预先存储第一动作与所述第一功能之间的映射关系。
  15. 根据权利要求13或14所述的终端，其特征在于，所述动作传感器包括以下一种或多种：
    加速传感器、陀螺仪传感器、重力传感器、线性加速传感器、旋转向量传感器。
  16. 根据权利要求11-15中任一项所述的终端，其特征在于，所述发送模块还用于，当所述第一终端感应到的所述第一动作为上下运动的动作时，向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行改变音量的功能。
  17. 根据权利要求11-15中任一项所述的终端，其特征在于，所述发送模块还用于，当所述第一终端感应到的所述第一动作为双击屏幕的动作时，向所述第二终端发送第一消息，所述第一消息用于指示所述第二终端执行截屏的功能。
  18. 根据权利要求17所述的终端，其特征在于，所述终端还包括：
    接收模块，用于接收所述第二终端发送的截屏信息；
    所述处理模块，还用于当所述第一终端指向第三终端时，对所述第三终端进行识别；
    所述发送模块，还用于向所述第三终端发送所述截屏信息。
  19. 根据权利要求11-17中任一项所述的终端，其特征在于，所述处理模块用于当所述第一终端指向第三终端时，对所述第三终端进行识别；
    发送模块，用于向所述第二终端发送第一指示信息，所述第一指示信息用于指示所述第二终端向所述第三终端发送第一信息；
    所述发送模块，还用于向所述第三终端发送第二指示信息，所述第二指示信息用于指示所述第三终端接收所述第二终端发送的所述第一信息。
  20. 根据权利要求11-19中任一项所述的终端，其特征在于，所述第一终端包括智能手环、手表或者手机，所述第二终端包括音箱或者电视机。
PCT/CN2020/102021 2019-08-05 2020-07-15 终端交互的方法及终端 WO2021022981A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP20849447.6A EP3986006A4 (en) 2019-08-05 2020-07-15 TERMINAL INTERACTION METHOD AND TERMINAL
US17/626,692 US11991594B2 (en) 2019-08-05 2020-07-15 Terminal interaction method and terminal

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910717178.0A CN110557741B (zh) 2019-08-05 2019-08-05 终端交互的方法及终端
CN201910717178.0 2019-08-05

Publications (1)

Publication Number Publication Date
WO2021022981A1 true WO2021022981A1 (zh) 2021-02-11

Family

ID=68737072

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/102021 WO2021022981A1 (zh) 2019-08-05 2020-07-15 终端交互的方法及终端

Country Status (4)

Country Link
US (1) US11991594B2 (zh)
EP (1) EP3986006A4 (zh)
CN (1) CN110557741B (zh)
WO (1) WO2021022981A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115038042A (zh) * 2021-10-22 2022-09-09 荣耀终端有限公司 无线连接方法、电子设备及图形界面

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110557741B (zh) 2019-08-05 2021-08-13 华为技术有限公司 终端交互的方法及终端
CN111405508A (zh) * 2020-02-19 2020-07-10 华为技术有限公司 可穿戴设备的定位方法及可穿戴设备
CN111882846B (zh) * 2020-03-05 2021-07-06 珠海市杰理科技股份有限公司 无线控制方法、装置、ble设备、芯片及存储介质
CN111583484A (zh) * 2020-04-02 2020-08-25 北京声智科技有限公司 设备控制方法、装置、电子设备及计算机可读存储介质

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271363A1 (en) * 2012-04-16 2013-10-17 Amir POZNANSKY Electronic Remote Control Thimble
CN103703495A (zh) * 2013-08-23 2014-04-02 华为技术有限公司 一种遥控器、信息处理方法及***
CN106356082A (zh) * 2016-09-26 2017-01-25 北京小米移动软件有限公司 控制方法、控制***及相应的装置
CN106447855A (zh) * 2016-09-19 2017-02-22 深圳博科智能科技有限公司 一种基于摇一摇开锁的方法及终端设备
CN106663366A (zh) * 2014-07-25 2017-05-10 7哈格斯实验室 用于确定和控制待控设备的方法，实施这些方法的装置、使用和***
CN106713598A (zh) * 2015-07-24 2017-05-24 中兴通讯股份有限公司 基于指示方向的指令传输方法及装置、智能设备
CN108073372A (zh) * 2017-11-13 2018-05-25 成都创慧科达科技有限公司 一种打印机控制方法以及打印控制***
CN108684023A (zh) * 2018-04-25 2018-10-19 江沛岭 一种以手势动作互联多个蓝牙设备的控制方法
CN110557741A (zh) * 2019-08-05 2019-12-10 华为技术有限公司 终端交互的方法及终端

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090180451A1 (en) * 2008-01-10 2009-07-16 Comsys Communication & Signal Processing Ltd. Apparatus for and method of coordinating transmission and reception opportunities in a communications device incorporating multiple radios
US8014791B2 (en) * 2008-06-30 2011-09-06 Intelligent Sciences, Ltd. Method and system for determining position of a wireless electronic device within a volume
US11025475B2 (en) * 2012-12-05 2021-06-01 Origin Wireless, Inc. Method, apparatus, server, and systems of time-reversal technology
US9235845B2 (en) * 2010-08-27 2016-01-12 Intel Corporation Intelligent remote control system
US20120238216A1 (en) * 2011-03-17 2012-09-20 Polycom, Inc. Systems and methods for managing bluetooth device pairings
US20130283351A1 (en) * 2012-04-18 2013-10-24 Nokia Corporation Method and apparatus for configuring services based on touch selection
US20150168174A1 (en) * 2012-06-21 2015-06-18 Cellepathy Ltd. Navigation instructions
US20160249164A1 (en) * 2015-02-25 2016-08-25 Qualcomm Incorporated Techniques for use in determining a position using visible light communication
CN104699244B (zh) * 2015-02-26 2018-07-06 小米科技有限责任公司 智能设备的操控方法及装置
WO2016191875A1 (en) 2015-06-04 2016-12-08 Griffin Innovation Device and method for controlling a plurality of targeted devices
US10863003B2 (en) * 2015-09-10 2020-12-08 Elliot Berookhim Methods, devices, and systems for determining a subset for autonomous sharing of digital media
US10691473B2 (en) * 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
CN106897038A (zh) * 2015-12-17 2017-06-27 北京传送科技有限公司 一种投屏***
CN106899740A (zh) * 2015-12-17 2017-06-27 北京传送科技有限公司 一种手机盒子
US20180115858A1 (en) * 2016-10-21 2018-04-26 Qualcomm Incorporated Systems and methods for connecting wireless communication devices
KR102477489B1 (ko) 2017-05-16 2022-12-13 애플 인크. 디지털 어시스턴트 서비스의 원거리 확장
US10620721B2 (en) * 2018-01-29 2020-04-14 Google Llc Position-based location indication and device control
US11307752B2 (en) * 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
KR20200144846A (ko) * 2019-06-19 2020-12-30 삼성전자주식회사 외부 장치의 위치 정보를 결정하기 위한 전자 장치 및 그의 동작 방법

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130271363A1 (en) * 2012-04-16 2013-10-17 Amir POZNANSKY Electronic Remote Control Thimble
CN103703495A (zh) * 2013-08-23 2014-04-02 华为技术有限公司 一种遥控器、信息处理方法及***
CN106663366A (zh) * 2014-07-25 2017-05-10 7哈格斯实验室 用于确定和控制待控设备的方法，实施这些方法的装置、使用和***
CN106713598A (zh) * 2015-07-24 2017-05-24 中兴通讯股份有限公司 基于指示方向的指令传输方法及装置、智能设备
CN106447855A (zh) * 2016-09-19 2017-02-22 深圳博科智能科技有限公司 一种基于摇一摇开锁的方法及终端设备
CN106356082A (zh) * 2016-09-26 2017-01-25 北京小米移动软件有限公司 控制方法、控制***及相应的装置
CN108073372A (zh) * 2017-11-13 2018-05-25 成都创慧科达科技有限公司 一种打印机控制方法以及打印控制***
CN108684023A (zh) * 2018-04-25 2018-10-19 江沛岭 一种以手势动作互联多个蓝牙设备的控制方法
CN110557741A (zh) * 2019-08-05 2019-12-10 华为技术有限公司 终端交互的方法及终端

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3986006A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115038042A (zh) * 2021-10-22 2022-09-09 荣耀终端有限公司 无线连接方法、电子设备及图形界面
CN115038042B (zh) * 2021-10-22 2023-04-14 荣耀终端有限公司 无线连接方法、电子设备及图形界面

Also Published As

Publication number Publication date
EP3986006A1 (en) 2022-04-20
CN110557741A (zh) 2019-12-10
US20220322042A1 (en) 2022-10-06
US11991594B2 (en) 2024-05-21
CN110557741B (zh) 2021-08-13
EP3986006A4 (en) 2022-08-10

Similar Documents

Publication Publication Date Title
WO2021022981A1 (zh) 终端交互的方法及终端
US9462108B2 (en) Mobile terminal and method for controlling the mobile terminal
US9681268B2 (en) Mobile device position detection
US10708743B2 (en) Service sharing device and method
CN106713598B (zh) 基于指示方向的指令传输方法及装置、智能设备
WO2013123697A1 (zh) 一种共享设备的确定方法和文件传输方法以及***
US20150035762A1 (en) Electronic device and pairing method thereof
CN108769893B (zh) 一种终端检测方法及终端
KR101680667B1 (ko) 이동 단말기 및 이동 단말기의 제어방법
WO2021143685A1 (zh) 定位方法及通信设备
WO2022160966A1 (zh) 一种uwb***下新增基站的初始化方法、终端以及***
US11277711B2 (en) Electronic device for determining location information of external device
KR101644608B1 (ko) 가시 범위 내 통신대상 인식을 위한 단말 및 그 방법
US20220201434A1 (en) Coverage extension for device localization through collaborative ranging
KR20170083328A (ko) 모바일 디바이스 및 모바일 디바이스의 제어방법
WO2022143089A1 (zh) 一种室内定位方法、终端以及***
KR102169688B1 (ko) 장소정보 제공방법 및 그 시스템
Jian et al. Hybrid cloud computing for user location-aware augmented reality construction
KR20170071334A (ko) 이동 단말기 및 그의 동작 방법
CN115150646B (zh) 一种显示第二电子设备控制窗口的方法及第一电子设备
EP4373139A1 (en) Method and electronic device for searching for external device through positioning angle adjustment
CN114915915B (zh) 一种室内多个设备的定位***
CN113347710B (zh) 一种定位方法和相关装置
CN118160327A (zh) 通过定位角调整来搜索外部装置的方法和电子装置
KR20230049525A (ko) 측위 각도 조정을 통해 외부 장치 검색 방법 및 전자 장치

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20849447

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2020849447

Country of ref document: EP

Effective date: 20220114

NENP Non-entry into the national phase

Ref country code: DE