WO2020220154A1 - Screen display switching method, display device, and movable platform - Google Patents

Screen display switching method, display device, and movable platform Download PDF

Info

Publication number
WO2020220154A1
WO2020220154A1 PCT/CN2019/084713 CN2019084713W WO2020220154A1 WO 2020220154 A1 WO2020220154 A1 WO 2020220154A1 CN 2019084713 W CN2019084713 W CN 2019084713W WO 2020220154 A1 WO2020220154 A1 WO 2020220154A1
Authority
WO
WIPO (PCT)
Prior art keywords
finger
double
screen
click
state
Prior art date
Application number
PCT/CN2019/084713
Other languages
French (fr)
Chinese (zh)
Inventor
王根源
何宇坤
陈奋
Original Assignee
深圳市大疆创新科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市大疆创新科技有限公司 filed Critical 深圳市大疆创新科技有限公司
Priority to PCT/CN2019/084713 priority Critical patent/WO2020220154A1/en
Priority to CN201980008901.6A priority patent/CN111656313A/en
Publication of WO2020220154A1 publication Critical patent/WO2020220154A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G06F3/1431Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units

Definitions

  • the embodiment of the present invention relates to the field of control technology, in particular to a screen display switching method, a display device, and a movable platform.
  • the embodiment of the present invention provides a screen display switching method, a display device, and a movable platform.
  • an embodiment of the present invention provides a screen display switching method, which is applied to a display device provided with a first screen and a second screen, and the screen display switching method includes:
  • control instruction is a screen cut instruction
  • the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
  • an embodiment of the present invention provides a display device, including a first screen, a second screen, and a processor; the processor is connected to the first screen and the second screen respectively; the processor is Configured as:
  • control instruction is a screen cut instruction
  • the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
  • an embodiment of the present invention provides a movable platform that includes a body, a power supply battery provided on the body, a power system, a flight controller, and the display device according to the second aspect, and the power supply battery can Power is supplied to the power system, and the power system provides flight power for the drone.
  • an embodiment of the present invention provides a machine-readable storage medium having several computer instructions stored on the machine-readable storage medium, and the computer instructions implement the steps of the method described in the first aspect when executed.
  • control commands input by the user in this embodiment can include multiple types, and are not limited to existing physical hardware or virtual buttons, and can ensure that screen display switching can be achieved in as many application scenarios as possible, especially in extreme sports scenarios. , To achieve the effect of quickly switching screens, which is conducive to improving the user experience.
  • Figure 1 is a flowchart of a screen display switching method provided by an embodiment of the present invention
  • FIG. 2 is a flowchart of obtaining a control instruction according to an embodiment of the present invention
  • FIG. 3 is another flow chart of obtaining control instructions according to an embodiment of the present invention.
  • FIG. 4 is another flow chart of obtaining a control instruction according to an embodiment of the present invention.
  • FIG. 5 is a flowchart of obtaining a double-finger double-click event according to an embodiment of the present invention.
  • FIG. 6 is another flowchart of obtaining a two-finger double-click event provided by an embodiment of the present invention.
  • FIG. 7 is a flowchart of adjusting the number of double-finger double-clicks according to an embodiment of the present invention.
  • FIG. 8 is another flow chart for adjusting the number of double-finger double-clicks according to an embodiment of the present invention.
  • FIG. 9 is another flowchart for detecting a double-finger double-tap event provided by an embodiment of the present invention.
  • FIG. 10 is another flowchart for adjusting the number of double-finger double-clicks according to an embodiment of the present invention.
  • FIG. 11 is another flowchart of adjusting the number of double-finger double-clicks according to an embodiment of the present invention.
  • FIG. 12 is another flowchart of adjusting the number of double-finger double-clicks according to an embodiment of the present invention.
  • FIG. 13 is a flowchart of another screen display switching provided by an embodiment of the present invention.
  • FIG. 14 is a flowchart of another screen display switching provided by an embodiment of the present invention.
  • the embodiment of the present invention provides a screen display switching method.
  • the inventive idea is to set a variety of control instructions to facilitate the display device to switch between the two screens after receiving the control instructions, thereby improving the switching efficiency so that The display device is adapted to more application scenarios.
  • Figure 1 is a flowchart of a screen display switching method provided by an embodiment of the present invention, which can be applied to a display device provided with a first screen and a second screen, where the display device can be an electronic device such as a smart terminal, a tablet computer, etc. It can be at least one movable platform among unmanned aerial vehicles, automobiles, remote control vehicles, robots, and cameras. It is understandable that a processor is also provided in the display device, and the processor can execute a screen display switching method, and the following description of the embodiments is based on the processor.
  • the positions of the first screen and the second screen may be fixed or not.
  • the first screen and the second screen may correspond to designated screens, that is, the corresponding relationship is fixed.
  • the first screen refers to the screen on the front of the display device
  • the second screen refers to the screen on the back of the display device, that is, the first screen and The second screens are respectively located on two different sides of the display device.
  • any one of the multiple screens may be the first screen or the second screen, that is, the first screen and the second screen can correspond to the currently displayed screen and the screen to be switched to, That is, the corresponding relationship is not fixed.
  • a screen display switching method includes:
  • step 101 a control instruction input by a user is acquired.
  • the processor of the display device may communicate with sensors in the display device, where the sensors may include one or more of a touch screen, a voice collection module, and a camera. Based on the sensor in the display device, the manner of the control instruction input by the user may also include at least one of the following: voice input, operation of the screen cut button, and preset gesture operation.
  • the user when the display device is provided with a voice collection module, the user can input voice to the voice collection module, so that the voice collection module can collect the user's voice.
  • keywords are also preset in the voice device, so that the processor obtains the control instructions input by the user. See Figure 2, which may include: the processor can communicate with the voice collection module, and the voice collection The module collects voice data in real time or periodically, so that the processor can obtain the voice data collected by the voice collection module (corresponding to step 201). Then, the processor can parse the voice data to obtain text data (corresponding to step 202).
  • the speech analysis algorithm can use speech recognition algorithms and speech analysis algorithms in related technologies, such as Mel Frequency Cepstral Coefficient (MFCC).
  • MFCC Mel Frequency Cepstral Coefficient
  • the processor can detect whether the text data includes a preset keyword, and if it includes, it determines that the keyword corresponding to the voice is a control instruction input by the user (corresponding to step 203).
  • the preset keywords may include, but are not limited to: switch screen, switch screen, screen switch, switch, or invisible on this screen. These keywords can be stored locally in the display device in the form of a table or database to facilitate the processor to read.
  • control instruction is input by voice, so that the user's activity range can be greatly increased, that is, the user's use position is not restricted, which is beneficial to expand the application scenarios of the display device.
  • the touch screen includes a screen cut button, so that the processor obtains the control instruction input by the user, as shown in Figure 3, including: the processor can communicate with the first screen and the second screen, so that the screen cut button (corresponding to Step 301). If it is monitored that the user operates the screen cut button and the preset operating condition is met, it is determined that the control instruction input by the user is acquired (corresponding to step 302).
  • the preset operating conditions may include, but are not limited to: the screen-cutting button has been pressed for more than a preset time period, and has been continuously clicked multiple times. In this example, by setting the screen cutting button, it is convenient for the user to directly operate the screen cutting button and improve the screen cutting efficiency.
  • the user can perform gesture operations on the touch screen, including tap, slide, two-finger drag, two-finger double-tap, two-finger slide, double-click, three-finger slide and other gesture operations.
  • gesture operations including tap, slide, two-finger drag, two-finger double-tap, two-finger slide, double-click, three-finger slide and other gesture operations.
  • Setting the gesture operation in the case that the display device can obtain the user control instruction, the corresponding gesture operation falls into the protection scope of this application.
  • a preset gesture may also be set in the display device, and the preset gesture may be used as a control instruction, which may include at least one of the following: two-finger double-tap, two-finger sliding, single-tap double-tap, and three-finger sliding.
  • the processor obtains the control instruction input by the user, referring to FIG. 4, which may include: the processor may be communicatively connected to the first screen and the second screen, respectively, the first screen and the second screen may be touch screens, and can detect that the user is directed to the first screen Touch operation on one screen and/or second screen. Taking the touch operation of the first screen as an example, the processor may monitor the touch operation of the first screen (corresponding to step 401). then.
  • the processor determines whether the preset gesture is included in the touch operation, and if the preset gesture is included, the processor determines that the control instruction input by the user is acquired (corresponding to step 402).
  • the processor determines whether the preset gesture is included in the touch operation, and if the preset gesture is included, the processor determines that the control instruction input by the user is acquired (corresponding to step 402).
  • the processor determines whether the preset gesture is included in the touch operation, as shown in Figure 5, including: the processor can detect whether the user's finger has been pressed by communicating with the touch screen . If it is detected that the user has pressed a finger, the processor records the current touch time of each finger; the fingers include the first finger and the second finger (corresponding to step 501). The first finger and the second finger are not specific fingers, but the first finger is the first finger, and the second finger is the second finger. Then, the processor detects whether the first finger and the second finger are lifted, and determines whether a two-finger double-tap event is detected according to the detection result (corresponding to step 502).
  • the processor determines whether a two-finger double-tap event is detected according to the detection result, see Figure 6, including: for the second finger, if the second finger is detected to be lifted, the processor is based on the second finger lifted corresponding current Time, the last release time of the second finger and the set duration adjust the number of double-finger releases (corresponding to step 601). For example, referring to FIG. 7, the processor determines whether the difference between the current time corresponding to the second finger lifting and the last release time of the second finger exceeds the set time period (corresponding to step 701). If it exceeds the set time period, adjust the two-finger double-click release times to the first state; if not, maintain the current state of the two-finger double-click release times (corresponding to step 702).
  • the setting duration can be set according to specific scenarios, for example, 500ms ⁇ 1000ms. Then, the number of two-finger double-tap releases and the release time of the second finger are adjusted based on the offset of the second finger and the set threshold (corresponding to step 602). For example, referring to FIG. 8, the processor may determine the offset between the raised position and the pressed position of the second finger, and determine whether the offset exceeds a set threshold (corresponding to step 801). If the offset exceeds the set threshold, adjust the number of two-finger double-click releases to the second state; if the offset is less than the set threshold, adjust the number of two-finger double-click releases to the next state of the current state (corresponding to step 802 ).
  • the number of two-finger double-tap releases can include the first state (that is, the number of times is 0), the second state (that is, the number of times is 1), and the third state (that is, the number of times is 1). 2).
  • the processor determines whether a two-finger double-tap event is detected according to the detection result, see FIG. 9, including: for the first finger, if the first finger is detected to be lifted, the processor records the lift of the first finger The offset coordinates of the position and the pressed position, and the adjustment of the single-finger double-click release times (corresponding to step 901). Referring to Figure 10, the processor adjusts the single-finger double-click release times including:
  • the setting duration can be set according to specific scenarios, for example, 500ms ⁇ 1000ms. If it is longer than the set duration, the processor adjusts the single-finger double-click release times to the second state; if not, adjusts the single-finger double-click release times to the next state of the current state (corresponding to step 1002).
  • the processor can determine the current state of the single-finger double-click release times (corresponding to step 902). If the number of single-finger double-click releases is in the second state, the status of the single-finger double-click release number is adjusted based on the offset of the first finger and the set threshold (corresponding to step 903).
  • the processor adjusts the state of the number of single-finger double tap releases based on the offset of the first finger and the set threshold. See FIG. 11, which may include: the processor may determine whether the offset of the first finger exceeds the set threshold (corresponding to Step 1101). If yes, the processor adjusts the two-finger double-click release times to the first state; if not, the processor maintains the current state of the two-finger double-click release times (corresponding to step 1102).
  • the processor determines whether the current position of the first finger is within the set range of the previous click position if the single-finger double-click release times is the third state; If it is within the set range of the previous click position, it is determined that a single-finger double-click event is detected.
  • the setting range can be adjusted according to a specific scene, for example, it can be a rectangular area of 120 pixels*120 pixels.
  • the processor adjusts the state of the number of double-finger double-tap release times based on the last release time of the first finger and the touch time of the second finger, and records the release time of the first finger (corresponding to step 904). After that, the processor judges the current state of the two-finger double-click release times, and if the two-finger double-click release times is the third state, it determines that the two-finger double-click event is detected (corresponding to step 905).
  • the processor adjusts the state of the two-finger double-tap release times based on the last release time of the first finger and the touch time of the second finger. See FIG. 12, which may include: the processor determines whether the last release time of the first finger is greater than that of the second finger Touch time (corresponding to step 1201). If yes, adjust the two-finger double-click release times to the next state of the current state; if not, maintain the current state of the two-finger double-click release times (corresponding to step 1202).
  • the processor determines whether the two-finger double-click release times are in the third state, and if the two-finger double-click release times are in the third state, it determines that a two-finger double-click event is detected (corresponding to step 603).
  • a touch screen is provided on the display device as an example to describe the content of the two-finger double-click operation. It is understandable that when a camera is provided on the display device, if the user swings two fingers back and forth in the air twice, the camera can collect an image or video of the user's hand, and analyze the user's gesture, which can also determine the user's gesture It is a two-finger double-tap gesture.
  • the gesture analysis can be implemented by using the target tracking algorithm in the related technology, and the specific solution can be referred to in the related technology, which will not be described here.
  • step 102 if the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays the image corresponding to the data code stream .
  • the processor may generate a screen cutting message and send it to the screen cutting module after determining that the control instruction is a screen cutting instruction.
  • the screen cutting module stops the current screen, which is the first screen Liveview (a graphical tool)/OSD (On-Screen Display, screen menu adjustment method) based on the screen cutting message, that is, stops inputting the data stream to the current screen.
  • the processor switches the data stream to another screen, the second screen. After restarting Liveview/OSD, the corresponding image will be displayed on the second screen to complete the screen switching.
  • control commands input by the user in this embodiment can include multiple types, and are not limited to existing physical hardware or virtual buttons, and can ensure that screen display switching can be achieved in as many application scenarios as possible, especially in extreme sports scenarios. , To achieve the effect of quickly switching screens, which is conducive to improving the user experience.
  • the screen cut button can be a physical button or a virtual button, and the timer T starts.
  • the counting of timer T is stopped and it is judged whether T is greater than (including equal to) the set duration of 500ms. If T is less than 500ms, check whether the screen cutting button is pressed again. If T is greater than 500ms, it is determined that screen switching is required to generate a screen cutting message and send it to the screen cutting module.
  • the screen cut module stops the data stream to the current screen, that is, the current screen stops Liveview/OSD. Switch the data stream to another screen, restart Liveview/OSD, and display the corresponding content on another screen to complete the screen cut operation.
  • the voice data is text analyzed and the keywords in the text data are recognized. If the keywords are not preset keywords, the voice data is collected again If it is a preset keyword, it is determined that screen switching is required to generate a screen cutting message and send it to the screen cutting module.
  • the screen cut module stops the data stream to the current screen, that is, the current screen stops Liveview/OSD. Switch the data stream to another screen, restart Liveview/OSD, and display the corresponding content on another screen to complete the screen cut operation.
  • finger 0 and finger 1 are all outside the hot zone, re-check whether they are pressed; if one is outside the hot zone, the finger that does not exceed the hot zone becomes finger 1, and the other The finger becomes finger 0 and re-detects.
  • finger 0 and finger 1 are all in the hot zone, it includes:
  • the offset x coordinate and y coordinate of the lifted position and the clicked position of the finger 0 are recorded, namely dx and dy. Then, calculate whether the difference between the current time and the current touch time LastTouchT exceeds 500ms. If it exceeds, the single-finger double-click release times ReleaseCnt is cleared and added to 1 (that is, adjusted to the second state), if it is less than the single-finger double-click release times ReleaseCnt is added 1 (adjust to the next state of the current state).
  • the release number of single-finger double-click ReleaseCnt is in the second state, the x coordinate TouchHitXLast and the y coordinate TouchHitYLast of the current click position are recorded. If the single-finger double-click release times ReleaseCnt is in the third state, it is determined whether the current position is within the range of 120*120 of the upper click position, if it is determined that a single-finger double-click event has been detected, if not, then transition to the next step.
  • DoubleLastTouchT calculates whether the difference between the current time and the current touch time DoubleLastTouchT exceeds 500ms, if it exceeds, clear the number of double-finger double-click releases ReleaseTouchCnt to zero (ie adjust to the first state) and determine the offset dx Whether /dy exceeds the setting range of 120*120; if it is smaller, judge whether the offset dx/dy exceeds the setting range of 120*120.
  • the screen cut module stops the data stream to the current screen, that is, the current screen stops Liveview/OSD. Switch the data stream to another screen, restart Liveview/OSD, and display the corresponding content on another screen to complete the screen cut operation.
  • An embodiment of the present invention also provides a display device, including a first screen, a second screen, and a processor; the processor is connected to the first screen and the second screen respectively; the processor is configured to :
  • control instruction is a screen cut instruction
  • the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
  • the manner of the control instruction input by the user includes at least one of the following: voice input, operation of the screen cut button, and preset gesture operation.
  • the processor is configured to obtain a control instruction input by the user, including:
  • the text data includes a preset keyword, and if it includes, it is determined that the keyword corresponding to the voice is a control instruction input by the user.
  • the processor being configured to obtain the control instruction input by the user includes:
  • the processor being configured to obtain the control instruction input by the user includes:
  • the control instruction input by the user is acquired.
  • the preset gesture operation includes at least one of the following: two-finger double-tap, two-finger sliding, single-tap double-tap, and three-finger sliding.
  • the processor is configured to determine whether the touch operation includes a preset gesture, including:
  • the finger If it is detected that the user has pressed a finger, record the current touch time of each finger; the finger includes a first finger and a second finger;
  • the processor is configured to determine whether a two-finger double-tap event is detected according to the detection result, including:
  • the current time corresponding to the second finger lift, the last release time of the second finger and the set duration are adjusted based on the current time.
  • the processor is configured to adjust the number of two-finger double-tap releases based on the current time corresponding to the lifting of the second finger, the last release time of the second finger, and the set duration ,include:
  • the processor configured to adjust the number of two-finger double-tap releases based on the offset of the second finger and a set threshold includes:
  • the processor being configured to determine whether a two-finger double-tap event is detected according to the detection result includes:
  • the first finger For the first finger, if it is detected that the first finger is lifted, recording the offset coordinates of the lifted position and the pressed position of the first finger, and adjusts the number of times the single-finger double-click release;
  • the processor is configured to adjust the number of single-finger double-click releases, including:
  • the number of single-finger double-click releases is adjusted to the second state; if not, the number of single-finger double-click releases is adjusted to the next state of the current state.
  • the processor configured to adjust the state of the number of two-finger double-click releases based on the offset of the first finger and a set threshold includes:
  • the processor configured to adjust the state of the number of releases of the two-finger double tap based on the last release time of the first finger and the touch time of the second finger includes:
  • the processor after the processor is configured to determine the current state of the single-finger double-click release times, it is further configured to include:
  • the first screen and the second screen are respectively located on two different sides of the display device.
  • the embodiment of the present invention also provides a movable platform, including a body, a power supply battery provided on the body, a power system, a flight controller, and the display device as described in the above embodiment, the power supply battery can be The power system supplies power, and the power system provides flight power for the drone.
  • the embodiment of the present invention also provides a machine-readable storage medium, the machine-readable storage medium stores a number of computer instructions, and when the computer instructions are executed, the steps of the screen display switching method described in FIGS. 1 to 14 are implemented .

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Provided are a screen display switching method, display device, and movable platform. The screen display switching method is applied to a display device provided with a first screen and a second screen, and said screen display switching method comprises: obtaining a control instruction inputted by a user (101); if said control instruction is a screen-switch instruction, then switching to a second screen the data code stream inputted to a first screen, said second screen displaying an image corresponding to said data code stream (102). The control instruction entered by the user may comprise multiple types, and is not limited to existing physical hardware or virtual buttons, and can ensure that in as many application scenarios as possible, particularly in extreme sports scenarios, screen display switching is accomplished, thus achieving the effect of quickly switching screens, which is conducive to improving user experience.

Description

屏幕显示切换方法、显示设备、可移动平台Screen display switching method, display device, and movable platform 技术领域Technical field
本发明实施例涉及控制技术领域,尤其涉及屏幕显示切换方法、显示设备、可移动平台。The embodiment of the present invention relates to the field of control technology, in particular to a screen display switching method, a display device, and a movable platform.
背景技术Background technique
目前,现有的小型显示设备,例如运动相机,较少采用双屏幕。部分具有双屏幕的显示设备因屏幕面积较小,则采用物理硬件或者虚拟按钮来进行切换。然而,上述屏幕切换方式无法适应于一些应用场景(例如极限运动),导致用户体验较差。Currently, existing small display devices, such as sports cameras, rarely use dual screens. Some display devices with dual screens use physical hardware or virtual buttons to switch due to their small screen area. However, the aforementioned screen switching method cannot be adapted to some application scenarios (for example, extreme sports), resulting in poor user experience.
发明内容Summary of the invention
本发明实施例提供一种屏幕显示切换方法、显示设备、可移动平台。The embodiment of the present invention provides a screen display switching method, a display device, and a movable platform.
第一方面,本发明实施例提供一种屏幕显示切换方法,应用于设置有第一屏幕和第二屏幕的显示设备,所述屏幕显示切换方法包括:In a first aspect, an embodiment of the present invention provides a screen display switching method, which is applied to a display device provided with a first screen and a second screen, and the screen display switching method includes:
获取用户输入的控制指令;Obtain the control instructions input by the user;
若所述控制指令为切屏指令,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,所述第二屏幕显示所述数据码流对应的图像。If the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
第二方面,本发明实施例提供一种显示设备,包括第一屏幕、第二屏幕和处理器;所述处理器分别与所述第一屏幕和所述第二屏幕连接;所述处理器被配置为:In the second aspect, an embodiment of the present invention provides a display device, including a first screen, a second screen, and a processor; the processor is connected to the first screen and the second screen respectively; the processor is Configured as:
获取用户输入的控制指令;Obtain the control instructions input by the user;
若所述控制指令为切屏指令,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,所述第二屏幕显示所述数据码流对应的图像。If the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
第三方面,本发明实施例提供一种可移动平台,包括机体、设于所述机体上的供电电池、动力***、飞行控制器和如第二方面所述的显示设备, 所述供电电池能够为所述动力***供电,所述动力***为所述无人机提供飞行动力。In a third aspect, an embodiment of the present invention provides a movable platform that includes a body, a power supply battery provided on the body, a power system, a flight controller, and the display device according to the second aspect, and the power supply battery can Power is supplied to the power system, and the power system provides flight power for the drone.
第四方面,本发明实施例提供一种机器可读存储介质,所述机器可读存储介质上存储有若干计算机指令,所述计算机指令被执行时实现第一方面所述方法的步骤。In a fourth aspect, an embodiment of the present invention provides a machine-readable storage medium having several computer instructions stored on the machine-readable storage medium, and the computer instructions implement the steps of the method described in the first aspect when executed.
由上述的技术方案可见,本实施例中通过获取用户输入的控制指令,从而可以在控制指令为切屏指令时,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,第二屏幕显示所述数据码流对应的图像。这样,本实施例中用户输入的控制指令可以包括多种,并不局限于现有的物理硬件或者虚拟按钮,可以保证在尽可能多的应用场景下,尤其是极限运动场景下实现屏幕显示切换,达到快速切换屏幕的效果,有利于提升用户的使用体验。It can be seen from the above technical solution that in this embodiment, by acquiring the control instruction input by the user, when the control instruction is a screen cutting instruction, the data stream input to the first screen can be switched to the second screen. , The second screen displays the image corresponding to the data stream. In this way, the control commands input by the user in this embodiment can include multiple types, and are not limited to existing physical hardware or virtual buttons, and can ensure that screen display switching can be achieved in as many application scenarios as possible, especially in extreme sports scenarios. , To achieve the effect of quickly switching screens, which is conducive to improving the user experience.
附图说明Description of the drawings
为了更清楚地说明本发明实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。In order to more clearly describe the technical solutions in the embodiments of the present invention, the following will briefly introduce the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative labor.
图1是本发明实施例提供的一种屏幕显示切换方法的流程图;Figure 1 is a flowchart of a screen display switching method provided by an embodiment of the present invention;
图2是本发明实施例提供的一种获取控制指令的流程图;FIG. 2 is a flowchart of obtaining a control instruction according to an embodiment of the present invention;
图3是本发明实施例提供的另一种获取控制指令的流程图;FIG. 3 is another flow chart of obtaining control instructions according to an embodiment of the present invention;
图4是本发明实施例提供的又一种获取控制指令的流程图;FIG. 4 is another flow chart of obtaining a control instruction according to an embodiment of the present invention;
图5是本发明实施例提供的一种获取双指双击事件的流程图;FIG. 5 is a flowchart of obtaining a double-finger double-click event according to an embodiment of the present invention;
图6是本发明实施例提供的另一种获取双指双击事件的流程图;FIG. 6 is another flowchart of obtaining a two-finger double-click event provided by an embodiment of the present invention;
图7是本发明实施例提供的一种调整双指双击次数的流程图;FIG. 7 is a flowchart of adjusting the number of double-finger double-clicks according to an embodiment of the present invention;
图8是本发明实施例提供的另一种调整双指双击次数的流程图;FIG. 8 is another flow chart for adjusting the number of double-finger double-clicks according to an embodiment of the present invention;
图9是本发明实施例提供的另一种检测双指双击事件的流程图;FIG. 9 is another flowchart for detecting a double-finger double-tap event provided by an embodiment of the present invention;
图10是本发明实施例提供的另一种调整双指双击次数的流程图;FIG. 10 is another flowchart for adjusting the number of double-finger double-clicks according to an embodiment of the present invention;
图11是本发明实施例提供的又一种调整双指双击次数的流程图;FIG. 11 is another flowchart of adjusting the number of double-finger double-clicks according to an embodiment of the present invention;
图12是本发明实施例提供的又一种调整双指双击次数的流程图;FIG. 12 is another flowchart of adjusting the number of double-finger double-clicks according to an embodiment of the present invention;
图13是本发明实施例提供的另一种屏幕显示切换的流程图;FIG. 13 is a flowchart of another screen display switching provided by an embodiment of the present invention;
图14是本发明实施例提供的又一种屏幕显示切换的流程图。FIG. 14 is a flowchart of another screen display switching provided by an embodiment of the present invention.
具体实施方式Detailed ways
下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护的范围。另外,在不冲突的情况下,下述的实施例及实施例中的特征可以相互组合。The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention. In addition, if there is no conflict, the following embodiments and the features in the embodiments can be combined with each other.
目前,现有的小型显示设备,例如运动相机,较少采用双屏幕。部分具有双屏幕的显示设备因屏幕面积较小,则采用物理硬件或者虚拟按钮来进行切换。然而,上述屏幕切换方式无法适应于一些应用场景(例如极限运动),导致用户体验较低。Currently, existing small display devices, such as sports cameras, rarely use dual screens. Some display devices with dual screens use physical hardware or virtual buttons to switch due to their small screen area. However, the above-mentioned screen switching method cannot be adapted to some application scenarios (such as extreme sports), resulting in a lower user experience.
为此,本发明实施例提供了一种屏幕显示切换方法,其发明构思在于,通过设置多种控制指令,方便显示设备在接收到控制指令后实现两个屏幕的切换,提高切换效率,以使显示设备适应于更多的应用场景。To this end, the embodiment of the present invention provides a screen display switching method. The inventive idea is to set a variety of control instructions to facilitate the display device to switch between the two screens after receiving the control instructions, thereby improving the switching efficiency so that The display device is adapted to more application scenarios.
图1是本发明实施例提供的一种屏幕显示切换方法的流程图,可以应用于设置有第一屏幕和第二屏幕的显示设备,其中显示设备可以为智能终端、平板电脑等电子设备,还可以为无人飞行器、汽车、遥控车、机器人、相机中的至少一种可移动平台。可理解的是,显示设备内还设置有处理器,该处理器可以执行一种屏幕显示切换方法,后续以处理器为执行主体描述各实施例。Figure 1 is a flowchart of a screen display switching method provided by an embodiment of the present invention, which can be applied to a display device provided with a first screen and a second screen, where the display device can be an electronic device such as a smart terminal, a tablet computer, etc. It can be at least one movable platform among unmanned aerial vehicles, automobiles, remote control vehicles, robots, and cameras. It is understandable that a processor is also provided in the display device, and the processor can execute a screen display switching method, and the following description of the embodiments is based on the processor.
可理解的是,第一屏幕和第二屏幕的位置可以是固定的,也可以是不 固定的。例如,第一屏幕和第二屏幕可以对应指定的屏幕,即对应关系固定,如第一屏幕是指显示设备正面的屏幕,第二屏幕是指显示设备背面的屏幕,即所述第一屏幕和所述第二屏幕分别位于所述显示设备的两个不同侧面。在显示设备包括多个屏幕时,该多个屏幕中的任何一个都有可能是第一屏幕或第二屏幕,即第一屏幕和第二屏幕可以对应当前显示的屏幕和需要切换到的屏幕,即对应关系不固定。It is understandable that the positions of the first screen and the second screen may be fixed or not. For example, the first screen and the second screen may correspond to designated screens, that is, the corresponding relationship is fixed. For example, the first screen refers to the screen on the front of the display device, and the second screen refers to the screen on the back of the display device, that is, the first screen and The second screens are respectively located on two different sides of the display device. When the display device includes multiple screens, any one of the multiple screens may be the first screen or the second screen, that is, the first screen and the second screen can correspond to the currently displayed screen and the screen to be switched to, That is, the corresponding relationship is not fixed.
参见图1,一种屏幕显示切换方法,包括:Referring to Figure 1, a screen display switching method includes:
在步骤101中,获取用户输入的控制指令。In step 101, a control instruction input by a user is acquired.
本实施例中,显示设备的处理器可以与显示设备中的传感器通信,其中传感器可以包括触摸屏、语音采集模组、摄像头中的一种或者多种。基于显示设备中的传感器,用户输入的控制指令的方式也可以包括以下至少一种:语音输入、操作切屏按键、预设手势操作。In this embodiment, the processor of the display device may communicate with sensors in the display device, where the sensors may include one or more of a touch screen, a voice collection module, and a camera. Based on the sensor in the display device, the manner of the control instruction input by the user may also include at least one of the following: voice input, operation of the screen cut button, and preset gesture operation.
在一示例中,在显示设备设置有语音采集模组时,用户可以对着语音采集模组进行语音输入,这样语音采集模组可以采集到用户的语音。为准确获取语音所表达的语义信息,语音设备内还预先设置有关键词,这样处理器获取用户输入的控制指令,参见图2,可以包括:处理器可以与语音采集模组通信连接,语音采集模组实时地或者周期性的采集语音数据,这样处理器可以获取到语音采集模组采集的语音数据(对应步骤201)。然后,处理器可以解析语音数据,得到文本数据(对应步骤202)。其中语音解析算法可以采用相关技术中的语音识别算法、语音分析算法等,例如梅尔频率倒谱系数(MFCC),在能够获取到语音对应的文本数据的情况下,相应方案落入本申请的保护范围。之后,处理器可以检测文本数据内是否包括预先设置的关键字,若包括,则确定语音对应的关键字为用户输入的控制指令(对应步骤203)。其中,预先设置的关键字可以包括但不限于:切换屏幕、切屏、Screen Switch、Switch,或者本屏看不到。这些关键字可以以表格或者数据库的形式存储在显示设备本地,以方便处理器读取。In an example, when the display device is provided with a voice collection module, the user can input voice to the voice collection module, so that the voice collection module can collect the user's voice. In order to accurately obtain the semantic information expressed by the voice, keywords are also preset in the voice device, so that the processor obtains the control instructions input by the user. See Figure 2, which may include: the processor can communicate with the voice collection module, and the voice collection The module collects voice data in real time or periodically, so that the processor can obtain the voice data collected by the voice collection module (corresponding to step 201). Then, the processor can parse the voice data to obtain text data (corresponding to step 202). Among them, the speech analysis algorithm can use speech recognition algorithms and speech analysis algorithms in related technologies, such as Mel Frequency Cepstral Coefficient (MFCC). When the text data corresponding to the speech can be obtained, the corresponding solution falls into the scope of this application. protected range. After that, the processor can detect whether the text data includes a preset keyword, and if it includes, it determines that the keyword corresponding to the voice is a control instruction input by the user (corresponding to step 203). Among them, the preset keywords may include, but are not limited to: switch screen, switch screen, screen switch, switch, or invisible on this screen. These keywords can be stored locally in the display device in the form of a table or database to facilitate the processor to read.
本实施例中通过语音输入控制指令,这样用户的活动范围可以大大增加即不会限制用户的使用位置,有利于扩展显示设备的应用场景。In this embodiment, the control instruction is input by voice, so that the user's activity range can be greatly increased, that is, the user's use position is not restricted, which is beneficial to expand the application scenarios of the display device.
在另一示例中,在显示设备设置有触摸屏,即第一屏幕和/或第二屏幕为触摸屏时,用户可以以对着触摸屏进行操作。在一场景中,触摸屏包括切屏按键,这样处理器获取用户输入的控制指令,参见图3,包括:处理器可以与第一屏幕和第二屏幕通信连接,从而可以监控到切屏按键(对应步骤301)。若监控到用户操作切屏按键且满足预先设置的操作条件,则确定获取到用户输入的控制指令(对应步骤302)。预先设置的操作条件可以包括但不限于:切屏按键被按下时间超过预设时长、被连续点击多次。本示例中通过设置切屏按键,可以方便用户直接操作切屏按键,提高切屏效率。In another example, when the display device is provided with a touch screen, that is, when the first screen and/or the second screen are touch screens, the user can operate on the touch screen. In one scenario, the touch screen includes a screen cut button, so that the processor obtains the control instruction input by the user, as shown in Figure 3, including: the processor can communicate with the first screen and the second screen, so that the screen cut button (corresponding to Step 301). If it is monitored that the user operates the screen cut button and the preset operating condition is met, it is determined that the control instruction input by the user is acquired (corresponding to step 302). The preset operating conditions may include, but are not limited to: the screen-cutting button has been pressed for more than a preset time period, and has been continuously clicked multiple times. In this example, by setting the screen cutting button, it is convenient for the user to directly operate the screen cutting button and improve the screen cutting efficiency.
在另一场景中,用户可以对触摸屏进行手势操作,可以包括点击、滑动、双指拖动、双指双击、双指滑动、单击双击、三指滑动等手势操作,技术人员可以根据具体场景设置手势操作,在能够使显示设备获得到用户控制指令的情况下,相应手势操作落入本申请的保护范围。可理解的是,本示例中显示设备内还可以设置预设手势,将预设手势作为控制指令,可以包括以下至少一种:双指双击、双指滑动、单击双击、三指滑动。当然,技术人员还可以根据具体场景设备预设手势,在能够作为控制指令的情况下,相应方案落入本申请的保护范围。这样,处理器获取用户输入的控制指令,参见图4,可以包括:处理器可以分别与第一屏幕和第二屏幕通信连接,第一屏幕和第二屏幕可以为触摸屏,且可以检测用户针对第一屏幕和/或第二屏幕的触摸操作。以触摸操作第一屏幕为例,处理器可以监控第一屏幕的触摸操作(对应步骤401)。然后。处理器判断触摸操作内是否包括预设手势,若包括预设手势,则处理器确定获取到用户输入的控制指令(对应步骤402)。本示例中通过设置预设手势,方便用户使用自身熟悉的手势实现切换,提高切屏效率和使用体验。In another scenario, the user can perform gesture operations on the touch screen, including tap, slide, two-finger drag, two-finger double-tap, two-finger slide, double-click, three-finger slide and other gesture operations. Setting the gesture operation, in the case that the display device can obtain the user control instruction, the corresponding gesture operation falls into the protection scope of this application. It is understandable that, in this example, a preset gesture may also be set in the display device, and the preset gesture may be used as a control instruction, which may include at least one of the following: two-finger double-tap, two-finger sliding, single-tap double-tap, and three-finger sliding. Of course, technicians can also preset gestures according to specific scenes, and if they can be used as control instructions, the corresponding solutions fall within the protection scope of this application. In this way, the processor obtains the control instruction input by the user, referring to FIG. 4, which may include: the processor may be communicatively connected to the first screen and the second screen, respectively, the first screen and the second screen may be touch screens, and can detect that the user is directed to the first screen Touch operation on one screen and/or second screen. Taking the touch operation of the first screen as an example, the processor may monitor the touch operation of the first screen (corresponding to step 401). then. The processor determines whether the preset gesture is included in the touch operation, and if the preset gesture is included, the processor determines that the control instruction input by the user is acquired (corresponding to step 402). In this example, by setting preset gestures, it is convenient for users to use their familiar gestures to switch, which improves screen cutting efficiency and user experience.
在一示例中,以预设手势为双指双击为例,处理器判断触摸操作内是 否包括预设手势,参见图5,包括:处理器通过与触摸屏通信,可以检测到用户手指是否已经按下。若检测到用户有手指按下,处理器记录各手指的当前触摸时间;手指包括第一手指和第二手指(对应步骤501)。其中第一手指和第二手指并非特定的手指,而是先按下的手指为第一手指,后按下的手指为第二手指。然后,处理器检测第一手指和所述第二手指是否抬起,根据检测结果确定是否检测到双指双击事件(对应步骤502)。In one example, taking the preset gesture as a two-finger double-tap as an example, the processor determines whether the preset gesture is included in the touch operation, as shown in Figure 5, including: the processor can detect whether the user's finger has been pressed by communicating with the touch screen . If it is detected that the user has pressed a finger, the processor records the current touch time of each finger; the fingers include the first finger and the second finger (corresponding to step 501). The first finger and the second finger are not specific fingers, but the first finger is the first finger, and the second finger is the second finger. Then, the processor detects whether the first finger and the second finger are lifted, and determines whether a two-finger double-tap event is detected according to the detection result (corresponding to step 502).
本示例中,处理器根据检测结果确定是否检测到双指双击事件,参见图6,包括:针对第二手指,若检测到第二手指抬起,则处理器基于第二手指抬起对应的当前时间、第二手指的最后一次释放时间和设定时长调整双指双击释放次数(对应步骤601)。例如,参见图7,处理器判断第二手指抬起对应的当前时间与第二手指的最后一次释放时间之差是否超过设定时长(对应步骤701)。若超过设定时长,则将双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态(对应步骤702)。其中设定时长可以根据具体场景进行设置,例如500ms~1000ms。然后,基于第二手指的偏移量和设定阈值调整双指双击释放次数,以及第二手指的释放时间(对应步骤602)。例如,参见图8,处理器可以判断第二手指抬起位置和按下位置之间的偏移量,并判断偏移量是否超过设定阈值(对应步骤801)。若偏移量超过设定阈值,则将双指双击释放次数调整为第二状态;若偏移量小于设定阈值,则将双指双击释放次数调整为当前状态的下一状态(对应步骤802)。可理解的是,考虑到预设手势为双指双击,因此双指双击释放次数可以包括第一状态(即次数为0)、第二状态(即次数为1)和第三状态(即次数为2)。In this example, the processor determines whether a two-finger double-tap event is detected according to the detection result, see Figure 6, including: for the second finger, if the second finger is detected to be lifted, the processor is based on the second finger lifted corresponding current Time, the last release time of the second finger and the set duration adjust the number of double-finger releases (corresponding to step 601). For example, referring to FIG. 7, the processor determines whether the difference between the current time corresponding to the second finger lifting and the last release time of the second finger exceeds the set time period (corresponding to step 701). If it exceeds the set time period, adjust the two-finger double-click release times to the first state; if not, maintain the current state of the two-finger double-click release times (corresponding to step 702). The setting duration can be set according to specific scenarios, for example, 500ms~1000ms. Then, the number of two-finger double-tap releases and the release time of the second finger are adjusted based on the offset of the second finger and the set threshold (corresponding to step 602). For example, referring to FIG. 8, the processor may determine the offset between the raised position and the pressed position of the second finger, and determine whether the offset exceeds a set threshold (corresponding to step 801). If the offset exceeds the set threshold, adjust the number of two-finger double-click releases to the second state; if the offset is less than the set threshold, adjust the number of two-finger double-click releases to the next state of the current state (corresponding to step 802 ). It is understandable that, considering that the preset gesture is a two-finger double-tap, the number of two-finger double-tap releases can include the first state (that is, the number of times is 0), the second state (that is, the number of times is 1), and the third state (that is, the number of times is 1). 2).
本示例中,处理器根据检测结果确定是否检测到双指双击事件,参见图9,包括:针对所述第一手指,若检测到第一手指抬起,则处理器记录第一手指的抬起位置和按下位置的偏移坐标,以及调整单指双击释放次数(对应步骤901)。参见图10,处理器调整单指双击释放次数包括:In this example, the processor determines whether a two-finger double-tap event is detected according to the detection result, see FIG. 9, including: for the first finger, if the first finger is detected to be lifted, the processor records the lift of the first finger The offset coordinates of the position and the pressed position, and the adjustment of the single-finger double-click release times (corresponding to step 901). Referring to Figure 10, the processor adjusts the single-finger double-click release times including:
判断所述第一手指抬起对应的当前时间与第一手指的最后一次释放时 间之差是否大于设定时长(对应步骤1001)。设定时长可以根据具体场景进行设置,例如500ms~1000ms。若大于设定时长,处理器将单指双击释放次数调整为第二状态;若否,则将单指双击释放次数调整为当前状态的下一状态(对应步骤1002)。It is determined whether the difference between the current time corresponding to the lifting of the first finger and the last release time of the first finger is greater than the set duration (corresponding to step 1001). The setting duration can be set according to specific scenarios, for example, 500ms~1000ms. If it is longer than the set duration, the processor adjusts the single-finger double-click release times to the second state; if not, adjusts the single-finger double-click release times to the next state of the current state (corresponding to step 1002).
之后,处理器可以确定单指双击释放次数的当前状态(对应步骤902)。若单指双击释放次数为第二状态,则基于第一手指的偏移量和设定阈值调整单指双击释放次数的状态(对应步骤903)。After that, the processor can determine the current state of the single-finger double-click release times (corresponding to step 902). If the number of single-finger double-click releases is in the second state, the status of the single-finger double-click release number is adjusted based on the offset of the first finger and the set threshold (corresponding to step 903).
其中,处理器基于第一手指的偏移量和设定阈值调整单指双击释放次数的状态,参见图11,可以包括:处理器可以确定第一手指的偏移量是否超过设定阈值(对应步骤1101)。若是,处理器将双指双击释放次数调整为第一状态;若否,处理器维持双指双击释放次数的当前状态(对应步骤1102)。Wherein, the processor adjusts the state of the number of single-finger double tap releases based on the offset of the first finger and the set threshold. See FIG. 11, which may include: the processor may determine whether the offset of the first finger exceeds the set threshold (corresponding to Step 1101). If yes, the processor adjusts the two-finger double-click release times to the first state; if not, the processor maintains the current state of the two-finger double-click release times (corresponding to step 1102).
需要说明的是,处理器在确定单指双击释放次数的当前状态之后,若单指双击释放次数为第三状态,则判断第一手指的当前位置是否在前一次点击位置的设定范围内;若位于前一次点击位置的设定范围内,则确定检测到单指双击事件。其中,设定范围可以根据具体场景进行调整,例如可以为120像素*120像素的矩形区域。It should be noted that after determining the current state of the single-finger double-click release times, the processor determines whether the current position of the first finger is within the set range of the previous click position if the single-finger double-click release times is the third state; If it is within the set range of the previous click position, it is determined that a single-finger double-click event is detected. Among them, the setting range can be adjusted according to a specific scene, for example, it can be a rectangular area of 120 pixels*120 pixels.
本示例中,处理器基于第一手指上次释放时间和第二手指的触摸时间调整双指双击释放次数的状态,并记录所述第一手指的释放时间(对应步骤904)。之后,处理器判断双指双击释放次数的当前状态,若双指双击释放次数为第三状态,则确定检测到双指双击事件(对应步骤905)。In this example, the processor adjusts the state of the number of double-finger double-tap release times based on the last release time of the first finger and the touch time of the second finger, and records the release time of the first finger (corresponding to step 904). After that, the processor judges the current state of the two-finger double-click release times, and if the two-finger double-click release times is the third state, it determines that the two-finger double-click event is detected (corresponding to step 905).
其中,处理器基于第一手指上次释放时间和第二手指的触摸时间调整双指双击释放次数的状态,参见图12,可以包括:处理器判断第一手指上次释放时间是否大于第二手指的触摸时间(对应步骤1201)。若是,则将双指双击释放次数调整为当前状态的下一状态;若否,则维持所述双指双击释放次数的当前状态(对应步骤1202)。Wherein, the processor adjusts the state of the two-finger double-tap release times based on the last release time of the first finger and the touch time of the second finger. See FIG. 12, which may include: the processor determines whether the last release time of the first finger is greater than that of the second finger Touch time (corresponding to step 1201). If yes, adjust the two-finger double-click release times to the next state of the current state; if not, maintain the current state of the two-finger double-click release times (corresponding to step 1202).
最后,处理器判断双指双击释放次数是否为第三状态,若双指双击释 放次数为第三状态,则确定检测到双指双击事件(对应步骤603)。Finally, the processor determines whether the two-finger double-click release times are in the third state, and if the two-finger double-click release times are in the third state, it determines that a two-finger double-click event is detected (corresponding to step 603).
上述各实施例中以显示设备上设置有触摸屏为例描述了双指双击操作的内容。可理解的是,在显示设备上设置有摄像头时,若用户伸双指在空中来回摆2次,该摄像头可以采集到用户手部图像或者视频,并分析出用户的手势,同样可以确定用户手势为双指双击手势。其中手势分析可以采用相关技术中的目标跟踪算法实现,具体方案可以参考相关技术中,在此不再表述。In the foregoing embodiments, a touch screen is provided on the display device as an example to describe the content of the two-finger double-click operation. It is understandable that when a camera is provided on the display device, if the user swings two fingers back and forth in the air twice, the camera can collect an image or video of the user's hand, and analyze the user's gesture, which can also determine the user's gesture It is a two-finger double-tap gesture. The gesture analysis can be implemented by using the target tracking algorithm in the related technology, and the specific solution can be referred to in the related technology, which will not be described here.
在步骤102中,若所述控制指令为切屏指令,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,所述第二屏幕显示所述数据码流对应的图像。In step 102, if the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays the image corresponding to the data code stream .
本实施例中,处理器在确定控制指令为切屏指令后可以生成切屏消息发送给切屏模块。切屏模块基于切屏消息停止当前屏幕即第一屏幕Liveview(一种图形化工具)/OSD(On-Screen Display,屏幕菜单式调节方式),即停止向当前屏幕输入数据码流。处理器将数据码流切换到另一屏幕即第二屏幕。重新启动Liveview/OSD后,由第二屏幕显示对应的图像,完成屏幕切换。In this embodiment, the processor may generate a screen cutting message and send it to the screen cutting module after determining that the control instruction is a screen cutting instruction. The screen cutting module stops the current screen, which is the first screen Liveview (a graphical tool)/OSD (On-Screen Display, screen menu adjustment method) based on the screen cutting message, that is, stops inputting the data stream to the current screen. The processor switches the data stream to another screen, the second screen. After restarting Liveview/OSD, the corresponding image will be displayed on the second screen to complete the screen switching.
至此,本实施例中通过获取用户输入的控制指令,从而可以在控制指令为切屏指令时,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,第二屏幕显示所述数据码流对应的图像。这样,本实施例中用户输入的控制指令可以包括多种,并不局限于现有的物理硬件或者虚拟按钮,可以保证在尽可能多的应用场景下,尤其是极限运动场景下实现屏幕显示切换,达到快速切换屏幕的效果,有利于提升用户的使用体验。So far, in this embodiment, by acquiring the control instruction input by the user, when the control instruction is a screen cutting instruction, the data stream input to the first screen can be switched to the second screen, and the second screen displays The image corresponding to the data stream. In this way, the control commands input by the user in this embodiment can include multiple types, and are not limited to existing physical hardware or virtual buttons, and can ensure that screen display switching can be achieved in as many application scenarios as possible, especially in extreme sports scenarios. , To achieve the effect of quickly switching screens, which is conducive to improving the user experience.
下面以不同输入场景下为例描述一种屏幕显示切换方法,参见图13和图14:The following describes a screen display switching method under different input scenarios as an example, see Figure 13 and Figure 14:
如图13所示,在按键切屏的场景中,当用户按下切屏按键后,该切屏按键可以为物理按钮或者虚拟按钮,并开始计时T。当用户抬起切屏按键后,停止计算计时T并判断T是否大于(包括等于)设定时长500ms。若 T小于500ms,则重新检测切屏按键是否被按下,若T大于500ms,则确定需要进行屏幕切换生成切屏消息,发送给切屏模块。切屏模块停止向当前屏幕的数据码流,即当前屏幕停止Liveview/OSD。将数据码流切换到另一屏幕,重新启动Liveview/OSD,由另一屏幕显示相应内容,从而完成切屏操作。As shown in FIG. 13, in the scene where the user presses the screen cut button, the screen cut button can be a physical button or a virtual button, and the timer T starts. When the user lifts the screen-cutting button, the counting of timer T is stopped and it is judged whether T is greater than (including equal to) the set duration of 500ms. If T is less than 500ms, check whether the screen cutting button is pressed again. If T is greater than 500ms, it is determined that screen switching is required to generate a screen cutting message and send it to the screen cutting module. The screen cut module stops the data stream to the current screen, that is, the current screen stops Liveview/OSD. Switch the data stream to another screen, restart Liveview/OSD, and display the corresponding content on another screen to complete the screen cut operation.
继续如图13所示,在语音切屏的场景中,当采集语音数据,对语音数据进行文本分析并识别出文本数据内的关键词,若关键词不是预设关键词,则重新采集语音数据,若是预设关键词,则确定需要进行屏幕切换生成切屏消息,发送给切屏模块。切屏模块停止向当前屏幕的数据码流,即当前屏幕停止Liveview/OSD。将数据码流切换到另一屏幕,重新启动Liveview/OSD,由另一屏幕显示相应内容,从而完成切屏操作。Continue as shown in Figure 13, in the scene of voice cut screen, when the voice data is collected, the voice data is text analyzed and the keywords in the text data are recognized. If the keywords are not preset keywords, the voice data is collected again If it is a preset keyword, it is determined that screen switching is required to generate a screen cutting message and send it to the screen cutting module. The screen cut module stops the data stream to the current screen, that is, the current screen stops Liveview/OSD. Switch the data stream to another screen, restart Liveview/OSD, and display the corresponding content on another screen to complete the screen cut operation.
如图14所示,在双指双击切屏的场景中,检测用户是否按下手指0(即第一手指)和手指1(即第二手指),若按下手指0则记录当前触摸时间LastTouchT,若按下手指1则记录当前触摸时间DoubleLastTouchT。然后,判断手指0和手指1是否定义在热区(即设定范围,例如屏幕的显示区域的四个角落)内,若不在热区内,则重新检测手指0。需要说明的是,当手指0和手指1全部位于热区外,则重新检测两者是否被按下;若有一个位于热区外,则未超出热区外的手指变成手指1,另一个手指变为手指0并重新检测。As shown in Figure 14, in the scene of two-finger double-tap to cut the screen, it is detected whether the user presses finger 0 (ie the first finger) and finger 1 (ie the second finger). If finger 0 is pressed, the current touch time LastTouchT is recorded , If finger 1 is pressed, the current touch time DoubleLastTouchT will be recorded. Then, it is judged whether finger 0 and finger 1 are defined in the hot zone (that is, the setting range, for example, the four corners of the display area of the screen). If they are not in the hot zone, finger 0 is detected again. It should be noted that when finger 0 and finger 1 are all outside the hot zone, re-check whether they are pressed; if one is outside the hot zone, the finger that does not exceed the hot zone becomes finger 1, and the other The finger becomes finger 0 and re-detects.
若手指0和手指1全部位于热区内,则包括:If finger 0 and finger 1 are all in the hot zone, it includes:
针对手指0 Target finger 0
若检测到用户抬起手指0,则记录手指0抬起位置和点击位置的偏移x坐标和y坐标,即dx和dy。然后,计算当前时刻与当前触摸时间LastTouchT之差是否超过500ms,若超过则将单指双击释放次数ReleaseCnt清零后加1(即调整为第二状态),若小于将单指双击释放次数ReleaseCnt加1(调整为当前状态的下一状态)。If it is detected that the user lifts finger 0, the offset x coordinate and y coordinate of the lifted position and the clicked position of the finger 0 are recorded, namely dx and dy. Then, calculate whether the difference between the current time and the current touch time LastTouchT exceeds 500ms. If it exceeds, the single-finger double-click release times ReleaseCnt is cleared and added to 1 (that is, adjusted to the second state), if it is less than the single-finger double-click release times ReleaseCnt is added 1 (adjust to the next state of the current state).
若单指双击释放次数ReleaseCnt为第二状态,则记录当前点击位置的 x坐标TouchHitXLast和y坐标TouchHitYLast。若单指双击释放次数ReleaseCnt为第三状态,则确定当前位置是否在上位点击位置的120*120范围内,若是确定检测到单指双击事件,若否,则转换到下一步。If the release number of single-finger double-click ReleaseCnt is in the second state, the x coordinate TouchHitXLast and the y coordinate TouchHitYLast of the current click position are recorded. If the single-finger double-click release times ReleaseCnt is in the third state, it is determined whether the current position is within the range of 120*120 of the upper click position, if it is determined that a single-finger double-click event has been detected, if not, then transition to the next step.
判断偏移量dx和dy是否超过设定范围120*120,若是则将双指双击释放次数ReleaseTouchCnt清零(即调整为第一状态),若否,则转换到下一步。Determine whether the offsets dx and dy exceed the setting range of 120*120, if so, clear the number of releases of the two-finger double-click ReleaseTouchCnt to zero (ie, adjust to the first state), if not, switch to the next step.
手指0上次释放时间是否大于手指1的触摸时间,若是,则双指双击释放次数ReleaseTouchCnt加1,并记录手指0释放时间LastReleaseT,若否则记录手指0释放时间LastReleaseT。Whether the last release time of finger 0 is greater than the touch time of finger 1, if yes, the release time of two-finger double-click ReleaseTouchCnt is increased by 1, and the release time of finger 0 LastReleaseT is recorded, if not, the release time of finger 0 LastReleaseT is recorded.
针对手指1 Target finger 1
若检测到用户抬起手指1,则计算当前时刻与当前触摸时间DoubleLastTouchT之差是否超过500ms,若超过则将双指双击释放次数ReleaseTouchCnt清零(即调整为第一状态)并判断偏移量dx/dy是否超过设定范围120*120;若小于判断偏移量dx/dy是否超过设定范围120*120。If it is detected that the user lifts the finger 1, calculate whether the difference between the current time and the current touch time DoubleLastTouchT exceeds 500ms, if it exceeds, clear the number of double-finger double-click releases ReleaseTouchCnt to zero (ie adjust to the first state) and determine the offset dx Whether /dy exceeds the setting range of 120*120; if it is smaller, judge whether the offset dx/dy exceeds the setting range of 120*120.
判断偏移量dx和dy是否超过设定范围120*120,若是则将双指双击释放次数ReleaseTouchCnt清零(即调整为第一状态),若否,则转换到下一步。Determine whether the offsets dx and dy exceed the setting range of 120*120, if so, clear the number of releases of the two-finger double-click ReleaseTouchCnt to zero (ie, adjust to the first state), if not, switch to the next step.
将双指双击释放次数ReleaseTouchCnt加1,并记录手指1释放时间DoubleLastReleaseT。Add 1 to the release times of the two-finger double-click ReleaseTouchCnt, and record the release time DoubleLastReleaseT of finger 1.
然后判断手指0上次释放时间是否大于手指1的触摸时间,若是检测到双指双击事件,即确定出需要进行屏幕切换生成切屏消息,发送给切屏模块。切屏模块停止向当前屏幕的数据码流,即当前屏幕停止Liveview/OSD。将数据码流切换到另一屏幕,重新启动Liveview/OSD,由另一屏幕显示相应内容,从而完成切屏操作。Then it is judged whether the last release time of finger 0 is greater than the touch time of finger 1. If a double-finger double-tap event is detected, it is determined that a screen switch is required to generate a screen cut message, which is sent to the screen cut module. The screen cut module stops the data stream to the current screen, that is, the current screen stops Liveview/OSD. Switch the data stream to another screen, restart Liveview/OSD, and display the corresponding content on another screen to complete the screen cut operation.
本发明实施例还提供了一种显示设备,包括第一屏幕、第二屏幕和处理器;所述处理器分别与所述第一屏幕和所述第二屏幕连接;所述处理器被配置为:An embodiment of the present invention also provides a display device, including a first screen, a second screen, and a processor; the processor is connected to the first screen and the second screen respectively; the processor is configured to :
获取用户输入的控制指令;Obtain the control instructions input by the user;
若所述控制指令为切屏指令,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,所述第二屏幕显示所述数据码流对应的图像。If the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
在一些实施例中,用户输入的控制指令的方式包括以下至少一种:语音输入、操作切屏按键、预设手势操作。In some embodiments, the manner of the control instruction input by the user includes at least one of the following: voice input, operation of the screen cut button, and preset gesture operation.
在一些实施例中,若输入方式为语音输入,所述处理器被配置为获取用户输入的控制指令,包括:In some embodiments, if the input mode is voice input, the processor is configured to obtain a control instruction input by the user, including:
获取所述显示设备中语音采集模组采集的语音数据;Acquiring voice data collected by a voice collection module in the display device;
解析所述语音数据,得到文本数据;Parse the voice data to obtain text data;
检测所述文本数据内是否包括预先设置的关键字,若包括,则确定所述语音对应的关键字为用户输入的控制指令。It is detected whether the text data includes a preset keyword, and if it includes, it is determined that the keyword corresponding to the voice is a control instruction input by the user.
在一些实施例中,若输入方式为操作切屏按键,所述处理器被配置为获取用户输入的控制指令包括:In some embodiments, if the input mode is to operate the screen cut button, the processor being configured to obtain the control instruction input by the user includes:
监控所述切屏按键;Monitor the screen cut button;
若监控到用户操作所述切屏按键且满足预先设置的操作条件,则确定获取到用户输入的控制指令。If it is monitored that the user operates the screen cutting button and the preset operating condition is met, it is determined that the control instruction input by the user is acquired.
在一些实施例中,若输入方式为预设手势操作,所述处理器被配置为获取用户输入的控制指令包括:In some embodiments, if the input mode is a preset gesture operation, the processor being configured to obtain the control instruction input by the user includes:
监控所述第一屏幕的触摸操作;Monitoring the touch operation of the first screen;
若所述触摸操作包括预设手势,则获取到用户输入的控制指令。If the touch operation includes a preset gesture, the control instruction input by the user is acquired.
在一些实施例中,所述预设手势操作包括以下至少一种:双指双击、双指滑动、单击双击、三指滑动。In some embodiments, the preset gesture operation includes at least one of the following: two-finger double-tap, two-finger sliding, single-tap double-tap, and three-finger sliding.
在一些实施例中,若所述预设手势操作为双指双击,所述处理器被配置为判断所述触摸操作是否包括预设手势,包括:In some embodiments, if the preset gesture operation is a two-finger double tap, the processor is configured to determine whether the touch operation includes a preset gesture, including:
若检测到用户有手指按下,则记录所述各手指的当前触摸时间;所述手指包括第一手指和第二手指;If it is detected that the user has pressed a finger, record the current touch time of each finger; the finger includes a first finger and a second finger;
检测所述第一手指和所述第二手指是否抬起,根据检测结果确定是否 检测到双指双击事件。Detect whether the first finger and the second finger are lifted, and determine whether a two-finger double-tap event is detected according to the detection result.
在一些实施例中,所述处理器被配置为根据检测结果确定是否检测到双指双击事件,包括:In some embodiments, the processor is configured to determine whether a two-finger double-tap event is detected according to the detection result, including:
针对所述第二手指,若检测到所述第二手指抬起,则基于所述第二手指抬起对应的当前时间、所述第二手指的最后一次释放时间和所述设定时长调整所述双指双击释放次数;For the second finger, if it is detected that the second finger is lifted, the current time corresponding to the second finger lift, the last release time of the second finger and the set duration are adjusted based on the current time. The number of double-finger releases;
基于所述第二手指的偏移量和设定阈值调整所述双指双击释放次数,以及记录所述第二手指的释放时间;Adjusting the number of releases of the two-finger double tap based on the offset of the second finger and a set threshold, and recording the release time of the second finger;
若双指双击释放次数为第三状态,则确定检测到双指双击事件。If the two-finger double-click release times are in the third state, it is determined that a two-finger double-click event is detected.
在一些实施例中,所述处理器被配置为基于所述第二手指抬起对应的当前时间、所述第二手指的最后一次释放时间和所述设定时长调整所述双指双击释放次数,包括:In some embodiments, the processor is configured to adjust the number of two-finger double-tap releases based on the current time corresponding to the lifting of the second finger, the last release time of the second finger, and the set duration ,include:
判断所述第二手指抬起对应的当前时间与所述第二手指的最后一次释放时间之差是否超过所述设定时长;Determining whether the difference between the current time corresponding to the lifting of the second finger and the last release time of the second finger exceeds the set duration;
若超过所述设定时长,则将所述双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态。If it exceeds the set time period, adjust the two-finger double-click release times to the first state; if not, maintain the current state of the two-finger double-click release times.
在一些实施例中,所述处理器被配置为基于所述第二手指的偏移量和设定阈值调整所述双指双击释放次数包括:In some embodiments, the processor configured to adjust the number of two-finger double-tap releases based on the offset of the second finger and a set threshold includes:
判断偏移量是否超过设定阈值;Judge whether the offset exceeds the set threshold;
若所述偏移量超过所述设定阈值,则将双指双击释放次数调整为第二状态;若所述偏移量小于所述设定阈值,则将双指双击释放次数调整为当前状态的下一状态。If the offset exceeds the set threshold, adjust the number of two-finger double-click releases to the second state; if the offset is less than the set threshold, adjust the number of two-finger double-click releases to the current state The next state.
在一些实施例中,所述处理器被配置为根据检测结果确定是否检测到双指双击事件包括:In some embodiments, the processor being configured to determine whether a two-finger double-tap event is detected according to the detection result includes:
针对所述第一手指,若检测到所述第一手指抬起,则记录所述第一手指的抬起位置和按下位置的偏移坐标,以及调整所述单指双击释放次数;For the first finger, if it is detected that the first finger is lifted, recording the offset coordinates of the lifted position and the pressed position of the first finger, and adjusts the number of times the single-finger double-click release;
确定单指双击释放次数的当前状态;Determine the current state of the single-finger double-click release times;
若单指双击释放次数为第二状态,则基于所述第一手指的偏移量和设定阈值调整双指双击释放次数的状态;If the number of single-finger double-click releases is in the second state, adjust the state of the two-finger double-click release times based on the offset of the first finger and the set threshold;
基于所述第一手指上次释放时间和所述第二手指的触摸时间调整双指双击释放次数的状态,并记录所述第一手指的释放时间;Adjusting the state of the number of times of the two-finger double tap release based on the last release time of the first finger and the touch time of the second finger, and recording the release time of the first finger;
若双指双击释放次数为第三状态,则确定检测到双指双击事件。If the two-finger double-click release times are in the third state, it is determined that a two-finger double-click event is detected.
在一些实施例中,所述处理器被配置为调整所述单指双击释放次数,包括:In some embodiments, the processor is configured to adjust the number of single-finger double-click releases, including:
判断所述第一手指抬起对应的当前时间与所述第一手指的最后一次释放时间之差是否大于设定时长;Judging whether the difference between the current time corresponding to the lifting of the first finger and the last release time of the first finger is greater than a set duration;
若大于设定时长,则将单指双击释放次数调整为第二状态;若否,则将单指双击释放次数调整为当前状态的下一状态。If it is longer than the set duration, the number of single-finger double-click releases is adjusted to the second state; if not, the number of single-finger double-click releases is adjusted to the next state of the current state.
在一些实施例中,所述处理器被配置为基于所述第一手指的偏移量和设定阈值调整双指双击释放次数的状态包括:In some embodiments, the processor configured to adjust the state of the number of two-finger double-click releases based on the offset of the first finger and a set threshold includes:
确定所述第一手指的偏移量是否超过所述设定阈值;Determining whether the offset of the first finger exceeds the set threshold;
若是,则将双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态。If yes, adjust the two-finger double-tap release times to the first state; if not, maintain the current state of the two-finger double-tap release times.
在一些实施例中,所述处理器被配置为基于所述第一手指上次释放时间和所述第二手指的触摸时间调整双指双击释放次数的状态包括:In some embodiments, the processor configured to adjust the state of the number of releases of the two-finger double tap based on the last release time of the first finger and the touch time of the second finger includes:
判断所述第一手指上次释放时间是否大于所述第二手指的触摸时间;Determining whether the last release time of the first finger is greater than the touch time of the second finger;
若是,则将双指双击释放次数调整为当前状态的下一状态;若否,则维持所述双指双击释放次数的当前状态。If yes, adjust the number of two-finger double-click release times to the next state of the current state; if not, then maintain the current state of the two-finger double-click release times.
在一些实施例中,所述处理器被配置为确定单指双击释放次数的当前状态之后,还被配置为包括:In some embodiments, after the processor is configured to determine the current state of the single-finger double-click release times, it is further configured to include:
若单指双击释放次数为第三状态,则判断所述第一手指的当前位置是否在前一次点击位置的设定范围内;If the number of single-finger double-click releases is the third state, it is determined whether the current position of the first finger is within the set range of the previous click position;
若位于前一次点击位置的设定范围内,则确定检测到单指双击事件。If it is within the set range of the previous click position, it is determined that a single-finger double-click event is detected.
在一些实施例中,所述第一屏幕和所述第二屏幕分别位于所述显示设 备的两个不同侧面。In some embodiments, the first screen and the second screen are respectively located on two different sides of the display device.
本发明实施例还提供了一种可移动平台,包括机体、设于所述机体上的供电电池、动力***、飞行控制器和如上述实施例所述的显示设备,所述供电电池能够为所述动力***供电,所述动力***为所述无人机提供飞行动力。The embodiment of the present invention also provides a movable platform, including a body, a power supply battery provided on the body, a power system, a flight controller, and the display device as described in the above embodiment, the power supply battery can be The power system supplies power, and the power system provides flight power for the drone.
本发明实施例还提供了一种机器可读存储介质,所述机器可读存储介质上存储有若干计算机指令,所述计算机指令被执行时实现图1~图14所述屏幕显示切换方法的步骤。The embodiment of the present invention also provides a machine-readable storage medium, the machine-readable storage medium stores a number of computer instructions, and when the computer instructions are executed, the steps of the screen display switching method described in FIGS. 1 to 14 are implemented .
需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that in this article, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply one of these entities or operations. There is any such actual relationship or order between. The terms "include", "include", or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements that are not explicitly listed. Elements, or also include elements inherent to such processes, methods, articles, or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other same elements in the process, method, article, or equipment including the element.
以上对本发明实施例所提供的检测装置和方法进行了详细介绍,本发明中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。The detection device and method provided by the embodiments of the present invention are described in detail above. Specific examples are used in the present invention to explain the principles and implementations of the present invention. The description of the above embodiments is only used to help understand the method of the present invention. And its core ideas; for those of ordinary skill in the art, according to the ideas of the present invention, there will be changes in the specific implementation and the scope of application. In summary, the content of this specification should not be construed as limiting the present invention .

Claims (34)

  1. 一种屏幕显示切换方法,其特征在于,应用于设置有第一屏幕和第二屏幕的显示设备,所述屏幕显示切换方法包括:A screen display switching method, characterized in that it is applied to a display device provided with a first screen and a second screen, and the screen display switching method includes:
    获取用户输入的控制指令;Obtain the control instructions input by the user;
    若所述控制指令为切屏指令,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,所述第二屏幕显示所述数据码流对应的图像。If the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
  2. 根据权利要求1所述的屏幕显示切换方法,其特征在于,用户输入的控制指令的方式包括以下至少一种:语音输入、操作切屏按键、预设手势操作。The screen display switching method according to claim 1, wherein the control instruction input by the user includes at least one of the following: voice input, operation of the screen switch button, and preset gesture operation.
  3. 根据权利要求2所述的屏幕显示切换方法,其特征在于,若输入方式为语音输入,获取用户输入的控制指令包括:The screen display switching method according to claim 2, wherein if the input mode is voice input, obtaining the control instruction input by the user comprises:
    获取所述显示设备中语音采集模组采集的语音数据;Acquiring voice data collected by a voice collection module in the display device;
    解析所述语音数据,得到文本数据;Parse the voice data to obtain text data;
    检测所述文本数据内是否包括预先设置的关键字,若包括,则确定所述语音对应的关键字为用户输入的控制指令。It is detected whether the text data includes a preset keyword, and if it includes, it is determined that the keyword corresponding to the voice is a control instruction input by the user.
  4. 根据权利要求2所述的屏幕显示切换方法,其特征在于,若输入方式为操作切屏按键,获取用户输入的控制指令包括:The screen display switching method according to claim 2, wherein if the input mode is to operate the screen cut button, obtaining the control instruction input by the user comprises:
    监控所述切屏按键;Monitor the screen cut button;
    若监控到用户操作所述切屏按键且满足预先设置的操作条件,则确定获取到用户输入的控制指令。If it is monitored that the user operates the screen cutting button and the preset operating condition is met, it is determined that the control instruction input by the user is acquired.
  5. 根据权利要求2所述的屏幕显示切换方法,其特征在于,若输入方式为预设手势操作,获取用户输入的控制指令包括:The screen display switching method according to claim 2, wherein if the input mode is a preset gesture operation, obtaining a control instruction input by the user comprises:
    监控所述第一屏幕的触摸操作;Monitoring the touch operation of the first screen;
    若所述触摸操作包括预设手势,则获取到用户输入的控制指令。If the touch operation includes a preset gesture, the control instruction input by the user is acquired.
  6. 根据权利要求5所述的屏幕显示切换方法,其特征在于,所述预设手势操作包括以下至少一种:双指双击、双指滑动、单击双击、三指滑动。The screen display switching method according to claim 5, wherein the preset gesture operation includes at least one of the following: two-finger double-tap, two-finger sliding, single-tap double-tap, and three-finger sliding.
  7. 根据权利要求6所述的屏幕显示切换方法,其特征在于,若所述预设手势操作为双指双击,判断所述触摸操作是否包括预设手势,包括:The screen display switching method according to claim 6, wherein if the preset gesture operation is a two-finger double tap, determining whether the touch operation includes a preset gesture includes:
    若检测到用户有手指按下,则记录所述各手指的当前触摸时间;所述手指包括第一手指和第二手指;If it is detected that the user has pressed a finger, record the current touch time of each finger; the finger includes a first finger and a second finger;
    检测所述第一手指和所述第二手指是否抬起,根据检测结果确定是否检测到双指双击事件。It is detected whether the first finger and the second finger are lifted, and whether a double-finger double-tap event is detected according to the detection result.
  8. 根据权利要求7所述的屏幕显示切换方法,其特征在于,根据检测结果确定是否检测到双指双击事件包括:8. The screen display switching method according to claim 7, wherein determining whether a two-finger double-tap event is detected according to the detection result comprises:
    针对所述第二手指,若检测到所述第二手指抬起,则基于所述第二手指抬起对应的当前时间、所述第二手指的最后一次释放时间和所述设定时长调整所述双指双击释放次数;For the second finger, if it is detected that the second finger is lifted, the current time corresponding to the second finger lift, the last release time of the second finger and the set duration are adjusted based on the current time. The number of double-finger releases;
    基于所述第二手指的偏移量和设定阈值调整所述双指双击释放次数,以及记录所述第二手指的释放时间;Adjusting the number of releases of the two-finger double tap based on the offset of the second finger and a set threshold, and recording the release time of the second finger;
    若双指双击释放次数为第三状态,则确定检测到双指双击事件。If the two-finger double-click release times are in the third state, it is determined that a two-finger double-click event is detected.
  9. 根据权利要求8所述的屏幕显示切换方法,其特征在于,基于所述第二手指抬起对应的当前时间、所述第二手指的最后一次释放时间和所述设定时长调整所述双指双击释放次数包括:The screen display switching method according to claim 8, wherein the two fingers are adjusted based on the current time corresponding to the lifting of the second finger, the last release time of the second finger, and the set duration. The number of double-click releases includes:
    判断所述第二手指抬起对应的当前时间与所述第二手指的最后一次释放时间之差是否超过所述设定时长;Determining whether the difference between the current time corresponding to the lifting of the second finger and the last release time of the second finger exceeds the set duration;
    若超过所述设定时长,则将所述双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态。If it exceeds the set time period, adjust the two-finger double-click release times to the first state; if not, maintain the current state of the two-finger double-click release times.
  10. 根据权利要求8所述的屏幕显示切换方法,其特征在于,基于所述第二手指的偏移量和设定阈值调整所述双指双击释放次数包括:The screen display switching method according to claim 8, wherein adjusting the number of times of double-finger double-click release based on the offset of the second finger and a set threshold value comprises:
    判断偏移量是否超过设定阈值;Judge whether the offset exceeds the set threshold;
    若所述偏移量超过所述设定阈值,则将双指双击释放次数调整为第二状态;若所述偏移量小于所述设定阈值,则将双指双击释放次数调整为当前状态的下一状态。If the offset exceeds the set threshold, adjust the number of two-finger double-click releases to the second state; if the offset is less than the set threshold, adjust the number of two-finger double-click releases to the current state The next state.
  11. 根据权利要求8所述的屏幕显示切换方法,其特征在于,根据检测结果确定是否检测到双指双击事件包括:The screen display switching method according to claim 8, wherein determining whether a two-finger double-tap event is detected according to the detection result comprises:
    针对所述第一手指,若检测到所述第一手指抬起,则记录所述第一手指的抬起位置和按下位置的偏移坐标,以及调整所述单指双击释放次数;For the first finger, if it is detected that the first finger is lifted, recording the offset coordinates of the lifted position and the pressed position of the first finger, and adjusts the number of times the single-finger double-click release;
    确定所述单指双击释放次数的当前状态;Determining the current state of the single-finger double-click release times;
    若所述单指双击释放次数为第一状态,则基于所述第一手指的偏移量和设定阈值调整单指双击释放次数的状态;If the number of single-finger double-click releases is in the first state, adjusting the state of the single-finger double-click release number based on the offset of the first finger and the set threshold;
    基于所述第一手指上次释放时间和所述第二手指的触摸时间调整双指双击释放次数的状态,并记录所述第一手指的释放时间;Adjusting the state of the number of times of the two-finger double tap release based on the last release time of the first finger and the touch time of the second finger, and recording the release time of the first finger;
    若双指双击释放次数为第三状态,则确定检测到双指双击事件。If the two-finger double-click release times are in the third state, it is determined that a two-finger double-click event is detected.
  12. 根据权利要求11所述的屏幕显示切换方法,其特征在于,调整所述单指双击释放次数,包括:The screen display switching method according to claim 11, wherein adjusting the number of releases of the single-finger double-click includes:
    判断所述第一手指抬起对应的当前时间与所述第一手指的最后一次释放时间之差是否大于设定时长;Judging whether the difference between the current time corresponding to the lifting of the first finger and the last release time of the first finger is greater than a set duration;
    若大于设定时长,则将所述单指双击释放次数调整为第二状态;若否,则将双指双击释放次数调整为当前状态的下一状态。If it is longer than the set duration, the single-finger double-click release times are adjusted to the second state; if not, the two-finger double-click release times are adjusted to the next state of the current state.
  13. 根据权利要求11所述的屏幕显示切换方法,其特征在于,基于所述第一手指的偏移量和设定阈值调整双指双击释放次数的状态包括:11. The screen display switching method according to claim 11, wherein adjusting the state of the number of times of double-finger double-click release based on the offset of the first finger and a set threshold value comprises:
    确定所述第一手指的偏移量是否超过所述设定阈值;Determining whether the offset of the first finger exceeds the set threshold;
    若是,则将双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态。If yes, adjust the two-finger double-tap release times to the first state; if not, maintain the current state of the two-finger double-tap release times.
  14. 根据权利要求11所述的屏幕显示切换方法,其特征在于,基于所述第一手指上次释放时间和所述第二手指的触摸时间调整双指双击释放次数的状态包括:11. The screen display switching method according to claim 11, wherein the adjusting the state of the number of releases of the two-finger double tap based on the last release time of the first finger and the touch time of the second finger comprises:
    判断所述第一手指上次释放时间是否大于所述第二手指的触摸时间;Determining whether the last release time of the first finger is greater than the touch time of the second finger;
    若是,则将双指双击释放次数调整为当前状态的下一状态;若否,则维持所述双指双击释放次数的当前状态。If yes, adjust the number of two-finger double-click release times to the next state of the current state; if not, then maintain the current state of the two-finger double-click release times.
  15. 根据权利要求11~14任一项所述的屏幕显示切换方法,其特征在于,确定单指双击释放次数的当前状态之后,所述方法还包括:The screen display switching method according to any one of claims 11 to 14, wherein after determining the current state of the number of single-finger double-click releases, the method further comprises:
    若单指双击释放次数为第三状态,则判断所述第一手指的当前位置是否在前一次点击位置的设定范围内;If the number of single-finger double-click releases is the third state, it is determined whether the current position of the first finger is within the set range of the previous click position;
    若位于前一次点击位置的设定范围内,则确定检测到单指双击事件。If it is within the set range of the previous click position, it is determined that a single-finger double-click event is detected.
  16. 根据权利要求1所述的屏幕显示切换方法,其特征在于,所述第一屏幕和所述第二屏幕分别位于所述显示设备的两个不同侧面。The screen display switching method according to claim 1, wherein the first screen and the second screen are respectively located on two different sides of the display device.
  17. 一种显示设备,其特征在于,包括第一屏幕、第二屏幕和处理器;所述处理器分别与所述第一屏幕和所述第二屏幕连接;所述处理器被配置为:A display device, characterized by comprising a first screen, a second screen, and a processor; the processor is respectively connected to the first screen and the second screen; the processor is configured to:
    获取用户输入的控制指令;Obtain the control instructions input by the user;
    若所述控制指令为切屏指令,则将输入到所述第一屏幕的数据码流切换到所述第二屏幕,所述第二屏幕显示所述数据码流对应的图像。If the control instruction is a screen cut instruction, the data code stream input to the first screen is switched to the second screen, and the second screen displays an image corresponding to the data code stream.
  18. 根据权利要求17所述的显示设备,其特征在于,用户输入的控制指令的方式包括以下至少一种:语音输入、操作切屏按键、预设手势操作。The display device according to claim 17, wherein the control instruction input by the user includes at least one of the following: voice input, operation of a screen cut button, and preset gesture operation.
  19. 根据权利要求18所述的显示设备,其特征在于,若输入方式为语音输入,所述处理器被配置为获取用户输入的控制指令,包括:The display device according to claim 18, wherein if the input mode is voice input, the processor is configured to obtain a control instruction input by the user, comprising:
    获取所述显示设备中语音采集模组采集的语音数据;Acquiring voice data collected by a voice collection module in the display device;
    解析所述语音数据,得到文本数据;Parse the voice data to obtain text data;
    检测所述文本数据内是否包括预先设置的关键字,若包括,则确定所述语音对应的关键字为用户输入的控制指令。It is detected whether the text data includes a preset keyword, and if it includes, it is determined that the keyword corresponding to the voice is a control instruction input by the user.
  20. 根据权利要求18所述的显示设备,其特征在于,若输入方式为操作切屏按键,所述处理器被配置为获取用户输入的控制指令包括:The display device according to claim 18, wherein if the input mode is to operate the screen cut button, the processor is configured to obtain the control instruction input by the user comprises:
    监控所述切屏按键;Monitor the screen cut button;
    若监控到用户操作所述切屏按键且满足预先设置的操作条件,则确定获取到用户输入的控制指令。If it is monitored that the user operates the screen cutting button and the preset operating condition is met, it is determined that the control instruction input by the user is acquired.
  21. 根据权利要求18所述的显示设备,其特征在于,若输入方式为预 设手势操作,所述处理器被配置为获取用户输入的控制指令包括:The display device according to claim 18, wherein if the input mode is a preset gesture operation, the processor is configured to obtain the control instruction input by the user comprises:
    监控所述第一屏幕的触摸操作;Monitoring the touch operation of the first screen;
    若所述触摸操作包括预设手势,则获取到用户输入的控制指令。If the touch operation includes a preset gesture, the control instruction input by the user is acquired.
  22. 根据权利要求21所述的显示设备,其特征在于,所述预设手势操作包括以下至少一种:双指双击、双指滑动、单击双击、三指滑动。The display device according to claim 21, wherein the preset gesture operation includes at least one of the following: two-finger double-tap, two-finger sliding, single-tap double-tap, and three-finger sliding.
  23. 根据权利要求22所述的显示设备,其特征在于,若所述预设手势操作为双指双击,所述处理器被配置为判断所述触摸操作是否包括预设手势,包括:The display device according to claim 22, wherein if the preset gesture operation is a two-finger double tap, the processor is configured to determine whether the touch operation includes a preset gesture, comprising:
    若检测到用户有手指按下,则记录所述各手指的当前触摸时间;所述手指包括第一手指和第二手指;If it is detected that the user has pressed a finger, record the current touch time of each finger; the finger includes a first finger and a second finger;
    检测所述第一手指和所述第二手指是否抬起,根据检测结果确定是否检测到双指双击事件。It is detected whether the first finger and the second finger are lifted, and whether a double-finger double-tap event is detected according to the detection result.
  24. 根据权利要求23所述的显示设备,其特征在于,所述处理器被配置为根据检测结果确定是否检测到双指双击事件,包括:22. The display device of claim 23, wherein the processor is configured to determine whether a two-finger double-tap event is detected according to the detection result, comprising:
    针对所述第二手指,若检测到所述第二手指抬起,则基于所述第二手指抬起对应的当前时间、所述第二手指的最后一次释放时间和所述设定时长调整所述双指双击释放次数;For the second finger, if it is detected that the second finger is lifted, the current time corresponding to the second finger lift, the last release time of the second finger and the set duration are adjusted based on the current time. The number of double-finger releases;
    基于所述第二手指的偏移量和设定阈值调整所述双指双击释放次数,以及记录所述第二手指的释放时间;Adjusting the number of releases of the two-finger double tap based on the offset of the second finger and a set threshold, and recording the release time of the second finger;
    若双指双击释放次数为第三状态,则确定检测到双指双击事件。If the two-finger double-click release times are in the third state, it is determined that a two-finger double-click event is detected.
  25. 根据权利要求24所述的显示设备,其特征在于,所述处理器被配置为基于所述第二手指抬起对应的当前时间、所述第二手指的最后一次释放时间和所述设定时长调整所述双指双击释放次数,包括:The display device according to claim 24, wherein the processor is configured to be based on the current time corresponding to the lifting of the second finger, the last release time of the second finger, and the set duration Adjust the double-finger double-click release times, including:
    判断所述第二手指抬起对应的当前时间与所述第二手指的最后一次释放时间之差是否超过所述设定时长;Determining whether the difference between the current time corresponding to the lifting of the second finger and the last release time of the second finger exceeds the set duration;
    若超过所述设定时长,则将所述双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态。If it exceeds the set time period, adjust the two-finger double-click release times to the first state; if not, maintain the current state of the two-finger double-click release times.
  26. 根据权利要求24所述的显示设备,其特征在于,所述处理器被配置为基于所述第二手指的偏移量和设定阈值调整所述双指双击释放次数包括:The display device according to claim 24, wherein the processor is configured to adjust the number of double-finger double-click releases based on the offset of the second finger and a set threshold value, comprising:
    判断偏移量是否超过设定阈值;Judge whether the offset exceeds the set threshold;
    若所述偏移量超过所述设定阈值,则将双指双击释放次数调整为第二状态;若所述偏移量小于所述设定阈值,则将双指双击释放次数调整为当前状态的下一状态。If the offset exceeds the set threshold, adjust the number of two-finger double-click releases to the second state; if the offset is less than the set threshold, adjust the number of two-finger double-click releases to the current state The next state.
  27. 根据权利要求24所述的显示设备,其特征在于,所述处理器被配置为根据检测结果确定是否检测到双指双击事件包括:The display device according to claim 24, wherein the processor is configured to determine whether a two-finger double-tap event is detected according to the detection result comprises:
    针对所述第一手指,若检测到所述第一手指抬起,则记录所述第一手指的抬起位置和按下位置的偏移坐标,以及调整所述单指双击释放次数;For the first finger, if it is detected that the first finger is lifted, recording the offset coordinates of the lifted position and the pressed position of the first finger, and adjusts the number of times the single-finger double-click release;
    确定所述单指双击释放次数的当前状态;Determining the current state of the single-finger double-click release times;
    若所述单指双击释放次数为第二状态,则基于所述第一手指的偏移量和设定阈值调整单指双击释放次数的状态;If the number of single-finger double-click releases is in the second state, adjusting the state of the single-finger double-click release number based on the offset of the first finger and the set threshold;
    基于所述第一手指上次释放时间和所述第二手指的触摸时间调整双指双击释放次数的状态,并记录所述第一手指的释放时间;Adjusting the state of the number of times of the two-finger double tap release based on the last release time of the first finger and the touch time of the second finger, and recording the release time of the first finger;
    若双指双击释放次数为第三状态,则确定检测到双指双击事件。If the two-finger double-click release times are in the third state, it is determined that a two-finger double-click event is detected.
  28. 根据权利要求27所述的显示设备,其特征在于,所述处理器被配置为调整所述单指双击释放次数,包括:The display device according to claim 27, wherein the processor is configured to adjust the number of releases of the single-finger double-click, comprising:
    判断所述第一手指抬起对应的当前时间与所述第一手指的最后一次释放时间之差是否大于设定时长;Judging whether the difference between the current time corresponding to the lifting of the first finger and the last release time of the first finger is greater than a set duration;
    若大于设定时长,则将所述单指双击释放次数调整为第二状态;若否,则将双指双击释放次数调整为当前状态的下一状态。If it is longer than the set duration, the single-finger double-click release times are adjusted to the second state; if not, the two-finger double-click release times are adjusted to the next state of the current state.
  29. 根据权利要求27所述的显示设备,其特征在于,所述处理器被配置为基于所述第一手指的偏移量和设定阈值调整双指双击释放次数的状态包括:The display device according to claim 27, wherein the processor is configured to adjust the state of the number of double-finger double-click releases based on the offset of the first finger and a set threshold value, comprising:
    确定所述第一手指的偏移量是否超过所述设定阈值;Determining whether the offset of the first finger exceeds the set threshold;
    若是,则将双指双击释放次数调整为第一状态;若否,则维持所述双指双击释放次数的当前状态。If yes, adjust the two-finger double-tap release times to the first state; if not, maintain the current state of the two-finger double-tap release times.
  30. 根据权利要求27所述的显示设备,其特征在于,所述处理器被配置为基于所述第一手指上次释放时间和所述第二手指的触摸时间调整双指双击释放次数的状态包括:28. The display device according to claim 27, wherein the processor is configured to adjust the state of the number of releases of the two-finger double tap based on the last release time of the first finger and the touch time of the second finger, comprising:
    判断所述第一手指上次释放时间是否大于所述第二手指的触摸时间;Determining whether the last release time of the first finger is greater than the touch time of the second finger;
    若是,则将双指双击释放次数调整为当前状态的下一状态;若否,则维持所述双指双击释放次数的当前状态。If yes, adjust the number of two-finger double-click release times to the next state of the current state; if not, then maintain the current state of the two-finger double-click release times.
  31. 根据权利要求27~30任一项所述的显示设备,其特征在于,所述处理器被配置为确定单指双击释放次数的当前状态之后,还被配置为包括:The display device according to any one of claims 27 to 30, wherein the processor is configured to, after determining the current state of the single-finger double-click release times, is further configured to include:
    若单指双击释放次数为第三状态,则判断所述第一手指的当前位置是否在前一次点击位置的设定范围内;If the number of single-finger double-click releases is the third state, it is determined whether the current position of the first finger is within the set range of the previous click position;
    若位于前一次点击位置的设定范围内,则确定检测到单指双击事件。If it is within the set range of the previous click position, it is determined that a single-finger double-click event is detected.
  32. 根据权利要求1所述的显示设备,其特征在于,所述第一屏幕和所述第二屏幕分别位于所述显示设备的两个不同侧面。The display device according to claim 1, wherein the first screen and the second screen are respectively located on two different sides of the display device.
  33. 一种可移动平台,其特征在于,包括机体、设于所述机体上的供电电池、动力***、飞行控制器和如权利要求17~32任一项所述的显示设备,所述供电电池能够为所述动力***供电,所述动力***为所述无人机提供飞行动力。A movable platform, characterized by comprising a body, a power supply battery arranged on the body, a power system, a flight controller, and the display device according to any one of claims 17 to 32, and the power supply battery can Power is supplied to the power system, and the power system provides flight power for the drone.
  34. 一种机器可读存储介质,其特征在于,所述机器可读存储介质上存储有若干计算机指令,所述计算机指令被执行时实现权利要求1~16任一项所述方法的步骤。A machine-readable storage medium, characterized in that a number of computer instructions are stored on the machine-readable storage medium, and when the computer instructions are executed, the steps of the method according to any one of claims 1 to 16 are realized.
PCT/CN2019/084713 2019-04-28 2019-04-28 Screen display switching method, display device, and movable platform WO2020220154A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2019/084713 WO2020220154A1 (en) 2019-04-28 2019-04-28 Screen display switching method, display device, and movable platform
CN201980008901.6A CN111656313A (en) 2019-04-28 2019-04-28 Screen display switching method, display device and movable platform

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2019/084713 WO2020220154A1 (en) 2019-04-28 2019-04-28 Screen display switching method, display device, and movable platform

Publications (1)

Publication Number Publication Date
WO2020220154A1 true WO2020220154A1 (en) 2020-11-05

Family

ID=72348474

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/084713 WO2020220154A1 (en) 2019-04-28 2019-04-28 Screen display switching method, display device, and movable platform

Country Status (2)

Country Link
CN (1) CN111656313A (en)
WO (1) WO2020220154A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115437723A (en) * 2021-06-01 2022-12-06 北京小米移动软件有限公司 Application scene fast switching method and device, electronic equipment and storage medium
US20240036568A1 (en) * 2022-08-01 2024-02-01 Alvion Inc. Program for manipulating manipulation target device

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113821154A (en) * 2021-08-27 2021-12-21 深圳市柔宇科技股份有限公司 Screen switching control method, foldable device and storage medium
CN117916155A (en) * 2021-12-10 2024-04-19 深圳市大疆创新科技有限公司 Data acquisition method, data display method, data processing method, landing method of aircraft, data display system and storage medium
CN114265542A (en) * 2021-12-14 2022-04-01 美的集团(上海)有限公司 Robot voice interaction method and device and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107678664A (en) * 2017-08-28 2018-02-09 中兴通讯股份有限公司 A kind of terminal interface switching, the method, apparatus and terminal of gesture processing
CN109189353A (en) * 2018-07-23 2019-01-11 维沃移动通信有限公司 A kind of double screen switching method and mobile terminal
CN109426408A (en) * 2017-09-01 2019-03-05 中兴通讯股份有限公司 A kind of multi-screen terminal and its apply display control method, device
CN109618049A (en) * 2018-11-30 2019-04-12 努比亚技术有限公司 Terminal screen method for handover control, terminal and computer readable storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20120091975A (en) * 2011-02-10 2012-08-20 삼성전자주식회사 Apparatus for displaying information comprising at least of two touch screens and method for displaying information thereof
US9507513B2 (en) * 2012-08-17 2016-11-29 Google Inc. Displaced double tap gesture

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107678664A (en) * 2017-08-28 2018-02-09 中兴通讯股份有限公司 A kind of terminal interface switching, the method, apparatus and terminal of gesture processing
CN109426408A (en) * 2017-09-01 2019-03-05 中兴通讯股份有限公司 A kind of multi-screen terminal and its apply display control method, device
CN109189353A (en) * 2018-07-23 2019-01-11 维沃移动通信有限公司 A kind of double screen switching method and mobile terminal
CN109618049A (en) * 2018-11-30 2019-04-12 努比亚技术有限公司 Terminal screen method for handover control, terminal and computer readable storage medium

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115437723A (en) * 2021-06-01 2022-12-06 北京小米移动软件有限公司 Application scene fast switching method and device, electronic equipment and storage medium
US20240036568A1 (en) * 2022-08-01 2024-02-01 Alvion Inc. Program for manipulating manipulation target device

Also Published As

Publication number Publication date
CN111656313A (en) 2020-09-11

Similar Documents

Publication Publication Date Title
WO2020220154A1 (en) Screen display switching method, display device, and movable platform
US11604560B2 (en) Application association processing method and apparatus
JP5260643B2 (en) User interface device, user interface method, and recording medium
WO2016045579A1 (en) Application interaction control method and apparatus, and terminal
US20110261213A1 (en) Real time video process control using gestures
US10564712B2 (en) Information processing device, information processing method, and program
WO2020042890A1 (en) Video processing method, terminal, and computer readable storage medium
CN105760102B (en) Terminal interaction control method and device and application program interaction control method
CN108616712B (en) Camera-based interface operation method, device, equipment and storage medium
US11671275B2 (en) Method and system of controlling device using real-time indoor image
US20170046866A1 (en) Method and device for presenting operating states
CN106843669A (en) Application interface operating method and device
US11188145B2 (en) Gesture control systems
US11740754B2 (en) Method for interface operation and terminal, storage medium thereof
WO2015192763A1 (en) Touch screen control method and device
CN107870674B (en) Program starting method and mobile terminal
US20210072818A1 (en) Interaction method, device, system, electronic device and storage medium
CN107688385A (en) A kind of control method and device
WO2021073187A1 (en) Television and television control method and control device thereof, and readable storage medium
CN108052258B (en) Terminal task processing method, task processing device and mobile terminal
CN114637439A (en) Display device and gesture track recognition method
CN106774827B (en) Projection interaction method, projection interaction device and intelligent terminal
CN105335061A (en) Information display method and apparatus and terminal
CN111190515A (en) Shortcut panel operation method, device and readable storage medium
WO2016145827A1 (en) Terminal control method and device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19927361

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19927361

Country of ref document: EP

Kind code of ref document: A1