CN110750159B - Gesture control method and device - Google Patents

Gesture control method and device Download PDF

Info

Publication number
CN110750159B
CN110750159B CN201911008047.1A CN201911008047A CN110750159B CN 110750159 B CN110750159 B CN 110750159B CN 201911008047 A CN201911008047 A CN 201911008047A CN 110750159 B CN110750159 B CN 110750159B
Authority
CN
China
Prior art keywords
gesture control
vehicle
controlled module
control function
gesture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911008047.1A
Other languages
Chinese (zh)
Other versions
CN110750159A (en
Inventor
曾彬
肖琴
吴阳平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Sensetime Technology Co Ltd
Original Assignee
Shenzhen Sensetime Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Sensetime Technology Co Ltd filed Critical Shenzhen Sensetime Technology Co Ltd
Priority to CN201911008047.1A priority Critical patent/CN110750159B/en
Publication of CN110750159A publication Critical patent/CN110750159A/en
Application granted granted Critical
Publication of CN110750159B publication Critical patent/CN110750159B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60WCONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT
    • B60W50/00Details of control systems for road vehicle drive control not related to the control of a particular sub-unit, e.g. process diagnostic or vehicle driver interfaces
    • B60W50/08Interaction between the driver and the control system

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Theoretical Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Transportation (AREA)
  • Mechanical Engineering (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the disclosure provides a gesture control method and device, wherein the method comprises the following steps: acquiring state information of a vehicle and information of at least one controlled module on the vehicle, wherein the controlled module supports gesture control; and enabling control of the gesture control function of the at least one controlled module is performed according to the state information of the vehicle.

Description

Gesture control method and device
Technical Field
The disclosure relates to machine learning technology, in particular to a gesture control method and device.
Background
With the continuous development and popularization of product intellectualization, electronization and interconnection, a plurality of more and more intelligent man-machine interaction modes appear so as to meet the demands of people for pursuing individuation and fashion. For example, a touch screen of a smart phone is a man-machine interaction system implemented by touching. There are also products controlled through voice interaction, for example, a user can perform related operations according to voice input instructions whenever the user inputs related instructions.
Disclosure of Invention
Accordingly, embodiments of the present disclosure provide at least a gesture control method and apparatus.
In a first aspect, a gesture control method is provided, the method comprising:
Acquiring state information of a vehicle and information of at least one controlled module on the vehicle, wherein the controlled module supports gesture control;
and enabling control of the gesture control function of the at least one controlled module is performed according to the state information of the vehicle.
In combination with any one of the embodiments of the present disclosure, the enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle includes: and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module in response to the state information of the vehicle indicating that the vehicle is in a driving state.
In combination with any one of the embodiments of the present disclosure, the enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle includes: acquiring pre-determined dangerous grade information of gesture control functions of each controlled module; and responding to the state information of the vehicle to indicate that the vehicle is in a running state, and stopping starting the gesture control function of the controlled module for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information.
In combination with any one of the embodiments of the present disclosure, the enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle includes: and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module according to the state information of the vehicle, wherein the state information of the vehicle indicates that the speed of the vehicle is in a preset speed range.
In combination with any one of the embodiments of the present disclosure, the stopping the gesture control function of the controlled module includes: and configuring the gesture control function of the controlled module into an unavailable state.
In combination with any one of the embodiments of the present disclosure, the configuring the gesture control function of the controlled module to be in an unavailable state includes: and automatically switching the gesture control function of the controlled module from the available state to the unavailable state.
In combination with any one of the embodiments of the present disclosure, after configuring the gesture control function of the controlled module to be in an unavailable state, the method further includes: and automatically switching the gesture control function of the controlled module from the unavailable state to the available state.
In combination with any one of the embodiments of the present disclosure, the stopping the gesture control function of the controlled module includes: and stopping starting the gesture control function of the controlled module according to a preset forbidden mark of the gesture control function of the controlled module.
In combination with any one of the embodiments of the present disclosure, the enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle includes: enabling control over all gesture control functions in the controlled module; or, performing enabling control on at least one gesture control function in the controlled module.
In combination with any of the embodiments of the present disclosure, the controlled module includes at least one of: window control, multimedia play control, light brightness control, air conditioner temperature adjustment and interactive entertainment control.
In a second aspect, there is provided a gesture control apparatus, the apparatus comprising:
the information acquisition module is used for acquiring state information of a vehicle and information of at least one controlled module on the vehicle, and the controlled module supports gesture control;
and the enabling control module is used for enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle.
In combination with any one of the embodiments of the present disclosure, the enabling control module is specifically configured to: and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module in response to the state information of the vehicle indicating that the vehicle is in a driving state.
In combination with any one of the embodiments of the present disclosure, the enabling control module is specifically configured to: acquiring pre-determined dangerous grade information of gesture control functions of each controlled module; and responding to the state information of the vehicle to indicate that the vehicle is in a running state, and stopping starting the gesture control function of the controlled module for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information.
In combination with any one of the embodiments of the present disclosure, the enabling control module is specifically configured to: and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module according to the state information of the vehicle, wherein the state information of the vehicle indicates that the speed of the vehicle is in a preset speed range.
In combination with any one of the embodiments of the present disclosure, the enabling control module, when configured to stop enabling the gesture control function of the controlled module, includes: and configuring the gesture control function of the controlled module into an unavailable state.
In combination with any one of the embodiments of the present disclosure, the enabling control module, when configured to configure the gesture control function of the controlled module to an unavailable state, includes: and automatically switching the gesture control function of the controlled module from the available state to the unavailable state.
In combination with any embodiment of the disclosure, the enabling control module is further configured to: after the gesture control function of the controlled module is configured into an unavailable state, the gesture control function of the controlled module is automatically switched from the unavailable state to the available state.
In combination with any one of the embodiments of the present disclosure, the enabling control module, when configured to stop enabling the gesture control function of the controlled module, includes: and stopping starting the gesture control function of the controlled module according to a preset forbidden mark of the gesture control function of the controlled module.
In combination with any one of the embodiments of the present disclosure, the enabling control module is specifically configured to: enabling control over all gesture control functions in the controlled module; or, performing enabling control on at least one gesture control function in the controlled module.
In combination with any of the embodiments of the present disclosure, the controlled module includes at least one of: window control, multimedia play control, light brightness control, air conditioner temperature adjustment and interactive entertainment control.
In a third aspect, an electronic device is provided, the device comprising a memory for storing computer instructions executable on the processor for implementing a gesture control method according to any of the embodiments of the present disclosure when the computer instructions are executed.
In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored, which when executed by a processor implements a gesture control method according to any of the embodiments of the present disclosure.
According to the gesture control method and device, the available or unavailable enabling control is performed on the gesture control function of the controlled module on the vehicle according to the state information of the vehicle, so that the safety of gesture control can be better ensured, driving risks caused by misuse of gesture control when the vehicle runs are prevented, and the gesture control is started under the condition that the controlled module is safe to use.
Drawings
In order to more clearly illustrate the technical solutions of one or more embodiments of the present disclosure or related technologies, the following description will briefly describe the drawings that are required to be used in the embodiments or related technology descriptions, and it is apparent that the drawings in the following description are only some embodiments described in one or more embodiments of the present disclosure, and other drawings may be obtained according to these drawings without inventive effort to those of ordinary skill in the art.
FIG. 1 illustrates a flow chart of a gesture control method provided by at least one embodiment of the present disclosure;
FIG. 2 illustrates a flow chart of another gesture control method provided by at least one embodiment of the present disclosure;
FIG. 3 illustrates a flow chart of yet another gesture control method provided by at least one embodiment of the present disclosure;
FIG. 4 illustrates a gesture control interface of a music player provided in at least one embodiment of the present disclosure;
FIG. 5 illustrates a block diagram of a gesture control apparatus provided in at least one embodiment of the present disclosure;
fig. 6 illustrates an electronic device provided by at least one embodiment of the present disclosure.
Detailed Description
In order that those skilled in the art will better understand the technical solutions in one or more embodiments of the present disclosure, the technical solutions in one or more embodiments of the present disclosure will be clearly and completely described below with reference to the accompanying drawings in one or more embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, not all embodiments. All other embodiments, which may be made by one of ordinary skill in the art based on one or more embodiments of the present disclosure without inventive faculty, are intended to be within the scope of the present disclosure.
The embodiment of the disclosure provides a gesture control method different from voice interaction control or touch interaction control, which performs equipment control in a gesture interaction mode.
Referring to fig. 1, fig. 1 provides an exemplary gesture control method, which may include:
in step 100, status information of a vehicle and information of at least one controlled module on the vehicle, the controlled module supporting gesture control, is obtained.
When a user wants to control a device to enable a functional component therein, a gesture can be made for gesture control. For example, a user may control up and down movement of a window in a vehicle, or control adjustment of an air conditioning temperature in a vehicle, etc., by way of gesture control.
At least one controlled module may be present in the vehicle capable of supporting gesture control, which may include, for example, any of the following: window control, multimedia play control, light brightness control, air conditioner temperature adjustment, camera shooting control and interactive entertainment control. For example, the multimedia play control may be a play control of a music player in a vehicle; the interactive entertainment control can be module control related to man-machine interaction, such as games in vehicles, photography and photographing, network platform shopping and the like. In actual implementation, which controlled modules in the vehicle support gesture control can be set autonomously according to service requirements.
In this step, the status information of the vehicle and the information of the controlled module on the vehicle may be collected. Wherein the status information of the vehicle includes, but is not limited to: the vehicle is in a stationary state or a traveling state, and the traveling speed of the vehicle is information. The collected information of the controlled modules on the vehicle may be, for example, information of all controlled modules capable of supporting gesture control on the vehicle is collected, so as to obtain which controlled modules capable of supporting gesture control are all available.
In addition, the collecting of the state information of the vehicle and the information of the controlled module in this step may be performed at any timing. For example, the method of the present embodiment may be performed when the state information of the vehicle is changed; alternatively, the method may be performed when it is detected that the user is to perform gesture control.
In step 102, enabling control is performed on the gesture control function of the at least one controlled module according to the state information of the vehicle.
In this step, enabling control is performed on the gesture control function of the controlled module, where the enabling control includes: so that the gesture control function of the controlled module is available or unavailable. In practical implementations, different available or unavailable states may be differently displayed in different ways. For example, the available state may be highlighted and the unavailable state may be distinguished by a non-highlighting. By enabling control of the gesture control function, the user can control the controlled module through gesture control or the controlled module cannot respond to gesture control of the user.
It should be further noted that one controlled module may receive control of multiple gestures. For example, assuming that the controlled module is a music player in a vehicle, the gesture controls that the play of the music player may receive may include, for example: the "palm panning to right" gesture triggers a switch to the next song, the "index finger rotating clockwise" gesture triggers an increase in volume, etc.
In this embodiment, the enabling control of the gesture control function of the controlled module may be that all the gesture control functions in the controlled module are enabled, for example, all the gesture control functions corresponding to the controlled module are stopped or all the gesture control functions are started. Or, at least one gesture control function in the controlled module may be enabled, for example, only one or two gesture control functions corresponding to the controlled module are disabled.
In this embodiment, the enabling control of the gesture control function of the controlled module may be based on the state information of the vehicle, and the following examples are several examples of controlling the gesture control function based on the state information of the vehicle, but it is understood that the embodiments are not limited to the following examples:
In one example, the collected state information of the vehicle is that the vehicle is in a driving state, that is, the vehicle is in a driving process, then some controlled modules are dangerous to activate in the driving process of the vehicle, for example, games, photographing and other modules involving man-machine interaction in the vehicle, and if the driver uses gestures to control the modules, the driver may cause driving distraction and dangerous driving. Thus, when the vehicle is traveling, it may be provided that certain modules in the vehicle are not available for use by gesture control, i.e., at least some of the controlled modules in the vehicle cease enabling the gesture control function of that module.
In another example, the gesture control function of each controlled module in the vehicle may preset its corresponding risk level information for indicating a level assessment that implementing the gesture control function may cause a risk, e.g., a indicates a high risk level and D indicates a low risk level. For example, the game control module in the vehicle is a high-risk-level module, and the music play control module is a low-risk-level module. As mentioned above, the risk level information may correspond to the entire controlled module, indicating that all gesture control functions in the module are dangerous; or may be a hazard level corresponding to a portion of the gestures in the controlled module that identifies a portion of the gesture control functions.
In the enabling control of the gesture control function, the control may be performed in combination with the state information of the vehicle and the risk level information. For example, if the state information of the vehicle indicates that the vehicle is in a driving state, for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information, the gesture control function of the controlled module is stopped to be started. For example, it may be set that the gesture control function of the controlled module having the hazard level information higher than C (e.g., a, B) will be stopped when the vehicle is in a running state. The music playing control on the vehicle is a controlled module with a low risk level (e.g., D) and can be operated when the vehicle is turned on.
In yet another example, the collected state information of the vehicle may be a vehicle speed of the vehicle, and if the vehicle speed is within a preset vehicle speed range, the gesture control function of the controlled module is stopped to be started for at least part of the controlled modules. For example, if the vehicle speed is relatively high, the gesture control function of the game control module may be disabled.
According to the gesture control method, the available or unavailable enabling control is performed on the gesture control function of the controlled module on the vehicle according to the state information of the vehicle, so that the safety of gesture control can be better ensured, the driving risk caused by misuse of gesture control during running of the vehicle is prevented, and the gesture control is started under the condition that the controlled module is safe to use.
FIG. 2 provides a gesture control method of another embodiment of the present disclosure, which may include a process in which the same steps as the flow of FIG. 1 will not be described in detail.
In step 200, status information of a vehicle and information of at least one controlled module on the vehicle are obtained, wherein the controlled module supports gesture control.
In step 202, according to the state information of the vehicle, the gesture control function of the controlled module is configured to be in an unavailable state.
For example, the gesture control function of the controlled module may be controlled according to vehicle state information such as whether the vehicle is in a running state or the vehicle speed of the vehicle. For example, if the vehicle is traveling, the gesture control function of the game control module in the vehicle is set to an unavailable state.
In this embodiment, the manner of enabling control of the gesture control function may be implemented by configuration of the "available" or "unavailable" state of the gesture control function. For example, two state identifiers can be set for the gesture control function of a certain controlled module, and the state identifier F can represent that the gesture control function is in an available state, and when the gesture control is performed by the user, the gesture control of the user can be responded to control the operation of the controlled module; the state identifier U may indicate that the gesture control function is in an unavailable state, and when the gesture control is performed by the user, the operation of the controlled module is not controlled in response to the gesture control of the user. In this step, according to the state information of the vehicle, the state identifier of the gesture control function of the controlled module may be configured as U, and according to the state identifier U, the control instruction of the gesture on the module is not executed any more.
In addition, the automatic switching of the state identification can be performed by setting the state identification to realize the enabling control of the gesture control function. For example, the configuration in this step is an unavailable state, and the gesture control function of the controlled module may be automatically switched from the available state to the unavailable state. For example, when the vehicle is in a stationary state, the state flag of the gesture control function of the game or photographing module of the vehicle is F, i.e., these modules can be controlled by the gesture of the user, through which the user can control photographing or control the game operation. When the vehicle is changed from a stationary state to a driving state, the state identification of the gesture control function of the game or the photographing module of the vehicle can be changed from F to U, namely, the automatic switching from the available state to the unavailable state is realized. When the user is controlled by the gesture again, the gesture control function is not operated according to the gesture control function any more due to the fact that the gesture control function is detected to correspond to the state identifier U.
In another example, after the gesture control function of the controlled module is configured to be in the unavailable state, the gesture control function of the controlled module may also be automatically switched from the unavailable state to the available state. For example, when the vehicle is switched from the running state to the stationary state, the state flag U may be automatically changed to F.
In still other embodiments, the setting of the status identification of the gesture control function may also be determined in combination with the vehicle status information and the risk level information of the gesture control function. For example, if the vehicle is in a driving state, for a gesture control function with a low risk level (for example, the level is D), the corresponding state identifier may be configured as an F available state; whereas for gesture control functions with higher risk levels (e.g., level a), their corresponding state identification may be configured as a U unavailable state.
According to the gesture control method, the available or unavailable enabling control is performed on the gesture control function of the controlled module on the vehicle according to the state information of the vehicle, so that the safety of gesture control can be well ensured, and driving risks caused by implementing gesture control when the vehicle runs are prevented; moreover, the enabling control is performed through the configuration of the available state identifiers, so that the gesture control function can be conveniently switched between different available states, and the enabling control of the gesture control function is more flexible.
FIG. 3 provides a gesture control method of another embodiment of the present disclosure, which may include a process in which the same steps as the flow of FIG. 1 will not be described in detail.
In step 300, a multi-frame gesture image acquired by a camera is received.
For example, a camera mounted on a vehicle may capture a gesture image that includes gestures that a user makes when he or she is to control a controlled module.
In step 302, gesture detection processing is performed on the gesture images, so as to obtain target gestures included in the gesture images.
For example, the gesture image may be input into a pre-trained neural network, resulting in recognition of the gesture in the gesture image. For example, the currently recognized target gesture is a V gesture.
In step 304, status information of a vehicle and information of at least one controlled module on the vehicle are obtained, the controlled module supporting gesture control.
In this embodiment, before responding according to the detected target gesture, it may be determined whether the gesture control function corresponding to the currently used target gesture is available.
For example, in current vehicle state information, it is not dangerous for some controlled modules to enable gesture control functions, while some controlled modules are dangerous to enable gesture control functions. For example, when the vehicle is on, the related control risk level of playing music is low, i.e. the music can be played while the vehicle is running, so the music playing can be controlled by using gestures. When the vehicle is started, the game playing danger level is high, and the driving safety can be influenced. These are of course merely examples.
Therefore, the step can acquire the state information of the vehicle and the information of the controlled module, for example, the acquired state information of the vehicle is that the current vehicle is in a running state, and the information of the controlled module is that the current gesture control is the game interaction module of the vehicle.
In step 306, according to the preset forbidden mark of the gesture control function of the controlled module, stopping starting the gesture control function of the controlled module.
In this step, according to the acquired "the vehicle is in a driving state" and the current gesture control is performed on the game interaction module of the vehicle ", the following information" if the vehicle is in a driving state, "which is prohibited from being used" is acquired. Illustratively, table 1 below records this information:
table 1 example of inhibit use information
Gesture Conditions (conditions) Identification mark
V gesture The vehicle is in a driving state U (inhibit starting)
V gesture The vehicle is in a stationary state F (allow activation)
As shown in the above table 1, when the V gesture is recognized, if the vehicle is in a driving state, the control function corresponding to the gesture is prohibited from being activated. And even if the target gesture is detected and identified before, the control operation of the controlled module is not performed according to the control instruction corresponding to the V gesture without responding to the target gesture.
Different from the embodiment shown in fig. 2, the conditions similar to those shown in table 1 in this embodiment are preset, and when a certain gesture is detected, whether to control according to the control instruction corresponding to the gesture can be known according to the condition query. The conditions in this embodiment are not automatically switched, which is equivalent to enabling control according to preset conditions, whereas the embodiment shown in fig. 2 can perform automatic switching configuration of the available or unavailable state.
According to the gesture control method, the available or unavailable enabling control is performed on the gesture control function of the controlled module on the vehicle according to the state information of the vehicle, so that the safety of gesture control can be well ensured, and the driving risk caused by misuse of gesture control when the vehicle runs is prevented; moreover, by performing the enabling control according to the preset enabling control conditions of the gesture control function, whether the gesture control function is available or not can be determined more quickly, and the efficiency of gesture control is improved.
The gesture control method of the present disclosure is described below by taking a function of applying gesture control in a vehicle as an example, but it is understood that the gesture control method is not limited to application to a vehicle, but may be applied to other devices such as a mobile phone.
In a vehicle, a driver can adjust vehicle accessories such as a vehicle window, light brightness, air-conditioning temperature and the like through gesture actions; vehicle entertainment components in the vehicle may also be controlled, for example, to control music playback, such as switching songs, adjusting volume. Game control may also be performed by gestures, and so on. In particular implementations, a variety of scenarios for gesture control in a vehicle may also be defined: for example, scene one: volume playing; scene II: window adjustment; scene III: and (5) adjusting an air conditioner. And can be controlled by the control method under multiple scenes described in the above embodiment using gestures in multiple scenes of the vehicle.
For example, FIG. 4 illustrates a presentation interface for gesture control of a music player, as shown in FIG. 4, where a user may click on the music player, in one illustrative example, when the user clicks on gesture control area 41 in the player interface (i.e., the red area at the bottom of the player), gesture control of a music play related function is indicated as being turned on; if the user clicks the gesture control area 41 again, gesture control of the music play related function is canceled.
The interface shown in fig. 4 is a functional interface of the music player, and may also be referred to as a target functional interface to be controlled by the gesture image. The user can make various gestures, the camera collects gesture images, and the gesture control device controls the music playing function of the music player according to the received gesture images. And, it is also possible to control related functional components of the music player in response to the gesture image in the interface shown in fig. 4. For example, the volume of music play may be increased in response to the gesture image; for another example, a window glass of a vehicle may also be moved in response to a gesture image. For another example, not only the volume of music playing can be increased in response to the gesture image, but also the state of change of the control function related to the music player generated with the change of the gesture image can be synchronously displayed.
With continued reference to fig. 4, the gesture control area 41 highlights the icon displaying the plurality of gestures, which indicates that the plurality of gestures are supported for control in the music playing scene, for example, the related gestures and the corresponding controlled music playing function may be shown in the following table 2, where the gestures include:
TABLE 2 gesture and corresponding control function
For example, after gesture control of music play related functions is turned on, the user may make an OK gesture, and the music player starts playing music. And, the running start of the function of playing music can be synchronously displayed in the function state interface of fig. 4; similarly, when the user makes a fist gesture, music playing is paused, and the operation stop of the music playing function can also be synchronously displayed in the function state interface.
For example, the user makes a gesture of rotating the index finger, and after detecting the gesture of rotating the index finger, the gesture control device may first determine whether an "OK" gesture has been detected. If "OK" has not been detected before, not responding; if "OK" has been previously detected, the volume of the music player may be adjusted according to the component control information corresponding to the index finger rotation gesture. For example, if the gesture is "index finger rotate clockwise", the music player may be controlled to increase the volume of music playing. Meanwhile, in the functional status interface of fig. 4, an indication of an increase in volume with a clockwise rotation of the index finger may also be displayed simultaneously by the volume adjustment display module 42.
For another example, the user makes a gesture of shifting the palm to the right, and after detecting the index finger rotation gesture, the gesture control device may first determine whether an "OK" gesture has been detected. If "OK" has not been detected before, not responding; if "OK" has been previously detected, the music player may be adjusted to switch to the next song according to a gesture of panning the palm to the right. Meanwhile, in the functional status interface of fig. 4, the song cutting effect of panning right with the palm may also be displayed synchronously through the song display module 43.
In addition, the user can also control praise on the song through gestures. For example, the user may stand his thumb, and in response to this gesture, the gesture control device may control the music player to display a praise identification for a certain song in the functional status interface shown in fig. 4. For example, the praise flag 44 in fig. 4 is lit. Also, it may be pre-determined whether an "OK" gesture has been detected before praise.
Gesture control of other functions is not described in detail.
In the example shown in fig. 4, the risk level information of the music player control module may be set to D, i.e. it belongs to a lower risk level, and then the gesture control function of the controlled module may be used when the vehicle is in a driving state. That is, the above-mentioned use of the gesture control function of the music player may determine that the gesture control function of the controlled module is available according to the state information of the vehicle and the information of the module.
FIG. 5 provides a gesture control apparatus capable of performing the gesture control method of any of the embodiments of the present disclosure. As shown in fig. 5, the apparatus may include: an information acquisition module 51 and an enable control module 52.
The information acquisition module 51 is configured to acquire status information of a vehicle and information of at least one controlled module on the vehicle, where the controlled module supports gesture control.
For example, the status information of the vehicle includes, but is not limited to: the vehicle is in a stationary state or a traveling state, and the traveling speed of the vehicle is information. The collected information of the controlled modules on the vehicle may be, for example, information of all controlled modules capable of supporting gesture control on the vehicle is collected, so as to obtain which controlled modules capable of supporting gesture control are all available.
And the enabling control module 52 is configured to perform enabling control on the gesture control function of the at least one controlled module according to the state information of the vehicle.
For example, the enabling control of the gesture control function of the controlled module may be based on the state information of the vehicle, and the following examples are several examples of controlling the gesture control function based on the state information of the vehicle, but it is understood that the embodiments are not limited to the following examples:
In one example, the collected state information of the vehicle is that the vehicle is in a driving state, that is, the vehicle is in a driving process, then some controlled modules are dangerous to activate in the driving process of the vehicle, for example, games, photographing and other modules involving man-machine interaction in the vehicle, and if the driver uses gestures to control the modules, the driver may cause driving distraction and dangerous driving. Thus, when the vehicle is traveling, it may be provided that certain modules in the vehicle are not available for use by gesture control, i.e., at least some of the controlled modules in the vehicle cease enabling the gesture control function of that module.
In another example, the gesture control function of each controlled module in the vehicle may preset its corresponding risk level information for indicating a level assessment that implementing the gesture control function may cause a risk, e.g., a indicates a high risk level and D indicates a low risk level. For example, the game control module in the vehicle is a high-risk-level module, and the music play control module is a low-risk-level module. As mentioned above, the risk level information may correspond to the entire controlled module, indicating that all gesture control functions in the module are dangerous; or may be a hazard level corresponding to a portion of the gestures in the controlled module that identifies a portion of the gesture control functions.
In the enabling control of the gesture control function, the control may be performed in combination with the state information of the vehicle and the risk level information. For example, if the state information of the vehicle indicates that the vehicle is in a driving state, for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information, the gesture control function of the controlled module is stopped to be started. For example, it may be set that the gesture control function of the controlled module having the hazard level information higher than C (e.g., a, B) will be stopped when the vehicle is in a running state. The music playing control on the vehicle is a controlled module with a low risk level (e.g., D) and can be operated when the vehicle is turned on.
In yet another example, the collected state information of the vehicle may be a vehicle speed of the vehicle, and if the vehicle speed is within a preset vehicle speed range, the gesture control function of the controlled module is stopped to be started for at least part of the controlled modules. For example, if the vehicle speed is relatively high, the gesture control function of the game control module may be disabled.
According to the gesture control device, the enabling control module can perform available or unavailable enabling control on the gesture control function of the controlled module on the vehicle according to the state information of the vehicle, so that the safety of gesture control can be better guaranteed, driving risks caused by misuse of gesture control when the vehicle runs are prevented, and the gesture control is started under the condition that the controlled module is safe to use.
In one example, the enable control module 52 is specifically configured to: and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module in response to the state information of the vehicle indicating that the vehicle is in a driving state.
In one example, the enable control module 52 is specifically configured to: acquiring pre-determined dangerous grade information of gesture control functions of each controlled module; and responding to the state information of the vehicle to indicate that the vehicle is in a running state, and stopping starting the gesture control function of the controlled module for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information.
For example, if the vehicle is in a driving state, for a gesture control function with a low risk level (for example, the level is D), the corresponding state identifier may be configured as an F available state; whereas for gesture control functions with higher risk levels (e.g., level a), their corresponding state identification may be configured as a U unavailable state.
In one example, the enable control module 52 is specifically configured to: and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module according to the state information of the vehicle, wherein the state information of the vehicle indicates that the speed of the vehicle is in a preset speed range.
In one example, the enable control module 52, when used to disable the gesture control function of the controlled module, includes: and configuring the gesture control function of the controlled module into an unavailable state.
In one example, the enabling control module 52, when configured to configure the gesture control function of the controlled module to an unavailable state, comprises: and automatically switching the gesture control function of the controlled module from the available state to the unavailable state.
In one example, the enable control module 52 is further configured to: after the gesture control function of the controlled module is configured into an unavailable state, the gesture control function of the controlled module is automatically switched from the unavailable state to the available state.
By performing the enabling control by the configuration of the available state identifier, the gesture control function can be conveniently switched between different available states, and the enabling control of the gesture control function is more flexible.
In one example, the enable control module 52, when used to disable the gesture control function of the controlled module, includes: and stopping starting the gesture control function of the controlled module according to a preset forbidden mark of the gesture control function of the controlled module.
In one example, the enable control module 52 is specifically configured to: enabling control over all gesture control functions in the controlled module; or, performing enabling control on at least one gesture control function in the controlled module.
In one example, the controlled module includes at least one of: window control, multimedia play control, light brightness control, air conditioner temperature adjustment and interactive entertainment control.
The disclosed embodiments also provide an electronic device, as shown in fig. 6, comprising a memory 61 and a processor 62, the memory 61 being configured to store computer instructions executable on the processor 62, the processor 62 being configured to implement the gesture control method according to any of the embodiments of the disclosure when executing the computer instructions.
Embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the gesture control method of any embodiment of the present disclosure.
One skilled in the art will appreciate that one or more embodiments of the present disclosure may be provided as a method, system, or computer program product. Accordingly, one or more embodiments of the present disclosure may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Moreover, one or more embodiments of the present disclosure may take the form of a computer program product on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) having computer-usable program code embodied therein.
The embodiments of the present disclosure also provide a computer-readable storage medium, on which a computer program may be stored, which when executed by a processor, implements the steps of the neural network training method for word recognition described in any embodiment of the present disclosure, and/or implements the steps of the word recognition method described in any embodiment of the present disclosure. Wherein the term "and/or" means at least one of the two, e.g. "multiple and/or B" includes three schemes: many, B, and "many and B".
The various embodiments in this disclosure are described in a progressive manner, and identical and similar parts of the various embodiments are all referred to each other, and each embodiment is mainly described as different from other embodiments. In particular, for data processing apparatus embodiments, the description is relatively simple, as it is substantially similar to method embodiments, with reference to the description of method embodiments in part.
The foregoing has described certain embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the acts or steps recited in the claims may be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
Embodiments of the subject matter and functional operations described in this disclosure may be implemented in the following: digital electronic circuitry, tangibly embodied computer software or firmware, computer hardware including the structures disclosed in this disclosure and structural equivalents thereof, or a combination of one or more of them. Embodiments of the subject matter described in this disclosure can be implemented as one or more computer programs, i.e., one or more modules of computer program instructions encoded on a tangible, non-transitory program carrier for execution by, or to control the operation of, data processing apparatus. Alternatively or additionally, the program instructions may be encoded on a manually-generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode and transmit information to suitable receiver apparatus for execution by data processing apparatus. The computer storage medium may be a machine-readable storage device, a machine-readable storage substrate, a random or serial access memory device, or a combination of one or more of them.
The processes and logic flows described in this disclosure can be performed by one or more programmable computers executing one or more computer programs to perform corresponding functions by operating on input data and generating output. The processes and logic flows can also be performed by, and apparatus can also be implemented as, special purpose logic circuitry, e.g., a FPG multi (field programmable gate array) or multi SIC (application specific integrated circuit).
Computers suitable for executing computer programs include, for example, general purpose and/or special purpose microprocessors, or any other type of central processing unit. Typically, the central processing unit will receive instructions and data from a read only memory and/or a random access memory. The essential elements of a computer include a central processing unit for carrying out or executing instructions and one or more memory devices for storing instructions and data. Typically, a computer will also include, or be operatively coupled to receive data from or transfer data to, or both, one or more mass storage devices for storing data, e.g., magnetic, magneto-optical disks, or optical disks, etc. However, a computer does not have to have such a device. Furthermore, the computer may be embedded in another device, such as a mobile phone, a personal digital assistant (PD multislot), a mobile audio or video player, a game console, a Global Positioning System (GPS) receiver, or a portable storage device such as a Universal Serial Bus (USB) flash drive, to name a few.
Computer readable media suitable for storing computer program instructions and data include all forms of non-volatile memory, media and memory devices including, for example, semiconductor memory devices (e.g., EPROM, EEPROM, and flash memory devices), magnetic disks (e.g., internal hard disk or removable disks), magneto-optical disks, and CD-ROM and DVD-ROM disks. The processor and the memory can be supplemented by, or incorporated in, special purpose logic circuitry.
Although this disclosure contains many specific implementation details, these should not be construed as limiting the scope of any disclosure or the scope of what is claimed, but rather as primarily describing features of particular embodiments of the particular disclosure. Certain features that are described in this disclosure in the context of separate embodiments can also be implemented in combination in a single embodiment. On the other hand, the various features described in the individual embodiments may also be implemented separately in the various embodiments or in any suitable subcombination. Furthermore, although features may be acting in certain combinations and even initially claimed as such, one or more features from a claimed combination can in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
Similarly, although operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In some cases, multitasking and parallel processing may be advantageous. Moreover, the separation of various system modules and components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
Thus, particular embodiments of the subject matter have been described. Other embodiments are within the scope of the following claims. In some cases, the actions recited in the claims can be performed in a different order and still achieve desirable results. Furthermore, the processes depicted in the accompanying drawings are not necessarily required to be in the particular order shown, or sequential order, to achieve desirable results. In some implementations, multitasking and parallel processing may be advantageous.
The foregoing description of the preferred embodiment(s) of the present disclosure is merely intended to illustrate the embodiment(s) of the present disclosure, and any modifications, equivalents, improvements, etc. that fall within the spirit and principles of the embodiment(s) of the present disclosure are intended to be included within the scope of the present disclosure.

Claims (18)

1. A method of gesture control, the method comprising:
acquiring state information of a vehicle and information of at least one controlled module on the vehicle, wherein the controlled module supports gesture control;
enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle;
Enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle comprises:
responsive to the state information of the vehicle indicating that the vehicle is in a driving state, stopping enabling a gesture control function of at least a portion of the controlled modules included in the at least one controlled module; and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module according to the state information of the vehicle, wherein the state information of the vehicle indicates that the speed of the vehicle is in a preset speed range.
2. The method of claim 1, wherein enabling control of the gesture control function of the at least one controlled module based on the state information of the vehicle comprises:
acquiring pre-determined dangerous grade information of gesture control functions of each controlled module;
and responding to the state information of the vehicle to indicate that the vehicle is in a running state, and stopping starting the gesture control function of the controlled module for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information.
3. The method according to claim 1 or 2, wherein the ceasing to enable the gesture control function of the controlled module comprises:
and configuring the gesture control function of the controlled module into an unavailable state.
4. The method of claim 3, wherein configuring the gesture control function of the controlled module to an unavailable state comprises:
and automatically switching the gesture control function of the controlled module from the available state to the unavailable state.
5. The method of claim 3, wherein after configuring the gesture control function of the controlled module to an unavailable state, the method further comprises:
and automatically switching the gesture control function of the controlled module from the unavailable state to the available state.
6. The method according to claim 1 or 2, wherein the ceasing to enable the gesture control function of the controlled module comprises:
and stopping starting the gesture control function of the controlled module according to a preset forbidden mark of the gesture control function of the controlled module.
7. The method of claim 1, wherein enabling control of the gesture control function of the at least one controlled module based on the state information of the vehicle comprises:
Enabling control over all gesture control functions in the controlled module;
or, performing enabling control on at least one gesture control function in the controlled module.
8. The method of claim 1, wherein the controlled module comprises at least one of: window control, multimedia play control, light brightness control, air conditioner temperature adjustment and interactive entertainment control.
9. A gesture control apparatus, the apparatus comprising:
the information acquisition module is used for acquiring state information of a vehicle and information of at least one controlled module on the vehicle, and the controlled module supports gesture control;
the enabling control module is used for enabling control of the gesture control function of the at least one controlled module according to the state information of the vehicle;
the enabling control module is specifically configured to: responsive to the state information of the vehicle indicating that the vehicle is in a driving state, stopping enabling a gesture control function of at least a portion of the controlled modules included in the at least one controlled module; and stopping starting the gesture control function of at least part of the controlled modules included in the at least one controlled module according to the state information of the vehicle, wherein the state information of the vehicle indicates that the speed of the vehicle is in a preset speed range.
10. The apparatus of claim 9, wherein the device comprises a plurality of sensors,
the enabling control module is specifically configured to: acquiring pre-determined dangerous grade information of gesture control functions of each controlled module; and responding to the state information of the vehicle to indicate that the vehicle is in a running state, and stopping starting the gesture control function of the controlled module for the gesture control function of the controlled module with the dangerous grade information higher than the preset grade information.
11. The device according to claim 9 or 10, wherein,
the enabling control module, when being used for stopping starting the gesture control function of the controlled module, comprises: and configuring the gesture control function of the controlled module into an unavailable state.
12. The apparatus of claim 11, wherein the enabling control module, when configured to configure the gesture control function of the controlled module to an unavailable state, comprises: and automatically switching the gesture control function of the controlled module from the available state to the unavailable state.
13. The apparatus of claim 11, wherein the enabling control module is further configured to: after the gesture control function of the controlled module is configured into an unavailable state, the gesture control function of the controlled module is automatically switched from the unavailable state to the available state.
14. The device according to claim 9 or 10, wherein,
the enabling control module, when being used for stopping starting the gesture control function of the controlled module, comprises: and stopping starting the gesture control function of the controlled module according to a preset forbidden mark of the gesture control function of the controlled module.
15. The apparatus of claim 9, wherein the device comprises a plurality of sensors,
the enabling control module is specifically configured to: enabling control over all gesture control functions in the controlled module; or, performing enabling control on at least one gesture control function in the controlled module.
16. The apparatus of claim 9, wherein the controlled module comprises at least one of: window control, multimedia play control, light brightness control, air conditioner temperature adjustment and interactive entertainment control.
17. An electronic device comprising a memory for storing computer instructions executable on the processor for implementing the method of any one of claims 1 to 8 when the computer instructions are executed.
18. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the method of any of claims 1 to 8.
CN201911008047.1A 2019-10-22 2019-10-22 Gesture control method and device Active CN110750159B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911008047.1A CN110750159B (en) 2019-10-22 2019-10-22 Gesture control method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911008047.1A CN110750159B (en) 2019-10-22 2019-10-22 Gesture control method and device

Publications (2)

Publication Number Publication Date
CN110750159A CN110750159A (en) 2020-02-04
CN110750159B true CN110750159B (en) 2023-09-08

Family

ID=69279390

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911008047.1A Active CN110750159B (en) 2019-10-22 2019-10-22 Gesture control method and device

Country Status (1)

Country Link
CN (1) CN110750159B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113591659B (en) * 2021-07-23 2023-05-30 重庆长安汽车股份有限公司 Gesture control intention recognition method and system based on multi-mode input

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102713794A (en) * 2009-11-24 2012-10-03 奈克斯特控股公司 Methods and apparatus for gesture recognition mode control
CN104460974A (en) * 2013-09-25 2015-03-25 现代自动车株式会社 Vehicle operation device
JP2018180987A (en) * 2017-04-14 2018-11-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Automatic driving vehicle, stopping method/program of automatic driving vehicle
CN109933199A (en) * 2019-03-13 2019-06-25 百度在线网络技术(北京)有限公司 Control method, device, electronic equipment and storage medium based on gesture
JP2019114188A (en) * 2017-12-26 2019-07-11 本田技研工業株式会社 Vehicle control device, vehicle control method, and program

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA3029938A1 (en) * 2018-01-12 2019-07-12 Superior Marine Products Llc Gesturing for control input for a vehicle

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102713794A (en) * 2009-11-24 2012-10-03 奈克斯特控股公司 Methods and apparatus for gesture recognition mode control
CN104460974A (en) * 2013-09-25 2015-03-25 现代自动车株式会社 Vehicle operation device
JP2018180987A (en) * 2017-04-14 2018-11-15 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカPanasonic Intellectual Property Corporation of America Automatic driving vehicle, stopping method/program of automatic driving vehicle
JP2019114188A (en) * 2017-12-26 2019-07-11 本田技研工業株式会社 Vehicle control device, vehicle control method, and program
CN109933199A (en) * 2019-03-13 2019-06-25 百度在线网络技术(北京)有限公司 Control method, device, electronic equipment and storage medium based on gesture

Also Published As

Publication number Publication date
CN110750159A (en) 2020-02-04

Similar Documents

Publication Publication Date Title
CN110716648B (en) Gesture control method and device
EP3754476B1 (en) Information display method, graphical user interface and terminal
US10401948B2 (en) Information processing apparatus, and information processing method to operate on virtual object using real object
CN110764616A (en) Gesture control method and device
EP3133541A1 (en) Method and device for prompting gear shifting of bicycle
EP3902278B1 (en) Music playing method, device, terminal and storage medium
EP3611055B1 (en) Multimedia information push method and apparatus, storage medium, and electronic device
US11200022B2 (en) Method and apparatus of playing audio data
JP6374598B2 (en) REPRODUCTION CONTROL METHOD, REPRODUCTION CONTROL DEVICE, AND ELECTRONIC DEVICE
CN111346376B (en) Interaction method and device based on multimedia resources, electronic equipment and storage medium
US20170169611A1 (en) Augmented reality workspace transitions based on contextual environment
WO2013036233A1 (en) Augmented reality based on imaged object characteristics
CN103686418A (en) Information processing method and electronic device
JP2017515435A (en) REPRODUCTION CONTROL METHOD, REPRODUCTION CONTROL DEVICE, COMPUTER PROGRAM, AND COMPUTER-READABLE STORAGE MEDIUM
CN110341627B (en) Method and device for controlling behavior in vehicle
CN110991260B (en) Scene marking method, device, equipment and storage medium
CN110750159B (en) Gesture control method and device
CN105955608B (en) Shortcut control method and device and electronic equipment
CN113050910A (en) Voice interaction method, device, equipment and storage medium
JP2014086849A (en) Content acquisition device and program
CN103106909A (en) Vehicle device and vehicle video control method
TWI742421B (en) User interface integration method and vehicle-mounted device
CN110780934B (en) Deployment method and device of vehicle-mounted image processing system
WO2021003949A1 (en) Song playback method, device and system
CN112764523A (en) Man-machine interaction method and device based on iris recognition and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant