CN110850973B - Audio device control method, audio device and storage medium - Google Patents

Audio device control method, audio device and storage medium Download PDF

Info

Publication number
CN110850973B
CN110850973B CN201911050307.1A CN201911050307A CN110850973B CN 110850973 B CN110850973 B CN 110850973B CN 201911050307 A CN201911050307 A CN 201911050307A CN 110850973 B CN110850973 B CN 110850973B
Authority
CN
China
Prior art keywords
audio device
user
rotation angle
rotation
determining
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911050307.1A
Other languages
Chinese (zh)
Other versions
CN110850973A (en
Inventor
葛俊
赵吉福
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Goertek Inc
Original Assignee
Goertek Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Goertek Inc filed Critical Goertek Inc
Priority to CN201911050307.1A priority Critical patent/CN110850973B/en
Publication of CN110850973A publication Critical patent/CN110850973A/en
Application granted granted Critical
Publication of CN110850973B publication Critical patent/CN110850973B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a control method of audio equipment, which comprises the following steps: when a first gesture instruction of a user is detected within a first preset time period, determining a first rotation direction and a first rotation angle according to the first gesture instruction; and controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle. The invention also discloses an audio device and a computer readable storage medium. The invention is convenient for the user to adjust the viewing angle of the display screen of the audio equipment.

Description

Audio device control method, audio device and storage medium
Technical Field
The present invention relates to the field of man-machine interaction, and in particular, to a control method of an audio device, and a computer readable storage medium.
Background
With the development of technology, audio devices having a display screen are emerging. Generally, when a user uses an audio device, the audio device is separated by a certain distance, if the user wants to adjust the display orientation of the display screen of the audio device, the user can only manually adjust the display screen before going to the audio device, which is inconvenient for the user to adjust the viewing angle of the display screen of the audio device.
The foregoing is provided merely for the purpose of facilitating understanding of the technical solutions of the present invention and is not intended to represent an admission that the foregoing is prior art.
Disclosure of Invention
The invention provides a control method of an audio device, the audio device and a computer readable storage medium, so as to facilitate a user to adjust the viewing angle of a display screen of the audio device.
To achieve the above object, the present invention provides a control method of an audio device, the control method of the audio device comprising the steps of:
when a first gesture instruction of a user is detected within a first preset time period, determining a first rotation direction and a first rotation angle according to the first gesture instruction;
and controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle.
Optionally, when the first gesture instruction of the user is detected within the first preset time period, the step of determining the first rotation direction and the first rotation angle according to the first gesture instruction includes:
when a first gesture instruction of a user is detected within a first preset time period, determining the change of a target coordinate within the first preset time period according to the gesture change corresponding to the first gesture instruction;
and determining a first rotating direction and a first rotating angle according to the change of the target coordinates in the first preset time period and the coordinates of the audio equipment.
Optionally, the step of determining the change of the target coordinate within the first preset duration according to the gesture change corresponding to the first gesture instruction includes:
identifying a fingertip image in the hand image corresponding to the first gesture instruction;
determining target coordinates from the position of the fingertip image relative to the audio device;
and determining the displacement of the target coordinates within the first preset time period. Optionally, the step of determining the first rotation direction and the first rotation angle according to the change of the target coordinates and the coordinates of the audio device within the first preset time period includes:
setting coordinates of the audio equipment as an origin of coordinates, and determining a first coordinate and a second coordinate according to the change of the target coordinates in the first preset time period, wherein the change of the target coordinates in the first preset time period is that the target coordinates in the first preset time period are changed from the first coordinate to the second coordinate;
and determining the first rotation angle and the first rotation direction according to the first coordinate, the second coordinate and the origin of coordinates.
Optionally, the first rotation angle is less than or equal to 180 °.
Optionally, after the step of controlling the rotation of the display screen of the audio device according to the first rotation direction and the first rotation angle, the method further includes:
when a second control instruction is detected within a second preset time period, a second rotation angle and a second rotation direction are obtained;
and controlling the display screen to rotate according to the second rotation direction and the second rotation angle.
Optionally, the second control instruction includes at least one of:
a first voice instruction of a user, wherein the first voice instruction of the user comprises direction information and/or angle information;
and the second gesture instruction is used for identifying the number of fingertips in the gesture image corresponding to the second gesture instruction, and acquiring the second rotation angle according to the number of fingertips, wherein the larger the number of fingertips is, the larger the second rotation angle is, or the second rotation angle is determined according to a preset angle.
Optionally, the audio device is provided with an image capturing device, and before the step of determining the first rotation direction and the first rotation angle according to the first gesture command when the first gesture command of the user is detected within the first preset time period, the method further includes:
when a second voice command of the user is received, determining the position of the user according to the second voice command;
determining a third rotation direction and a third rotation angle according to the position relation between the position of the user and the shooting area of the shooting device;
and controlling the rotation of the image pickup device according to the third rotation direction and the third rotation angle.
To achieve the above object, the present invention also provides an audio apparatus comprising:
the audio device comprises a memory, a processor and a control program of the audio device stored in the memory and capable of running on the processor, wherein the control program of the audio device realizes the steps of the control method of the audio device when being executed by the processor.
In order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a control program of an audio device, which when executed by a processor, implements the steps of the control method of an audio device as described above.
The invention provides a control method of audio equipment, the audio equipment and a computer readable storage medium, wherein when a first gesture instruction of a user is detected within a first preset duration, a first rotation direction and a first rotation angle are determined according to the first gesture instruction; and controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle. Therefore, the user can control the display screen of the audio device to rotate only by making gesture instructions, and even if the user is in a long distance, the user can also control the display screen to rotate, so that the user can conveniently adjust the viewing angle of the display screen of the audio device.
Drawings
FIG. 1 is a schematic diagram of a hardware operating environment of an embodiment terminal according to an embodiment of the present invention;
fig. 2 is a flowchart of a first embodiment of a control method of an audio device according to the present invention;
fig. 3 is a flowchart of a second embodiment of a control method of an audio device according to the present invention;
fig. 4 is a flowchart of a third embodiment of a control method of an audio device according to the present invention;
fig. 5 is a flowchart of a fourth embodiment of a control method of an audio device according to the present invention;
fig. 6 is a diagram illustrating man-machine interaction of a control method of an audio device according to the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
The invention provides a control method of audio equipment, which is convenient for a user to adjust the viewing angle of a display screen of the audio equipment.
As shown in fig. 1, fig. 1 is a schematic diagram of a hardware running environment of an embodiment terminal according to an embodiment of the present invention;
the terminal of the embodiment of the invention can be audio equipment, and can also be a server or a control terminal for controlling the audio equipment.
As shown in fig. 1, the terminal may include: a processor 1001, such as a CPU central processing unit (central processing unit), a memory 1002, and a communication bus 1003. The communication bus 1003 is used to implement connection communication between the constituent elements in the terminal. The memory 1002 may be a high-speed RAM Random Access Memory (RAM) or a stable memory (non-volatile memory), such as a disk memory. The memory 1002 may alternatively be a storage device separate from the processor 1001 described above.
It will be appreciated by those skilled in the art that the configuration of the terminal shown in fig. 1 is not limiting of the terminal of the embodiments of the present invention, and may include more or less components than those illustrated, or may combine certain components, or may be arranged in different components.
As shown in fig. 1, a control program of an audio device may be included in a memory 1002 as a computer storage medium.
In the terminal shown in fig. 1, the processor 1001 may be used to call a control program of an audio device stored in the memory 1002 and perform the following operations:
when a first gesture instruction of a user is detected within a first preset time period, determining a first rotation direction and a first rotation angle according to the first gesture instruction;
and controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
when a first gesture instruction of a user is detected within a first preset time period, determining the change of a target coordinate within the first preset time period according to the gesture change corresponding to the first gesture instruction;
and determining a first rotating direction and a first rotating angle according to the change of the target coordinates in the first preset time period and the coordinates of the audio equipment.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
identifying a fingertip image in the hand image corresponding to the first gesture instruction;
determining target coordinates from the position of the fingertip image relative to the audio device;
and determining the displacement of the target coordinates within the first preset time period.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
the first rotation angle is less than or equal to 180 °.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
setting coordinates of the audio equipment as an origin of coordinates, and determining a first coordinate and a second coordinate according to the change of the target coordinates in the first preset time period, wherein the change of the target coordinates in the first preset time period is that the target coordinates in the first preset time period are changed from the first coordinate to the second coordinate;
and determining the first rotation angle and the first rotation direction according to the first coordinate, the second coordinate and the origin of coordinates.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
when a second control instruction is detected within a second preset time period, a second rotation angle and a second rotation direction are obtained;
and controlling the display screen to rotate according to the second rotation direction and the second rotation angle.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
the second control instruction includes at least one of:
a first voice instruction of a user, wherein the first voice instruction of the user comprises direction information and/or angle information;
and the second gesture instruction is used for identifying the number of fingertips in the gesture image corresponding to the second gesture instruction, and acquiring the second rotation angle according to the number of fingertips, wherein the larger the number of fingertips is, the larger the second rotation angle is, or the second rotation angle is determined according to a preset angle.
Further, the processor 1001 may call a control program of the audio device stored in the memory 1002, and further perform the following operations:
when a second voice command of the user is received, determining the position of the user according to the second voice command;
determining a third rotation direction and a third rotation angle according to the position relation between the position of the user and the shooting area of the shooting device;
and controlling the rotation of the image pickup device according to the third rotation direction and the third rotation angle.
Referring to fig. 2, in an embodiment, the control method of the audio device includes:
and S10, when a first gesture instruction of a user is detected within a first preset time period, determining a first rotation direction and a first rotation angle according to the first gesture instruction.
In this embodiment, the terminal may be an audio device, or may be a control terminal or a server of the audio device. The following description will take an example in which the embodiment terminal is an audio device. It should be noted that the audio device may be a smart speaker.
Optionally, the audio device is provided with a display screen.
Optionally, the audio device may be further provided with a camera; or the camera device is arranged in the action space of the audio equipment, and the terminal is communicated with the camera device through data communication. The camera device can be used for collecting gesture instructions made by a user. The following description will be made taking an example in which the image pickup device is provided in an audio apparatus.
Optionally, in the first preset duration, the user makes a gesture instruction in a shooting area of the image capturing device, and the terminal may collect, through the image capturing device, the gesture instruction made by the user as the first gesture instruction.
Optionally, when the intelligent device detects the first gesture command, the change of the target coordinate in the first preset duration may be determined according to the gesture change corresponding to the first gesture command, and the first rotation direction and the first rotation angle may be determined according to the change of the target coordinate and the coordinate of the audio device.
It should be noted that, the terminal may identify a preset mark point in the hand image according to the hand image corresponding to the first gesture instruction, and use the position of the preset mark point as the target coordinate, for example, may set the fingertip in the hand image as the preset mark point, use the position of the fingertip as the target coordinate, collect the coordinate displacement corresponding to the fingertip, change the coordinate of the fingertip from the first coordinate to the second coordinate in the first preset duration, set the coordinate of the audio device as the origin of coordinates, and determine the first rotation angle and the first rotation direction according to the first coordinate, the second coordinate and the origin of coordinates.
Alternatively, the terminal may store different corresponding relations between the first gesture instructions and the first rotation directions in advance, and when the terminal detects the first gesture instructions within a first preset time period, the terminal may acquire the corresponding first rotation directions according to the first gesture instructions, and acquire a preset angle as the first rotation angle (the preset angle may be the first preset angle, and the value range of the first preset angle may be 10 ° -45 °). For example, the terminal may save that the first rotation direction corresponding to the right finger command is a counterclockwise rotation direction, and the first rotation direction corresponding to the left finger command is a clockwise rotation direction, and the first preset angle is 20 °, and when the terminal detects that the first gesture command is a right hand command, the obtained first rotation direction is a counterclockwise rotation direction, and the first rotation angle is 20 °.
It should be noted that the first preset duration may be set according to actual situation requirements, and may be selected from 1 second to 10 seconds.
And step S20, controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle.
Optionally, the display screen is arranged on the audio device through a rotatable structure, and the terminal can control the rotation of the display screen by controlling the rotation of the rotatable structure; optionally, the audio device is provided with or mounted on a rotatable base, and the terminal is operable to control rotation of the display screen by controlling rotation of the rotatable base.
Optionally, after determining the first rotation direction and the first rotation angle of the display screen according to the first gesture instruction, the terminal can control the display screen to rotate by the first rotation angle in a direction corresponding to the first rotation direction through the motor.
In one embodiment, when a first gesture instruction of a user is detected, determining a first rotation direction and a first rotation angle according to the first gesture instruction; and controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle. Therefore, the user can control the display screen of the audio device to rotate only by making gesture instructions, and even if the user is in a long distance, the user can also control the display screen to rotate, so that the user can conveniently adjust the viewing angle of the display screen of the audio device.
In a second embodiment, as shown in fig. 3, on the basis of the embodiment shown in fig. 2, the step of determining the first rotation direction and the first rotation angle according to the first gesture command when the first gesture command of the user is detected within the first preset time period includes:
step S11, when a first gesture instruction of a user is detected within a first preset time period, determining the change of a target coordinate within the first preset time period according to the gesture change corresponding to the first gesture instruction.
And step S12, determining a first rotation direction and a first rotation angle according to the change of the target coordinates and the coordinates of the audio equipment within the first preset time period.
In this embodiment, after detecting a first gesture instruction of a user within a first preset duration, the terminal obtains a hand image corresponding to the first gesture instruction, then identifies a preset mark point in the hand image, and uses a position of the preset mark point as a target coordinate (specific coordinate data may use a position of the audio device as a coordinate origin, and establish a three-dimensional coordinate system for determination). The preset mark point may be a palm center of the user or a fingertip of the user, and the preset mark point is taken as an example of the fingertip of the user.
Optionally, when the preset mark point is a fingertip of the user, the terminal may identify a fingertip image in the hand image through a fingertip identification algorithm, and then determine the target coordinate according to the position of the fingertip of the user relative to the audio device. It should be noted that, the fingertip recognition algorithm may adopt a gravity center distance method, and each peak value obtained by recognizing the distances between all points of the edge of the hand and the palm center traverse clockwise or anticlockwise corresponds to a finger fingertip (if the user stretches out only one finger, only one peak value is obtained), and the generation position of the peak value is the fingertip position. The fingertip recognition algorithm can be divided into 5 steps: (1) gaussian blur is performed on the hand image; (2) skin color segmentation; (3) finding a hand contour; (4) calculating moment, namely palm center; (5) looking for a user's fingertip.
When the user simultaneously extends a plurality of fingers, the average value of the target coordinates is calculated as the final target coordinates after obtaining a plurality of target coordinates.
And establishing a three-dimensional coordinate system by taking the position of the audio equipment as a coordinate origin, taking the position of a user fingertip as a target coordinate in a first preset time period, and changing the target coordinate from the first coordinate to the second coordinate in the first preset time period to obtain a connecting line a between the coordinate origin and the first coordinate and a connecting line b between the coordinate origin and the second coordinate, so that an angle beta between the connecting line a and the connecting line b and a direction I of the first coordinate pointing to the second coordinate can be calculated. When the display screen can rotate in any direction in the three-dimensional space, the angle beta and the direction one are the first rotation angle and the first rotation direction, and when the display screen rotates along a certain plane, the angle beta and the angle component beta 'of the direction one on the rotation plane of the display screen and the direction component direction two are used as the first rotation angle and the second rotation direction, for example, when the display screen rotates along a horizontal plane, the angle beta and the angle component beta' of the direction one on the horizontal plane and the direction two are used as the first rotation angle and the first rotation direction. The first rotation angle is less than or equal to 180 °.
Taking a rotation plane of a display screen as a horizontal plane as an example, referring to fig. 6, the intelligent device detects a first gesture instruction of a user within a first preset period of time, and obtains a change of a fingertip from a first coordinate 22 to a second coordinate 21, wherein a connection line between the first coordinate 22 and an origin O is 40, a connection line between the second coordinate 21 and the origin O is 30, and an included angle β between the connection line 30 and the connection line 40 and a direction from the first coordinate 22 to the second coordinate 21 are directions one. Because the included angle β may not be in a horizontal plane, when the rotation plane of the display screen is a horizontal plane, an included angle component β 'of the included angle β in the horizontal plane and a direction component direction two of the direction one in the horizontal plane are calculated, and the included angle component β' and the direction two are the first rotation angle and the first rotation direction.
It should be noted that, the terminal may divide the active space of the audio device into m×n grids in advance, each grid has its corresponding coordinate range, then determine the offset angle between each grid and the central line of the screen, after obtaining the target coordinates, further obtain the grid where the target coordinates are located, and then obtain the offset angle between the grid and the central line of the screen as the first rotation angle.
Alternatively, when the display screen of the audio device is rotatable by 360 °, two first rotation angles may be determined, and the two first rotation angles correspond to different first rotation directions (respectively, a counterclockwise rotation direction and a clockwise rotation direction). In order to reduce the power consumption of the audio device, therefore, the first rotation angle at which the angle is smallest of the two first rotation angles may be acquired as the finally determined first rotation angle, i.e., the determined first rotation angle is less than or equal to 180 °. When both the first rotation angles are 180 °, one of the first rotation angles may be selected as the determined first rotation angle.
Therefore, the user can control the display screen of the audio device to rotate only by making gesture instructions, and even if the user is in a long distance, the user can also control the display screen to rotate, so that the user can conveniently adjust the viewing angle of the display screen of the audio device.
In a third embodiment, as shown in fig. 4, after the step of controlling the rotation of the display screen of the audio device according to the first rotation direction and the first rotation angle, the method further includes:
and step S30, acquiring a second rotation angle and a second rotation direction when a second control instruction is detected within a second preset time period.
And S40, controlling the display screen to rotate according to the second rotation direction and the second rotation angle.
In this embodiment, after the terminal controls the display screen of the audio device to rotate according to the first rotation direction and the first rotation angle (i.e., after the display screen rotates for the first time), if the user is not satisfied with the viewing angle after the display screen rotates, a second control instruction may be sent within a second preset duration to control the display screen to rotate again, where the second control instruction may be a gesture instruction or a voice instruction.
It should be noted that, the scenario that the user continues to make the gesture instruction may be to continue to hold the gesture corresponding to the first gesture instruction, or may be to make a gesture instruction again.
Optionally, after the terminal controls the display screen to rotate according to the first rotation direction and the first rotation angle, the gesture instruction of the user detected in the second preset duration may be used as a second control instruction, and the first voice instruction of the user detected in the second preset duration may also be used as a second control instruction. The second preset time length can be set according to actual situation requirements, and can be selected to be 5 seconds to 30 seconds.
Optionally, after detecting the second control instruction, when the second control instruction is a first voice instruction of the user, the first voice instruction may include direction and/or angle information, the angle information and the direction information may be obtained by parsing according to the first voice instruction of the user, and as the second rotation angle and the second rotation direction, for example, when the user sends the first voice instruction that "clockwise rotates by 5 °", the user may determine that the second rotation angle is 5 ° at the same time, and the second rotation direction is clockwise.
Optionally, when the second control instruction is a second gesture instruction of the user, the second rotation angle may be obtained according to a preset rule, that is, when the second gesture instruction of the user is detected, the preset angle is obtained as the second rotation angle, where the preset angle is smaller than or equal to the first rotation angle, and the direction indicated by the second gesture instruction is used as the second rotation direction or the preset direction is obtained as the second rotation direction. For example, the number of fingertips in the gesture image corresponding to the gesture instruction is identified, a corresponding preset angle is obtained according to the number of fingertips, the corresponding preset angle is used as a second rotation angle, and the larger the number of fingertips obtained by identification is, the larger the second rotation angle obtained by determination is; for example, when the rotation angle corresponding to one fingertip is 5 °, and when the number of fingertips corresponding to the second gesture command is 2, the obtained second rotation angle is 10 °, and in addition, the direction pointed by the fingertips is identified as the second rotation direction, or the second rotation direction is determined according to the preset direction. The second rotation angle is finely adjusted by a user based on the position of the display screen after rotating according to the first rotation angle, so that the preset angle can be a smaller angle value, the value range of the preset angle can be 1-10 degrees, and the preset angle is set according to practical conditions. The range of the corresponding rotation angle of one fingertip can be 5 degrees to 10 degrees. For example, when the rotation angle corresponding to one fingertip is 5 °, and when the number of fingertips corresponding to the second gesture command is 2, the obtained second rotation angle is 10 °
Optionally, after determining the second rotation direction corresponding to the second control instruction and determining to obtain the second rotation angle, the audio device may control the display to rotate again according to the second rotation direction and the second rotation angle.
Therefore, after the display screen is rotated for the first time, the display screen may not be rotated to the direction expected by the user completely, and at this time, the user can make similar gesture instructions or voice instructions again to make small correction rotation on the display screen, so that the viewing requirement of the user is met.
In a fourth embodiment, as shown in fig. 5, on the basis of the embodiments in fig. 2 to 4, the audio device is provided with an image capturing device, and before the step of determining the first rotation direction and the first rotation angle according to the first gesture command when the first gesture command of the user is detected within the first preset duration, the method further includes:
and step S50, when a second voice instruction of the user is received, determining the position of the user according to the second voice instruction.
Step S51, determining a third rotation direction and a third rotation angle according to a positional relationship between the position of the user and the shooting area of the imaging device.
And step S52, controlling the image pickup device to rotate according to the third rotation direction and the third rotation angle.
In this embodiment, the audio device is provided with a microphone array, and when the terminal detects the second voice command, that is, detects the specific voice command sent by the user through the microphone array, the terminal can obtain the position of the user through the algorithm processing of sound source localization, and the camera device rotates to face the user and collects the image information of the user.
Optionally, before detecting the first gesture instruction, the terminal may determine the position of the user by first receiving the time of the voice information before and after at least two microphones on the microphone array and the sound intensity of the voice information detected by at least two microphones when receiving the second voice instruction sent by the user.
Optionally, the audio device is provided with an image pickup means.
Optionally, the camera device may be connected to the audio device through a rotatable structure, and the terminal may rotate by controlling the rotatable structure to control rotation of the camera device; the camera device can also be arranged on a display screen of the audio equipment, and the terminal can control the rotation of the display screen so as to realize the control of the rotation of the camera device.
Alternatively, the terminal may determine the photographing region of the image pickup device in advance according to the current photographing wide angle and photographing accuracy of the image pickup device. It should be appreciated that the imaging area of the imaging device may be substantially a sector.
Optionally, after the position of the user is obtained according to the second voice command, the terminal may determine a third rotation direction and a third rotation angle for controlling rotation of the image capturing device according to the position of the user and the current capturing area of the image capturing device, so as to adjust a spatial position where the capturing area is located, so that the position of the user is located in the capturing area.
Optionally, after determining the third rotation direction and the third rotation angle, the terminal controls the image capturing device to rotate according to the third rotation angle and the third rotation direction, so that the position of the user is in the capturing area of the image capturing device.
It should be understood that, after the audio device obtains the user position according to the second voice command, it may first determine whether the user position is in the shooting area, and if not, execute steps S50 to S52; if yes, the terminal directly executes step S10.
Therefore, the user can be in the shooting area without actively searching the shooting area of the camera device, and is convenient to make gesture instructions to the audio equipment.
In addition, the invention also provides an audio device, which comprises a memory, a processor and a control program of the audio device, wherein the control program of the audio device is stored on the memory and can be run on the processor, and the processor realizes the steps of the control method of the audio device when executing the control program of the audio device.
Furthermore, the present invention also proposes a computer-readable storage medium comprising a control program of an audio device, which when executed by a processor implements the steps of the control method of an audio device as described in the above embodiments.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of embodiments, it will be clear to a person skilled in the art that the above embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course also by means of hardware, but in many cases the former is an alternative embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a television, a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description of the invention and the accompanying drawings is only illustrative, and is not intended to limit the scope of the invention, but rather is to be construed in any way in view of the following description, the accompanying drawings and the like.

Claims (8)

1. A control method of an audio device, characterized in that the control method of the audio device comprises the steps of:
when a first gesture instruction of a user is detected within a first preset time period, determining a first rotation direction and a first rotation angle according to a hand image corresponding to the first gesture instruction;
controlling the display screen of the audio equipment to rotate according to the first rotating direction and the first rotating angle;
when a first gesture instruction of a user is detected within a first preset time period, determining a first rotation direction and a first rotation angle according to a hand image corresponding to the first gesture instruction includes:
when a first gesture instruction of a user is detected within a first preset time period, determining the change of a target coordinate within the first preset time period according to the gesture change of a hand image corresponding to the first gesture instruction;
determining a first rotation direction and a first rotation angle according to the change of the target coordinates in the first preset time period and the coordinates of the audio equipment;
the step of determining the change of the target coordinates in the first preset duration according to the gesture change of the hand image corresponding to the first gesture instruction includes:
identifying a fingertip image in the hand image corresponding to the first gesture instruction through a fingertip identification algorithm;
determining target coordinates from the position of the fingertip image relative to the audio device;
and determining the displacement of the target coordinates within the first preset time period.
2. The method of controlling an audio device according to claim 1, wherein the step of determining the first rotation direction and the first rotation angle according to the change of the target coordinates and the coordinates of the audio device within the first preset time period comprises:
setting coordinates of the audio equipment as an origin of coordinates, and determining a first coordinate and a second coordinate according to the change of the target coordinates in the first preset time period, wherein the change of the target coordinates in the first preset time period is that the target coordinates in the first preset time period are changed from the first coordinate to the second coordinate;
and determining the first rotation angle and the first rotation direction according to the first coordinate, the second coordinate and the origin of coordinates.
3. The control method of an audio device according to any one of claims 1 to 2, wherein the first rotation angle is less than or equal to 180 °.
4. The method for controlling an audio device according to any one of claims 1 to 2, further comprising, after the step of controlling the rotation of the display screen of the audio device according to the first rotation direction and the first rotation angle:
when a second control instruction is detected within a second preset time period, a second rotation angle and a second rotation direction are obtained;
and controlling the display screen to rotate according to the second rotation direction and the second rotation angle.
5. The method of controlling an audio device of claim 4, wherein the second control instruction comprises at least one of:
a first voice instruction of a user, wherein the first voice instruction of the user comprises direction information and/or angle information;
and the second gesture instruction is used for identifying the number of fingertips in the gesture image corresponding to the second gesture instruction, and acquiring the second rotation angle according to the number of fingertips, wherein the larger the number of fingertips is, the larger the second rotation angle is, or the second rotation angle is determined according to a preset angle.
6. The method for controlling an audio device according to claim 1, wherein the audio device is provided with an image capturing device, and the step of determining the first rotation direction and the first rotation angle according to the hand image corresponding to the first gesture command when the first gesture command of the user is detected within the first preset time period further comprises:
when a second voice command of the user is received, determining the position of the user according to the second voice command;
determining a third rotation direction and a third rotation angle according to the position relation between the position of the user and the shooting area of the shooting device;
and controlling the rotation of the image pickup device according to the third rotation direction and the third rotation angle.
7. An audio device comprising a memory, a processor and a control program for the audio device stored on the memory and executable on the processor, the control program for the audio device, when executed by the processor, implementing the steps of the control method for the audio device according to any one of claims 1 to 6.
8. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon a control program of an audio device, which when executed by a processor, implements the steps of the control method of an audio device according to any one of claims 1 to 6.
CN201911050307.1A 2019-10-29 2019-10-29 Audio device control method, audio device and storage medium Active CN110850973B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911050307.1A CN110850973B (en) 2019-10-29 2019-10-29 Audio device control method, audio device and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911050307.1A CN110850973B (en) 2019-10-29 2019-10-29 Audio device control method, audio device and storage medium

Publications (2)

Publication Number Publication Date
CN110850973A CN110850973A (en) 2020-02-28
CN110850973B true CN110850973B (en) 2023-10-03

Family

ID=69598487

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911050307.1A Active CN110850973B (en) 2019-10-29 2019-10-29 Audio device control method, audio device and storage medium

Country Status (1)

Country Link
CN (1) CN110850973B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111857350B (en) * 2020-07-28 2024-07-19 海尔优家智能科技(北京)有限公司 Method, device and equipment for rotating display equipment
CN112468750A (en) * 2020-11-13 2021-03-09 深圳康佳电子科技有限公司 Display control method, device, system and computer readable storage medium
TWI817194B (en) * 2021-09-07 2023-10-01 中原大學 Rotate-type smart speaker and rotate-type home appliance controller

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101000508A (en) * 2006-12-31 2007-07-18 华为技术有限公司 Display terminal control method and device
CN105657260A (en) * 2015-12-31 2016-06-08 宇龙计算机通信科技(深圳)有限公司 Shooting method and terminal
CN108361938A (en) * 2018-02-05 2018-08-03 广东美的暖通设备有限公司 Control method, air conditioner, air-conditioning system and the storage medium of indoor unit
CN109309873A (en) * 2017-07-28 2019-02-05 腾讯科技(深圳)有限公司 Screen angle method of adjustment, device and storage medium
CN109460074A (en) * 2018-10-29 2019-03-12 歌尔科技有限公司 A kind of audio frequency apparatus orientation display methods, device and audio frequency apparatus
CN109885174A (en) * 2019-02-28 2019-06-14 努比亚技术有限公司 Gesture control method, device, mobile terminal and storage medium

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9207769B2 (en) * 2012-12-17 2015-12-08 Lenovo (Beijing) Co., Ltd. Processing method and electronic device
KR101533319B1 (en) * 2014-02-22 2015-07-03 주식회사 브이터치 Remote control apparatus and method using camera centric virtual touch

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101000508A (en) * 2006-12-31 2007-07-18 华为技术有限公司 Display terminal control method and device
CN105657260A (en) * 2015-12-31 2016-06-08 宇龙计算机通信科技(深圳)有限公司 Shooting method and terminal
CN109309873A (en) * 2017-07-28 2019-02-05 腾讯科技(深圳)有限公司 Screen angle method of adjustment, device and storage medium
CN108361938A (en) * 2018-02-05 2018-08-03 广东美的暖通设备有限公司 Control method, air conditioner, air-conditioning system and the storage medium of indoor unit
CN109460074A (en) * 2018-10-29 2019-03-12 歌尔科技有限公司 A kind of audio frequency apparatus orientation display methods, device and audio frequency apparatus
CN109885174A (en) * 2019-02-28 2019-06-14 努比亚技术有限公司 Gesture control method, device, mobile terminal and storage medium

Also Published As

Publication number Publication date
CN110850973A (en) 2020-02-28

Similar Documents

Publication Publication Date Title
CN110850973B (en) Audio device control method, audio device and storage medium
CN108776970B (en) Image processing method and device
US10043308B2 (en) Image processing method and apparatus for three-dimensional reconstruction
CN109934065B (en) Method and device for gesture recognition
CN110035218B (en) Image processing method, image processing device and photographing equipment
CN109165606B (en) Vehicle information acquisition method and device and storage medium
CN103679788B (en) The generation method and device of 3D rendering in a kind of mobile terminal
EP2991027A1 (en) Image processing program, image processing method and information terminal
CN104049760B (en) The acquisition methods and system of a kind of man-machine interaction order
US20160104037A1 (en) Method and device for generating motion signature on the basis of motion signature information
WO2018040480A1 (en) Method and device for adjusting scanning state
CN110286754B (en) Projection method based on eyeball tracking and related equipment
CN111582240B (en) Method, device, equipment and medium for identifying number of objects
CN112068698A (en) Interaction method and device, electronic equipment and computer storage medium
US20200020089A1 (en) Image processing method, apparatus, terminal, and storage medium
US11816924B2 (en) Method for behaviour recognition based on line-of-sight estimation, electronic equipment, and storage medium
CN110726971B (en) Visible light positioning method, device, terminal and storage medium
KR101586071B1 (en) Apparatus for providing marker-less augmented reality service and photographing postion estimating method therefor
CN110942064B (en) Image processing method and device and electronic equipment
CN110769351A (en) Control method of audio device, and storage medium
CN109377519A (en) Target tracking method, device, target tracking equipment and storage medium
CN113780291B (en) Image processing method and device, electronic equipment and storage medium
US9761009B2 (en) Motion tracking device control systems and methods
CN113192127A (en) Image processing method and device, electronic equipment and storage medium
CN108108694B (en) Face feature point positioning method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant