CN110268721B - Microphone subassembly, cloud platform and cloud platform system - Google Patents

Microphone subassembly, cloud platform and cloud platform system Download PDF

Info

Publication number
CN110268721B
CN110268721B CN201780085911.0A CN201780085911A CN110268721B CN 110268721 B CN110268721 B CN 110268721B CN 201780085911 A CN201780085911 A CN 201780085911A CN 110268721 B CN110268721 B CN 110268721B
Authority
CN
China
Prior art keywords
microphone
data
pan
audio data
attitude
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201780085911.0A
Other languages
Chinese (zh)
Other versions
CN110268721A (en
Inventor
周长兴
蓝求
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SZ DJI Osmo Technology Co Ltd
Original Assignee
SZ DJI Osmo Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SZ DJI Osmo Technology Co Ltd filed Critical SZ DJI Osmo Technology Co Ltd
Publication of CN110268721A publication Critical patent/CN110268721A/en
Application granted granted Critical
Publication of CN110268721B publication Critical patent/CN110268721B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00Details of transducers, loudspeakers or microphones
    • H04R1/08Mouthpieces; Microphones; Attachments therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Toys (AREA)
  • Studio Devices (AREA)

Abstract

The invention discloses a microphone assembly, a holder and a holder system. The microphone assembly (10) is used for a pan-tilt-head system. The pan-tilt system comprises a pan-tilt (20). The microphone assembly (10) is in communication with the pan/tilt head (20). The microphone assembly (10) comprises a microphone (11), a body sensing controller (12) arranged on the microphone, a main control unit (13) arranged on the microphone and a transmitting antenna (14). The microphone (11) is used for acquiring audio data. The body sensing controller (12) is used for acquiring the motion parameters of the microphone (11). The main control unit (13) is used for acquiring audio data and calculating attitude data of the microphone (11) according to the motion parameters. The transmitting antenna (14) is used for transmitting the audio data and the attitude data to the pan-tilt head (20). According to the microphone assembly, the cradle head and the cradle head system, the body sensing controller is integrated on the microphone, chips and antennas required by the body sensing controller for independently sending the attitude data to the cradle head are saved, and therefore user experience is improved and cost is saved.

Description

Microphone subassembly, cloud platform and cloud platform system
Technical Field
The invention relates to the technical field of somatosensory control, in particular to a microphone assembly, a holder and a holder system.
Background
The holder system is a system for increasing stability of the imaging device. At present, a pan-tilt system generally includes a pan-tilt, a microphone, and an imaging device mounted on the pan-tilt. The imaging device is used for recording video, and the microphone is used for a user to take in the hand to receive sound and send audio data to the holder so as to record the sound of the user into the video. In order to be applied to different application scenarios, for example, a user is far away from the pan/tilt head, and the user wants to control the posture of the pan/tilt head, the pan/tilt head system is usually further provided with a remote controller, and the remote controller sends control data to the pan/tilt head to control the posture of the pan/tilt head. Therefore, when the user is far away from the cloud platform and uses the remote controller to control the cloud platform, two devices, namely a microphone and the remote controller, are needed, and the user experience is low and the cost is high.
Disclosure of Invention
The embodiment of the invention provides a microphone assembly, a holder and a holder system.
The microphone assembly of the embodiment of the invention is used for a holder system, the holder system comprises a holder, the microphone assembly is communicated with the holder, and the microphone assembly comprises:
a microphone for acquiring audio data;
the body sensing controller is arranged on the microphone and is used for acquiring the motion parameters of the microphone;
the main control unit is arranged on the microphone and used for acquiring the audio data and calculating attitude data of the microphone according to the motion parameters; and
and the transmitting antenna is used for transmitting the audio data and the attitude data to the holder.
The cloud platform of the embodiment of the invention, used for cloud platform system, the said cloud platform system includes the microphone assembly, the said microphone assembly communicates with said cloud platform, the said microphone assembly includes the microphone, the said cloud platform includes:
the receiving antenna is used for receiving audio data acquired by the microphone and attitude data of the microphone, which are sent by the microphone component; and
and the microcontroller is connected with the receiving antenna and used for controlling the attitude of the holder according to the attitude data and fusing the audio data with an image acquired by an imaging device carried on the holder.
The cloud platform system of the embodiment of the invention comprises:
the microphone assembly; and
the pan/tilt/zoom lens assembly is in communication with the pan/tilt/zoom lens assembly.
According to the microphone assembly, the cradle head and the cradle head system, the body sensing controller is integrated on the microphone, chips and antennas required by the body sensing controller for independently sending the attitude data to the cradle head are saved, and therefore user experience is improved and cost is saved.
Additional aspects and advantages of embodiments of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
FIG. 1 is a block schematic diagram of a pan and tilt head system according to an embodiment of the present invention;
fig. 2 is a schematic structural diagram of a microphone assembly according to an embodiment of the present invention;
fig. 3 is a schematic structural view of a pan-tilt head according to an embodiment of the present invention;
FIG. 4 is a block schematic diagram of a pan and tilt head system according to another embodiment of the present invention;
FIG. 5 is a block schematic diagram of a pan and tilt head system according to yet another embodiment of the present invention;
description of the main elements and symbols:
the microphone assembly 10, the microphone 11, the body feeling controller 12, the main control unit 13, the micro control unit 132, the microphone chip 134, the transmitting antenna 14, and the codec 15;
the device comprises a cloud deck 20, a receiving antenna 21, a microcontroller 22, a cloud deck chip 23, a first support 24, a second support 25, a third support 26, a first motor 27, a second motor 28 and a third motor 29;
an imaging device 30;
pan and tilt head system 100.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are exemplary only for the purpose of illustrating the embodiments of the present invention and are not to be construed as limiting the embodiments of the present invention.
In the description of the embodiments of the present invention, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", "clockwise", "counterclockwise", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the embodiments of the present invention and simplifying the description, but do not indicate or imply that the device or element referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the embodiments of the present invention. Furthermore, the terms "first", "second" and "first" are used for descriptive purposes only and are not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, features defined as "first", "second", may explicitly or implicitly include one or more of the described features. In the description of the embodiments of the present invention, "a plurality" means two or more unless specifically limited otherwise.
In the description of the embodiments of the present invention, it should be noted that, unless explicitly stated or limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; may be mechanically connected, may be electrically connected or may be in communication with each other; either directly or indirectly through intervening media, either internally or in any other suitable relationship. Specific meanings of the above terms in the embodiments of the present invention can be understood by those of ordinary skill in the art according to specific situations.
In embodiments of the invention, unless expressly stated or limited otherwise, the first feature "on" or "under" the second feature may comprise the first and second features being in direct contact, or the first and second features being in contact, not directly, but via another feature therebetween. Also, the first feature being "on," "above" and "over" the second feature includes the first feature being directly on and obliquely above the second feature, or merely indicating that the first feature is at a higher level than the second feature. A first feature being "under," "below," and "beneath" a second feature includes the first feature being directly under and obliquely below the second feature, or simply meaning that the first feature is at a lesser elevation than the second feature.
The following disclosure provides many different embodiments or examples for implementing different configurations of embodiments of the invention. In order to simplify the disclosure of embodiments of the invention, the components and arrangements of specific examples are described below. Of course, they are merely examples and are not intended to limit the present invention. Furthermore, embodiments of the invention may repeat reference numerals and/or reference letters in the various examples, which have been repeated for purposes of simplicity and clarity and do not in themselves dictate a relationship between the various embodiments and/or arrangements discussed. In addition, embodiments of the present invention provide examples of various specific processes and materials, but one of ordinary skill in the art may recognize applications of other processes and/or use of other materials.
Referring to fig. 1 and 2, a microphone assembly 10 for a pan/tilt head system 100 is provided according to an embodiment of the present invention. Pan/tilt head system 100 includes pan/tilt head 20. The microphone assembly 10 is in communication with a pan/tilt head 20. The microphone assembly 10 includes a microphone 11, a body-sensing controller 12, a main control unit 13, and a transmitting antenna 14. The body-sensing controller 12 and the main control unit 13 are provided on the microphone 11. The microphone 11 is used to acquire audio data. The body sensing controller 12 is used to obtain the motion parameters of the microphone 11. The main control unit 13 is used for acquiring audio data and calculating attitude data of the microphone 11 according to the motion parameters. The transmitting antenna 14 is used to transmit the audio data and the attitude data to the pan/tilt head 20.
According to the microphone assembly 10, the body sensing controller 12 is integrated on the microphone 11, the audio data and the attitude data are sent to the cloud deck 20 together, chips and antennas required for the body sensing controller 12 to send the attitude data to the cloud deck 20 independently are saved, and therefore user experience is improved and cost is saved.
Referring to fig. 2 and 3, in one embodiment, the microphone 11 is held by a user to obtain audio data of the user, so as to record the voice of the user into a video captured by the imaging device 30 remotely mounted on the pan/tilt head 20. Of course, the audio data acquired by the microphone 11 may also include audio data of the user's surroundings. The motion sensing controller 12 is configured to identify, track, and quantify a real-time motion state of the microphone 11 to obtain a motion parameter of the microphone 11. The main control unit 13 is configured to obtain audio data from the microphone 11, and perform attitude calculation on the microphone 11 according to the motion parameters, thereby calculating attitude data of the microphone 11 in a geodetic coordinate system. Finally, the transmitting antenna 14 transmits the audio data and the attitude data to the pan/tilt head 20.
Referring to fig. 4, in some embodiments, the main control Unit 13 includes a Micro Controller Unit (MCU) 132 and a microphone chip 134. The microphone chip 134 is used to acquire audio data. The micro control unit 132 is used to calculate pose data from the motion parameters.
In particular, a microphone chip 134 and a micro control unit 132 may be configured in the main control unit 13, and the microphone chip 134 may acquire audio data from the microphone 11 through an integrated audio interface.
In some embodiments, the transmit antenna 14 is used to transmit audio data and pose data separately to the pan/tilt head 20.
In some embodiments, the microphone chip 134 is further configured to integrate the audio data and the gesture data to obtain integrated data. The transmitting antenna 14 transmits the audio data and the attitude data to the pan/tilt head 20 is to transmit the integrated data to the pan/tilt head 20.
In some embodiments, the microphone 11 is a microphone 11 that outputs digital audio data. At this time, the microphone chip 134 is used to directly acquire digital audio data.
Specifically, the microphone 11 that outputs digital audio data may be a digital microphone. The microphone chip 134 obtains digital audio data directly from the digital microphone. It can be understood that the digital microphone has strong anti-interference capability and is not interfered and influenced by computers, networks and radio frequency magnetic field signal sources, so that the digital microphone has good sound receiving effect, and the limited space of the digital microphone can be effectively utilized to integrate the body sensing controller 12 in the digital microphone because a shielding wire is not needed.
Referring to fig. 5, in some embodiments, the microphone 11 is a microphone 11 outputting analog audio data. The microphone assembly 10 also includes a codec (codec) 15. The codec 15 is connected to both the microphone 11 and the microphone chip 134. The codec 15 is configured to convert analog audio data into digital audio data and output the digital audio data to the microphone chip 134.
Specifically, the microphone 11 that outputs analog audio data may be an analog microphone. Generally, the codec 15 is used to convert a digital signal into an analog signal, or convert an analog signal into a digital signal. In the present embodiment, the codec 15 is configured to convert analog audio data into digital audio data and output the digital audio data to the microphone chip 134. It will be appreciated that the analog microphone is less costly, which is advantageous in reducing the cost of manufacturing the microphone assembly 10.
In this way, the selection of the type of the microphone 11 is diversified, and the application range is wide.
Referring to fig. 2, in some embodiments, the somatosensory controller 12 is integrated inside the microphone 11; or the somatosensory controller 12 is integrated outside the microphone 11.
Preferably, the somatosensory controller 12 is integrated inside the microphone 11, which not only utilizes the housing of the microphone 11 to protect itself to improve the lifetime of the somatosensory controller 12, but also reduces the volume of the microphone assembly 10 to improve the user experience. In one embodiment, the somatosensory controller 12 may be integrated in the center position inside the microphone 11, thereby more accurately acquiring the motion parameters of the microphone 11.
In some embodiments, the main control unit 13 is also integrated inside the microphone 11 to further reduce the volume of the microphone assembly 10, improve the user experience, and protect the main control unit 13. Wherein the transmitting antenna 14 may be arranged on the outer surface of the microphone 11.
In some embodiments, the somatosensory controller 12 comprises a gyroscope; or the somatosensory controller 12 comprises a gyroscope and an accelerometer; or the body sensing controller 12 includes a gyroscope and a magnetic sensor; or the body sensing controller 12 includes, an accelerometer and a magnetic sensor.
It will be appreciated that the somatosensory controller 12 is used to obtain the motion parameters of the microphone 11. Specifically, the motion parameter acquired by the gyroscope is angular velocity, the motion parameter acquired by the accelerometer is acceleration, and the motion parameter acquired by the magnetic sensor is position or direction. The main control unit 13 performs attitude calculation for the microphone 11 based on these motion parameters, thereby calculating attitude data of the microphone 11 in the geodetic coordinate system. Of course, the main control unit 13 may also calculate the attitude data of the microphone 11 in the geocentric/geostationary coordinate system or other coordinate systems.
In some embodiments, the attitude data includes at least one of yaw angle, roll angle, pitch angle, yaw rate, roll rate, pitch rate.
For example, the attitude data may include yaw angle; or include roll angle; or yaw and pitch rates; or yaw angle, pitch angle, roll angle speed; or include yaw, roll, pitch, yaw rate, roll rate, and pitch rate.
In some embodiments, the microphone chip 134 is also used to encode audio data and gesture data.
Specifically, encoding refers to representing the consolidated data in code, making it information that can be processed and analyzed by a computer. The code includes numbers, letters, special symbols, or a combination thereof.
In some embodiments, the microphone assembly 10 is in wireless or bluetooth communication connection with the pan/tilt head 20 via the transmitting antenna 14.
When the microphone assembly 10 is in wireless communication connection with the cradle head 20 through the transmitting antenna 14, the microphone assembly 10 and the cradle head 20 can adopt 5.2G wireless connection for wireless communication, and the working frequency range of the transmitting antenna 14 is 5150-5350 MHz. It can be understood that the wireless connection of 5.2G has the advantages of small interference, high frequency, etc., and the volume of the transmitting antenna 14 can be set to be small.
In other embodiments, when the microphone assembly 10 is connected to the cradle head 20 through the transmitting antenna 14 in a wireless communication manner, the microphone assembly 10 and the cradle head 20 may also be connected in a wireless manner by using 5.8G for wireless communication, and the operating frequency range of the transmitting antenna 14 is 5250-5825 MHz.
Referring to fig. 1 and 3, an embodiment of the present invention provides a head 20 for a head system 100. Pan-tilt system 100 includes a microphone assembly 10. The microphone assembly 10 is in communication with a pan/tilt head 20. The microphone assembly 10 includes a microphone 11. The pan/tilt head 20 includes a receiving antenna 21 and a microcontroller 22 connected to the receiving antenna 21. The receiving antenna 21 is used for receiving the audio data acquired by the microphone 11 and the attitude data of the microphone 11 sent by the microphone assembly 10. The microcontroller 22 is configured to control the attitude of the pan/tilt head 20 based on the attitude data of the microphone 11, and to fuse audio data with an image acquired by the imaging device 30 mounted on the pan/tilt head 20.
The cradle head 20 of the embodiment of the invention receives the audio data and the attitude data through the receiving antenna 21, and controls the attitude of the cradle head 20 through the microcontroller 22 according to the attitude data of the microphone 11, thereby saving the antenna required by the cradle head 20 for independently receiving the attitude data of the microphone 11.
In some embodiments, microcontroller 22 is configured to control the movement of the head 20 in accordance with the attitude data to cause the attitude of the head 20 to follow the attitude of the microphone 11.
In this way, the user can remotely control the pan/tilt head 20 through the microphone assembly 10, so that the posture of the pan/tilt head 20 is consistent with that of the microphone 11, and the operation is simple. For example, if there are a plurality of users a-C in the scene, if the microphone assembly 10 is initially aimed at the speaking user a, and when the user B speaks, the microphone assembly 10 is turned to B, and at this time, the posture of the microphone 11 is changed, and the pan/tilt head 20 follows the posture of the microphone 11 to be able to orient the imaging device 30 mounted on the pan/tilt head 20 to the user B as well, so that the sound and the picture are synchronized.
In some embodiments, the attitude data includes at least one of yaw angle, roll angle, pitch angle, yaw rate, roll rate, pitch rate.
For example, the attitude data may include yaw angle; or include roll angle; or yaw and pitch rates; or yaw angle, pitch angle, roll angle speed; or include yaw, roll, pitch, yaw rate, roll rate, and pitch rate.
Specifically, the pan-tilt 20 according to the embodiment of the present invention may be a two-axis pan-tilt or a three-axis pan-tilt, and the pan-tilt 20 is schematically illustrated as a three-axis pan-tilt, please refer to fig. 3, in which the pan-tilt 20 includes a first support 24, a second support 25, and a third support 26. The pan/tilt head 20 comprises a driving motor, and the microcontroller 22 is configured to control the driving motor to drive the pan/tilt head 20 to move according to the attitude data of the microphone 11 so that the attitude of the pan/tilt head 20 follows the attitude of the microphone 11. The drive motor comprises a first motor 27 connecting the first bracket 24 and the third bracket 26, a second motor 28 connecting the first bracket 24 and the second bracket 25, and a third motor 29 arranged at the end of the second bracket 25 facing away from the second motor 28. The first bracket 24 is a roll shaft bracket, the second bracket 25 is a yaw shaft bracket, and the third bracket 26 is a pitch shaft bracket. The first motor 27, the second motor 28, and the third motor 29 are a pitch motor, a roll motor, and a yaw motor, respectively. The first motor 27 can drive the third bracket 26 or the imaging device 30 to rotate about the pitch axis. The second motor 28 can drive the first support 24 or the imaging device 30 to rotate about the roll axis. The third motor 29 can drive the second support 25 or the imaging device 30 to rotate about the yaw axis.
In some embodiments, the audio data and the pose data are encoded data. The pan/tilt head 20 further includes a pan/tilt head chip 23. The pan/tilt/zoom chip 23 is used to decode the encoded audio data and the attitude data. The microcontroller 22 is configured to generate a control instruction according to the attitude data, and control the pan/tilt head 20 to perform an operation corresponding to the control instruction according to the control instruction.
The pan/tilt/zoom lens 23 and the microphone chip 134 may be the same chip.
Specifically, the control instruction may cause the cradle head 20 to follow the posture of the microphone 11, that is, make the posture of the cradle head 20 consistent with the posture of the microphone 11, or may be a control instruction generated by the microcontroller 22 for judging the current posture of the cradle head 20 and adjusting the current posture according to actual conditions, or the like.
In some embodiments, the pan/tilt head 20 is in wireless or bluetooth communication connection with the microphone assembly 10 via a receiving antenna 21.
When the cradle head 20 is in wireless communication connection with the microphone assembly 10 through the receiving antenna 21, the cradle head 20 and the microphone assembly 10 can adopt 5.2G wireless connection for wireless communication, and the working frequency range of the receiving antenna 21 is 5150-5350 MHz. It can be understood that the wireless connection of 5.2G has the advantages of small interference, high frequency, etc., and the volume of the receiving antenna 21 can be set small.
In other embodiments, when the cradle head 20 is connected to the microphone assembly 10 through the receiving antenna 21 in a wireless communication manner, the cradle head 20 and the microphone assembly 10 may also be connected in a wireless communication manner by using a 5.8G wireless connection, and the operating frequency range of the receiving antenna 21 is 5250-5825 MHz.
Referring to fig. 1 to 3, a pan/tilt head system 100 according to an embodiment of the present invention includes a microphone assembly 10 according to any one of the above embodiments and a pan/tilt head 20 according to any one of the above embodiments. The microphone assembly 10 is in communication with a pan/tilt head 20.
According to the microphone assembly 10, the body sensing controller 12 is integrated on the microphone 11, the audio data and the attitude data are sent to the cloud deck 20 together, chips and antennas required for the body sensing controller 12 to send the attitude data to the cloud deck 20 independently are saved, and therefore user experience is improved and cost is saved.
The cradle head 20 of the embodiment of the invention receives the audio data and the attitude data through the receiving antenna 21, and controls the attitude of the cradle head 20 through the microcontroller 22 according to the attitude data of the microphone 11, thereby saving the antenna required by the cradle head 20 for independently receiving the attitude data of the microphone 11.
In some embodiments, pan-tilt system 100 further includes an imaging device 30 mounted on pan-tilt 20.
Specifically, the pan/tilt head 20 is used to stabilize the imaging device 30. The imaging device 30 is used for video recording, and the imaging device 30 may be a camera, a mobile phone, a tablet computer, etc. The microcontroller 22 is also used to record the audio data acquired by the microphone 11 into the video captured by the imaging device 30.
In some embodiments, the microphone assembly 10 and the pan/tilt head 20 are connected for wireless communication via a proprietary protocol.
Specifically, in one embodiment, microphone assembly 10 and pan/tilt head 20 are connected for wireless communication via a 5.2G wireless proprietary protocol.
It will be appreciated that a proprietary protocol is a standard developed and adopted internally by vendors, which other vendors generally do not have access to unless authorized. The microphone assembly 10 and the holder 20 are in wireless connection communication through a private protocol, and the microphone assembly is safe, reliable and high in communication speed.
In the description herein, references to the description of the terms "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example" or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
Any process or method descriptions in flow charts or otherwise described herein may be understood as representing modules, segments, or portions of code which include one or more executable instructions for implementing specific logical functions or steps of the process, and alternate implementations are included within the scope of the preferred embodiment of the present invention in which functions may be executed out of order from that shown or discussed, including substantially concurrently or in reverse order, depending on the functionality involved, as would be understood by those reasonably skilled in the art of the present invention.
The logic and/or steps represented in the flowcharts or otherwise described herein, such as an ordered listing of executable instructions that can be considered to implement logical functions, can be embodied in any computer-readable medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processing module-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. For the purposes of this description, a "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of the computer-readable medium would include the following: an electrical connection (IPM overcurrent protection circuit) having one or more wires, a portable computer diskette (magnetic device), a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disc read-only memory (CDROM). Additionally, the computer-readable medium could even be paper or another suitable medium upon which the program is printed, as the program can be electronically captured, via for instance optical scanning of the paper or other medium, then compiled, interpreted or otherwise processed in a suitable manner if necessary, and then stored in a computer memory.
It should be understood that portions of embodiments of the present invention may be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, the various steps or methods may be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one or combination of the following techniques, which are known in the art, may be used: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application specific integrated circuit having an appropriate combinational logic gate circuit, a Programmable Gate Array (PGA), a Field Programmable Gate Array (FPGA), or the like.
It will be understood by those skilled in the art that all or part of the steps carried by the method for implementing the above embodiments may be implemented by hardware related to instructions of a program, which may be stored in a computer readable storage medium, and when the program is executed, the program includes one or a combination of the steps of the method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing module, or each unit may exist alone physically, or two or more units are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium.
The storage medium mentioned above may be a read-only memory, a magnetic or optical disk, etc.
Although embodiments of the present invention have been shown and described above, it is understood that the above embodiments are exemplary and not to be construed as limiting the present invention, and that variations, modifications, substitutions and alterations can be made in the above embodiments by those of ordinary skill in the art within the scope of the present invention.

Claims (29)

1. A microphone assembly for a pan-tilt-head system, the pan-tilt-head system comprising a pan-tilt-head, the microphone assembly in communication with the pan-tilt-head, the microphone assembly comprising:
a microphone for acquiring audio data;
the body sensing controller is arranged on the microphone and is used for acquiring the motion parameters of the microphone;
the main control unit is arranged on the microphone and used for acquiring the audio data, calculating to obtain gesture data of the microphone according to the motion parameters and integrating the audio data and the gesture data to obtain integrated data; and
the transmitting antenna is used for sending the integrated data of the audio data and the attitude data to the holder so that the holder controls the attitude of the holder according to the attitude data and fuses the audio data and the image acquired by the imaging device carried on the holder;
wherein the gesture data of the microphone is changeable based on the emission object of the audio data.
2. The microphone assembly of claim 1, wherein the master control unit comprises a micro control unit and a microphone chip, the microphone chip being configured to acquire the audio data, the micro control unit being configured to calculate the gesture data from the motion parameters.
3. The microphone assembly of claim 2, wherein the microphone is a microphone that outputs digital audio data, and wherein the microphone chip is further configured to directly capture the digital audio data.
4. The microphone assembly of claim 2, wherein the microphone is a microphone that outputs analog audio data, the microphone assembly further comprising a codec coupled to both the microphone and the microphone chip, the codec configured to convert the analog audio data into digital audio data and output the digital audio data to the microphone chip.
5. The microphone assembly of claim 1, wherein the somatosensory controller is integrated inside the microphone; or
The somatosensory controller is integrated external to the microphone.
6. The microphone assembly of claim 1, wherein the somatosensory controller comprises:
a gyroscope; or
A gyroscope and accelerometer; or
A gyroscope and a magnetic sensor; or
Gyroscopes, accelerometers and magnetic sensors.
7. The microphone assembly of claim 1, wherein the attitude data comprises at least one of yaw angle, roll angle, pitch angle, yaw rate, roll rate, pitch rate.
8. The microphone assembly of claim 2 wherein the microphone chip is further configured to encode the audio data and the gesture data.
9. The microphone assembly of claim 1, wherein the microphone assembly is in wireless or bluetooth communication with the holder via the transmitting antenna.
10. A cloud platform for cloud platform system, cloud platform system includes the microphone subassembly, the microphone subassembly with cloud platform communication, the microphone subassembly includes the microphone, its characterized in that, the cloud platform includes:
the receiving antenna is used for receiving the audio data acquired by the microphone and the integrated data of the attitude data of the microphone, which are sent by the microphone component; and
the microcontroller is connected with the receiving antenna and used for controlling the attitude of the holder according to the attitude data and fusing the audio data with an image acquired by an imaging device carried on the holder;
wherein the gesture data of the microphone is changeable based on the emission object of the audio data.
11. A head according to claim 10, wherein said microcontroller is adapted to control said head movement in accordance with said attitude data so as to cause the attitude of said head to follow the attitude of said microphone.
12. A head according to claim 11, wherein said attitude data comprises at least one of yaw angle, roll angle, pitch angle, yaw rate, roll rate, pitch rate.
13. The holder according to claim 10, wherein the audio data and the attitude data are encoded data, the holder further comprises a holder chip, the holder chip is configured to decode the encoded audio data and the attitude data, and the microcontroller is configured to generate a control command according to the attitude data and control the holder to perform an operation corresponding to the control command according to the control command.
14. A head according to claim 10, wherein said head is connected in wireless or bluetooth communication with said microphone assembly through said receiving antenna.
15. A pan-tilt system, comprising: a microphone assembly and a pan/tilt head, the microphone assembly in communication with the pan/tilt head,
the microphone assembly includes:
a microphone for acquiring audio data;
the body sensing controller is arranged on the microphone and is used for acquiring the motion parameters of the microphone;
the main control unit is arranged on the microphone and used for acquiring the audio data, calculating attitude data of the microphone according to the motion parameters, and integrating the audio data and the attitude data to obtain integrated data;
the transmitting antenna is used for transmitting the integrated data of the audio data and the attitude data to the holder;
the cloud platform includes:
the receiving antenna is used for receiving the audio data acquired by the microphone and the integrated data after the attitude data of the microphone are integrated, wherein the audio data are sent by the microphone component;
the microcontroller is connected with the receiving antenna and used for controlling the attitude of the holder according to the attitude data and fusing the audio data with an image acquired by an imaging device carried on the holder;
wherein the gesture data of the microphone is changeable based on the emission object of the audio data.
16. The pan-tilt head system according to claim 15, wherein the main control unit comprises a micro-control unit and a microphone chip, the microphone chip is configured to acquire the audio data, and the micro-control unit is configured to calculate the pose data according to the motion parameters.
17. A pan-tilt head system according to claim 16, wherein the microphone is a microphone for outputting digital audio data, and the microphone chip is further configured to directly capture the digital audio data.
18. The pan-tilt head system according to claim 16, wherein the microphone is a microphone outputting analog audio data, the microphone assembly further comprises a codec connected to the microphone and the microphone chip, the codec being configured to convert the analog audio data into digital audio data and output the digital audio data to the microphone chip.
19. The pan-tilt head system according to claim 15, wherein the somatosensory controller is integrated inside the microphone; or
The somatosensory controller is integrated external to the microphone.
20. A pan and tilt head system according to claim 15, wherein the somatosensory controller comprises:
a gyroscope; or
A gyroscope and accelerometer; or
A gyroscope and a magnetic sensor; or
Gyroscopes, accelerometers and magnetic sensors.
21. The pan-tilt head system of claim 15, wherein the attitude data comprises at least one of yaw angle, roll angle, pitch angle, yaw rate, roll rate, pitch rate.
22. The pan-tilt head system of claim 16, wherein the microphone chip is further configured to encode the audio data and the pose data.
23. The pan-tilt head system according to claim 15, wherein the microphone assembly is in wireless or bluetooth communication with the pan-tilt head via the transmitting antenna.
24. The pan-tilt system of claim 15, wherein the microcontroller is configured to control the pan-tilt motion according to the attitude data to cause the attitude of the pan-tilt to follow the attitude of the microphone.
25. The pan-tilt head system of claim 24, wherein the attitude data comprises at least one of yaw angle, roll angle, pitch angle, yaw rate, roll rate, pitch rate.
26. The pan-tilt head system according to claim 15, wherein the audio data and the attitude data are encoded data, the pan-tilt head further comprises a pan-tilt head chip, the pan-tilt head chip is configured to decode the encoded audio data and the encoded attitude data, and the microcontroller is configured to generate a control command according to the attitude data and control the pan-tilt head to perform an operation corresponding to the control command according to the control command.
27. The pan-tilt head system according to claim 15, wherein the pan-tilt head is in wireless or bluetooth communication connection with the microphone assembly via the receiving antenna.
28. A head system according to any one of claims 15 to 27, further comprising an imaging device mounted on said head.
29. A pan and tilt head system according to any of claims 15-27, wherein the microphone assembly is connected in wireless communication with the pan and tilt head via a proprietary protocol.
CN201780085911.0A 2017-07-31 2017-09-21 Microphone subassembly, cloud platform and cloud platform system Expired - Fee Related CN110268721B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN2017209467704 2017-07-31
CN201720946770.4U CN207340106U (en) 2017-07-31 2017-07-31 Microphone assembly, holder and clouds terrace system
PCT/CN2017/102812 WO2019024201A1 (en) 2017-07-31 2017-09-21 Microphone assembly, pan-tilt and pan-tilt system

Publications (2)

Publication Number Publication Date
CN110268721A CN110268721A (en) 2019-09-20
CN110268721B true CN110268721B (en) 2021-02-09

Family

ID=62377680

Family Applications (2)

Application Number Title Priority Date Filing Date
CN201720946770.4U Expired - Fee Related CN207340106U (en) 2017-07-31 2017-07-31 Microphone assembly, holder and clouds terrace system
CN201780085911.0A Expired - Fee Related CN110268721B (en) 2017-07-31 2017-09-21 Microphone subassembly, cloud platform and cloud platform system

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN201720946770.4U Expired - Fee Related CN207340106U (en) 2017-07-31 2017-07-31 Microphone assembly, holder and clouds terrace system

Country Status (2)

Country Link
CN (2) CN207340106U (en)
WO (1) WO2019024201A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108829254A (en) * 2018-06-21 2018-11-16 广东小天才科技有限公司 A kind of implementation method, system and relevant device that microphone is interacted with user terminal
CN110771158A (en) 2018-07-02 2020-02-07 深圳市大疆创新科技有限公司 Control method of photographing apparatus, photographing system, and storage medium
CN110159905A (en) * 2019-06-25 2019-08-23 深圳市长丰影像器材有限公司 A kind of foldable hand-held stabilizer of built-in microphone

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201167402Y (en) * 2008-03-17 2008-12-17 夏旺军 Microphone with remote-control function
JP2012210703A (en) * 2012-05-02 2012-11-01 Kazuo Hanno Multifunctional input fully automatic robot
CN105227898A (en) * 2014-06-23 2016-01-06 江南大学 A kind of helmet-type wireless remote monitering method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10808882B2 (en) * 2010-05-26 2020-10-20 Intouch Technologies, Inc. Tele-robotic system with a robot face placed on a chair
CN103426282A (en) * 2013-07-31 2013-12-04 深圳市大疆创新科技有限公司 Remote control method and terminal
CN104580986A (en) * 2015-02-15 2015-04-29 王生安 Video communication system combining virtual reality glasses
CN206237414U (en) * 2016-10-21 2017-06-09 成都时代星光科技有限公司 Voice transmission device, pronunciation receiver and unmanned plane voice broadcast service system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201167402Y (en) * 2008-03-17 2008-12-17 夏旺军 Microphone with remote-control function
JP2012210703A (en) * 2012-05-02 2012-11-01 Kazuo Hanno Multifunctional input fully automatic robot
CN105227898A (en) * 2014-06-23 2016-01-06 江南大学 A kind of helmet-type wireless remote monitering method

Also Published As

Publication number Publication date
CN207340106U (en) 2018-05-08
CN110268721A (en) 2019-09-20
WO2019024201A1 (en) 2019-02-07

Similar Documents

Publication Publication Date Title
US11480291B2 (en) Camera system using stabilizing gimbal
US11665422B2 (en) Method and system for user feedback in a motion constrained image stabilization system
CN110268721B (en) Microphone subassembly, cloud platform and cloud platform system
CN108184061B (en) Tracking control method and device for handheld cloud deck, handheld cloud deck and storage medium
WO2018102559A2 (en) Vision-based navigation system
US11618586B2 (en) Detection and signaling of conditions of an unmanned aerial vehicle
JP7095697B2 (en) Generation device and generation method, as well as playback device and playback method
US11405235B2 (en) Modular vehicle sensing, assisting connected system
CN112672133A (en) Three-dimensional imaging method and device based on unmanned aerial vehicle and computer readable storage medium
JP2006139525A (en) Autonomous mobile robot
KR101452372B1 (en) Method and System for Controlling Camera
JP6563694B2 (en) Image processing apparatus, image processing system, image composition apparatus, image processing method, and program
CN111684784B (en) Image processing method and device
CN111917904B (en) Control method and electronic device
CN111212785B (en) Improved multi-rotor aircraft and interface device
JP2022157413A (en) Image transmission device, image generation device, image transmission method, image transmission program, and storage medium
KR20220156335A (en) Electronic device and method for processing image based on depth information using the same
JP2020145612A (en) Image processing apparatus, image processing system, image processing method, and program
JP2014160935A (en) Video recording apparatus and movable body

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20210209

CF01 Termination of patent right due to non-payment of annual fee