CN118233848A - Intelligent broadcasting control method and system based on wireless self-organizing network - Google Patents

Abstract

The invention provides a control method and a system of intelligent broadcasting based on a wireless self-organizing network, comprising S1, a central control host autonomously discovers and acquires information of wireless recording and broadcasting intelligent terminal equipment at each position; s2, the central control host automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal devices and a preset position structure model; s3, each intelligent terminal device acquires a user sound signal in real time through a microphone array, and processes the sound signal to acquire processed audio; s4, keyword recognition is carried out on the processed audio; s5, triggering when a plurality of intelligent terminal devices recognize specific keywords, and analyzing and processing the audio characteristics by a microphone array and a keyword recognition engine to obtain the intelligent terminal device with the nearest acquired audio; s6, the central control host computer makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword class; the invention improves the flexibility of system deployment and expansion.

Description

Intelligent broadcasting control method and system based on wireless self-organizing network

Technical Field

The invention relates to the technical field of communication, in particular to a control method and a system of intelligent broadcasting based on a wireless self-organizing network.

Background

Broadcasting is a way to spread a single sound or signal to a wide audience, and conventional broadcasting systems are mainly based on complex wired architecture, mainly implemented by means of wired technology, and all speakers are uniformly managed by one central control system. Although such systems are capable of providing basic broadcast services, such as playing prerecorded audio and issuing notifications, they are relatively weak in terms of installation, maintenance, and expansion, and lack intelligent processing capability to quickly respond to emergency situations; especially in the application of key places such as schools, hospitals and enterprises. With the rapid development of artificial intelligence and wireless communication technologies, especially microphone array, speech recognition and synthesis, wiFi, etc., there is an urgent need for technical upgrades to existing broadcast systems.

Disclosure of Invention

Aiming at the defects existing in the prior art, the invention aims to provide a control method and a control system for intelligent broadcasting based on a wireless self-organizing network, which can solve the problems that the existing broadcasting has weaker capability in installation, maintenance and expansion and lacks intelligent processing capability for quick response to emergency.

In order to achieve the above purpose, the technical scheme of the invention is as follows:

the invention is realized by the following technical scheme: the invention provides a control method of intelligent broadcasting based on wireless self-organizing network, comprising the following steps

S1, configuring each wireless recording intelligent terminal device at a preset position, and enabling a central control host to autonomously find and acquire information of the wireless recording intelligent terminal devices at each position;

s2, the central control host automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal devices and a preset position structure model;

s3, each intelligent terminal device acquires a user sound signal in real time through a microphone array, and processes the sound signal to acquire processed audio;

S4, keyword recognition is carried out on the processed audio;

s5, triggering the intelligent terminal equipment when the intelligent terminal equipment identifies specific keywords, and analyzing and processing the audio characteristics by the microphone array and the keyword identification engine to obtain the intelligent terminal equipment with the nearest acquired audio;

s6, the central control host computer makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword class.

Further, the microphone array and the keyword recognition engine analyze and process the audio characteristics to obtain the intelligent terminal device with the nearest acquired audio, which comprises the following steps: and determining the nearest intelligent terminal equipment for obtaining the audio according to the time from the keyword audio to each intelligent terminal equipment and the audio energy value data.

Further, the central control host makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword category, and the method comprises the following steps:

when the keyword category is a dialogue type, the central control host machine performs communication with the user according to the intelligent terminal equipment with the latest acquired audio;

When the keyword category is a warning type, the central control host constructs an emergency broadcasting text according to the position information of the intelligent terminal equipment with the latest acquired audio and the keyword information to carry out emergency broadcasting of all or part of intelligent terminal equipment.

Further, the central control host constructs an emergency broadcast text according to the position information and the keyword information of the intelligent terminal equipment with the latest acquired audio to perform emergency broadcast of all or part of the intelligent terminal equipment, and the method comprises the following steps of

The central control host computer automatically constructs an emergency broadcast text according to a preset model by combining the alarm type of the triggered keyword and acquiring the position information of the intelligent terminal equipment with the nearest audio;

And the central control host selects a speaker with proper attribute according to the warning type, synthesizes voice of the emergency broadcast text, and performs emergency broadcast through local or all intelligent terminal equipment after receiving the synthesized audio.

Further, the central control host autonomously discovers and acquires information of the wireless recording and broadcasting intelligent terminal at each position, including:

Configuring wireless recording and broadcasting intelligent terminal equipment at each preset position, and accessing a wireless network to complete mutual self-discovery with a central control host through an mDNS protocol;

and the central control host acquires the position information and the configuration information of the intelligent terminal equipment when finding that the intelligent terminal equipment is added.

Further, the location information includes floor information, azimuth information, and room number information.

Further, the processing of the sound signal includes a beam forming process and a noise reduction process.

Further, the self-checking method further comprises self-checking of the intelligent terminal equipment, and the self-checking flow of the intelligent terminal equipment comprises the following steps:

Starting the broadcasting function of the intelligent terminal equipment to enable the intelligent terminal equipment to broadcast the audio with specific characteristics at a certain volume;

Starting the recording function of the intelligent terminal equipment while broadcasting, and recording the played audio;

Extracting characteristics of the content of the record;

judging whether the extracted recording characteristics are the same as the specific characteristics of the played audio;

if the intelligent terminal equipment is the same, the intelligent terminal equipment is normal;

If the characteristics are different, the characteristics are not matched, and the intelligent terminal equipment is abnormal;

and synchronizing the self-checking result to the central control host, and collecting self-checking information by the central control host to generate a self-checking report.

The invention also provides a control system of intelligent broadcasting based on the wireless self-organizing network, which comprises:

The system comprises a plurality of wireless recording and broadcasting intelligent terminal devices, a microphone array and a wireless recording and broadcasting intelligent terminal device, wherein the wireless recording and broadcasting intelligent terminal devices are used for acquiring user sound signals in real time through the microphone array and processing the sound signals to acquire processed audio; the wireless recording and broadcasting intelligent terminal equipment is also used for carrying out keyword recognition on the processed audio; triggering the intelligent terminal equipment according to the fact that a plurality of intelligent terminal equipment recognize specific keywords, and analyzing and processing audio features by a microphone array and a keyword recognition engine to obtain intelligent terminal equipment with the nearest acquired audio;

The central control host is in wireless connection with the wireless broadcasting intelligent terminal equipment, and automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal equipment and a preset position structure model; the central control host is also used for making decisions and actions according to the intelligent terminal equipment with the nearest acquired audio and the keyword class.

The invention also provides a computer readable storage medium having stored thereon a computer program having stored thereon instructions which, when executed by one or more processors, cause the one or more processors to perform the method of any of the preceding claims.

Compared with the prior art, the invention has the beneficial effects that:

the control method and the system based on the intelligent broadcasting of the wireless self-organizing network adopt the wireless network to replace the wired connection, namely adopt WiFi, realize automatic network construction and equipment discovery, simplify the installation flow, and improve the flexibility of system deployment and expansion;

The intelligent terminal equipment integrates the multi-microphone array, supports active noise reduction, echo cancellation, keyword recognition and sound source positioning, and realizes intelligent interaction and quick response;

according to the invention, the emergency broadcasting, such as evacuation indication in a fire disaster, is automatically started by utilizing keyword triggering and position information, clear instruction voice is synthesized by a text-to-voice technology, and the emergency information is ensured to be transmitted in time;

The invention also has the self-checking function to ensure the continuous operation of the equipment, automatically monitors and reports the states of the loudspeaker and the microphone, optimizes maintenance work and reduces long-term operation cost.

Drawings

The disclosure of the present invention is described with reference to the accompanying drawings. It is to be understood that the drawings are designed solely for the purposes of illustration and not as a definition of the limits of the invention. Wherein:

fig. 1 is a schematic flow chart of a control method of intelligent broadcasting based on a wireless ad hoc network in an embodiment of the present invention;

Fig. 2 is a GUI display diagram of a central control host discovering a wireless recording and broadcasting intelligent terminal device and automatically constructing a position map in the embodiment of the present invention;

FIG. 3 is a diagram illustrating an example of a dialogue being initiated based on a plurality of intelligent terminal devices detecting keywords and the intelligent terminal device that has acquired the nearest audio in an embodiment of the present invention;

FIG. 4 is a diagram illustrating an example of emergency broadcasting according to a plurality of intelligent terminal devices detecting keywords and obtaining the nearest intelligent terminal device of audio and the type of the keywords in the embodiment of the present invention;

Fig. 5 is a flow chart of a self-checking process of the intelligent terminal device in the embodiment of the invention.

Detailed Description

In order to make the technical solutions in the present specification better understood by those skilled in the art, the technical solutions in the embodiments herein will be clearly and completely described below with reference to the drawings in the embodiments herein, and it is apparent that the described embodiments are only some embodiments herein, but not all embodiments. All other embodiments, based on the embodiments herein, which a person of ordinary skill in the art would obtain without undue burden, are within the scope of protection herein.

It should be noted that the terms "first," "second," and the like in the description and claims herein and in the foregoing figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments described herein may be capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.

The present specification provides method operational steps as described in the examples or flowcharts, but may include more or fewer operational steps based on conventional or non-inventive labor. The order of steps recited in the embodiments is merely one way of performing the order of steps and does not represent a unique order of execution. When a system or apparatus product in practice is executed, it may be executed sequentially or in parallel according to the method shown in the embodiments or the drawings.

The technical scheme of the invention is as follows: the invention provides a control method of intelligent broadcasting based on a wireless self-organizing network; as shown in fig. 1, the method comprises the steps of:

S1, configuring each wireless recording intelligent terminal device at a preset position, and enabling a central control host to autonomously find and acquire information of the wireless recording intelligent terminal devices at each position;

s2, the central control host automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal devices and a preset position structure model;

Specifically, the central control host in S1 and S2 discovers a wireless recording and broadcasting intelligent terminal device, and automatically constructs a position map to perform GUI display, as shown in fig. 2, where the wireless recording and broadcasting intelligent terminal device is provided with a plurality of wireless recording and broadcasting intelligent terminal devices (devices in fig. 2 replace the wireless recording and broadcasting intelligent terminal devices), and exemplary wireless recording and broadcasting intelligent terminal devices are configured at different positions of each floor in a region, including devices 1,2, 3, 4, and the like; wherein, the device 1 is positioned on the east side of the building 1, the device 2 is positioned on the west side of the building 1, the device 3 is positioned on the west side of the building 2, the device 4 is positioned on the east side of the building 3, etc.; after the configuration of each wireless recording and broadcasting intelligent terminal equipment is finished, accessing a wireless network, and mutually and automatically discovering a central control host and each wireless recording and broadcasting intelligent terminal equipment through an mDNS protocol (Multicast DNS protocol); the central control host automatically acquires the position of the device when the central control host discovers and perceives that the wireless recording and broadcasting intelligent terminal device is added, wherein the position comprises floor information, azimuth information, room number information and the like; after acquiring the information of all the wireless recording and broadcasting intelligent terminal equipment, the central control host can automatically construct a position map according to the position information of the whole intelligent terminal equipment and a preset position structure model and automatically display an equipment position GUI (graphical user interface).

The mDNS protocol is used in combination with GUI (graphical user interface) presentation, so that a user can intuitively find and manage intelligent terminal equipment in a local network; through GUI display, the mDNS simplifies the management and searching processes of the intelligent terminal equipment, and provides visual and easy-to-use interaction experience for users.

S3, each intelligent terminal device acquires a user sound signal in real time through a microphone array, and processes the sound signal to acquire processed audio; the processing of the sound signal comprises beam forming processing and noise reduction processing;

Wherein the beamforming process synthesizes a survey signal by collecting and concentrating a plurality of sound pressure signals (from a microphone array) of sound waves in a specific direction and then by mathematical operation; this may enable directivity to be directed to a specific sound source or enhance a signal from a desired direction while reducing noise in other directions. The beam forming process comprises the following steps:

array processing: an array of microphones is created, each microphone capturing sound signals from a different angle.

And (3) signal synthesis: the signal of each microphone is synchronized and analyzed, typically by time delay and amplitude adjustment to cancel out the potential difference.

Weight distribution: the weighting coefficient of each channel is calculated based on the position and directivity information of each microphone to maximize concentration in the target direction.

And (3) filtering: the signal is further enhanced or noise reduced by digital signal processing techniques such as digital filters.

Through the beamforming process, the sound signal may be optimized to improve speech intelligibility, precisely point to, or enhance the audio effect of a particular region.

Noise reduction processing of sound is used to reduce noise, background noise, or unnecessary high frequency components in recorded or captured sound so as to clearly emphasize a speech signal; principle of noise reduction processing of sound:

Frequency domain noise reduction: the sound signal is converted from the time domain to the frequency domain using frequency domain analysis techniques (e.g., fast fourier transform, FFT) and then noise is removed with a suitable algorithm by comparing the difference between the noise power spectrum and the speech power spectrum.

Time domain noise reduction: noise is processed in the time domain, such as window function processing, moving average filtering, or over-sampling techniques based on timing statistics.

And (5) carrying out statistics and noise reduction: based on a model of noise statistics (e.g., mean, variance), noise is removed by averaging or kalman filtering, assuming that the noise is independent and co-distributed.

The noise reduction processing method of the sound comprises the following steps:

spectral subtraction (Spectral Subtraction): in the frequency domain, the spectrum of the noise is directly subtracted from the spectrum of the speech signal.

Wiener filtering: a noise reduction method based on Wiener-Khinchin theorem uses the statistical characteristics of signals to calculate the optimal filter coefficients.

Neural network noise reduction: and predicting the input signal by using a deep learning technology and training a noise suppression model, wherein the output is a noise-reduced signal.

Noise algorithms such as Wiener filter (Wiener deconvolution), filter banks, spectral estimation and re-comparison method (Wiener-Hopf method), and the like.

By different noise reduction techniques, the sound signal may be optimized for easier understanding and receiving of information therein by the user.

S4, keyword recognition is carried out on the processed audio; i.e. identify the keywords inside the acquired piece of audio.

S5, triggering the intelligent terminal equipment when the intelligent terminal equipment identifies specific keywords, and analyzing and processing the audio characteristics by the microphone array and the keyword identification engine to obtain the intelligent terminal equipment with the nearest acquired audio;

The intelligent terminal device with the nearest audio acquisition is obtained by analyzing and processing the audio characteristics by the microphone array and the keyword recognition engine, and comprises

And the central control host determines the nearest intelligent terminal equipment for obtaining the audio according to the time from the keyword audio to each intelligent terminal equipment and the audio energy value data.

S6, the central control host computer makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword class; the central control host computer makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword class, and the method comprises the following steps:

when the keyword category is a dialogue type, the central control host machine performs communication with the user according to the intelligent terminal equipment with the latest acquired audio;

When the keyword category is a warning type, the central control host constructs an emergency broadcasting text according to the acquired position information of the intelligent terminal equipment with the latest audio and the keyword information to carry out emergency broadcasting of all or part of intelligent terminal equipment; the central control host constructs an emergency broadcasting text according to the position information and the keyword information of the intelligent terminal equipment with the latest acquired audio to carry out the emergency broadcasting of all or partial intelligent terminal equipment, and the method comprises the following steps of

The central control host computer automatically constructs an emergency broadcast text according to a preset model by combining the alarm type of the triggered keyword and acquiring the position information of the intelligent terminal equipment with the nearest audio;

And the central control host selects a speaker with proper attribute according to the warning type (local warning or all area warning), synthesizes voice of the emergency broadcast text, and performs emergency broadcast through local or all intelligent terminal equipment after receiving synthesized audio.

The invention discloses a control method of intelligent broadcasting based on a wireless self-organizing network, which also comprises self-checking of intelligent terminal equipment, wherein the self-checking method comprises the following steps:

Starting the broadcasting function of the intelligent terminal equipment to enable the intelligent terminal equipment to broadcast the audio with specific characteristics at a certain volume;

Starting the recording function of the intelligent terminal equipment while broadcasting, and recording the played audio;

Extracting characteristics of the content of the record;

judging whether the extracted recording characteristics are the same as the specific characteristics of the played audio;

if the intelligent terminal equipment is the same, the intelligent terminal equipment is normal;

If the characteristics are different, the characteristics are not matched, and the intelligent terminal equipment is abnormal;

and synchronizing the self-checking result to the central control host, and collecting self-checking information by the central control host to generate a self-checking report.

In the first embodiment, the example that a plurality of intelligent terminal devices detect keywords, according to the intelligent terminal device with the nearest acquired audio, and start a conversation is shown in fig. 3, each intelligent terminal device collects a sound signal sent by a user in real time through a microphone array, the intelligent terminal device performs beam forming and noise reduction processing on the acquired sound signal, performs keyword recognition by using the noise reduced audio, analyzes and processes audio features to obtain data when the plurality of intelligent terminal devices detect that a specific keyword is triggered, and uploads the data to a central control host to make a decision, and the central control host determines the intelligent terminal device with the nearest distance to the user according to the time estimation of the arrival of the audio of the keyword at the device and the audio energy value, determines that only the conversation with the user in a trigger command word area is needed according to the detected keyword category, and actively starts the intelligent terminal device with the nearest distance to the user to make a conversation with the user. When a user sends out "rescue me", the device 1, the device 2 and the device 3 can acquire the sound signal, acquire the keyword "rescue me" after the signal is processed, the central control host receives the specific keyword "rescue me", a trigger command, the nearest intelligent terminal device is determined to be the device 3 according to the time when the audio arrives at the device and the audio energy value, and then the central control host starts a call mode, and the main control room communicates with the user through the device 3.

In the second embodiment, the case that a plurality of intelligent terminal devices detect keywords, and according to the intelligent terminal device with the latest acquired audio and the type of the keywords, emergency broadcasting is performed is shown, and the process is shown in fig. 4, each intelligent terminal device acquires sound signals sent by a user in real time through a microphone array, the intelligent terminal device performs beam forming and noise reduction processing on the acquired sound signals, keyword recognition is performed by using the noise reduced audio, when the plurality of intelligent terminal devices detect that a specific keyword is triggered, the microphone array and a keyword recognition engine perform analysis processing on the audio characteristics to obtain data and upload the data to a central control host for decision, and the central control host estimates the time of arrival of the audio at the device, the audio energy value and determines the latest intelligent terminal device of the user according to the type of the triggered keywords, wherein the warning type comprises global warning or local warning; and combining the position of the triggering warning area, automatically constructing an emergency broadcast text by the central control host according to a preset model, selecting a speaker with proper attribute by the host according to the warning type, performing voice synthesis on the emergency broadcast text, and performing emergency broadcast by the central control host through all intelligent recording and broadcasting intelligent terminals after receiving synthesized audio. When a user sends out fire, the devices 1,2 and 3 on three floors acquire the sound information, the key words are extracted after processing, the intelligent terminal device closest to the user is determined to be the device 3 according to the time when the key words reach the device and the audio energy value, the emergency broadcasting is determined to be the whole domain emergency broadcasting according to the position information of the device 3 and the key word information, emergency evacuation of an emergency broadcasting text is automatically constructed, the fire is carried out in a western region of a second floor, … is avoided, a speaker with proper attribute is selected, voice synthesis is carried out on the emergency broadcasting text, and the emergency broadcasting is carried out through all the intelligent terminal devices after the central control host receives the synthesized audio.

Fig. 5 is a schematic diagram of a self-checking process of the intelligent terminal device according to the embodiment of the invention, and when the terminal device needs to be overhauled, the intelligent terminal device needing to be overhauled is started by the central control host to carry out self-checking. After the intelligent terminal equipment receives the self-checking instruction, the recording and broadcasting are started simultaneously, the self-broadcasting and self-recording is started, the intelligent terminal equipment plays the audio with specific characteristics at a certain volume, and after the self-broadcasting and self-recording is finished, the self-checking algorithm performs characteristic extraction on the recorded audio. If the extracted features are consistent with the audio features, the equipment is normal, if the features are not matched, the speaker playing or microphone receiving is abnormal, the self-checking result is automatically synchronized to the host, and the host rapidly and automatically generates an equipment self-checking report according to the collected self-checking information, for example: "first floor east area 13 # terminal equipment abnormality …"

The invention also provides a control system of intelligent broadcasting based on the wireless self-organizing network, which comprises:

The system comprises a plurality of wireless recording and broadcasting intelligent terminal devices, a microphone array and a wireless recording and broadcasting intelligent terminal device, wherein the wireless recording and broadcasting intelligent terminal devices are used for acquiring user sound signals in real time through the microphone array and processing the sound signals to acquire processed audio; the wireless recording and broadcasting intelligent terminal equipment is used for carrying out keyword recognition on the processed audio; triggering the intelligent terminal equipment according to the fact that a plurality of intelligent terminal equipment recognize specific keywords, and analyzing and processing audio features by a microphone array and a keyword recognition engine to obtain intelligent terminal equipment with the nearest acquired audio;

The central control host is in wireless connection with the wireless broadcasting intelligent terminal equipment, and automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal equipment and a preset position structure model; the central control host is also used for making decisions and actions according to the intelligent terminal equipment with the nearest acquired audio and the keyword class.

The control method and the system based on the intelligent broadcasting of the wireless self-organizing network adopt the wireless network to replace the wired connection, namely adopt WiFi, realize automatic network construction and equipment discovery, simplify the installation flow, and improve the flexibility of system deployment and expansion;

The intelligent terminal equipment integrates the multi-microphone array, supports active noise reduction, echo cancellation, keyword recognition and sound source positioning, and realizes intelligent interaction and quick response;

according to the invention, the emergency broadcasting, such as evacuation indication in a fire disaster, is automatically started by utilizing keyword triggering and position information, clear instruction voice is synthesized by a text-to-voice technology, and the emergency information is ensured to be transmitted in time;

The invention also has the self-checking function to ensure the continuous operation of the equipment, automatically monitors and reports the states of the loudspeaker and the microphone, optimizes maintenance work and reduces long-term operation cost.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present disclosure.

It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.

In the several embodiments provided herein, it should be understood that the disclosed systems, devices, and methods may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. In addition, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices, or elements, or may be an electrical, mechanical, or other form of connection.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the elements may be selected according to actual needs to achieve the objectives of the embodiments herein.

In addition, each functional unit in the embodiments herein may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions herein are essentially or portions contributing to the prior art, or all or portions of the technical solutions may be embodied in the form of a software product stored in a storage medium, including several instructions to cause a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the embodiments herein. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, randomAccess Memory), a magnetic disk, an optical disk, or other various media capable of storing program codes.

Specific examples are set forth herein to illustrate the principles and embodiments herein and are merely illustrative of the methods herein and their core ideas; also, as will be apparent to those of ordinary skill in the art in light of the teachings herein, many variations are possible in the specific embodiments and in the scope of use, and nothing in this specification should be construed as a limitation on the invention.

Claims (10)

1. The control method of intelligent broadcasting based on the wireless self-organizing network is characterized in that: comprises the following steps

S1, configuring each wireless recording and broadcasting intelligent terminal device at a preset position, and enabling a central control host to autonomously find and acquire information of the intelligent terminal devices at each position;

s2, the central control host automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal devices and a preset position structure model;

s3, each intelligent terminal device acquires a user sound signal in real time through a microphone array, and processes the sound signal to acquire processed audio;

S4, keyword recognition is carried out on the processed audio;

s5, triggering the intelligent terminal equipment when the intelligent terminal equipment identifies specific keywords, and analyzing and processing the audio characteristics by the microphone array and the keyword identification engine to obtain the intelligent terminal equipment with the nearest acquired audio;

s6, the central control host computer makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword class.

2. The control method for intelligent broadcasting based on wireless self-organizing network according to claim 1, wherein: the microphone array and the keyword recognition engine analyze and process the audio characteristics to obtain the intelligent terminal equipment with the nearest acquired audio, and the intelligent terminal equipment comprises the following components: and determining the nearest intelligent terminal equipment for obtaining the audio according to the time from the keyword audio to each intelligent terminal equipment and the audio energy value data.

3. The control method for intelligent broadcasting based on wireless self-organizing network according to claim 1, wherein: the central control host computer makes decisions and actions according to the intelligent terminal equipment with the latest acquired audio and the keyword class, and the method comprises the following steps:

when the keyword category is a dialogue type, the central control host machine performs communication with the user according to the intelligent terminal equipment with the latest acquired audio;

When the keyword category is a warning type, the central control host constructs an emergency broadcasting text according to the position information of the intelligent terminal equipment with the latest acquired audio and the keyword information to carry out emergency broadcasting of all or part of intelligent terminal equipment.

4. A control method for intelligent broadcasting based on wireless self-organizing network according to claim 3, wherein: the central control host constructs an emergency broadcast text according to the position information and the keyword information of the intelligent terminal equipment with the latest acquired audio to carry out emergency broadcast of all or partial intelligent terminal equipment, and the method comprises the following steps of

The central control host computer automatically constructs an emergency broadcast text according to a preset model by combining the alarm type of the triggered keyword and acquiring the position information of the intelligent terminal equipment with the nearest audio;

And the central control host selects a speaker with proper attribute according to the warning type, synthesizes voice of the emergency broadcast text, and performs emergency broadcast through local or all intelligent terminal equipment after receiving the synthesized audio.

5. The control method for intelligent broadcasting based on wireless self-organizing network according to claim 1, wherein: the central control host autonomously discovers and acquires information of wireless recorded broadcast intelligent terminals at all positions, and the method comprises the following steps:

Configuring wireless recording and broadcasting intelligent terminal equipment at each preset position, and accessing a wireless network to complete mutual self-discovery with a central control host through an mDNS protocol;

and the central control host acquires the position information and the configuration information of the intelligent terminal equipment when finding that the intelligent terminal equipment is added.

6. The method for controlling intelligent broadcasting based on wireless ad hoc network according to claim 5, wherein: the location information includes floor information, azimuth information, and room number information.

7. The control method for intelligent broadcasting based on wireless self-organizing network according to claim 1, wherein: the processing of the sound signal includes a beam forming process and a noise reduction process.

8. The control method for intelligent broadcasting based on wireless self-organizing network according to claim 1, wherein: the self-checking method also comprises self-checking of the intelligent terminal equipment, wherein the self-checking flow of the intelligent terminal equipment comprises the following steps:

Starting the broadcasting function of the intelligent terminal equipment to enable the intelligent terminal equipment to broadcast the audio with specific characteristics at a certain volume;

Starting the recording function of the intelligent terminal equipment while broadcasting, and recording the played audio;

Extracting characteristics of the content of the record;

judging whether the extracted recording characteristics are the same as the specific characteristics of the played audio;

if the intelligent terminal equipment is the same, the intelligent terminal equipment is normal;

If the characteristics are different, the characteristics are not matched, and the intelligent terminal equipment is abnormal;

and synchronizing the self-checking result to the central control host, and collecting self-checking information by the central control host to generate a self-checking report.

9. The control system of intelligent broadcast based on wireless self-organizing network, its characterized in that: comprising the following steps:

The system comprises a plurality of wireless recording and broadcasting intelligent terminal devices, a microphone array and a wireless recording and broadcasting intelligent terminal device, wherein the wireless recording and broadcasting intelligent terminal devices are used for acquiring user sound signals in real time through the microphone array and processing the sound signals to acquire processed audio; the wireless recording and broadcasting intelligent terminal equipment is also used for carrying out keyword recognition on the processed audio; triggering the intelligent terminal equipment according to the fact that a plurality of intelligent terminal equipment recognize specific keywords, and analyzing and processing audio features by a microphone array and a keyword recognition engine to obtain intelligent terminal equipment with the nearest acquired audio;

The central control host is in wireless connection with the wireless broadcasting intelligent terminal equipment, and automatically builds a position map and displays a GUI according to the position information of all the intelligent terminal equipment and a preset position structure model; the central control host is also used for making decisions and actions according to the intelligent terminal equipment with the nearest acquired audio and the keyword class.

10. A computer readable storage medium having stored thereon a computer program, characterized in that the computer program has stored instructions which, when executed by one or more processors, cause the one or more processors to perform the method of any of claims 1 to 8.