CN110544532A - sound source space positioning ability detecting system based on APP - Google Patents

Abstract

The invention discloses an APP-based sound source space positioning capability detection system, which comprises an APP client, a server and a computer management terminal, wherein the APP client is in communication connection with the internet; the APP client comprises a spatial auditory sense detection and recovery training module, a test environment acoustic parameter acquisition module, a subject information input module, an operation training module and a data transmission module; the server is mainly used for sorting the received data and storing the selected positions and the real positions of the received subjects in a list form; the computer management terminal is used for managing the information of the testee, storing or processing the listening signals, downloading and analyzing the experimental data and correcting the experimental error. The system of the invention reduces the influence of interference factors on experimental results, improves the efficiency of sound source space positioning, and provides a scientific and efficient experimental platform for the research of sound source positioning audiology.

Description

Sound source space positioning ability detecting system based on APP

Technical Field

the invention relates to the technical field of electroacoustic, in particular to a sound source space positioning capability detection system based on APP.

background

Nowadays, more and more people are continuously decreasing hearing ability and even facing the danger of losing due to noise pollution, long-term wearing of electronic equipment and the aggravation of social aging. The localization cues of the hearing impaired population often deteriorate in ability (due to decreased hearing ability and due to the configuration of the hearing aid worn by the hearing impaired), which means a deterioration in the ability to determine from which direction a given sound comes. This brings great inconvenience and danger to their normal lives, such as vehicles coming and going to the side and behind where the vision cannot be perceived correctly on the road in time. Early detection and treatment of spatial disability is therefore necessary for patients suffering from hearing loss.

Currently, although the detection of spatial localization ability and the provision of treatment and recovery means have been studied for a long time, most of them are still in the laboratory stage. The existing spatial hearing and recovery training device mainly has the following defects:

1. Conventional hearing test devices are time consuming and labor intensive to operate, and expensive instruments are costly and not conducive to widespread use in some general hospitals.

2. hearing screening must use specific equipment and tools, must employ specialized personnel for operation, and requires the construction of a complex set of speaker arrays and associated control systems for spatial sound localization.

3. With the increasing aging of the population, the proportion of middle-aged and elderly people of patients with hearing loss is the largest, and the difficulty is higher for some patients with old age and inconvenient body.

Disclosure of Invention

aiming at the defects, the system for detecting the sound source space positioning capability based on the APP is provided.

the invention is realized by at least one of the following technical schemes.

A sound source space positioning capability detection system based on APP comprises an APP client, a server and a computer management terminal, wherein the APP client is in communication connection with the computer management terminal through the server; the APP client side comprises a space hearing detection module, a module for carrying out recovery training on the crowd with damaged space positioning capacity through virtual sound source positioning, acquisition of acoustic parameters of a test environment, recording of subject information, operation training, a detection module and data transmission;

Acquiring acoustic parameters of a test environment, and acquiring background noise of the test environment in real time and judging whether the test is suitable or not;

the method comprises the steps of inputting the information of a subject, wherein the information of the user comprises registration information of the user, wherein the registration information of the user comprises name, age, sex, hearing threshold value, telephone and hearing condition;

an operation training for familiarizing the subject with the operation of the APP client and with the virtual spatial sound source;

The detection module is used for detecting and training the spatial positioning capability of a subject and simulating different noise environments through background noise with different signal-to-noise ratios;

data transmission, mainly sending registration information and sound source position information to a server for storage;

the server is mainly used for sorting the received data, storing the received position selected by the subject and the real position of the virtual space sound source in a list form, and serving as a transfer station for data transmission between the APP client and the computer management terminal;

The computer management terminal is used for managing the information of the testee, replacing or deleting the listening signals, downloading and analyzing the experimental data and correcting the experimental error.

Further, the APP client also comprises an experiment announcement, wherein the experiment announcement comprises an experiment purpose, required time, an improper method adopted by a subject and an experiment place.

Further, the specific step of judging whether the experiment is appropriate is as follows: when the background noise is larger than a set value, the APP client reminds that the experiment is not suitable, and a quiet environment is recommended to be selected for testing; and when the background noise is not greater than the set value, judging that the experimental condition is met.

Further, the spatial auditory detection process of the APP client is as follows:

1) providing a training sound source to let the subject become familiar with the virtual sound in the space;

2) randomly playing a virtual sound at a certain position in the horizontal direction, wherein the virtual sound source is a detection sound source in a detection module; (ii) a

3) and the subject selects a sensing position on an APP client interface, and the APP client automatically records the selected position and the real position information of the virtual sound and sends the data to the server for storage.

Further, the server comprises a data receiving and storing module;

The data receiving module is used for receiving the registration information and the position information sent by the APP client;

and the storage module is used for storing the information of the testee and the experimental data and storing the received selected positions and the real positions of the testee in a list form.

further, the computer management terminal specifically comprises an information management module, an audio management module, a result collection module and a safety management module, wherein:

The information management is used for realizing the management of the information of the testee and the detection and the correction of the experiment;

The audio management is used for replacing or deleting the audio required by the APP client;

result summarization, which is used for counting the experimental data of each subject and is convenient for derivation and analysis;

And the safety management module is used for guaranteeing the safety of the data of the testee.

Further, the detection module includes four detection sound sources, which are pure tones, and pure tones including background noise with a signal-to-noise ratio of 0, 5, and 10, respectively.

Further, each detected sound source has 24 sound segments, each sound segment representing a virtual sound at a different azimuth.

Further, the sound propagation process of the APP client uses a linear time invariant system to perform signal processing, the HRTF is used as a transmission function of the linear time invariant system, filtering is performed through the transmission function, and the obtained binaural signal:

E0 is a frequency domain signal of a single path, EL and ER are a left ear signal and a right ear signal respectively, r represents the distance between a point sound source and a head center, namely the distance between a coordinate origin O, an azimuth angle theta is an included angle between the projection of a direction vector from the coordinate origin O to a sound source S on a horizontal plane and a y axis, and the value range of theta is more than or equal to 0 degree and less than or equal to 360 degrees. The elevation angle is the included angle between the sound source direction vector and the horizontal plane, the value range of the elevation angle is f to represent the sound source frequency, a represents the physiological structure parameters (including the parameters of the shape, the size and the like of the physiological structures such as the head, the trunk and the like), and a is different among different individuals.

the invention includes but is not limited to supporting virtual sound source localization under static virtual auditory playback and dynamic virtual auditory playback, and also supporting real sound source localization of loudspeaker playback, and the APP client can be used as a data acquisition platform.

The invention can be suitable for psychoacoustic behavioral testing of absolute sound source position (direction and distance) by selecting points on the screen of the smart phone, can also be used for discrimination experiment of relative distance judgment by a discrimination mode of two-next-to-one and the like, and can be widely suitable for psychoacoustic testing of similar experiments by capturing the direction and distance of the points selected by a subject on the screen.

The system mainly realizes the data acquisition of sound source space auditory localization at a far end, and provides a complete self-feedback experimental network for a listener (the experimental condition input, the signal selection, the listening localization behavioural experiment and the judgment of the localization result are all independently completed by a subject), thereby reducing the influence of other interference factors on the experimental result; on the other hand, the system can improve the efficiency of sound source space positioning, is suitable for the preliminary detection of sound source space auditory positioning of remote or large-scale subjects, and provides a scientific and efficient experimental platform for the research of sound source positioning audiology.

compared with the prior art, the invention has the following beneficial effects:

(1) the APP client is convenient to install, simple to operate, capable of integrating signals required by spatial hearing detection and recovery training into the portable smart phone, free of professional personnel and equipment, capable of screening a large number of people, free of time and place limitation, low in cost and convenient to popularize.

(2) The APP client is in communication connection with the server, real-time synchronization of position data can be achieved, data information of the selected position and the real position can be stored and fed back in real time, and a good feedback correction effect is achieved when recovery training is conducted.

(3) according to the management client provided by the invention, a user can retrieve the detection result of the user at any time and master the hearing level of the user. For scientific researchers, through the analysis of the whole database, the hearing conditions of all age groups can be mastered, and the reasons can be analyzed to give corresponding guidance opinions.

drawings

FIG. 1 is a schematic diagram of a spatial auditory detection system according to an embodiment;

FIG. 2 is an interface schematic diagram of APP client location selection in the present embodiment;

FIG. 3 is a schematic diagram of a system for detecting a sound source spatial localization capability based on APP in this embodiment;

fig. 4 is a schematic diagram of a virtual free-field sound image of the present embodiment;

FIG. 5 is a flow chart of spatial auditory detection in accordance with the present embodiment;

Wherein: 1-APP client, 2-server, 3-management client.

Detailed Description

the objects, technical solutions and advantages of the present invention will be further described with reference to the accompanying drawings. It should be understood that the embodiments described herein are not intended to be construed as merely illustrative of the present invention and not limitative of the scope thereof.

The invention can be used as an independent sound source positioning capability test system for collecting test data of a test subject without the limitation of time and place.

Fig. 1 and fig. 3 show an APP-based sound source spatial localization capability detection system, which includes an APP client 1 communicatively connected to the internet, a server 2 communicatively connected to the APP client 1, and a management client 3, i.e., a computer management terminal, communicatively connected to the server 2.

the APP client 1 comprises functions of spatial auditory detection, recovery training of people with impaired spatial positioning ability through virtual sound source positioning, acquisition of acoustic parameters of a test environment, subject information input, operation training, a detection module, experiment bulletin and sending experiment data to the server 2;

acquiring acoustic parameters of a test environment, and acquiring background noise of the test environment in real time and judging whether the test is suitable or not; reminding the test unsuitability when the background noise is more than 40dB, and recommending and judging whether the test is suitable or not; testing; when the background noise is not more than 40dB, it is judged that the experimental condition is satisfied, and the subsequent step may be performed.

the system comprises a subject information input device, a hearing management device and a hearing management system, wherein the subject information input device is used for filling out registration information of a user on line, and the user registration information comprises name, age, gender, hearing threshold value, telephone and hearing condition;

Operation training for familiarizing the subject with the operation of the APP client 1 and with the virtual spatial sound source;

the detection module is used for detecting and training the spatial positioning capability of a subject and simulating different noise environments through background noise with different signal-to-noise ratios;

Data transmission for transmitting the registration information, the sound source position selected by the subject and the sound source actual position to the server 2 for storage;

experimental announcements for informing experimental purposes. The experiment is based on the purpose of scientific research, the data and the required time for judging the horizontal plane sound source position of different people are collected, and the total time of the experiment is about 90 minutes. The experimental site is as follows: selecting a quieter environment such as a noiseless bedroom or office as far as possible, and stopping the experiment immediately when dizziness and nausea appear;

The spatial auditory detection process of the APP client 1 is as follows:

1) The APP client 1 provides a training sound source to enable a subject to be familiar with virtual sound in space;

2) Randomly playing a virtual sound at a certain position in the horizontal direction, wherein the virtual sound source is a detection sound source in a detection module;

3) the subject selects a sensing position on the interface of the APP client 1, and the APP client 1 automatically records the selected position and the real position information and sends the data to the server 2 for storage.

when the user uses the test board, the user firstly knows the basic information of the test through the test bulletin, so that the subject has a certain mind to prepare and select a proper place (such as a noiseless bedroom or an office) to improve the accuracy of the result. The collection of the acoustic parameters of the test environment can remind a subject whether the background noise of the test environment is suitable for the experiment (reminding the test is not suitable when the background noise is more than 40 dB), so that the reliability of the test result is ensured. Through the entry of the personal related information, a storage address of the user is formed in the server 2 for storing the data synchronously uploaded by the user. Training before the start of the official experiment is an operation method for helping the user to become familiar with software, sensing the direction of a virtual sound source played through headphones, and providing a familiar process before the start of the experiment. In the detection module, the test scheme with different signal-to-noise ratios can be selected by the subject, and the positioning capability under the background noise with different intensities can be detected. Through data transmission, the acquired data information is stored in real time, and subsequent downloading and analysis are facilitated.

The position selection interface of the APP client 1 is shown in fig. 2, the middle of the turntable is the position of a person, the peripheral turntable is a scale which is used for drawing a circle of people on the horizontal plane, 3 degrees are used as intervals, and the position of 0 degree above the peripheral turntable is the right front side. When a subject perceives a sound source in a certain direction, the small circle on the frequency screen turntable is dragged to the perception direction, the current angle below the character can display the selected degree in real time, the precision is 1 degree, and a confirmation or return interface can appear after hands are loosened. The sense direction may be reselected to prevent misselection if the selection returns and the selected data saved for the next signal test if the selection is determined.

the server 2 comprises a data receiving and storing module, and the data receiving module is mainly used for sorting received data, specifically receiving registration information and position information sent by the APP client 1; and the storage module is used for storing the information of the testee and the experimental data and storing the received selected positions and the real positions of the testee in a list form.

the server 2 serves as a transfer station for data transmission between the APP client 1 and the computer terminal, can manage user information of the registration module, can store data selected by a detection module user in a list, and is convenient for later-stage export.

the computer management terminal is used for managing the information of the testee, replacing or deleting the listening signals, downloading and analyzing the experimental data and correcting the experiment; specifically include information management, audio frequency management, result and gather, safety management module, wherein:

The information management is used for realizing the management of the information of the testee, including name, gender, age, hearing condition, bilateral pure tone threshold value and mobile phone number, and can modify the place with errors and perform experimental detection and error correction;

Audio management, which is used for replacing or deleting the audio required by the APP;

And (4) summarizing results, counting experimental data of each subject, and facilitating derivation and analysis. Summarizing and sorting the results of each subject, detecting whether the data is wrong, removing the data which is misoperated, and supplementing the missing data with experiments in time;

the safety management module is used for guaranteeing the safety of the data of the testee;

In order to ensure the safety of the experimental data of the subject, after the administrator logs in the management client 3 through the password, the administrator can check the experimental data of the subject according to the date or name, and delete or modify the errors occurring in the experiment. The sound source files stored in the server 2 can be replaced or deleted according to the needs, and positioning experiments under other conditions, such as frequency, loudness, personalized positioning difference under non-personalized HRTFs, are performed on the system of the invention.

fig. 4 is a schematic diagram of a virtual free-field sound image, and according to signal and system theory, the process of sound propagation can be regarded as a linear time-invariant system, in which a sound source signal is an input, a sound signal of a left ear or a right ear is an output, and an HRTF is a transfer function of the linear time-invariant system. Therefore, the acoustic signal at the human ear can be synthesized by convolving (or multiplying) the sound source signal and the HRTF in the time domain. A sound source in a space corresponds to a pair of HRTF data (one for each of the left and right ears); different spatial orientations correspond to different HRTF pairs. In binaural signal synthesis, acoustic events from different spatial orientations can be simulated by convolving HRTFs from different orientations with the sound source signal. Since the binaural sound signal contains the main information of sound, the listener can be made to have a subjective feeling as if it were in a specific acoustic environment by artificially simulating the binaural sound signal and reproducing it with headphones or speakers.

Filtering the single-path frequency domain signal E0 with a pair of HRTFs, resulting in a binaural signal:

wherein E0 is a frequency domain signal of a single path, EL and ER are a left ear signal and a right ear signal respectively, and r represents the distance between a sound source and a head center, namely the distance between a sound source coordinate origin and a head center coordinate origin; the azimuth angle theta is an included angle between the projection of the direction vector from the head center coordinate origin to the sound source S on the horizontal plane and the y axis, and the value range of theta is more than or equal to 0 degree and less than or equal to 360 degrees; the elevation angle is the included angle between the sound source direction vector and the horizontal plane, the value range of the elevation angle is f to represent the sound source frequency, a represents the physiological structure parameters, the parameters comprise the shape and the size of the physiological structure of the head and the trunk, and a is different among different individuals.

The convolution process of this embodiment is: reading time domain data from the HRTF database, multiplying a single-channel frequency domain signal E0 with a pair of HRTFs in space to obtain binaural signals EL and ER at corresponding positions, and feeding the dual-channel signals to left and right ears respectively through loudspeaker playback, so that a subject can generate spatial auditory sensation. Judging the position through subjective judgment, and selecting a corresponding position on an interface; the HRTF database is the basis for virtual sound synthesis.

As shown in fig. 5, before starting the detection, the user selects a comfortable sound volume on the APP client 1 according to his hearing ability, so as to perform the detection in the best state.

before the detection is started, an operation training process is provided, so that a user can know the experimental process and how to use the tablet selection point, and the operation of the virtual sound source and the operation familiar with the APP client 1 interface are adapted.

The detection function of the APP client 1 is realized through a detection module, the detection module comprises four detection sound sources including pure tones and pure tones with signal-to-noise ratios of 0, 5 and 10 and containing background noise, and the detection module is used for simulating environmental noises with different intensities. The subject can select four detected sound sources.

Each group of detection sound sources comprises 24 virtual sounds with different directions, the detection sound sources are divided into 24 sound segments A1-A24 at intervals of 15 degrees in 360 degrees of a circle, then a random sequence is respectively generated, each segment of the 24 sound segments A1-A24 is contained in the sequence, sound playing is carried out according to the sequence, and a user can continuously and repeatedly play the sound until a selection is made on an interface of the APP client 1, and the selected position and the actual position of the sound source are synchronized into the server 2 in real time.

After the selection of one detection sound source is completed, the system of the invention can judge whether all the sound segments of the group and four groups of detection sound sources are completed, when the sound segments of the selected group are not completed, the rest segments are continuously played, when the sound segments of the group are completed, the system judges whether all the four groups of detection sound sources are completed, if not, the system selects the sound source group which is not played to continue the experiment until the detection is completed.

After the detection is finished, the user can obtain the detection result through the management client 3, mainly the position data input by the user and the corresponding real position data, and the hearing condition of the user can be grasped in time through the comparison between the position data and the corresponding real position data.

the system of the invention can be used as a platform for controlling sound source playing and result discrimination (coordinate point selection). Whether the audio signal stored in the server 2 is modified or the speaker is used for the experiment related to sound source localization, the system can be used as a controller to control the audio device to play the sound signal and then perform the point selection operation on the interface, as shown in fig. 2. Compared with the traditional sound source positioning test method, the method has the advantages that the experiment efficiency is improved, the labor input is reduced, and the influence of human factors on the result is reduced.

the embodiment shows that the system can carry out spatial auditory detection for people in need at any time and any place, has high efficiency and low cost, is easy to popularize, and enables users with hearing problems to find and take corresponding treatment measures as soon as possible. The whole system is simple to operate, pages are clear, and a new user can be skillfully applied after simple training. Compared with the traditional loudspeaker array in a laboratory, the loudspeaker array in the laboratory has the advantages that a user does not need to invest a lot and is not limited to a specific place, and the loudspeaker array is greatly convenient for the user to use.

The present invention can be implemented in various other embodiments, and the above detailed description is provided for the purpose of illustrating the technical solutions and advantages of the present invention, and it should be understood that the above description is only the most preferred embodiment of the present invention, and is not intended to limit the present invention, and any modifications, additions and equivalents within the scope of the principles of the present invention should be included in the scope of the present invention.

Claims (9)

1. a sound source space positioning capability detection system based on APP comprises an APP client, a server and a computer management terminal, wherein the APP client is in communication connection with the computer management terminal through the server, and the system is characterized in that the APP client comprises space hearing detection, recovery training of people with space positioning capability damage through virtual sound source positioning, acquisition of acoustic parameters of a test environment, input of subject information, operation training, a detection module and data transmission;

Acquiring acoustic parameters of a test environment, and acquiring background noise of the test environment in real time and judging whether the test is suitable or not;

the method comprises the steps of inputting the information of a subject, wherein the information of the user comprises registration information of the user, wherein the registration information of the user comprises name, age, sex, hearing threshold value, telephone and hearing condition;

an operation training for familiarizing the subject with the operation of the APP client and with the virtual spatial sound source;

The detection module is used for providing sound sources for spatial auditory detection and operation training and can simulate different noise environments through background noises with different signal-to-noise ratios;

Data transmission, mainly sending registration information and sound source position information to a server for storage;

the server is mainly used for sorting the received data, storing the received position selected by the subject and the real position of the virtual space sound source in a list form, and serving as a transfer station for data transmission between the APP client and the computer management terminal;

The computer management terminal is used for managing the information of the testee, replacing or deleting the listening signals, downloading and analyzing the experimental data and correcting the experimental error.

2. the APP-based sound source spatial localization capability detection system of claim 1, wherein the determination of whether the experiment is appropriate is specifically: when the background noise is larger than a set value, the APP client reminds that the experiment is not suitable, and a quiet environment is recommended to be selected for testing; and when the background noise is not greater than the set value, judging that the experimental condition is met.

3. the APP-based sound source spatial localization capability detection system of claim 1, wherein the APP client further comprises an experimental announcement, the experimental announcement comprises informing of experimental purpose, required duration, improper subject-taken measures, and experimental site.

4. the APP-based sound source spatial localization capability detection system according to claim 1, wherein the spatial auditory detection process of the APP client is as follows:

1) Providing a training sound source to let the subject become familiar with the virtual sound in the space;

2) Randomly playing a virtual sound at a certain position in the horizontal direction, wherein the virtual sound source is a detection sound source in a detection module;

3) And the subject selects a sensing position on an APP client interface, and the APP client automatically records the selected position and the real position information of the virtual sound and sends the data to the server for storage.

5. The APP-based acoustic source spatial localization capability detection system of claim 1, wherein the server comprises a data receiving and storage module;

The data receiving is used for receiving the registration information and the position information sent by the APP terminal;

and the storage module is used for storing the information of the testee and the experimental data, receiving the selected position of the testee and the real position of the virtual sound, and storing the selected position and the real position of the virtual sound in a list form.

6. The APP-based sound source spatial localization capability detection system of claim 1, wherein the computer management terminal specifically comprises an information management, audio management, result summarization, and security management module, wherein:

the information management is used for realizing the management, the experiment detection and the error correction of the information of the testee;

the audio management is used for replacing or deleting the audio required by the APP client;

result summarization, which is used for counting the experimental data of each subject and is convenient for derivation and analysis;

and the safety management module is used for guaranteeing the safety of the data of the testee.

7. The APP-based sound source spatial localization capability detection system according to claim 1, wherein the detection module comprises four detection sound sources, which are pure tones, and pure tones with signal-to-noise ratio of 0, 5, and 10 and containing background noise.

8. the APP-based sound source spatial localization capability detection system of claim 6, wherein each detected sound source has 24 sound segments, each sound segment representing a virtual sound at a different azimuth.

9. The system of claim 1, wherein a linear time invariant system is used for signal processing in the sound propagation process of the APP client, HRTF is used as a transfer function of the linear time invariant system, and filtering is performed through the transfer function to obtain binaural signals:

wherein E0 is a frequency domain signal of a single path, EL and ER are a left ear signal and a right ear signal respectively, and r represents the distance between a sound source and a head center, namely the distance between a sound source coordinate origin and a head center coordinate origin; the azimuth angle theta is an included angle between the projection of the direction vector from the head center coordinate origin to the sound source S on the horizontal plane and the y axis, and the value range of theta is more than or equal to 0 degree and less than or equal to 360 degrees; the elevation angle is the included angle between the sound source direction vector and the horizontal plane, the value range of the elevation angle is f to represent the sound source frequency, a represents the physiological structure parameters, the parameters comprise the shape and the size of the physiological structure of the head and the trunk, and a is different among different individuals.