CN113824780A - Method and device for eliminating real-time talkback noise of monitoring equipment - Google Patents
Method and device for eliminating real-time talkback noise of monitoring equipment Download PDFInfo
- Publication number
- CN113824780A CN113824780A CN202111086650.9A CN202111086650A CN113824780A CN 113824780 A CN113824780 A CN 113824780A CN 202111086650 A CN202111086650 A CN 202111086650A CN 113824780 A CN113824780 A CN 113824780A
- Authority
- CN
- China
- Prior art keywords
- noise
- real
- client
- socket connection
- talkback
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/14—Session management
- H04L67/141—Setup of application sessions
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4396—Processing of audio elementary streams by muting the audio signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04Q—SELECTING
- H04Q5/00—Selecting arrangements wherein two or more subscriber stations are connected by the same line to the exchange
- H04Q5/24—Selecting arrangements wherein two or more subscriber stations are connected by the same line to the exchange for two-party-line systems
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Telephonic Communication Services (AREA)
- Closed-Circuit Television Systems (AREA)
Abstract
The invention discloses a method and a device for eliminating real-time talkback noise of monitoring equipment, wherein the method mainly comprises the following steps: initiating a voice talkback request; establishing Socket connection between the client and the server; monitoring the Socket connection state; and according to the Socket connection state, eliminating the real-time talkback noise of the monitoring equipment. The method can realize real-time talkback noise elimination at the client, has simple procedure, only needs to control the video mute or play state of the equipment end according to the Socket connection state, well solves the problems of complex noise elimination process and low real-time performance at the server end, and greatly saves the development time.
Description
Technical Field
The invention belongs to the field of talkback noise elimination, and particularly relates to a method and a device for eliminating real-time talkback noise of monitoring equipment.
Background
At present, most of voice noise reduction related methods at home and abroad are carried out at a server, a dynamic energy threshold value is set by carrying out framing processing on voice data, then a stable noise spectrum is obtained based on the dynamic energy threshold value, and noise reduction voice data is obtained based on spectral subtraction to eliminate talkback noise.
Therefore, how to efficiently and conveniently eliminate the real-time talkback noise of the monitoring equipment has very important significance in practical application.
Disclosure of Invention
Aiming at the problems, the invention provides a method for eliminating real-time talkback noise of monitoring equipment, which successfully solves the problem that the noise can not be effectively eliminated at the equipment end.
The technical scheme provided by the invention is as follows:
on one hand, the invention discloses a method for eliminating real-time talkback noise of monitoring equipment, which comprises the following steps:
s1) initiating a voice intercom request;
s2) the client establishes Socket connection with the server;
s3) monitoring the Socket connection state;
s4) according to the Socket connection state, real-time talkback noise of the monitoring equipment is eliminated.
Further, the specific process of establishing Socket connection between the client and the server is as follows:
s2.1) the client side obtains Socket information;
s2.2) the client is connected to the server according to the Socket information and receives a random code instruction;
s2.3) the client requests to establish a session;
s2.4) the server responds to the session request instruction of the client, and the client receives the session confirmation instruction;
s2.5) acquiring the Session and calling a first interface to notify the equipment terminal;
s2.6) the client receives the channel preparation instruction and establishes a data channel.
Further, the Session confirmation instruction includes a Session unique identifier issued by the server to the current client.
Further, the Socket information includes: service address, port number, encryption password, audio format.
Further, the first interface is a program interface defined through signaling.
Further, the specific process for eliminating the real-time talkback noise of the monitoring device is as follows:
judging the Socket connection state;
when the Socket connection state is connection, performing mute processing on the equipment video;
and when the Socket connection state is disconnected, restoring sound processing to the video at the equipment end.
Further, the process of eliminating the real-time talkback noise of the monitoring equipment is triggered and executed by a preset program.
Further, the operation triggered and executed by the preset program comprises judging and triggering execution of muting and sound restoration according to the Socket connection state.
On the other hand, the invention discloses a device for eliminating real-time talkback noise of monitoring equipment, which comprises:
the voice talkback unit is used for realizing the voice talkback function;
the connection establishing unit is used for establishing Socket connection between the client and the server;
the connection state monitoring unit is used for monitoring the Socket connection state;
and the noise elimination unit is used for carrying out mute processing or sound recovery processing on the video of the equipment end according to the Socket connection state.
Advantageous effects
The method for eliminating the real-time talkback noise of the monitoring equipment can realize the elimination of the real-time talkback noise at the client, has simple procedure, only needs to control the video mute or play state of the equipment end according to the Socket connection state, well solves the problems of complex noise elimination process and low real-time performance at the server end, and greatly saves the development time.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flow chart of a method for eliminating real-time intercom noise of a monitoring device in embodiment 1 of the present invention;
fig. 2 is a schematic flowchart of a process of establishing Socket connection by multiple handshakes between a client and a server in embodiment 1 of the present invention;
fig. 3 is a schematic structural diagram of an apparatus for eliminating real-time intercom noise of a monitoring device in embodiment 2 of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Example 1
Referring to fig. 1, the present embodiment provides a method for eliminating real-time intercom noise of a monitoring device, including the following steps:
s1) the client initiates a voice talkback request;
s2) the client side and the server side handshake for multiple times to establish Socket connection;
specifically, referring to fig. 2, a specific process of establishing Socket connection by multiple handshakes between the client and the server is as follows:
s2.1) the client side obtains Socket information;
specifically, Socket information is acquired through the NVR configuration interface, and the Socket information includes: service address, port number, encryption password, audio format. The NVR is a storage and forwarding part of the Network monitoring system, and cooperates with the Video encoder or the Network camera to complete Video recording, storage and forwarding functions of videos.
S2.2) the client is connected to the server according to the Socket information and receives a random code (ReleaseRandomKey) instruction;
specifically, the instruction is issued by the server at the first time after the client connects to the server.
S2.3) the client requests to establish a session;
s2.4) the server responds to a session request instruction (RequireSession) of the client, and the client receives a session confirmation (Session ack) instruction;
specifically, the Session confirmation instruction includes a Session id, i.e., a Session unique identifier, issued by the server to the current client. And the client sends the Session to the NVR equipment end through a background and DMS protocol, wherein the Session ID information is necessary information of the Session.
S2.5) acquiring the Session and calling the first interface to notify the NVR equipment terminal;
specifically, the called first interface is a program interface defined through signaling. The NVR equipment end is connected to the server according to the Socket information, receives a random code (ReleaseRandomKey) instruction, then requests the server to establish a Session, Session information of S2.4) is carried in request information of the request for establishing the Session, the server replies a Session request instruction of the NVR equipment end, and the NVR equipment end receives a Session confirmation instruction.
S2.6) the client receives a channel preparation (BridgeReady) instruction and establishes a data channel.
S3) monitoring the Socket connection state;
s4) eliminating real-time talkback noise of the monitoring equipment at the client according to the Socket connection state;
specifically, because the video data that NVR equipment obtained is audio frequency, consequently, when the user talkbacks in pronunciation, can bring in video noise, if Socket connection status is for connecting then do the mute processing to the video, if for the disconnection then resume video broadcast immediately, reject the video broadcast noise of pronunciation in-process from this, wherein judge according to Socket connection status that to trigger to carry out the silence and resume sound and trigger by presetting the procedure and carry out, it specifically as follows to preset the procedure:
example 2
Referring to fig. 3, the present invention further provides an apparatus for eliminating real-time intercom noise of a monitoring device, including:
the voice talkback unit 101 is used for realizing a voice talkback function;
a connection establishing unit 102, configured to establish a Socket connection between the client and the server, where it needs to be noted that, since the specific Socket connection establishing process is described in detail in step S2 of the method for eliminating real-time intercom noise of the monitoring device, details are not described here again;
a connection state monitoring unit 103, configured to monitor a Socket connection state;
the noise eliminating unit 104 is configured to mute or restore the audio processing to the device video according to the Socket connection state, and it should be noted that, since the specific noise eliminating process is already described in detail in step S4 of the method for eliminating the real-time talk noise of the monitoring device, no further description is given here.
The method for eliminating the real-time talkback noise of the monitoring equipment can realize the elimination of the real-time talkback noise at the client, has simple procedures, only needs to control the video mute or playing state of the equipment end according to the Socket connection state, and well solves the problems of complex noise elimination process and low real-time performance at the server end.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium may store a program, and the program, when executed, includes some or all of the steps of any method for eliminating real-time intercom noise of a monitoring device described in the above method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned memory comprises: a U-disk, a Read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments, objects, technical solutions and advantages of the present application are further described in detail, it should be understood that the above-mentioned embodiments are only examples of the present application, and are not intended to limit the scope of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present application should be included in the scope of the present application.
Claims (10)
1. A method for eliminating real-time talkback noise of monitoring equipment is characterized by comprising the following steps:
s1) initiating a voice intercom request;
s2) the client establishes Socket connection with the server;
s3) monitoring the Socket connection state;
s4) according to the Socket connection state, real-time talkback noise of the monitoring equipment is eliminated.
2. The method for eliminating real-time talkback noise of monitoring equipment according to claim 1, wherein the specific process of establishing Socket connection between the client and the server is as follows:
s2.1) the client side obtains Socket information;
s2.2) the client is connected to the server according to the Socket information and receives a random code instruction;
s2.3) the client requests to establish a session;
s2.4) the server responds to the session request instruction of the client, and the client receives the session confirmation instruction;
s2.5) acquiring the Session and calling a first interface to notify the equipment terminal;
s2.6) the client receives the channel preparation instruction and establishes a data channel.
3. The method as claimed in claim 2, wherein the Session confirmation command includes a Session unique identifier issued by the server to the current client.
4. The method for eliminating real-time talkback noise of monitoring equipment according to claim 2 or 3, wherein the Socket information comprises: service address, port number, encryption password, audio format.
5. The method for eliminating real-time talkback noise of a monitoring device according to claim 2, wherein the first interface is a program interface defined by signaling.
6. The method for eliminating real-time talkback noise of monitoring equipment according to claim 1, wherein the real-time talkback noise of the monitoring equipment is eliminated by the following specific process:
judging the Socket connection state;
when the Socket connection state is connection, performing mute processing on the equipment video;
and when the Socket connection state is disconnected, restoring sound processing to the video at the equipment end.
7. The method for eliminating real-time talkback noise of a monitoring device according to claim 6, wherein the process of eliminating the real-time talkback noise of the monitoring device is triggered by a preset program.
8. The method for eliminating real-time talkback noise of monitoring equipment according to claim 7, wherein the operation triggered and executed by the preset program comprises the steps of judging and triggering to mute and restore sound according to the Socket connection state.
9. A device for eliminating real-time talkback noise of monitoring equipment is characterized by comprising:
the voice talkback unit is used for realizing the voice talkback function;
the connection establishing unit is used for establishing Socket connection between the client and the server;
the connection state monitoring unit is used for monitoring the Socket connection state;
and the noise elimination unit is used for carrying out mute processing or sound recovery processing on the video of the equipment end according to the Socket connection state.
10. A storage medium, storing a computer program or instructions which, when executed, implement the method of any one of claims 1 to 8.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111086650.9A CN113824780B (en) | 2021-09-16 | 2021-09-16 | Method and device for eliminating real-time talkback noise of monitoring equipment |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202111086650.9A CN113824780B (en) | 2021-09-16 | 2021-09-16 | Method and device for eliminating real-time talkback noise of monitoring equipment |
Publications (2)
Publication Number | Publication Date |
---|---|
CN113824780A true CN113824780A (en) | 2021-12-21 |
CN113824780B CN113824780B (en) | 2022-08-05 |
Family
ID=78914743
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202111086650.9A Active CN113824780B (en) | 2021-09-16 | 2021-09-16 | Method and device for eliminating real-time talkback noise of monitoring equipment |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN113824780B (en) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8867524B1 (en) * | 2005-09-30 | 2014-10-21 | At&T Intellectual Property Ii, L.P. | Method and apparatus for activating an incoming call voice session on a video display device |
CN105898233A (en) * | 2016-05-27 | 2016-08-24 | 浙江宇视科技有限公司 | Audio and video playing method and apparatus in video monitoring |
US20170279925A1 (en) * | 2014-12-09 | 2017-09-28 | Alibaba Group Holding Limited | Service processing method and apparatus, and service server |
CN108011871A (en) * | 2017-11-16 | 2018-05-08 | 青岛海信电器股份有限公司 | A kind of remote assistance processing method and equipment |
CN108132773A (en) * | 2018-01-23 | 2018-06-08 | 广东欧珀移动通信有限公司 | Electronic device and its signal processing method |
CN210518526U (en) * | 2019-08-15 | 2020-05-12 | 苏州万店掌网络科技有限公司 | Camera capable of supporting two-way voice talkback |
-
2021
- 2021-09-16 CN CN202111086650.9A patent/CN113824780B/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8867524B1 (en) * | 2005-09-30 | 2014-10-21 | At&T Intellectual Property Ii, L.P. | Method and apparatus for activating an incoming call voice session on a video display device |
US20170279925A1 (en) * | 2014-12-09 | 2017-09-28 | Alibaba Group Holding Limited | Service processing method and apparatus, and service server |
CN105898233A (en) * | 2016-05-27 | 2016-08-24 | 浙江宇视科技有限公司 | Audio and video playing method and apparatus in video monitoring |
CN108011871A (en) * | 2017-11-16 | 2018-05-08 | 青岛海信电器股份有限公司 | A kind of remote assistance processing method and equipment |
CN108132773A (en) * | 2018-01-23 | 2018-06-08 | 广东欧珀移动通信有限公司 | Electronic device and its signal processing method |
CN210518526U (en) * | 2019-08-15 | 2020-05-12 | 苏州万店掌网络科技有限公司 | Camera capable of supporting two-way voice talkback |
Also Published As
Publication number | Publication date |
---|---|
CN113824780B (en) | 2022-08-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10425782B2 (en) | Voice messaging method and mobile terminal supporting voice messaging in mobile messenger service | |
CN107911437B (en) | Screen sharing method and device, electronic equipment and storage medium | |
WO2017000476A1 (en) | Voice verification method, device and system | |
KR101301434B1 (en) | Voice instant messaging between mobile and computing devices | |
CN110266810B (en) | Message receiving method, device and storage medium based on MQTT protocol | |
CN111405042B (en) | Electronic device discovery method and device, storage medium and electronic device | |
WO2019071829A1 (en) | Method, storage medium, device and system for implementing microphone connection-based battle between hosts on pc | |
CN112767936B (en) | Voice dialogue method and device, storage medium and electronic equipment | |
CN103368829A (en) | Chat message processing method and system for instant messaging tool | |
CN101606360B (en) | Unique compressed call identifiers | |
WO2018166367A1 (en) | Real-time prompt method and device in real-time conversation, storage medium, and electronic device | |
CN109819278B (en) | Optimization method of live video | |
AU2013262210B2 (en) | Transmission method for media data stream and thin client | |
CN113824780B (en) | Method and device for eliminating real-time talkback noise of monitoring equipment | |
CN113612759A (en) | High-performance high-concurrency intelligent broadcasting system based on SIP protocol and implementation method | |
CN112311802B (en) | Information transmission method and information transmission device | |
CN105376427A (en) | Recording method, device and system | |
CN105391702A (en) | Audio/video communication method, terminal, server and platform | |
US11818185B2 (en) | Audio streaming from host Bluetooth device to multiple receiving Bluetooth devices | |
CN107948663A (en) | A kind of way of recording, client and terminal device | |
CN112770269A (en) | Voice communication method and system under wide-band and narrow-band intercommunication environment | |
WO2022166591A1 (en) | Method and apparatus for playing live streaming resource, and storage medium and electronic device | |
CN114745213A (en) | Conference record generation method and device, electronic equipment and storage medium | |
US9288180B2 (en) | Communication system and method | |
CN111356062B (en) | Data acquisition method, microphone and computer readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |