CN113824780A - Method and device for eliminating real-time talkback noise of monitoring equipment - Google Patents

Method and device for eliminating real-time talkback noise of monitoring equipment Download PDF

Info

Publication number
CN113824780A
CN113824780A CN202111086650.9A CN202111086650A CN113824780A CN 113824780 A CN113824780 A CN 113824780A CN 202111086650 A CN202111086650 A CN 202111086650A CN 113824780 A CN113824780 A CN 113824780A
Authority
CN
China
Prior art keywords
noise
real
client
socket connection
talkback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202111086650.9A
Other languages
Chinese (zh)
Other versions
CN113824780B (en
Inventor
姚傲
张瑞
周圣强
黄岗
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
OP Retail Suzhou Technology Co Ltd
Original Assignee
OP Retail Suzhou Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by OP Retail Suzhou Technology Co Ltd filed Critical OP Retail Suzhou Technology Co Ltd
Priority to CN202111086650.9A priority Critical patent/CN113824780B/en
Publication of CN113824780A publication Critical patent/CN113824780A/en
Application granted granted Critical
Publication of CN113824780B publication Critical patent/CN113824780B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/14Session management
    • H04L67/141Setup of application sessions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/439Processing of audio elementary streams
    • H04N21/4396Processing of audio elementary streams by muting the audio signal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04QSELECTING
    • H04Q5/00Selecting arrangements wherein two or more subscriber stations are connected by the same line to the exchange
    • H04Q5/24Selecting arrangements wherein two or more subscriber stations are connected by the same line to the exchange for two-party-line systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)
  • Closed-Circuit Television Systems (AREA)

Abstract

The invention discloses a method and a device for eliminating real-time talkback noise of monitoring equipment, wherein the method mainly comprises the following steps: initiating a voice talkback request; establishing Socket connection between the client and the server; monitoring the Socket connection state; and according to the Socket connection state, eliminating the real-time talkback noise of the monitoring equipment. The method can realize real-time talkback noise elimination at the client, has simple procedure, only needs to control the video mute or play state of the equipment end according to the Socket connection state, well solves the problems of complex noise elimination process and low real-time performance at the server end, and greatly saves the development time.

Description

Method and device for eliminating real-time talkback noise of monitoring equipment
Technical Field
The invention belongs to the field of talkback noise elimination, and particularly relates to a method and a device for eliminating real-time talkback noise of monitoring equipment.
Background
At present, most of voice noise reduction related methods at home and abroad are carried out at a server, a dynamic energy threshold value is set by carrying out framing processing on voice data, then a stable noise spectrum is obtained based on the dynamic energy threshold value, and noise reduction voice data is obtained based on spectral subtraction to eliminate talkback noise.
Therefore, how to efficiently and conveniently eliminate the real-time talkback noise of the monitoring equipment has very important significance in practical application.
Disclosure of Invention
Aiming at the problems, the invention provides a method for eliminating real-time talkback noise of monitoring equipment, which successfully solves the problem that the noise can not be effectively eliminated at the equipment end.
The technical scheme provided by the invention is as follows:
on one hand, the invention discloses a method for eliminating real-time talkback noise of monitoring equipment, which comprises the following steps:
s1) initiating a voice intercom request;
s2) the client establishes Socket connection with the server;
s3) monitoring the Socket connection state;
s4) according to the Socket connection state, real-time talkback noise of the monitoring equipment is eliminated.
Further, the specific process of establishing Socket connection between the client and the server is as follows:
s2.1) the client side obtains Socket information;
s2.2) the client is connected to the server according to the Socket information and receives a random code instruction;
s2.3) the client requests to establish a session;
s2.4) the server responds to the session request instruction of the client, and the client receives the session confirmation instruction;
s2.5) acquiring the Session and calling a first interface to notify the equipment terminal;
s2.6) the client receives the channel preparation instruction and establishes a data channel.
Further, the Session confirmation instruction includes a Session unique identifier issued by the server to the current client.
Further, the Socket information includes: service address, port number, encryption password, audio format.
Further, the first interface is a program interface defined through signaling.
Further, the specific process for eliminating the real-time talkback noise of the monitoring device is as follows:
judging the Socket connection state;
when the Socket connection state is connection, performing mute processing on the equipment video;
and when the Socket connection state is disconnected, restoring sound processing to the video at the equipment end.
Further, the process of eliminating the real-time talkback noise of the monitoring equipment is triggered and executed by a preset program.
Further, the operation triggered and executed by the preset program comprises judging and triggering execution of muting and sound restoration according to the Socket connection state.
On the other hand, the invention discloses a device for eliminating real-time talkback noise of monitoring equipment, which comprises:
the voice talkback unit is used for realizing the voice talkback function;
the connection establishing unit is used for establishing Socket connection between the client and the server;
the connection state monitoring unit is used for monitoring the Socket connection state;
and the noise elimination unit is used for carrying out mute processing or sound recovery processing on the video of the equipment end according to the Socket connection state.
Advantageous effects
The method for eliminating the real-time talkback noise of the monitoring equipment can realize the elimination of the real-time talkback noise at the client, has simple procedure, only needs to control the video mute or play state of the equipment end according to the Socket connection state, well solves the problems of complex noise elimination process and low real-time performance at the server end, and greatly saves the development time.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this application, illustrate embodiments of the invention and, together with the description, serve to explain the invention and not to limit the invention. In the drawings:
fig. 1 is a schematic flow chart of a method for eliminating real-time intercom noise of a monitoring device in embodiment 1 of the present invention;
fig. 2 is a schematic flowchart of a process of establishing Socket connection by multiple handshakes between a client and a server in embodiment 1 of the present invention;
fig. 3 is a schematic structural diagram of an apparatus for eliminating real-time intercom noise of a monitoring device in embodiment 2 of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
Example 1
Referring to fig. 1, the present embodiment provides a method for eliminating real-time intercom noise of a monitoring device, including the following steps:
s1) the client initiates a voice talkback request;
s2) the client side and the server side handshake for multiple times to establish Socket connection;
specifically, referring to fig. 2, a specific process of establishing Socket connection by multiple handshakes between the client and the server is as follows:
s2.1) the client side obtains Socket information;
specifically, Socket information is acquired through the NVR configuration interface, and the Socket information includes: service address, port number, encryption password, audio format. The NVR is a storage and forwarding part of the Network monitoring system, and cooperates with the Video encoder or the Network camera to complete Video recording, storage and forwarding functions of videos.
S2.2) the client is connected to the server according to the Socket information and receives a random code (ReleaseRandomKey) instruction;
specifically, the instruction is issued by the server at the first time after the client connects to the server.
S2.3) the client requests to establish a session;
s2.4) the server responds to a session request instruction (RequireSession) of the client, and the client receives a session confirmation (Session ack) instruction;
specifically, the Session confirmation instruction includes a Session id, i.e., a Session unique identifier, issued by the server to the current client. And the client sends the Session to the NVR equipment end through a background and DMS protocol, wherein the Session ID information is necessary information of the Session.
S2.5) acquiring the Session and calling the first interface to notify the NVR equipment terminal;
specifically, the called first interface is a program interface defined through signaling. The NVR equipment end is connected to the server according to the Socket information, receives a random code (ReleaseRandomKey) instruction, then requests the server to establish a Session, Session information of S2.4) is carried in request information of the request for establishing the Session, the server replies a Session request instruction of the NVR equipment end, and the NVR equipment end receives a Session confirmation instruction.
S2.6) the client receives a channel preparation (BridgeReady) instruction and establishes a data channel.
S3) monitoring the Socket connection state;
s4) eliminating real-time talkback noise of the monitoring equipment at the client according to the Socket connection state;
specifically, because the video data that NVR equipment obtained is audio frequency, consequently, when the user talkbacks in pronunciation, can bring in video noise, if Socket connection status is for connecting then do the mute processing to the video, if for the disconnection then resume video broadcast immediately, reject the video broadcast noise of pronunciation in-process from this, wherein judge according to Socket connection status that to trigger to carry out the silence and resume sound and trigger by presetting the procedure and carry out, it specifically as follows to preset the procedure:
Figure BDA0003266030420000041
Figure BDA0003266030420000051
example 2
Referring to fig. 3, the present invention further provides an apparatus for eliminating real-time intercom noise of a monitoring device, including:
the voice talkback unit 101 is used for realizing a voice talkback function;
a connection establishing unit 102, configured to establish a Socket connection between the client and the server, where it needs to be noted that, since the specific Socket connection establishing process is described in detail in step S2 of the method for eliminating real-time intercom noise of the monitoring device, details are not described here again;
a connection state monitoring unit 103, configured to monitor a Socket connection state;
the noise eliminating unit 104 is configured to mute or restore the audio processing to the device video according to the Socket connection state, and it should be noted that, since the specific noise eliminating process is already described in detail in step S4 of the method for eliminating the real-time talk noise of the monitoring device, no further description is given here.
The method for eliminating the real-time talkback noise of the monitoring equipment can realize the elimination of the real-time talkback noise at the client, has simple procedures, only needs to control the video mute or playing state of the equipment end according to the Socket connection state, and well solves the problems of complex noise elimination process and low real-time performance at the server end.
In addition, an embodiment of the present invention further provides a computer-readable storage medium, where the computer-readable storage medium may store a program, and the program, when executed, includes some or all of the steps of any method for eliminating real-time intercom noise of a monitoring device described in the above method embodiments.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable memory. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a memory and includes several instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned memory comprises: a U-disk, a Read-only memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.
The above-mentioned embodiments, objects, technical solutions and advantages of the present application are further described in detail, it should be understood that the above-mentioned embodiments are only examples of the present application, and are not intended to limit the scope of the present application, and any modifications, equivalent substitutions, improvements and the like made on the basis of the technical solutions of the present application should be included in the scope of the present application.

Claims (10)

1. A method for eliminating real-time talkback noise of monitoring equipment is characterized by comprising the following steps:
s1) initiating a voice intercom request;
s2) the client establishes Socket connection with the server;
s3) monitoring the Socket connection state;
s4) according to the Socket connection state, real-time talkback noise of the monitoring equipment is eliminated.
2. The method for eliminating real-time talkback noise of monitoring equipment according to claim 1, wherein the specific process of establishing Socket connection between the client and the server is as follows:
s2.1) the client side obtains Socket information;
s2.2) the client is connected to the server according to the Socket information and receives a random code instruction;
s2.3) the client requests to establish a session;
s2.4) the server responds to the session request instruction of the client, and the client receives the session confirmation instruction;
s2.5) acquiring the Session and calling a first interface to notify the equipment terminal;
s2.6) the client receives the channel preparation instruction and establishes a data channel.
3. The method as claimed in claim 2, wherein the Session confirmation command includes a Session unique identifier issued by the server to the current client.
4. The method for eliminating real-time talkback noise of monitoring equipment according to claim 2 or 3, wherein the Socket information comprises: service address, port number, encryption password, audio format.
5. The method for eliminating real-time talkback noise of a monitoring device according to claim 2, wherein the first interface is a program interface defined by signaling.
6. The method for eliminating real-time talkback noise of monitoring equipment according to claim 1, wherein the real-time talkback noise of the monitoring equipment is eliminated by the following specific process:
judging the Socket connection state;
when the Socket connection state is connection, performing mute processing on the equipment video;
and when the Socket connection state is disconnected, restoring sound processing to the video at the equipment end.
7. The method for eliminating real-time talkback noise of a monitoring device according to claim 6, wherein the process of eliminating the real-time talkback noise of the monitoring device is triggered by a preset program.
8. The method for eliminating real-time talkback noise of monitoring equipment according to claim 7, wherein the operation triggered and executed by the preset program comprises the steps of judging and triggering to mute and restore sound according to the Socket connection state.
9. A device for eliminating real-time talkback noise of monitoring equipment is characterized by comprising:
the voice talkback unit is used for realizing the voice talkback function;
the connection establishing unit is used for establishing Socket connection between the client and the server;
the connection state monitoring unit is used for monitoring the Socket connection state;
and the noise elimination unit is used for carrying out mute processing or sound recovery processing on the video of the equipment end according to the Socket connection state.
10. A storage medium, storing a computer program or instructions which, when executed, implement the method of any one of claims 1 to 8.
CN202111086650.9A 2021-09-16 2021-09-16 Method and device for eliminating real-time talkback noise of monitoring equipment Active CN113824780B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111086650.9A CN113824780B (en) 2021-09-16 2021-09-16 Method and device for eliminating real-time talkback noise of monitoring equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111086650.9A CN113824780B (en) 2021-09-16 2021-09-16 Method and device for eliminating real-time talkback noise of monitoring equipment

Publications (2)

Publication Number Publication Date
CN113824780A true CN113824780A (en) 2021-12-21
CN113824780B CN113824780B (en) 2022-08-05

Family

ID=78914743

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111086650.9A Active CN113824780B (en) 2021-09-16 2021-09-16 Method and device for eliminating real-time talkback noise of monitoring equipment

Country Status (1)

Country Link
CN (1) CN113824780B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8867524B1 (en) * 2005-09-30 2014-10-21 At&T Intellectual Property Ii, L.P. Method and apparatus for activating an incoming call voice session on a video display device
CN105898233A (en) * 2016-05-27 2016-08-24 浙江宇视科技有限公司 Audio and video playing method and apparatus in video monitoring
US20170279925A1 (en) * 2014-12-09 2017-09-28 Alibaba Group Holding Limited Service processing method and apparatus, and service server
CN108011871A (en) * 2017-11-16 2018-05-08 青岛海信电器股份有限公司 A kind of remote assistance processing method and equipment
CN108132773A (en) * 2018-01-23 2018-06-08 广东欧珀移动通信有限公司 Electronic device and its signal processing method
CN210518526U (en) * 2019-08-15 2020-05-12 苏州万店掌网络科技有限公司 Camera capable of supporting two-way voice talkback

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8867524B1 (en) * 2005-09-30 2014-10-21 At&T Intellectual Property Ii, L.P. Method and apparatus for activating an incoming call voice session on a video display device
US20170279925A1 (en) * 2014-12-09 2017-09-28 Alibaba Group Holding Limited Service processing method and apparatus, and service server
CN105898233A (en) * 2016-05-27 2016-08-24 浙江宇视科技有限公司 Audio and video playing method and apparatus in video monitoring
CN108011871A (en) * 2017-11-16 2018-05-08 青岛海信电器股份有限公司 A kind of remote assistance processing method and equipment
CN108132773A (en) * 2018-01-23 2018-06-08 广东欧珀移动通信有限公司 Electronic device and its signal processing method
CN210518526U (en) * 2019-08-15 2020-05-12 苏州万店掌网络科技有限公司 Camera capable of supporting two-way voice talkback

Also Published As

Publication number Publication date
CN113824780B (en) 2022-08-05

Similar Documents

Publication Publication Date Title
US10425782B2 (en) Voice messaging method and mobile terminal supporting voice messaging in mobile messenger service
CN107911437B (en) Screen sharing method and device, electronic equipment and storage medium
WO2017000476A1 (en) Voice verification method, device and system
KR101301434B1 (en) Voice instant messaging between mobile and computing devices
CN110266810B (en) Message receiving method, device and storage medium based on MQTT protocol
CN111405042B (en) Electronic device discovery method and device, storage medium and electronic device
WO2019071829A1 (en) Method, storage medium, device and system for implementing microphone connection-based battle between hosts on pc
CN112767936B (en) Voice dialogue method and device, storage medium and electronic equipment
CN103368829A (en) Chat message processing method and system for instant messaging tool
CN101606360B (en) Unique compressed call identifiers
WO2018166367A1 (en) Real-time prompt method and device in real-time conversation, storage medium, and electronic device
CN109819278B (en) Optimization method of live video
AU2013262210B2 (en) Transmission method for media data stream and thin client
CN113824780B (en) Method and device for eliminating real-time talkback noise of monitoring equipment
CN113612759A (en) High-performance high-concurrency intelligent broadcasting system based on SIP protocol and implementation method
CN112311802B (en) Information transmission method and information transmission device
CN105376427A (en) Recording method, device and system
CN105391702A (en) Audio/video communication method, terminal, server and platform
US11818185B2 (en) Audio streaming from host Bluetooth device to multiple receiving Bluetooth devices
CN107948663A (en) A kind of way of recording, client and terminal device
CN112770269A (en) Voice communication method and system under wide-band and narrow-band intercommunication environment
WO2022166591A1 (en) Method and apparatus for playing live streaming resource, and storage medium and electronic device
CN114745213A (en) Conference record generation method and device, electronic equipment and storage medium
US9288180B2 (en) Communication system and method
CN111356062B (en) Data acquisition method, microphone and computer readable storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant