CN112261214A - Network voice communication automatic test method and system - Google Patents

Network voice communication automatic test method and system Download PDF

Info

Publication number
CN112261214A
CN112261214A CN202011134233.2A CN202011134233A CN112261214A CN 112261214 A CN112261214 A CN 112261214A CN 202011134233 A CN202011134233 A CN 202011134233A CN 112261214 A CN112261214 A CN 112261214A
Authority
CN
China
Prior art keywords
test
voice
text
voice stream
stream
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202011134233.2A
Other languages
Chinese (zh)
Inventor
刘继明
潘湛章
张元国
彭耀文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Shanglu Information Technology Co ltd
Original Assignee
Guangdong Shanglu Information Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Shanglu Information Technology Co ltd filed Critical Guangdong Shanglu Information Technology Co ltd
Priority to CN202011134233.2A priority Critical patent/CN112261214A/en
Publication of CN112261214A publication Critical patent/CN112261214A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/24Arrangements for testing
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L13/00Speech synthesis; Text to speech systems
    • G10L13/02Methods for producing synthetic speech; Speech synthesisers

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Telephonic Communication Services (AREA)
  • Telephone Function (AREA)

Abstract

The present disclosure provides a network voice communication automatic test method and system, the method includes: establishing communication connection with a tested telephone; acquiring a first test text, and synthesizing a first test voice stream according to the first test text; sending the first test voice stream to a tested telephone; acquiring a second test voice stream received by the tested telephone; identifying the second test voice stream to generate a second test text; and comparing and analyzing the first test text and the second test text and obtaining a test result. The system and the method realize the automatic test of the network voice communication, improve the test efficiency and reduce the test cost; the conversion and transmission of the voice and the characters are not interfered by external sound, the signal-to-noise ratio is higher, the signals are clear, the algorithm is simple, the cost is reduced, the testing efficiency and the accuracy are improved, and the testing result is more stable.

Description

Network voice communication automatic test method and system
Technical Field
The present disclosure relates to the field of communication testing technologies, and in particular, to an automated testing method and system for network voice communication.
Background
With the development of the technology, the functions of the telephone set equipment are increased day by day, and the network environment is complicated day by day. Under various different sip service environments, the test complexity is higher and higher, and the cost of the number of test cases is increased. Under the condition, the manual test cannot meet the actual test requirement due to complex operation, low efficiency, high cost and lack of stability and accuracy of the test result.
Disclosure of Invention
The present disclosure provides a network voice communication automated testing method and system for the above problems.
In order to solve at least one of the above technical problems, the present disclosure proposes the following technical solutions:
in a first aspect, an automated testing method for network voice communication is provided, which includes the following steps:
establishing communication connection with a tested telephone;
acquiring a first test text, and synthesizing a first test voice stream according to the first test text;
sending the first test voice stream to a tested telephone;
acquiring a second test voice stream received by the tested telephone;
identifying the second test voice stream to generate a second test text;
and comparing and analyzing the first test text and the second test text and obtaining a test result.
In a second aspect, a network voice communication automation test system is provided, configured to execute any one of the above network voice communication automation test methods, including:
the communication connection unit is used for establishing communication connection with the tested telephone;
the voice synthesis unit is used for acquiring a first test text and synthesizing a first test voice stream according to the first test text;
the voice sending unit is used for sending the first testing voice stream to the tested telephone;
the voice receiving unit is used for acquiring a second test voice stream received by the tested telephone;
the voice recognition unit is used for recognizing the second test voice stream to generate a second test text;
and the comparison and analysis unit is used for comparing and analyzing the first test text and the second test text and acquiring a test result.
The method has the advantages that the automatic testing of the network voice communication is realized, the testing efficiency is improved, and the testing cost is reduced; the conversion and transmission of the voice and the characters are not interfered by external sound, the signal-to-noise ratio is higher, the signals are clear, the algorithm is simple, the cost is reduced, the testing efficiency and the accuracy are improved, and the testing result is more stable.
In addition, in the technical solutions of the present disclosure, the technical solutions of the present disclosure can be implemented by adopting conventional means in the art, unless otherwise specified.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without inventive efforts.
Fig. 1 is a flowchart of an automated testing method for network voice communication according to an embodiment of the present disclosure.
Fig. 2 is a schematic structural diagram of an automated testing system for network voice communication according to an embodiment of the present disclosure.
Detailed Description
In order to make the objects, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below with reference to the accompanying drawings and embodiments. It is to be understood that the specific embodiments described herein are merely illustrative of some, but not all, embodiments of the disclosure and are not to be considered as limiting the disclosure. All other embodiments, which can be derived by a person skilled in the art from the embodiments disclosed herein without making any creative effort, shall fall within the protection scope of the present disclosure.
It should be noted that the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Example 1:
referring to the accompanying drawing 1 of the specification, there is shown a network voice communication automation testing method provided by the embodiment of the application, which may include the following steps:
s101: establishing communication connection with a tested telephone;
specifically, a phone terminal is set to establish communication connection with a phone to be tested, and the phone terminal can be an IP phone or a computer-simulated phone terminal.
In an optional embodiment, the phone terminal and the phone to be tested are connected through an SIP server. The specific connection step may include:
the phone terminal initiates a communication request to the SIP server;
the SIP server forwards a communication request to the tested telephone;
the tested telephone returns a response indicating the successful connection to the SIP server;
the SIP server forwards the response of successful connection to the telephone terminal;
after receiving the response, the telephone terminal sends ACK information to the SIP server for confirmation;
the SIP server forwards the ACK information to the tested telephone;
and communication connection is established between the phone terminal and the tested phone.
S102: acquiring a first test text, and synthesizing a first test voice stream according to the first test text;
in an alternative embodiment, obtaining the first test text and synthesizing the first test speech stream according to the first test text may include the steps of:
a tester presets a test text case set;
randomly acquiring text fields in the test text case set to form a first test text;
cutting character segments in the first test text into sentences;
and synthesizing the sentences in sequence to obtain a first test voice stream.
Specifically, a plurality of text fields can be set in the test text case set according to the test requirements.
In an alternative embodiment, the synthesis of the first test text into the first test speech stream may use a TTS service based on the MRCP communication protocol.
S103: sending the first test voice stream to a tested telephone;
in an optional embodiment, sending the first test voice stream to the tested phone specifically includes:
sending the first test voice stream to an SIP server;
and the SIP server forwards the first test voice stream to the tested telephone.
In an alternative embodiment, the first test voice stream is sent in the form of RTP packets.
S104: acquiring a second test voice stream received by the tested telephone;
s105: identifying the second test voice stream to generate a second test text;
specifically, the second test text includes each text field corresponding to the second test voice stream.
In an alternative embodiment, the recognition of the second test speech stream to generate the second test text may use an ASR service based on the MRCP communication protocol.
S106: and comparing and analyzing the first test text and the second test text and obtaining a test result.
In an alternative embodiment, the test results may include string similarity, such as cosine similarity, i.e., string similarity defined in a vector space model VSM, vectorized using a bag of words model and calculated using a cosine formula.
In alternative embodiments, the test result may include a ratio between the number of characters having differences and the total number of characters, a distribution of the characters having differences among the text segments, specific information of the characters having differences, and the like. Therefore, the performance of the phone for processing the audio, the call quality, the completion degree and the fluency of voice receiving and the like are evaluated, the comprehensiveness of the test is ensured, and the test purpose and effect are achieved.
In an alternative embodiment, after the test result is obtained, the test result may be sent to the phone to be tested. Therefore, the management of the tested phone and the test result is realized. In an optional embodiment, the test result can be sent to any server or terminal according to actual test requirements, so that the test result can be managed and backtracked conveniently, and the efficiency is improved.
In an alternative embodiment, the second test voice stream may be saved according to the test result. For example, if the string similarity is too low, the second test voice stream may be saved for easy viewing and analysis.
The system and the method can realize automatic testing of network voice communication, improve testing efficiency and reduce testing cost; the conversion and transmission of the voice and the characters are not interfered by external sound, the signal-to-noise ratio is higher, the signals are clear, the algorithm is simple, the cost is reduced, the testing efficiency and the accuracy are improved, and the testing result is more stable.
Example 2:
referring to the specification and fig. 2, there is shown a network voice communication automation test system provided by an embodiment of the present application, including,
the communication connection unit 11 establishes communication connection with the tested telephone;
the voice synthesis unit 12 is configured to obtain a first test text, and synthesize a first test voice stream according to the first test text;
the voice sending unit 13 is configured to send the first testing voice stream to the tested phone;
the voice receiving unit 14 is configured to obtain a second test voice stream received by the tested phone;
the voice recognition unit 15 recognizes the second test voice stream to generate a second test text;
the comparison and analysis unit 16 compares and analyzes the first test text and the second test text and obtains a test result.
In an alternative embodiment, the communication connection unit 11 may be a real phone terminal or a computer-simulated phone terminal.
In an alternative embodiment, the communication connection unit 11 establishes a communication connection with the phone to be tested through the SIP server.
In an alternative embodiment, the obtaining of the first test text and the synthesizing of the first test speech stream from the first test text in the speech synthesis unit 12 comprises,
a tester presets a test text case set;
randomly acquiring text fields in the test text case set to form a first test text;
cutting character segments in the first test text into sentences;
and synthesizing the sentences in sequence to obtain a first test voice stream.
In an alternative embodiment, the speech synthesis unit 12 may use a TTS service based on the MRCP communication protocol.
In an alternative embodiment, the voice sending unit 13 sends the first test voice stream to the tested phone set includes,
the voice sending unit 13 sends the first test voice stream to the SIP server;
and the SIP server forwards the first test voice stream to the tested telephone.
In an alternative embodiment, the first test voice stream is sent in the form of RTP packets.
In an alternative embodiment, the voice receiving unit 14 and the voice recognition unit 15 may be built-in structures of the phone under test. Therefore, the voice receiving unit 14 receives the second test voice stream and forwards the second test voice stream to the voice recognition unit 15 for voice recognition, the whole process is completed in the tested phone, interference is further reduced, the definition of signals is improved, and the test accuracy is further improved.
In an alternative embodiment, the speech recognition unit 15 may use an ASR service based on the MRCP communication protocol.
In an alternative embodiment, the test results may include string similarity, such as cosine similarity, i.e., string similarity defined in a vector space model VSM, vectorized using a bag of words model and calculated using a cosine formula.
In alternative embodiments, the test result may include a ratio between the number of characters having differences and the total number of characters, a distribution of the characters having differences among the text segments, specific information of the characters having differences, and the like. Therefore, the performance of the phone for processing the audio, the call quality, the completion degree and the fluency of voice receiving and the like are evaluated, the comprehensiveness of the test is ensured, and the test purpose and effect are achieved.
In an optional embodiment, the comparison and analysis unit feeds back the test result to the phone to be tested after obtaining the test result.
In an alternative embodiment, the second test voice stream may be saved according to the test result. For example, if the string similarity is too low, the second test voice stream may be saved for easy viewing and analysis.
The system and the method can realize automatic testing of network voice communication, improve testing efficiency and reduce testing cost; the conversion and transmission of the voice and the characters are not interfered by external sound, the signal-to-noise ratio is higher, the signals are clear, the algorithm is simple, the cost is reduced, the testing efficiency and the accuracy are improved, and the testing result is more stable.
It should be noted that, in the system provided in the foregoing embodiment, when the functions of the system are implemented, only the division of each functional unit is illustrated, and in practical applications, the functions may be distributed by different functional units according to needs, that is, the internal structure of the device is divided into different functional modules, so as to complete all or part of the functions described above. In addition, the system and method embodiments provided by the above embodiments belong to the same concept, and specific implementation processes thereof are described in the method embodiments for details, which are not described herein again.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, for embodiments of the system, the apparatus, and the storage medium, since they are substantially similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for relevant points.
It will be understood by those skilled in the art that all or part of the steps for implementing the above embodiments may be implemented by hardware, or may be implemented by a program instructing relevant hardware, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a magnetic disk or an optical disk, etc.
The present invention is not limited to the above preferred embodiments, and any modifications, equivalent replacements, improvements, etc. within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. The automatic testing method for network voice communication is characterized by comprising the following steps,
establishing communication connection with a tested telephone;
acquiring a first test text, and synthesizing a first test voice stream according to the first test text;
sending the first test voice stream to the tested telephone;
acquiring a second test voice stream received by the tested telephone;
recognizing the second test voice stream to generate a second test text;
and comparing and analyzing the first test text and the second test text and obtaining a test result.
2. The method for automated testing of voice over internet protocol communication of claim 1, wherein the establishing of the communication connection with the phone under test is performed by a SIP server.
3. The automated testing method for network voice communication according to claim 1, wherein the obtaining a first test text and synthesizing a first test voice stream according to the first test text comprises,
a tester presets a test text case set;
randomly acquiring character segments in the test character case set to form the first test text;
cutting character segments in the first test text into sentences;
and synthesizing in sequence according to the sequence of the sentences to obtain the first test voice stream.
4. The method according to claim 1, wherein the sending the first test voice stream to the handset under test comprises:
sending the first test voice stream to an SIP server;
and the SIP server forwards the first test voice stream to the tested telephone.
5. The method for automated testing of network voice communication according to claim 1, further comprising sending the test result to a phone under test.
6. The network voice communication automatic test system for executing the network voice communication automatic test method of any one of claims 1 to 5, characterized by comprising,
the communication connection unit is used for establishing communication connection with the tested telephone;
the voice synthesis unit is used for acquiring a first test text and synthesizing a first test voice stream according to the first test text;
the voice sending unit is used for sending the first testing voice stream to the tested telephone;
the voice receiving unit is used for acquiring a second test voice stream received by the tested telephone;
the voice recognition unit is used for recognizing the second test voice stream to generate a second test text;
and the comparison and analysis unit is used for comparing and analyzing the first test text and the second test text and acquiring a test result.
7. The system according to claim 6, wherein the communication connection unit establishes a communication connection with the phone under test through the SIP server.
8. The network voice communication automated test system of claim 6, wherein the voice synthesis unit obtaining a first test text and synthesizing a first test voice stream from the first test text comprises,
a tester presets a test text case set;
randomly acquiring character segments in the test character case set to form the first test text;
cutting character segments in the first test text into sentences;
and synthesizing in sequence according to the sequence of the sentences to obtain the first test voice stream.
9. The network voice communication automated test system of claim 6, wherein the voice sending unit sending the first test voice stream to the handset under test comprises,
the voice sending unit sends the first test voice stream to an SIP server;
and the SIP server forwards the first test voice stream to the tested telephone.
10. The system according to claim 6, wherein the comparative analysis unit feeds back the test result to the phone under test after obtaining the test result.
CN202011134233.2A 2020-10-21 2020-10-21 Network voice communication automatic test method and system Pending CN112261214A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011134233.2A CN112261214A (en) 2020-10-21 2020-10-21 Network voice communication automatic test method and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011134233.2A CN112261214A (en) 2020-10-21 2020-10-21 Network voice communication automatic test method and system

Publications (1)

Publication Number Publication Date
CN112261214A true CN112261214A (en) 2021-01-22

Family

ID=74263134

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011134233.2A Pending CN112261214A (en) 2020-10-21 2020-10-21 Network voice communication automatic test method and system

Country Status (1)

Country Link
CN (1) CN112261214A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113110997A (en) * 2021-04-23 2021-07-13 中国工商银行股份有限公司 Test method, device and equipment

Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08331228A (en) * 1995-05-31 1996-12-13 Nec Corp Telephone set for testing voice recognizing device
CN103345922A (en) * 2013-07-05 2013-10-09 张巍 Large-length voice full-automatic segmentation method
CN107516510A (en) * 2017-07-05 2017-12-26 百度在线网络技术(北京)有限公司 A kind of smart machine automated voice method of testing and device
CN107657947A (en) * 2017-09-20 2018-02-02 百度在线网络技术(北京)有限公司 Method of speech processing and its device based on artificial intelligence
CN108055416A (en) * 2017-12-30 2018-05-18 深圳市潮流网络技术有限公司 A kind of IVR automated testing methods of VoIP voices
CN108538296A (en) * 2017-03-01 2018-09-14 广东神马搜索科技有限公司 Speech recognition test method and test terminal
CN108564966A (en) * 2018-02-02 2018-09-21 安克创新科技股份有限公司 The method and its equipment of tone testing, the device with store function
CN109473121A (en) * 2018-12-05 2019-03-15 苏州思必驰信息科技有限公司 Speech synthesis quality detecting method and device
CN109660681A (en) * 2018-12-05 2019-04-19 福建星网智慧软件有限公司 A kind of automated testing method and system of IP-PBX voice broadcast
CN110399294A (en) * 2019-06-26 2019-11-01 平安科技(深圳)有限公司 Method for generating test case, device, computer equipment and storage medium
CN110415681A (en) * 2019-09-11 2019-11-05 北京声智科技有限公司 A kind of speech recognition effect testing method and system
CN110444227A (en) * 2019-08-30 2019-11-12 惠州市德赛西威汽车电子股份有限公司 A kind of voice automated testing method
CN111145737A (en) * 2018-11-06 2020-05-12 中移(杭州)信息技术有限公司 Voice test method and device and electronic equipment
AU2019268092A1 (en) * 2019-01-18 2020-08-06 Adobe Inc. Prototyping voice user interfaces for languages with non-phonetic alphabets
CN111798833A (en) * 2019-04-04 2020-10-20 北京京东尚科信息技术有限公司 Voice test method, device, equipment and storage medium

Patent Citations (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08331228A (en) * 1995-05-31 1996-12-13 Nec Corp Telephone set for testing voice recognizing device
CN103345922A (en) * 2013-07-05 2013-10-09 张巍 Large-length voice full-automatic segmentation method
CN108538296A (en) * 2017-03-01 2018-09-14 广东神马搜索科技有限公司 Speech recognition test method and test terminal
CN107516510A (en) * 2017-07-05 2017-12-26 百度在线网络技术(北京)有限公司 A kind of smart machine automated voice method of testing and device
CN107657947A (en) * 2017-09-20 2018-02-02 百度在线网络技术(北京)有限公司 Method of speech processing and its device based on artificial intelligence
CN108055416A (en) * 2017-12-30 2018-05-18 深圳市潮流网络技术有限公司 A kind of IVR automated testing methods of VoIP voices
CN108564966A (en) * 2018-02-02 2018-09-21 安克创新科技股份有限公司 The method and its equipment of tone testing, the device with store function
CN111145737A (en) * 2018-11-06 2020-05-12 中移(杭州)信息技术有限公司 Voice test method and device and electronic equipment
CN109473121A (en) * 2018-12-05 2019-03-15 苏州思必驰信息科技有限公司 Speech synthesis quality detecting method and device
CN109660681A (en) * 2018-12-05 2019-04-19 福建星网智慧软件有限公司 A kind of automated testing method and system of IP-PBX voice broadcast
AU2019268092A1 (en) * 2019-01-18 2020-08-06 Adobe Inc. Prototyping voice user interfaces for languages with non-phonetic alphabets
CN111798833A (en) * 2019-04-04 2020-10-20 北京京东尚科信息技术有限公司 Voice test method, device, equipment and storage medium
CN110399294A (en) * 2019-06-26 2019-11-01 平安科技(深圳)有限公司 Method for generating test case, device, computer equipment and storage medium
CN110444227A (en) * 2019-08-30 2019-11-12 惠州市德赛西威汽车电子股份有限公司 A kind of voice automated testing method
CN110415681A (en) * 2019-09-11 2019-11-05 北京声智科技有限公司 A kind of speech recognition effect testing method and system

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113110997A (en) * 2021-04-23 2021-07-13 中国工商银行股份有限公司 Test method, device and equipment

Similar Documents

Publication Publication Date Title
CN105100521A (en) Method and server for realizing ordered speech in teleconference
CN105119877B (en) Speech verification method, apparatus and system
CN102244592B (en) Network service quality testing system, method, testing center and testing terminal
US7653547B2 (en) Method for testing a speech server
CN102497481A (en) Method, device and system for voice dialing
US9813536B2 (en) System for testing wireless interaction between a system for reproducing audio signals and a mobile phone, and corresponding method and computer program product
US20140329511A1 (en) Audio conferencing
CN109842712A (en) Method, apparatus, computer equipment and the storage medium that message registration generates
WO2019207379A1 (en) System and method for providing a response to a user query using a visual assistant
CN101202040A (en) An efficient voice activity detactor to detect fixed power signals
CN103841276A (en) Method for evaluating speech quality based on smart phone platform
CN106157975A (en) A kind of determine the system of voice quality, method and device
CN1240098A (en) Communications system and method for testing of communications apparatus
CN110784591A (en) Intelligent voice automatic detection method, device and system
CN103379662B (en) The method of network insertion, interface equipment and mobile internet surfing equipment
CN1135027C (en) Communications system and method for testing of communications apparatus
CN112261214A (en) Network voice communication automatic test method and system
CN102484762A (en) Auditory display device and method
CN108234778B (en) Method and device for generating digital graph rule
CN110708418B (en) Method and device for identifying attributes of calling party
US20190082279A1 (en) Testing of vehicle system module using audio recognition
CN104078049B (en) Signal processing apparatus and signal processing method
CN108091349B (en) Voice quality detection system and method and PESQ control terminal
CN115426434B (en) Data processing method, device and storage medium
TWI519123B (en) Method of processing telephone voice output, software product processing telephone voice, and electronic device with phone function

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20210122

RJ01 Rejection of invention patent application after publication