CN115422052A

CN115422052A - Vehicle navigation app test system and method

Info

Publication number: CN115422052A
Application number: CN202211046202.0A
Authority: CN
Inventors: 姚程程; 刘权; 龚祖贺; 刘奋
Original assignee: Heading Data Intelligence Co Ltd
Current assignee: Heading Data Intelligence Co Ltd
Priority date: 2022-08-29
Filing date: 2022-08-29
Publication date: 2022-12-02

Abstract

The invention relates to a system and a method for testing vehicle navigation app, wherein the system comprises the following components: the device layer is used for interacting with the target vehicle-mounted navigation app, monitoring and inspecting an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and executing a test case issued by the test layer; the test layer is used for generating and managing a test case based on the environmental parameters configured by the user layer, issuing the test case to the equipment layer, receiving the test result of the equipment layer and generating a test report according to the test result; and the user layer is used for configuring one or more environmental parameters of one or more environments required by the operation of the test layer. According to the invention, by building an automatic test framework and applying a debugging interface and a visual recognition technology, the automatic test, execution, data recovery and test report generation of the vehicle navigation app are realized, and the test efficiency and integrity of the vehicle navigation app are improved.

Description

Vehicle navigation app test system and method

Technical Field

The invention belongs to the technical field of application testing of mobile terminals, and particularly relates to a system and a method for testing vehicle-mounted navigation app.

Background

Along with the faster and faster economic development of China, the intelligent life is closer to the people, and the intelligent vehicle-mounted navigation app can enable a user to obtain the driving condition of an automobile at any time, so that the intelligent vehicle-mounted navigation app has human-vehicle interaction and intelligent navigation functions. With the more and more abundant functions of the vehicle navigation app, the test difficulty brought by the vehicle navigation app is increased day by day. In a conventional test scheme, an assistant test app is developed through an aid Definition Language (AIDL) to perform data interaction on a navigation application app. The json data are artificially constructed and sent through the assistant app during each test, scene feedback of the navigation app is observed by naked eyes, the app execution log is captured and analyzed, manpower is consumed, repeatability is high, test time is too long, and manual test is particularly laborious.

The current navigation app test can only determine the test result by observing the phenomenon with naked eyes or capturing log keywords, and it consumes manpower. The existing vehicle navigation app has numerous functions, the brought communication protocol is more and more complex, in order to meet the full coverage of a scene, usually thousands of test cases exist, and manual execution is difficult to meet the full coverage of the scene. In the using process of the vehicle-mounted navigation app, a large amount of log information is generated, and manual key information screening is too complicated.

Disclosure of Invention

In order to solve the problem of the efficiency of the automated test of the vehicle navigation app, a first aspect of the present invention provides a test system of the vehicle navigation app, including: the device layer is used for interacting with the target vehicle-mounted navigation app, monitoring and inspecting an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and executing a test case issued by the test layer; the test layer is used for generating and managing a test case based on the environmental parameters configured by the user layer, issuing the test case to the equipment layer, receiving the test result of the equipment layer and generating a test report according to the test result; and the user layer is used for configuring one or more environmental parameters of one or more environments required by the operation of the test layer.

In some embodiments of the invention, the device layer comprises: the device interaction layer is used for monitoring and viewing an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and transmitting a test case to the device execution layer; and the equipment execution layer is used for interacting with the target vehicle navigation app, executing the test case issued by the test layer, recording the test result and transmitting the test result to the equipment interaction layer.

Further, the device interaction layer implements operations on the standard vehicle-mounted navigation app through the poco library.

In some embodiments of the invention, the test layer comprises: the test application layer is used for generating and managing a test case based on the environmental parameters configured by the user layer; and the test framework layer is used for issuing a test case to the equipment layer, receiving a test result of the equipment layer and analyzing and verifying the test result.

Further, the receiving, analyzing and verifying the test result of the device layer includes: receiving a test result of the equipment layer; and analyzing and verifying the test result through keyword analysis, test data injection, assertion result or failure retry.

In the above embodiment, the user layer includes: the user execution layer is used for configuring one or more environmental parameters of one or more environments required by the running of the test layer; and the environment management layer is used for constructing one or more environments required by the test layer according to the environment parameters.

In a second aspect of the present invention, a method for testing a vehicle navigation app is provided, including: configuring environmental parameters of one or more environments required for the running of the test; generating and managing test cases based on the environment parameters, issuing one or more test cases to the target vehicle navigation app, controlling the target vehicle navigation app and executing the test cases; and monitoring and viewing the interactive page of the target vehicle navigation app, and recording and uploading the test result and the test log.

Further, the monitoring and viewing of the interaction page of the target vehicle navigation app, and the recording and uploading of the test result and the test log include: and identifying and monitoring an interactive page of the target vehicle-mounted navigation app, capturing an abnormal scene through a modulation interface of the target vehicle-mounted navigation app, and recording and uploading a test result and a test log.

In a third aspect of the present invention, there is provided an electronic device comprising: one or more processors; the storage device is used for storing one or more programs, and when the one or more programs are executed by the one or more processors, the one or more processors implement the test method of the vehicle-mounted navigation app provided by the invention in the second aspect.

In a fourth aspect of the present invention, a computer-readable medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the testing method of the in-vehicle navigation app provided in the second aspect of the present invention.

The beneficial effects of the invention are:

the invention solves the problems that people need to participate and judge the test result at any time in the previous test process, and the test efficiency is greatly improved because no people execute at night. Realizing automatic testing, controlling the vehicle navigation app to automatically execute to a scene to be tested, sending data to be tested, verifying a test result, and backfilling the test result into a test report; the test task is really transmitted by one key and is automatically executed. Test data are forwarded through the server, accurate issuing is achieved, and test results are accurately recovered. The method simplifies the way of manually reading the log.

Drawings

FIG. 1 is a schematic diagram of a basic architecture of a test system for an in-vehicle navigation app in some embodiments of the invention;

FIG. 2 is a schematic diagram of a specific structure of a test system of the in-vehicle navigation app in some embodiments of the invention;

FIG. 3 is a schematic diagram of one implementation of a test system for an in-vehicle navigation app in some embodiments of the invention;

FIG. 4 is a detailed flowchart of a method for testing the in-vehicle navigation app according to some embodiments of the invention;

FIG. 5 is a basic flow diagram illustrating a method for testing an in-vehicle navigation app according to some embodiments of the invention;

fig. 6 is a schematic structural diagram of an electronic device in some embodiments of the invention.

Detailed Description

The principles and features of this invention are described below in conjunction with the following drawings, which are set forth by way of illustration only and are not intended to limit the scope of the invention.

Referring to fig. 1, in a first aspect of the present invention, there is provided a test system 1 of a vehicle navigation app, comprising: the device layer 11 is used for interacting with the target vehicle-mounted navigation app, monitoring and inspecting an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and executing a test case issued by the test layer; the test layer 12 is used for generating and managing a test case based on the environmental parameters configured by the user layer, issuing the test case to the equipment layer, receiving the test result of the equipment layer and generating a test report according to the test result; and the user layer 13 is used for configuring one or more environmental parameters of the environment required by the operation of the test layer.

It can be understood that the car navigation app is not limited to the terminal operating system, i.e. the above method is applicable to IOS series, android (android) series, windows mobile, blackBerry OS, ubuntu, etc. Interactive pages generally refer to pages that are exposed by the APP during runtime, which include dynamic pages or static pages that accompany a user operation or a simulation operation, and a series of changes after the user operation or the simulation operation is performed. The log usually records normal data and abnormal data during the operation of the navigation app, that is, when the vehicle navigation app performs a test, a part of test results are recorded in the log.

Referring to fig. 2, in some embodiments of the invention, the device layer 11 comprises: the device interaction layer is used for monitoring and viewing an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and transmitting a test case to the device execution layer; and the equipment execution layer is used for interacting with the target vehicle-mounted navigation app, executing the test case issued by the test layer, recording the test result and transmitting the test result to the equipment interaction layer.

Specifically, a poco library is called through a python language to detect a UI control of the vehicle-mounted APP, and normal operations such as clicking, sliding, zooming and the like of the APP are achieved. And image recognition matching is carried out on the vehicle-mounted app by combining an opencv vision technology, and scene elements can be accurately perceived in a complex scene. It is understood that the poco library and opencv library are both function libraries or module libraries with multiple functions that can be executed or compiled across platforms, and therefore, the above embodiment is not limited to python language, and other languages (e.g., C, C + +) can be used to implement the above equivalent operations.

Referring to fig. 2, in some embodiments of the invention, the test layer 12 comprises: the test application layer is used for generating and managing a test case based on the environmental parameters configured by the user layer; and the test framework layer is used for issuing a test case to the equipment layer, receiving a test result of the equipment layer and analyzing and verifying the test result.

Specifically, the json-format test data is sent to the server side through the http request, and the server side sends the test data to the app to be tested, so that the test data is accurately issued. The real-time information of the navigation equipment to be tested can also be transmitted back to the server, the server sends the real-time information to the PC upper computer, data analysis is carried out by using python, and a test case test result is judged. When an abnormal scene occurs and the test case fails, the vehicle navigation app screenshot can be uploaded to a pc upper computer, and scene and log information are stored. The test case is counted by using the conventional excel, and the test result can be simultaneously backfilled with the excel.

Referring to fig. 2, in the above embodiment, the user layer 13 includes: the user execution layer is used for configuring one or more environmental parameters of one or more environments required by the running of the test layer; and the environment management layer is used for constructing one or more environments required by the test layer according to the environment parameters.

Specifically, a test framework is constructed by utilizing python, and a flash deployment server is used as server data transfer. Adb (Android Debug Bridge) is used as a communication Bridge for operatively connecting the Android device and the PC. Accordingly, for the IOS based navigation app, relevant testing tools (e.g., XC TEST, KIF, etc.) are utilized to enable manipulation of the target navigation app. In particular, each of the device layer, the test layer and the user layer is provided with a log management module, which is used for recording, managing, transmitting and the like logs.

Referring to fig. 3, the device layer, the test layer, and the user layer are merely logical abstractions of the test system in the present disclosure. Fig. 3 only shows that a PC (upper computer) is used as a carrier of an equipment layer, a test layer and a user layer at the same time, and a server is used as data transfer between the upper computer and a navigation APP, and does not participate in functions such as specific test case issuing, test data execution and the like; however, based on the above hardware virtualization, those skilled in the art realize the same test function as the upper computer by using the connection between the server and the navigation APP. Thus, the device layer, the test layer, and the user layer may be actually implemented by the server and/or the local PC. The upper computer is generally a digital device with a computing or communication function, such as a PC, a smart phone, a tablet computer, and the like. The test layer and the user layer can be realized by a local upper computer or a remote server.

Example 2

Referring to fig. 5, in a second aspect of the present invention, there is provided a method for testing an in-vehicle navigation app, including: configuring environmental parameters of one or more environments required for the running of the test; generating and managing test cases based on the environment parameters, issuing one or more test cases to the target vehicle navigation app, controlling the target vehicle navigation app and executing the test cases; and monitoring and viewing the interactive page of the target vehicle navigation app, and recording and uploading the test result and the test log.

Referring to fig. 4, in some embodiments of the present invention, the method for testing the in-vehicle navigation app specifically includes the following steps:

step 1: starting execution, then initializing the environment, and connecting the adb with a test vehicle central control (app);

step 2: collecting test cases and starting to execute the test cases;

and step 3: controlling the vehicle-mounted navigation app to reach a tested scene or meet a test condition, and sending test data (a specific test case or a test scene) to the test app by a pc (upper computer);

and 4, step 4: detecting a scene of the detected app, and analyzing day information returned by the detected app;

and 5: judging whether the use case passes: if yes, executing step 6; if not, returning abnormal information to the PC and then executing the step 6;

step 6: backfilling a test result, and judging whether all test cases are executed: if yes, ending the test; if not, returning to the step 2.

Example 3

Referring to fig. 6, in a third aspect of the present invention, there is provided an electronic apparatus comprising: one or more processors; storage means for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to carry out the method of the invention in the second aspect.

Electronic device 500 may include a processing means (e.g., central processing unit, graphics processor, etc.) 501 that may perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM) 502 or a program loaded from a storage means 508 into a Random Access Memory (RAM) 503. In the RAM503, various programs and data necessary for the operation of the electronic apparatus 500 are also stored. The processing device 501, the ROM502, and the RAM503 are connected to each other through a bus 504. An input/output (I/O) interface 505 is also connected to bus 504.

The following devices may be connected to the I/O interface 505 in general: input devices 506 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; output devices 507 including, for example, a Liquid Crystal Display (LCD), speakers, vibrators, and the like; a storage device 508 including, for example, a hard disk; and a communication device 509. The communication means 509 may allow the electronic device 500 to communicate with other devices wirelessly or by wire to exchange data. While fig. 6 illustrates an electronic device 500 having various means, it is to be understood that not all illustrated means are required to be implemented or provided. More or fewer devices may alternatively be implemented or provided. Each block shown in fig. 6 may represent one device or may represent multiple devices as desired.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication means 509, or installed from the storage means 508, or installed from the ROM 502. The computer program, when executed by the processing device 501, performs the above-described functions defined in the methods of embodiments of the present disclosure. It should be noted that the computer readable medium described in the embodiments of the present disclosure may be a computer readable signal medium or a computer readable storage medium or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In embodiments of the disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In embodiments of the present disclosure, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: electrical wires, optical cables, RF (radio frequency), etc., or any suitable combination of the foregoing.

The computer readable medium may be embodied in the electronic device; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more computer programs which, when executed by the electronic device, cause the electronic device to:

computer program code for carrying out operations for embodiments of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C + +, python, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).

The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.

Claims

1. A test system for an in-vehicle navigation app, comprising:

the device layer is used for interacting with the target vehicle-mounted navigation app, monitoring and inspecting an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and executing a test case issued by the test layer;

the test layer is used for generating and managing a test case based on the environmental parameters configured by the user layer, issuing the test case to the equipment layer, receiving the test result of the equipment layer and generating a test report according to the test result;

and the user layer is used for configuring one or more environmental parameters of one or more environments required by the operation of the test layer.

2. The system for testing the in-vehicle navigation app as recited in claim 1, wherein the device layer includes:

the device interaction layer is used for monitoring and viewing an interaction page of the target vehicle-mounted navigation app, transmitting a test result and a log to the test layer, and transmitting a test case to the device execution layer;

and the equipment execution layer is used for interacting with the target vehicle-mounted navigation app, executing the test case issued by the test layer, recording the test result and transmitting the test result to the equipment interaction layer.

3. The system for testing the in-vehicle navigation app as recited in claim 2, wherein the device interaction layer enables the operation of the standard in-vehicle navigation app via a poco library.

4. The system for testing the in-vehicle navigation app as recited in claim 1, wherein the test layer comprises:

the test application layer is used for generating and managing a test case based on the environmental parameters configured by the user layer;

and the test framework layer is used for issuing a test case to the equipment layer, receiving a test result of the equipment layer and analyzing and verifying the test result.

5. The system for testing the in-vehicle navigation app according to claim 4, wherein the receiving, parsing and verifying the test result of the device layer comprises:

receiving a test result of the equipment layer;

and analyzing and verifying the test result through keyword analysis, test data injection, assertion result or failure retry.

6. The system for testing the in-vehicle navigation app according to any one of claims 1 to 5, wherein the user layer comprises:

the user execution layer is used for configuring one or more environmental parameters of one or more environments required by the running of the test layer;

and the environment management layer is used for constructing one or more environments required by the test layer according to the environment parameters.

7. A test method of an in-vehicle navigation app is characterized by comprising the following steps:

configuring environmental parameters of one or more environments required for the running of the test;

generating and managing test cases based on the environment parameters, issuing one or more test cases to the target vehicle navigation app, controlling the target vehicle navigation app and executing the test cases;

and monitoring and viewing the interactive page of the target vehicle navigation app, and recording and uploading the test result and the test log.

8. The method for testing the vehicle navigation app as claimed in claim 7, comprising the steps of monitoring and viewing the interaction page of the target vehicle navigation app, and recording and uploading the test result and the test log, wherein the steps of:

and identifying and monitoring an interactive page of the target vehicle-mounted navigation app, capturing an abnormal scene through a modulation interface of the target vehicle-mounted navigation app, and recording and uploading a test result and a test log.

9. An electronic device, comprising: one or more processors; a storage device to store one or more programs that, when executed by the one or more processors, cause the one or more processors to implement a method of testing the in-vehicle navigation app of any of claims 7 or 8.

10. A computer-readable medium, on which a computer program is stored, wherein the computer program, when executed by a processor, implements a method of testing the in-vehicle navigation app of any of claims 7 or 8.