CN115470153B - Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system - Google Patents
Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system Download PDFInfo
- Publication number
- CN115470153B CN115470153B CN202211418118.7A CN202211418118A CN115470153B CN 115470153 B CN115470153 B CN 115470153B CN 202211418118 A CN202211418118 A CN 202211418118A CN 115470153 B CN115470153 B CN 115470153B
- Authority
- CN
- China
- Prior art keywords
- intelligent terminal
- point
- test
- evaluating
- fluency
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/30—Monitoring
- G06F11/34—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
- G06F11/3409—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
- G06F11/3419—Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment by assessing time
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The application provides a stability fluency evaluating method, a stability fluency evaluating system and stability fluency evaluating equipment for a UI of an intelligent terminal system, and relates to the technical field of computers. The method can obtain a pre-constructed test case; operating a target intelligent terminal of a system UI to be evaluated by using a test case, and acquiring operation process data; measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the data of the operation process; and evaluating the stability and smoothness of the UI of the target intelligent terminal system based on the measured performance indexes. The method and the device for evaluating the stability and smoothness of the UI of the target intelligent terminal system can evaluate the stability and smoothness of the UI of the target intelligent terminal system by using the performance indexes obtained by the test case test, and can truly evaluate the stability and smoothness of the UI of the intelligent terminal system through objective data test.
Description
Technical Field
The application relates to the technical field of computers, in particular to a method, a system and equipment for evaluating the stability fluency of a UI (user interface) of an intelligent terminal system.
Background
The User Interface (UI) of the intelligent terminal system refers to human-computer interaction, operation logic, attractive Interface and the like in the overall software and hardware system level of the terminal, such as a smart phone, a smart tablet computer, a smart handheld device and the like. Taking a smart phone as an example, a good smart phone System UI can bring good experience to users, the smart phone System UIs most contacted in the market at present include hua shi hong meng OS (Operating System), MIUI of millet, color OS of OPPO, origin OS of vivo, glorious Magic UI and the like, and various mobile phone manufacturers capture a lot of users by virtue of excellent mobile phone systems and become fabs that defeat mobile phone development, particularly iOS System of apple and hua hong meng OS System, which have gradually become wind signs in the development direction of mobile phone systems.
Therefore, the stable fluency of the smart terminal system UI, including the smart phone system UI, the smart tablet system UI, the smart handheld device system UI and the like, becomes a central importance of the development of each smart terminal system UI, for example, the smart terminal system is stuck (e.g., APP operation response is stuck, user operation response is slow, process performance is poor and the like), and has a great influence on the daily use of the smart terminal by the user.
Currently, most of evaluation mechanisms only evaluate the UI of the intelligent terminal system in terms of system functions (such as card service, split screen application, multi-screen linkage, individual interaction and the like) and the attractiveness of the UI interface of the system, and quickly and slowly respond to the operation of the UI of the system, and judge whether the UI of the system is stable and smooth only through subjective feeling. The evaluation test is not rigorous and accurate enough, and the UI stability and smoothness of the intelligent terminal system cannot be truly reflected. Therefore, there is a need to solve this technical problem.
Disclosure of Invention
In view of the above problems, the present application is proposed to provide a method, system and device for evaluating stability and smoothness of a UI of an intelligent terminal system that overcomes or at least partially solves the above problems. The technical scheme is as follows:
in a first aspect, a method for evaluating the stability and smoothness of a UI of an intelligent terminal system is provided, which includes:
acquiring a pre-constructed test case;
operating a target intelligent terminal of a system UI to be evaluated by using the test case, and collecting operation process data;
measuring a performance index for evaluating the stability and smoothness of the UI of the intelligent terminal system according to the operation process data;
and evaluating the stability and smoothness of the UI of the target intelligent terminal system based on the measured performance index.
In a possible implementation manner, operating a target intelligent terminal of a system UI to be evaluated by using the test case, and acquiring operation process data includes:
and executing the test case on a target intelligent terminal of the UI of the system to be evaluated, operating the target intelligent terminal by using a manipulator, and acquiring operation process data by using a high frame rate industrial camera and a touch sensor.
In a possible implementation manner, the executing the test case on a target intelligent terminal of a system UI to be evaluated, operating the target intelligent terminal by using a manipulator, and acquiring operation process data by using a high frame rate industrial camera and a touch sensor includes:
determining a test application used for testing on a target intelligent terminal of the UI of the system to be evaluated according to the test case;
determining a static reference point and a static reference area of the test application according to the test application;
executing the test case on the target intelligent terminal, and operating the test application by using a manipulator;
acquiring a time point when the manipulator leaves the screen interface of the target intelligent terminal after operating the test application by using a touch sensor, and recording the time point as a starting point;
capturing and tracking an image of the change of the screen interface of the target intelligent terminal when the manipulator operates the test application by using a high frame rate industrial camera;
and taking the images of the starting point and the target intelligent terminal screen interface change as collected operation process data.
In a possible implementation manner, measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the operation process data includes:
determining a time point of an image of the test application, which extends to the static reference point, opened on the page according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a first end point;
determining a time point at which a page of the test application is completely opened and extends to the image which is paved on the static reference area according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a second end point;
calculating the response time delay of the test application according to the starting point and the first ending point;
calculating the completion time delay of the test application according to the starting point and the second ending point;
and taking the response time delay and the completion time delay as performance indexes for evaluating the stable fluency of the UI of the intelligent terminal system.
In one possible implementation manner, the test case is executed on the target intelligent terminal for multiple times in a circulating manner, and the test application is operated by using the manipulator for multiple times in a circulating manner; the starting point, the first ending point and the second ending point are all multiple, and the response delay and the completion delay are multiple; the method further comprises the following steps:
calculating the average value and/or standard deviation of a plurality of response time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system;
and calculating the average value and/or standard deviation of the plurality of finishing time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system.
In a second aspect, a stable fluency evaluating system for a UI of an intelligent terminal system is provided, which includes:
the acquisition module is used for acquiring a pre-constructed test case;
the test module is used for operating a target intelligent terminal of the UI of the system to be evaluated by utilizing the test case and acquiring operation process data;
the measuring module is used for measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the operation process data;
and the evaluation module is used for evaluating the stable smoothness of the UI of the target intelligent terminal system based on the measured performance index.
In one possible implementation, the test module is further configured to:
executing the test case on a target intelligent terminal of a system UI to be evaluated, operating the target intelligent terminal by using a manipulator, and acquiring operation process data by using a high frame rate industrial camera and a touch sensor.
In one possible implementation, the test module is further configured to:
determining a test application used for testing on a target intelligent terminal of the UI of the system to be evaluated according to the test case;
determining a static reference point and a static reference area of the test application according to the test application;
executing the test case on the target intelligent terminal, and operating the test application by using a manipulator;
acquiring a time point when the manipulator leaves the screen interface of the target intelligent terminal after operating the test application by using a touch sensor, and recording the time point as a starting point;
capturing and tracking an image of the change of the screen interface of the target intelligent terminal when the manipulator operates the test application by using a high frame rate industrial camera;
and taking the images of the starting point and the target intelligent terminal screen interface change as collected operation process data.
In one possible implementation, the measurement module is further configured to:
determining a time point of an image of the test application, which extends to the static reference point, opened on the page according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a first end point;
determining a time point at which a page of the test application is completely opened and extends to the image which is paved on the static reference area according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a second end point;
calculating the response time delay of the test application according to the starting point and the first ending point;
calculating the completion time delay of the test application according to the starting point and the second ending point;
and taking the response time delay and the completion time delay as performance indexes for evaluating the stable fluency of the UI of the intelligent terminal system.
In a third aspect, an electronic device is provided, and the electronic device includes a processor and a memory, where the memory stores a computer program, and the processor is configured to run the computer program to execute the method for evaluating stable fluency of an intelligent terminal system UI according to any of the foregoing methods.
By means of the technical scheme, the method, the system and the equipment for evaluating the stability and the fluency of the UI of the intelligent terminal system can obtain a pre-constructed test case; operating a target intelligent terminal of a system UI to be evaluated by using the test case, and collecting operation process data; measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the data of the operation process; and evaluating the stability and smoothness of the UI of the target intelligent terminal system based on the measured performance indexes. The method and the device for evaluating the stability and smoothness of the UI of the target intelligent terminal system can evaluate the stability and smoothness of the UI of the target intelligent terminal system by using the performance indexes obtained by the test case test, and can truly evaluate the stability and smoothness of the UI of the intelligent terminal system through objective data test.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings used in the description of the embodiments of the present application will be briefly described below.
Fig. 1 is a flowchart of a method for evaluating stability and smoothness of a UI of an intelligent terminal system according to an embodiment of the present disclosure;
FIG. 2 is a schematic diagram of static reference points of a test application provided by an embodiment of the present application;
FIG. 3 is a schematic diagram of a static reference area of a test application provided by an embodiment of the present application;
fig. 4 is a structural diagram of a stable fluency evaluation system of an intelligent terminal system UI according to an embodiment of the present application.
Detailed Description
Exemplary embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
It should be noted that the terms "first," "second," and the like in the description and claims of this application and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that such uses are interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the term "include" and its variants are to be read as open-ended terms meaning "including, but not limited to".
As introduced in the foregoing, at present, the operation response to the UI of the system is fast and slow, whether the system is stable and smooth is judged only through subjective feeling, and the evaluation test is not rigorous and accurate enough and cannot truly reflect the stable and smooth degree of the UI of the intelligent terminal system. In order to solve the technical problem, an embodiment of the present application provides a method for evaluating stability fluency of a UI of an intelligent terminal system, and as shown in fig. 1, the method for evaluating stability fluency of a UI of an intelligent terminal system may include the following steps S101 and S104:
and step S101, acquiring a pre-constructed test case.
In this step, the pre-constructed test case may include an application frequently used by the user and some scenarios (e.g., applications in scenarios such as social contact, news consultation, video, map, and music), which is not limited in this embodiment of the present application.
And S102, operating the target intelligent terminal of the UI of the system to be evaluated by using the test case, and collecting operation process data.
In this step, the target intelligent terminal of the UI of the system to be evaluated is operated, which may be the operation of clicking, sliding, long-pressing, dragging, pressing, shaking, and the like, and this is not limited in this embodiment of the present application.
And S103, measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the operation process data.
And step S104, evaluating the stability and smoothness of the UI of the target intelligent terminal system based on the measured performance indexes.
According to the method and the device, the performance index obtained by testing the test case can be utilized to evaluate the stable smoothness of the UI of the target intelligent terminal system, and the stable smoothness of the UI of the intelligent terminal system can be truly evaluated through objective data testing.
In the embodiment of the present application, a possible implementation manner is provided, where in the step S102, the target intelligent terminal of the UI to be evaluated is operated by using the test case, and operation process data is collected, and the method specifically includes the following steps A1:
a1, executing a test case on a target intelligent terminal of a system UI to be evaluated, operating the target intelligent terminal by using a manipulator, and acquiring operation process data by using a high frame rate industrial camera and a touch sensor.
According to the embodiment, the manipulator, the high-frame-rate industrial camera and the touch sensor are cooperatively operated to acquire the data of the operation process, a user does not need to manually operate the target intelligent terminal, and the testing efficiency and accuracy are improved.
The embodiment of the present application provides a possible implementation manner, where in the above step A1, a test case is executed on a target intelligent terminal of a to-be-evaluated system UI, a manipulator is used to operate the target intelligent terminal, and a high frame rate industrial camera and a touch sensor are used to collect operation process data, and the method specifically includes the following steps a11 to a16:
and A11, determining test application used for testing on a target intelligent terminal of the UI of the system to be evaluated according to the test case.
As described in step S101, the pre-constructed test case may include applications frequently used by the user, and the applications may relate to scenes such as social class, news consultation class, video class, map class, music class, and the like. Therefore, the test application used for testing on the target intelligent terminal of the UI of the system to be evaluated can be determined according to the test case, the test application can be an application program frequently used by a user, and can relate to scenes such as social contact scenes, news consultation scenes, video scenes, map scenes, music scenes and the like.
And A12, determining a static reference point and a static reference area of the test application according to the test application.
In this step, a static reference point and a static reference area of the test application may be specifically determined on the target intelligent terminal, for example, the application closest to the right side of the test application is used as the static reference point, and the content effective area in the screen of the target intelligent terminal is set as the static reference area.
And step A13, executing the test case on the target intelligent terminal, and operating the test application by using the manipulator.
In this step, the manipulator is used to operate the test application, and the manipulator may be used to click, slide, long press, drag, press a key, shake, and the like on the test application, which is not limited in this embodiment of the present application.
And A14, acquiring a time point when the manipulator leaves the screen interface of the target intelligent terminal after operating the test application by using the touch sensor, and recording the time point as a starting point.
And A15, capturing and tracking an image of the change of the screen interface of the target intelligent terminal when the manipulator operates the test application by using the high-frame-rate industrial camera.
And step A16, using the images of the starting point and the target intelligent terminal screen interface change as the collected operation process data.
The embodiment can utilize the cooperative work of the manipulator, the high frame rate industrial camera and the touch sensor to collect, and the operation process data for operating the test application for testing on the target intelligent terminal is acquired without manually operating the target intelligent terminal by a user, so that the testing efficiency and accuracy are improved.
After the steps a11 to a16 are executed, the step S103 measures a performance index for evaluating the stable smoothness of the UI of the intelligent terminal system according to the operation process data, and specifically includes the following steps B1 to B5:
and step B1, according to the image of the change of the screen interface of the target intelligent terminal, determining a time point of the image of the test application extending to the static reference point, and recording the time point as a first end point.
And step B2, according to the image of the change of the screen interface of the target intelligent terminal, determining a time point at which the page of the test application is completely opened and extends to the image of the fully paved static reference area, and recording the time point as a second end point.
And step B3, calculating the response time delay of the test application according to the starting point and the first ending point.
In this step, the response delay may be a time from when the manipulator issues an operation instruction to the screen interface to when the system obtains information and feeds the information back to the screen through the interface when the intelligent terminal is operated. Since the first end point is a point of time at which the page of the test application opens the image extending to the static reference point, a time difference between the start point and the first end point may be taken as the response time delay.
And B4, calculating the completion time delay of the test application according to the starting point and the second ending point.
In this step, the time delay may be a time taken from when the manipulator issues an operation instruction to the screen interface to when the interface is loaded and reaches a readable stable static state when the intelligent terminal is operated. Since the second end point is a time point at which the page of the test application is fully opened and extends to the image that is fully laid out in the static reference area, the time difference between the start point and the second end point can be used as the completion delay.
And step B5, taking the response delay and the completion delay as performance indexes for evaluating the stable fluency of the UI of the intelligent terminal system.
The response delay and the completion delay are used as performance indexes for evaluating the stable smoothness of the UI of the intelligent terminal system, and the stable smoothness of the UI of the intelligent terminal system can be truly evaluated through objective data testing.
In the embodiment of the present application, a possible implementation manner is provided, in which step a13 executes the test case on the target intelligent terminal, and the manipulator is used to operate the test application, specifically, the test case may be executed on the target intelligent terminal repeatedly, and the manipulator is used to operate the test application repeatedly. For example, there are 20 test cases, and each test case executes the test 50 times in a loop, and the examples are only illustrative and do not limit the application.
Thus, the starting point, the first ending point and the second ending point are paired, the starting point, the first ending point and the second ending point all include a plurality of points, the response delay and the completion delay may include a plurality of points, and this embodiment may further include the following steps C1 and C2:
step C1, calculating the average value and/or standard deviation of a plurality of response time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system;
and step C2, calculating the average value and/or standard deviation of a plurality of finished time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system.
For example, multiple levels of fluency can be set, and each level corresponds to a corresponding response delay and completion delay, so that the level of the fluency of the target intelligent terminal system UI can be determined according to the average value of the calculated response delay and completion delay. In addition, a plurality of stable intervals can be set, and each interval corresponds to the standard deviation of the corresponding response delay and the standard deviation of the completion delay, so that the interval where the stability of the target intelligent terminal system UI is located can be determined according to the calculated standard deviation of the response delay and the standard deviation of the completion delay. It should be noted that the examples are merely illustrative and do not limit the embodiments of the present application.
According to the embodiment, the response time delay, the finishing time delay average value, the standard deviation or the fluctuation rate and the like of each intelligent terminal system UI can be obtained. The smaller the average value of the response delay and the completion delay is, the higher the fluency of the UI of the intelligent terminal system is represented; the smaller the standard deviation or fluctuation rate is, the better the stability of the UI of the intelligent terminal system is in the process of user operation. And evaluating the stable smoothness capability of the UI of the intelligent terminal system according to the performance indexes.
In the above, various implementation manners of each link of the embodiment shown in fig. 1 are introduced, and the method for evaluating the stability and the smoothness of the UI of the intelligent terminal system provided in the embodiment of the present application is further described through a specific embodiment.
In a specific embodiment, taking an intelligent terminal as an example of an intelligent mobile phone, a system for evaluating the stability and smoothness of a system UI of the intelligent mobile phone is provided, and the system for evaluating the stability and smoothness of the system UI of the intelligent mobile phone covers a set of test cases executed on intelligent equipment based on android, iOS and Hongmon system UI. The evaluation system operates the terminal smart phone device in a mechanical mode (including clicking, sliding, long pressing, dragging, pressing and other operation methods, and completely simulating manual operation), test cases comprise application programs frequently used by users and some scenes (such as social application, news consultation application, video application, map application, music application and other scenes), then an ultrahigh frame rate industrial camera is used for tracking and analyzing an operation process, and further UI performance indexes of a mobile phone system under each application scene are accurately measured.
Firstly, the system for evaluating the UI stability fluency of the smart phone system provided by the embodiment of the application comprises response time delay of starting the mobile phone application program and completion time delay of complete expansion of the mobile phone application program, and after 50 tests of each test case, the response time delay, the completion time delay average value, the standard deviation and the fluctuation rate of the UI of each model system can be obtained. The smaller the average value of the response delay and the completion delay is, the higher the fluency of the UI of the mobile phone system is represented; the smaller the standard deviation and the fluctuation rate are, the better the stability of the UI of the mobile phone system is in the user operation process. And evaluating the stability and smoothness capability of the UI of the smart phone system according to the performance indexes.
1. Response delay, completion delay calculating and testing method
The high frame rate industrial camera is matched with a touch sensor, a manipulator is used for simulating a user to execute an operation instruction, the high frame rate industrial camera automatically captures and tracks the change of an equipment interface, after the action is finished, the image change is analyzed frame by frame, the action starting point and the action ending point are searched, the time difference between the two points is calculated, and finally the response time delay and the finish time delay are quantized.
Response time delay: when the mobile smart phone is operated, the slave manipulator issues an operation instruction to the screen interface, and the slave manipulator obtains information and feeds the information back to the screen through the interface.
And (4) completing time delay: and the time from the time when the manipulator gives an operation instruction to the screen interface to the time when the interface loading is finished and the stable static state which can be read is reached.
1.1, a response time delay test method:
(1) The application APP to be tested is moved to the leftmost upper corner of the screen, and specifically, the point (1) shown in fig. 2 can be referred to.
(2) The APP closest to the right of this APP is set as a static reference point, which can be specifically referred to as (2) shown in fig. 2.
(3) And opening a control program to move the mechanical arm to the position above the APP to be tested and execute a click command, marking the starting point when the mechanical arm lifts off the screen interface, and marking the starting point and the first end point when the APP page is opened and extends to the static reference point, wherein the starting and ending time of the starting point and the first end point is response time delay.
1.2, completing the time delay test method:
(1) The application APP to be tested is moved to the leftmost upper corner of the screen, and specifically, the point (1) shown in fig. 3 can be referred to.
(2) The content valid area in the screen is set as a static reference area, which can be specifically referred to at block 31 shown in fig. 3.
(3) Opening the control program and moving the manipulator to the APP top that needs the test and carry out the click instruction, standing by the manipulator and lifting off and leave the screen interface and record as the starting point, when the APP page is opened completely and extends to and is full of whole static reference area and record as the second endpoint, this starting point and the start-stop time of second endpoint are just the completion time delay.
2. Standard deviation and fluctuation rate calculation method
And (3) each test case respectively passes through 50 response time delays and completes time delay test, the obtained data is averaged, and the dispersion degree of the two numerical values relative to the average value is reflected according to a standard deviation function and a fluctuation rate function. The larger the standard deviation and the fluctuation rate value are, the larger the deviation of the data is, the more unstable the data set is, that is, the more unstable the UI of the smartphone is.
3. Test case for stable fluency of UI of smart phone system
3.1 response delay test case
3.1.1 social scenarios
1. Testing application: weChat cold start, QQ cold start
2. WeChat application testing step: (1) The mechanical arm opens the WeChat from the desktop cold start of the mobile phone system, and the result recorded by the high-frame-rate industrial camera is the time from the point/operation WeChat to the first frame of the interface change. And (2) clicking the WeChat main interface to enter the session. Clicking the WeChat main interface to enter a certain session, and recording the time from clicking/operating the certain session to changing the first frame of the WeChat main interface.
3. QQ application test step: (1) And the mechanical arm opens the QQ from the desktop cold start of the mobile phone system, and the result recorded by the high-frame-rate industrial camera is the time from the point/operation of the QQ to the first frame of interface change. And (2) clicking the QQ main interface to enter the session. Clicking the QQ main interface to enter a certain session, and recording the time from the point/operation of the certain session of the QQ to the change of the first frame of the QQ main interface.
3.1.2 shopping scenario
1. Testing application: cold start of elutriation
2. Taobao application test procedure: the mechanical arm is started from the desktop of the mobile phone system in a cold mode to open the mobile phone panning, and the result recorded by the high-frame-rate industrial camera is the time from clicking/operating the mobile phone panning to the first frame of interface change.
3.1.3 News consultation scenario
1. Testing application: microblog cold start, today's first cold start, UC browser cold start, hundred degree cold start
2. A microblog application testing step: (1) And the mechanical arm opens a microblog from the desktop of the mobile phone system in a cold start mode, and the result recorded by the high-frame-rate industrial camera is the time from the point/operation of the microblog to the first frame of interface change. (2) And checking the microblog pictures, opening and designating a certain picture from the microblog application, and recording the time from the point when the microblog checking pictures are clicked/operated to the point when the pictures change into the first frame.
3. The test procedure of the top application of today: the mechanical arm opens the current headline from the cold start of the desktop of the mobile phone system, and the recorded result of the high-frame-rate industrial camera is the time from the click/operation of the current headline to the change of the first frame of the interface.
4. And a UC browser application testing step: and the mechanical arm opens the UC browser from the desktop cold start of the mobile phone system, and the result recorded by the high-frame-rate industrial camera is the time from the point/operation of the UC browser to the first frame of interface change.
5. Hundred-degree application testing steps: the mechanical arm is opened from the desktop cold start of the mobile phone system to the first frame of time of interface change, wherein the result recorded by the high-frame-rate industrial camera is clicking/operating hundred degrees.
3.1.4 music scenes
1. Testing application: QQ music
2. QQ music application testing step: (1) The mechanical arm opens QQ music from the desktop cold start of the mobile phone system, and the result recorded by the high frame rate industrial camera is the time from the point/operation of the QQ music to the first frame of interface change. (2) And the QQ music enters a song listening and song recognition interface, the song listening and song recognition is opened from a QQ music main interface, and the recorded result is the time for clicking/operating the QQ music to listen to the song recognition until the QQ music main interface changes the first frame.
3.1.5 map navigation scenarios
1. Testing application: gade map cold start
2. And a step of applying and testing the Gaode map: the mechanical arm opens the high-resolution map from the desktop cold start of the mobile phone system, and the result recorded by the high-frame-rate industrial camera is the time from the point/operation of the high-resolution map to the first frame of interface change.
3.1.6 video-like scenes
1. Testing application: aiqiyi cold start
2. The method comprises the following steps of (1) Aiqi art application testing: the smart art is opened by the mechanical arm from the desktop cold start of the mobile phone system, and the result recorded by the high-frame-rate industrial camera is the time from clicking/operating the smart art to the first frame of interface change.
3.2, completing the time delay test case
3.2.1 social scenarios
1. Testing application: clicking a WeChat main interface to enter a conversation, checking a picture by a WeChat friend circle, and clicking a QQ main interface to enter the conversation
2. And (3) WeChat testing: (1) And clicking/operating the mechanical arm from the WeChat main interface to enter a certain session, and recording the result that the WeChat session is completely opened until the state is static and the required completion time delay is achieved. (2) The mechanical arm clicks/operates a certain picture big picture from the WeChat friend circle, and the recorded result is that the picture of the friend circle is completely unfolded until the picture is in a static state, and the required completion time delay is achieved.
3. And (3) QQ testing: (1) And the mechanical arm clicks/operates from the QQ main interface to enter a certain session, and the recorded result is the completion delay required when the QQ is completely opened to a static state.
3.2.2 News consultation scenarios
1. Testing application: viewing microblog pictures
2. A microblog picture checking test step: (1) And clicking/operating a certain picture big picture from the microblog by the mechanical arm, and recording the result as the time delay required for completing the picture from the picture to a static state.
3.2.3 video-like scenes
1. Testing application: love art
2. The method comprises the following steps of: (1) And the mechanical arm clicks/operates the search box from the Aiqi skill main interface, and the recorded result is the required completion time delay from the opening of the Aiqi skill search box to the static state.
3.2.4, music scene
1. Testing application: QQ music
2. The QQ music main interface opens the search box test step: (1) The mechanical arm clicks/operates the song listening and song recognition interface from the QQ music main interface, and the recorded result is the required completion time delay from the opening of the song listening and song recognition interface to the static state.
According to the embodiment, through a set of multi-scenario application case tests, objective, comprehensive and multi-dimensional data passing can be achieved, the real performance index of the UI stability and smoothness of the smart phone system is reflected to a user, and the feedback speed and timeliness of mobile phone equipment to user operation are displayed to the user through data. Meanwhile, the evaluation system can also compare the advantages and disadvantages of different optimization solutions for the calling of the mobile phone system UI and the bottom hardware resources among mobile phone manufacturers, is beneficial to the upgrading and iteration of intelligent mobile phone equipment, plays a guiding role in product marketing and brands, contributes to the overall level development of the industry, and has a positive effect on the use of a truly good product by a user.
It should be noted that, the sequence numbers of the steps in the foregoing embodiments do not mean the execution sequence, and the execution sequence of each process should be determined by the function and the inherent logic of the process, and should not constitute any limitation on the implementation process of the embodiments of the present application. In practical applications, all the possible embodiments described above may be combined in a combined manner to form possible embodiments of the present application, and details are not described herein again.
Based on the stable fluency evaluation method of the UI of the intelligent terminal system provided by the embodiments, the embodiment of the application also provides a stable fluency evaluation system of the UI of the intelligent terminal system based on the same inventive concept.
Fig. 4 shows a structural diagram of a stable fluency evaluation system of an intelligent terminal system UI according to an embodiment of the present application. As shown in fig. 4, the system for evaluating stability of a UI of a specific intelligent terminal system may include an obtaining module 410, a testing module 420, a measuring module 430, and an evaluating module 440.
An obtaining module 410, configured to obtain a pre-constructed test case;
the test module 420 is configured to operate a target intelligent terminal of the UI of the system to be evaluated by using the test case, and acquire operation process data;
the measuring module 430 is used for measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the operation process data;
and the evaluating module 440 is configured to evaluate the stable smoothness of the UI of the target intelligent terminal system based on the measured performance index.
In the embodiment of the present application, a possible implementation manner is provided, and the test module 420 shown in fig. 4 is further configured to:
executing the test case on a target intelligent terminal of a system UI to be evaluated, operating the target intelligent terminal by using a manipulator, and acquiring operation process data by using a high frame rate industrial camera and a touch sensor.
In the embodiment of the present application, a possible implementation manner is provided, and the test module 420 shown in fig. 4 is further configured to:
determining a test application used for testing on a target intelligent terminal of the UI of the system to be evaluated according to the test case;
determining a static reference point and a static reference area of the test application according to the test application;
executing the test case on the target intelligent terminal, and operating the test application by using a manipulator;
acquiring a time point when the manipulator leaves the screen interface of the target intelligent terminal after operating the test application by using a touch sensor, and recording the time point as a starting point;
capturing and tracking an image of the change of the screen interface of the target intelligent terminal when the manipulator operates the test application by using a high frame rate industrial camera;
and taking the images of the starting point and the target intelligent terminal screen interface change as collected operation process data.
In the embodiment of the present application, a possible implementation manner is provided, and the measurement module 430 shown in fig. 4 is further configured to:
according to the image of the change of the screen interface of the target intelligent terminal, determining a time point of the image of the page of the test application extending to the static reference point, and recording the time point as a first end point;
determining a time point at which a page of the test application is completely opened and extends to the static reference area which is fully paved, and marking as a second end point according to the image of the target intelligent terminal screen interface change;
calculating the response time delay of the test application according to the starting point and the first ending point;
calculating the completion time delay of the test application according to the starting point and the second ending point;
and taking the response time delay and the completion time delay as performance indexes for evaluating the stable fluency of the UI of the intelligent terminal system.
The embodiment of the application provides a possible implementation manner, the test case is executed on the target intelligent terminal for multiple times in a circulating manner, and the test application is operated by using a manipulator for multiple times in a circulating manner; the starting point, the first ending point and the second ending point are all multiple, and the response delay and the completion delay are multiple; the measurement module 430 shown in fig. 4 above is also used to:
calculating the average value and/or standard deviation of a plurality of response time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system;
and calculating the average value and/or standard deviation of the plurality of finishing time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system.
Based on the same inventive concept, an embodiment of the present application further provides an electronic device, which includes a processor and a memory, where the memory stores a computer program, and the processor is configured to run the computer program to execute the method for evaluating the stable fluency of the UI of the intelligent terminal system according to any of the above embodiments.
Based on the same inventive concept, the embodiment of the present application further provides a storage medium, in which a computer program is stored, where the computer program is configured to execute the stable fluency evaluation method of the UI of the intelligent terminal system according to any one of the above embodiments when running.
It can be clearly understood by those skilled in the art that the specific working processes of the system, the apparatus, and the module described above may refer to the corresponding processes in the foregoing method embodiments, and for the sake of brevity, the detailed description is omitted here.
Those of ordinary skill in the art will understand that: the technical solution of the present application may be essentially or wholly or partially embodied in the form of a software product, where the computer software product is stored in a storage medium and includes program instructions for enabling an electronic device (e.g., a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application when the program instructions are executed. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk, an optical disk, or the like.
Alternatively, all or part of the steps of implementing the foregoing method embodiments may be implemented by hardware (an electronic device such as a personal computer, a server, or a network device) associated with program instructions, which may be stored in a computer-readable storage medium, and when the program instructions are executed by a processor of the electronic device, the electronic device executes all or part of the steps of the method described in the embodiments of the present application.
The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments can be modified or some or all of the technical features can be equivalently replaced within the spirit and principle of the present application; such modifications or substitutions do not depart from the scope of the present application.
Claims (5)
1. A stable fluency evaluating method of an intelligent terminal system UI is characterized by comprising the following steps:
acquiring a pre-constructed test case;
operating a target intelligent terminal of a system UI to be evaluated by using the test case, and acquiring operation process data;
measuring a performance index for evaluating the stability and smoothness of the UI of the intelligent terminal system according to the operation process data;
evaluating the stability fluency of the target intelligent terminal system UI based on the measured performance index;
operating a target intelligent terminal of a system UI to be evaluated by using the test case, and acquiring operation process data; according to the operation process data, measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system, wherein the performance index comprises the following steps:
determining a test application used for testing on a target intelligent terminal of the UI of the system to be evaluated according to the test case; determining a static reference point and a static reference area of the test application according to the test application;
executing the test case on the target intelligent terminal, and operating the test application by using a manipulator;
acquiring a time point when the manipulator leaves the screen interface of the target intelligent terminal after operating the test application by using a touch sensor, and recording the time point as a starting point;
capturing and tracking an image of the change of the screen interface of the target intelligent terminal when the manipulator operates the test application by using a high frame rate industrial camera;
according to the image of the change of the screen interface of the target intelligent terminal, determining a time point of the image of the page of the test application extending to the static reference point, and recording the time point as a first end point;
determining a time point at which a page of the test application is completely opened and extends to the image which is paved on the static reference area according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a second end point;
calculating the response time delay of the test application according to the starting point and the first ending point; calculating the completion time delay of the test application according to the starting point and the second ending point; and taking the response time delay and the completion time delay as performance indexes for evaluating the stable fluency of the UI of the intelligent terminal system.
2. The method according to claim 1, wherein the test case is executed on the target intelligent terminal in a cycle of multiple times, and the test application is operated in a cycle of multiple times by using a manipulator; the starting point, the first ending point and the second ending point are all multiple, and the response delay and the completion delay are multiple; the method further comprises the following steps:
calculating the average value and/or standard deviation of a plurality of response time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system;
and calculating the average value and/or standard deviation of a plurality of finishing time delays as a performance index for evaluating the stable fluency of the UI of the intelligent terminal system.
3. The utility model provides a stable fluency evaluation system of intelligent terminal system UI which characterized in that includes:
the acquisition module is used for acquiring a pre-constructed test case;
the test module is used for operating a target intelligent terminal of the UI of the system to be evaluated by utilizing the test case and acquiring operation process data;
the measuring module is used for measuring a performance index for evaluating the stable fluency of the UI of the intelligent terminal system according to the operation process data;
the evaluation module is used for evaluating the stable fluency of the UI of the target intelligent terminal system based on the measured performance index;
wherein the test module is further configured to:
determining a test application used for testing on a target intelligent terminal of the UI of the system to be evaluated according to the test case; determining a static reference point and a static reference area of the test application according to the test application;
executing the test case on the target intelligent terminal, and operating the test application by using a manipulator;
acquiring a time point when the manipulator leaves the screen interface of the target intelligent terminal after operating the test application by using a touch sensor, and recording the time point as a starting point;
capturing and tracking an image of the change of the screen interface of the target intelligent terminal when the manipulator operates the test application by using a high frame rate industrial camera;
the measurement module is further configured to:
determining a time point of an image of the test application, which extends to the static reference point, opened on the page according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a first end point;
determining a time point at which a page of the test application is completely opened and extends to the image which is paved on the static reference area according to the image of the change of the screen interface of the target intelligent terminal, and recording the time point as a second end point;
calculating the response time delay of the test application according to the starting point and the first ending point; calculating the completion time delay of the test application according to the starting point and the second ending point; and taking the response time delay and the completion time delay as performance indexes for evaluating the stable fluency of the UI of the intelligent terminal system.
4. An electronic device, comprising a processor and a memory, wherein the memory stores a computer program, and the processor is configured to execute the computer program to execute the method for evaluating stable fluency of a smart terminal system UI according to any one of claims 1 to 2.
5. A storage medium, wherein a computer program is stored in the storage medium, and wherein the computer program is configured to execute the method for evaluating stable fluency of an intelligent terminal system UI according to any of claims 1-2 when running.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211418118.7A CN115470153B (en) | 2022-11-14 | 2022-11-14 | Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211418118.7A CN115470153B (en) | 2022-11-14 | 2022-11-14 | Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115470153A CN115470153A (en) | 2022-12-13 |
| CN115470153B true CN115470153B (en) | 2023-03-24 |
Family
ID=84338127
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211418118.7A Active CN115470153B (en) | 2022-11-14 | 2022-11-14 | Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115470153B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109876429A (en) * | 2019-01-24 | 2019-06-14 | 吴宏琴 | Direction-controlling method, mobile terminal and storage medium based on scene of game |
| CN111555938A (en) * | 2020-04-28 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Information processing method and related device |
| CN113811855A (en) * | 2019-05-06 | 2021-12-17 | 苹果公司 | User interface for capturing and managing visual media |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2977941B1 (en) * | 2009-07-10 | 2022-11-16 | BlackBerry Limited | System and method for managing electronic assets |
| CN103268194B (en) * | 2013-04-18 | 2016-01-20 | 广州视睿电子科技有限公司 | A kind of method of testing and testing tool time delay of interactive intelligent tablet computer |
| CN103338290B (en) * | 2013-06-04 | 2016-12-28 | 宁波大学 | A kind of method of automatic test Android phone touch screen performance |
| CN105302701B (en) * | 2014-06-23 | 2020-02-28 | 中兴通讯股份有限公司 | Method, device and equipment for testing reaction time of terminal user interface |
| CN105786336A (en) * | 2014-12-22 | 2016-07-20 | ***通信集团终端有限公司 | Method, device and system for evaluating fluency of terminal touch screen |
| CN106096121B (en) * | 2016-06-07 | 2019-03-19 | 武汉虹信技术服务有限责任公司 | Intelligent building project method for drawing map based on universal map control |
| CN107734120A (en) * | 2016-08-10 | 2018-02-23 | 北京东舟技术股份有限公司 | The fluency method for testing performance of terminal device |
| CN110058755A (en) * | 2019-04-15 | 2019-07-26 | 广州视源电子科技股份有限公司 | A kind of method, apparatus, terminal device and the storage medium of PowerPoint interaction |
| CN111405218A (en) * | 2020-03-26 | 2020-07-10 | 深圳市微测检测有限公司 | Touch screen time delay detection method, system, device, equipment and storage medium |
| CN111813689B (en) * | 2020-07-22 | 2021-08-31 | 腾讯科技（深圳）有限公司 | Game testing method, apparatus and medium |
-
2022
- 2022-11-14 CN CN202211418118.7A patent/CN115470153B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109876429A (en) * | 2019-01-24 | 2019-06-14 | 吴宏琴 | Direction-controlling method, mobile terminal and storage medium based on scene of game |
| CN113811855A (en) * | 2019-05-06 | 2021-12-17 | 苹果公司 | User interface for capturing and managing visual media |
| CN111555938A (en) * | 2020-04-28 | 2020-08-18 | 腾讯科技（深圳）有限公司 | Information processing method and related device |
Non-Patent Citations (1)
| Title |
|---|
| "How to test the touch screen on a Samsung Android cell phone";JAMES BOND;《https://smartmobilephonesolutions.com/content/how-to-test-the-touch-screen-on-a-samsung-android-cell-phone》;20141122;1-6 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115470153A (en) | 2022-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109240576B (en) | Image processing method and device in game, electronic device and storage medium | |
| CN108920380A (en) | Test method, device, server, equipment and the storage medium of the software compatibility | |
| US9471912B2 (en) | Behavioral event measurement system and related method | |
| US8823794B2 (en) | Measuring device user experience through display outputs | |
| RU2609752C2 (en) | Method and mobile terminal device for independent video image playback | |
| US20150135169A1 (en) | Testing device and testing method thereof | |
| CN108984395A (en) | A kind of application program launching time-consuming test method, device and storage medium | |
| CN106982368B (en) | Video response speed detection method and system | |
| CN103955428A (en) | Method and equipment for testing response speed of application | |
| US9009083B1 (en) | Mechanism for automatic quantification of multimedia production quality | |
| US9378109B1 (en) | Testing tools for devices | |
| Havranek et al. | V2S: a tool for translating video recordings of mobile app usages into replayable scenarios | |
| CN113312967B (en) | Detection method and device for detection | |
| CN115470153B (en) | Method, system and equipment for evaluating stability fluency of UI (user interface) of intelligent terminal system | |
| CN113254608A (en) | System and method for generating training data through question answering | |
| WO2021023171A1 (en) | Method and apparatus for test script recording time selection | |
| Feng et al. | Video2Action: Reducing human interactions in action annotation of app tutorial videos | |
| US9075494B2 (en) | Systems and methods for performing object selection | |
| CN105718363A (en) | Acquisition method and device of mobile phone response startup time point | |
| CN110502419A (en) | A kind of test method of graphic user interface, device and equipment | |
| WO2017036311A1 (en) | Object sorting method and device | |
| CN111026989B (en) | Page loading time detection method and device and electronic equipment | |
| CN103873769A (en) | Image search systems and methods | |
| CN114090436A (en) | Test method and device | |
| Lin et al. | Benchmarking handheld graphical user interface: Smoothness quality of experience |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |