CN112015644A - Screen fluency determination method, device, equipment and medium - Google Patents
Screen fluency determination method, device, equipment and medium Download PDFInfo
- Publication number
- CN112015644A CN112015644A CN202010865392.3A CN202010865392A CN112015644A CN 112015644 A CN112015644 A CN 112015644A CN 202010865392 A CN202010865392 A CN 202010865392A CN 112015644 A CN112015644 A CN 112015644A
- Authority
- CN
- China
- Prior art keywords
- video
- video frame
- screen
- tested
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 68
- 238000012360 testing method Methods 0.000 claims abstract description 68
- 230000015654 memory Effects 0.000 claims description 20
- 238000012217 deletion Methods 0.000 claims description 7
- 230000037430 deletion Effects 0.000 claims description 7
- 239000000126 substance Substances 0.000 claims description 2
- 230000000694 effects Effects 0.000 abstract description 7
- 238000012545 processing Methods 0.000 abstract description 6
- 238000004364 calculation method Methods 0.000 description 8
- 230000002860 competitive effect Effects 0.000 description 8
- 230000006870 function Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 6
- 238000004422 calculation algorithm Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 238000013515 script Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 238000013522 software testing Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004451 qualitative analysis Methods 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000010998 test method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Preventing errors by testing or debugging software
- G06F11/3668—Software testing
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N17/00—Diagnosis, testing or measuring for television systems or their details
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Quality & Reliability (AREA)
- Computer Hardware Design (AREA)
- Bioinformatics & Computational Biology (AREA)
- Human Computer Interaction (AREA)
- Evolutionary Biology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Health & Medical Sciences (AREA)
- Biomedical Technology (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Analysis (AREA)
Abstract
The application discloses a method, a device, equipment and a medium for determining screen fluency, and relates to the technical field of image processing. The specific implementation scheme is as follows: acquiring a video shot by shooting equipment; the video is shot when the screen interface of the equipment to be tested performs sliding operation; for at least two continuous video frames with similarity greater than a set threshold in the video, deleting the at least two video frames to enable the at least two video frames to remain one video frame; and determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video. The method and the device for testing the screen fluency realize the effect of determining the screen fluency of the equipment to be tested, can be used for testing the screen fluency of any equipment to be tested, and expand the application range of the screen fluency test.
Description
Technical Field
The embodiment of the application relates to the technical field of computers, in particular to an image processing technology, and particularly relates to a method, a device, equipment and a medium for determining screen fluency.
Background
There is a need for a screen fluency test for devices with screens. The main test method comprises the following steps: the method comprises the steps that a personal computer is connected with equipment to be tested, after a tester inputs a command line on the personal computer, the personal computer sends the command line to the equipment to be tested, and an operating system of the equipment to be tested returns screen frame rate data of the equipment to be tested according to the received command line, so that the blocking degree of a screen can be determined according to the screen frame rate data, the fluency can be further determined, and developers can optimize the equipment to be tested on a software level according to the fluency.
Because the operating system on the competitive product equipment often shields command lines sent by other equipment, the fluency testing method is not suitable for fluency testing of any equipment, and further cannot perform contrast testing.
Disclosure of Invention
The embodiment of the application provides a method, a device, equipment and a storage medium for determining screen fluency, and aims to solve the problems that the existing screen fluency testing method is not suitable for determining the screen fluency of any equipment to be tested and is narrow in application range.
According to a first aspect, there is provided a screen fluency determination method, the method comprising:
acquiring a video shot by shooting equipment; the video is shot when the screen interface of the equipment to be tested performs sliding operation;
for at least two continuous video frames with similarity greater than a set threshold in the video, deleting the at least two video frames to enable the at least two video frames to remain one video frame;
and determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video.
According to a second aspect, there is provided a screen fluency determination apparatus, the apparatus comprising:
the video acquisition module is used for acquiring a video shot by the shooting equipment; the video is shot when the screen interface of the equipment to be tested performs sliding operation;
the video frame deleting module is used for deleting at least two continuous video frames with similarity greater than a set threshold value in the video so as to enable the at least two video frames to remain one video frame;
and the fluency determination module is used for determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video.
According to a third aspect, there is provided an electronic device comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform a method for screen fluency determination of blockchains as described in any of the embodiments herein.
According to a fourth aspect, there is provided a non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform a method for screen fluency determination of blockchains as described in any of the embodiments herein.
According to the technology of the application, the effect of determining the screen fluency of the equipment to be tested is achieved, the method can be used for testing the screen fluency of any competitive product equipment, and the application range of the screen fluency test is expanded.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not intended to limit the present application. Wherein:
FIG. 1 is a flow chart of a method for determining screen fluency disclosed according to an embodiment of the present application;
FIG. 2A is a flow chart of a method for determining screen fluency disclosed according to an embodiment of the present application;
fig. 2B is a schematic diagram of a video frame stacking according to an embodiment of the present application;
fig. 3 is a schematic structural diagram of a screen fluency determination apparatus according to an embodiment of the present application;
fig. 4 is a block diagram of an electronic device of a screen fluency determination method according to an embodiment of the application.
Detailed Description
The following description of the exemplary embodiments of the present application, taken in conjunction with the accompanying drawings, includes various details of the embodiments of the application for the understanding of the same, which are to be considered exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present application. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
The applicant finds that the existing screen fluency testing method specifically comprises the following four steps: 1) and accessing a test website page or test software by using the device to be tested, wherein the test website or the test software can give corresponding screen frame rate data. 2) The tester manually slides the screen of the device to be tested, and observes the fluency of the screen of the device to be tested by naked eyes. 3) The device under test script of the IOS system executes the operation and then outputs the screen frame rate data by using an XCODE self-contained Instruments tool. 4) And executing the automatic script, and recording the frame division processing of the screen to obtain the frame rate data of the screen.
The disadvantages of the above method 1) are: only frame rate data under a set scene of a test website or test software can be determined, and a specific scene cannot be designed to test the fluency according to the characteristics of the equipment to be tested. The disadvantages of the above-mentioned method of the 2) are: errors cannot be avoided, and the subjectivity of visual observation is large, so that the method is not convincing. The disadvantages of the above-mentioned method of the 3) are: depending on the development environment of the IOS system and engineering source codes, scripts need to be written, a basic programming basis is required, and the learning cost is high. The disadvantages of the above-mentioned method of the 4) are: in some closed systems, device developers tend to shield the developer's access, resulting in a failure to perform screen fluency tests.
In summary, at present, no comprehensive and mature screen fluency testing method is available for determining the screen fluency of the competitive product equipment.
Fig. 1 is a flowchart of a method for determining screen fluency disclosed in an embodiment of the present application, which may be applied to a case of determining screen fluency of a device under test. The method of the present embodiment may be performed by a device for determining screen fluency, which may be implemented by software and/or hardware, and may be integrated on any electronic device with computing capability, such as a server.
As shown in fig. 1, the method for determining the fluency of the screen disclosed in the present embodiment may include:
s101, acquiring a video shot by shooting equipment; the video is shot when the screen interface of the device to be tested performs sliding operation.
The shooting device includes, but is not limited to, any device with a video shooting function, such as a camera, a video recorder, and a smart phone. In order to ensure the accuracy of the finally determined screen fluency, the resolution of the video shot by the shooting device is not lower than 720p, and is alternatively 1080p resolution or 2k resolution.
In an embodiment, the shooting device is installed in a fixture, the fixture is fixedly placed above the device to be tested, an included angle formed by the fixture and a central point of the device to be tested is a preset included angle, and the optional fixture is fixedly placed right above the device to be tested, namely, the included angle formed by the optional fixture and the central point of the device to be tested is 0 degree. And when the screen interface of the equipment to be tested executes sliding operation, simultaneously starting the video shooting function of the shooting equipment so as to shoot the screen interface of the equipment to be tested in real time. When the screen interface of the equipment to be tested finishes the sliding operation, the video shooting function of the shooting equipment is stopped at the same time, and the shot video is sent to the screen fluency determination device.
By acquiring the video shot by the shooting equipment, a foundation is laid for executing video frame deletion operation on at least two continuous video frames with similarity greater than a set threshold in the video subsequently.
S102, for at least two continuous video frames with similarity larger than a set threshold value in the video, deleting the at least two video frames to enable the at least two video frames to remain one video frame.
In one embodiment, the screen fluency determination device performs frame processing on the acquired video to obtain each video frame, and performs image similarity calculation on continuous video frames in all video frames by using the existing image similarity calculation algorithm, including but not limited to a structural similarity measurement method, a cosine similarity method, an image similarity calculation method based on a histogram, an image similarity calculation method based on mutual information, an image similarity calculation method based on feature points, and the like, to determine the similarity between the continuous video frames. And if the similarity between at least two continuous video frames is greater than a set threshold value, performing video deletion operation on the at least two continuous video frames, and remaining one video frame. The set threshold may be set arbitrarily according to actual conditions, and this embodiment is not particularly limited.
Optionally, the video deleting operation includes: and deleting the video frames with the later shooting time and deleting the video frames with the first residual shooting time in at least two continuous video frames.
The method comprises the steps of deleting at least two video frames by at least two continuous video frames with similarity greater than a set threshold value in the video so as to enable the at least two video frames to have one remaining video frame, and laying a foundation for subsequently determining the total number of remaining video frames in the video.
S103, determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video.
In one embodiment, after deleting the video frames in S102, the total number of remaining video frames in the video is counted, and qualitative analysis is performed on the screen fluency of the device under test according to the total number. The more the total number of the remaining video frames is, the less the continuous video frames with the similarity greater than a set threshold in the video are, that is, the screen of the device to be tested does not display the same display content for a long time in the sliding process, and the better the smoothness of the screen of the device to be tested is; correspondingly, the less the total number of the remaining video frames is, the more the continuous video frames with the similarity greater than the set threshold value in the video are, namely, the screen of the device to be tested displays the same display content for a longer time in the sliding process, namely, the poorer the screen fluency of the device to be tested is.
Optionally, a first quantity threshold, a second quantity threshold, a third quantity threshold, and a fourth quantity threshold are preset, where the first quantity threshold is greater than the second quantity threshold, the second quantity threshold is greater than the third quantity threshold, and the third quantity threshold is greater than the fourth quantity threshold. If the total number of the remaining video frames in the video is greater than or equal to a first number threshold, determining that the screen fluency of the device to be tested is 'good'; if the total number of the remaining video frames in the video is smaller than a first number threshold and is larger than or equal to a second number threshold, determining that the screen fluency of the device to be tested is 'better'; if the total number of the remaining video frames in the video is smaller than a second number threshold and is larger than or equal to a third number threshold, determining that the screen fluency of the device to be tested is 'normal'; if the total number of the remaining video frames in the video is smaller than a third number threshold and is larger than or equal to a fourth number threshold, determining that the screen fluency of the device to be tested is 'poor'; and if the total number of the remaining video frames in the video is smaller than the fourth number threshold, determining that the screen fluency of the equipment to be tested is poor.
The screen fluency of the equipment to be tested is determined according to the total number of the residual video frames in the video, so that the effect of testing the screen fluency of the equipment to be tested is realized.
According to the technical scheme of the embodiment, for at least two continuous video frames with the similarity greater than the set threshold in the obtained shooting video, the video frames of the at least two video frames are deleted, so that one video frame is remained in the at least two video frames, and finally the screen fluency of the device to be tested is determined according to the total number of the remained video frames in the video, so that the effect of determining the screen fluency of the device to be tested is achieved, and compared with the existing screen fluency testing method, the method has the following advantages: 1. the test scene is not limited, the test can be carried out in various test scenes, and the test diversity is good. 2. The method does not need manual participation, and the determined screen fluency result is not influenced by subjective judgment of people, so the method is very convincing. 3. The test script does not need to be written in advance, and the requirements on the programming basis and the learning cost of related technicians are low. 4. The method does not depend on the support of the operating system of the device to be tested, so that the problem of shielding by the operating system of the competitive product device can be avoided, the method can be used for testing the screen fluency of any competitive product device, and the application range of the screen fluency test is expanded.
On the basis of the above embodiment, the device to be tested includes a smart sound box.
The smart sound box comprises a touch screen, a user can perform touch operation on the screen, including but not limited to clicking, double clicking, dragging and the like, and the smart sound box responds to the touch operation of the user and executes corresponding functions.
Through regard as the equipment that awaits measuring with intelligent audio amplifier, realized carrying out the effect of testing to the screen smoothness degree of intelligent audio amplifier for the tester can optimize and adjust the screen of intelligent audio amplifier according to the test result.
Fig. 2A is a flowchart of a method for determining screen fluency disclosed in the embodiment of the present application, which is further optimized and expanded based on the above technical solution, and can be combined with the above optional embodiments. As shown in fig. 2A, the method may include:
s201, acquiring control parameters, controlling a mechanical arm to execute sliding operation on a screen interface of equipment to be tested according to the control parameters, and controlling shooting equipment to carry out video shooting on the screen.
In one embodiment, the technician presets control parameters for controlling the movement of the robotic arm, including but not limited to a slip frequency control parameter, a slip amplitude control parameter, a slip direction control parameter, and a slip start time control parameter, among others. The screen fluency determination device acquires the control parameters and controls the mechanical arm to execute sliding operation on the screen interface of the equipment to be tested according to the control parameters. Meanwhile, the screen fluency determination means controls the photographing apparatus to start photographing the video while the robot arm starts performing the sliding operation, and to stop photographing the video while the robot arm stops performing the interactive operation, according to a code written in advance by a technician.
Optionally, the main body for executing the sliding operation on the screen interface of the device to be tested may be the mechanical arm or a human body, such as a human finger, that is, the sliding operation is executed on the screen interface of the device to be tested in a manual manner, and the shooting device is controlled to shoot the screen in a video mode.
By acquiring the control parameters, the mechanical arm is controlled to execute sliding operation on the screen interface of the equipment to be tested according to the control parameters, and the shooting equipment is controlled to shoot the screen in a video mode, so that automatic sliding operation on the screen interface and video shooting on the screen by the shooting equipment are realized, no human intervention is performed, the labor cost is reduced, and the accuracy and the efficiency are improved.
S202, acquiring a video shot by shooting equipment; the video is shot when the screen interface of the device to be tested performs sliding operation.
And S203, for each video frame in the video, cutting an area of the video frame, which comprises a main body for executing the sliding operation.
In one embodiment, the entity recognition is performed on the video frame, and the region of the subject of the identified sliding operation is cropped.
Optionally, S203 includes the following two implementation manners a or B:
A. and determining a preset position area in the video frame as an area containing a main body for executing the sliding operation, and cutting the preset position area from the video frame.
In an embodiment, a technician presets a location area, where the preset location area may be a lower left corner rectangular area of a video frame or a lower right corner rectangular area of the video frame, and this embodiment does not limit the location area at all. After the video is acquired, cutting off the corresponding preset position area in each video frame aiming at each video frame.
Through cutting out the preset position area in the video frame, the cutting mode has higher efficiency and is easier to realize.
B. And identifying the area containing the main body for executing the sliding operation in the video frame according to the image characteristics of the video frame, and cutting the identified area from the video frame.
In one embodiment, for each video frame, a preset artificial intelligence algorithm is adopted to identify a region containing a subject performing a sliding operation in the video frame according to image features of the video frame, wherein the artificial intelligence algorithm includes, but is not limited to, a target detection algorithm based on a classifier or a target detection algorithm based on a candidate region, and the like. And cropping out the area of the subject performing the sliding operation identified in each video frame.
By identifying and cutting out the region containing the main body for executing the sliding operation, the area of the region cut out in the mode is smaller, the influence on the original video frame is smaller, and therefore the final screen fluency determination result is more accurate.
By cutting the area of each video frame in the video, which contains the main body executing the sliding operation, the influence of the main body executing the sliding operation on the video frame picture is avoided, and the accuracy of the final screen fluency determination result is ensured to be good.
S204, performing a stacking operation on the shot first video frame; sequentially deleting the n-th video frame if the similarity between the n-th video frame and the video frame at the stack top is larger than a preset threshold value for the shot n-th video frame, otherwise, performing a stacking operation on the n-th video frame; and N is an integer which is greater than 1 and less than or equal to N, and N is the total number of video frames in the video obtained by shooting.
In one embodiment, the video frames are sorted in the order of shooting time, the video frames are firstly stored in the sequence table according to the sorting order, and the first video frame with the earliest shooting time is firstly subjected to a stacking operation according to the obtained sequence table, namely the first video frame is the top video frame. And then, sequentially carrying out similarity calculation on the rest video frames in the sequence list and the stack top video frame according to the shooting sequence, for example, when N is 2, the similarity calculation between the second video frame and the stack top video frame is shown, and when N is N, the similarity calculation between the last video frame and the stack top video frame is shown. And deleting each video frame with the similarity to the video frame at the top of the stack larger than a preset threshold according to the obtained similarity calculation result, and executing the stacking operation on each video frame with the similarity to the video frame at the top of the stack smaller than or equal to the preset threshold.
Illustratively, assuming that the preset threshold is 0.6, the second video frame, the third video frame, the fourth video frame and the fifth video frame are included in addition to the top video frame. If the similarity between the second video frame, the third video frame, the fourth video frame and the fifth video frame and the stack top video frame is 0.8, 0.7, 0.5 and 0.4 respectively. The second video frame and the third video frame are deleted and the fourth video frame and the fifth video frame are stacked.
As shown in fig. 2B, fig. 2B is a schematic diagram of stacking video frames according to an embodiment of the present disclosure, where 20 is a sequential stack in this embodiment, 21 represents a first captured video frame, after stacking the video frame 21, the video frame 21 is located at the top of the stack, 22 represents an a-th video frame whose similarity to the video frame 21 is less than or equal to a preset threshold, after stacking the video frame 22, the video frame 22 is located at the top of the stack, 23 represents a B-th video frame whose similarity to the video frame 21 is less than or equal to the preset threshold, where B is greater than a, that is, the video frame 23 is a video frame whose capture time is after the video frame 22. After the video frame 23 is stacked, the video frame 23 is at the top of the stack,
the method comprises the steps of executing a stacking operation on a shot first video frame, and sequentially deleting a shot nth video frame if the similarity between the nth video frame and a video frame at the top of a stack is larger than a preset threshold value, otherwise, executing the stacking operation on the nth video frame.
S205, determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video.
In one embodiment, the total number of all the pushed video frames is counted as the total number of the remaining video frames in the video.
S206, generating a test report according to the determined screen fluency of the plurality of devices to be tested, wherein the test report comprises a test scene, the total number of the remaining video frames corresponding to the devices to be tested and a contrast test conclusion of the screen fluency of the devices to be tested.
In one embodiment, after performing S201 to S205 on a plurality of devices under test to determine screen fluency of the plurality of devices under test, a test report is generated accordingly, where the test report includes:
1. and testing scenes including but not limited to web page testing scenes, application software testing scenes, system software testing scenes and the like.
2. And the total number of the remaining video frames corresponding to each device to be tested.
3. And comparing and testing the screen fluency of each device to be tested.
Wherein, according to the total number of the remaining video frames corresponding to each device to be tested, the contrast test conclusion of the screen fluency of each device to be tested is obtained, for example, the device to be tested includes a device to be tested a, a device to be tested B and a device to be tested C, the total number of the remaining video frames corresponding to the device to be tested a is 20, the total number of the remaining video frames corresponding to the device to be tested B is 30, the total number of the remaining video frames corresponding to the device to be tested C is 40, and then the contrast test conclusion of the screen fluency is: the screen fluency of the device to be tested C is highest, the screen fluency of the device to be tested B is second, and the screen fluency of the device to be tested A is lowest.
By generating the test report according to the determined screen fluency of the multiple devices to be tested, the tester can more intuitively know the difference of the screen fluency of the device and the competition product device, so that the tester can timely optimize and adjust the device.
According to the technical scheme of the embodiment, the technical effect of more accurately and more quickly determining the screen fluency of the equipment to be tested is achieved, the method and the device can be used for testing the screen fluency of any competitive product equipment, and the application range of the screen fluency test is expanded.
Fig. 3 is a schematic structural diagram of a device for determining screen fluency according to an embodiment of the present application, which can be applied to a case of determining screen fluency of a device under test. The apparatus of the embodiment can be implemented by software and/or hardware, and can be integrated on any electronic device with computing capability, such as a server.
As shown in fig. 3, the screen fluency determination apparatus 30 disclosed in the present embodiment may include a video acquisition module 31, a video frame deletion module 32, and a fluency determination module 33, wherein:
optionally, the apparatus further includes a control parameter obtaining module, specifically configured to:
and acquiring control parameters, controlling the mechanical arm to execute sliding operation on a screen interface of the equipment to be tested according to the control parameters, and controlling the shooting equipment to carry out video shooting on the screen.
Optionally, the apparatus further includes a region clipping module, specifically configured to:
and for each video frame in the video, cutting an area of the video frame, which contains a main body for executing the sliding operation.
Optionally, the region clipping module is further specifically configured to:
determining a preset position area in the video frame as an area containing a main body for executing the sliding operation, and cutting the preset position area from the video frame; alternatively, the first and second electrodes may be,
and identifying the area containing the main body for executing the sliding operation in the video frame according to the image characteristics of the video frame, and cutting the identified area from the video frame.
Optionally, the video frame deleting module 32 is specifically configured to:
performing a stacking operation on the shot first video frame;
sequentially deleting the n-th video frame if the similarity between the n-th video frame and the video frame at the stack top is larger than a preset threshold value for the shot n-th video frame, otherwise, performing a stacking operation on the n-th video frame; and N is an integer which is greater than 1 and less than or equal to N, and N is the total number of video frames in the video obtained by shooting.
Optionally, the apparatus further includes a test report generation module, specifically configured to:
and generating a test report according to the determined screen fluency of the plurality of devices to be tested, wherein the test report comprises a test scene, the total number of the remaining video frames corresponding to each device to be tested and a contrast test conclusion of the screen fluency of each device to be tested.
Optionally, the device under test includes a smart speaker.
The screen fluency determination apparatus 30 disclosed in the embodiment of the present application can execute the screen fluency determination method disclosed in the embodiment of the present application, and has functional modules and beneficial effects corresponding to the execution method. The contents not described in detail in this embodiment may refer to the description in any embodiment of the screen fluency determination method in this application.
According to an embodiment of the present application, an electronic device and a readable storage medium are also provided.
Fig. 4 is a block diagram of an electronic device according to an embodiment of the present application. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the present application that are described and/or claimed herein.
As shown in fig. 4, the electronic apparatus includes: one or more processors 401, memory 402, and interfaces for connecting the various components, including high-speed interfaces and low-speed interfaces. The various components are interconnected using different buses and may be mounted on a common motherboard or in other manners as desired. The processor may process instructions for execution within the electronic device, including instructions stored in or on the memory to display graphical information of a GUI on an external input/output apparatus (such as a display device coupled to the interface). In other embodiments, multiple processors and/or multiple buses may be used, along with multiple memories and multiple memories, as desired. Also, multiple electronic devices may be connected, with each device providing portions of the necessary operations (e.g., as a server array, a group of blade servers, or a multi-processor system). In fig. 4, one processor 401 is taken as an example.
The memory 402, as a non-transitory computer readable storage medium, may be used to store non-transitory software programs, non-transitory computer executable programs, and modules, such as program instructions/modules corresponding to the screen fluency determination method in the embodiment of the present application (for example, the video acquisition module 31, the video frame deletion module 32, and the fluency determination module 33 shown in fig. 3). The processor 401 executes various functional applications of the server and data processing by running non-transitory software programs, instructions, and modules stored in the memory 402, that is, implements the screen fluency determination method in the above-described method embodiments.
The memory 402 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the electronic device of the screen fluency determination method, and the like. Further, the memory 402 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 402 may optionally include memory located remotely from the processor 401, and these remote memories may be connected to the electronic device of the screen fluency determination method via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The electronic device of the screen fluency determination method may further include: an input device 403 and an output device 404. The processor 401, the memory 402, the input device 403 and the output device 404 may be connected by a bus or other means, and fig. 4 illustrates an example of a connection by a bus.
The input device 403 may receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic apparatus of the screen fluency determination method, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, a pointing stick, one or more mouse buttons, a track ball, a joystick, or other input devices. The output devices 404 may include a display device, auxiliary lighting devices (e.g., LEDs), and haptic feedback devices (e.g., vibrating motors), among others. The display device may include, but is not limited to, a Liquid Crystal Display (LCD), a Light Emitting Diode (LED) display, and a plasma display. In some implementations, the display device can be a touch screen.
Various implementations of the systems and techniques described here can be realized in digital electronic circuitry, integrated circuitry, application specific ASICs (application specific integrated circuits), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
These computer programs (also known as programs, software applications, or code) include machine instructions for a programmable processor, and may be implemented using high-level procedural and/or object-oriented programming languages, and/or assembly/machine languages. As used herein, the terms "machine-readable medium" and "computer-readable medium" refer to any computer program product, apparatus, and/or device (e.g., magnetic discs, optical disks, memory, Programmable Logic Devices (PLDs)) used to provide machine instructions and/or data to a programmable processor, including a machine-readable medium that receives machine instructions as a machine-readable signal. The term "machine-readable signal" refers to any signal used to provide machine instructions and/or data to a programmable processor.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.
According to the technical scheme of the embodiment of the application, the effect of determining the screen fluency of the equipment to be tested is achieved, and the method does not depend on the support of the operating system of the equipment to be tested, so that the problem of shielding the operating system of the equipment to be competitive products is avoided, the method can be used for testing the screen fluency of any equipment to be competitive products, and the application range of the screen fluency test is expanded.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present application may be executed in parallel, sequentially, or in different orders, and the present invention is not limited thereto as long as the desired results of the technical solutions disclosed in the present application can be achieved.
The above-described embodiments should not be construed as limiting the scope of the present application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (16)
1. A method of screen fluency determination, the method comprising:
acquiring a video shot by shooting equipment; the video is shot when the screen interface of the equipment to be tested performs sliding operation;
for at least two continuous video frames with similarity greater than a set threshold in the video, deleting the at least two video frames to enable the at least two video frames to remain one video frame;
and determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video.
2. The method of claim 1, wherein prior to acquiring the video captured by the capture device, the method further comprises:
and acquiring control parameters, controlling the mechanical arm to execute sliding operation on a screen interface of the equipment to be tested according to the control parameters, and controlling the shooting equipment to carry out video shooting on the screen.
3. The method of claim 1, wherein before performing video frame deletion on at least two consecutive video frames in the video, the at least two consecutive video frames having a similarity greater than a set threshold, the method further comprises:
and for each video frame in the video, cutting an area of the video frame, which contains a main body for executing the sliding operation.
4. The method of claim 3, wherein cropping the region of the video frame that contains the subject performing the sliding operation comprises:
determining a preset position area in the video frame as an area containing a main body for executing the sliding operation, and cutting the preset position area from the video frame; alternatively, the first and second electrodes may be,
and identifying the area containing the main body for executing the sliding operation in the video frame according to the image characteristics of the video frame, and cutting the identified area from the video frame.
5. The method of claim 1, wherein for at least two consecutive video frames in the video with similarity greater than a set threshold, performing video frame deletion on the at least two video frames to make the at least two video frames one video frame left comprises:
performing a stacking operation on the shot first video frame;
sequentially deleting the n-th video frame if the similarity between the n-th video frame and the video frame at the stack top is larger than a preset threshold value for the shot n-th video frame, otherwise, performing a stacking operation on the n-th video frame; and N is an integer which is greater than 1 and less than or equal to N, and N is the total number of video frames in the video obtained by shooting.
6. The method of claim 1, wherein after determining the screen fluency of the device under test from the total number of video frames remaining in the video, the method further comprises:
and generating a test report according to the determined screen fluency of the plurality of devices to be tested, wherein the test report comprises a test scene, the total number of the remaining video frames corresponding to each device to be tested and a contrast test conclusion of the screen fluency of each device to be tested.
7. The method of any of claims 1-6, wherein the device under test comprises a smart sound box.
8. A screen fluency determination apparatus, the apparatus comprising:
the video acquisition module is used for acquiring a video shot by the shooting equipment; the video is shot when the screen interface of the equipment to be tested performs sliding operation;
the video frame deleting module is used for deleting at least two continuous video frames with similarity greater than a set threshold value in the video so as to enable the at least two video frames to remain one video frame;
and the fluency determination module is used for determining the screen fluency of the equipment to be tested according to the total number of the remaining video frames in the video.
9. The apparatus according to claim 8, wherein the apparatus further comprises a control parameter obtaining module, specifically configured to:
and acquiring control parameters, controlling the mechanical arm to execute sliding operation on a screen interface of the equipment to be tested according to the control parameters, and controlling the shooting equipment to carry out video shooting on the screen.
10. The apparatus according to claim 8, wherein the apparatus further comprises a region cropping module, specifically configured to:
and for each video frame in the video, cutting an area of the video frame, which contains a main body for executing the sliding operation.
11. The apparatus of claim 10, wherein the region cropping module is further specifically configured to:
determining a preset position area in the video frame as an area containing a main body for executing the sliding operation, and cutting the preset position area from the video frame; alternatively, the first and second electrodes may be,
and identifying the area containing the main body for executing the sliding operation in the video frame according to the image characteristics of the video frame, and cutting the identified area from the video frame.
12. The apparatus of claim 8, wherein the video frame deletion module is specifically configured to:
performing a stacking operation on the shot first video frame;
sequentially deleting the n-th video frame if the similarity between the n-th video frame and the video frame at the stack top is larger than a preset threshold value for the shot n-th video frame, otherwise, performing a stacking operation on the n-th video frame; and N is an integer which is greater than 1 and less than or equal to N, and N is the total number of video frames in the video obtained by shooting.
13. The apparatus according to claim 8, wherein the apparatus further comprises a test report generation module, specifically configured to:
and generating a test report according to the determined screen fluency of the plurality of devices to be tested, wherein the test report comprises a test scene, the total number of the remaining video frames corresponding to each device to be tested and a contrast test conclusion of the screen fluency of each device to be tested.
14. The apparatus of any of claims 8-13, wherein the device under test comprises a smart sound box.
15. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein the content of the first and second substances,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the screen fluency determination method of any of claims 1-7.
16. A non-transitory computer readable storage medium storing computer instructions for causing a computer to perform the screen fluency determination method of any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010865392.3A CN112015644A (en) | 2020-08-25 | 2020-08-25 | Screen fluency determination method, device, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010865392.3A CN112015644A (en) | 2020-08-25 | 2020-08-25 | Screen fluency determination method, device, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112015644A true CN112015644A (en) | 2020-12-01 |
Family
ID=73502170
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010865392.3A Pending CN112015644A (en) | 2020-08-25 | 2020-08-25 | Screen fluency determination method, device, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112015644A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114173194A (en) * | 2021-12-08 | 2022-03-11 | 广州品唯软件有限公司 | Page fluency detection method and device, server and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106681898A (en) * | 2015-11-05 | 2017-05-17 | 广州市动景计算机科技有限公司 | Method and device for acquiring application performance data |
| CN108174191A (en) * | 2017-12-29 | 2018-06-15 | 广州虎牙信息科技有限公司 | Video fluency test method, computer storage media and terminal |
| CN110430425A (en) * | 2019-07-31 | 2019-11-08 | 北京奇艺世纪科技有限公司 | A kind of video fluency determines method, apparatus, electronic equipment and medium |
| CN111147884A (en) * | 2020-01-02 | 2020-05-12 | 广州虎牙科技有限公司 | Data processing method, device, system, user side and storage medium |
| CN111159042A (en) * | 2019-12-31 | 2020-05-15 | 可牛网络技术（北京）有限公司 | Fluency testing method and device and electronic equipment |
-
2020
- 2020-08-25 CN CN202010865392.3A patent/CN112015644A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106681898A (en) * | 2015-11-05 | 2017-05-17 | 广州市动景计算机科技有限公司 | Method and device for acquiring application performance data |
| CN108174191A (en) * | 2017-12-29 | 2018-06-15 | 广州虎牙信息科技有限公司 | Video fluency test method, computer storage media and terminal |
| CN110430425A (en) * | 2019-07-31 | 2019-11-08 | 北京奇艺世纪科技有限公司 | A kind of video fluency determines method, apparatus, electronic equipment and medium |
| CN111159042A (en) * | 2019-12-31 | 2020-05-15 | 可牛网络技术（北京）有限公司 | Fluency testing method and device and electronic equipment |
| CN111147884A (en) * | 2020-01-02 | 2020-05-12 | 广州虎牙科技有限公司 | Data processing method, device, system, user side and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114173194A (en) * | 2021-12-08 | 2022-03-11 | 广州品唯软件有限公司 | Page fluency detection method and device, server and storage medium |
| CN114173194B (en) * | 2021-12-08 | 2024-04-12 | 广州品唯软件有限公司 | Page smoothness detection method and device, server and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8823383B2 (en) | System and method for electrostatic discharge testing of devices under test | |
| CN110659600B (en) | Object detection method, device and equipment | |
| CN111225236B (en) | Method and device for generating video cover, electronic equipment and computer-readable storage medium | |
| CN113190106B (en) | Gesture recognition method and device and electronic equipment | |
| CN111984476A (en) | Test method and device | |
| US20140282386A1 (en) | Capture and display of historical run-time execution traces in a code editor | |
| EP3852007A2 (en) | Method, apparatus, electronic device, readable storage medium and program for classifying video | |
| CN110648294A (en) | Image restoration method and device and electronic equipment | |
| CN113325954B (en) | Method, apparatus, device and medium for processing virtual object | |
| US20160077955A1 (en) | Regression testing of responsive user interfaces | |
| KR20210042284A (en) | Video type detection method, apparatus, electronic device and storage medium | |
| CN111935506B (en) | Method and apparatus for determining repeating video frames | |
| CN112507090A (en) | Method, apparatus, device and storage medium for outputting information | |
| CN111858318A (en) | Response time testing method, device, equipment and computer storage medium | |
| CN111784757A (en) | Training method of depth estimation model, depth estimation method, device and equipment | |
| CN111783639A (en) | Image detection method and device, electronic equipment and readable storage medium | |
| CN112507833A (en) | Face recognition and model training method, device, equipment and storage medium | |
| CN109359029A (en) | It is a kind of automate non-intrusion type Android apply accessible support detection method | |
| CN111695516A (en) | Thermodynamic diagram generation method, device and equipment | |
| CN112015644A (en) | Screen fluency determination method, device, equipment and medium | |
| CN111970560B (en) | Video acquisition method and device, electronic equipment and storage medium | |
| CN111918073B (en) | Live broadcast room management method and device | |
| CN110798681B (en) | Monitoring method and device of imaging equipment and computer equipment | |
| US20230139994A1 (en) | Method for recognizing dynamic gesture, device, and storage medium | |
| CN111242455A (en) | Method and device for evaluating voice function of electronic map, electronic equipment and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20210512 Address after: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant after: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. Applicant after: Shanghai Xiaodu Technology Co.,Ltd. Address before: 100085 Baidu Building, 10 Shangdi Tenth Street, Haidian District, Beijing Applicant before: BEIJING BAIDU NETCOM SCIENCE AND TECHNOLOGY Co.,Ltd. |
|
| TA01 | Transfer of patent application right |