CN116109817A - Identification method and identification device for display screen icon flickering and electronic equipment - Google Patents
Identification method and identification device for display screen icon flickering and electronic equipment Download PDFInfo
- Publication number
- CN116109817A CN116109817A CN202211737476.4A CN202211737476A CN116109817A CN 116109817 A CN116109817 A CN 116109817A CN 202211737476 A CN202211737476 A CN 202211737476A CN 116109817 A CN116109817 A CN 116109817A
- Authority
- CN
- China
- Prior art keywords
- icon
- display screen
- identified
- color
- flicker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/25—Determination of region of interest [ROI] or a volume of interest [VOI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/02—Recognising information on displays, dials, clocks
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for identifying the flicker of a display screen icon, which comprises the following steps: setting an icon expected value and an identification area of the display screen according to prior information displayed by the display screen, and setting an interested area; acquiring an instrument image according to the set identification area, and storing the acquired image into a series of pictures according to the acquisition sequence; detecting outline display states of icons to be identified in an interested region in a series of pictures in N periods; and under the condition that the outline display state of the icon to be identified is continuously unchanged, judging whether the icon to be identified in the region of interest of the picture is displayed or not under the condition that the flicker does not occur in the region of interest of the picture according to whether the outline of the icon to be identified in the region of interest of each frame of picture is displayed or not. By utilizing the method and the device, the accuracy and generalization of the flicker recognition of the display screen icons are improved.
Description
Technical Field
The invention relates to a method for identifying the flicker of a display screen icon, and also relates to a corresponding identification device and electronic equipment, belonging to the technical field of image identification.
Background
In the prior art, various information indication icons and alarm icons are usually arranged on a liquid crystal display screen of a vehicle machine. Under different usage scenarios, the icons may be displayed at different frequencies or in a specific color, or may disappear, or may blink at a certain frequency.
In chinese patent No. ZL 201580076251.0, an imaging apparatus capable of detecting flickering with high accuracy even when a bright subject is photographed is disclosed. The digital camera performs imaging a plurality of times at an arbitrary frame rate by the MOS type imaging element, and detects the presence or absence of flicker by comparing captured image signals read out from the imaging element during frame periods (F1, F2) based on the frame rate. The end time of the signal read-out period in the frame period (F1) is earlier than the end time of the frame period (F1), and the end time of the signal read-out period in the frame period (F2) is the same as the end time of the frame period (F2).
In addition, in the chinese patent application with application number 202010173128.3, an automatic detection system and detection method for an automobile instrument panel based on machine vision are disclosed. The system comprises: the device comprises an upper computer, an electric control unit, a visible light camera, an instrument panel detection device, an IO module, a CAN bus and instrument panel detection software. The upper computer sends a control instruction to the electric control unit through the IO module and controls the starting up of the visible light camera, and the electric control unit processes the data and controls each part of the instrument panel to display the corresponding state through the MCU module. The visible light camera realizes counting synchronization with the instrument panel through the IO module, ensures that the visible light camera at the corresponding position is used for capturing pictures when the display state of the instrument panel changes, converts the captured pictures into digital signals and transmits the digital signals to instrument panel detection software, and the software processes the pictures and then compares the pictures with related instructions in a database. And finally, transmitting a qualified signal to an alarm, and alarming if the signal is unqualified.
Disclosure of Invention
The invention aims to provide a method for identifying the flickering of a display screen icon.
Another technical problem to be solved by the invention is to provide a device for identifying the flickering of the display screen icon.
A further technical problem to be solved by the present invention is to provide an electronic device for implementing the above identification method.
In order to achieve the technical purpose, the invention adopts the following technical scheme:
according to a first aspect of an embodiment of the present invention, there is provided a method for identifying blinking of a display screen icon, including the steps of:
s1: setting an icon expected value and an identification area of the display screen according to prior information displayed by the display screen, and setting an interested area;
s2: acquiring an instrument image according to the set identification area, and storing the acquired image into a series of pictures according to the acquisition sequence;
s3: detecting outline display states of icons to be identified in an interested region of a series of pictures in N periods, wherein N is a positive integer;
s4: judging whether the icon to be identified in the region of interest of the picture is displayed or not under the condition that the flicker does not occur in the region of interest of the picture according to whether the icon to be identified in the region of interest of each frame of picture has a display contour or not under the condition that the contour display state of the icon to be identified is continuously unchanged; if yes, entering step S5; if not, outputting a recognition result;
s5: carrying out color recognition on the icon to be recognized in the interested area of each frame of picture, judging whether the icon accords with a color expected value, and if so, indicating that the color verification is passed; if not, the color verification is not passed, and the current color is recorded.
Preferably, in S3, subtraction processing is performed on two adjacent frames of pictures, absolute values are taken from the result, the absolute values are stored in a list,
if the absolute values in the list are all 0, the outline display state of the icon to be identified in the interested area of the adjacent two frames of pictures is unchanged; the absolute value in the list is 1, which indicates that the outline display state of the icon to be identified in the interested area of the two adjacent frames of pictures is changed.
Preferably, in N periods, if the absolute value in the list is continuously 0, the outline display state of the icon to be identified is continuously unchanged, the interested area does not flash, and the step S4 is entered; and when the absolute value in the list is hopped by 0 and 1, the change of the outline display state is indicated, and the hopping frequency is judged.
Wherein preferably, after S5, the method further comprises the steps of:
s6: judging whether the jump is uniform, if so, entering step S7; if the jump is not uniform, the step S8 is carried out;
s7: judging whether the hopping times meet the expected value of the hopping times according to the hopping times in one period, and outputting the identification result;
s8: and identifying the color of the jump of the icon to be identified in the region of interest, judging whether the jump meets the expected color value, and outputting an identification result.
Wherein in step S6, it is preferably determined whether the hopping is uniform according to the ratio of 0 or 1 in the distribution of 0 and 1 in the list.
Preferably, in the step S7, if the number of hops matches the expected value of the number of hops, the flicker frequency passes verification; if the hopping frequency does not accord with the expected value of the hopping frequency, the flicker frequency is not verified, and the current flicker frequency is recorded.
According to a second aspect of an embodiment of the present invention, there is provided a display screen icon flickering recognition device, including an image acquisition device, an image processing device, and a controller, wherein the controller is configured to perform the display screen icon flickering recognition method as described above;
the image acquisition device is used for acquiring images of the display screen and acquiring instrument images;
and acquiring the image of the instrument image according to a preset identification area through the image processing device.
According to a third aspect of the embodiment of the present invention, there is provided an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the method for identifying the blinking of the display screen icon as described above when executing the program.
Compared with the prior art, the method and the device have the advantages that the outline detection and the color detection are carried out on the display screen icons according to the characteristic that all the sub-outlines on the display screen have uniform similarity so as to obtain the display characteristics and the flicker characteristics of icon display, the accuracy of identifying the flicker of the display screen icons is improved, the generalization of the flicker identification of the display screen icons is further improved, the automatic detection is facilitated, and the product quality of the display screen is ensured.
Drawings
FIG. 1 is a flowchart of a method for recognizing blinking of a display screen icon according to a first embodiment of the present invention;
fig. 2A and 2B are two pictures of the original shooting and capturing of the flashing icon 3 (low tire pressure warning) in the first embodiment of the present invention;
FIG. 3 is a diagram showing a status of outline display (low tire pressure warning blinking icon) after subtraction of two (FIG. 2A, FIG. 2B) pictures according to a first embodiment of the present invention;
FIG. 4 is a graph showing the corrosion filtering effect in a first embodiment of the present invention;
FIG. 5 is a second view showing the corrosion filtering effect according to the first embodiment of the present invention;
FIG. 6 is a flowchart of a method for recognizing blinking of a display screen icon according to a second embodiment of the present invention;
fig. 7 is a flowchart of a method for identifying a display screen judging icon indicating time period according to a third embodiment of the present invention;
fig. 8 is a block diagram of an identification device according to a fourth embodiment of the present invention;
fig. 9 is a schematic structural diagram of an electronic device according to a sixth embodiment of the present invention.
Detailed Description
The technical contents of the present invention will be described in detail with reference to the accompanying drawings and specific examples.
The embodiment of the invention can detect all the flicker recognition of the display screen icons, and the display screen is taken as an example for the following description.
< first embodiment >
In different embodiments of the present invention, the meter image is an image that captures the content displayed on the display screen of the dashboard in real time, and may be a test image during the production phase of the vehicle, or may be an actual display image during the running of the vehicle, which is not particularly limited in the present invention. In one embodiment of the invention, in the vehicle production stage, the display screens arranged in a row sequentially pass through the camera, and the camera is used for collecting images so as to implement the method for identifying the icon flicker of the display screens.
As shown in fig. 1 to 3, a first embodiment of the present invention discloses a method for identifying icon flicker of a display screen, including:
s1: and setting an icon expected value and an identification area of the display screen according to the prior information displayed by the display screen, and setting an area of interest.
The icon expected value and the identification area of the display screen are set according to the prior information displayed by the display screen, and the region of interest (Region of Interest, abbreviated as ROI) 10 is set.
Wherein the icon expected values include: color expected value, number of hops expected value. The two expected values are used for judging whether the color verification and the jump frequency verification pass or not respectively, and judging whether the icon is successfully verified or not according to whether the two verification passes or not.
Since the number of hops is equal to 2 times the flicker frequency, the number of hops verifies whether or not it passes the same as the flicker frequency.
It should be noted that, for different vehicle types, the preset regions of interest 10 are different; or the icons to be identified are different, and the preset regions of interest 10 are also different. That is, the region of interest 10 is determined by the model or icon position to be identified.
S2: and acquiring the images of the display screen according to the set identification area, and storing the acquired images into a series of pictures according to the acquisition sequence.
And acquiring the instrument images according to the set identification areas, and storing the acquired images into a series of pictures according to the acquisition sequence. As shown in fig. 2A and 2B, the meter image is acquired according to the set identification area, and the acquired image is saved as a series of pictures in the acquisition order, and the names of the pictures are picture1, picture2 and picture3 … …. Each frame of picture comprises at least the complete region of interest 10.
When the instrument image is acquired through the camera, the RGB camera is preferably used, and the color information is accurately acquired; meanwhile, photographing is completed in a camera bellows environment, and reflected light interference can be effectively reduced. As shown in fig. 2A and 2B, the image acquisition modes include, but are not limited to, electronic screen capturing and photographing modes, and are automatically completed by the device, so that the image acquisition accuracy is improved.
The requirements on the frequency and the acquisition time of image acquisition are as follows:
if the expected value of the flicker frequency of the identification icon is f (expected flicker frequency), the expected flicker frequency of the icon is not less than 2 times the number of frames per second (fps) of image acquisition (i.e., the image acquisition frequency is 2 f), which is operated to ensure that the icon is subjected to 2 hops within one period, and identification is performed based on the detected hops.
For N consecutive cycles of image acquisition (i.e. the inverse of the expected flicker frequency), preferably 10 consecutive cycles. The display screen is stationary relative to the camera during these N periods to ensure that the position of each icon in each frame of pictures is fixed throughout the series of pictures. Wherein N is a positive integer.
After the image is acquired by using a photographing mode, if the image needs to be calibrated, the following method can be used: the first icon 1 and the second icon 2 which are preset are triggered to flash, as shown in fig. 2A, the positions of the two icons (the first icon 1 and the second icon 2) in the same frame of picture are obtained, and the proportional relation between the picture and the electronic design is obtained by comparing the difference of the positions of the two icons in the same frame of picture with the difference of the positions of the two icons (the known value in advance) displayed in the electronic design. And then the position of the icon 3 to be identified in the region of interest can be calculated through the proportional relation, the reference coordinates in one frame of picture, the positions of the first icon 1, the second icon 2 and the icon 3 to be identified in the electronic design drawing, which are known in advance, as shown by the icon 3 to be identified in fig. 2B.
The electronic design drawing is a known display screen original design engineering drawing. The proportion of the pictures shot by the camera is the same as that of the electronic design drawing. But picture calibration is not required if the image acquisition mode of electronic screen capturing is used.
S3: and detecting the outline display state of the icon 3 to be identified in the region of interest in a series of pictures in N periods.
Since the position of the icon 3 to be recognized has been calculated in step S2, the outline display state of the image at that position in each frame of picture is detected.
The outline display state of the detected icon 3 to be recognized is shown in fig. 3. The specific method for detecting the outline display state comprises the following steps: subtracting two adjacent frames of pictures, and taking absolute values of the results, namely |Picture2-Picture1|, to obtain the distribution of 0 and 1. Whether the profile display state is changed is judged by the distribution of 0 and 1.
As is well known, in the case of camera shooting, the subtraction of images generates a lot of residues, and the state of the contour subtraction of 0 cannot be achieved. Therefore, the invention uses corrosion to realize the filtration of interference, so that the picture pixel data does not have interference factors, therefore, the pixel data can only be all 0 or all 1, and all 0 means all off and all 1 means all on; the filtering effect of corrosion is shown in fig. 4 and 5. In addition to corrosion, the filtering may be performed by other methods of image morphology, which are known in the art and are not described herein.
And respectively corroding two adjacent frames of pictures, binarizing the pixel data of the two adjacent frames of pictures, subtracting the pixel data corresponding to the two frames of pictures after binarization, and storing the absolute values obtained by subtracting the pixel data corresponding to the two frames of pictures into a list.
Wherein the absolute values in the list are all 0, which indicates that the outline display state of the icon 3 to be identified in the interested area of the two adjacent frames of pictures is unchanged (i.e. the state of the pixel in the two frames of pictures is not changed in a bright and dark state); the absolute values in the list are all 1, which indicates that the outline display state of the icon 3 to be identified in the region of interest of the two adjacent frames of pictures changes (i.e. the pixel in the two frames of pictures changes in state of being on or off, or is on or off).
And then determining the change of the outline display state of the icon 3 to be identified according to the distribution of 0 and 1 in the list (namely, the distribution of 0 and 1 in the list). And in N periods, if the absolute value in the list of the icons 3 to be identified is continuously 0 in all the frame pictures, namely 1 does not appear in the N periods, the outline display state of the icons 3 to be identified is continuously unchanged, namely the interested area does not flicker, and the step S4 is performed. If the absolute value in the list of the icons 3 to be identified in all the frame pictures is hopped by 0 and 1 (i.e. not all 0 and not all 1), the outline display state is changed, i.e. the interested area flickers, and the step S6 is entered.
Here, there are two cases when the outline display state of the icon 3 to be recognized in the region of interest is continuously unchanged (i.e., the icon 3 does not blink):
(1) Icon 3 in the region of interest continues to light up (no extinction occurs during N cycles)
(2) The icon 3 in the region of interest remains unlit (no lighting occurs during N cycles)
Further determination is required for both cases, i.e. in step S4.
Because only one condition of flickering occurs on the icon 3 to be identified in the region of interest, namely, continuous jump of on and off is performed, and no continuous bright or unlit condition exists, step S4 is not needed, and only the frequency of jump is needed to be further judged, namely, step S6.
S4: and under the condition that the outline display state of the icon 3 to be identified is continuously unchanged, judging whether the icon 3 to be identified in the interested area of the picture is displayed under the condition that the interested area does not flicker according to whether the icon 3 to be identified in the interested area of each frame of picture is displayed.
If the icon 3 to be identified in the region of interest has a contour, that is, the icon 3 to be identified in the region of interest has a display, step S5 is entered; if the icon 3 to be identified in the region of interest does not display an outline, that is, the icon 3 to be identified in the region of interest is not displayed, it is further determined whether the icon is not displayed to conform to the expected color value, and the step S9 is proceeded.
Optionally, whether the icon 3 to be identified has a display contour is judged by the contour pixel RGB value, if the contour pixel RGB value is greater than 0, the icon 3 to be identified is indicated to have the display contour; if the contour pixel RGB value is equal to 0, it indicates that the icon 3 to be identified has no contour displayed.
S5: and (3) carrying out color recognition on the icon 3 to be recognized in the region of interest in each frame of picture, judging whether the icon accords with the expected color value, and entering step S9.
If the icon 3 to be identified in the region of interest in each frame of picture is subjected to color identification, judging that the icon meets the expected color value, and passing the color verification; if not, the color verification is not passed.
Optionally, whether the color of the icon 3 to be identified meets the expected color value is determined by the RGB value of each contour pixel of the icon 3 to be identified. Wherein the expected value of the color is a set value, for example: the tire pressure icon is yellow, the high beam icon is blue, and the low beam icon is green, and the color setting is defined by each manufacturer, so the invention is not limited.
S6: and judging whether the jump is uniform.
The jump is judged to be uniform based on the distribution of 0 and 1 in the list, where the duty ratio (duty ratio) of 0 or 1 is 40 to 60% (preferably 50%). If the jump is uniform, the step S7 is carried out; if the hopping is not uniform, the hopping number is not in accordance with the expected value, and the process proceeds to step S9.
S7: and judging whether the hopping times meet the expected value of the hopping times according to the hopping times in one period, and entering step S8.
If the hopping frequency in one period is equal to 2f, the hopping frequency is consistent with the expected value of the hopping frequency; if the hopping number in one period is not equal to 2f, the hopping number is not in accordance with the expected value of the hopping number.
If the hopping times meet the expected value of the hopping times, the hopping times pass verification, namely the flicker frequency passes verification; if the hopping frequency does not accord with the expected value of the hopping frequency, the hopping frequency is verified to be not passed, namely the flicker frequency is verified to be not passed, and the current flicker frequency is recorded.
S8: and identifying the color of the jump of the icon 3 to be identified in the region of interest, judging whether the color meets the expected value of the color, and entering step S9.
Optionally, whether the color meets the color expected value is judged by the contour pixel RGB value of the icon 3 to be identified.
If the color accords with the color expected value, the color verification is passed; if the color does not meet the expected value of the color, the color verification is not passed, and the current color is recorded.
S9: and (3) summarizing the jump times and the color results judged in the steps S4-S8 according with the icon expected values, and outputting a recognition result report.
If the color verification and the flicker frequency verification are passed, the icon is indicated to be displayed normally, namely the icon verification is successful; if any one or all of the color verification or the jump number verification is not passed, the icon is indicated to be displayed abnormally, namely the icon verification fails.
When the icon is successfully verified, the output form of the result report is as follows: color, flicker frequency verification was successful. When the icon verification fails, the result report has the following three output forms:
1. if the color verification is not passed and the flicker frequency verification is passed, the output flicker frequency accords with the expected value. The color does not accord with the expected value, and the current color is output;
2. and if the color verification is passed and the flicker frequency verification is not passed, outputting that the flicker frequency does not accord with the expected value, and outputting the current flicker frequency. The color meets the expected value;
3. if the color verification is not passed and the flicker frequency verification is not passed, outputting that the flicker frequency does not accord with the expected value, and outputting the current flicker frequency. The color does not conform to the expected value and the current color is output.
It should be noted that, in this embodiment, a display screen displaying instrument information on a vehicle is described as an example, which is only for explaining the method for identifying the flicker of the display screen, and the method for identifying the flicker of the display screen is not limited to be applied to the detection of the display screen of the vehicle, and the method for identifying the flicker of the display screen can be applied to the detection and identification of various display screens, and has a wide application prospect.
< second embodiment >
As shown in fig. 6, a second embodiment of the present invention discloses another method for identifying icon flickering of a display screen, which includes the following steps:
s1 to S2 are the same as those of the first embodiment of the present invention, and are not described here again.
S3: and (2) extracting the colors of the icons in the interested area of the picture stored in the step (S2), writing the icons into a list, and judging whether the colors jump or not according to the list content.
Optionally, cluster extraction is performed according to the colors of the icons, and at least one group of colors is extracted;
preferably, two sets of primary colors, namely a first primary color and a second primary color, are extracted. In the judging process, two groups of main colors are respectively judged.
If the color jumps, entering step S4; if no color jump occurs, the process proceeds to step S6.
S4: and judging whether the jump is uniform.
To improve the accuracy of the detection, it can be detected whether the occurrence of the jump is sufficiently uniform to prove whether it corresponds to a flicker with a duty cycle of 50%.
If the jump is uniform, entering step S5; if the hopping is not uniform, the hopping is not in accordance with the expected value of the hopping number, and the step S7 is performed.
S5: and judging whether the hopping times meet the expected value of the hopping times according to the hopping times in one period, and entering step S7.
If the hopping frequency in one period is equal to 2f, the hopping frequency is consistent with the expected value of the hopping frequency; if the hopping number in one period is not equal to 2f, the hopping number is not in accordance with the expected value of the hopping number.
S6: and comparing the color of the icon with the background color, and judging whether the icon is normally bright.
Wherein the background color is fixed to gray black.
If the icon color is the same as the background color, the icon is not normally bright, whether the situation accords with the color expected value is judged, and the step S8 is carried out; if the icon color does not match the background color, the icon is normally bright, and the process proceeds to step S7.
Optionally, whether the color meets the color expected value is judged through the RGB value of the icon.
S7: and judging whether the icon color accords with the color expected value or not, and proceeding to step S8.
Optionally, whether the color meets the color expected value is judged through the RGB value of the icon.
S8: and (3) summarizing the jump times and the color results judged in the steps S4-S7 according with the icon expected values, and outputting a result report.
The form of the output result report is the same as that described in the first embodiment of the present invention, and will not be described here again.
< third embodiment >
As shown in fig. 7, a third embodiment of the present invention discloses a method for identifying a display screen icon indication time period, which includes the following steps:
s1: setting an expected value of the icon display time length, and starting to collect images after the setting is completed.
S2: comparing the acquired images of each frame, and judging whether the icon appears or not.
If the icon appears, the step S3 is entered; if the icon does not appear, the expected value is not met, and the process proceeds to step S5.
The method for determining the appearance of the icon is the same as the method for determining the outline display state in the first embodiment of the present invention, and will not be described herein.
S3: and (4) timing the appearing icon, closing the timing after the icon disappears, judging whether the timing duration accords with the expected value, and entering step S4.
S4: and outputting a test result.
< fourth embodiment >
As shown in fig. 8, a fourth embodiment of the present invention further provides a device for recognizing blinking of a display screen icon, including: the image processing apparatus includes an image acquisition apparatus, an image processing apparatus, and a controller configured to execute the recognition method of the display screen icon flickering in the first to third embodiments.
The image acquisition device is an RGB camera to accurately acquire color information; the photographing is completed in the dark box environment, so that the interference of reflected light can be effectively reduced; the camera device is rigidly connected with the display screen, so that the calibration data can be reused.
In one embodiment of the invention, the page switching device capable of triggering the switching of the display content of the display screen is used for switching the display content of the display screen, for example, the display content of the display screen is switched from text information, image information or video information to display of the display screen, so that the display screen identification device is convenient for acquiring the display screen displayed on the display screen and identifying the acquired image.
It is worth to say that, when the display content of display screen is not the display screen, display screen recognition device gathers and discerns the display content, judges when unable recognition display screen profile to be the display screen not, and the discernment is exited, waits for again receiving the image of gathering and discerns again.
The page switching device is not particularly limited, and may be a switching device connected to the display screen through a wired or wireless network, or may be a switching device connected to the display screen through a CAN interface of the vehicle, so that the display content of the display screen CAN be switched to a design criterion, which is not described herein.
In an alternative example, the display screen identification device further includes a log unit for recording identification information, and the controller is further configured to: and recording the judging result through the log unit.
In one embodiment of the present invention, the result of the recognition of the meter image is recorded by the log unit, for example, the result of the comparison of the display data and the pointer readout data in the foregoing embodiment is recorded. It should be noted that the log unit is not specifically limited in the present invention, the identification result of the instrument identification device on the display screen may be recorded, and the running record of the vehicle may be obtained through the log interface connected to the vehicle, for example, the sensing data of the vehicle sensor may be obtained, which is not described herein.
< fifth embodiment >
Another embodiment of the present invention provides a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of recognizing display screen icon flickering in the first to third embodiments.
In practical applications, the computer-readable storage medium may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In one embodiment of the invention, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
< sixth embodiment >
Fig. 9 is a schematic structural diagram of an electronic device 12 according to a sixth embodiment of the present invention. It should be noted that the electronic device 12 shown in fig. 9 is only an example, and should not be construed as limiting the function and scope of use of the embodiment of the present invention.
As shown in fig. 9, the electronic device 12 is in the form of a general purpose computing device. Components of the electronic device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, a bus 18 that connects the various system components, including the system memory 28 and the processing units 16.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 30 and/or cache memory 32. The electronic device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 9, commonly referred to as a "hard disk drive"). Although not shown in fig. 9, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 18 through one or more data medium interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored in, for example, memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 42 generally perform the functions and/or methods of the embodiments described herein.
The electronic device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the electronic device 12, and/or any devices (e.g., network card, modem, etc.) that enable the electronic device 12 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 22. Also, the electronic device 12 may communicate with one or more networks such as a Local Area Network (LAN), a Wide Area Network (WAN) and/or a public network, such as the Internet, through a network adapter 20. As shown in fig. 9, the network adapter 20 communicates with other modules of the electronic device 12 over the bus 18. It should be appreciated that although not shown in fig. 9, other hardware and/or software modules may be used in connection with electronic device 12, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processor unit 16 executes various functional applications and data processing by running a program stored in the system memory 28, for example, implements the recognition method of display screen icon flickering in the first to third embodiments of the present invention.
Compared with the prior art, the method and the device have the advantages that the outline detection and the color detection are carried out on the display screen icons according to the characteristic that all the sub-outlines on the display screen have uniform similarity so as to obtain the display characteristics and the flicker characteristics of icon display, the accuracy of identifying the flicker of the display screen icons is improved, the generalization of the flicker identification of the display screen icons is further improved, the automatic detection is facilitated, and the product quality of the display screen is ensured.
The identification method, the identification device and the electronic equipment for the flicker of the display screen icon provided by the invention are described in detail. Any obvious modifications to the present invention, without departing from the spirit thereof, would constitute an infringement of the patent rights of the invention and would take on corresponding legal liabilities.
Claims (8)
1. The method for identifying the flickering of the display screen icon is characterized by comprising the following steps:
s1: setting an icon expected value and an identification area of the display screen according to prior information displayed by the display screen, and setting an interested area;
s2: acquiring the images of the display screen according to the set identification area, and storing the acquired images into a series of pictures according to the acquisition sequence;
s3: detecting outline display states of icons to be identified in an interested region of a series of pictures in N periods, wherein N is a positive integer;
s4: judging whether the icon to be identified in the region of interest of the picture is displayed or not under the condition that the flicker does not occur in the region of interest of the picture according to whether the icon to be identified in the region of interest of each frame of picture has a display contour or not under the condition that the contour display state of the icon to be identified is continuously unchanged; if yes, entering step S5; if not, outputting a recognition result;
s5: carrying out color recognition on the icon to be recognized in the interested area of each frame of picture, judging whether the icon accords with a color expected value, and if so, indicating that the color verification is passed; if not, the color verification is not passed, and the current color is recorded.
2. The method for recognizing flicker of a display screen icon according to claim 1, wherein:
in S3, subtracting the two adjacent frames of pictures, taking absolute value of the result, storing the absolute value into a list,
if the absolute values in the list are all 0, the outline display state of the icon 3 to be identified in the interested area of the adjacent two frames of pictures is unchanged; the absolute value in the list is 1, which indicates that the outline display state of the icon to be identified in the interested area of the two adjacent frames of pictures is changed.
3. The method for recognizing flicker of a display screen icon according to claim 2, wherein:
in the N periods, if the absolute value in the list is continuously 0, the outline display state of the icon to be identified is continuously unchanged, the interested area does not flash, and the step S4 is entered; and when the absolute value in the list is hopped by 0 and 1, the change of the outline display state is indicated, and the hopping frequency is judged.
4. The method for recognizing flicker of a display screen icon according to claim 1, wherein: after S5, the method further comprises the steps of:
s6: judging whether the jump is uniform, if so, entering step S7; if the jump is not uniform, the step S8 is carried out;
s7: judging whether the hopping times meet the expected value of the hopping times according to the hopping times in one period, and outputting the identification result;
s8: and identifying the color of the jump of the icon to be identified in the region of interest, judging whether the jump meets the expected color value, and outputting an identification result.
5. The method for recognizing flicker of a display screen icon according to claim 4, wherein:
in step S6, it is determined whether the hopping is uniform according to the duty ratio of 0 or 1 in the distribution of 0 and 1 in the list.
6. The method for recognizing flicker of a display screen icon according to claim 4, wherein:
in the step S7, if the hopping number meets the expected value of the hopping number, the flicker frequency passes verification; if the hopping frequency does not accord with the expected value of the hopping frequency, the flicker frequency is not verified, and the current flicker frequency is recorded.
7. The device for identifying the flickering of the display screen icon is characterized by comprising an image acquisition device, an image processing device and a controller, wherein,
the controller is configured to perform the method of recognizing blinking of a display screen icon as set forth in any one of claims 1 to 6;
the image acquisition device is used for acquiring images of the display screen and acquiring instrument images;
and acquiring the image of the instrument image according to a preset identification area through the image processing device.
8. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized by:
when the processor executes the program, the method for recognizing the flickering of the display screen icon according to any one of claims 1 to 6 is realized.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211737476.4A CN116109817A (en) | 2022-12-31 | 2022-12-31 | Identification method and identification device for display screen icon flickering and electronic equipment |
PCT/CN2023/128509 WO2024139668A1 (en) | 2022-12-31 | 2023-10-31 | Display screen icon flickering identification method, identification apparatus, and electronic device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202211737476.4A CN116109817A (en) | 2022-12-31 | 2022-12-31 | Identification method and identification device for display screen icon flickering and electronic equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116109817A true CN116109817A (en) | 2023-05-12 |
Family
ID=86260872
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202211737476.4A Pending CN116109817A (en) | 2022-12-31 | 2022-12-31 | Identification method and identification device for display screen icon flickering and electronic equipment |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN116109817A (en) |
WO (1) | WO2024139668A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024139668A1 (en) * | 2022-12-31 | 2024-07-04 | 瞬联软件科技(北京)有限公司 | Display screen icon flickering identification method, identification apparatus, and electronic device |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6320503B1 (en) * | 2016-12-28 | 2018-05-09 | オリンパス株式会社 | Imaging apparatus, flicker detection method, and program |
CN110654237B (en) * | 2018-06-29 | 2022-02-08 | 比亚迪股份有限公司 | Vehicle body icon display method and device, vehicle and storage medium |
CN111239158A (en) * | 2020-03-13 | 2020-06-05 | 苏州鑫睿益荣信息技术有限公司 | Automobile instrument panel detection system and detection method based on machine vision |
CN114489608B (en) * | 2022-01-17 | 2022-08-16 | 星河智联汽车科技有限公司 | Display screen icon control method and device, terminal equipment and storage medium |
CN116109817A (en) * | 2022-12-31 | 2023-05-12 | 瞬联软件科技(北京)有限公司 | Identification method and identification device for display screen icon flickering and electronic equipment |
-
2022
- 2022-12-31 CN CN202211737476.4A patent/CN116109817A/en active Pending
-
2023
- 2023-10-31 WO PCT/CN2023/128509 patent/WO2024139668A1/en unknown
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024139668A1 (en) * | 2022-12-31 | 2024-07-04 | 瞬联软件科技(北京)有限公司 | Display screen icon flickering identification method, identification apparatus, and electronic device |
Also Published As
Publication number | Publication date |
---|---|
WO2024139668A1 (en) | 2024-07-04 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20190266966A1 (en) | Gray scale adjustment method and device for display panel | |
WO2024139668A1 (en) | Display screen icon flickering identification method, identification apparatus, and electronic device | |
CN111654692B (en) | Camera detection method and device, camera and storage medium | |
CN111445452B (en) | Defect detection method and device of electronic product and computer readable storage medium | |
CN112147439A (en) | Instrument detection method, device, equipment, storage medium and system | |
CN117130186B (en) | LCD display screen flaw defect intelligent detection method | |
US20190180112A1 (en) | Method, device, and non-transitory computer readable medium for searching video event | |
CN114430461B (en) | Method, device, terminal and storage medium for realizing soft photosensitivity based on deep learning | |
CN116007909A (en) | Car lamp testing method and car lamp testing system | |
CN116051373A (en) | Image stitching method, image stitching device and terminal equipment | |
CN116016909A (en) | Television partition backlight detection system and method | |
CN102368946B (en) | Pupil covering state detection device, and in-vehicle camera provided therewith | |
CN115423861A (en) | Gas leakage detection method and device, equipment and storage medium | |
CN110674012B (en) | Information indication method, device and storage medium | |
JPH1131296A (en) | Parking lot managing method/device | |
CN114460862A (en) | Camera equipment ring test simulation method applied to ADAS | |
CN112989866B (en) | Object recognition method, device, electronic equipment and readable storage medium | |
JPH05130512A (en) | Picture element defect measuring instrument for solid-state image pickup element | |
KR102192247B1 (en) | camera with event filtering feature and event filtering method for camera | |
KR100468643B1 (en) | Device and method for moving detecting in watching system | |
CN113469297B (en) | Image tampering detection method, device, equipment and computer readable storage medium | |
JP2002262282A (en) | Image supervisory method and image supervisory device | |
CN115272911A (en) | Blast furnace tuyere abnormal state evaluation method, device and storage medium | |
JPH04311186A (en) | Image monitoring device | |
CN116862905A (en) | Method, device and equipment for detecting display panel and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |