CN114501287A - Method, device and system for detecting working state of electronic equipment - Google Patents
Method, device and system for detecting working state of electronic equipment Download PDFInfo
- Publication number
- CN114501287A CN114501287A CN202210087184.4A CN202210087184A CN114501287A CN 114501287 A CN114501287 A CN 114501287A CN 202210087184 A CN202210087184 A CN 202210087184A CN 114501287 A CN114501287 A CN 114501287A
- Authority
- CN
- China
- Prior art keywords
- image
- gray
- electronic equipment
- condition
- value
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 39
- 238000001514 detection method Methods 0.000 claims abstract description 48
- 238000012360 testing method Methods 0.000 claims description 27
- 238000004590 computer program Methods 0.000 claims description 8
- 238000006243 chemical reaction Methods 0.000 claims description 5
- 238000004519 manufacturing process Methods 0.000 abstract description 19
- 238000010191 image analysis Methods 0.000 abstract description 7
- 238000011156 evaluation Methods 0.000 abstract description 6
- 238000007689 inspection Methods 0.000 abstract description 5
- 241001270131 Agaricus moelleri Species 0.000 description 11
- 230000003287 optical effect Effects 0.000 description 9
- 239000003086 colorant Substances 0.000 description 8
- 238000012545 processing Methods 0.000 description 7
- 238000010586 diagram Methods 0.000 description 6
- 238000009825 accumulation Methods 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 238000010606 normalization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000001052 transient effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R29/00—Monitoring arrangements; Testing arrangements
- H04R29/004—Monitoring arrangements; Testing arrangements for microphones
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/40—Image enhancement or restoration using histogram techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
- G08B5/22—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission
- G08B5/36—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission using visible light sources
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/01—Assessment or evaluation of speech recognition systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Acoustics & Sound (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Electromagnetism (AREA)
- General Health & Medical Sciences (AREA)
- Otolaryngology (AREA)
- Signal Processing (AREA)
- Business, Economics & Management (AREA)
- Emergency Management (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the application discloses a method, a device and a system for detecting the working state of electronic equipment, which are used for acquiring an equipment image of the electronic equipment; the light component arranged on the electronic equipment can be lightened under the normal working state and can be extinguished under the non-working state. In order to reduce interference of images of other areas except the bright part and improve the efficiency of image analysis, an image of a target area where the bright part of the electronic device is located can be intercepted from the device image. In order to realize the evaluation of the brightness of the target area image, the target area image can be converted into a gray scale image; in the case that the gray value of the gray map satisfies the set wake-up condition, it may be determined that the electronic device belongs to a normal wake-up state. Compare in manual detection's mode, in this technical scheme, can evaluate the luminance in the regional of light component place on the electronic equipment to reach the automated inspection to electronic equipment production detection stage, greatly promoted the detection efficiency that electronic equipment produced the detection.
Description
Technical Field
The present disclosure relates to the field of electronic product detection technologies, and in particular, to a method, an apparatus, and a system for detecting a working state of an electronic device.
Background
The intelligent sound box combines emerging technologies such as voice recognition and natural language processing on the basis of the traditional sound box, so that the intelligent sound box has the functions of sound resource playing, intelligent voice interaction, intelligent home control and the like. The smart sound box is regarded as a future entrance of smart home due to its abundant product functions, and further becomes one of the fastest developing electronic products in the near term.
The production detection stage of the intelligent sound box is an important process for ensuring the normal work of the intelligent sound box. The test of the production detection stage may include whether the smart speaker is capable of being awakened normally, whether the smart speaker is capable of being networked normally, and the like. The current test mode needs to rely on manual work to detect, triggers the voice command of intelligent audio amplifier start work through the broadcast, and whether artificial recognition intelligent audio amplifier is awakened up etc.. In order to ensure the working stability of the intelligent sound box, a large number of repeatability tests are often required in the production detection stage. At present, the manual detection mode not only needs to consume more human resources, but also has lower detection efficiency.
Therefore, how to realize the automatic detection of the electronic device is a problem to be solved by those skilled in the art.
Disclosure of Invention
The embodiment of the application aims to provide a method, a device and a system for detecting the working state of electronic equipment, which can realize automatic detection of the electronic equipment.
In order to solve the foregoing technical problem, an embodiment of the present application provides a method for detecting a working state of an electronic device, including:
acquiring a device image of an electronic device;
intercepting a target area image in which a bright part of the electronic equipment is positioned from the equipment image;
converting the target area image into a gray scale image;
and under the condition that the gray value of the gray map meets the set awakening condition, determining that the electronic equipment belongs to a normal awakening state.
Optionally, the method further comprises:
acquiring a brightness value of the electronic equipment recorded by a light sensor;
and determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets a set awakening condition and the brightness value is greater than or equal to a set brightness threshold value.
Optionally, the method further comprises:
and recording the device image and the time stamp of the electronic device and setting a manual check mark under the condition that the gray scale value of the gray scale map meets the set awakening condition, the brightness value is smaller than the set brightness threshold value, or the gray scale value of the gray scale map does not meet the set awakening condition, and the brightness value is larger than or equal to the set brightness threshold value.
Optionally, after the step of intercepting the target area image in which the bright part of the electronic device is located from the device image, the method further includes:
counting colors corresponding to all pixel points in the target area image; wherein each color has its corresponding operating mode;
and under the condition that the ratio of the number of the pixel points corresponding to the target color to the number of all the pixel points of the target area image exceeds a set proportion value, judging that the electronic equipment belongs to the working mode corresponding to the target color.
Optionally, after the acquiring the device image of the electronic device, the method further includes:
judging whether the brightness of a background image in the equipment image exceeds a set threshold value or not; wherein the background image is an image of the device image except the target area image;
if the brightness of the background image in the equipment image exceeds a set threshold value, performing a gray histogram stipulation operation on the gray image to obtain an adjusted gray image;
correspondingly, when the gray value of the gray map meets the set wake-up condition, determining that the electronic device belongs to the normal wake-up state includes:
and determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the adjusted gray map meets the set awakening condition.
Optionally, in a case that the gray-scale value of the gray-scale map satisfies a set wake-up condition, determining that the electronic device belongs to a normal wake-up state includes:
calculating a gray average value of the gray map;
judging whether the gray average value is greater than or equal to a set gray lower limit value or not;
and if the average value of the gray scales is greater than or equal to a set lower limit value of the gray scales, determining that the electronic equipment belongs to a normal awakening state.
Optionally, when the gray scale value of the gray scale map meets a set wake-up condition, determining that the electronic device belongs to a normal wake-up state further includes:
adding one to the wakeup count value;
judging whether the awakening count value reaches a set count threshold value within set test time;
and under the condition that the awakening count value reaches a set count threshold value within set test time, judging that the awakening state of the electronic equipment is stable.
Optionally, after determining that the electronic device belongs to the normal wake-up state, the method further includes:
and recording the equipment image and the corresponding timestamp thereof, and controlling the electronic equipment to execute the operation flow corresponding to the normal awakening state.
The embodiment of the application also provides a device for detecting the working state of the electronic equipment, which comprises an acquisition unit, an interception unit, a conversion unit and a determination unit;
the acquisition unit is used for acquiring an equipment image of the electronic equipment;
the intercepting unit is used for intercepting a target area image where a bright part of the electronic equipment is located from the equipment image;
the conversion unit is used for converting the target area image into a gray scale image;
the determining unit is used for determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets a set awakening condition.
Optionally, the obtaining unit is configured to obtain a brightness value of the electronic device recorded by a light sensor;
the determining unit is used for determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets a set awakening condition and the brightness value is greater than or equal to a set brightness threshold.
Optionally, the system further comprises a setting unit;
the setting unit is used for recording the device image and the time stamp of the electronic device and setting the manual check identifier under the condition that the gray scale value of the gray scale map meets the set awakening condition, the brightness value is smaller than the set brightness threshold value, or the gray scale value of the gray scale map does not meet the set awakening condition, and the brightness value is larger than or equal to the set brightness threshold value.
Optionally, the system further comprises a statistic unit and a judgment unit;
the statistical unit is used for counting the color corresponding to each pixel point in the target area image; wherein each color has its corresponding operating mode;
the judging unit is used for judging that the electronic equipment belongs to the working mode corresponding to the target color under the condition that the ratio of the number of the pixel points corresponding to the target color to the number of all the pixel points of the target area image exceeds a set proportion value.
Optionally, the system further comprises a judging unit and an adjusting unit;
the judging unit is used for judging whether the brightness of the background image in the equipment image exceeds a set threshold value or not; wherein the background image is an image of the device image except the target area image;
the adjusting unit is used for executing a gray histogram stipulation operation on the gray image to obtain an adjusted gray image if the brightness of a background image in the equipment image exceeds a set threshold;
correspondingly, the determining unit is configured to determine that the electronic device belongs to a normal wake-up state when the gray scale value of the adjusted gray scale map meets a set wake-up condition.
Optionally, the determining unit is configured to calculate a mean grayscale value of the grayscale map; judging whether the gray average value is greater than or equal to a set gray lower limit value or not; and if the average value of the gray scales is greater than or equal to a set lower limit value of the gray scales, determining that the electronic equipment belongs to a normal awakening state.
Optionally, the system further comprises an accumulation unit, a counting judgment unit and a counting judgment unit;
the accumulation unit is used for adding one to the awakening count value;
the counting judgment unit is used for judging whether the awakening count value reaches a set counting threshold value within set test time;
and the counting judgment unit is used for judging that the electronic equipment is stable in the awakening state under the condition that the awakening count value reaches a set counting threshold value in set test time.
Optionally, a recording unit is further included;
and the recording unit is used for recording the equipment image and the corresponding timestamp thereof and controlling the electronic equipment to execute the operation flow corresponding to the normal awakening state.
The embodiment of the present application further provides a device for detecting an operating state of an electronic device, including:
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of the method for detecting the operating state of the electronic device as described above.
The embodiment of the application also provides a system for detecting the working state of the electronic equipment, which comprises an image collector and a processor;
the image collector is used for collecting an equipment image of the electronic equipment and transmitting the equipment image to the processor;
the processor is used for acquiring a device image of the electronic device; intercepting a target area image where a bright part of the electronic equipment is located from the equipment image; converting the target area image into a gray scale image; and under the condition that the gray value of the gray map meets the set awakening condition, determining that the electronic equipment belongs to a normal awakening state.
Optionally, a light sensor is also included;
the optical sensor is used for recording the brightness value of the electronic equipment;
the processor is connected with the optical sensor and used for acquiring the brightness value of the electronic equipment recorded by the optical sensor; and determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets a set awakening condition and the brightness value is greater than or equal to a set brightness threshold value.
According to the technical scheme, the equipment image of the electronic equipment is obtained; the light component arranged on the electronic equipment can be lightened under the normal working state and can be extinguished under the non-working state. The automatic detection of the production detection stage of the electronic equipment can be realized depending on the on-off condition of the bright part on the electronic equipment. In order to reduce interference of images of other areas except the bright part and improve the efficiency of image analysis, an image of a target area where the bright part of the electronic device is located can be intercepted from the device image. In order to realize the evaluation of the brightness of the target area image, the target area image can be converted into a gray scale image; in the case that the gray value of the gray map satisfies the set wake-up condition, it may be determined that the electronic device belongs to a normal wake-up state. Compare in manual detection's mode, in this technical scheme, can evaluate the luminance in the regional on electronic equipment light component place to reach the automated inspection to electronic equipment production detection stage, greatly promoted the detection efficiency that electronic equipment production detected.
Drawings
In order to more clearly illustrate the embodiments of the present application, the drawings needed for the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and that other drawings can be obtained by those skilled in the art without inventive effort.
Fig. 1 is a flowchart of a method for detecting an operating state of an electronic device according to an embodiment of the present disclosure;
fig. 2 is a schematic structural diagram of a device for detecting an operating state of an electronic device according to an embodiment of the present disclosure;
fig. 3 is a structural diagram of a device for detecting an operating state of an electronic apparatus according to another embodiment of the present application;
fig. 4 is a schematic structural diagram of a system for detecting an operating state of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some embodiments of the present application, and not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application without any creative effort belong to the protection scope of the present application.
The terms "including" and "having," and any variations thereof, in the description and claims of this application and the drawings described above, are intended to cover non-exclusive inclusions. For example, a process, method, system, article, or apparatus that comprises a list of steps or elements is not limited to only those steps or elements but may include other steps or elements not expressly listed.
In order that those skilled in the art will better understand the disclosure, the following detailed description will be given with reference to the accompanying drawings.
Next, a method for detecting an operating state of an electronic device provided in an embodiment of the present application is described in detail. Fig. 1 is a flowchart of a method for detecting an operating state of an electronic device according to an embodiment of the present application, where the method includes:
s101: a device image of an electronic device is acquired.
The electronic device can be a device which needs to be subjected to working state detection in the production detection stage. The type of the electronic device may be various, and for convenience of introduction, in the embodiment of the present application, an example of the smart speaker is described.
Taking the wake-up test of the electronic device as an example, the device image of the electronic device is obtained, and the device image of the electronic device can be collected after the wake-up word is played.
S102: and intercepting an image of a target area where a bright part of the electronic equipment is positioned from the equipment image.
The outer ring of the intelligent sound box is generally provided with a bright part. The bright part can represent the operating condition of intelligent audio amplifier through bright going out. In practical applications, the light component may be illuminated in a plurality of colors to indicate different states. For example, the light is not turned on in the sleep state, the blue light is turned on in the normal wake-up state, the yellow light is turned on in the set mode, and the red light is turned on in the network connection interruption state.
In the actual production test stage, the most important test item is wake-up detection, that is, whether the smart sound box can be correctly awakened by the wake-up word is detected, whether the smart sound box is mistakenly awakened under the condition that the wake-up word is not sent or not is detected, whether the smart sound box can be awakened every time when the interval of continuous multiple awakening is short, and the like.
It is contemplated that the light emitting member is generally disposed in a location area of the electronic device and does not occupy the entire outer surface of the electronic device. In order to improve the efficiency and accuracy of image analysis, when the device image is analyzed, an image of a target area where a bright part of the electronic device is located can be intercepted from the device image.
S103: and converting the target area image into a gray scale image.
When the bright part is lightened, the gray value of each pixel point on the target area image is higher; when the bright part is extinguished, the gray value of each pixel point on the target area image is lower. Therefore, in the embodiment of the application, the on-off condition of the bright part can be identified based on the gray value of each pixel point on the target area image, so that the working state of the electronic equipment can be determined.
In practical application, the Gray value Gray corresponding to each pixel point in the target area image can be determined according to the following formula,
Gray＝(R*30+G*59+B*11+50)/100；
r, G, B respectively represents the brightness values corresponding to the three channels of red, green and blue corresponding to the pixel point.
S104: and under the condition that the gray value of the gray map meets the set awakening condition, determining that the electronic equipment belongs to a normal awakening state.
The wake-up condition may include a lowest value of the corresponding gray value in the wake-up state.
In practical application, the gray level mean value of the gray level image can be calculated; and judging whether the average gray level value is greater than or equal to a set lower gray level limit value or not. The lower gray level limit value may be set according to a corresponding gray level value of the image when the light member is in a lit state.
If the average value of the gray scales is greater than or equal to the set lower limit value of the gray scales, it is indicated that the bright part of the electronic equipment is lighted, and at this time, it can be determined that the electronic equipment belongs to the normal awakening state.
In this embodiment of the application, after it is determined that the electronic device belongs to the normal wake-up state, the device image and the timestamp corresponding to the device image may be recorded, and the electronic device may be controlled to execute the operation procedure corresponding to the normal wake-up state.
In the production detection stage, the electronic equipment is often tested for many times, and the equipment images recorded in each test can be summarized into a video form, so that an operator can conveniently and quickly browse the test condition of the electronic equipment.
According to the technical scheme, the equipment image of the electronic equipment is obtained; the light component arranged on the electronic equipment can be lightened under the normal working state and can be extinguished under the non-working state. The automatic detection of the production detection stage of the electronic equipment can be realized depending on the on-off condition of the bright part on the electronic equipment. In order to reduce interference of images of other areas except the bright part and improve the efficiency of image analysis, an image of a target area where the bright part of the electronic device is located can be intercepted from the device image. In order to realize the evaluation of the brightness of the target area image, the target area image can be converted into a gray scale image; in the case that the gray value of the gray map satisfies the set wake-up condition, it may be determined that the electronic device belongs to a normal wake-up state. Compare in manual detection's mode, in this technical scheme, can evaluate the luminance in the regional on electronic equipment light component place to reach the automated inspection to electronic equipment production detection stage, greatly promoted the detection efficiency that electronic equipment production detected.
In this application embodiment, in order to promote the accuracy that electronic equipment awakening state detected, in addition to the grey scale value according to the equipment image discerns electronic equipment operating condition, can also rely on light sensor to discern the luminance of bright part to confirm electronic equipment's operating condition, realize the dual detection to electronic equipment operating condition.
In a specific implementation, a brightness value of the electronic device recorded by the optical sensor may be acquired; in the case that the gray value of the gray map satisfies the set wake-up condition and the brightness value is greater than or equal to the set brightness threshold, it may be determined that the electronic device belongs to the normal wake-up state.
When the gray scale value of the gray scale map meets the set wake-up condition and the brightness value is smaller than the set brightness threshold, or the gray scale value of the gray scale map does not meet the set wake-up condition and the brightness value is greater than or equal to the set brightness threshold, it is described that the wake-up state identified based on the optical sensor is inconsistent with the wake-up state identified based on the image analysis, at this time, the wake-up state can be analyzed by human intervention, and for the convenience of the human analysis, the device image and the time stamp of the electronic device can be recorded first, and a human verification identifier is set.
When the awakening state results obtained by the two detection modes are inconsistent, the image and the timestamp of the device are recorded, so that an operator can conveniently determine whether the awakening state of the electronic device is normal by manually watching the image of the device. And according to the time stamp, the adjacent equipment images before and after the current equipment image time can be obtained, so that the accuracy of analysis is improved.
In the embodiment of the application, the light component can represent different types of working states by lighting different colors of light. Therefore, in the embodiment of the present application, the wake-up state of the electronic device is detected according to the gray level of the image. The working state of the electronic device can also be determined based on the color corresponding to each pixel point in the target area image.
In a specific implementation, after a target area image where a bright part of the electronic device is located is intercepted from an equipment image, counting colors corresponding to each pixel point in the target area image; wherein each color has its corresponding operating mode; and under the condition that the ratio of the number of the pixel points corresponding to the target color to the number of all the pixel points of the target area image exceeds a set proportion value, judging that the electronic equipment belongs to the working mode corresponding to the target color.
The captured target area image may contain some background area in addition to the bright features. Therefore, the target area image may include a plurality of colors, and the ratio of the bright member in the target area image is the highest compared to the background area, so that it is possible to determine which color the bright member belongs to based on the specific gravity of each color, thereby determining what type of operating state the electronic device is in.
The set proportion value may be set based on actual demand, and may be set to 80%, for example. Suppose that the image in the target region contains two colors, namely white and red, and there are 1000 pixels in total, where there are 100 white pixels and 900 red pixels, and the ratio 900/1000 corresponding to the red pixels is 90%, and is greater than 80% of the setting, at this time, it can be determined that the bright part is in red, and red indicates that the electronic device is in the off-network state.
In the embodiment of the application, based on the color corresponding to each pixel point in the target area image, the identification of different colors of the bright part under the electronic equipment can be realized. Different colors can represent different types of working states, and automatic identification and detection of different working states of the electronic equipment can be realized.
In consideration of the fact that in practical use, there may be a case where the background environment where the electronic device is located is high in brightness, when the light member belongs to a white lighting state, it is difficult to distinguish the brightness of the light member from the brightness of the background environment based on the gradation value.
Therefore, in the embodiment of the application, after the device image of the electronic device is acquired, whether the brightness of the background image in the device image exceeds a set threshold value or not can be judged; the background image is an image of the device image except the target area image.
The brightness of the background image can also be evaluated through the gray scale value, when the average value of the gray scales of the background image reaches a set threshold value, it can be determined that the environment light intensity is too large, which can affect the evaluation of the brightness of the bright part, therefore, under the condition that the brightness of the background image in the device image exceeds the set threshold value, the gray scale histogram prescribing operation can be carried out on the gray scale image, so as to obtain the adjusted gray scale image. Correspondingly, under the condition that the gray value of the adjusted gray map meets the set awakening condition, the electronic equipment can be determined to be in the normal awakening state.
By performing a gray histogram normalization operation on the gray map of the light member, the brightness contrast of the light member with the environment can be increased, so that the operating state of the electronic device can be analyzed more accurately based on the gray map of the light member.
In the embodiment of the application, in order to further improve the accuracy of the wake-up state detection, the electronic device may be subjected to a plurality of wake-up tests within a set time period.
In a specific implementation, when the gray value of the gray map meets a set awakening condition, after the electronic device is determined to be in a normal awakening state, the awakening count value is increased by one; and judging whether the awakening count value reaches a set count threshold value within the set test time.
Under the condition that the awakening count value does not reach the set count threshold value within the set test time, the awakening state of the electronic equipment is not stable, at the moment, the equipment image corresponding to the electronic equipment within the test time and the timestamp corresponding to each frame of image can be recorded, and prompt information with unstable state is set.
And under the condition that the awakening count value reaches the set count threshold value within the set test time, judging that the awakening state of the electronic equipment is stable.
By carrying out the awakening test on the electronic equipment for a plurality of times within the test time, the accuracy of the detection result of the awakening test can be improved, and the misjudgment caused by the fact that the electronic equipment is not awakened for a certain time is avoided.
Fig. 2 is a schematic structural diagram of a detection apparatus for detecting an operating state of an electronic device according to an embodiment of the present application, including an obtaining unit 21, an intercepting unit 22, a converting unit 23, and a determining unit 24;
an acquisition unit 21 configured to acquire a device image of an electronic device;
an intercepting unit 22 for intercepting an image of a target area where a bright part of the electronic apparatus is located from the apparatus image;
a conversion unit 23 for converting the target area image into a grayscale image;
and the determining unit 24 is used for determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets the set awakening condition.
Optionally, the obtaining unit is configured to obtain a brightness value of the electronic device recorded by the optical sensor;
and the determining unit is used for determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets the set awakening condition and the brightness value is greater than or equal to the set brightness threshold.
Optionally, the system further comprises a setting unit;
and the setting unit is used for recording the device image and the time stamp of the electronic device and setting the manual check mark under the condition that the gray value of the gray map meets the set awakening condition and the brightness value is smaller than the set brightness threshold value or the gray value of the gray map does not meet the set awakening condition and the brightness value is larger than or equal to the set brightness threshold value.
Optionally, the system further comprises a statistic unit and a judgment unit;
the statistical unit is used for counting the color corresponding to each pixel point in the target area image; wherein, each color has a corresponding working mode;
and the judging unit is used for judging that the electronic equipment belongs to the working mode corresponding to the target color under the condition that the ratio of the number of the pixel points corresponding to the target color to the number of all the pixel points of the target area image exceeds a set proportion value.
Optionally, the system further comprises a judging unit and an adjusting unit;
the judging unit is used for judging whether the brightness of the background image in the equipment image exceeds a set threshold value or not; the background image is an image except the target area image in the equipment image;
the adjusting unit is used for executing a gray histogram stipulation operation on the gray image to obtain an adjusted gray image if the brightness of the background image in the equipment image exceeds a set threshold;
correspondingly, the determining unit is used for determining that the electronic equipment belongs to the normal awakening state under the condition that the gray value of the adjusted gray map meets the set awakening condition.
Optionally, the determining unit is configured to calculate a mean value of the gray levels of the gray level map; judging whether the average value of the gray scales is larger than or equal to a set lower limit value of the gray scales; and if the average value of the gray scales is greater than or equal to the set lower limit value of the gray scales, determining that the electronic equipment belongs to a normal awakening state.
Optionally, the system further comprises an accumulation unit, a count judgment unit and a count judgment unit;
an accumulation unit for adding one to the wakeup count value;
the counting judgment unit is used for judging whether the awakening count value reaches a set counting threshold value within set test time;
and the counting judgment unit is used for judging that the awakening state of the electronic equipment is stable under the condition that the awakening count value reaches the set counting threshold value in the set test time.
Optionally, a recording unit is further included;
and the recording unit is used for recording the equipment image and the corresponding timestamp thereof and controlling the electronic equipment to execute the operation flow corresponding to the normal awakening state.
The description of the features in the embodiment corresponding to fig. 2 may refer to the related description of the embodiment corresponding to fig. 1, and is not repeated here.
According to the technical scheme, the equipment image of the electronic equipment is obtained; the light component arranged on the electronic equipment can be lightened under the normal working state and can be extinguished under the non-working state. The automatic detection of the production detection stage of the electronic equipment can be realized depending on the on-off condition of the bright part on the electronic equipment. In order to reduce interference of images of other areas except the bright part and improve the efficiency of image analysis, an image of a target area where the bright part of the electronic device is located can be intercepted from the device image. In order to realize the evaluation of the brightness of the target area image, the target area image can be converted into a gray scale image; in the case that the gray value of the gray map satisfies the set wake-up condition, it may be determined that the electronic device belongs to a normal wake-up state. Compare in manual detection's mode, in this technical scheme, can evaluate the luminance in the regional on electronic equipment light component place to reach the automated inspection to electronic equipment production detection stage, greatly promoted the detection efficiency that electronic equipment production detected.
Fig. 3 is a structural diagram of a device for detecting an operating state of an electronic device according to another embodiment of the present application, and as shown in fig. 3, the device for detecting an operating state of an electronic device includes: a memory 20 for storing a computer program;
the processor 21 is configured to implement the steps of the method for detecting the operating status of the electronic device according to the above embodiment when executing the computer program.
The detection device for the working state of the electronic device provided by this embodiment may include, but is not limited to, a smart phone, a tablet computer, a notebook computer, or a desktop computer.
The processor 21 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 21 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 21 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 21 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 21 may further include an AI (Artificial Intelligence) processor for processing a calculation operation related to machine learning.
The memory 20 may include one or more computer-readable storage media, which may be non-transitory. Memory 20 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In this embodiment, the memory 20 is at least used for storing the following computer program 201, wherein after being loaded and executed by the processor 21, the computer program can implement the relevant steps of the method for detecting the operating state of the electronic device disclosed in any of the foregoing embodiments. In addition, the resources stored in the memory 20 may also include an operating system 202, data 203, and the like, and the storage manner may be a transient storage manner or a permanent storage manner. Operating system 202 may include, among others, Windows, Unix, Linux, and the like. The data 203 may include, but is not limited to, a device image, a target area image, a wake-up condition, etc. of the electronic device.
In some embodiments, the detecting device for detecting the operating state of the electronic device may further include a display 22, an input/output interface 23, a communication interface 24, a power supply 25, and a communication bus 26.
It will be appreciated by those skilled in the art that the arrangement shown in figure 3 does not constitute a limitation of the means for detecting the operating state of the electronic device and may comprise more or less components than those shown.
It is understood that, if the method for detecting the operating state of the electronic device in the above embodiments is implemented in the form of a software functional unit and sold or used as a stand-alone product, the method may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application may be substantially or partially implemented in the form of a software product, which is stored in a storage medium and executes all or part of the steps of the methods of the embodiments of the present application, or all or part of the technical solutions. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), an electrically erasable programmable ROM, a register, a hard disk, a removable magnetic disk, a CD-ROM, a magnetic or optical disk, and other various media capable of storing program codes.
Fig. 4 is a schematic structural diagram of a system for detecting an operating state of an electronic device according to an embodiment of the present disclosure, including an image collector 41 and a processor 42;
an image collector 41, configured to collect a device image of the electronic device, and transmit the device image to the processor 42;
a processor 42 for acquiring a device image of the electronic device; intercepting a target area image where a bright part of the electronic equipment is located from the equipment image; converting the target area image into a gray scale image; and under the condition that the gray value of the gray map meets the set awakening condition, determining that the electronic equipment belongs to a normal awakening state.
Optionally, a light sensor is also included;
a light sensor for recording a brightness value of the electronic device;
the processor 42 is connected to the optical sensor and configured to obtain a brightness value of the electronic device recorded by the optical sensor; and determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets the set awakening condition and the brightness value is greater than or equal to the set brightness threshold.
The light sensor may employ TSL 2540. The TSL2540 has two output channels, representing the brightness values of visible light and infrared light, respectively. In practical applications, the processor may read the luminance value in its visible light register.
After determining that the electronic device belongs to the normal wake-up state, the wake-up time counter +1 may be set, and the test device may automatically play the voice command to perform the subsequent detection step. When the set test termination condition is reached, such as setting the test time 24h, the detection procedure can be automatically terminated.
The description of the features in the embodiment corresponding to fig. 4 may refer to the related description of the embodiment corresponding to fig. 1, and is not repeated here.
According to the technical scheme, the equipment image of the electronic equipment is obtained; the light component arranged on the electronic equipment can be lightened under the normal working state and can be extinguished under the non-working state. The automatic detection of the production detection stage of the electronic equipment can be realized depending on the on-off condition of the bright part on the electronic equipment. In order to reduce interference of images of other areas except the bright part and improve the efficiency of image analysis, an image of a target area where the bright part of the electronic device is located can be intercepted from the device image. In order to realize the evaluation of the brightness of the target area image, the target area image can be converted into a gray scale image; in the case that the gray value of the gray map satisfies the set wake-up condition, it may be determined that the electronic device belongs to a normal wake-up state. Compare in manual detection's mode, in this technical scheme, can evaluate the luminance in the regional on electronic equipment light component place to reach the automated inspection to electronic equipment production detection stage, greatly promoted the detection efficiency that electronic equipment production detected.
The method, the device and the system for detecting the working state of the electronic device provided by the embodiment of the application are described in detail above. The embodiments are described in a progressive manner in the specification, each embodiment focuses on differences from other embodiments, and the same and similar parts among the embodiments are referred to each other. The device disclosed by the embodiment corresponds to the method disclosed by the embodiment, so that the description is simple, and the relevant points can be referred to the method part for description.
Those of skill would further appreciate that the various illustrative components and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the components and steps of the various examples have been described above generally in terms of their functionality in order to clearly illustrate this interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The method, the device and the system for detecting the working state of the electronic device provided by the application are described in detail above. The principles and embodiments of the present invention are explained herein using specific examples, which are presented only to assist in understanding the method and its core concepts. It should be noted that, for those skilled in the art, it is possible to make various improvements and modifications to the present invention without departing from the principle of the present invention, and those improvements and modifications also fall within the scope of the claims of the present application.
Claims (10)
1. A method for detecting the working state of electronic equipment is characterized by comprising the following steps:
acquiring a device image of an electronic device;
intercepting a target area image in which a bright part of the electronic equipment is positioned from the equipment image;
converting the target area image into a gray scale image;
and under the condition that the gray value of the gray map meets the set awakening condition, determining that the electronic equipment belongs to a normal awakening state.
2. The method for detecting the operating status of the electronic device according to claim 1, further comprising:
acquiring a brightness value of the electronic equipment recorded by a light sensor;
and determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets a set awakening condition and the brightness value is greater than or equal to a set brightness threshold value.
3. The method for detecting the operating state of the electronic device according to claim 2, further comprising:
and recording the device image and the time stamp of the electronic device and setting a manual check mark under the condition that the gray scale value of the gray scale map meets the set awakening condition, the brightness value is smaller than the set brightness threshold value, or the gray scale value of the gray scale map does not meet the set awakening condition, and the brightness value is larger than or equal to the set brightness threshold value.
4. The method for detecting the operating status of the electronic device according to claim 1, further comprising, after the step of intercepting the image of the target area where the bright component of the electronic device is located from the image of the device:
counting the color corresponding to each pixel point in the target area image; wherein each color has its corresponding operating mode;
and under the condition that the ratio of the number of pixel points corresponding to the target color to the number of all pixel points of the target area image exceeds a set proportion value, judging that the electronic equipment belongs to the working mode corresponding to the target color.
5. The method for detecting the operating state of the electronic device according to claim 1, further comprising, after the acquiring the device image of the electronic device:
judging whether the brightness of a background image in the equipment image exceeds a set threshold value or not; wherein the background image is an image of the device image except the target area image;
if the brightness of the background image in the equipment image exceeds a set threshold value, performing a gray histogram stipulation operation on the gray image to obtain an adjusted gray image;
correspondingly, when the gray value of the gray map meets the set wake-up condition, determining that the electronic device belongs to the normal wake-up state includes:
and determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the adjusted gray map meets the set awakening condition.
6. The method for detecting the operating state of the electronic device according to claim 1, wherein when the gray-level value of the gray-level map satisfies the set wake-up condition, determining that the electronic device belongs to a normal wake-up state further comprises:
adding one to the wakeup count value;
judging whether the awakening count value reaches a set count threshold value within set test time;
and under the condition that the awakening count value reaches a set count threshold value within set test time, judging that the awakening state of the electronic equipment is stable.
7. The method for detecting the operating status of the electronic device according to claim 1, further comprising, after determining that the electronic device belongs to the normal wake-up state:
and recording the equipment image and the corresponding timestamp thereof, and controlling the electronic equipment to execute the operation flow corresponding to the normal awakening state.
8. The detection device of the working state of an electronic device is characterized by comprising an acquisition unit, an interception unit, a conversion unit and a determination unit;
the acquisition unit is used for acquiring an equipment image of the electronic equipment;
the intercepting unit is used for intercepting a target area image where a bright part of the electronic equipment is located from the equipment image;
the conversion unit is used for converting the target area image into a gray scale image;
the determining unit is used for determining that the electronic equipment belongs to a normal awakening state under the condition that the gray value of the gray map meets a set awakening condition.
9. A detection device for detecting the working state of electronic equipment is characterized by comprising:
a memory for storing a computer program;
a processor for executing the computer program to implement the steps of the method for detecting the operating state of an electronic device according to any of claims 1 to 7.
10. A detection system for the working state of electronic equipment is characterized by comprising an image collector and a processor;
the image collector is used for collecting an equipment image of the electronic equipment and transmitting the equipment image to the processor;
the processor is used for acquiring a device image of the electronic device; intercepting a target area image in which a bright part of the electronic equipment is positioned from the equipment image; converting the target area image into a gray scale image; and under the condition that the gray value of the gray map meets the set awakening condition, determining that the electronic equipment belongs to a normal awakening state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210087184.4A CN114501287A (en) | 2022-01-25 | 2022-01-25 | Method, device and system for detecting working state of electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210087184.4A CN114501287A (en) | 2022-01-25 | 2022-01-25 | Method, device and system for detecting working state of electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114501287A true CN114501287A (en) | 2022-05-13 |
Family
ID=81475351
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210087184.4A Pending CN114501287A (en) | 2022-01-25 | 2022-01-25 | Method, device and system for detecting working state of electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114501287A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101419663A (en) * | 2008-06-05 | 2009-04-29 | 华中科技大学 | Indicating light status real time monitor and identification method for power equipment fault indicator |
| US20140056506A1 (en) * | 2012-08-27 | 2014-02-27 | Hon Hai Precision Industry Co., Ltd. | Electronic device and method for detecting state of lamps |
| CN104897367A (en) * | 2015-04-28 | 2015-09-09 | 南车株洲电力机车研究所有限公司 | Indicating light optical state automatic test method and system |
| US20170061894A1 (en) * | 2015-08-26 | 2017-03-02 | Canon Kabushiki Kaisha | Image display apparatus |
| CN110035176A (en) * | 2019-03-25 | 2019-07-19 | 努比亚技术有限公司 | A kind of brightness adjusting method of mobile terminal, mobile terminal and storage medium |
| CN110851296A (en) * | 2019-10-29 | 2020-02-28 | 北京海益同展信息科技有限公司 | Fault detection method and device and storage medium |
| CN111145138A (en) * | 2019-07-30 | 2020-05-12 | Tcl王牌电器(惠州)有限公司 | Detection method, device and equipment of LED lamp panel and storage medium |
-
2022
- 2022-01-25 CN CN202210087184.4A patent/CN114501287A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101419663A (en) * | 2008-06-05 | 2009-04-29 | 华中科技大学 | Indicating light status real time monitor and identification method for power equipment fault indicator |
| US20140056506A1 (en) * | 2012-08-27 | 2014-02-27 | Hon Hai Precision Industry Co., Ltd. | Electronic device and method for detecting state of lamps |
| CN104897367A (en) * | 2015-04-28 | 2015-09-09 | 南车株洲电力机车研究所有限公司 | Indicating light optical state automatic test method and system |
| US20170061894A1 (en) * | 2015-08-26 | 2017-03-02 | Canon Kabushiki Kaisha | Image display apparatus |
| CN110035176A (en) * | 2019-03-25 | 2019-07-19 | 努比亚技术有限公司 | A kind of brightness adjusting method of mobile terminal, mobile terminal and storage medium |
| CN111145138A (en) * | 2019-07-30 | 2020-05-12 | Tcl王牌电器(惠州)有限公司 | Detection method, device and equipment of LED lamp panel and storage medium |
| CN110851296A (en) * | 2019-10-29 | 2020-02-28 | 北京海益同展信息科技有限公司 | Fault detection method and device and storage medium |
Non-Patent Citations (1)
| Title |
|---|
| 邓继忠，张泰岭: "数字图像处理技术", 30 September 2005, 广东科技出版社, pages: 269 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112395928A (en) | Method for automatically detecting equipment state operation | |
| CN111191576A (en) | Personnel behavior target detection model construction method, intelligent analysis method and system | |
| CN110018172B (en) | Product detection system and method | |
| CN111654692B (en) | Camera detection method and device, camera and storage medium | |
| CN112560649A (en) | Behavior action detection method, system, equipment and medium | |
| CN112153373A (en) | Fault identification method and device for bright kitchen range equipment and storage medium | |
| CN111060521A (en) | Method for detecting quantity and area of bubbles on surface of precast concrete T beam | |
| CN112802133B (en) | Mini Led display screen unit plate ink color detection and sorting method based on machine vision | |
| CN113808153A (en) | Tomato maturity detection method and device, computer equipment and storage medium | |
| CN113039577A (en) | Product testing method and device, computer readable storage medium and electronic equipment | |
| CN111291778B (en) | Training method of depth classification model, exposure anomaly detection method and device | |
| CN104954627B (en) | A kind of information processing method and electronic equipment | |
| CN114501287A (en) | Method, device and system for detecting working state of electronic equipment | |
| CN113033548A (en) | Image recognition method for unit running state judgment and monitoring point alignment | |
| CN110310341B (en) | Method, device, equipment and storage medium for generating default parameters in color algorithm | |
| CN110715369A (en) | Air purifier control method and device, storage medium and air purifier | |
| CN103927544A (en) | Machine vision grading method for ginned cotton rolling quality | |
| CN111402189B (en) | Video image color cast detection device and method | |
| CN103136439B (en) | Plant illness discrimination method and system thereof | |
| CN108765396A (en) | It is a kind of it is based on computer vision go out light device go out light detection method | |
| CN116563770B (en) | Method, device, equipment and medium for detecting vehicle color | |
| CN111523605A (en) | Image identification method and device, electronic equipment and medium | |
| CN117132174B (en) | Model training method and system applied to quality detection of industrial assembly line | |
| CN115965848B (en) | Image processing method and related device | |
| CN118348016A (en) | LED panel defect detection method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |