CN111860365B - Classroom light adjusting method and device, computer equipment and storage medium - Google Patents
Classroom light adjusting method and device, computer equipment and storage medium Download PDFInfo
- Publication number
- CN111860365B CN111860365B CN202010723005.2A CN202010723005A CN111860365B CN 111860365 B CN111860365 B CN 111860365B CN 202010723005 A CN202010723005 A CN 202010723005A CN 111860365 B CN111860365 B CN 111860365B
- Authority
- CN
- China
- Prior art keywords
- courseware
- lamplight
- target user
- light
- classroom
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 230000008921 facial expression Effects 0.000 claims abstract description 51
- 238000001514 detection method Methods 0.000 claims abstract description 16
- 238000004590 computer program Methods 0.000 claims description 16
- 230000001795 light effect Effects 0.000 claims description 16
- 238000005286 illumination Methods 0.000 claims description 14
- 238000004422 calculation algorithm Methods 0.000 claims description 12
- 238000004364 calculation method Methods 0.000 claims description 4
- 230000006870 function Effects 0.000 description 9
- 238000010276 construction Methods 0.000 description 6
- 230000000694 effects Effects 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 230000001737 promoting effect Effects 0.000 description 3
- 238000010586 diagram Methods 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 238000012544 monitoring process Methods 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013019 agitation Methods 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000008094 contradictory effect Effects 0.000 description 1
- 238000007405 data analysis Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011897 real-time detection Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001502 supplementing effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
- G06V40/166—Detection; Localisation; Normalisation using acquisition arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/35—Categorising the entire scene, e.g. birthday party or wedding scene
- G06V20/36—Indoor scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/174—Facial expression recognition
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05B—ELECTRIC HEATING; ELECTRIC LIGHT SOURCES NOT OTHERWISE PROVIDED FOR; CIRCUIT ARRANGEMENTS FOR ELECTRIC LIGHT SOURCES, IN GENERAL
- H05B47/00—Circuit arrangements for operating light sources in general, i.e. where the type of light source is not relevant
- H05B47/10—Controlling the light source
- H05B47/105—Controlling the light source in response to determined parameters
- H05B47/115—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings
- H05B47/125—Controlling the light source in response to determined parameters by determining the presence or movement of objects or living beings by using cameras
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Tourism & Hospitality (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- General Business, Economics & Management (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
Abstract
The invention belongs to the field of big data, and discloses a classroom light adjusting method, a classroom light adjusting device, computer equipment and a storage medium. The method comprises the following steps: taking courseware display pictures in target information and target users as detection cores of the multiplexing cameras; modulating real-time lamplight in a virtual drawing board according to the face brightness of a target user, the facial expression of the target user, the background color of courseware and the display content of the courseware, real-time analyzing first lamplight information which is most suitable for a current classroom according to the modulated real-time lamplight, and transmitting the first lamplight information to a lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current classroom according to the first lamplight information. The invention can automatically adjust the light of the classroom under the condition of low cost, so as to ensure the watching definition of courseware and the good external image of teachers, thereby improving the teaching quality of the classroom.
Description
Technical Field
The invention relates to the field of data analysis in the field of big data, in particular to a classroom light adjusting method, a classroom light adjusting device, computer equipment and a storage medium.
Background
At present, the Chinese high-quality education is in a scarce state, and how to enable students to enjoy high-quality education resources and how to break the contradictory relationship between the education resources and time and space becomes the current urgent demand.
At present, in order to promote educational quality, standardized classroom construction of giving lessons and the scheme of improving the external image and the teaching achievement of giving lessons the teacher through beautiful face camera appear, and this scheme mainly is through strictly asking classroom size, background and fitment content etc. to realize, and the inadequacy of this scheme lies in: firstly, the cost is high, in the teaching process of the teaching teacher, as the color of courseware (for example, PPT) displayed on the teaching screen changes along with the color, and the ambient light of the classroom changes along with the change of weather and the like, the change can directly influence the watching definition of students on the courseware, and in the continuously changing color of the courseware and the ambient light, the situation that the external image of the teaching teacher is good is difficult to continuously ensure, for example, the facial features of the teaching teacher can also be in a state of being difficult to observe along with the facial features of the teaching teacher, and the like, thereby leading to the phenomenon that the teaching teacher and the students have poor experience effect, and further directly influencing the teaching quality of the class of two teachers.
Disclosure of Invention
Based on the above, it is necessary to provide a classroom light adjusting method, device, computer equipment and storage medium for automatically adjusting classroom light under the condition of low cost, so as to ensure the definition of courseware and the appearance of teachers, and further improve the teaching quality of the classroom.
A classroom light adjustment method, comprising:
receiving a courseware opening instruction sent by a control terminal in a current classroom, and determining target information by multiplexing a camera; the target information comprises courseware display pictures and target users, wherein the actual distance of the courseware display pictures is within a preset target distance;
taking the courseware display picture and the target user in the target information as detection cores of the multiplexing camera, so that the multiplexing camera can identify the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware in the current class room in real time;
modulating real-time lamplight in a virtual drawing board according to the face brightness of the target user, the facial expression of the target user, the background color of courseware and the display content of the courseware, fusing the modulated real-time lamplight in a virtual picture of the current classroom, analyzing first lamplight information which is most suitable for the current classroom in real time according to the virtual picture, and transmitting the first lamplight information to a lamplight central control system in real time so that the lamplight central control system can simultaneously adjust lamplight irradiation angle, irradiation height and lamplight color temperature in the current classroom according to the first lamplight information;
when the multiplexing camera is detected to not recognize the target information within the preset time threshold, the light central control system is enabled to close the light in the current classroom.
A classroom light adjustment device, comprising:
the first determining module is used for receiving a courseware opening instruction sent by a control terminal in a current classroom and determining target information through a multiplexing camera; the target information comprises courseware display pictures and target users, wherein the actual distance of the courseware display pictures is within a preset target distance;
the recognition module is used for taking the courseware display picture and the target user in the target information as detection cores of the multiplexing camera, so that the multiplexing camera can recognize the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware in the current class room in real time;
the first adjusting module is used for modulating real-time lamplight in a virtual drawing board according to the face brightness of the target user, the facial expression of the target user, the background color of courseware and the display content of the courseware, fusing the modulated real-time lamplight in a virtual picture of the current courseware, analyzing first lamplight information which is most suitable for the current courseware in real time according to the virtual picture, and transmitting the first lamplight information to the lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current courseware according to the first lamplight information;
and the closing module is used for enabling the lamplight central control system to close lamplight in the current classroom when the multiplexing camera is detected to not recognize the target information within the preset time threshold.
A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, the processor implementing the above-described classroom light adjustment method when executing the computer program.
A computer readable storage medium storing a computer program which when executed by a processor implements the above-described classroom light adjustment method.
According to the classroom light adjusting method, the device, the computer equipment and the storage medium, the light of the current classroom can be automatically adjusted, various construction conditions of the current classroom are not required to be worried about, the classroom is not required to be built with high cost, various current environments are not required to influence the light in the current classroom, the watching definition of courseware in the current classroom and the appearance of teachers are good, and the teaching quality of the classroom is further improved. The invention is also applied to the field of intelligent education, thereby promoting the construction of intelligent cities.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the description of the embodiments of the present invention will be briefly described below, it being obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic view of an application environment of a classroom light modulation method according to an embodiment of the present invention;
FIG. 2 is a flow chart of a method for adjusting light in a classroom according to an embodiment of the invention;
FIG. 3 is a schematic diagram of a classroom light adjustment device according to an embodiment of the present invention;
FIG. 4 is a schematic diagram of a computer device in accordance with an embodiment of the invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all embodiments of the invention. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
The invention provides a classroom light adjusting method, which relates to the monitoring field in the field of operation and maintenance of a base frame; the method can also be applied to the field of smart cities, thereby promoting the construction of the smart cities. The method is applicable in an application environment as in fig. 1, where a client communicates with a server over a network. The clients may be, but are not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices. The server may be implemented as a stand-alone server or as a server cluster composed of a plurality of servers.
In one embodiment, as shown in fig. 2, a method for adjusting light in a classroom is provided, and the method is applied to the server in fig. 1, and includes the following steps:
s10, receiving a courseware opening instruction sent by a control terminal in a current classroom, and determining target information by multiplexing a camera; the target information comprises courseware display pictures and target users, wherein the actual distance of the courseware display pictures is within a preset target distance;
as can be appreciated, the execution subject related to the present embodiment is a server with a control function, where the server can control and multiplex a camera control terminal (the control terminal referred to in the present embodiment may refer to a computer device stored in a current classroom or a mobile device, where the computer device may be used to store various types of courseware, and the mobile device is used to manually trigger a courseware opening instruction) and a light central control system, where the multiplexed camera is used for color detection, face recognition, and image recognition, and the light central control system is used to adjust a light irradiation angle, an irradiation height, a light color temperature, and the like in a light device, where the light device referred to herein is an RGB three-color LED light installed in a suitable position in the current classroom, and it should be noted that the present embodiment is mainly applied to a double-teacher's classroom; the target user in the target information refers to a teacher who gives lessons in the current classroom, and courseware display pictures in the target information can be used for displaying similar types of courseware such as word, ppt and excel, wherein the display content in the courseware display pictures is also the teaching content of the current teacher. When receiving a courseware opening instruction, the embodiment can determine that a teacher starts a current teaching process, and at the moment, the server determines target information through the multiplexing camera, so that on one hand, the follow-up monitoring of the target information is facilitated, on the other hand, the multiplexing camera can be prevented from being in a working state for determining the target information all the time, and further the working time of the multiplexing camera is shortened.
S20, taking the courseware display picture and the target user in the target information as detection cores of the multiplexing camera, so that the multiplexing camera can identify the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware in the current class room in real time;
understandably, the courseware display picture and the target user in the target information are taken as the detection cores of the multiplexing camera, and the detection cores can be realized by pre-storing character characteristics of the target user and the position information of the courseware display picture in the current classroom, so that the stored information can be taken as the moving target of the multiplexing camera; the face brightness of the target user and the facial expression of the target user are recognized in real time through a face recognition method integrated in the multiplexing camera, wherein the face brightness is easy to be influenced by the current environment to cause face overexposure, face darkness and the like, and the fact that the face brightness of the target user and the facial expression of the target user need to be recognized and the face is required to be stable is required to wait; the background color of the courseware is identified in real time through a color detection algorithm integrated in the multiplexing camera, wherein the background color of the courseware comprises dark color, light color, color and the like; the courseware display content is identified in real time through an image identification algorithm integrated in the multiplexing camera, wherein the courseware display content comprises pictures, texts, characters and the like of various subjects, and the courseware display content is in one-to-one correspondence with the facial expressions of the target user, and if the courseware display content is a romantic subject, the facial expressions of the target user should be expressed as target facial expressions of agitation and the like; it should be noted that the above-mentioned face brightness of the target user, facial expression of the target user, background color of courseware and display content of courseware are affected by various current environments in the current classroom to some extent, so that the problem that the face brightness of the target user, facial expression of the target user, background color of courseware and display content of courseware have low brightness or low definition (may be affected by various reflection interference in the current environment, and the like, thereby affecting the light of the target information in the current classroom) may be caused, where the current environments include weather environments and environments formed by various objects such as buildings, trees, and the like. According to the embodiment, the target user face brightness, the target user facial expression, the courseware background color and the courseware display content are simultaneously recognized by multiplexing the camera to be combined, so that the embodiment can consider from multi-dimensional factors, and further the comprehensive characteristics in the recognition process can be ensured.
S30, modulating real-time lamplight in a virtual drawing board according to the face brightness of the target user, the facial expression of the target user, the background color of courseware and the display content of the courseware, fusing the modulated real-time lamplight in a virtual picture of the current courseware, analyzing first lamplight information which is most suitable for the current courseware in real time according to the virtual picture, and transmitting the first lamplight information to a lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current courseware according to the first lamplight information;
the virtual drawing board is understandably controlled by the server, so that the virtual drawing board can be called by the server in the embodiment, wherein the virtual drawing board comprises a plurality of types of colors, the colors are modulated by taking RGB as initial colors, real-time lights suitable for displaying contents with a target user face brightness, a target user face expression, a courseware background color and courseware (such as 1 brightness of the target user face, a target user face expression as a heart, a courseware background color as a dark color, courseware displaying contents as a theme related to the sea, the target user face brightness as 1 brightness, the real-time lights are represented as dark lights, the target user face expression as a heart, the real-time lights are represented as a heart-like color, the real-time lights are represented as dark colors, the real-time lights are represented as a blue light related to the main theme, at this time, the target user face brightness, the target user face color, the courseware background color and the courseware displaying contents are normalized and converted, the target user face brightness, the target user face expression, the courseware background color and the courseware displaying contents are provided with a real-time total color, and finally a light weight is obtained by setting a light total color corresponding to the total color value of the total color of the total table, and finally, the real-time light can be obtained; the virtual pictures are obtained from a virtual three-dimensional model, wherein the three-dimensional model is based on a model established by three-dimensional modeling software according to a current classroom, the three-dimensional model can image all objects in the current classroom, such as objects like a lighting device and a courseware display picture, and particularly, light simulation is carried out in the three-dimensional model by real-time light, multiple virtual pictures fused with the real-time light can be generated, finally, various virtual pictures are analyzed to determine the most suitable virtual pictures (the specific analysis process is to analyze light color temperature information through the real-time light first, the real-time light irradiates the target information from multiple light irradiation angles and irradiation heights, the light irradiation angle and irradiation height information with the best light effect are selected, and the light color temperature information, the light irradiation angle and the irradiation height information are used as first light information which is most suitable for the current classroom), so as to determine the first light information which is most suitable for the current classroom through the most suitable virtual pictures. According to the embodiment, the light irradiation angle, the irradiation height and the light color temperature in the current classroom can be modulated according to specific face brightness of the target user, facial expression of the target user, background color of courseware and courseware display content (which is equivalent to light supplementing of the current classroom), so that a teaching teacher can be presented in front of students with the best external image, experience effects of the students and the teacher are improved, influence of external environment on definition of courseware display images in the current classroom can be avoided, and teaching quality can be improved.
And S40, when the multiplexing camera is detected to not recognize the target information within a preset time threshold, enabling the light central control system to close the light in the current classroom.
In the embodiment, when the multiplexing camera is detected to not recognize the target information within the preset time threshold, it can be determined that the teacher in the current classroom has completed the current teaching process, and at the moment, the light in the current classroom can be turned off through the light central control system, so that the waste of resources is reduced. It should be noted that, at this time, the multiplexing camera can start the video recording function, but can temporarily close the function of identifying the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware in the current class room, so as to reduce the workload of the multiplexing camera. In another embodiment, when the multiplexing camera does not recognize the target information within the preset time threshold, the light central control system irradiates the shooting area of the multiplexing camera in a soft light form, and simultaneously the terminal equipment plays light background music or/and video pictures until the multiplexing camera does not recognize the target information, and the light central control system turns off the light in the current classroom.
In an embodiment, the multiplexing camera integrates a color detection algorithm, a face recognition method and an image recognition algorithm;
the enabling the multiplexing camera to identify the face brightness of the target user, the facial expression of the target user, the background color of courseware and the display content of the courseware in the current class room in real time comprises the following steps:
the face brightness of the target user and the facial expression of the target user are recognized in real time through the face recognition method integrated in the multiplexing camera;
the background color of the courseware is identified in real time through the color detection algorithm integrated in the multiplexing camera;
and identifying the courseware display content in real time through the image identification algorithm integrated in the multiplexing camera.
Further, after receiving the courseware opening instruction sent by the control terminal in the current classroom, the method further comprises the following steps:
acquiring the illumination intensity in the current environment of the current classroom, which is detected in real time by a preset illumination intensity sensor, determining the initial brightness and the ending brightness of the courseware display picture in the current classroom through the illumination intensity, and adjusting the brightness of the courseware display picture according to the initial brightness and the ending brightness.
The initial brightness is the brightness of the initial time point of the courseware display picture under the illumination intensity in the current environment, and the ending brightness is the brightness of the ending time point of the courseware display picture under the illumination intensity in the current environment, wherein the brightness size of the ending brightness is larger than the brightness size of the initial brightness; after determining that the teacher has started the current teaching process, the embodiment can acquire the illumination intensity in the current environment through the preset illumination intensity sensor installed in the proper position in the current classroom, at this time, the embodiment can determine the brightness of the courseware display picture suitable for human eyes according to the current illumination intensity, wherein the brightness comprises initial brightness and ending brightness, and the embodiment adjusts the brightness from the initial brightness to the ending brightness, so that the embodiment can attract the attention of human eyes.
Further, the determining the target information by multiplexing the camera includes:
acquiring the character characteristics of the target user and the position information of the courseware display picture displayed in the current classroom, and calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character characteristics and the position information;
when the actual distance is within a preset target distance, determining the target user and the courseware display picture as the target information;
and when the actual distance exceeds a preset target distance, prompting that the target information is missing, and continuously calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character characteristics and the position information.
As can be appreciated, the present embodiment calculates the actual distance in real time based on the character features of the target user and the position information of the courseware display screen, and further determines the target information based on the actual distance.
Further, after the light central control system simultaneously adjusts the light irradiation angle, the light irradiation height and the light color temperature in the current classroom according to the first light information, the light central control system further includes:
when detecting that at least one of the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware is changed in real time, re-analyzing second lamplight information which is most suitable for the current class room according to the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware after the change, and transmitting the second lamplight information to a lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current class room according to the second lamplight information.
Understandably, in this embodiment, the real-time detection is performed on the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware by using the multiplexing camera, and one of them is changed, so that the lighting angle, the lighting height and the lighting color temperature in the current classroom can be determined again.
Further, the detecting, in real time, that at least one of the target user face brightness, the target user facial expression, the courseware background color, and the courseware display content is changed includes:
when the page change number in the courseware display picture is detected to be lower than a preset number threshold value in real time within a preset time length, confirming that the courseware display content is changed in light influence, and recording change information of the courseware display content;
and when the page change number in the courseware display picture is detected to be greater than or equal to a preset number threshold value in real time within the preset time, confirming that the courseware display content is changed in a non-light influence manner. Understandably, when a non-light influencing change occurs in the courseware presentation content, the change in the courseware presentation content is not taken into consideration for adjusting the light irradiation angle, irradiation height, and light color temperature in the current class room.
As can be appreciated, in this embodiment, in order to determine whether frequent page number changes occur in the courseware display content (to determine that the number of page changes is 1 in a preset period of time and is smaller than 2 set by the preset number threshold after comparing the number of page changes with the preset number threshold, for example, the number of page changes is 1 in 5 seconds, and then it is determined that light influence changes occur in the courseware display content), when frequent page number changes occur (that is, it is understood that the courseware display content changes), this embodiment does not add the courseware display content to consideration factors of light irradiation angle, irradiation height and light color temperature in the current courseware.
Further, after the light central control system simultaneously adjusts the light irradiation angle, the light irradiation height and the light color temperature in the current classroom according to the first light information, the light central control system further includes:
enabling the multiplexing camera to determine the light effect in the current classroom;
when the light effect is identical to the first light information, determining that the light effect is correct;
and when the light effect does not coincide with the first light information, enabling the light central control system to readjust the light effect which coincides with the first light information in the current classroom.
Understandably, this embodiment is mainly for verifying whether the light effect is consistent with the first light information, enhancing the supervision of the subsequent light effect, and avoiding affecting the experience effect of students and teachers.
Further, after the lighting central control system turns off the lighting in the current classroom, the lighting central control system further includes:
acquiring the facial expressions of the target user in a plurality of time periods in the teaching process of the target user, determining whether the facial expressions of the target user in each time period are matched with the courseware display content corresponding to the time period, and recording a matching result;
and evaluating the teaching quality of the target user according to the matching result.
As can be appreciated, in this embodiment, the target user facial expressions of multiple time periods may be obtained through a preset face recognition model, where the courseware display content corresponding to each time period may be different, so that the target user facial expression corresponding to each time period may also be different, that is, each courseware display content may at least correspond to one target user facial expression, at this time, the target user facial expression may be matched with the courseware display content corresponding to the time period, for example, in the teaching process, the teacher may present the target user facial expression such as excitement as much as possible in the teaching process, if the teacher does not present the corresponding target user facial expression, it may be determined that a non-matching result occurs in one time period, the teacher presents the content in the courseware with normal teaching, at this time, the teacher may present the target user facial expression such as a smile as much as possible, and if the teacher presents the corresponding target user facial expression, it may be determined that a matching result occurs in one time period, so that the teaching quality of the target user may be evaluated by means of the matching result.
In summary, the above-mentioned classroom light adjusting method can automatically adjust the light of the current classroom, does not need to worry about various construction conditions of the current classroom, does not need to spend high cost to build the classroom, does not need to worry about the light of various current environments influencing the current classroom, and can ensure the watching definition of courseware in the current classroom and the good external image of teachers, thereby improving the teaching quality of the classroom. The method is also applied to the field of intelligent education, thereby promoting the construction of intelligent cities.
It should be understood that the sequence number of each step in the foregoing embodiment does not mean that the execution sequence of each process should be determined by the function and the internal logic, and should not limit the implementation process of the embodiment of the present invention.
In one embodiment, a classroom light adjustment device is provided, where the classroom light adjustment device corresponds to the classroom light adjustment method in the above embodiment one-to-one. As shown in fig. 3, the classroom light adjustment device includes a first determination module 11, an identification module 12, a first adjustment module 13, and a shut-down module 14. The functional modules are described in detail as follows:
the first determining module 11 is configured to receive a courseware opening instruction sent by a control terminal in a current classroom, and determine target information through a multiplexing camera; the target information comprises courseware display pictures and target users, wherein the actual distance of the courseware display pictures is within a preset target distance;
the recognition module 12 is configured to use the courseware display picture and the target user in the target information as a detection core of the multiplexing camera, so that the multiplexing camera recognizes the face brightness, the facial expression, the background color and the courseware display content of the target user in the current class room in real time;
the first adjusting module 13 is configured to modulate real-time light in a virtual drawing board according to the face brightness of the target user, the facial expression of the target user, the background color of the courseware, and the display content of the courseware, and fuse the modulated real-time light in a virtual picture of the current courseroom, so as to analyze first light information most suitable for the current courseroom in real time according to the virtual picture, and transmit the first light information to a light central control system in real time, so that the light central control system can adjust a light irradiation angle, an irradiation height, and a light color temperature in the current courseroom according to the first light information;
and the closing module 14 is used for enabling the lamplight central control system to close lamplight in the current classroom when the fact that the multiplexing camera does not recognize the target information within the preset time threshold is detected.
Further, the identification module includes:
the first recognition sub-module is used for recognizing the face brightness of the target user and the facial expression of the target user in real time through the face recognition method integrated in the multiplexing camera;
the second recognition sub-module is used for recognizing the background color of the courseware in real time through the color detection algorithm integrated in the multiplexing camera;
and the third recognition sub-module is used for recognizing the courseware display content in real time through the image recognition algorithm integrated in the multiplexing camera.
Further, the classroom light adjusting device further includes:
the second adjusting module is used for acquiring the illumination intensity in the current environment of the current classroom, which is detected in real time by a preset illumination intensity sensor, determining the initial brightness and the ending brightness of the courseware display picture in the current classroom through the illumination intensity, and adjusting the brightness of the courseware display picture according to the initial brightness and the ending brightness.
Further, the first determining module includes:
the first calculation module is used for acquiring the character characteristics of the target user and the position information of the courseware display picture displayed in the current classroom, and calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character characteristics and the position information;
the second determining module is used for determining the target user and the courseware display picture as the target information when the actual distance is within a preset target distance;
and the second calculation module is used for prompting the target information to be lost when the actual distance exceeds a preset target distance, and continuously calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character features and the position information.
Further, the classroom light adjusting device further includes:
and the third adjusting module is used for re-analyzing second lamplight information which is most suitable for the current classroom according to the changed face brightness of the target user, the face expression of the target user, the background color of the courseware and the courseware display content when detecting that at least one of the face brightness of the target user, the face expression of the target user, the background color of the courseware and the courseware display content is changed in real time, and transmitting the second lamplight information to the lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current classroom according to the second lamplight information.
Further, the third adjustment module includes:
the recording module is used for confirming that the courseware display content is changed in light influence when the number of page changes in the courseware display picture is lower than a preset number threshold value in real time within a preset time length, and recording the change information of the courseware display content;
and when the page change number in the courseware display picture is detected to be greater than or equal to a preset number threshold value in real time within the preset time, confirming that the courseware display content is changed in a non-light influence manner.
Further, the classroom light adjusting device further includes:
the third determining module is used for enabling the multiplexing camera to determine the light effect in the current classroom;
a fourth determining module, configured to determine that the light effect is correct when the light effect matches the first light information;
and the fourth adjusting module is used for enabling the lamplight central control system to readjust the lamplight effect which is matched with the first lamplight information in the current class room when the lamplight effect is not matched with the first lamplight information.
The specific limitation of the classroom light adjusting device can be referred to above as limitation of the classroom light adjusting method, and will not be described herein. The modules in the classroom light adjusting device can be realized in whole or in part by software, hardware and a combination thereof. The above modules may be embedded in hardware or may be independent of a processor in the computer device, or may be stored in software in a memory in the computer device, so that the processor may call and execute operations corresponding to the above modules.
In one embodiment, a computer device is provided, which may be a server, the internal structure of which may be as shown in fig. 4. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, computer programs, and a database. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage media. The database of the computer device is used for storing data related to the classroom light adjustment method. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program when executed by a processor implements a classroom light adjustment method.
In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the steps of the classroom light adjustment method in the above embodiment, such as steps S10 to S40 shown in fig. 2. Alternatively, the processor may implement the functions of the modules/units of the classroom light adjustment device in the above embodiments, such as the functions of modules 11 through 14 shown in fig. 4, when executing a computer program. In order to avoid repetition, a description thereof is omitted.
In one embodiment, a computer readable storage medium is provided, on which a computer program is stored, which when executed by a processor, implements the steps of the classroom light adjustment method in the above embodiment, such as steps S10 through S40 shown in fig. 2. Alternatively, the computer program when executed by the processor implements the functions of the modules/units of the classroom light adjustment device in the above embodiments, such as the functions of modules 11 through 14 shown in fig. 4. In order to avoid repetition, a description thereof is omitted.
Those skilled in the art will appreciate that implementing all or part of the above described methods may be accomplished by way of a computer program stored on a non-transitory computer readable storage medium, which when executed, may comprise the steps of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in embodiments provided herein may include non-volatile and/or volatile memory. The nonvolatile memory can include Read Only Memory (ROM), programmable ROM (PROM), electrically Programmable ROM (EPROM), electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double Data Rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous Link DRAM (SLDRAM), memory bus direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), among others.
It will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of the functional units and modules is illustrated, and in practical application, the above-described functional distribution may be performed by different functional units and modules according to needs, i.e. the internal structure of the apparatus is divided into different functional units or modules to perform all or part of the above-described functions.
The above embodiments are only for illustrating the technical solution of the present invention, and not for limiting the same; although the invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical scheme described in the foregoing embodiments can be modified or some technical features thereof can be replaced by equivalents; such modifications and substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the present invention, and are intended to be included in the scope of the present invention.
Claims (9)
1. A classroom light adjustment method, comprising:
receiving a courseware opening instruction sent by a control terminal in a current classroom, and determining target information by multiplexing a camera; the target information comprises courseware display pictures and target users, wherein the actual distance of the courseware display pictures is within a preset target distance; the target user refers to a teacher who gives lessons in the current classroom;
taking the courseware display picture and the target user in the target information as detection cores of the multiplexing camera, so that the multiplexing camera can identify the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware in the current class room in real time;
modulating real-time lamplight in a virtual drawing board according to the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware, fusing the modulated real-time lamplight in a virtual picture of the current courseware, analyzing first lamplight information which is most suitable for the current courseware in real time according to the virtual picture, and transmitting the first lamplight information to a lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current courseware according to the first lamplight information;
when the multiplexing camera is detected to not recognize the target information within a preset time threshold, the lamplight central control system is enabled to close lamplight in the current classroom;
the determining target information by multiplexing the cameras comprises:
acquiring the character characteristics of the target user and the position information of the courseware display picture displayed in the current classroom, and calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character characteristics and the position information;
when the actual distance is within the preset target distance, determining the target user and the courseware display picture as the target information;
and when the actual distance exceeds the preset target distance, prompting that the target information is missing, and continuously calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character features and the position information.
2. The classroom light adjustment method according to claim 1, wherein the multiplexed camera integrates a color detection algorithm, a face recognition method, and an image recognition algorithm; the enabling the multiplexing camera to identify the face brightness of the target user, the facial expression of the target user, the background color of courseware and the display content of the courseware in the current class room in real time comprises the following steps:
the face brightness of the target user and the facial expression of the target user are recognized in real time through the face recognition method integrated in the multiplexing camera;
the background color of the courseware is identified in real time through the color detection algorithm integrated in the multiplexing camera;
and identifying the courseware display content in real time through the image identification algorithm integrated in the multiplexing camera.
3. The classroom light adjustment method according to claim 1, wherein after receiving the courseware opening command sent by the control terminal in the current classroom, further comprising:
acquiring the illumination intensity in the current environment of the current classroom, which is detected in real time by a preset illumination intensity sensor, determining the initial brightness and the ending brightness of the courseware display picture in the current classroom through the illumination intensity, and adjusting the brightness of the courseware display picture according to the initial brightness and the ending brightness.
4. The method for adjusting light in a classroom according to claim 1, wherein after the light central control system simultaneously adjusts the light irradiation angle, the light irradiation height and the light color temperature in the current classroom according to the first light information, the method further comprises:
when detecting that at least one of the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware is changed in real time, re-analyzing second lamplight information which is most suitable for the current class room according to the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware after the change, and transmitting the second lamplight information to a lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current class room according to the second lamplight information.
5. The classroom light adjustment method according to claim 4, wherein said detecting in real time a change in at least one of the brightness of the face of the target user, the facial expression of the target user, the background color of the courseware, and the presentation content of the courseware, comprises:
when the page change number in the courseware display picture is detected to be lower than a preset number threshold value in real time within a preset time length, confirming that the courseware display content is changed in light influence, and recording change information of the courseware display content;
and when the page change number in the courseware display picture is detected to be greater than or equal to a preset number threshold value in real time within the preset time, confirming that the courseware display content is changed in a non-light influence manner.
6. The method for adjusting light in a classroom according to claim 1, wherein after the light central control system simultaneously adjusts the light irradiation angle, the light irradiation height and the light color temperature in the current classroom according to the first light information, the method further comprises:
enabling the multiplexing camera to determine the light effect in the current classroom;
when the light effect is identical to the first light information, determining that the light effect is correct;
and when the light effect does not coincide with the first light information, enabling the light central control system to readjust the light effect which coincides with the first light information in the current classroom.
7. A classroom light adjustment device, comprising:
the first determining module is used for receiving a courseware opening instruction sent by a control terminal in a current classroom and determining target information through a multiplexing camera; the target information comprises courseware display pictures and target users, wherein the actual distance of the courseware display pictures is within a preset target distance; the target user refers to a teacher who gives lessons in the current classroom;
the recognition module is used for taking the courseware display picture and the target user in the target information as detection cores of the multiplexing camera, so that the multiplexing camera can recognize the face brightness of the target user, the facial expression of the target user, the background color of the courseware and the display content of the courseware in the current class room in real time;
the first adjusting module is used for modulating real-time lamplight in a virtual drawing board according to the face brightness of the target user, the facial expression of the target user, the background color of courseware and the display content of the courseware, fusing the modulated real-time lamplight in a virtual picture of the current courseware, analyzing first lamplight information which is most suitable for the current courseware in real time according to the virtual picture, and transmitting the first lamplight information to the lamplight central control system in real time so that the lamplight central control system can simultaneously adjust the lamplight irradiation angle, the irradiation height and the lamplight color temperature in the current courseware according to the first lamplight information;
the closing module is used for enabling the lamplight central control system to close lamplight in the current classroom when the fact that the multiplexing camera does not recognize the target information within a preset time threshold is detected;
the first determining module includes:
the first calculation module is used for acquiring the character characteristics of the target user and the position information of the courseware display picture displayed in the current classroom, and calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character characteristics and the position information;
the second determining module is used for determining the target user and the courseware display picture as the target information when the actual distance is within the preset target distance;
and the second calculation module is used for prompting the target information to be lost when the actual distance exceeds the preset target distance, and continuously calculating the actual distance between the target user and the courseware display picture in real time through the multiplexing camera according to the character features and the position information.
8. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the classroom light adjustment method of any one of claims 1-6 when the computer program is executed by the processor.
9. A computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the classroom light adjustment method of any one of claims 1-6.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010723005.2A CN111860365B (en) | 2020-07-24 | 2020-07-24 | Classroom light adjusting method and device, computer equipment and storage medium |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010723005.2A CN111860365B (en) | 2020-07-24 | 2020-07-24 | Classroom light adjusting method and device, computer equipment and storage medium |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111860365A CN111860365A (en) | 2020-10-30 |
CN111860365B true CN111860365B (en) | 2024-02-06 |
Family
ID=72950090
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010723005.2A Active CN111860365B (en) | 2020-07-24 | 2020-07-24 | Classroom light adjusting method and device, computer equipment and storage medium |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111860365B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112799433B (en) * | 2021-01-20 | 2022-08-12 | 深圳市达特文化科技股份有限公司 | Character display system based on point light source |
CN112954864A (en) * | 2021-02-04 | 2021-06-11 | 无锡欣马智慧科技有限公司 | Intelligent classroom dimming method and system |
CN113010952B (en) * | 2021-03-26 | 2022-03-15 | 深圳市六道文化传播有限公司 | Indoor exhibition hall design method and system |
CN114494836B (en) * | 2022-04-02 | 2022-07-01 | 蜂联智能(深圳)有限公司 | Intelligent illumination debugging system based on regional environment |
Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107221202A (en) * | 2017-07-20 | 2017-09-29 | 安庆状元郎电子科技有限公司 | A kind of interactive blackboard of automatic regulating lightness |
CN108234902A (en) * | 2017-05-08 | 2018-06-29 | 浙江广播电视集团 | A kind of studio intelligence control system and method perceived based on target location |
CN109152171A (en) * | 2018-08-30 | 2019-01-04 | 广州视源电子科技股份有限公司 | Lamplight control method and device, readable storage medium and control system |
CN109657529A (en) * | 2018-07-26 | 2019-04-19 | 台州学院 | Classroom teaching effect evaluation system based on human facial expression recognition |
CN109788621A (en) * | 2019-01-29 | 2019-05-21 | 深圳市赛亿科技开发有限公司 | Intelligent lamp and its control method, electronic equipment, storage medium |
CN109842984A (en) * | 2019-03-07 | 2019-06-04 | 北京交通大学 | Wisdom classroom lighting control system and wisdom classroom illuminate self-adaptation control method |
CN110248450A (en) * | 2019-04-30 | 2019-09-17 | 广州富港万嘉智能科技有限公司 | A kind of combination personage carries out the method and device of signal light control |
WO2020045837A1 (en) * | 2018-08-28 | 2020-03-05 | 김영대 | Method for smart-remote lecturing using automatic scene-transition technology having artificial intelligence function in virtual and augmented reality lecture room |
CN210868273U (en) * | 2019-04-02 | 2020-06-26 | 湖南新云网科技有限公司 | Classroom light intelligent control device |
-
2020
- 2020-07-24 CN CN202010723005.2A patent/CN111860365B/en active Active
Patent Citations (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108234902A (en) * | 2017-05-08 | 2018-06-29 | 浙江广播电视集团 | A kind of studio intelligence control system and method perceived based on target location |
CN107221202A (en) * | 2017-07-20 | 2017-09-29 | 安庆状元郎电子科技有限公司 | A kind of interactive blackboard of automatic regulating lightness |
CN109657529A (en) * | 2018-07-26 | 2019-04-19 | 台州学院 | Classroom teaching effect evaluation system based on human facial expression recognition |
WO2020045837A1 (en) * | 2018-08-28 | 2020-03-05 | 김영대 | Method for smart-remote lecturing using automatic scene-transition technology having artificial intelligence function in virtual and augmented reality lecture room |
CN109152171A (en) * | 2018-08-30 | 2019-01-04 | 广州视源电子科技股份有限公司 | Lamplight control method and device, readable storage medium and control system |
CN109788621A (en) * | 2019-01-29 | 2019-05-21 | 深圳市赛亿科技开发有限公司 | Intelligent lamp and its control method, electronic equipment, storage medium |
CN109842984A (en) * | 2019-03-07 | 2019-06-04 | 北京交通大学 | Wisdom classroom lighting control system and wisdom classroom illuminate self-adaptation control method |
CN210868273U (en) * | 2019-04-02 | 2020-06-26 | 湖南新云网科技有限公司 | Classroom light intelligent control device |
CN110248450A (en) * | 2019-04-30 | 2019-09-17 | 广州富港万嘉智能科技有限公司 | A kind of combination personage carries out the method and device of signal light control |
Non-Patent Citations (1)
Title |
---|
基于物联网的教室灯光智能调节***;许浩然;《电子技术与软件工程》(第4期);第84-85页 * |
Also Published As
Publication number | Publication date |
---|---|
CN111860365A (en) | 2020-10-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111860365B (en) | Classroom light adjusting method and device, computer equipment and storage medium | |
CN109271945B (en) | Method and system for realizing job correction on line | |
US7652716B2 (en) | Computer-controlled lighting for video communication | |
CN108875473A (en) | Living body verification method, device and system and storage medium | |
CN104902180B (en) | A kind of mobile terminal camera parameter regulation means and mobile terminal | |
CN112669422B (en) | Simulated 3D digital person generation method and device, electronic equipment and storage medium | |
CN111008542A (en) | Object concentration analysis method and device, electronic terminal and storage medium | |
CN112996196A (en) | Intelligent environment light control method, system, computer equipment and storage medium | |
CN108229450A (en) | The method and living creature characteristic recognition system of light filling are carried out based on screen display | |
CN110012116A (en) | It is a kind of intelligent with system and device | |
CN114596620B (en) | Light supplement control method, device and equipment for face recognition equipment and storage medium | |
CN208013970U (en) | A kind of living creature characteristic recognition system | |
CN110827595A (en) | Interaction method and device in virtual teaching and computer storage medium | |
CN109618088A (en) | Intelligent camera system and method with illumination identification and reproduction capability | |
CN114881893A (en) | Image processing method, device, equipment and computer readable storage medium | |
CN112529548B (en) | Online education platform cloud resource management system | |
US20200034606A1 (en) | Facial mirroring in virtual and augmented reality | |
CN113536893A (en) | Online teaching learning concentration degree identification method, device, system and medium | |
CN108965837A (en) | A kind of projection environment brightness control method, system and terminal device | |
CN114596616A (en) | Intelligent classroom lighting method and system based on face recognition | |
CN110896448B (en) | Teaching video shooting method, device and system | |
CN110867106B (en) | Chinese teaching system | |
CN110688991A (en) | Intelligent reading method and intelligent learning table thereof | |
CN114245529B (en) | Light control method and system | |
CN111416971B (en) | Control method, control system, electronic device and readable storage medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |