CN114816043A - Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof - Google Patents

Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof Download PDF

Info

Publication number
CN114816043A
CN114816043A CN202111419842.7A CN202111419842A CN114816043A CN 114816043 A CN114816043 A CN 114816043A CN 202111419842 A CN202111419842 A CN 202111419842A CN 114816043 A CN114816043 A CN 114816043A
Authority
CN
China
Prior art keywords
skylight
gesture
pupil
control
cover plate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111419842.7A
Other languages
Chinese (zh)
Inventor
龚晓琴
田鋆
李彦奇
王星皓
娄凌宇
张云轩
张楠
李佳
韩立武
苗冬梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FAW Bestune Car Co Ltd
Original Assignee
FAW Bestune Car Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by FAW Bestune Car Co Ltd filed Critical FAW Bestune Car Co Ltd
Priority to CN202111419842.7A priority Critical patent/CN114816043A/en
Publication of CN114816043A publication Critical patent/CN114816043A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B60—VEHICLES IN GENERAL
    • B60J—WINDOWS, WINDSCREENS, NON-FIXED ROOFS, DOORS, OR SIMILAR DEVICES FOR VEHICLES; REMOVABLE EXTERNAL PROTECTIVE COVERINGS SPECIALLY ADAPTED FOR VEHICLES
    • B60J7/00—Non-fixed roofs; Roofs with movable panels, e.g. rotary sunroofs
    • B60J7/0007—Non-fixed roofs; Roofs with movable panels, e.g. rotary sunroofs moveable head-liners, screens, curtains or blinds for ceilings
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention discloses a vehicle-mounted gesture control skylight system based on pupil recognition and a control method thereof, belonging to the technical field of automobile skylights and comprising the following steps: skylight apron drive control system, skylight sunshade screen drive control system, gesture recognition unit, central controller and infrared pupil identification system. The invention provides a vehicle-mounted gesture control skylight system based on a neural network and a control method thereof.

Description

Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof
Technical Field
The invention discloses a vehicle-mounted gesture control skylight system based on pupil recognition and a control method thereof, and belongs to the technical field of automobile skylights.
Background
The automobile skylight is arranged on the top of an automobile, so that air in the automobile can be effectively circulated, the fresh air can be effectively introduced, and healthy and comfortable enjoyment experience is brought to an automobile owner. An automotive sunroof generally includes a sunroof cover, a sunroof curtain, and a sunroof rail supporting and restraining the sunroof cover and the sunroof curtain in a moving direction. The automobile skylight further comprises a skylight cover plate driving control system for driving and controlling the movable skylight cover plate to open and close and a skylight sunshade curtain driving control system for driving and controlling the movable skylight sunshade curtain to open and close.
The switch window signal is obtained through the key controller, and with the development of times and science and technology, the conventional key operation cannot meet the psychological requirement of pursuing novelty and fashion of customers. In addition, the skylight key and the lighting lamp are controlled to be small in size in the market at present, a driver is often required to operate the skylight key after raising and confirming the position of the skylight key in the driving process, the skylight is difficult to operate while observing road conditions, driving is easy to be distracted, danger is caused, and the driving safety of vehicles is not facilitated.
For solving the above-mentioned problem that exists, carry out single regulation through the position that changes key controller or adopt the gesture at present, but can not carry out gesture recognition according to user's custom to still can lead to the unable discernment's of gesture problem, experience is felt relatively poorly.
Disclosure of Invention
The invention aims to solve the problems that a skylight control system in the market is single, low in automation degree and incapable of performing gesture recognition according to user habits at present, and provides a vehicle-mounted gesture control skylight system based on pupil recognition and a control method thereof.
The invention aims to solve the problems and is realized by the following technical scheme:
a pupil recognition based vehicle-mounted gesture control skylight system comprises: the skylight cover plate driving control system, the skylight sunshade curtain driving control system, the gesture recognition unit, the central controller and the infrared pupil recognition system are arranged on the skylight cover plate, the central controller is electrically connected with the skylight cover plate driving control system, the skylight sunshade curtain driving control system, the gesture recognition unit and the infrared pupil recognition system respectively, and the gesture recognition unit comprises a first gesture recognition unit and a second gesture recognition unit respectively.
Preferably, the infrared pupil identification system is used for identifying the pupil information of the driver, and comprises an infrared pupil acquisition module and an alarm module which are electrically connected.
Preferably, the first gesture recognition unit and the second gesture recognition unit are respectively used for acquiring a first gesture motion image signal and a second gesture motion image signal.
Preferably, the sunroof cover driving control system includes:
the skylight cover plate control unit is used for controlling the opening and closing of the movable skylight cover plate;
and the skylight cover plate driving unit is used for driving the movable skylight cover plate to open and close.
Preferably, the sunroof shade drive control system includes:
the skylight sunshade curtain control unit is used for controlling the opening and closing of the movable skylight sunshade curtain;
and the skylight sunshade curtain driving unit is used for driving the movable skylight sunshade curtain to open and close.
A control method for controlling a skylight system through vehicle-mounted gestures based on pupil recognition comprises the following steps:
the pupil information of the user is collected by the infrared pupil collection module and fed back to the central controller, and the central controller judges whether the pupil information of the user is consistent with the initial input information;
if yes, calling corresponding user gesture habit data according to the pupil information of the user, and respectively sending opening gesture signals to a first gesture recognition unit and a second gesture recognition unit;
the first gesture recognition unit and the second gesture recognition unit respectively acquire a first gesture action image signal and a second gesture action image signal and feed back the first gesture action image signal and the second gesture action image signal to the central controller;
the central controller respectively generates execution instructions according to the acquired first gesture action image signal and the acquired second gesture action image signal and sends the execution instructions to the skylight cover plate control unit and the skylight sun-shading curtain control unit;
and the skylight cover plate control unit and the skylight sunshade screen control unit respectively receive the execution instruction and then respectively send the execution instruction to the skylight cover plate driving unit and the skylight sunshade screen driving unit to respectively execute corresponding operations.
Preferably, when the central controller judges that the pupil information of the user does not accord with the initial input information, an alarm instruction is generated and sent back to the alarm module, and the alarm module executes corresponding operation after receiving the alarm instruction.
Compared with the prior art, the invention has the following beneficial effects:
the invention provides a vehicle-mounted gesture control skylight system based on pupil recognition and a control method thereof.
Drawings
Fig. 1 is an electrical connection diagram of a vehicle-mounted gesture control skylight system based on pupil recognition.
FIG. 2 is a schematic diagram of a sunroof control gesture of a vehicle-mounted gesture control sunroof system based on pupil recognition.
FIG. 3 is a schematic diagram of a sunshade control gesture of a vehicle-mounted gesture control skylight system based on pupil recognition.
Fig. 4 is an electrical connection diagram of a central controller of a vehicle-mounted gesture control sunroof system based on pupil recognition.
Detailed Description
The invention is further illustrated below with reference to the accompanying figures 1-4:
the technical solutions of the present invention will be described clearly and completely with reference to the accompanying drawings, and it should be understood that the described embodiments are some, but not all embodiments of the present invention. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer", etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the drawings, and are only for convenience of description and simplicity of description, but do not indicate or imply that the device or element being referred to must have a particular orientation, be constructed and operated in a particular orientation, and thus, should not be construed as limiting the present invention.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
As shown in fig. 1, a first embodiment of the present invention provides a vehicle-mounted gesture control sunroof system based on pupil recognition based on the prior art, including: skylight apron drive control system, skylight sunshade screen drive control system, gesture recognition unit, central controller and infrared pupil identification system, central controller respectively with skylight apron drive control system, skylight sunshade screen drive control system, gesture recognition unit and infrared pupil identification system electric connection, the gesture recognition unit includes: first gesture recognition unit and second gesture recognition unit, infrared pupil identification system respectively with first gesture recognition unit and second gesture recognition unit electric connection.
The infrared pupil identification system is used for identifying pupil information of a driver and comprises an infrared pupil acquisition module and an alarm module which are electrically connected, when an infrared light source in the infrared pupil acquisition module irradiates the pupil of a user, a camera in the infrared pupil acquisition module acquires the pupil information of the user and feeds the pupil information back to the central controller, and the pupil information is converted into corresponding data information
The first gesture recognition unit and the second gesture recognition unit are respectively used for acquiring a first gesture action image signal and a second gesture action image signal.
The skylight cover plate driving control system comprises a skylight cover plate control unit and a skylight cover plate driving unit, wherein the skylight cover plate control unit is used for controlling the movable skylight cover plate to be opened and closed, and the skylight cover plate driving unit is used for driving the movable skylight cover plate to be opened and closed. The signal input end of the skylight cover plate control unit is connected with the central controller, and the signal output end of the skylight cover plate control unit is connected with the skylight cover plate driving unit. The skylight sunshade screen driving control system comprises a skylight sunshade screen control unit and a skylight sunshade screen driving unit, wherein the skylight sunshade screen control unit is used for controlling the opening and closing of the movable skylight sunshade screen, the skylight sunshade screen driving unit is used for driving the movable skylight sunshade screen to open and close, the signal input end of the skylight sunshade screen control unit is connected with the central controller, and the signal output end of the skylight sunshade screen control unit is connected with the skylight sunshade screen driving unit.
The first gesture recognition unit and the second gesture recognition unit are of the same structure, the first gesture recognition unit is based on a gesture sensor module and comprises a circuit board, a cross-shaped partition board is fixed on the circuit board, the circuit board is divided into four opposite spaces by the partition board, at least one infrared light-emitting element and a receiver capable of recognizing and receiving light emitted by the infrared light-emitting element are arranged in each space, and the direction of at least one infrared light-emitting element in the same space is consistent with the direction of the receiver in the space; the maximum distance from the receiver to the circuit board is smaller than the maximum distance from the infrared light-emitting element to the circuit board; the maximum distance from the infrared light-emitting element to the circuit board is smaller than the maximum distance from the partition board to the circuit board. When the user waves his hand, the hand reflects the light emitted from the infrared light-emitting element to the receiver. The hand is in different positions, different receivers receive the hand, and the gesture action of the user can be judged according to the time sequence received by the receivers. In order to make gesture recognition more accurate, the surface of division board is covered with reflection of light rete, and the division board is more far away from the circuit board, and the thickness is littleer. So that the space separated by the isolation plate is in a bell mouth shape, and more light enters the receiver. In order to avoid gesture recognition errors, the gesture sensor module further comprises a signal processing module, and the signal processing module is connected with the infrared light-emitting element and the receiver. The signal processing module judges the gesture according to the signal change of the receiver, and after the signal processing module identifies a certain gesture meeting the requirement, if no other gesture appears within three seconds, the gesture is considered to be correct, a signal is output to the skylight glass control unit, otherwise, the gesture is considered to be invalid, and the gesture identified finally is taken as a standard to be judged. Thereby avoiding the false opening and closing caused by waving hands.
The above describes a vehicle-mounted gesture control skylight system based on pupil recognition, and the control method thereof is described as follows, the method comprises the following steps:
step S1, acquiring pupil information of the user by the infrared pupil acquisition module and feeding back the pupil information to the central controller, and judging whether the pupil information of the user is consistent with the initial input information by the central controller;
if yes, calling corresponding user gesture habit data according to the pupil information of the user, and respectively sending opening gesture signals to a first gesture recognition unit and a second gesture recognition unit;
if not, generating an alarm instruction and feeding the alarm instruction back to the alarm module, and executing corresponding operation after the alarm module receives the alarm instruction.
Step S2, the first gesture recognition unit and the second gesture recognition unit respectively acquire a first gesture image signal and a second gesture image signal and feed back the first gesture image signal and the second gesture image signal to the central controller;
step S3, the central controller respectively generates execution instructions according to the acquired first gesture image signal and the acquired second gesture image signal and sends the execution instructions to the skylight cover plate control unit and the skylight sun-shading curtain control unit;
and the skylight cover plate control unit and the skylight sunshade screen control unit respectively receive the execution instruction and then respectively send the execution instruction to the skylight cover plate driving unit and the skylight sunshade screen driving unit to respectively execute corresponding operations.
The gesture motion image signal operation logic is shown in table 1 below, the control gesture is not limited to a left hand or a right hand, the left hand is taken as an example in the embodiment, and the skylight control gesture and the sunshade screen control gesture are shown in fig. 2-3.
TABLE 1 gesture image signal operation logic table
Figure RE-GDA0003693045770000071
The central controller is in the form of a general purpose computing device. As shown in fig. 4, in general, computing device 100 includes: a processor 101 and a memory 102.
Processor 101 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and so forth. The processor 101 may be implemented in at least one hardware form of a DSP (Digital Signal Processing), an FPGA (Field-Programmable Gate Array), and a PLA (Programmable Logic Array). The processor 101 may also include a main processor and a coprocessor, where the main processor is a processor for Processing data in an awake state, and is also called a Central Processing Unit (CPU); a coprocessor is a low power processor for processing data in a standby state. In some embodiments, the processor 101 may be integrated with a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the display screen. In some embodiments, the processor 101 may further include an AI (Artificial Intelligence) processor for processing computing operations related to machine learning.
Memory 102 may include one or more computer-readable storage media, which may be tangible and non-transitory. Memory 102 may also include high speed random access memory, as well as non-volatile memory, such as one or more magnetic disk storage devices, flash memory storage devices. In some embodiments, a non-transitory computer readable storage medium in the memory 102 is used to store at least one instruction for execution by the processor 101 to implement a semantic recognition based vehicle gesture control sunroof system and a control method thereof provided herein.
In some embodiments, the terminal 100 may further include: a peripheral interface 103 and at least one peripheral. Specifically, the peripheral device includes: at least one of radio frequency circuitry 104, touch screen display 105, camera 106, audio circuitry 107, positioning components 108, and power supply 109.
The peripheral interface 103 may be used to connect at least one peripheral related to I/O (Input/Output) to the processor 101 and the memory 102. In some embodiments, processor 101, memory 102, and peripheral interface 103 are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor 101, the memory 102, and the peripheral interface 103 may be implemented on separate chips or circuit boards, which is not limited by the embodiment.
The Radio Frequency circuit 104 is used for receiving and transmitting RF (Radio Frequency) signals, also called electromagnetic signals. The radio frequency circuitry 104 communicates with communication networks and other communication devices via electromagnetic signals. The rf circuit 104 converts an electrical signal into an electromagnetic signal for transmission, or converts a received electromagnetic signal into an electrical signal. Optionally, the radio frequency circuit 104 comprises: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and so forth. The radio frequency circuitry 104 may communicate with other terminals via at least one wireless communication protocol. The wireless communication protocols include, but are not limited to: the world wide web, metropolitan area networks, intranets, generations of mobile communication networks (2G, 3G, 4G, and 5G), Wireless local area networks, and/or WiFi (Wireless Fidelity) networks. In some embodiments, the rf circuit 104 may further include NFC (Near Field Communication) related circuits, which are not limited in this application.
The touch display screen 105 is used to display a UI (User Interface). The UI may include graphics, text, icons, video, and any combination thereof. The touch display screen 105 also has the ability to acquire touch signals on or over the surface of the touch display screen 105. The touch signal may be input to the processor 101 as a control signal for processing. The touch screen display 105 is used to provide virtual buttons and/or a virtual keyboard, also referred to as soft buttons and/or a soft keyboard. In some embodiments, the touch display screen 105 may be one, providing the front panel of the terminal 100; in other embodiments, the touch display screen 105 may be at least two, respectively disposed on different surfaces of the terminal 100 or in a folded design; in still other embodiments, the touch display 105 may be a flexible display disposed on a curved surface or on a folded surface of the terminal 100. Even more, the touch screen display 105 may be arranged in a non-rectangular irregular pattern, i.e., a shaped screen. The touch Display screen 105 may be made of LCD (Liquid Crystal Display), OLED (Organic Light-Emitting Diode), and the like.
The camera assembly 106 is used to capture images or video. Optionally, the camera assembly 106 includes a front camera and a rear camera. Generally, a front camera is used for realizing video call or self-shooting, and a rear camera is used for realizing shooting of pictures or videos. In some embodiments, the number of the rear cameras is at least two, and each of the rear cameras is any one of a main camera, a depth-of-field camera and a wide-angle camera, so that the main camera and the depth-of-field camera are fused to realize a background blurring function, and the main camera and the wide-angle camera are fused to realize a panoramic shooting function and a VR (Virtual Reality) shooting function. In some embodiments, camera head assembly 106 may also include a flash. The flash lamp can be a monochrome temperature flash lamp or a bicolor temperature flash lamp. The double-color-temperature flash lamp is a combination of a warm-light flash lamp and a cold-light flash lamp, and can be used for light compensation at different color temperatures.
Audio circuit 107 is operative to provide an audio interface between a user and terminal 100. Audio circuitry 107 may include a microphone and a speaker. The microphone is used for collecting sound waves of a user and the environment, converting the sound waves into electric signals, and inputting the electric signals to the processor 101 for processing or inputting the electric signals to the radio frequency circuit 104 to realize voice communication. The microphones may be provided in plural, respectively at different portions of the terminal 100 for the purpose of stereo sound collection or noise reduction. The microphone may also be an array microphone or an omni-directional pick-up microphone. The speaker is used to convert electrical signals from the processor 101 or the radio frequency circuit 104 into sound waves. The loudspeaker can be a traditional film loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, the speaker can be used for purposes such as converting an electric signal into a sound wave audible to a human being, or converting an electric signal into a sound wave inaudible to a human being to measure a distance. In some embodiments, audio circuitry 107 may also include a headphone jack.
The positioning component 108 is used to locate the current geographic Location of the terminal 100 to implement navigation or LBS (Location Based Service). The Positioning component 108 can be a Positioning component based on the Global Positioning System (GPS) in the united states, the beidou System in china, or the galileo System in russia.
The power supply 109 is used to supply power to various components in the terminal 100. The power source 109 may be alternating current, direct current, disposable or rechargeable. When the power supply 109 includes a rechargeable battery, the rechargeable battery may be a wired rechargeable battery or a wireless rechargeable battery. The wired rechargeable battery is a battery charged through a wired line, and the wireless rechargeable battery is a battery charged through a wireless coil. The rechargeable battery may also be used to support fast charge technology.
In some embodiments, the terminal 100 also includes one or more sensors 110. The one or more sensors 110 include, but are not limited to: acceleration sensor 111, gyro sensor 112, pressure sensor 113, fingerprint sensor 114, optical sensor 115, and proximity sensor 116.
The acceleration sensor 111 can detect the magnitude of acceleration on three coordinate axes of a coordinate system established with the terminal 100. For example, the acceleration sensor 111 may be used to detect components of the gravitational acceleration in three coordinate axes. The processor 101 may control the touch screen 105 to display the user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 111. The acceleration sensor 111 may also be used for acquisition of motion data of a game or a user.
The gyro sensor 112 may detect a body direction and a rotation angle of the terminal 100, and the gyro sensor 112 may cooperate with the acceleration sensor 111 to acquire a 3D (3 dimensional) motion of the user with respect to the terminal 100. From the data collected by the gyro sensor 112, the processor 101 may implement the following functions: motion sensing (such as changing the UI according to a user's tilting operation), image stabilization at the time of photographing, game control, and inertial navigation.
The pressure sensor 113 may be disposed on a side bezel of the terminal 100 and/or an underlying layer of the touch display screen 105. When the pressure sensor 113 is disposed at a side frame of the terminal 100, a user's grip signal to the terminal 100 can be detected, and left-right hand recognition or shortcut operation can be performed according to the grip signal. When the pressure sensor 113 is disposed at the lower layer of the touch display screen 105, the operability control on the UI interface can be controlled according to the pressure operation of the user on the touch display screen 105. The operability control comprises at least one of a button control, a scroll bar control, an icon control and a menu control.
The fingerprint sensor 114 is used for collecting a fingerprint of a user to identify the identity of the user according to the collected fingerprint. Upon identifying that the user's identity is a trusted identity, the processor 101 authorizes the user to perform relevant sensitive operations including unlocking a screen, viewing encrypted information, downloading software, paying, and changing settings, etc. The fingerprint sensor 114 may be disposed on the front, back, or side of the terminal 100. When a physical button or a vendor Logo is provided on the terminal 100, the fingerprint sensor 114 may be integrated with the physical button or the vendor Logo.
The optical sensor 115 is used to collect the ambient light intensity. In one embodiment, the processor 101 may control the display brightness of the touch screen display 105 based on the ambient light intensity collected by the optical sensor 115. Specifically, when the ambient light intensity is high, the display brightness of the touch display screen 105 is increased; when the ambient light intensity is low, the display brightness of the touch display screen 105 is turned down. In another embodiment, the processor 101 may also dynamically adjust the shooting parameters of the camera head assembly 106 according to the ambient light intensity collected by the optical sensor 115.
A proximity sensor 116, also known as a distance sensor, is typically disposed on the front face of the terminal 100. The proximity sensor 116 is used to collect the distance between the user and the front surface of the terminal 100. In one embodiment, when the proximity sensor 116 detects that the distance between the user and the front surface of the terminal 100 gradually decreases, the processor 101 controls the touch display screen 105 to switch from the bright screen state to the dark screen state; when the proximity sensor 116 detects that the distance between the user and the front surface of the terminal 100 gradually becomes larger, the processor 101 controls the touch display screen 105 to switch from the breath screen state to the bright screen state.
Those skilled in the art will appreciate that the configuration shown in fig. 4 is not intended to be limiting of terminal 100 and may include more or fewer components than those shown, or some components may be combined, or a different arrangement of components may be used.
In an exemplary embodiment, a computer readable storage medium is further provided, on which a computer program is stored, which when executed by a processor, implements a semantic recognition based vehicle-mounted gesture control sunroof system and a control method thereof as provided in all inventive embodiments of the present application.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
While embodiments of the invention have been disclosed above, it is not intended to be limited to the uses set forth in the specification and examples. It can be applied to all kinds of fields suitable for the present invention. Additional modifications will readily occur to those skilled in the art. It is therefore intended that the invention not be limited to the exact details and illustrations described and illustrated herein, but fall within the scope of the appended claims and equivalents thereof.

Claims (7)

1. The utility model provides a vehicle-mounted gesture control skylight system based on pupil discernment which characterized in that includes: the skylight cover plate driving control system, the skylight sunshade curtain driving control system, the gesture recognition unit, the central controller and the infrared pupil recognition system are arranged on the skylight cover plate, the central controller is electrically connected with the skylight cover plate driving control system, the skylight sunshade curtain driving control system, the gesture recognition unit and the infrared pupil recognition system respectively, and the gesture recognition unit comprises a first gesture recognition unit and a second gesture recognition unit respectively.
2. The vehicle-mounted gesture control skylight system based on pupil identification as claimed in claim 1, wherein the infrared pupil identification system is used for identifying pupil information of a driver, and comprises an infrared pupil acquisition module and an alarm module which are electrically connected.
3. The pupil recognition-based vehicle-mounted gesture control sunroof system according to claim 2, wherein the first gesture recognition unit and the second gesture recognition unit are respectively configured to acquire a first gesture motion image signal and a second gesture motion image signal.
4. The vehicle-mounted gesture control skylight system based on pupil recognition according to claim 3, wherein the skylight cover plate driving control system comprises:
the skylight cover plate control unit is used for controlling the opening and closing of the movable skylight cover plate;
and the skylight cover plate driving unit is used for driving the movable skylight cover plate to open and close.
5. The gesture-controlled skylight system of claim 4, wherein the skylight covering drive control system comprises:
the skylight sunshade curtain control unit is used for controlling the opening and closing of the movable skylight sunshade curtain;
and the skylight sunshade curtain driving unit is used for driving the movable skylight sunshade curtain to open and close.
6. A control method for controlling a skylight system through a vehicle-mounted gesture based on pupil recognition is characterized by comprising the following steps:
the pupil information of the user is collected by the infrared pupil collection module and fed back to the central controller, and the central controller judges whether the pupil information of the user is consistent with the initial input information;
if yes, calling corresponding user gesture habit data according to the pupil information of the user, and respectively sending opening gesture signals to a first gesture recognition unit and a second gesture recognition unit;
the first gesture recognition unit and the second gesture recognition unit respectively acquire a first gesture action image signal and a second gesture action image signal and feed back the first gesture action image signal and the second gesture action image signal to the central controller;
the central controller respectively generates execution instructions according to the acquired first gesture action image signal and the acquired second gesture action image signal and sends the execution instructions to the skylight cover plate control unit and the skylight sun-shading curtain control unit;
and the skylight cover plate control unit and the skylight sunshade screen control unit respectively receive the execution instruction and then respectively send the execution instruction to the skylight cover plate driving unit and the skylight sunshade screen driving unit to respectively execute corresponding operations.
7. The control method of the vehicle-mounted gesture control skylight system based on the pupil recognition is characterized in that when the central controller judges that the pupil information of the user is inconsistent with the initial input information, an alarm instruction is generated and sent back to the alarm module, and the alarm module executes corresponding operation after receiving the alarm instruction.
CN202111419842.7A 2021-11-26 2021-11-26 Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof Pending CN114816043A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111419842.7A CN114816043A (en) 2021-11-26 2021-11-26 Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111419842.7A CN114816043A (en) 2021-11-26 2021-11-26 Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof

Publications (1)

Publication Number Publication Date
CN114816043A true CN114816043A (en) 2022-07-29

Family

ID=82526624

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111419842.7A Pending CN114816043A (en) 2021-11-26 2021-11-26 Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof

Country Status (1)

Country Link
CN (1) CN114816043A (en)

Similar Documents

Publication Publication Date Title
CN108961681B (en) Fatigue driving reminding method and device and storage medium
KR20180136776A (en) Mobile terminal and method for controlling the same
CN113212257B (en) Automatic driver seat position adjusting method, device, terminal and storage medium based on Internet of vehicles
CN110341627B (en) Method and device for controlling behavior in vehicle
CN110827820B (en) Voice awakening method, device, equipment, computer storage medium and vehicle
CN110933452B (en) Method and device for displaying lovely face gift and storage medium
CN114090102B (en) Method, device, electronic equipment and medium for starting application program
CN110275655B (en) Lyric display method, device, equipment and storage medium
CN109977570B (en) Vehicle body noise determination method, device and storage medium
CN111447562B (en) Vehicle travel track analysis method and device and computer storage medium
WO2023116085A1 (en) Intelligent sun shading method and system for automobile sun shield, terminal, and storage medium
CN114090140A (en) Interaction method between devices based on pointing operation and electronic device
CN114779920A (en) Whole vehicle window gesture control system based on biological recognition and control method thereof
CN114801889A (en) Intelligent charging control method, system, terminal and storage medium for electric automobile
CN114384466A (en) Sound source direction determining method, sound source direction determining device, electronic equipment and storage medium
CN114816043A (en) Vehicle-mounted gesture control skylight system based on pupil recognition and control method thereof
CN110717365B (en) Method and device for obtaining picture
CN115237246A (en) Vehicle-mounted gesture control skylight system based on semantic recognition and control method thereof
CN110992954A (en) Method, device, equipment and storage medium for voice recognition
CN113138782A (en) Method, device, terminal and storage medium for OTA (over the air) upgrading calibration data
CN110659609B (en) Fingerprint matching method and device, electronic equipment and medium
CN111008381B (en) Terminal detection method, device, terminal and storage medium
CN110956595B (en) Face beautifying processing method, device, system and storage medium
CN113450799A (en) Vehicle-mounted schedule management method, system, terminal and storage medium
CN114822470A (en) Vehicle-mounted holographic noise reduction air conditioning method, system, terminal and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination