CN114627718A - ADAS teaching system and method - Google Patents
ADAS teaching system and method Download PDFInfo
- Publication number
- CN114627718A CN114627718A CN202210338015.3A CN202210338015A CN114627718A CN 114627718 A CN114627718 A CN 114627718A CN 202210338015 A CN202210338015 A CN 202210338015A CN 114627718 A CN114627718 A CN 114627718A
- Authority
- CN
- China
- Prior art keywords
- vehicle
- adas
- glasses
- teaching
- function
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 102100034112 Alkyldihydroxyacetonephosphate synthase, peroxisomal Human genes 0.000 title claims abstract description 111
- 101000799143 Homo sapiens Alkyldihydroxyacetonephosphate synthase, peroxisomal Proteins 0.000 title claims abstract description 111
- 238000000848 angular dependent Auger electron spectroscopy Methods 0.000 title claims abstract description 111
- 238000000034 method Methods 0.000 title claims abstract description 31
- 239000011521 glass Substances 0.000 claims abstract description 80
- 230000007246 mechanism Effects 0.000 claims description 12
- 230000009471 action Effects 0.000 claims description 11
- 230000000875 corresponding effect Effects 0.000 claims description 9
- 230000003068 static effect Effects 0.000 claims description 7
- 230000000694 effects Effects 0.000 claims description 6
- 238000013178 mathematical model Methods 0.000 claims description 5
- 230000000007 visual effect Effects 0.000 claims description 5
- 230000001276 controlling effect Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 abstract description 71
- 230000008569 process Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003014 reinforcing effect Effects 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
- G09B9/02—Simulators for teaching or training purposes for teaching control of vehicles or other craft
- G09B9/04—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles
- G09B9/05—Simulators for teaching or training purposes for teaching control of vehicles or other craft for teaching control of land vehicles the view from a vehicle being simulated
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Aviation & Aerospace Engineering (AREA)
- Business, Economics & Management (AREA)
- Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- General Physics & Mathematics (AREA)
- Control Of Driving Devices And Active Controlling Of Vehicle (AREA)
Abstract
The invention discloses an ADAS teaching system and a method, wherein the system comprises: vehicle and MR glasses; the MR glasses are used for displaying dynamic images according to the ADAS function state of the vehicle and vehicle control data, and the dynamic images are display images simulating the starting, triggering work and/or function closing of the ADAS function; the vehicle control data is provided to the MR glasses by a vehicle having a teach mode. The invention has the advantages that: thereby through the teaching and the experience of MR glasses cooperation real vehicle driving experience realization ADAS function, can help the familiarity of the quick realization function of user to know the use, help the quick various ADAS functions of handing of user, improve user experience.
Description
Technical Field
The invention relates to the field of intelligent driving, in particular to an ADAS teaching system and an ADAS teaching method.
Background
With the popularization of intelligent driving, the ADAS function of the vehicle on the market is commonly provided at present, but most users cannot use, dare to use or use the vehicle according to attitudes. How to use and how the function works is not reliably and accurately perceived by the user. At present, the teaching of the ADAS function is only embodied in the specification, and the specification is static while the ADAS function is dynamic, and the lengthy specification is not approved by the user, so that the user has no effective channel to learn the ADAS function.
Disclosure of Invention
The invention aims to overcome the defects of the prior art and provide a teaching experience system and a teaching experience method for realizing dynamic ADAS function based on MR technology, so that a user can quickly learn and experience the ADAS function.
In order to achieve the purpose, the invention adopts the technical scheme that: an ADAS teaching system, the system comprising: vehicle and MR glasses;
the MR glasses are used for displaying dynamic images according to the ADAS function state of the vehicle and vehicle control data, and the dynamic images are display images simulating the starting, triggering work and/or function closing of the ADAS function; the vehicle control data is provided to the MR glasses by a vehicle having a teach mode.
The control method of the automobile comprises the following steps that connection between a steering wheel and wheels is kept disconnected, connection between an accelerator pedal and an engine is kept disconnected, connection between a gear shifting operating mechanism and a gearbox is kept disconnected, connection between an electronic hand brake button and brake calipers is kept disconnected under a teaching mode of the automobile, and automobile control data are steering wheel signals, accelerator pedal signals, gear shifting operating mechanism signals and/or electronic hand brake signals under the teaching mode.
The vehicle is also provided with an ADAS function switch which controls the on and off of the ADAS function in a hard switch or a central control software switch mode.
MR glasses are furnished with a bluetooth OBD transceiver, bluetooth OBD transceiver is used for inserting vehicle OBD mouth, MR glasses pass through bluetooth OBD transceiver receives the signal that comes from steering wheel, accelerator pedal, brake pedal, operating device, ADAS function button, electron manual brake button, door and safety belt.
A programmable operation module is arranged in the MR glasses and used for generating virtual driving images and updating dynamic virtual images according to data transmitted by the Bluetooth OBD transceiver; and generating a vehicle driving state meeting the ADAS function triggering condition, and displaying the function in an MR (magnetic resonance) glasses in an image mode after triggering the ADAS function.
An ADAS teaching method, comprising: the method comprises the steps that the vehicle enters an ADAS teaching mode after meeting the condition of entering the teaching mode, and in the teaching mode, MR glasses receive signals from a steering wheel, an accelerator pedal, a brake pedal, a gear shifting operation mechanism, an ADAS function button, an electronic hand brake button, a vehicle door and a safety belt through a Bluetooth BOD transceiver; the MR glasses are internally provided with a logic processing module to identify a front windshield area and a rearview mirror area of the vehicle, can display dynamic images based on the identified areas to achieve the effect that a wearer can see virtual roads and vehicles in the areas, provides vehicle state conditions of an origin ADAS function to trigger the ADAS function, and updates work reminding and auxiliary control information of the ADAS function in the dynamic images displayed in the identified areas.
The condition that the vehicle meets the condition of entering the teaching mode comprises the following steps: the power mode of the vehicle is switched to ON, the electronic hand brake button is operated to lock the electronic calipers, the vehicle is kept static for a set time and the teaching mode switch is turned ON; and when the vehicle power supply mode is switched to OFF, the vehicle exits the teaching mode.
In the teaching mode, the release of a brake caliper of a vehicle is forbidden, the starting of an engine is forbidden, the enabling of a gear position of a gearbox is forbidden, and the steering is forbidden.
In the teaching mode, the MR glasses can identify a front windshield area and a rear view mirror area of the vehicle and can display dynamic images based on the identified areas so as to enable a wearer to see virtual roads and vehicles in the areas; the MR glasses receive signals from the vehicle control equipment in real time; and carrying out logic operation according to the received signals and the currently displayed virtual road and vehicle, and updating the dynamic image according to the operation result to carry out ADAS teaching.
The MR glasses are internally provided with a programmable operation module which receives signals from the Bluetooth OBD transceiver and carries out logic operation by resolving a prestored mathematical model in real time; after judging that the vehicle needs to turn, brake, accelerate or reasonably combine all the actions according to the operation result, controlling the speed and the turning angle and the active action information of the ADAS function based on the actions, and displaying corresponding different dynamic influences by the MR glasses to enable a wearer to generate a visual effect that the vehicle is doing the corresponding actions.
The invention has the advantages that: the teaching and experience of the ADAS function are realized by matching the MR glasses with the real vehicle driving experience, so that the user can be helped to quickly realize the familiarity and the understanding of the use process of the function, the user can be helped to quickly start various ADAS functions, and the user experience is improved; ADAS is decoupled with systems such as power and a steering wheel in a teaching mode, so that although driving control parts such as a steering wheel accelerator are really operated, real driving feeling is provided, real vehicle motion cannot be generated, safety and reliability in experience and teaching processes are guaranteed, and learning, teaching and experience can be realized only by one person through operation, and the system is simple and reliable.
Drawings
The contents of the various figures of the present specification and the labels in the figures are briefly described as follows:
FIG. 1 is a control schematic diagram of the present invention entering a teaching mode;
FIG. 2 is a schematic diagram of the ADAS teaching method of the present invention.
Detailed Description
The following description of preferred embodiments of the invention will be made in further detail with reference to the accompanying drawings.
The invention provides an ADAS function teaching method and device with a sense of being personally on the scene and a vehicle. Virtual roads and vehicles are simulated on a front windshield through the MR device, a user performs virtual control on the vehicles through control devices such as a steering wheel, an accelerator pedal and an ADAS function button which are completely decoupled in a non-road environment, the MR device changes the virtual roads and vehicles along with the control, and the visual effect that the user uses real devices to control the virtual vehicles is achieved. Based on the effect, the ADAS function of the vehicle is completely reproduced, so that the user can repeatedly exercise the ADAS function operation in a safe and real virtual environment. The method comprises the following specific steps:
an ADAS teaching system, the system comprising: vehicle and MR glasses;
the vehicle is provided with a teaching mode, in the teaching mode of the vehicle, the connection between a steering wheel and wheels is kept disconnected, the connection between an accelerator pedal and an engine is kept disconnected, the connection between a gear shifting operation mechanism and a gearbox is kept disconnected, and the connection between an electronic hand brake button and a brake caliper is kept disconnected;
the MR glasses are used for displaying dynamic images according to the ADAS function state of the vehicle and vehicle control data, and the dynamic images are display images simulating the starting, triggering work and/or function closing of the ADAS function; vehicle control data is provided to the MR glasses by a vehicle having a teaching mode. The vehicle control data is a steering wheel signal, an accelerator pedal signal, a gear shifting operating mechanism signal and/or an electronic hand brake signal in a teaching mode.
The vehicle is also provided with an ADAS function switch which controls the on and off of the ADAS function in a hard switch or a middle control software switch mode.
MR glasses are furnished with a bluetooth OBD transceiver, and its detachable configuration is on MR glasses body, and bluetooth OBD transceiver is used for inserting vehicle OBD mouth, and MR glasses embeds bluetooth communication, through bluetooth OBD transceiver receives the signal that comes from steering wheel, accelerator pedal, brake pedal, operating device, ADAS function button, electron manual brake button, door and safety belt.
A programmable operation module is arranged in the MR glasses and used for generating a virtual driving image and updating a dynamic virtual image according to data transmitted by the Bluetooth OBD transceiver; and generating a vehicle driving state meeting the ADAS function triggering condition, and displaying the function in an MR (magnetic resonance) glasses in an image mode after triggering the ADAS function.
The ADAS function takes a lane departure auxiliary early warning function as an example to perform principle description: a user operates a vehicle to enable the vehicle to enter a teaching mode, and the MR glasses are controlled by the built-in chip of the MR glasses to display virtual road driving animation/pictures in the teaching mode; before entering a teaching mode, a user inserts a Bluetooth OBD transceiver into an OBD port of a vehicle, after entering the teaching mode, MR glasses acquire data of the vehicle operated by the user and the starting or non-starting state of a lane departure auxiliary early warning function in ADAS, the data of the operated vehicle refers to information such as a steering wheel, an accelerator and a gear of the vehicle, the information is transmitted to the MR glasses in an electric signal mode, the MR glasses can display dynamic virtual pictures in the glasses in a virtual reality mode, the pictures comprise roads, vehicles, traffic lights and the like, when the signals such as the accelerator, the gear shifting and the steering wheel of the vehicle are received, the corresponding virtual pictures in the controlled vehicle are controlled according to control operation, whether the lane departure function is started or not is detected, if the pictures are started, the functions of the user and whether the vehicle in the picture after the MR glasses are based on the vehicle operated by the user deviates from the lane or not are detected, and the warning of the lane departure function is given, Information such as operation and display is displayed on the virtual dynamic picture in an MR (magnetic resonance) glasses mode, so that the use experience and teaching of lane departure in the ADAS function are realized, and after the operation of a user is started, the function detects whether a vehicle in the virtual driving picture deviates in real time so as to give lane departure warning, wherein the lane of the vehicle in the MR glasses is judged by the information of a steering wheel.
Firstly, the application part provides more real use scenes and experience by adopting the operation of a real vehicle, and further decouples information such as power, direction and the like of the vehicle, so that the situation that although a real steering wheel and an accelerator are operated, the steering and oiling of the real vehicle are not performed is ensured, and only the operation data provides control data for the vehicle in a virtual picture in MR glasses, thereby realizing the experience and use of the ADAS teaching function of mixed reality.
The ADAS teaching method comprises the following steps: the method comprises the steps that the vehicle enters an ADAS teaching mode after meeting the condition of entering the teaching mode, and in the teaching mode, MR glasses receive signals from a steering wheel, an accelerator pedal, a brake pedal, a gear shifting operation mechanism, an ADAS function button, an electronic hand brake button, a vehicle door and a safety belt through a Bluetooth BOD transceiver; the MR glasses are internally provided with a logic processing module to identify a front windshield area and a rearview mirror area of the vehicle, can display dynamic images based on the identified areas to achieve the effect that a wearer can see virtual roads and vehicles in the areas, provides vehicle state conditions of an origin ADAS function to trigger the ADAS function, and updates work reminding and auxiliary control information of the ADAS function in the dynamic images displayed in the identified areas.
The vehicle mainly provides real driving experience and provides data of a user for really operating the vehicle, such as data of a steering wheel, an accelerator, gears and the like, to the MR glasses, wherein the MR glasses are the core of the application, a core processor chip is arranged in the MR glasses, and the main user generates an image of a driving environment based on a driving model and enters human eyes through the MR glasses; the steering, gear shifting, refueling and the like of the vehicle in the driving model can be updated according to the operation control information of the vehicle, meanwhile, the starting state of the ADAS function can be obtained, and after the starting condition of the ADAS is triggered, the ADAS function is displayed in a picture mode, so that the ADAS function is experienced, the ADAS function is started, and the teaching and experience functions of starting the function are achieved.
The condition that the vehicle meets the condition of entering the teaching mode comprises the following steps: the power mode of the vehicle is switched to ON, the electronic hand brake button is operated to lock the electronic calipers, the vehicle is kept static for a set time and the teaching mode switch is turned ON; and when the vehicle power supply mode is switched to OFF, the vehicle exits the teaching mode. The conditions can ensure the static and safe state of the vehicle in the teaching mode, and the starting in the teaching mode is avoided, so that the safety of the vehicle is ensured.
In the teaching mode, the release of a vehicle brake caliper is forbidden, the starting of an engine is forbidden, the enabling of a gear position of a gearbox is forbidden, and the steering is forbidden. The safety and the reliability under the teaching mode are ensured by controlling modes such as forbidding enabling work of brake calipers, engine gears and the like of the vehicle.
In the teaching mode, the MR glasses can identify a front windshield area and a rear view mirror area of the vehicle and can display dynamic images based on the identified areas so as to enable a wearer to see virtual roads and vehicles in the areas; the MR glasses receive signals from the vehicle control equipment in real time; and carrying out logic operation according to the received signals and the currently displayed virtual road and vehicle, and updating the dynamic image according to the operation result to carry out ADAS teaching.
The MR glasses are internally provided with a programmable operation module which receives signals from the Bluetooth OBD transceiver and carries out logic operation by resolving a prestored mathematical model in real time; after judging that the vehicle needs to turn, brake, accelerate or reasonably combine all the actions according to the operation result, controlling the speed and the turning angle and the active action information of the ADAS function based on the actions, and displaying corresponding different dynamic influences by the MR glasses to enable a wearer to generate a visual effect that the vehicle does the corresponding actions.
The ADAS teaching method of the present application relates to a vehicle having the following features:
the vehicle is provided with a teaching mode, when the vehicle is in the teaching mode, the connection between a steering wheel and wheels is disconnected, the connection between an accelerator pedal and an engine is disconnected, the connection between a gear shifting operation mechanism and a gearbox is disconnected, and the connection between an electronic hand brake button and a brake caliper is disconnected.
The steps required to enter the teaching mode are as follows: the power mode of the vehicle is switched ON; operating an electronic hand brake button to lock the electronic calipers; the vehicle remains stationary for 5 minutes; and entering through a central control screen setting item. Exiting the teaching mode requires turning a key or pressing a one-touch start button to switch the vehicle power mode to OFF. The vehicle does not remember whether the vehicle was in the teaching mode before the last power-off, and the vehicle is not directly in the teaching mode when the vehicle is powered on next time.
When the vehicle is in the teaching mode, the vehicle can not cause the release of the parking calipers due to any driver input, and can not start an engine, change the gear of a gearbox and execute steering due to any driver input.
The vehicle is also provided with a pair of MR glasses, the MR glasses are provided with a Bluetooth OBD transceiver, and the MR glasses can be taken down from the glasses body to be connected with a copilot OBD port of the vehicle. The MR glasses receive signals from a steering wheel, an accelerator pedal, a brake pedal, a gear shifting operating mechanism, an ADAS function button, an electronic hand brake button, a vehicle door and a safety belt through the Bluetooth OBD transceiver. Besides, the MR glasses can also control an instrument panel to light and extinguish the icon indicating lamp through the Bluetooth OBD transceiver, so that the virtual vehicle speed is displayed, and the text prompt is displayed.
In the teaching mode, the MR glasses can identify a front windshield area and a rear view mirror area of the vehicle, and can display a dynamic image based on the identified areas to achieve the effect that a wearer sees virtual roads and vehicles in the areas.
The embodiment of the invention discloses an ADAS teaching method, which comprises the following steps:
the MR glasses receive signals from the vehicle control equipment in real time; and carrying out logic operation according to the received signals and the currently displayed virtual road and vehicle, and updating the dynamic image according to the operation result to carry out ADAS teaching.
The signals of the control equipment comprise steering wheel angle signals, accelerator pedal signals, brake pedal stroke signals, current gear signals of a gear shifting operating mechanism, ADAS function button signals, vehicle door switch signals and safety belt signals.
The virtual road comprises a lane line-free road, a single-side lane line road, a multi-lane line road, a crossroad, a T-shaped intersection, a curve and a fork road. Furthermore, traffic signal lamps, road traffic signboards, green belts and road guardrails are attached to the virtual roads.
The virtual vehicles comprise equidirectional vehicles and opposite vehicles, including civil vehicles, school buses, ambulances, fire trucks and trucks. Further, the virtual vehicle further comprises a three-wheeled motor vehicle, a three-wheeled non-motor vehicle, a two-wheeled non-motor vehicle and a pedestrian.
The MR glasses are internally provided with a programmable operation module which receives signals from the Bluetooth OBD transceiver and carries out logic operation by resolving a prestored mathematical model in real time.
The logical operation refers to: and judging whether the vehicle needs to be steered, started and accelerated or not according to the torque applied to the steering wheel by the external force, the steering wheel angle information, the current ADAS setting state and the current virtual road and the specific situation of the virtual vehicle. The logical operation further comprises: and judging which corresponding information needs to be displayed by an instrument panel of the vehicle according to the state of the vehicle, the virtual road and the specific situation of the virtual vehicle.
The dynamic image is updated according to the operation result: after the calculation result judges that the vehicle needs to turn, brake, accelerate or reasonably combine all the above three actions, the speed and the turning angle of the vehicle in the mathematical model are changed accordingly. The MR glasses show different dynamic effects to give the wearer a visual effect that the vehicle is doing the corresponding action.
As shown in fig. 1, the following steps are specifically required for entering the teaching mode:
the invention discloses a precondition for a vehicle to enter a teaching mode, and aims to urge a user to stop the vehicle at a place with little interference and then to learn the ADAS function. Since the attention for sensing the change of the surrounding environment is not much at the time of the user's ADAS function learning, it is necessary to stop the vehicle at a place where the environment and other vehicles do not interfere with each other, and at the same time, the environment and other vehicles do not interfere with each other.
The switching of the power supply mode to be ON is completed by a user, and the switching can be completed in a mode of turning a key or pressing a button to start and press. Locking the parking caliper is completed by a user operating an electronic parking button.
the purpose of this condition is still for safety reasons, complementary to and reinforcing step 101.
The vehicle is static and comprises two parts, namely, wheels are static and do not rotate, and a supporting surface for supporting the whole vehicle is not inclined and is respectively detected by a wheel speed sensor and a yaw-G sensor. These two sensors are then monitored by the ESP, which changes the "enter teaching mode" button of the center screen settings menu mentioned below to an available state when the ESP recognizes that the vehicle has been stationary for 5 minutes, and otherwise to a grey unavailable state.
103, setting a screen control mode to enter a teaching mode;
in the ADAS teaching method disclosed by the invention, the connection between the vehicle control equipment and the vehicle can be disconnected after the ADAS teaching method enters the teaching mode, and in such a state, the engine, the gearbox, the braking system and the steering system can not respond to the operation of a driver, so that the teaching mode needs to be avoided to the utmost extent due to misoperation in the environment where the vehicle needs to be frequently moved.
The teaching mode is started through a 5-level menu. Preferably, the tutorial mode is entered via the following menu path: "set", "help", "description", "ADAS function", "enter teaching mode". Furthermore, the central control screen displays a prompt field ' please rotate the steering wheel to the left ', after the steering wheel is slightly rotated to the left by external force, the instrument prompt field ' please rotate the steering wheel to the right to enable the wheels to be aligned, after the steering wheel is rotated to the middle position by the external force, the central control screen displays two buttons ' confirm to enter the teaching mode ' and ' cancel to enter the teaching mode ', and the button ' confirm to enter the teaching mode ' is clicked to enter the teaching mode.
104, disconnecting the signal connection of a steering wheel, an accelerator pedal, a brake pedal, a gear shift lever, an ADAS button, a vehicle door switch and a safety belt with the vehicle;
in the disclosed vehicle, the connection between the steering wheel and the wheels is completely decoupled, the connection between the accelerator pedal and the engine controller is completely decoupled, the connection between the brake pedal and the brake device is completely decoupled, the connection between the shift lever and the gearbox is completely decoupled, the connection between the ADAS button and the vehicle is completely decoupled, and the connection between the door, the safety belt and the body control system is completely decoupled. After entering the teaching mode, the wheels, the engine controller, the brake device, the gearbox and the ECU of the vehicle body control system shield signals from a steering wheel, an accelerator pedal, a brake pedal, a gear shift lever, an ADAS button, a vehicle door switch and a safety belt in a software shielding mode.
105, establishing signal connection between a steering wheel, an accelerator pedal, a brake pedal, a gear shift lever, an ADAS button, a vehicle door switch and a safety belt and MR glasses; the MR glasses are connected with a vehicle gateway through a Bluetooth OBD transceiver arranged on the MR glasses, and accordingly signal connection is established between the MR glasses and a steering wheel, an accelerator pedal, a brake pedal, a gear shifting lever, an ADAS button, a vehicle door switch and a safety belt.
in a specific implementation, the MR glasses continuously present different virtual roads in a certain sequence or in a random manner, virtual vehicles on the virtual roads randomly appear, and road surface attachments such as traffic lights and traffic signs randomly appear. The displayed objects are developed with the help of a unity engine.
A substep 202, in which the driver operates the steering wheel, the accelerator pedal, the brake pedal, the shift lever, the ADAS button, the door switch and the seat belt of the vehicle according to the virtual road and the virtual vehicle seen;
in a specific implementation, this step is performed entirely by the driver, without any intervention by the host vehicle.
in a specific implementation, the steering wheel, accelerator pedal, brake pedal, gear shift lever, ADAS button, door switch, and seat belt communicate with the MR glasses through a gateway and OBD interface. Likewise, this communication can be established and closed by the software of the MR glasses ECU.
In the substep 204, the MR glasses decide the behavior of the vehicle according to the currently displayed virtual road and virtual vehicle by combining the input signals; the input signal is a signal transmitted by a bluetooth OBD such as a steering wheel, an accelerator and the like of a vehicle which is considered to be operated, and in the specific implementation, the decision-making strategy is completely consistent with the real ADAS strategy of the vehicle. If the ADAS function is lane departure early warning, whether lane departure states exist on the virtual road and the virtual vehicle is identified, and if the lane departure states exist, early warning reminding is carried out according to the lane departure early warning function.
In the substep 205, the MR glasses update the displayed dynamic image according to the determined behavior of the vehicle;
the action of updating the image is completed by means of the unity engine. Ways to update the image include, but are not limited to: the viewpoint turning to the left, the viewpoint turning to the right, the viewpoint moving at an accelerated speed, and the viewpoint moving at a decelerated speed.
After the substep 205 is finished, the process returns to the substep 201, and the process is repeatedly executed until the vehicle power mode is switched to OFF, and the whole vehicle is powered OFF.
106, switching the power mode to OFF to exit the teaching mode;
in the ADAS teaching method in the scheme, the teaching mode is exited only in a way of powering off the whole vehicle. This is also for safety reasons.
It is clear that the specific implementation of the invention is not restricted to the above-described embodiments, but that various insubstantial modifications of the inventive process concept and technical solutions are within the scope of protection of the invention.
Claims (10)
1. An ADAS teaching system, comprising: the system comprises: vehicle and MR glasses;
the MR glasses are used for displaying dynamic images according to the ADAS function state of the vehicle and vehicle control data, and the dynamic images are display images simulating the starting, triggering work and/or function closing of the ADAS function; the vehicle control data is provided to the MR glasses by a vehicle having a teach mode.
2. An ADAS teaching system as claimed in claim 1 wherein: the control method of the automobile comprises the following steps that connection between a steering wheel and wheels is kept disconnected, connection between an accelerator pedal and an engine is kept disconnected, connection between a gear shifting operating mechanism and a gearbox is kept disconnected, connection between an electronic hand brake button and brake calipers is kept disconnected under a teaching mode of the automobile, and automobile control data are steering wheel signals, accelerator pedal signals, gear shifting operating mechanism signals and/or electronic hand brake signals under the teaching mode.
3. An ADAS teaching system as claimed in claim 1 or 2 wherein: the vehicle is also provided with an ADAS function switch which controls the on and off of the ADAS function in a hard switch or a central control software switch mode.
4. An ADAS teaching system as claimed in claim 1 or 2 wherein: MR glasses are furnished with a bluetooth OBD transceiver, bluetooth OBD transceiver is used for inserting vehicle OBD mouth, MR glasses pass through bluetooth OBD transceiver receives the signal that comes from steering wheel, accelerator pedal, brake pedal, operating device, ADAS function button, electron manual brake button, door and safety belt.
5. An ADAS teaching system as claimed in claim 4 wherein: a programmable operation module is arranged in the MR glasses and used for generating a virtual driving image and updating a dynamic virtual image according to data transmitted by the Bluetooth OBD transceiver; and generating a vehicle driving state meeting the ADAS function triggering condition, and displaying the function in an MR (magnetic resonance) glasses in an image mode after triggering the ADAS function.
6. An ADAS teaching method is characterized in that: the method comprises the following steps: the method comprises the steps that the vehicle enters an ADAS teaching mode after meeting the condition of entering the teaching mode, and in the teaching mode, MR glasses receive signals from a steering wheel, an accelerator pedal, a brake pedal, a gear shifting operation mechanism, an ADAS function button, an electronic hand brake button, a vehicle door and a safety belt through a Bluetooth BOD transceiver; the MR glasses are internally provided with a logic processing module to identify a front windshield area and a rearview mirror area of the vehicle, can display dynamic images based on the identified areas to achieve the effect that a wearer can see virtual roads and vehicles in the areas, provides vehicle state conditions of an origin ADAS function to trigger the ADAS function, and updates work reminding and auxiliary control information of the ADAS function in the dynamic images displayed in the identified areas.
7. An ADAS teaching method as claimed in claim 6, wherein: the condition that the vehicle meets the condition of entering the teaching mode comprises the following steps:
the power mode of the vehicle is switched to ON, the electronic hand brake button is operated to lock the electronic calipers, the vehicle is kept static for a set time and the teaching mode switch is turned ON; and when the vehicle power supply mode is switched to OFF, the vehicle exits the teaching mode.
8. An ADAS teaching method as claimed in claim 6 or 7, wherein: in the teaching mode, the release of a brake caliper of a vehicle is forbidden, the starting of an engine is forbidden, the enabling of a gear position of a gearbox is forbidden, and the steering is forbidden.
9. An ADAS teaching method as claimed in claim 6 or 7, wherein:
in the teaching mode, the MR glasses can identify a front windshield area and a rear view mirror area of the vehicle and can display dynamic images based on the identified areas so as to enable a wearer to see virtual roads and vehicles in the areas; the MR glasses receive signals from the vehicle control equipment in real time; and carrying out logic operation according to the received signals and the currently displayed virtual road and vehicle, and updating the dynamic image according to the operation result to carry out ADAS teaching.
10. An ADAS teaching method as claimed in claim 6 or 7, wherein:
the MR glasses are internally provided with a programmable operation module which receives signals from the Bluetooth OBD transceiver and carries out logic operation by resolving a prestored mathematical model in real time; after judging that the vehicle needs to turn, brake, accelerate or reasonably combine all the actions according to the operation result, controlling the speed and the turning angle and the active action information of the ADAS function based on the actions, and displaying corresponding different dynamic images by the MR glasses to enable a wearer to generate the visual effect that the vehicle does the corresponding actions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210338015.3A CN114627718A (en) | 2022-03-31 | 2022-03-31 | ADAS teaching system and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210338015.3A CN114627718A (en) | 2022-03-31 | 2022-03-31 | ADAS teaching system and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114627718A true CN114627718A (en) | 2022-06-14 |
Family
ID=81905548
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210338015.3A Pending CN114627718A (en) | 2022-03-31 | 2022-03-31 | ADAS teaching system and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114627718A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117392649A (en) * | 2023-12-11 | 2024-01-12 | 武汉未来幻影科技有限公司 | Identification method and device for indicating operation of vehicle part and processing equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201614862D0 (en) * | 2015-09-02 | 2016-10-19 | Ford Global Tech Llc | In-vehicle Tutorial |
| WO2018215833A1 (en) * | 2017-05-23 | 2018-11-29 | 1.21 Gigawatts Ltd. | Traffic monitoring and management systems and methods |
| WO2018224407A1 (en) * | 2017-06-08 | 2018-12-13 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Motor vehicle having a driving mode and a simulation mode |
| US20200010095A1 (en) * | 2019-08-30 | 2020-01-09 | Lg Electronics Inc. | Method and apparatus for monitoring driving condition of vehicle |
| WO2020241944A1 (en) * | 2019-05-31 | 2020-12-03 | 엘지전자 주식회사 | Vehicle control method and intelligent computing device for controlling vehicle |
| DE102019208235A1 (en) * | 2019-06-05 | 2020-12-10 | Volkswagen Aktiengesellschaft | Method for operating an HMD display unit for a vehicle, HMD display unit, multifunction steering wheel and vehicle for use in the method |
| KR102203234B1 (en) * | 2019-07-26 | 2021-01-14 | (주)디얼뷰 | System for Driving Exercise Based on Mixed Reality by Train Operator of Metro Railroad and Driving Method Thereof |
| CN113903208A (en) * | 2021-11-19 | 2022-01-07 | 山西宁志科技有限公司 | Real standard platform of advanced driving assistance system of ADAS |
| US20220036758A1 (en) * | 2020-07-31 | 2022-02-03 | Inventis Co.,Ltd | System and method for providing vehicle function guidance and virtual test-driving experience based on augmented reality content |
-
2022
- 2022-03-31 CN CN202210338015.3A patent/CN114627718A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| GB201614862D0 (en) * | 2015-09-02 | 2016-10-19 | Ford Global Tech Llc | In-vehicle Tutorial |
| CN106483879A (en) * | 2015-09-02 | 2017-03-08 | 福特全球技术公司 | Vehicle-mounted study course |
| WO2018215833A1 (en) * | 2017-05-23 | 2018-11-29 | 1.21 Gigawatts Ltd. | Traffic monitoring and management systems and methods |
| WO2018224407A1 (en) * | 2017-06-08 | 2018-12-13 | Deutsches Zentrum für Luft- und Raumfahrt e.V. | Motor vehicle having a driving mode and a simulation mode |
| WO2020241944A1 (en) * | 2019-05-31 | 2020-12-03 | 엘지전자 주식회사 | Vehicle control method and intelligent computing device for controlling vehicle |
| DE102019208235A1 (en) * | 2019-06-05 | 2020-12-10 | Volkswagen Aktiengesellschaft | Method for operating an HMD display unit for a vehicle, HMD display unit, multifunction steering wheel and vehicle for use in the method |
| KR102203234B1 (en) * | 2019-07-26 | 2021-01-14 | (주)디얼뷰 | System for Driving Exercise Based on Mixed Reality by Train Operator of Metro Railroad and Driving Method Thereof |
| US20200010095A1 (en) * | 2019-08-30 | 2020-01-09 | Lg Electronics Inc. | Method and apparatus for monitoring driving condition of vehicle |
| US20220036758A1 (en) * | 2020-07-31 | 2022-02-03 | Inventis Co.,Ltd | System and method for providing vehicle function guidance and virtual test-driving experience based on augmented reality content |
| CN113903208A (en) * | 2021-11-19 | 2022-01-07 | 山西宁志科技有限公司 | Real standard platform of advanced driving assistance system of ADAS |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117392649A (en) * | 2023-12-11 | 2024-01-12 | 武汉未来幻影科技有限公司 | Identification method and device for indicating operation of vehicle part and processing equipment |
| CN117392649B (en) * | 2023-12-11 | 2024-02-27 | 武汉未来幻影科技有限公司 | Identification method and device for indicating operation of vehicle part and processing equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3318946B1 (en) | Vehicle control method thereof | |
| CN102783145B (en) | Image control apparatus | |
| US20200269747A1 (en) | Display Control Method and Display Control Device | |
| JP6313355B2 (en) | Vehicle perimeter monitoring device | |
| EP2130736A1 (en) | Surrounding recognition support system | |
| US20180012489A1 (en) | Vehicular display control apparatus and vehicular display control method | |
| JP6939264B2 (en) | In-vehicle display device | |
| JP7212824B2 (en) | How to return to road vehicle and manual driving | |
| JP2010128794A (en) | Surrounding recognition assisting device for vehicle | |
| US20170190254A1 (en) | Vehicular image display device and vehicular image display method | |
| CN109204305A (en) | Equipment and motor vehicle used in abundant visual field method, observer's vehicle and object | |
| CN114627718A (en) | ADAS teaching system and method | |
| JP6623910B2 (en) | Display device for vehicles | |
| JP2021172096A (en) | Vehicle control system | |
| EP3031654B1 (en) | Display apparatus for a motor vehicle comprising a screen device, driver assistance system, motor vehicle and method | |
| JP2021172097A (en) | Vehicle control system | |
| WO2022254634A1 (en) | Vehicle display appratus and vehicle display method | |
| WO2005080140A1 (en) | On-vehicle display control device | |
| WO2018163534A1 (en) | Display device and display method | |
| KR200312981Y1 (en) | Device for displaying of signals of car | |
| JP4373282B2 (en) | Vehicle display device | |
| TWI816233B (en) | Car door control system and method | |
| DE102021106514A1 (en) | motor vehicle | |
| JP6894744B2 (en) | Image display device | |
| CN115782907A (en) | Intelligent driving function experience system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |