WO2023151522A1 - Artificial intelligence internet of things platform-based remote control method for automatic driving - Google Patents

Artificial intelligence internet of things platform-based remote control method for automatic driving Download PDF

Info

Publication number
WO2023151522A1
WO2023151522A1 PCT/CN2023/074475 CN2023074475W WO2023151522A1 WO 2023151522 A1 WO2023151522 A1 WO 2023151522A1 CN 2023074475 W CN2023074475 W CN 2023074475W WO 2023151522 A1 WO2023151522 A1 WO 2023151522A1
Authority
WO
WIPO (PCT)
Prior art keywords
artificial intelligence
vehicle
real
remote control
things platform
Prior art date
Application number
PCT/CN2023/074475
Other languages
French (fr)
Chinese (zh)
Inventor
刘天琼
Original Assignee
深圳市爱云信息科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市爱云信息科技有限公司 filed Critical 深圳市爱云信息科技有限公司
Publication of WO2023151522A1 publication Critical patent/WO2023151522A1/en

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0231Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means
    • G05D1/0246Control of position or course in two dimensions specially adapted to land vehicles using optical position detecting means using a video camera in combination with image processing means
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05DSYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
    • G05D1/00Control of position, course, altitude or attitude of land, water, air or space vehicles, e.g. using automatic pilots
    • G05D1/02Control of position or course in two dimensions
    • G05D1/021Control of position or course in two dimensions specially adapted to land vehicles
    • G05D1/0257Control of position or course in two dimensions specially adapted to land vehicles using a radar

Definitions

  • the invention relates to the technical field of unmanned driving, in particular to a remote control method for automatic driving based on an artificial intelligence Internet of Things platform.
  • the main purpose of the present invention is to provide a remote control method for automatic driving based on an artificial intelligence Internet of Things platform, aiming to realize remote control for unmanned vehicles, so that it is convenient for car owners to remotely perform emergency vehicle movement and predict the current road conditions in advance, and find them in real time. Find a suitable driving road and find a suitable parking space.
  • the present invention provides a remote control method for automatic driving based on an artificial intelligence Internet of Things platform, and the remote control method for automatic driving based on an artificial intelligence Internet of Things platform includes:
  • Obtain the real-time information of the vehicle detected by the smart rod management system preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud platform The information is modeled to obtain the corresponding digital model;
  • the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
  • the smart bar management system before the step of obtaining the real-time vehicle information detected by the smart bar management system, it also includes:
  • the smart bar management system before the step of obtaining the real-time vehicle information detected by the smart bar management system, it also includes:
  • the collection module includes: a laser radar module and/or an image collection module.
  • the step of controlling the unmanned vehicle through the real-time control instruction includes:
  • the step of performing remote mobile control on the unmanned vehicle according to the analyzed real-time control instruction it also includes:
  • the step of obtaining real-time control instructions through the wearable virtual/reality interactive device includes:
  • Real-time control instructions are obtained by visually stimulating the vehicle owner through the evoked pattern in the wearable virtual/reality interactive device.
  • the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
  • the present invention also provides a remote control method for automatic driving based on an artificial intelligence Internet of Things platform, including:
  • the modeling module is used to obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud
  • the platform models the target vehicle information to obtain a corresponding digital model
  • An acquisition module configured to send the digital model to the wearable virtual/reality interactive device for display, and obtain real-time control instructions through the wearable virtual/reality interactive device;
  • a control module configured to control the unmanned vehicle through the real-time control instructions according to the digital model, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space for the unmanned vehicle Look for.
  • each functional module of the remote control device for automatic driving based on the artificial intelligence Internet of Things platform of the present invention implements the steps of the above-mentioned remote control method for automatic driving based on the artificial intelligence Internet of Things platform when running.
  • the present invention also provides a terminal device, which includes: a memory, a processor, and an artificial intelligence-based Internet of Things platform stored on the memory and operable on the processor for automatic A remote control program for driving, when the remote control program based on the artificial intelligence Internet of Things platform for automatic driving is executed by the processor, the steps of the above-mentioned remote control method for automatic driving based on the artificial intelligence Internet of Things platform are realized .
  • the present invention also proposes a remote control method based on the artificial intelligence Internet of Things platform for automatic driving vehicles, storing a remote control program based on the artificial intelligence Internet of Things platform for automatic driving.
  • the remote control program of the platform for automatic driving is executed by the processor, the steps of the above-mentioned remote control method for automatic driving based on the artificial intelligence Internet of Things platform are realized.
  • the present invention also provides a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, the above-mentioned remote control system for automatic driving based on the artificial intelligence Internet of Things platform is realized. The steps of the control method.
  • the present invention provides a remote control method for automatic driving based on an artificial intelligence Internet of Things platform and a computer program product.
  • the remote control method for automatic driving based on an artificial intelligence Internet of Things platform includes the following steps: obtaining the vehicle detected by the smart bar management system Real-time information, preprocessing the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and modeling the target vehicle information through the artificial intelligence digital twin cloud platform to obtain a corresponding digital model; Send the digital model to the wearable virtual/reality interactive device for display, and obtain real-time control instructions through the wearable virtual/reality interactive device; according to the digital model, use the real-time control instructions to The unmanned vehicle is controlled to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
  • the real-time information of the vehicle is sent to the artificial intelligence Internet of Things platform through the smart bar management system for preprocessing to obtain the target vehicle information;
  • the target vehicle information is sent to the artificial intelligence digital twin cloud platform through the artificial intelligence Internet of Things platform, and the target vehicle information is modeled to obtain the corresponding digital model through the artificial intelligence digital twin cloud platform;
  • the model is sent to the wearable virtual/reality interactive device for display, and the real-time control instruction triggered by the user is obtained based on the wearable virtual/reality interactive device, so that the vehicle can be remotely mobile controlled through the real-time control instruction, so that the owner does not have to The driving position moves the vehicle.
  • the present invention realizes intelligent transportation for remote control of unmanned vehicles, and improves the efficiency of urban traffic operation , It also improves the owner's experience.
  • Fig. 1 is a schematic structural diagram of the hardware operating environment involved in the solution of the embodiment of the present invention
  • FIG. 2 is a schematic flow diagram of an embodiment of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention
  • FIG. 3 is a schematic diagram of functional modules of an embodiment of a remote control device for automatic driving based on an artificial intelligence Internet of Things platform in the present invention.
  • FIG. 1 is a schematic diagram of the equipment structure of the hardware operating environment involved in the solution of the embodiment of the present invention.
  • the terminal device in this embodiment of the present invention may be a terminal device for realizing data extraction from multiple types of data sources, and the terminal device may specifically be a smart phone, a personal computer, a server, and the like.
  • the device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 .
  • the communication bus 1002 is used to realize connection and communication between these components.
  • the user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keybod), and the optional user interface 1003 may also include a standard wired interface and a wireless interface.
  • the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface).
  • the memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory.
  • the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .
  • FIG. 1 does not constitute a limitation to the device, and may include more or less components than shown in the figure, or combine some components, or arrange different components.
  • the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a remote control program for automatic driving based on an artificial intelligence Internet of Things platform.
  • the operating system is a program that manages and controls the hardware and software resources of the device, and supports the operation of remote control programs for autonomous driving and other software or programs based on the artificial intelligence Internet of Things platform.
  • the user interface 1003 is mainly used for data communication with the client;
  • the network interface 1004 is mainly used for establishing a communication connection with the server;
  • the IoT platform is used for the control program of the remote control of the autonomous driving, and performs the following operations:
  • Obtain the real-time information of the vehicle detected by the smart rod management system preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud platform The information is modeled to obtain the corresponding digital model;
  • the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
  • the processor 1001 can also be used to call the information stored in the memory 1005 based on the artificial intelligence Internet of Things platform for automatic driving.
  • remote control program also do the following:
  • the processor 1001 can also be used to call the remote control program for automatic driving based on the artificial intelligence Internet of Things platform stored in the memory 1005, Also do the following:
  • Real-time acquisition of vehicle parameters and the environment where the vehicle is located by the acquisition module in the unmanned vehicle generates the real-time information of the vehicle, and sends the real-time information of the vehicle through the vehicle-mounted wireless network module in the unmanned vehicle
  • the acquisition module includes: a laser radar module and/or an image acquisition module.
  • processor 1001 can also be used to call the remote control program based on the artificial intelligence Internet of Things platform for automatic driving stored in the memory 1005, and also perform the following operations:
  • the processor 1001 can also be used to call the information stored in the memory 1005 based on the artificial intelligence Internet of Things platform for automatic driving.
  • remote control program also do the following:
  • processor 1001 can also be used to call the remote control program based on the artificial intelligence Internet of Things platform for automatic driving stored in the memory 1005, and also perform the following operations:
  • Real-time control instructions are obtained by visually stimulating the vehicle owner through the evoked pattern in the wearable virtual/reality interactive device.
  • the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
  • FIG. 2 is a schematic flowchart of a first embodiment of a remote control method for automatic driving based on an artificial intelligence Internet of Things platform in the present invention.
  • an embodiment of a remote control method for automatic driving based on an artificial intelligence Internet of Things platform is provided. It should be noted that although the logic sequence is shown in the flow chart, in some cases, it can The steps shown or described are performed in an order different than here.
  • the remote control method based on the artificial intelligence Internet of Things platform for automatic driving is applied to the remote control system for automatic driving based on the artificial intelligence Internet of Things platform, and the remote control method for automatic driving based on the artificial intelligence Internet of Things platform
  • the system includes: artificial intelligence Internet of things platform, wearable virtual/reality interactive equipment and smart pole management system.
  • the artificial intelligence Internet of things platform is developed on the traditional IOT platform, but it is not limited to AI technology.
  • the artificial intelligence Internet of things platform supports video cloud and big data systems at the same time.
  • the artificial intelligence Internet of things platform is the real value of the Internet of things technology. enabling platform.
  • AI IoT platform applications include: business and business formats, AI IoT platforms include business, technology, data, operating architecture (IAAS, PAAS, SAAS, DAAS) and multi-layer architecture integration platforms such as network communication layer and device layer, Among them, business and format include: smart city, smart transportation, smart park, smart community, and smart agriculture; AI IoT platform platform enablement also includes: application enablement, data enablement, and integration enablement; PAAS includes: IoT platform, AI platform and video cloud platform, etc.; IAAS includes: public cloud, private cloud and hybrid cloud, network communication layer includes: 2G/3G/4G/5G, Ethernet, 5G, Wi-Fi, Bluetooth, LORA and NB-IOT, etc.; DaaS includes big data processing, 3D holographic images, 3D modeling, etc.
  • the device layer includes: control devices, gateway edge devices, cameras and sensors, etc.
  • the smart pole management system is a public infrastructure integrating smart lighting, video surveillance, traffic management, environmental detection, wireless communication, information interaction, emergency help, etc., and is an important carrier for building a new smart city.
  • the smart pole management system can mount 5G communication base stations, WiFi wireless networks, intelligent energy-saving street lights, intelligent security monitoring, intelligent face recognition, traffic guidance and instructions, audio and radio and television, drone charging, car charging piles, and parking senseless Payment, unmanned driving guidance and other equipment.
  • the real-time vehicle information of unmanned vehicles can be received through the smart pole management system, and the real-time vehicle information can be preprocessed through the artificial intelligence Internet of Things platform, and the preprocessed real-time vehicle information can be sent to the artificial intelligence digital
  • the twin cloud platform performs modeling to obtain the corresponding digital model, and sends the digital model to the wearable virtual/reality interactive device for display, so that the owner can obtain real-time vehicle information at any time and remotely control the unmanned vehicle.
  • Step S10 obtain the real-time information of the vehicle detected by the smart bar management system, and use the artificial intelligence Internet of Things
  • the platform preprocesses the real-time information of the vehicle to obtain target vehicle information, and models the target vehicle information through the artificial intelligence digital twin cloud platform to obtain a corresponding digital model;
  • the platform obtains the digital model of the real-time information of the vehicle, and displays the digital model through a wearable virtual/reality interactive device.
  • the real-time vehicle information of the unmanned vehicle is obtained through the smart pole management system, which may include: vehicle parameter information and vehicle environment information, etc.; the real-time vehicle information is sent to the The artificial intelligence Internet of Things platform preprocesses the real-time information of the vehicle through the edge computing gateway in the artificial intelligence Internet of Things platform to obtain the target vehicle information; sends the target vehicle information to the artificial intelligence digital twin cloud platform, and through the artificial intelligence digital twin cloud
  • the platform performs digital modeling on the target vehicle information to obtain a digital model of the target vehicle information; sends the digital model corresponding to the target vehicle information to the wearable virtual/reality interactive device for display through the artificial intelligence digital twin cloud platform, so that
  • the owner can browse the vehicle parameter information and the environment information of the vehicle through the wearable virtual/reality interactive device, and then perform remote emergency maneuvering of the vehicle, predict the current road conditions and warnings in advance, and find the appropriate driving route in real time Maps and suitable parking spaces, etc.
  • the digital model is the digitalization of target vehicle information on the artificial
  • Step S20 sending the digital model to the wearable virtual/reality interaction device for display, and obtaining real-time control instructions through the wearable virtual/reality interaction device;
  • the real-time information about the vehicle can be obtained through the smart bar management system, the artificial intelligence Internet of Things platform and the artificial intelligence digital twin cloud platform.
  • the digital models are interacted and displayed in real-time on wearable virtual/reality interactive devices.
  • the wearable virtual/reality interactive device includes a visual interactive interface through which the digital model can be displayed, and based on the visual interactive interface, the car owner can be visually stimulated to obtain the real-time control command triggered by the car owner.
  • the visual interface displays the real-time parameters of the vehicle, such as the fuel volume/electricity of the vehicle, etc.
  • the edge computing gateway in the artificial intelligence Internet of Things platform preprocesses the real-time information of the vehicle to obtain the target vehicle information, and uses the artificial intelligence digital twin cloud platform to model the target vehicle information to obtain the real-time information of the vehicle.
  • the digital model will be sent to the wearable virtual/reality interactive device worn by the owner through the artificial intelligence digital twin Yunping, so that the owner can browse the real-time information of the vehicle on the wearable virtual/reality interactive device.
  • the digital model corresponding to the information receives the real-time control instruction triggered by the owner through the wearable virtual/reality interactive device, so as to control the unmanned vehicle according to the real-time control instruction.
  • Step S30 according to the digital model, the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space finding for the unmanned vehicle.
  • the unmanned vehicle After obtaining the real-time control command remotely initiated by the owner through the wearable virtual/reality interactive device, the unmanned vehicle will be remotely controlled according to the real-time control command and the digital model corresponding to the real-time information of the vehicle.
  • the real-time control instruction is sent to the artificial intelligence Internet of Things platform; Analysis; send the analyzed real-time control instructions to the smart rod management system, so that the analyzed real-time control instructions can be sent to the unmanned vehicle through the smart rod management system; and the computing center of the unmanned vehicle will analyze the real-time control instructions
  • the command is converted into the corresponding CAN signal, so as to control the brake motor driver of the unmanned vehicle through the CAN signal, and then realize the remote emergency vehicle movement, road condition prediction, driving route planning and parking space search for the vehicle.
  • step S10 "obtaining real-time vehicle information detected by the smart bar management system"
  • step S10 "obtaining real-time vehicle information detected by the smart bar management system”
  • Step S40 establishing a connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of Things platform, and establishing the connection between the unmanned vehicle and the smart device based on the wearable virtual/reality interactive device. Connection between rod management systems.
  • the owner Before the owner needs to remotely control the unmanned vehicle, he needs to send a connection command through the wearable virtual/reality interactive device, and send the connection command to the artificial intelligence Internet of Things platform through the wearable virtual/reality interactive device.
  • the Internet of Things platform After receiving the connection instruction, the Internet of Things platform will establish a connection with the wearable virtual/reality interactive device; at the same time, the connection instruction will be sent to the smart rod management system through the artificial intelligence Internet of Things platform, and through the smart rod management system
  • the 5G base station module in the system sends the connection instruction to the unmanned vehicle, and the unmanned vehicle will establish a connection with the nearest smart pole management system after receiving the connection instruction based on the signal receiving module to realize unmanned Driving the connection between the vehicle and the smart bar management system.
  • step S10 "obtaining real-time vehicle information sent through the smart bar management system"
  • step S10 "obtaining real-time vehicle information sent through the smart bar management system”
  • Step S50 through the collection module in the unmanned vehicle, the vehicle parameters and the environment where the vehicle is located are collected in real time to generate the real-time information of the vehicle, and the vehicle wireless network module in the unmanned vehicle is connected to the The real-time information is sent to the smart pole management system, wherein the collection module includes: a laser radar module and/or an image collection module.
  • the acquisition module that can be carried by the unmanned vehicle may include a laser radar module, an image acquisition module, and the like.
  • the lidar module can be used to scan the surrounding environment of the vehicle to form a 3D panorama Image map
  • the image acquisition module can be used to capture the surrounding environment of the vehicle, and recognize objects contained in the image through deep learning, such as pedestrians, driving, traffic signs, etc.
  • the vehicle when the vehicle is remotely moved, it is necessary to obtain real-time vehicle information such as obstacles around the vehicle, road conditions around the vehicle, and dividing lines of parking areas through the radar module and/or image acquisition module in advance, and send the vehicle
  • the real-time information is sent to the smart pole management system through the on-board wireless network module in the unmanned vehicle, and the smart pole management system can receive the real-time information of the vehicle through the 5G base station module, and send the real-time information of the vehicle after receiving the real-time information of the vehicle.
  • connection instruction when the car owner needs to remotely move the vehicle, he can send a connection instruction through the wearable virtual/reality interactive device. After receiving the connection instruction through the artificial intelligence Internet of Things platform, Send the connection command to the smart bar management system, and send the connection command to the signal receiving module of the unmanned vehicle through the 5G base station module in the smart bar management system. The nearest smart pole management system is connected.
  • the smart Pole management system When remotely controlling the vehicle, it is necessary to obtain real-time vehicle information such as obstacles around the vehicle and road conditions around the vehicle through the radar module and/or image acquisition module mounted on the unmanned vehicle, and send the real-time information of the vehicle to the smart Pole management system; through the smart pole management system, the real-time information of the vehicle is sent to the artificial intelligence Internet of Things platform for preprocessing to obtain the target vehicle information; the target vehicle information is sent to the artificial intelligence digital twin cloud platform through the artificial intelligence Internet of Things platform, The intelligent digital twin cloud platform models the target vehicle information to obtain the corresponding digital model; the digital model is wirelessly transmitted to the wearable virtual/reality interactive device worn by the owner through the artificial intelligence digital twin cloud platform, and through the wearable The virtual/reality interactive device receives the real-time control instruction triggered by the vehicle owner, so as to remotely move the unmanned vehicle according to the real-time control instruction.
  • the real-time information of the vehicle is obtained through the acquisition module mounted on the unmanned vehicle, and the real-time information of the vehicle is sent to the
  • the artificial intelligence Internet of Things platform performs preprocessing to obtain the target vehicle information; the target vehicle information is sent to the artificial intelligence digital twin cloud platform through the artificial intelligence Internet of Things platform, and the target vehicle information is modeled through the artificial intelligence digital twin cloud platform to obtain the corresponding A digital model; finally displaying the digital model through a wearable virtual/reality interactive device, and obtaining real-time control instructions triggered by the user based on the wearable virtual/reality interactive device, so as to perform remote mobile control on the vehicle through the real-time control instructions, The owner does not have to move the vehicle in the driving position.
  • the present invention is based on an artificial intelligence Internet of Things platform, an artificial intelligence digital twin cloud platform, a smart rod management system, and a wearable virtual/reality interactive device It realizes intelligent transportation for remote control of unmanned vehicles, improves the efficiency of urban traffic operation, and improves the experience of car owners.
  • a second embodiment of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention is proposed.
  • step S30 the step of "controlling the unmanned vehicle through the real-time control instruction" includes:
  • Step S301 sending the real-time control instruction to the artificial intelligence Internet of Things platform, and analyzing the real-time control instruction through the artificial intelligence Internet of Things platform, and controlling the unmanned vehicle according to the analyzed real-time control instruction Remote mobile control.
  • the real-time control command is sent to the artificial intelligence Internet of Things platform through the wearable virtual/reality interactive
  • the intelligent Internet of Things platform analyzes the real-time control instruction, so that the analyzed real-time control instruction can control the braking system of the vehicle, and then realize the remote control of the vehicle.
  • the real-time control command when the car owner triggers the real-time control command through the wearable virtual/reality interactive device, the real-time control command is actually based on the electrical signal generated by visual induction, so it needs to be controlled by the artificial intelligence Internet of Things.
  • the platform analyzes the real-time control command to obtain a signal capable of controlling the brake motor driver of the vehicle.
  • step S301 after “performing remote mobile control of the unmanned vehicle according to the analyzed real-time control instruction", it also includes:
  • Step S302 acquiring the location information of the moved unmanned vehicle, and judging whether the unmanned vehicle is at a preset target location according to the location information;
  • Step S303 if not, send the location information back to the wearable virtual/reality interaction device, so that the owner can remotely control the unmanned vehicle again based on the location information until reaching the desired location. the preset target position described above.
  • the collection module collects the current information of the vehicle to ensure that the vehicle is at the preset target position.
  • the current position information of the vehicle will be obtained again through the image acquisition module, and then the current position information of the vehicle will be compared with the preset target position to determine whether the vehicle is currently in the target position. Preset target position.
  • the Internet of Things platform sends the vehicle's current location information to the artificial intelligence digital twin cloud platform for modeling to obtain a digital model, and sends the digital model corresponding to the vehicle's current location information to the wearable virtual/reality through the artificial intelligence digital twin cloud platform
  • the interactive device displays, so that the owner can obtain the current state of the vehicle through the wearable virtual/reality interactive device, and then move the vehicle again based on the current state of the vehicle until the vehicle is moved to the preset target position.
  • step S20 "obtaining real-time control instructions through the wearable virtual/reality interactive device” may include:
  • Step S201 performing visual stimulation on the vehicle owner through the induced patterns in the wearable virtual/reality interactive device to obtain real-time control instructions.
  • the wearable virtual/reality interactive device is equipped with a visual interactive interface, in which the digital model corresponding to the vehicle information can be displayed, and it can also be displayed as a 3D holographic image or a three-dimensional
  • the car owner can browse the real-time information of the vehicle in the visual interface, and the car owner can also trigger the real-time control command through the visual interface to realize the remote movement of the vehicle.
  • the vehicle owner can be visually stimulated through the stimulation module in the visual interface.
  • Generate an EEG signal response related to the stimulation frequency collect the EEG signal for feature extraction and analysis to identify the owner's intention, that is, obtain the real-time control command triggered by the car owner, and remotely move the vehicle according to the real-time control command.
  • the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
  • the wearable virtual/reality interaction device can be a wearable MR (mixed reality) device or a wearable AR (augmented reality)/ VR (Virtual Reality) devices, specifically, the wearable MR device or wearable AR/VR device can be integrated into glasses or sunglasses, so that the owner can use the wearable MR device or wearable AR/VR device at any time The device remotely moves the vehicle.
  • MR mixed reality
  • AR augmented reality
  • VR Virtual Reality
  • the terminal device After the terminal device obtains the real-time control instruction triggered by the owner through the wearable virtual/reality interactive device, it sends the real-time control instruction to the artificial intelligence Internet of Things platform through wireless transmission, and the artificial intelligence object
  • the networking platform analyzes the real-time control instruction, so that the analyzed real-time control instruction can control the braking system of the vehicle.
  • the current position information of the vehicle After a remote movement of the vehicle, the current position information of the vehicle will be obtained again through the image acquisition module, and then the current position information of the vehicle will be compared with the preset target position to determine whether the vehicle is currently at the preset target position.
  • the current position information of the vehicle will be processed through the artificial intelligence IoT platform and the artificial intelligence digital twin cloud platform to obtain the corresponding digital model, and the human
  • the artificial intelligence digital twin cloud platform sends the data model to the wearable virtual/reality interactive device for display, so that the owner can obtain the current location information of the vehicle through the wearable virtual/reality interactive device, and then based on the current location information of the vehicle Move the vehicle again until the vehicle is moved to the preset target position.
  • Wearable virtual/reality interactive devices include: wearable MR devices or wearable AR/VR devices, and the wearable MR devices or wearable AR/VR devices can be integrated into glasses or sunglasses, so that car owners The vehicle can be remotely moved at any time through wearable MR devices or wearable AR/VR devices.
  • the real-time location information of the vehicle sent by the artificial intelligence Internet of Things platform will be displayed in real-time on the visual interface of the wearable MR device or the wearable AR/VR device, so that the owner can monitor the vehicle according to the real-time location information of the vehicle. Move once until the vehicle is moved to the preset target position. Therefore, the present invention realizes the remote movement of the vehicle based on the information interaction between the vehicle, the smart pole management system, the artificial intelligence Internet of Things platform, the artificial intelligence digital twin cloud platform, and the wearable virtual/reality interactive device, and improves the urban traffic.
  • the high operating efficiency enables car owners to perform emergency car moving operations or car search operations.
  • the embodiment of the present invention also proposes a remote control device for automatic driving based on an artificial intelligence Internet of Things platform.
  • FIG. 3 Schematic diagram of functional modules.
  • the present invention is based on the artificial intelligence Internet of Things platform for remote control devices for automatic driving, including:
  • the modeling module 10 is used to obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin
  • the cloud platform models the target vehicle information to obtain a corresponding digital model
  • An acquisition module 20 configured to send the digital model to the wearable virtual/reality interaction device for display, and obtain real-time control instructions through the wearable virtual/reality interaction device;
  • the control module 30 is configured to control the unmanned vehicle through the real-time control instructions according to the digital model, so as to realize emergency maneuvering, road condition prediction, driving route planning and Find a parking space.
  • the present invention is based on the artificial intelligence Internet of Things platform for the remote control device for automatic driving, which also includes:
  • connection module for establishing the connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of things platform, and establish the connection between the unmanned vehicle and the artificial intelligence based on the wearable virtual/reality interactive device
  • the connection between the smart bar management systems for establishing the connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of things platform, and establish the connection between the unmanned vehicle and the artificial intelligence based on the wearable virtual/reality interactive device.
  • the present invention is based on the artificial intelligence Internet of Things platform for the remote control device for automatic driving, which also includes:
  • the real-time acquisition module is used to collect the vehicle parameters and the environment of the vehicle in real time through the acquisition module in the unmanned vehicle to generate the real-time information of the vehicle, and send The real-time information of the vehicle is sent to the smart pole management system, wherein the acquisition module includes: a laser radar module and/or an image acquisition module.
  • control module 30 includes
  • the remote control unit is configured to send the real-time control instruction to the artificial intelligence Internet of Things platform, and analyze the real-time control instruction through the artificial intelligence Internet of Things platform, and control the unmanned vehicle according to the analyzed real-time control instruction.
  • the remote control unit is configured to send the real-time control instruction to the artificial intelligence Internet of Things platform, and analyze the real-time control instruction through the artificial intelligence Internet of Things platform, and control the unmanned vehicle according to the analyzed real-time control instruction.
  • the present invention is based on the artificial intelligence Internet of Things platform for the remote control device for automatic driving, which also includes:
  • a judging module configured to acquire position information of the moved unmanned vehicle, and judge whether the unmanned vehicle is at a preset target position according to the position information
  • a sending module configured to send the location information to the wearable virtual/reality interaction device if not, so that the owner can perform remote mobile control on the unmanned vehicle again based on the location information until the The unmanned vehicle arrives at the preset target position.
  • the acquisition module 20 includes a visual stimulation unit, which is used to visually stimulate the vehicle owner through the induced patterns in the wearable virtual/reality interaction device to obtain real-time control instructions.
  • the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
  • each functional module of the remote control device for automatic driving based on the artificial intelligence Internet of Things platform of the present invention is basically the same as the above-mentioned embodiments of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform, and will not be described here. repeat.
  • the embodiment of the present invention also proposes a computer-readable storage medium, the computer-readable storage medium stores a remote control program based on the artificial intelligence Internet of Things platform for automatic driving, and the artificial intelligence-based Internet of Things platform uses When the remote control program of automatic driving is executed by the processor, the above-mentioned steps of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform are realized.
  • Various embodiments of the remote control system for automatic driving based on the artificial intelligence Internet of Things platform and the computer-readable storage medium of the present invention can refer to various embodiments of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention, I won't repeat them here.
  • an embodiment of the present invention also provides a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, the remote control method for automatic driving based on the artificial intelligence Internet of Things platform is implemented.
  • the specific embodiments of the computer program product of the present invention are basically the same as the above-mentioned embodiments of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform, and will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Physics & Mathematics (AREA)
  • Remote Sensing (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Multimedia (AREA)
  • Electromagnetism (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Selective Calling Equipment (AREA)
  • Traffic Control Systems (AREA)
  • Control Of Driving Devices And Active Controlling Of Vehicle (AREA)

Abstract

An artificial intelligence Internet of Things platform-based remote control method for automatic driving. The steps of the remote control method comprise: obtaining vehicle real-time information detected by a smart pole management system, preprocessing the vehicle real-time information by means of the artificial intelligence Internet of Things platform to obtain target vehicle information, and modeling the target vehicle information by means of an artificial intelligence digital twin cloud platform to obtain a corresponding digital model (S10); sending the digital model to a wearable virtual/reality interaction device for display, and obtaining a real-time control instruction by means of the wearable virtual/reality interaction device (S20); and controlling an unmanned vehicle by means of the real-time control instruction according to the digital model, so as to achieve emergency vehicle moving, road condition pre-judgment, driving route planning and parking space searching of the unmanned vehicle (S30).

Description

基于人工智能物联网平台用于自动驾驶的远程控制方法Remote control method for autonomous driving based on artificial intelligence Internet of Things platform 技术领域technical field
本发明涉及无人驾驶技术领域,尤其是涉及基于人工智能物联网平台用于自动驾驶的远程控制方法。The invention relates to the technical field of unmanned driving, in particular to a remote control method for automatic driving based on an artificial intelligence Internet of Things platform.
背景技术Background technique
近年,城市的车辆数量在不断的增加,为了保证城市交通的正常运转,在城市的交通枢纽中,通常需要对车辆进行有效的调度。一般地,在对车辆进行调度时需要联系车主对车辆进行移动,一旦车主不在车辆附近就无法对车辆进行移动,尤其是车流高峰期时,由于车辆调度的不及时,导致了城市交通运转效率降低。In recent years, the number of vehicles in cities has been increasing. In order to ensure the normal operation of urban traffic, it is usually necessary to effectively dispatch vehicles in urban transportation hubs. Generally, when dispatching vehicles, it is necessary to contact the owner to move the vehicle. Once the owner is not near the vehicle, the vehicle cannot be moved, especially during peak traffic periods. Due to the untimely dispatch of vehicles, the efficiency of urban traffic operation is reduced. .
发明内容Contents of the invention
本发明的主要目的在于提供基于人工智能物联网平台用于自动驾驶的远程控制方法,旨在实现针对无人驾驶车辆的远程控制,便于车主远程进行紧急挪车和提前预知当前路况,并实时寻找到合适的驾车路张和寻找到合适的车位。The main purpose of the present invention is to provide a remote control method for automatic driving based on an artificial intelligence Internet of Things platform, aiming to realize remote control for unmanned vehicles, so that it is convenient for car owners to remotely perform emergency vehicle movement and predict the current road conditions in advance, and find them in real time. Find a suitable driving road and find a suitable parking space.
为实现上述目的,本发明提供一种基于人工智能物联网平台用于自动驾驶的远程控制方法,所述基于人工智能物联网平台用于自动驾驶的远程控制方法包括:In order to achieve the above object, the present invention provides a remote control method for automatic driving based on an artificial intelligence Internet of Things platform, and the remote control method for automatic driving based on an artificial intelligence Internet of Things platform includes:
获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;Obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud platform The information is modeled to obtain the corresponding digital model;
将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;Sending the digital model to the wearable virtual/reality interactive device for display, and obtaining real-time control instructions through the wearable virtual/reality interactive device;
根据所述数字模型,通过所述实时控制指令对所述无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。According to the digital model, the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
可选地,在所述获取所述智慧杆管理***检测的车辆实时信息的步骤之前,还包括:Optionally, before the step of obtaining the real-time vehicle information detected by the smart bar management system, it also includes:
建立所述可穿戴式虚拟/现实交互设备和所述人工智能物联网平台之间的连接,并基于所述可穿戴式虚拟/现实交互设备建立所述无人驾驶车辆与所述智慧杆管理***之间的连接。Establishing the connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of Things platform, and establishing the unmanned vehicle and the smart bar management system based on the wearable virtual/reality interactive device the connection between.
可选地,在所述获取所述智慧杆管理***检测的车辆实时信息的步骤之前,还包括:Optionally, before the step of obtaining the real-time vehicle information detected by the smart bar management system, it also includes:
通过所述无人驾驶车辆中的采集模块对车辆参数和车辆所处环境进行实时采集生成所述车辆 实时信息,并通过所述无人驾驶车辆中的车载无线网络模块将所述车辆实时信息发送至所述智慧杆管理***,其中,所述采集模块包括:激光雷达模块和/或图像采集模块。Real-time acquisition of vehicle parameters and the environment in which the vehicle is located through the acquisition module in the unmanned vehicle to generate the vehicle Real-time information, and send the vehicle real-time information to the smart bar management system through the vehicle wireless network module in the unmanned vehicle, wherein the collection module includes: a laser radar module and/or an image collection module.
可选地,所述通过所述实时控制指令对所述无人驾驶车辆进行控制的步骤,包括:Optionally, the step of controlling the unmanned vehicle through the real-time control instruction includes:
将所述实时控制指令发送至所述人工智能物联网平台,并通过所述人工智能物联网平台对所述实时控制指令进行解析,根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制。Send the real-time control instruction to the artificial intelligence Internet of Things platform, and analyze the real-time control instruction through the artificial intelligence Internet of Things platform, and perform remote mobile control on the unmanned vehicle according to the analyzed real-time control instruction .
可选地,在所述根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制的步骤之后,还包括:Optionally, after the step of performing remote mobile control on the unmanned vehicle according to the analyzed real-time control instruction, it also includes:
获取移动后的无人驾驶车辆的位置信息,并根据所述位置信息判断所述无人驾驶车辆是否处于预设目标位置;Acquiring the position information of the unmanned vehicle after moving, and judging whether the unmanned vehicle is at a preset target position according to the position information;
若否,则将所述位置信息发送至所述可穿戴式虚拟/现实交互设备,使得车主可基于所述位置信息对所述无人驾驶车辆再次进行远程移动控制,直至所述无人驾驶车辆到达所述预设目标位置。If not, then send the location information to the wearable virtual/reality interaction device, so that the owner can perform remote mobile control on the unmanned vehicle again based on the location information, until the unmanned vehicle reach the preset target position.
可选地,所述通过所述可穿戴式虚拟/现实交互设备获取实时控制指令的步骤,包括:Optionally, the step of obtaining real-time control instructions through the wearable virtual/reality interactive device includes:
通过所述可穿戴式虚拟/现实交互设备中的诱发图案对车主进行视觉刺激得到实时控制指令。Real-time control instructions are obtained by visually stimulating the vehicle owner through the evoked pattern in the wearable virtual/reality interactive device.
可选地,所述可穿戴式虚拟/现实交互设备包括:可穿戴式MR设备或者可穿戴式AR/VR设备。Optionally, the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
为实现上述目的,本发明还提供基于人工智能物联网平台用于自动驾驶的远程控制方法,包括:To achieve the above object, the present invention also provides a remote control method for automatic driving based on an artificial intelligence Internet of Things platform, including:
建模模块,用于获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;The modeling module is used to obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud The platform models the target vehicle information to obtain a corresponding digital model;
获取模块,用于将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;An acquisition module, configured to send the digital model to the wearable virtual/reality interactive device for display, and obtain real-time control instructions through the wearable virtual/reality interactive device;
控制模块,用于根据所述数字模型,通过所述实时控制指令对所述无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。A control module, configured to control the unmanned vehicle through the real-time control instructions according to the digital model, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space for the unmanned vehicle Look for.
其中,本发明基于人工智能物联网平台用于自动驾驶的远程控制装置的各个功能模块各自在运行时均实现如上所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。 Wherein, each functional module of the remote control device for automatic driving based on the artificial intelligence Internet of Things platform of the present invention implements the steps of the above-mentioned remote control method for automatic driving based on the artificial intelligence Internet of Things platform when running.
为实现上述目的,本发明还提供一种终端设备,所述终端设备包括:存储器、处理器和存储在所述存储器上并可在所述处理器上运行的基于人工智能物联网平台用于自动驾驶的远程控制程序,所述基于人工智能物联网平台用于自动驾驶的远程控制程序被所述处理器执行时实现如上所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。To achieve the above object, the present invention also provides a terminal device, which includes: a memory, a processor, and an artificial intelligence-based Internet of Things platform stored on the memory and operable on the processor for automatic A remote control program for driving, when the remote control program based on the artificial intelligence Internet of Things platform for automatic driving is executed by the processor, the steps of the above-mentioned remote control method for automatic driving based on the artificial intelligence Internet of Things platform are realized .
此外,为实现上述目的,本发明还提出基于人工智能物联网平台用于自动驾驶车辆远程控制方法上存储有基于人工智能物联网平台用于自动驾驶的远程控制程序,所述基于人工智能物联网平台用于自动驾驶的远程控制程序被处理器执行时实现如上所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。In addition, in order to achieve the above object, the present invention also proposes a remote control method based on the artificial intelligence Internet of Things platform for automatic driving vehicles, storing a remote control program based on the artificial intelligence Internet of Things platform for automatic driving. When the remote control program of the platform for automatic driving is executed by the processor, the steps of the above-mentioned remote control method for automatic driving based on the artificial intelligence Internet of Things platform are realized.
此外,为实现上述目的,本发明还提供计算机程序产品,所述计算机程序产品包括计算机程序,所述计算机程序被处理器执行时实现如上所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。In addition, in order to achieve the above object, the present invention also provides a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, the above-mentioned remote control system for automatic driving based on the artificial intelligence Internet of Things platform is realized. The steps of the control method.
本发明提供基于人工智能物联网平台用于自动驾驶的远程控制方法以及计算机程序产品,基于人工智能物联网平台用于自动驾驶的远程控制方法包括以下步骤:获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;根据所述数字模型,通过所述实时控制指令对所述无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。The present invention provides a remote control method for automatic driving based on an artificial intelligence Internet of Things platform and a computer program product. The remote control method for automatic driving based on an artificial intelligence Internet of Things platform includes the following steps: obtaining the vehicle detected by the smart bar management system Real-time information, preprocessing the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and modeling the target vehicle information through the artificial intelligence digital twin cloud platform to obtain a corresponding digital model; Send the digital model to the wearable virtual/reality interactive device for display, and obtain real-time control instructions through the wearable virtual/reality interactive device; according to the digital model, use the real-time control instructions to The unmanned vehicle is controlled to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
相比于现有技术中由车主在驾驶位对车辆进行移动控制的方式,在本发明中,通过智慧杆管理***将车辆实时信息发送至人工智能物联网平台进行预处理得到目标车辆信息;将该目标车辆信息通过人工智能物联网平台发送至人工智能数字孪生云平台,通过人工智能数字孪生云平台对目标车辆信息进行建模得到对应的数字模型;最终通过人工智能数字孪生云平台将该数字模型发送至可穿戴式虚拟/现实交互设备进行显示,并基于该可穿戴式虚拟/现实交互设备获取用户触发的实时控制指令,以通过该实时控制指令对车辆进行远程移动控制,使得车主不必在驾驶位对车辆进行移动。因此,本发明基于人工智能物联网平台、人工智能数字孪生云平台、智慧杆管理***以及可穿戴式虚拟/现实交互设备实现了针对无人驾驶车辆远程控制的智慧交通,提高了城市交通运转效率,也提升了车主体验。Compared with the way in the prior art that the car owner controls the movement of the vehicle in the driving position, in the present invention, the real-time information of the vehicle is sent to the artificial intelligence Internet of Things platform through the smart bar management system for preprocessing to obtain the target vehicle information; The target vehicle information is sent to the artificial intelligence digital twin cloud platform through the artificial intelligence Internet of Things platform, and the target vehicle information is modeled to obtain the corresponding digital model through the artificial intelligence digital twin cloud platform; The model is sent to the wearable virtual/reality interactive device for display, and the real-time control instruction triggered by the user is obtained based on the wearable virtual/reality interactive device, so that the vehicle can be remotely mobile controlled through the real-time control instruction, so that the owner does not have to The driving position moves the vehicle. Therefore, based on the artificial intelligence Internet of Things platform, artificial intelligence digital twin cloud platform, smart pole management system and wearable virtual/reality interactive equipment, the present invention realizes intelligent transportation for remote control of unmanned vehicles, and improves the efficiency of urban traffic operation , It also improves the owner's experience.
附图说明Description of drawings
图1为本发明实施例方案涉及的硬件运行环境的结构示意图; Fig. 1 is a schematic structural diagram of the hardware operating environment involved in the solution of the embodiment of the present invention;
图2为本发明基于人工智能物联网平台用于自动驾驶的远程控制方法一实施例的流程示意图;FIG. 2 is a schematic flow diagram of an embodiment of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention;
图3为本发明基于人工智能物联网平台用于自动驾驶的远程控制装置一实施例的功能模块示意图。FIG. 3 is a schematic diagram of functional modules of an embodiment of a remote control device for automatic driving based on an artificial intelligence Internet of Things platform in the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
具体实施方式Detailed ways
应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
如图1所示,图1是本发明实施例方案涉及的硬件运行环境的设备结构示意图。As shown in FIG. 1 , FIG. 1 is a schematic diagram of the equipment structure of the hardware operating environment involved in the solution of the embodiment of the present invention.
需要说明的是,本发明实施例终端设备可以是用于实现多类型数据源的数据抽取的终端设备,该终端设备具体可以是智能手机、个人计算机和服务器等。It should be noted that the terminal device in this embodiment of the present invention may be a terminal device for realizing data extraction from multiple types of data sources, and the terminal device may specifically be a smart phone, a personal computer, a server, and the like.
如图1所示,该设备可以包括:处理器1001,例如CPU,网络接口1004,用户接口1003,存储器1005,通信总线1002。其中,通信总线1002用于实现这些组件之间的连接通信。用户接口1003可以包括显示屏(Display)、输入单元比如键盘(Keybod),可选用户接口1003还可以包括标准的有线接口、无线接口。网络接口1004可选的可以包括标准的有线接口、无线接口(如WI-FI接口)。存储器1005可以是高速RAM存储器,也可以是稳定的存储器(non-volatile memory),例如磁盘存储器。存储器1005可选的还可以是独立于前述处理器1001的存储装置。As shown in FIG. 1 , the device may include: a processor 1001 , such as a CPU, a network interface 1004 , a user interface 1003 , a memory 1005 , and a communication bus 1002 . Wherein, the communication bus 1002 is used to realize connection and communication between these components. The user interface 1003 may include a display screen (Display), an input unit such as a keyboard (Keybod), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. Optionally, the network interface 1004 may include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 can be a high-speed RAM memory, or a stable memory (non-volatile memory), such as a disk memory. Optionally, the memory 1005 may also be a storage device independent of the aforementioned processor 1001 .
本领域技术人员可以理解,图1中示出的设备结构并不构成对设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。Those skilled in the art can understand that the device structure shown in FIG. 1 does not constitute a limitation to the device, and may include more or less components than shown in the figure, or combine some components, or arrange different components.
如图1所示,作为一种计算机存储介质的存储器1005中可以包括操作***、网络通信模块、用户接口模块以及基于人工智能物联网平台用于自动驾驶的远程控制程序。操作***是管理和控制设备硬件和软件资源的程序,支持基于人工智能物联网平台用于自动驾驶的远程控制程序以及其它软件或程序的运行。在图1所示的设备中,用户接口1003主要用于与客户端进行数据通信;网络接口1004主要用于与服务器建立通信连接;而处理器1001可以用于调用存储器1005中存储的基于人工智能物联网平台用于自动驾驶的远程控制的控制程序,并执行以下操作:As shown in FIG. 1 , the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a remote control program for automatic driving based on an artificial intelligence Internet of Things platform. The operating system is a program that manages and controls the hardware and software resources of the device, and supports the operation of remote control programs for autonomous driving and other software or programs based on the artificial intelligence Internet of Things platform. In the device shown in Figure 1, the user interface 1003 is mainly used for data communication with the client; the network interface 1004 is mainly used for establishing a communication connection with the server; The IoT platform is used for the control program of the remote control of the autonomous driving, and performs the following operations:
获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;Obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud platform The information is modeled to obtain the corresponding digital model;
将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚 拟/现实交互设备获取实时控制指令;Send the digital model to the wearable virtual/reality interactive device for display, and through the wearable virtual The simulated/real interactive device obtains real-time control instructions;
根据所述数字模型,通过所述实时控制指令对所述无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。According to the digital model, the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
进一步地,在所述获取通过所述获取所述智慧杆管理***检测的车辆实时信息的步骤之前,处理器1001还可以用于调用存储器1005中存储的基于人工智能物联网平台用于自动驾驶的远程控制程序,还执行以下操作:Further, before the step of obtaining the real-time vehicle information detected by the smart bar management system, the processor 1001 can also be used to call the information stored in the memory 1005 based on the artificial intelligence Internet of Things platform for automatic driving. remote control program, also do the following:
建立所述可穿戴式虚拟/现实交互设备和所述人工智能物联网平台之间的连接,并基于所述可穿戴式虚拟/现实交互设备建立所述无人驾驶车辆与所述智慧杆管理***之间的连接。Establishing the connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of Things platform, and establishing the unmanned vehicle and the smart bar management system based on the wearable virtual/reality interactive device the connection between.
进一步地,在所述获取所述智慧杆管理***检测的车辆实时信息的步骤之前,处理器1001还可以用于调用存储器1005中存储的基于人工智能物联网平台用于自动驾驶的远程控制程序,还执行以下操作:Further, before the step of obtaining the real-time vehicle information detected by the smart rod management system, the processor 1001 can also be used to call the remote control program for automatic driving based on the artificial intelligence Internet of Things platform stored in the memory 1005, Also do the following:
通过所述无人驾驶车辆中的采集模块对车辆参数和车辆所处环境进行实时采集生成所述车辆实时信息,并通过所述无人驾驶车辆中的车载无线网络模块将所述车辆实时信息发送至所述智慧杆管理***,其中,所述采集模块包括:激光雷达模块和/或图像采集模块。Real-time acquisition of vehicle parameters and the environment where the vehicle is located by the acquisition module in the unmanned vehicle generates the real-time information of the vehicle, and sends the real-time information of the vehicle through the vehicle-mounted wireless network module in the unmanned vehicle As for the smart pole management system, wherein the acquisition module includes: a laser radar module and/or an image acquisition module.
进一步地,处理器1001还可以用于调用存储器1005中存储的基于人工智能物联网平台用于自动驾驶的远程控制程序,还执行以下操作:Further, the processor 1001 can also be used to call the remote control program based on the artificial intelligence Internet of Things platform for automatic driving stored in the memory 1005, and also perform the following operations:
将所述实时控制指令发送至所述人工智能物联网平台,并通过所述人工智能物联网平台对所述实时控制指令进行解析,根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制。Send the real-time control instruction to the artificial intelligence Internet of Things platform, and analyze the real-time control instruction through the artificial intelligence Internet of Things platform, and perform remote mobile control on the unmanned vehicle according to the analyzed real-time control instruction .
进一步地,在所述根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制的步骤之后,处理器1001还可以用于调用存储器1005中存储的基于人工智能物联网平台用于自动驾驶的远程控制程序,还执行以下操作:Further, after the step of performing remote mobile control on the unmanned vehicle according to the analyzed real-time control instruction, the processor 1001 can also be used to call the information stored in the memory 1005 based on the artificial intelligence Internet of Things platform for automatic driving. remote control program, also do the following:
获取移动后的无人驾驶车辆的位置信息,并根据所述位置信息判断所述无人驾驶车辆是否处于预设目标位置;Acquiring the position information of the unmanned vehicle after moving, and judging whether the unmanned vehicle is at a preset target position according to the position information;
若否,则将所述位置信息发送至所述可穿戴式虚拟/现实交互设备,使得车主可基于所述位置信息对所述无人驾驶车辆再次进行远程移动控制,直至所述无人驾驶车辆到达所述预设目标位置。If not, then send the location information to the wearable virtual/reality interaction device, so that the owner can perform remote mobile control on the unmanned vehicle again based on the location information, until the unmanned vehicle reach the preset target position.
进一步地,处理器1001还可以用于调用存储器1005中存储的基于人工智能物联网平台用于自动驾驶的远程控制程序,还执行以下操作:Further, the processor 1001 can also be used to call the remote control program based on the artificial intelligence Internet of Things platform for automatic driving stored in the memory 1005, and also perform the following operations:
通过所述可穿戴式虚拟/现实交互设备中的诱发图案对车主进行视觉刺激得到实时控制指令。 Real-time control instructions are obtained by visually stimulating the vehicle owner through the evoked pattern in the wearable virtual/reality interactive device.
进一步地,所述可穿戴式虚拟/现实交互设备包括:可穿戴式MR设备或者可穿戴式AR/VR设备。Further, the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
参照图2,图2为本发明基于人工智能物联网平台用于自动驾驶的远程控制方法第一实施例的流程示意图。Referring to FIG. 2 , FIG. 2 is a schematic flowchart of a first embodiment of a remote control method for automatic driving based on an artificial intelligence Internet of Things platform in the present invention.
在本实施例中,提供了基于人工智能物联网平台用于自动驾驶的远程控制方法的实施例,需要说明的是,虽然在流程图中示出了逻辑顺序,但是在某些情况下,可以不同于此处的顺序执行所示出或描述的步骤。In this embodiment, an embodiment of a remote control method for automatic driving based on an artificial intelligence Internet of Things platform is provided. It should be noted that although the logic sequence is shown in the flow chart, in some cases, it can The steps shown or described are performed in an order different than here.
在本实施例中,基于人工智能物联网平台用于自动驾驶的远程控制方法应用于基于人工智能物联网平台用于自动驾驶的远程控制***,基于人工智能物联网平台用于自动驾驶的远程控制***包括:人工智能物联网平台、可穿戴式虚拟/现实交互设备和智慧杆管理***。其中,人工智能物联网平台是在传统IOT平台上发展起来,但是不止于AI技术,人工智能物联网平台同时支持视频云、大数据***等,人工智能物联网平台是真正将物联网技术发挥价值的赋能平台。人工智能物联网平台应用包括:业务与业态、人工智能物联网平台包括业务,技术,数据、运营架构即(IAAS、PAAS、SAAS、DAAS)以及网络通讯层和设备层等多层架构融合平台,其中,业务与业态包括:智慧城市、智慧交通,智慧园区、智慧社区和智慧农业等;人工智能物联网平台平台使能还包括:应用使能、数据使能和集成使能等;PAAS包括:物联网平台、AI平台和视频云平台等;IAAS包括:共有云、私有云和混合云,网络通讯层包括:2G/3G/4G/5G、以以太网、5G、Wi-Fi、蓝牙、LORA和NB-IOT等;DaaS包括大数据处理,3D全息影像,3D建模等。设备层包括:控制类设备、网关边缘设备、摄像头和传感器等。In this embodiment, the remote control method based on the artificial intelligence Internet of Things platform for automatic driving is applied to the remote control system for automatic driving based on the artificial intelligence Internet of Things platform, and the remote control method for automatic driving based on the artificial intelligence Internet of Things platform The system includes: artificial intelligence Internet of things platform, wearable virtual/reality interactive equipment and smart pole management system. Among them, the artificial intelligence Internet of things platform is developed on the traditional IOT platform, but it is not limited to AI technology. The artificial intelligence Internet of things platform supports video cloud and big data systems at the same time. The artificial intelligence Internet of things platform is the real value of the Internet of things technology. enabling platform. AI IoT platform applications include: business and business formats, AI IoT platforms include business, technology, data, operating architecture (IAAS, PAAS, SAAS, DAAS) and multi-layer architecture integration platforms such as network communication layer and device layer, Among them, business and format include: smart city, smart transportation, smart park, smart community, and smart agriculture; AI IoT platform platform enablement also includes: application enablement, data enablement, and integration enablement; PAAS includes: IoT platform, AI platform and video cloud platform, etc.; IAAS includes: public cloud, private cloud and hybrid cloud, network communication layer includes: 2G/3G/4G/5G, Ethernet, 5G, Wi-Fi, Bluetooth, LORA and NB-IOT, etc.; DaaS includes big data processing, 3D holographic images, 3D modeling, etc. The device layer includes: control devices, gateway edge devices, cameras and sensors, etc.
另外,智慧杆管理***为是集智慧照明、视频监控、交通管理、环境检测、无线通信、信息交互、应急求助等多功能于一体的公共基础设施,是构建新型智慧城市的重要载体。智慧杆管理***能挂载5G通信基站、WiFi无线网络、智能节能路灯、智能安防监控、智能人脸识别、交通诱导与指示、音响与广播电视、无人机充电、汽车充电桩、停车无感支付、无人驾驶诱导等设备。在本实施例中可通过智慧杆管理***接收无人驾驶车辆的车辆实时信息,并通过人工智能物联网平台对车辆实时信息进行预处理,并将预处理后的车辆实时信息发送至人工智能数字孪生云平台进行建模得到对应的数字模型,并将该数字模型发送至可穿戴式虚拟/现实交互设备进行显示,使得车主能够随时获取车辆实时信息,并对无人驾驶车辆进行远程控制。In addition, the smart pole management system is a public infrastructure integrating smart lighting, video surveillance, traffic management, environmental detection, wireless communication, information interaction, emergency help, etc., and is an important carrier for building a new smart city. The smart pole management system can mount 5G communication base stations, WiFi wireless networks, intelligent energy-saving street lights, intelligent security monitoring, intelligent face recognition, traffic guidance and instructions, audio and radio and television, drone charging, car charging piles, and parking senseless Payment, unmanned driving guidance and other equipment. In this embodiment, the real-time vehicle information of unmanned vehicles can be received through the smart pole management system, and the real-time vehicle information can be preprocessed through the artificial intelligence Internet of Things platform, and the preprocessed real-time vehicle information can be sent to the artificial intelligence digital The twin cloud platform performs modeling to obtain the corresponding digital model, and sends the digital model to the wearable virtual/reality interactive device for display, so that the owner can obtain real-time vehicle information at any time and remotely control the unmanned vehicle.
步骤S10,获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网 平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;Step S10, obtain the real-time information of the vehicle detected by the smart bar management system, and use the artificial intelligence Internet of Things The platform preprocesses the real-time information of the vehicle to obtain target vehicle information, and models the target vehicle information through the artificial intelligence digital twin cloud platform to obtain a corresponding digital model;
需要说明的是,在本实施例中,当车主不在车辆附近且需要对车辆进行紧急挪动时,为了不妨碍城市交通运转,可基于智慧杆管理***、人工智能物联网平台和人工智能数字孪生云平台得到车辆实时信息的数字模型,并将该数字模型通过可穿戴式虚拟/现实交互设备进行显示。It should be noted that, in this embodiment, when the owner is not near the vehicle and needs to move the vehicle urgently, in order not to hinder the operation of urban traffic, it can The platform obtains the digital model of the real-time information of the vehicle, and displays the digital model through a wearable virtual/reality interactive device.
具体地,例如,通过智慧杆管理***获取到无人驾驶车辆的车辆实时信息,该车辆实时信息可以包括:车辆参数信息和车辆所处环境信息等;通过智慧杆管理***将车辆实时信息发送至人工智能物联网平台,通过人工智能物联网平台中的边缘计算网关对该车辆实时信息进行预处理得到目标车辆信;将该目标车辆信息发送至人工智能数字孪生云平台,通过人工智能数字孪生云平台对该目标车辆信息进行数字建模得到关于该目标车辆信息的数字模型;将目标车辆信息对应的数字模型通过人工智能数字孪生云平台发送至可穿戴式虚拟/现实交互设备中进行展示,使得车主可通过该可穿戴式虚拟/现实交互设备浏览到车辆参数信息和车辆所处环境信息等,进而对车辆进行远程进行紧急挪车、提前预判当前路况和警告以及实时寻找到合适的驾车路线图和合适的车位等。其中,数字模型为目标车辆信息在人工智能数字孪生云平台的数字化。Specifically, for example, the real-time vehicle information of the unmanned vehicle is obtained through the smart pole management system, which may include: vehicle parameter information and vehicle environment information, etc.; the real-time vehicle information is sent to the The artificial intelligence Internet of Things platform preprocesses the real-time information of the vehicle through the edge computing gateway in the artificial intelligence Internet of Things platform to obtain the target vehicle information; sends the target vehicle information to the artificial intelligence digital twin cloud platform, and through the artificial intelligence digital twin cloud The platform performs digital modeling on the target vehicle information to obtain a digital model of the target vehicle information; sends the digital model corresponding to the target vehicle information to the wearable virtual/reality interactive device for display through the artificial intelligence digital twin cloud platform, so that The owner can browse the vehicle parameter information and the environment information of the vehicle through the wearable virtual/reality interactive device, and then perform remote emergency maneuvering of the vehicle, predict the current road conditions and warnings in advance, and find the appropriate driving route in real time Maps and suitable parking spaces, etc. Among them, the digital model is the digitalization of target vehicle information on the artificial intelligence digital twin cloud platform.
步骤S20,将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;Step S20, sending the digital model to the wearable virtual/reality interaction device for display, and obtaining real-time control instructions through the wearable virtual/reality interaction device;
需要说明的是,在本实施例中,为了使得车主能够远程控制无人驾驶车辆的移动,可将通过智慧杆管理***、人工智能物联网平台和人工智能数字孪生云平台得到关于车辆实时信息的数字模型实时交互和显示在可穿戴式虚拟/现实交互设备。可穿戴式虚拟/现实交互设备包括一个可视化交互界面,可通过该可视化交互界面对数字模型进行显示,也可以基于该可视化交互界面对车主进行视觉刺激得到车主触发的实时控制指令,也可在该可视化界面显示车辆实时参数,如车辆的油量/电量等。It should be noted that in this embodiment, in order to enable the owner to remotely control the movement of the unmanned vehicle, the real-time information about the vehicle can be obtained through the smart bar management system, the artificial intelligence Internet of Things platform and the artificial intelligence digital twin cloud platform. The digital models are interacted and displayed in real-time on wearable virtual/reality interactive devices. The wearable virtual/reality interactive device includes a visual interactive interface through which the digital model can be displayed, and based on the visual interactive interface, the car owner can be visually stimulated to obtain the real-time control command triggered by the car owner. The visual interface displays the real-time parameters of the vehicle, such as the fuel volume/electricity of the vehicle, etc.
具体地,例如,在通过人工智能物联网平台中的边缘计算网关对车辆实时信息进行预处理得到目标车辆信息,并通过人工智能数字孪生云平台对该目标车辆信息进行建模得到车辆实时信息的数字模型后,将通过人工智能数字孪生云平将该数字模型发送至车主所佩戴的可穿戴式虚拟/现实交互设备,使得车主可在该可穿戴式虚拟/现实交互设备中浏览到该车辆实时信息对应的数字模型,同时通过可穿戴式虚拟/现实交互设备接收车主触发的实时控制指令,以根据该实时控制指令对无人驾驶车辆进行控制。 Specifically, for example, the edge computing gateway in the artificial intelligence Internet of Things platform preprocesses the real-time information of the vehicle to obtain the target vehicle information, and uses the artificial intelligence digital twin cloud platform to model the target vehicle information to obtain the real-time information of the vehicle. After the digital model is completed, the digital model will be sent to the wearable virtual/reality interactive device worn by the owner through the artificial intelligence digital twin Yunping, so that the owner can browse the real-time information of the vehicle on the wearable virtual/reality interactive device. The digital model corresponding to the information receives the real-time control instruction triggered by the owner through the wearable virtual/reality interactive device, so as to control the unmanned vehicle according to the real-time control instruction.
步骤S30,根据所述数字模型,通过所述实时控制指令对所述无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。Step S30, according to the digital model, the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space finding for the unmanned vehicle.
在通过可穿戴式虚拟/现实交互设备获取到车主远程发起的实时控制指令后,将根据实时控制指令和车辆实时信息对应的数字模型对无人驾驶车辆进行远程控制。After obtaining the real-time control command remotely initiated by the owner through the wearable virtual/reality interactive device, the unmanned vehicle will be remotely controlled according to the real-time control command and the digital model corresponding to the real-time information of the vehicle.
具体地,例如,当通过可穿戴式虚拟/现实交互设备接收到车主触发的实时控制指令后,将该实时控制指令发送至人工智能物联网平台;通过人工智能物联网平台对该实时控制指令进行解析;将解析后的实时控制指令发送至智慧杆管理***,以通过智慧杆管理***将解析后的实时控制指令发送至无人驾驶车辆;而无人驾驶车辆的计算中心将解析后的实时控制指令转化为相应的CAN信号,以通过该CAN信号对无人驾驶车辆的制动电机驱动器进行控制,进而实现对车辆进行远程的紧急挪车、路况预判、行车路线规划和车位寻等。Specifically, for example, after receiving the real-time control instruction triggered by the owner through the wearable virtual/reality interactive device, the real-time control instruction is sent to the artificial intelligence Internet of Things platform; Analysis; send the analyzed real-time control instructions to the smart rod management system, so that the analyzed real-time control instructions can be sent to the unmanned vehicle through the smart rod management system; and the computing center of the unmanned vehicle will analyze the real-time control instructions The command is converted into the corresponding CAN signal, so as to control the brake motor driver of the unmanned vehicle through the CAN signal, and then realize the remote emergency vehicle movement, road condition prediction, driving route planning and parking space search for the vehicle.
进一步地,在上述步骤S10,“获取所述智慧杆管理***检测的车辆实时信息”之前,还包括:Further, before the above step S10, "obtaining real-time vehicle information detected by the smart bar management system", it also includes:
步骤S40,建立所述可穿戴式虚拟/现实交互设备和所述人工智能物联网平台之间的连接,并基于所述可穿戴式虚拟/现实交互设备建立所述无人驾驶车辆与所述智慧杆管理***之间的连接。Step S40, establishing a connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of Things platform, and establishing the connection between the unmanned vehicle and the smart device based on the wearable virtual/reality interactive device. Connection between rod management systems.
当车主需要对无人驾驶车辆进行远程控制之前,需要通过可穿戴式虚拟/现实交互设备发送连接指令,将该连接指令通过可穿戴式虚拟/现实交互设备发送至人工智能物联网平台,人工智能物联网平台在接收到该连接指令后将建立与可穿戴式虚拟/现实交互设备的连接;同时,将该连接指令通过人工智能物联网平台发送至智慧杆管理***,并通过所述智慧杆管理***中的5G基站模块将该连接指令发送至无人驾驶车辆,而无人驾驶车辆在基于信号接收模块接收到该连接指令后,将与距离最近的智慧杆管理***建立连接,以实现无人驾驶车辆与所述智慧杆管理***之间的连接。Before the owner needs to remotely control the unmanned vehicle, he needs to send a connection command through the wearable virtual/reality interactive device, and send the connection command to the artificial intelligence Internet of Things platform through the wearable virtual/reality interactive device. After receiving the connection instruction, the Internet of Things platform will establish a connection with the wearable virtual/reality interactive device; at the same time, the connection instruction will be sent to the smart rod management system through the artificial intelligence Internet of Things platform, and through the smart rod management system The 5G base station module in the system sends the connection instruction to the unmanned vehicle, and the unmanned vehicle will establish a connection with the nearest smart pole management system after receiving the connection instruction based on the signal receiving module to realize unmanned Driving the connection between the vehicle and the smart bar management system.
进一步地,在上述步骤S10,“获取通过所述智慧杆管理***发送的车辆实时信息”之前,还包括:Further, before the above step S10, "obtaining real-time vehicle information sent through the smart bar management system", it also includes:
步骤S50,通过所述无人驾驶车辆中的采集模块对车辆参数和车辆所处环境进行实时采集生成所述车辆实时信息,并通过所述无人驾驶车辆中的车载无线网络模块将所述车辆实时信息发送至所述智慧杆管理***,其中,所述采集模块包括:激光雷达模块和/或图像采集模块。Step S50, through the collection module in the unmanned vehicle, the vehicle parameters and the environment where the vehicle is located are collected in real time to generate the real-time information of the vehicle, and the vehicle wireless network module in the unmanned vehicle is connected to the The real-time information is sent to the smart pole management system, wherein the collection module includes: a laser radar module and/or an image collection module.
需要说明的是,在本实施例中,可通过无人驾驶车辆所搭载的采集模块可以包括激光雷达模块和图像采集模块等。激光雷达模块可用于对车辆周围环境进行扫描形成3D全景 影像图,而图像采集模块可用于捕获车辆的周边环境,通过深度学习识别出图像中包含的物体,比如行人、行车、交通路标等。It should be noted that, in this embodiment, the acquisition module that can be carried by the unmanned vehicle may include a laser radar module, an image acquisition module, and the like. The lidar module can be used to scan the surrounding environment of the vehicle to form a 3D panorama Image map, and the image acquisition module can be used to capture the surrounding environment of the vehicle, and recognize objects contained in the image through deep learning, such as pedestrians, driving, traffic signs, etc.
具体地,例如,在对车辆进行远程移动时,需要通过雷达模块和/或图像采集模块预先获取车辆周围的障碍物以及车辆周围的路况以及停车区域的分割线等车辆实时信息,并将该车辆实时信息通过无人驾驶车辆中的车载无线网络模块发送给智慧杆管理***,而智慧杆管理***可通过5G基站模块接收该车辆实时信息,并在接收到该车辆实时信息后将该车辆实时信息发送至人工智能物联网平台和人工智能数字孪生云平台分得到车辆实时信息对应的数字模型,并将该数字模型在可穿戴式虚拟/现实交互设备中进行显示,使得车主可基于可穿戴式虚拟/现实交互设备远程对无人驾驶车辆进行紧急挪车、路况预判、行车路线规划和车位寻找等。Specifically, for example, when the vehicle is remotely moved, it is necessary to obtain real-time vehicle information such as obstacles around the vehicle, road conditions around the vehicle, and dividing lines of parking areas through the radar module and/or image acquisition module in advance, and send the vehicle The real-time information is sent to the smart pole management system through the on-board wireless network module in the unmanned vehicle, and the smart pole management system can receive the real-time information of the vehicle through the 5G base station module, and send the real-time information of the vehicle after receiving the real-time information of the vehicle. Send it to the artificial intelligence Internet of Things platform and the artificial intelligence digital twin cloud platform to obtain the digital model corresponding to the real-time information of the vehicle, and display the digital model on the wearable virtual/reality interactive device, so that the owner can /Reality interactive equipment remotely performs emergency maneuvering, road condition prediction, driving route planning and parking space search for unmanned vehicles.
在本实施例中,当车主需要对车辆进行远程移动时,可通过可穿戴式虚拟/现实交互设备发送连接指令,在通过人工智能物联网平台接收到该连接指令后,通过人工智能物联网平台将该连接指令发送至智慧杆管理***,并通过智慧杆管理***中的5G基站模块将该连接指令发送至无人驾驶车辆的信号接收模块,无人驾驶车辆在接收到该连接信号后与距离最近的智慧杆管理***进行连接。在对车辆进行远程控制时,需要通过无人驾驶车辆搭载的雷达模块和/或图像采集模块预先获取车辆周围的障碍物以及车辆周围的路况等车辆实时信息,并将该车辆实时信息发送至智慧杆管理***;通过智慧杆管理***将车辆实时信息发送至人工智能物联网平台进行预处理得到目标车辆信息;将该目标车辆信息通过人工智能物联网平台发送至人工智能数字孪生云平台,通过人工智能数字孪生云平台对目标车辆信息进行建模得到对应的数字模型;将该数字模型通过人工智能数字孪生云平台无线传输至车主所佩戴的可穿戴式虚拟/现实交互设备,并通过可穿戴式虚拟/现实交互设备接收车主触发的实时控制指令,以根据实时控制指令对无人驾驶车辆进行远程移动。In this embodiment, when the car owner needs to remotely move the vehicle, he can send a connection instruction through the wearable virtual/reality interactive device. After receiving the connection instruction through the artificial intelligence Internet of Things platform, Send the connection command to the smart bar management system, and send the connection command to the signal receiving module of the unmanned vehicle through the 5G base station module in the smart bar management system. The nearest smart pole management system is connected. When remotely controlling the vehicle, it is necessary to obtain real-time vehicle information such as obstacles around the vehicle and road conditions around the vehicle through the radar module and/or image acquisition module mounted on the unmanned vehicle, and send the real-time information of the vehicle to the smart Pole management system; through the smart pole management system, the real-time information of the vehicle is sent to the artificial intelligence Internet of Things platform for preprocessing to obtain the target vehicle information; the target vehicle information is sent to the artificial intelligence digital twin cloud platform through the artificial intelligence Internet of Things platform, The intelligent digital twin cloud platform models the target vehicle information to obtain the corresponding digital model; the digital model is wirelessly transmitted to the wearable virtual/reality interactive device worn by the owner through the artificial intelligence digital twin cloud platform, and through the wearable The virtual/reality interactive device receives the real-time control instruction triggered by the vehicle owner, so as to remotely move the unmanned vehicle according to the real-time control instruction.
相比于现有技术中由车主在驾驶位对车辆进行移动控制的方式,在本发明中,通过无人驾驶车辆搭载的采集模块得到车辆实时信息,通过智慧杆管理***将车辆实时信息发送至人工智能物联网平台进行预处理得到目标车辆信息;将该目标车辆信息通过人工智能物联网平台发送至人工智能数字孪生云平台,通过人工智能数字孪生云平台对目标车辆信息进行建模得到对应的数字模型;最终通过可穿戴式虚拟/现实交互设备显示该数字模型,并基于该可穿戴式虚拟/现实交互设备获取用户触发的实时控制指令,以通过该实时控制指令对车辆进行远程移动控制,使得车主不必在驾驶位对车辆进行移动。因此,本发明基于人工智能物联网平台、人工智能数字孪生云平台、智慧杆管理***以及可穿戴式虚拟/现实交互设备 实现了针对无人驾驶车辆远程控制的智慧交通,提高了城市交通运转效率,也提升了车主体验。Compared with the way in the prior art that the vehicle owner controls the movement of the vehicle in the driving position, in the present invention, the real-time information of the vehicle is obtained through the acquisition module mounted on the unmanned vehicle, and the real-time information of the vehicle is sent to the The artificial intelligence Internet of Things platform performs preprocessing to obtain the target vehicle information; the target vehicle information is sent to the artificial intelligence digital twin cloud platform through the artificial intelligence Internet of Things platform, and the target vehicle information is modeled through the artificial intelligence digital twin cloud platform to obtain the corresponding A digital model; finally displaying the digital model through a wearable virtual/reality interactive device, and obtaining real-time control instructions triggered by the user based on the wearable virtual/reality interactive device, so as to perform remote mobile control on the vehicle through the real-time control instructions, The owner does not have to move the vehicle in the driving position. Therefore, the present invention is based on an artificial intelligence Internet of Things platform, an artificial intelligence digital twin cloud platform, a smart rod management system, and a wearable virtual/reality interactive device It realizes intelligent transportation for remote control of unmanned vehicles, improves the efficiency of urban traffic operation, and improves the experience of car owners.
进一步地,基于上述本发明基于人工智能物联网平台用于自动驾驶的远程控制方法的第一实施例,提出本发明基于人工智能物联网平台用于自动驾驶的远程控制方法的第二实施例。Further, based on the first embodiment of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention, a second embodiment of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention is proposed.
本实施例与第一实施例的区别在于,在本实施例中,在上述步骤S30中,“通过所述实时控制指令对所述无人驾驶车辆进行控制”的步骤,包括:The difference between this embodiment and the first embodiment is that in this embodiment, in the above step S30, the step of "controlling the unmanned vehicle through the real-time control instruction" includes:
步骤S301,将所述实时控制指令发送至所述人工智能物联网平台,并通过所述人工智能物联网平台对所述实时控制指令进行解析,根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制。Step S301, sending the real-time control instruction to the artificial intelligence Internet of Things platform, and analyzing the real-time control instruction through the artificial intelligence Internet of Things platform, and controlling the unmanned vehicle according to the analyzed real-time control instruction Remote mobile control.
终端设备在通过可穿戴式虚拟/现实交互设备获取到车主触发的实时控制指令后,将该实时控制指令通过穿戴式虚拟/现实交互设备以无线传输的方式发送至人工智能物联网平台,由人工智能物联网平台对该实时控制指令进行解析,使得解析后的实时控制指令能够对车辆的制动***进行控制,进而实现车辆的远程控制。After the terminal device obtains the real-time control command triggered by the owner through the wearable virtual/reality interactive device, the real-time control command is sent to the artificial intelligence Internet of Things platform through the wearable virtual/reality interactive The intelligent Internet of Things platform analyzes the real-time control instruction, so that the analyzed real-time control instruction can control the braking system of the vehicle, and then realize the remote control of the vehicle.
需要说明的是,在本实施例中,车主在通过可穿戴式虚拟/现实交互设备触发的实时控制指令时,该实时控制指令实际上基于视觉诱发产生的电信号,因此需要通过人工智能物联网平台对该实时控制指令进行解析得到能够对车辆的制动电机驱动器进行控制的信号。It should be noted that, in this embodiment, when the car owner triggers the real-time control command through the wearable virtual/reality interactive device, the real-time control command is actually based on the electrical signal generated by visual induction, so it needs to be controlled by the artificial intelligence Internet of Things. The platform analyzes the real-time control command to obtain a signal capable of controlling the brake motor driver of the vehicle.
进一步地,在上述步骤S301,“根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制”之后,还包括:Further, after the above step S301, after "performing remote mobile control of the unmanned vehicle according to the analyzed real-time control instruction", it also includes:
步骤S302,获取移动后的无人驾驶车辆的位置信息,并根据所述位置信息判断所述无人驾驶车辆是否处于预设目标位置;Step S302, acquiring the location information of the moved unmanned vehicle, and judging whether the unmanned vehicle is at a preset target location according to the location information;
步骤S303,若否,则将所述位置信息回传至所述可穿戴式虚拟/现实交互设备,使得车主可基于所述位置信息对所述无人驾驶车辆再次进行远程移动控制,直至到达所述预设目标位置。Step S303, if not, send the location information back to the wearable virtual/reality interaction device, so that the owner can remotely control the unmanned vehicle again based on the location information until reaching the desired location. the preset target position described above.
需要说明的是,在本实施例中,由于车主在对车辆进行远程控制时可能出现误差,因此,在对每次通过可穿戴式虚拟/现实交互设备进行远程移动控制之后,需要再次通过车载的采集模块对车辆的当前信息进行采集,以保证车辆处于预设目标位置。It should be noted that, in this embodiment, since the owner may make an error when remotely controlling the vehicle, after each remote mobile control through the wearable virtual/reality interactive device, it is necessary to pass the vehicle again. The collection module collects the current information of the vehicle to ensure that the vehicle is at the preset target position.
具体地,例如,在对车辆进行一次远程移动之后,将再次通过图像采集模块获取车辆的当前位置信息,进而将车辆当前的位置信息与预设目标位置进行比对,判断车辆当前是否已处于该预设目标位置。若是判断到车辆当前仍旧未处于预设目标位置,将通过人工智能 物联网平台将车辆当前的位置信息发送至人工智能数字孪生云平台进行建模得到数字模型,并将车辆当前的位置信息对应的数字模型通过人工智能数字孪生云平台发送至可穿戴式虚拟/现实交互设备进行显示,使得车主能够通过该可穿戴式虚拟/现实交互设备获取车辆当前状态,进而基于车辆当前状态再次对车辆进行移动,直至将车辆移动至预设目标位置。Specifically, for example, after a remote movement of the vehicle, the current position information of the vehicle will be obtained again through the image acquisition module, and then the current position information of the vehicle will be compared with the preset target position to determine whether the vehicle is currently in the target position. Preset target position. If it is judged that the vehicle is still not at the preset target position, it will use artificial intelligence to The Internet of Things platform sends the vehicle's current location information to the artificial intelligence digital twin cloud platform for modeling to obtain a digital model, and sends the digital model corresponding to the vehicle's current location information to the wearable virtual/reality through the artificial intelligence digital twin cloud platform The interactive device displays, so that the owner can obtain the current state of the vehicle through the wearable virtual/reality interactive device, and then move the vehicle again based on the current state of the vehicle until the vehicle is moved to the preset target position.
进一步地,上述步骤S20中,“通过所述可穿戴式虚拟/现实交互设备获取实时控制指令”,可以包括:Further, in the above step S20, "obtaining real-time control instructions through the wearable virtual/reality interactive device" may include:
步骤S201,通过所述可穿戴式虚拟/现实交互设备中的诱发图案对车主进行视觉刺激得到实时控制指令。Step S201, performing visual stimulation on the vehicle owner through the induced patterns in the wearable virtual/reality interactive device to obtain real-time control instructions.
需要说明的是,在本实施例中,可穿戴式虚拟/现实交互设备配置有一可视化交互界面,在该可视化交互界面中可将车辆信息对应的数字模型进行展示,也能够以3D全息影像或者三维方式进行展示,车主可在该可视化界面中浏览车辆的实时信息,并且车主也可通过该可视化界面触发实时控制指令,实现车辆的远程移动。It should be noted that, in this embodiment, the wearable virtual/reality interactive device is equipped with a visual interactive interface, in which the digital model corresponding to the vehicle information can be displayed, and it can also be displayed as a 3D holographic image or a three-dimensional The car owner can browse the real-time information of the vehicle in the visual interface, and the car owner can also trigger the real-time control command through the visual interface to realize the remote movement of the vehicle.
具体地,例如,在可穿戴式虚拟/现实交互设备的可视化界面中,可通过可视化界面中的刺激模块对车主进行视觉刺激,车主接收到一定频率的图形闪烁刺激时大脑枕叶视觉区随之产生与刺激频率相关的脑电信号响应,采集该脑电信号进行特征提取与分析从而识别车主的意图,即得到车主触发的实时控制指令,以根据该实时控制指令对车辆进行远程挪移。Specifically, for example, in the visual interface of a wearable virtual/reality interactive device, the vehicle owner can be visually stimulated through the stimulation module in the visual interface. Generate an EEG signal response related to the stimulation frequency, collect the EEG signal for feature extraction and analysis to identify the owner's intention, that is, obtain the real-time control command triggered by the car owner, and remotely move the vehicle according to the real-time control command.
进一步地,所述可穿戴式虚拟/现实交互设备包括:可穿戴式MR设备或者可穿戴式AR/VR设备。Further, the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
需要说明的是,在本实施例中,为了使得车主能够随时对车辆进行远程移动,穿戴式虚拟/现实交互设备可为可穿戴式MR(混合现实)设备或者可穿戴式AR(增强现实)/VR(虚拟现实)设备,具体地,可将该可穿戴式MR设备或者可穿戴式AR/VR设备集成于眼镜或者墨镜中,使得车主能够随时通过可穿戴式MR设备或者可穿戴式AR/VR设备对车辆进行远程移动。It should be noted that, in this embodiment, in order to enable the owner to remotely move the vehicle at any time, the wearable virtual/reality interaction device can be a wearable MR (mixed reality) device or a wearable AR (augmented reality)/ VR (Virtual Reality) devices, specifically, the wearable MR device or wearable AR/VR device can be integrated into glasses or sunglasses, so that the owner can use the wearable MR device or wearable AR/VR device at any time The device remotely moves the vehicle.
在本实施例中,终端设备在通过可穿戴式虚拟/现实交互设备获取到车主触发的实时控制指令后,将该实时控制指令通过无线传输的方式发送至人工智能物联网平台,由人工智能物联网平台对该实时控制指令进行解析,使得解析后的实时控制指令能够对车辆的制动***进行控制。在对车辆进行一次远程移动之后,将再次通过图像采集模块获取车辆的当前位置信息,进而将车辆当前的位置信息与预设目标位置进行比对,判断车辆当前是否已处于该预设目标位置。若是判断到车辆当前仍旧未处于预设目标位置,将通过人工智能物联网平台和人工智能数字孪生云平台将车辆当前的位置信息进行处理得到对应的数字模型,并通过人 工智能数字孪生云平台将该数据模型发送至可穿戴式虚拟/现实交互设备进行显示,使得车主能够通过该可穿戴式虚拟/现实交互设备获取车辆当前的位置信息,进而基于车辆当前的位置信息再次对车辆进行移动,直至将车辆移动至预设目标位置。可穿戴式虚拟/现实交互设备包括:可穿戴式MR设备或者可穿戴式AR/VR设备,并且可将该可穿戴式MR设备或者可穿戴式AR/VR设备集成于眼镜或者墨镜中,使得车主能够随时通过可穿戴式MR设备或者可穿戴式AR/VR设备对车辆进行远程移动。In this embodiment, after the terminal device obtains the real-time control instruction triggered by the owner through the wearable virtual/reality interactive device, it sends the real-time control instruction to the artificial intelligence Internet of Things platform through wireless transmission, and the artificial intelligence object The networking platform analyzes the real-time control instruction, so that the analyzed real-time control instruction can control the braking system of the vehicle. After a remote movement of the vehicle, the current position information of the vehicle will be obtained again through the image acquisition module, and then the current position information of the vehicle will be compared with the preset target position to determine whether the vehicle is currently at the preset target position. If it is judged that the vehicle is still not at the preset target position, the current position information of the vehicle will be processed through the artificial intelligence IoT platform and the artificial intelligence digital twin cloud platform to obtain the corresponding digital model, and the human The artificial intelligence digital twin cloud platform sends the data model to the wearable virtual/reality interactive device for display, so that the owner can obtain the current location information of the vehicle through the wearable virtual/reality interactive device, and then based on the current location information of the vehicle Move the vehicle again until the vehicle is moved to the preset target position. Wearable virtual/reality interactive devices include: wearable MR devices or wearable AR/VR devices, and the wearable MR devices or wearable AR/VR devices can be integrated into glasses or sunglasses, so that car owners The vehicle can be remotely moved at any time through wearable MR devices or wearable AR/VR devices.
在本发明中,在可穿戴式MR设备或者可穿戴式AR/VR设备的可视化界面中将实时显示人工智能物联网平台所发送的车辆实时位置信息,使得车主根据车辆实时位置信息对车辆进行多次移动,直至将车辆移动到预设目标位置。因此,本发明基于车辆、智慧杆管理***、人工智能物联网平台、人工智能数字孪生云平台、以及可穿戴式虚拟/现实交互设备之间的信息交互实现了车辆的远程移动,提升了城市交通的运转效率,使得车主可进行紧急挪车操作或者寻车操作。In the present invention, the real-time location information of the vehicle sent by the artificial intelligence Internet of Things platform will be displayed in real-time on the visual interface of the wearable MR device or the wearable AR/VR device, so that the owner can monitor the vehicle according to the real-time location information of the vehicle. Move once until the vehicle is moved to the preset target position. Therefore, the present invention realizes the remote movement of the vehicle based on the information interaction between the vehicle, the smart pole management system, the artificial intelligence Internet of Things platform, the artificial intelligence digital twin cloud platform, and the wearable virtual/reality interactive device, and improves the urban traffic. The high operating efficiency enables car owners to perform emergency car moving operations or car search operations.
此外,本发明实施例还提出基于人工智能物联网平台用于自动驾驶的远程控制装置,参照图3,图3为本发明基于人工智能物联网平台用于自动驾驶的远程控制装置一实施例的功能模块示意图。如图3所示,本发明基于人工智能物联网平台用于自动驾驶的远程控制装置,包括:In addition, the embodiment of the present invention also proposes a remote control device for automatic driving based on an artificial intelligence Internet of Things platform. Referring to FIG. 3, FIG. Schematic diagram of functional modules. As shown in Figure 3, the present invention is based on the artificial intelligence Internet of Things platform for remote control devices for automatic driving, including:
建模模块10,用于获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;The modeling module 10 is used to obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin The cloud platform models the target vehicle information to obtain a corresponding digital model;
获取模块20,用于将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;An acquisition module 20, configured to send the digital model to the wearable virtual/reality interaction device for display, and obtain real-time control instructions through the wearable virtual/reality interaction device;
控制模块30,用于根据所述数字模型,通过所述实时控制指令对所述无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。The control module 30 is configured to control the unmanned vehicle through the real-time control instructions according to the digital model, so as to realize emergency maneuvering, road condition prediction, driving route planning and Find a parking space.
进一步地,本发明基于人工智能物联网平台用于自动驾驶的远程控制装置,还包括:Further, the present invention is based on the artificial intelligence Internet of Things platform for the remote control device for automatic driving, which also includes:
建立连接模块,用于建立所述可穿戴式虚拟/现实交互设备和所述人工智能物联网平台之间的连接,并基于所述可穿戴式虚拟/现实交互设备建立所述无人驾驶车辆与所述智慧杆管理***之间的连接。Establish a connection module, for establishing the connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of things platform, and establish the connection between the unmanned vehicle and the artificial intelligence based on the wearable virtual/reality interactive device The connection between the smart bar management systems.
进一步地,本发明基于人工智能物联网平台用于自动驾驶的远程控制装置,还包括: Further, the present invention is based on the artificial intelligence Internet of Things platform for the remote control device for automatic driving, which also includes:
实时采集模块,用于通过所述无人驾驶车辆中的采集模块对车辆参数和车辆所处环境进行实时采集生成所述车辆实时信息,并通过所述无人驾驶车辆中的车载无线网络模块将所述车辆实时信息发送至所述智慧杆管理***,其中,所述采集模块包括:激光雷达模块和/或图像采集模块。The real-time acquisition module is used to collect the vehicle parameters and the environment of the vehicle in real time through the acquisition module in the unmanned vehicle to generate the real-time information of the vehicle, and send The real-time information of the vehicle is sent to the smart pole management system, wherein the acquisition module includes: a laser radar module and/or an image acquisition module.
进一步地,所述控制模块30,包括Further, the control module 30 includes
远程控制单元,用于将所述实时控制指令发送至所述人工智能物联网平台,并通过所述人工智能物联网平台对所述实时控制指令进行解析,根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制。The remote control unit is configured to send the real-time control instruction to the artificial intelligence Internet of Things platform, and analyze the real-time control instruction through the artificial intelligence Internet of Things platform, and control the unmanned vehicle according to the analyzed real-time control instruction. Drive a vehicle with remote mobile control.
进一步地,本发明基于人工智能物联网平台用于自动驾驶的远程控制装置,还包括:Further, the present invention is based on the artificial intelligence Internet of Things platform for the remote control device for automatic driving, which also includes:
判断模块,用于获取移动后的无人驾驶车辆的位置信息,并根据所述位置信息判断所述无人驾驶车辆是否处于预设目标位置;A judging module, configured to acquire position information of the moved unmanned vehicle, and judge whether the unmanned vehicle is at a preset target position according to the position information;
发送模块,用于若否,则将所述位置信息发送至所述可穿戴式虚拟/现实交互设备,使得车主可基于所述位置信息对所述无人驾驶车辆再次进行远程移动控制,直至所述无人驾驶车辆到达所述预设目标位置。A sending module, configured to send the location information to the wearable virtual/reality interaction device if not, so that the owner can perform remote mobile control on the unmanned vehicle again based on the location information until the The unmanned vehicle arrives at the preset target position.
进一步地,所述获取模块20,包括视觉刺激单元,用于通过所述可穿戴式虚拟/现实交互设备中的诱发图案对车主进行视觉刺激得到实时控制指令。Further, the acquisition module 20 includes a visual stimulation unit, which is used to visually stimulate the vehicle owner through the induced patterns in the wearable virtual/reality interaction device to obtain real-time control instructions.
进一步地,所述可穿戴式虚拟/现实交互设备包括:可穿戴式MR设备或者可穿戴式AR/VR设备。Further, the wearable virtual/reality interaction device includes: a wearable MR device or a wearable AR/VR device.
本发明基于人工智能物联网平台用于自动驾驶的远程控制装置的各个功能模块的具体实施方式与上述基于人工智能物联网平台用于自动驾驶的远程控制方法各实施例基本相同,在此不做赘述。The specific implementation of each functional module of the remote control device for automatic driving based on the artificial intelligence Internet of Things platform of the present invention is basically the same as the above-mentioned embodiments of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform, and will not be described here. repeat.
此外,本发明实施例还提出一种计算机可读存储介质,所述计算机可读存储介质上存储有基于人工智能物联网平台用于自动驾驶的远程控制程序,所述基于人工智能物联网平台用于自动驾驶的远程控制程序被处理器执行时实现如上所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。In addition, the embodiment of the present invention also proposes a computer-readable storage medium, the computer-readable storage medium stores a remote control program based on the artificial intelligence Internet of Things platform for automatic driving, and the artificial intelligence-based Internet of Things platform uses When the remote control program of automatic driving is executed by the processor, the above-mentioned steps of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform are realized.
本发明基于人工智能物联网平台用于自动驾驶的远程控制***和计算机可读存储介质的各实施例,均可参照本发明基于人工智能物联网平台用于自动驾驶的远程控制方法各个实施例,此处不再赘述。 Various embodiments of the remote control system for automatic driving based on the artificial intelligence Internet of Things platform and the computer-readable storage medium of the present invention can refer to various embodiments of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform of the present invention, I won't repeat them here.
此外,本发明实施例还提供一种计算机程序产品,所述计算机程序产品包括计算机程序,所述计算机程序被处理器执行时实现如以上基于人工智能物联网平台用于自动驾驶的远程控制方法的任一项实施例所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。In addition, an embodiment of the present invention also provides a computer program product, the computer program product includes a computer program, and when the computer program is executed by a processor, the remote control method for automatic driving based on the artificial intelligence Internet of Things platform is implemented. The steps of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform described in any one of the embodiments.
本发明计算机程序产品的具体实施例与上述基于人工智能物联网平台用于自动驾驶的远程控制方法的各实施例基本相同,在此不作赘述。The specific embodiments of the computer program product of the present invention are basically the same as the above-mentioned embodiments of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform, and will not be repeated here.
需要说明的是,在本文中,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。It should be noted that, in this document, the term "comprising", "comprising" or any other variation thereof is intended to cover a non-exclusive inclusion such that a process, method, article or apparatus comprising a set of elements includes not only those elements, It also includes other elements not expressly listed, or elements inherent in the process, method, article, or device. Without further limitations, an element defined by the phrase "comprising a ..." does not preclude the presence of additional identical elements in the process, method, article, or apparatus comprising that element.
上述本发明实施例序号仅仅为了描述,不代表实施例的优劣。The serial numbers of the above embodiments of the present invention are for description only, and do not represent the advantages and disadvantages of the embodiments.
通过以上的实施方式的描述,本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中,包括若干指令用以使得一台终端设备(可以是智能手机、个人计算机和服务器等)执行本发明各个实施例所述的方法。Through the description of the above embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus a necessary general-purpose hardware platform, and of course also by hardware, but in many cases the former is better implementation. Based on such an understanding, the essence of the technical solution of the present invention or the part that contributes to the prior art can be embodied in the form of software products, and the computer software products are stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk, etc.) ) includes several instructions to enable a terminal device (which may be a smart phone, a personal computer, a server, etc.) to execute the methods described in various embodiments of the present invention.
以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。 The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process conversion made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (10)

  1. 基于人工智能物联网平台用于自动驾驶的远程控制方法,所述远程控制方法应用于远程控制***,所述远程控制***包括:人工智能物联网平台、人工智能数字孪生云平台、可穿戴式虚拟/现实交互设备和智慧杆管理***;A remote control method for automatic driving based on an artificial intelligence Internet of Things platform, the remote control method is applied to a remote control system, and the remote control system includes: an artificial intelligence Internet of Things platform, an artificial intelligence digital twin cloud platform, a wearable virtual /Reality interactive equipment and smart rod management system;
    所述基于人工智能物联网平台用于自动驾驶的远程控制方法包括以下步骤:The remote control method for automatic driving based on the artificial intelligence Internet of Things platform includes the following steps:
    获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;Obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud platform The information is modeled to obtain the corresponding digital model;
    将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;Sending the digital model to the wearable virtual/reality interactive device for display, and obtaining real-time control instructions through the wearable virtual/reality interactive device;
    根据所述数字模型,通过所述实时控制指令对无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。According to the digital model, the unmanned vehicle is controlled through the real-time control instructions, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
  2. 如权利要求1所述的基于人工智能物联网平台用于自动驾驶的远程控制方法,其特征在于,在所述获取所述智慧杆管理***检测的车辆实时信息的步骤之前,还包括:The remote control method for automatic driving based on the artificial intelligence Internet of Things platform according to claim 1, wherein, before the step of obtaining the real-time vehicle information detected by the smart bar management system, it also includes:
    建立所述可穿戴式虚拟/现实交互设备和所述人工智能物联网平台之间的连接,并基于所述可穿戴式虚拟/现实交互设备建立所述无人驾驶车辆与所述智慧杆管理***之间的连接。Establishing the connection between the wearable virtual/reality interactive device and the artificial intelligence Internet of Things platform, and establishing the unmanned vehicle and the smart bar management system based on the wearable virtual/reality interactive device the connection between.
  3. 如权利要求1所述的基于人工智能物联网平台用于自动驾驶的远程控制方法,其特征在于,在所述获取通过所述智慧杆管理***发送的车辆实时信息的步骤之前,还包括:The remote control method for automatic driving based on the artificial intelligence Internet of Things platform according to claim 1, wherein, before the step of obtaining real-time vehicle information sent by the smart bar management system, it also includes:
    通过所述无人驾驶车辆中的采集模块对车辆参数和车辆所处环境进行实时采集生成所述车辆实时信息,并通过所述无人驾驶车辆中的车载无线网络模块将所述车辆实时信息发送至所述智慧杆管理***,其中,所述采集模块包括:激光雷达模块和/或图像采集模块。Real-time acquisition of vehicle parameters and the environment where the vehicle is located by the acquisition module in the unmanned vehicle generates the real-time information of the vehicle, and sends the real-time information of the vehicle through the vehicle-mounted wireless network module in the unmanned vehicle As for the smart pole management system, wherein the acquisition module includes: a laser radar module and/or an image acquisition module.
  4. 如权利要求1所述的基于人工智能物联网平台用于自动驾驶的远程控制方法,其特征在于,所述通过所述实时控制指令对所述无人驾驶车辆进行控制的步骤,包括:The remote control method for automatic driving based on the artificial intelligence Internet of Things platform according to claim 1, wherein the step of controlling the unmanned vehicle through the real-time control instruction includes:
    将所述实时控制指令发送至所述人工智能物联网平台,并通过所述人工智能物联网平台对所述实时控制指令进行解析,根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制。Send the real-time control instruction to the artificial intelligence Internet of Things platform, and analyze the real-time control instruction through the artificial intelligence Internet of Things platform, and perform remote mobile control on the unmanned vehicle according to the analyzed real-time control instruction .
  5. 如权利要求4所述的基于人工智能物联网平台用于自动驾驶的远程控制方法,其特征在于,在所述根据解析后的实时控制指令对无人驾驶车辆进行远程移动控制的步骤之后,还包括:The remote control method for automatic driving based on the artificial intelligence Internet of Things platform according to claim 4, wherein, after the step of performing remote mobile control on the unmanned vehicle according to the real-time control instruction after the analysis, further include:
    获取移动后的无人驾驶车辆的位置信息,并根据所述位置信息判断所述无人驾驶车辆是否处于预设目标位置;Acquiring the position information of the unmanned vehicle after moving, and judging whether the unmanned vehicle is at a preset target position according to the position information;
    若否,则将所述位置信息发送至所述可穿戴式虚拟/现实交互设备,使得车主可基于所述位 置信息对所述无人驾驶车辆再次进行远程移动控制,直至所述无人驾驶车辆到达所述预设目标位置。If not, then send the location information to the wearable virtual/reality interaction device, so that the owner can The remote mobile control of the unmanned vehicle is carried out again according to the setting information until the unmanned vehicle reaches the preset target position.
  6. 如权利要求1所述的基于人工智能物联网平台用于自动驾驶的远程控制方法,其特征在于,所述通过所述可穿戴式虚拟/现实交互设备获取实时控制指令的步骤,包括:The remote control method for automatic driving based on the artificial intelligence Internet of Things platform according to claim 1, wherein the step of obtaining real-time control instructions through the wearable virtual/reality interactive device includes:
    通过所述可穿戴式虚拟/现实交互设备中的诱发图案对车主进行视觉刺激得到实时控制指令。Real-time control instructions are obtained by visually stimulating the vehicle owner through the evoked pattern in the wearable virtual/reality interactive device.
  7. 如权利要求1所述的基于人工智能物联网平台用于自动驾驶的远程控制方法,其特征在于,所述可穿戴式虚拟/现实交互设备包括:可穿戴式MR设备或者可穿戴式AR/VR设备。The remote control method for automatic driving based on the artificial intelligence Internet of Things platform according to claim 1, wherein the wearable virtual/reality interactive device comprises: wearable MR equipment or wearable AR/VR equipment.
  8. 基于人工智能物联网平台用于自动驾驶的远程控制装置,其特征在于,所述远程控制装置应用于远程控制***,所述远程控制***包括:人工智能物联网平台、人工智能数字孪生云平台、可穿戴式虚拟/现实交互设备和智慧杆管理***;The remote control device for automatic driving based on the artificial intelligence Internet of Things platform is characterized in that the remote control device is applied to a remote control system, and the remote control system includes: an artificial intelligence Internet of Things platform, an artificial intelligence digital twin cloud platform, Wearable virtual/reality interactive equipment and smart rod management system;
    所述远程控制装置包括:The remote control device includes:
    建模模块,用于获取所述智慧杆管理***检测的车辆实时信息,通过所述人工智能物联网平台对所述车辆实时信息进行预处理得到目标车辆信息,并通过所述人工智能数字孪生云平台对所述目标车辆信息进行建模得到对应的数字模型;The modeling module is used to obtain the real-time information of the vehicle detected by the smart rod management system, preprocess the real-time information of the vehicle through the artificial intelligence Internet of Things platform to obtain target vehicle information, and obtain the target vehicle information through the artificial intelligence digital twin cloud The platform models the target vehicle information to obtain a corresponding digital model;
    获取模块,用于将所述数字模型发送至所述可穿戴式虚拟/现实交互设备进行显示,并通过所述可穿戴式虚拟/现实交互设备获取实时控制指令;An acquisition module, configured to send the digital model to the wearable virtual/reality interactive device for display, and obtain real-time control instructions through the wearable virtual/reality interactive device;
    控制模块,用于根据所述数字模型,通过所述实时控制指令对无人驾驶车辆进行控制,以实现对所述无人驾驶车辆的紧急挪车、路况预判、行车路线规划和车位寻找。The control module is configured to control the unmanned vehicle through the real-time control instructions according to the digital model, so as to realize emergency maneuvering, road condition prediction, driving route planning and parking space search for the unmanned vehicle.
  9. 一种终端设备,其特征在于,所述终端设备包括存储器、处理器和存储在所述存储器上并可在所述处理器上运行的基于人工智能物联网平台用于自动驾驶的远程控制程序,所述基于人工智能物联网平台用于自动驾驶的远程控制程序被所述处理器执行时实现如权利要求1至7中任一项所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。A terminal device, characterized in that the terminal device includes a memory, a processor, and a remote control program for automatic driving based on an artificial intelligence Internet of Things platform that is stored on the memory and can run on the processor, When the remote control program based on the artificial intelligence Internet of Things platform for automatic driving is executed by the processor, the remote control for automatic driving based on the artificial intelligence Internet of Things platform as described in any one of claims 1 to 7 is realized. method steps.
  10. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质上存储有基于人工智能物联网平台用于自动驾驶的远程控制程序,所述基于人工智能物联网平台用于自动驾驶的远程控制程序被处理器执行时实现如权利要求1至7中任一项所述的基于人工智能物联网平台用于自动驾驶的远程控制方法的步骤。 A computer-readable storage medium, characterized in that, the computer-readable storage medium is stored with a remote control program based on the artificial intelligence Internet of Things platform for automatic driving, and the remote control program based on the artificial intelligence Internet of Things platform for automatic driving When the remote control program is executed by the processor, the steps of the remote control method for automatic driving based on the artificial intelligence Internet of Things platform as described in any one of claims 1 to 7 are realized.
PCT/CN2023/074475 2022-02-10 2023-02-03 Artificial intelligence internet of things platform-based remote control method for automatic driving WO2023151522A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210123280.X 2022-02-10
CN202210123280.XA CN114153220B (en) 2022-02-10 2022-02-10 Remote control method for automatic driving based on artificial intelligence Internet of things platform

Publications (1)

Publication Number Publication Date
WO2023151522A1 true WO2023151522A1 (en) 2023-08-17

Family

ID=80450130

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/074475 WO2023151522A1 (en) 2022-02-10 2023-02-03 Artificial intelligence internet of things platform-based remote control method for automatic driving

Country Status (2)

Country Link
CN (1) CN114153220B (en)
WO (1) WO2023151522A1 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114153220B (en) * 2022-02-10 2022-06-14 深圳市爱云信息科技有限公司 Remote control method for automatic driving based on artificial intelligence Internet of things platform
CN114445563A (en) * 2022-03-15 2022-05-06 深圳市爱云信息科技有限公司 3D holographic image interaction method, device, system and medium
CN114715197B (en) * 2022-06-10 2022-08-30 深圳市爱云信息科技有限公司 Automatic driving safety method and system based on digital twin DaaS platform
CN114968162B (en) * 2022-06-20 2023-08-01 阿维塔科技(重庆)有限公司 Information display method and device for vehicle-mounted food
CN117354347B (en) * 2023-12-05 2024-02-20 广东申创光电科技有限公司 Vehicle-road cooperative control method and device for multifunctional intelligent lamp post of Internet of things

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106394545A (en) * 2016-10-09 2017-02-15 北京汽车集团有限公司 Driving system, unmanned vehicle and vehicle remote control terminal
CN108944916A (en) * 2018-07-24 2018-12-07 上海擎感智能科技有限公司 Vehicle, remotely controls method and system of parking at vehicle device equipment
US20190382003A1 (en) * 2018-06-13 2019-12-19 Toyota Jidosha Kabushiki Kaisha Collision avoidance for a connected vehicle based on a digital behavioral twin
CN110874945A (en) * 2018-08-31 2020-03-10 百度在线网络技术(北京)有限公司 Roadside sensing system based on vehicle-road cooperation and vehicle control method thereof
CN111741254A (en) * 2020-05-13 2020-10-02 苏州锦添科技产业发展有限公司 Visual digital twin high-end equipment system based on unmanned aerial vehicle information terminal
CN112581633A (en) * 2020-12-24 2021-03-30 北京亮道智能汽车技术有限公司 In-loop virtual simulation test method and system for vehicle with automatic driving function
CN113050455A (en) * 2021-03-27 2021-06-29 上海智能新能源汽车科创功能平台有限公司 Digital twin test system for intelligent networked automobile and control method
US20210272394A1 (en) * 2018-09-30 2021-09-02 Strong Force Intellectual Capital, Llc Intelligent transportation systems including digital twin interface for a passenger vehicle
CN113642242A (en) * 2021-08-17 2021-11-12 上海电气集团智能交通科技有限公司 Intelligent bus traffic simulation platform based on digital twins
CN114153220A (en) * 2022-02-10 2022-03-08 深圳市爱云信息科技有限公司 Remote control method for automatic driving based on artificial intelligence Internet of things platform

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11392117B2 (en) * 2016-02-18 2022-07-19 Sony Corporation Method and device for managing interaction between a wearable device and a vehicle
US20190236847A1 (en) * 2018-01-31 2019-08-01 Red Crater Global Limited Method and system for aligning digital display of images on augmented reality glasses with physical surrounds
US20200104289A1 (en) * 2018-09-27 2020-04-02 Aptiv Technologies Limited Sharing classified objects perceived by autonomous vehicles
CN110907966A (en) * 2019-11-22 2020-03-24 东华理工大学 Emergency vehicle navigation system and method based on real-time traffic flow in time of Internet of things
US11758636B2 (en) * 2020-03-30 2023-09-12 Ubicquia, Inc. Celestial scheduling of a smart streetlight controller
JP2023524250A (en) * 2020-04-28 2023-06-09 ストロング フォース ティーピー ポートフォリオ 2022,エルエルシー Digital twin systems and methods for transportation systems
CN113009931B (en) * 2021-03-08 2022-11-08 北京邮电大学 Man-machine and unmanned-machine mixed formation cooperative control device and method
CN113485392B (en) * 2021-06-17 2022-04-08 广东工业大学 Virtual reality interaction method based on digital twins
CN114024997B (en) * 2022-01-06 2022-04-01 深圳市爱云信息科技有限公司 Intelligent equipment based on automatic driving and AIOT Internet of things platform method

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106394545A (en) * 2016-10-09 2017-02-15 北京汽车集团有限公司 Driving system, unmanned vehicle and vehicle remote control terminal
US20190382003A1 (en) * 2018-06-13 2019-12-19 Toyota Jidosha Kabushiki Kaisha Collision avoidance for a connected vehicle based on a digital behavioral twin
CN108944916A (en) * 2018-07-24 2018-12-07 上海擎感智能科技有限公司 Vehicle, remotely controls method and system of parking at vehicle device equipment
CN110874945A (en) * 2018-08-31 2020-03-10 百度在线网络技术(北京)有限公司 Roadside sensing system based on vehicle-road cooperation and vehicle control method thereof
US20210272394A1 (en) * 2018-09-30 2021-09-02 Strong Force Intellectual Capital, Llc Intelligent transportation systems including digital twin interface for a passenger vehicle
CN111741254A (en) * 2020-05-13 2020-10-02 苏州锦添科技产业发展有限公司 Visual digital twin high-end equipment system based on unmanned aerial vehicle information terminal
CN112581633A (en) * 2020-12-24 2021-03-30 北京亮道智能汽车技术有限公司 In-loop virtual simulation test method and system for vehicle with automatic driving function
CN113050455A (en) * 2021-03-27 2021-06-29 上海智能新能源汽车科创功能平台有限公司 Digital twin test system for intelligent networked automobile and control method
CN113642242A (en) * 2021-08-17 2021-11-12 上海电气集团智能交通科技有限公司 Intelligent bus traffic simulation platform based on digital twins
CN114153220A (en) * 2022-02-10 2022-03-08 深圳市爱云信息科技有限公司 Remote control method for automatic driving based on artificial intelligence Internet of things platform

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
LIU QI, HONG GAOFENG, QIU JIAHUI, SU WEI, WEN QILI: "Research on the System Architecture and Key Technologies in 5G-Based Vehicular Networks", MOBILE COMMUNICATIONS, YIDONG TONGXIN ZAZHISHE, CN, vol. 43, no. 11, 1 January 2019 (2019-01-01), CN , pages 57 - 64, XP093083883, ISSN: 1006-1010, DOI: 10.3969/j.issn.1006-1010.2019.11.010 *

Also Published As

Publication number Publication date
CN114153220B (en) 2022-06-14
CN114153220A (en) 2022-03-08

Similar Documents

Publication Publication Date Title
WO2023151522A1 (en) Artificial intelligence internet of things platform-based remote control method for automatic driving
CN109067925B (en) Remote control parking method and system
CN107274695B (en) Intelligent lighting system, intelligent vehicle and vehicle driving assisting system and method thereof
CN109387211A (en) The system and method for using barrier when V2X communication system to perceive for improving
US20210191398A1 (en) System and Methods for Automated Detection of Vehicle Cabin Events for Triggering Remote Operator Assistance
JP7420734B2 (en) Data distribution systems, sensor devices and servers
CN113479195A (en) Method for automatic valet parking and system for carrying out said method
CA3199370A1 (en) Systems and methods for video object segmentation
CN112230656A (en) Automatic driving method for park vehicle, system, client and storage medium thereof
CN106846898A (en) The vehicles park assisted method, robot and system
CN109785654A (en) Vehicle guidance based on locational space model
CN111516690B (en) Control method and device of intelligent automobile and storage medium
CN114550489A (en) Vehicle searching information processing method, system and related device
CN114613193A (en) Calculation force sharing-based parking space acquisition method, storage medium, system and vehicle
CN114179829A (en) Multi-end cooperative vehicle driving method, device, system and medium
CN114882464B (en) Multi-task model training method, multi-task processing method, device and vehicle
CN107395757A (en) Based on ACP methods car networking system parallel with social physical message system
CN114640673A (en) Large vehicle management system based on edge cloud cooperation
CN114554391A (en) Parking lot vehicle searching method, device, equipment and storage medium
JP7210394B2 (en) INFORMATION PROVIDING DEVICE, INFORMATION PROVIDING METHOD AND PROGRAM
CN115164910B (en) Travel route generation method, travel route generation device, vehicle, storage medium, and chip
CN114937351B (en) Motorcade control method and device, storage medium, chip, electronic equipment and vehicle
WO2022143181A1 (en) Information processing method and apparatus, and information processing system
CN112859109B (en) Unmanned aerial vehicle panoramic image processing method and device and electronic equipment
US11700357B2 (en) Connected camera system for vehicles

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23752302

Country of ref document: EP

Kind code of ref document: A1