WO2020260494A1 - System for realizing in-vehicle infotainment function - Google Patents

System for realizing in-vehicle infotainment function Download PDF

Info

Publication number
WO2020260494A1
WO2020260494A1 PCT/EP2020/067893 EP2020067893W WO2020260494A1 WO 2020260494 A1 WO2020260494 A1 WO 2020260494A1 EP 2020067893 W EP2020067893 W EP 2020067893W WO 2020260494 A1 WO2020260494 A1 WO 2020260494A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
onboard computer
computer device
onboard
data stream
Prior art date
Application number
PCT/EP2020/067893
Other languages
French (fr)
Inventor
Songyuan HAN
Kun Li
Tingting Hu
Jun Yang
Original Assignee
Continental Automotive Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Continental Automotive Gmbh filed Critical Continental Automotive Gmbh
Publication of WO2020260494A1 publication Critical patent/WO2020260494A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/40Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass for recovering from a failure of a protocol instance or entity, e.g. service redundancy protocols, protocol state redundancy or protocol service redirection
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B31/00Arrangements for the associated working of recording or reproducing apparatus with related apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L45/00Routing or path finding of packets in data switching networks
    • H04L45/28Routing or path finding of packets in data switching networks using route fault recovery
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/08Protocols specially adapted for terminal emulation, e.g. Telnet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/10Protocols in which an application is distributed across nodes in the network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/30Services specially adapted for particular environments, situations or purposes
    • H04W4/40Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P]
    • H04W4/48Services specially adapted for particular environments, situations or purposes for vehicles, e.g. vehicle-to-pedestrians [V2P] for in-vehicle communication
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W40/00Communication routing or communication path finding
    • H04W40/02Communication route or path selection, e.g. power-based or shortest path routing
    • H04W40/12Communication route or path selection, e.g. power-based or shortest path routing based on transmission quality or channel quality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/024Guidance services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication

Definitions

  • the present invention relates to the field of motor vehicles, in particular to a system for realizing an in-vehicle infotainment function.
  • an onboard computer performs data processing on user-inputted data and data from onboard equipment such as an onboard GPS (Global Positioning System) device, radar, sensors, cameras or a CAN (Controller Area Network) , in order to generate an HMI (Human Machine Interface) video data stream and/or audio data stream, and sends the HMI video data stream and/or audio data stream to an HMI (e.g. a touch screen, speaker or other onboard device) , thereby realizing a corresponding in-car infotainment function, such as voice and video play, wireless communication, navigation, parking assistance and other functions.
  • GPS Global Positioning System
  • sensors sensors
  • a CAN Controller Area Network
  • the starting point of the present invention is the provision of a system for realizing an in-vehicle infotainment function and an onboard computer device, thereby solving the abovementioned problem in the prior art.
  • An embodiment of the present invention discloses a system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a cloud device;
  • the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, sends the acquired data to the cloud device, and realizes the in-vehicle infotainment function according to a data stream coming from the cloud device and directly presentable by an onboard human-machine interactive device ;
  • the cloud device performs data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device;
  • the system further comprises a mobile terminal device, which is in communicative connection with the onboard computer device in a wireless or wired manner and in communicative connection with the cloud device via a 5G network; if a fault occurs in 5G network communication between the onboard computer device and the cloud device, the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device.
  • the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data on the basis of an infotainment-function-related request from a user.
  • the data stream directly presentable by the onboard human-machine interactive device is an HMI video data stream and/or audio data stream.
  • the onboard computer device comprises a baseband module, a vehicle control module, an entertainment system module, and an interface for performing data exchange.
  • the cloud device generates a data stream capable of realizing radio, telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management functions.
  • An embodiment of the present invention further discloses a system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a mobile terminal device, the mobile terminal device being in communicative connection with the onboard computer device in a wireless or wired manner;
  • the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, the onboard computer device sends the acquired data to the mobile terminal device, and realizes the in-vehicle infotainment function according to a data stream coming from the mobile terminal device and directly presentable by an onboard human-machine interactive device;
  • the mobile terminal device performs emergency or limited-function data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device.
  • the data stream directly presentable by the onboard human-machine interactive device is an HMI video data stream and/or audio data stream.
  • the onboard computer device comprises a baseband module, a vehicle control module, an entertainment system module, and an interface for performing data exchange.
  • the mobile terminal device performs emergency or limited-function data processing and thereby obtains a data stream capable of realizing audio/video stream processing, parking assistance, navigation and voice recognition functions.
  • the mobile terminal device is in communicative connection with the onboard computer device by BLE , WIFI or USB.
  • the onboard computer device tests communication quality of a 5G network between itself and a cloud device; if it detects that a fault has occurred in the 5G network, the onboard computer device performs data exchange with the mobile terminal device to realize the in-vehicle infotainment function.
  • the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data on the basis of an infotainment-function-related request from a user.
  • the system for realizing an in-vehicle infotainment function in an embodiment of the present invention at least has the following advantages:
  • data processing work which is currently performed by the onboard computer device is transferred to the cloud device, thereby reducing the software and hardware expenses of the onboard computer device, lowering the cost of the onboard computer device and shortening the research and development cycle.
  • data processing is performed by means of the mobile terminal device to realize a travelling-safety-related in-vehicle infotainment function, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device.
  • the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device .
  • FIG. 1 shows a system for realizing an in-vehicle infotainment function according to a particular embodiment of the present invention.
  • FIG. 2 shows a system for realizing an in-vehicle infotainment function according to another particular embodiment of the present invention.
  • FIGs. 3A and 3B show application scenarios in which the system is used to realize a navigation function in the prior art and the present invention respectively.
  • onboard computer device 100 baseband chip: 110
  • the system provided in the present invention for realizing an in-vehicle infotainment function comprises an onboard computer device and a cloud device.
  • the onboard computer device can acquire vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, send the acquired data to the cloud device, and realize the in-vehicle infotainment function according to a data stream coming from the cloud device and directly presentable by an onboard human-machine interactive device.
  • the user of the vehicle can input an infotainment-function-related request via an HMI (e.g.
  • the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data.
  • the data stream directly presentable by the onboard human-machine interactive device may for example be an HMI video data stream and/or audio data stream.
  • the cloud device performs data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device. Data transmission between the onboard computer device and the cloud device is carried out by means of a 5G network .
  • the system provided in the present invention for realizing an in-vehicle infotainment function may further comprise a mobile terminal device.
  • the mobile terminal device can serve as a temporary standby solution when a fault occurs in the 5G network between the onboard computer device and the cloud device.
  • either one of the following two standby solutions may be used:
  • the mobile terminal device is in communicative connection with the onboard computer device in a wireless or wired manner (e.g. by BLE (Bluetooth Low Energy) , WIFI or USB) , and the onboard computer device can test the communication quality of the 5G network between itself and the cloud device; if it detects that a fault has occurred in 5G network communication between the onboard computer device and the cloud device, the onboard computer device sends the vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data to the mobile terminal device; by means of the mobile terminal device, emergency or limited-function data processing is performed on the data from the onboard computer device, so as to obtain the data stream directly presentable by the onboard human-machine interactive device, and the obtained data stream is sent to the onboard computer device.
  • BLE Bluetooth Low Energy
  • WIFI Wireless Fidelity
  • the onboard computer device realizes an associated in-vehicle infotainment function according to the data stream coming from the mobile terminal device and directly presentable by the onboard human-machine interactive device. Specifically, the mobile terminal device generates a data stream capable of realizing audio/video stream processing, parking assistance , navigation and voice recognition functions .
  • the mobile terminal device is in communicative connection with the onboard computer device in a wireless or wired manner and in communicative connection with the cloud device via a 5G network; if a fault occurs in 5G network communication between the onboard computer device and the cloud device, the mobile terminal device serves as a router to realize data transmission between the onboard computer device and the cloud device.
  • FIG. 1 shows a system for realizing an in-vehicle infotainment function according to a particular embodiment of the present invention.
  • the system comprises an onboard computer device and a cloud device.
  • the cloud device performs almost all of the data processing work to generate a data stream directly presentable by an onboard human-machine interactive device, to realize an in-vehicle infotainment function. Specifically, as shown in fig. 1, the cloud device generates a data stream capable of realizing radio , telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management functions.
  • FIG. 2 shows a system for realizing an in-vehicle infotainment function according to another particular embodiment of the present invention.
  • the system comprises an onboard computer device, a cloud device and a mobile terminal device.
  • the onboard computer device has a baseband module, a vehicle control module and an entertainment system module, and also has an interface for performing data exchange, e.g. an interface for performing data exchange with a speaker, display, camera, USB, Ethernet and CAN bus.
  • the baseband module provides network connection processing.
  • the vehicle control module provides power supply management of the entire onboard computer device.
  • the entertainment system module comprises a switched virtual circuit (Svc) , a component (Infra) and an operating system (OS) .
  • the switched virtual circuit (Svc) can realize the following functions: data acquisition, sending/receiving data, audio/video presentation and processing priority determination.
  • the component can realize the following functions : TCP/IP (can be used to test the communication quality of the 5G network to determine whether a communication fault exists) , compression, encryption/decryption and caching data and response.
  • the operating system supports functions such as SPI , I2C, I2S, UART , SDE and PMIC.
  • the cloud device comprises a display layer, an intermediate layer and a system component layer.
  • the cloud device generates a data stream to realize in-vehicle infotainment functions such as radio, telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management.
  • the mobile terminal device has an emergency processing APP, to provide audio/video stream processing, navigation, parking assistance and voice recognition functions.
  • FIGs. 3A and 3B show application scenarios in which the system is used to realize a navigation function in the prior art and the present invention respectively.
  • an onboard computer device is responsible for receiving a GPS signal , parsing the GPS signal, correcting the GPS signal, storing a map, loading the map, displaying the map, sending a route calculation request to a cloud device, receiving route information sent by the cloud device and displaying broadcast navigation information via an onboard human-machine interactive device.
  • the cloud device is only responsible for calculating a navigation route.
  • the onboard computer device is responsible for a large number of data processing tasks; the route information fed back by the cloud device cannot be presented by the onboard human-machine interactive device directly.
  • the onboard computer device is only responsible for receiving and sending GPS signals, sending screen click coordinates, and displaying video and playing audio.
  • the cloud device is responsible for parsing a GPS signal, correcting the GPS signal, parsing a user request, storing a map, loading the map, calculating a route, generating an HMI video stream and generating a navigation broadcast audio stream.
  • the cloud device is responsible for almost all of the data processing work; the HMI video stream and navigation broadcast audio stream fed back by the cloud device can be presented directly by the onboard human-machine interactive device .
  • data processing work which is currently performed by the onboard computer device is transferred to the cloud device, thereby reducing the software and hardware expenses of the onboard computer device, lowering the cost of the onboard computer device and shortening the research and development cycle.
  • data processing is performed by means of the mobile terminal device to realize a travelling-safety-related in-vehicle infotainment function, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device.
  • the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device .

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • Multimedia (AREA)
  • Computer Security & Cryptography (AREA)
  • Navigation (AREA)

Abstract

Disclosed in the present invention is a system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a cloud device; the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data, sends the acquired data to the cloud device, and realizes the in-vehicle infotainment function according to a data stream coming from the cloud device and directly presentable by an onboard human-machine interactive device; the cloud device performs data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device; data transmission between the onboard computer device and the cloud device is carried out by means of a 5G network. In the present invention, data processing work which is currently performed by the onboard computer device is transferred to the cloud device, thereby reducing the software and hardware expenses of the onboard computer device.

Description

Description
System for realizing in-vehicle infotainment function
Technical Field
[0001] The present invention relates to the field of motor vehicles, in particular to a system for realizing an in-vehicle infotainment function.
Background Art
[0002] At present, more and more vehicles are equipped with systems which provide various in-vehicle infotainment functions . In the course of travel, an onboard computer performs data processing on user-inputted data and data from onboard equipment such as an onboard GPS (Global Positioning System) device, radar, sensors, cameras or a CAN (Controller Area Network) , in order to generate an HMI (Human Machine Interface) video data stream and/or audio data stream, and sends the HMI video data stream and/or audio data stream to an HMI (e.g. a touch screen, speaker or other onboard device) , thereby realizing a corresponding in-car infotainment function, such as voice and video play, wireless communication, navigation, parking assistance and other functions.
[0003] However, as in-vehicle infotainment functions expand, the performance of onboard computers needs to be continually optimized in order to meet demands, and as a result, onboard computer software and hardware expenses are getting higher and higher; consequently, the cost of onboard computers is steadily increasing and the research and development cycle is excessively long .
Summary of the Invention
[0004] The starting point of the present invention is the provision of a system for realizing an in-vehicle infotainment function and an onboard computer device, thereby solving the abovementioned problem in the prior art.
[0005] An embodiment of the present invention discloses a system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a cloud device;
[0006] the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, sends the acquired data to the cloud device, and realizes the in-vehicle infotainment function according to a data stream coming from the cloud device and directly presentable by an onboard human-machine interactive device ;
[0007] the cloud device performs data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device;
[0008] data transmission between the onboard computer device and the cloud device is carried out by means of a 5G network.
[0009] Optionally, the system further comprises a mobile terminal device, which is in communicative connection with the onboard computer device in a wireless or wired manner and in communicative connection with the cloud device via a 5G network; if a fault occurs in 5G network communication between the onboard computer device and the cloud device, the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device.
[00010] Optionally, the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data on the basis of an infotainment-function-related request from a user. [00011] Optionally, the data stream directly presentable by the onboard human-machine interactive device is an HMI video data stream and/or audio data stream.
[00012] Optionally, the onboard computer device comprises a baseband module, a vehicle control module, an entertainment system module, and an interface for performing data exchange.
[00013] Optionally, the cloud device generates a data stream capable of realizing radio, telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management functions.
[00014] An embodiment of the present invention further discloses a system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a mobile terminal device, the mobile terminal device being in communicative connection with the onboard computer device in a wireless or wired manner;
[00015] the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, the onboard computer device sends the acquired data to the mobile terminal device, and realizes the in-vehicle infotainment function according to a data stream coming from the mobile terminal device and directly presentable by an onboard human-machine interactive device;
[00016] the mobile terminal device performs emergency or limited-function data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device.
[00017] Optionally, the data stream directly presentable by the onboard human-machine interactive device is an HMI video data stream and/or audio data stream. [00018] Optionally, the onboard computer device comprises a baseband module, a vehicle control module, an entertainment system module, and an interface for performing data exchange.
[00019] Optionally, the mobile terminal device performs emergency or limited-function data processing and thereby obtains a data stream capable of realizing audio/video stream processing, parking assistance, navigation and voice recognition functions.
[00020] Optionally, the mobile terminal device is in communicative connection with the onboard computer device by BLE , WIFI or USB.
[00021] Optionally, the onboard computer device tests communication quality of a 5G network between itself and a cloud device; if it detects that a fault has occurred in the 5G network, the onboard computer device performs data exchange with the mobile terminal device to realize the in-vehicle infotainment function.
[00022] Optionally, the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data on the basis of an infotainment-function-related request from a user.
[00023] The system for realizing an in-vehicle infotainment function in an embodiment of the present invention at least has the following advantages:
[00024] In the present invention, data processing work which is currently performed by the onboard computer device is transferred to the cloud device, thereby reducing the software and hardware expenses of the onboard computer device, lowering the cost of the onboard computer device and shortening the research and development cycle.
[00025] In the present invention, due to the high transmission bandwidth and low delay of the 5G network, the process of data transmission between the onboard computer device and the cloud device will not affect the implementation of the in-vehicle infotainment function. [00026] In the present invention, data processing is performed by means of the mobile terminal device to realize a travelling-safety-related in-vehicle infotainment function, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device.
[00027] In the present invention, the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device .
Brief Description of the Drawings
[00028] Fig. 1 shows a system for realizing an in-vehicle infotainment function according to a particular embodiment of the present invention.
[00029] Fig. 2 shows a system for realizing an in-vehicle infotainment function according to another particular embodiment of the present invention.
[00030] Figs. 3A and 3B show application scenarios in which the system is used to realize a navigation function in the prior art and the present invention respectively.
[00031] In the figures, reference numerals are used for below elements :
onboard computer device: 10
presentation layer: 11
transmission layer: 12
operating system layer: 13
driver layer : 14
cloud device : 20
radio : 21
multimedia : 22
reversing camera: 23 Bluetooth/Wi-Fi protocal stack: 24 voice recognition : 25
sound management : 26
navigation engine/guidance : 27 parking assistance : 28
HMI : 29
onboard computer device: 100 baseband chip: 110
vehicle control chip: 120
entertainment system chip: 130 SVc: 131
acquisition : 1311
sending/receiving: 1312
presentation : 1313
processing priority: 1314
Infra: 132
TCP/IP: 1321
encryption/decryption : 1322 compression : 1323
cache: 1324
OS: 133
SPI : 1331
I2C: 1332
I2S: 1333
UART: 1334
SDE : 1335
PMIC: 1336
cloud device : 200
radio: 2101
multimedia : 2102
Bluetooth : 2103
Wi-Fi :2104
voice recognition : 2105
navigation : 2106 parking assistance : 2107
reversing camera: 2108
sound: 2109
telephone : 2110
ADAS: 2111
network connection : 2112
Intermediate layer: 220
Radio: 2201
Multimedia: 2202
Bluetooth : 2203
Wi-Fi :2204
voice recognition : 2205
navigation : 2206
parking assistance : 2207
reversing camera: 2208
sound: 2209
telephone : 2210
ADAS: 2211
network connection : 2212
system component layer: 230
mobile terminal device: 300
emergency processing App:310
Please calculate three routes from A to B:S100a
Receive GPS signal :S101
Parse GPS signal :S102
Correct GPS signal :S103
Store map: Sill
Load map: SI12
Display map:S113
send route calculation request :S121
Receive route information : S122
Display broadcast navigation information : S123 Please receive three routes from A to B:S200a Receive route calculation request :S201 Calculate route :S202
Feed back navigation information : S203
GPS original signal + screen touch coordinates : SlOOb
Receive GPS signal :S131
Send GPS signal :S132
Send screen click coordinates : S133
Display video/broadcast audio :S134
HMI video stream + navigation broadcast audio stream: S200b
Parse GPS signal :S211
Correct GPS signal :S212
Parse user request: S213
Store map:S214
Load map:S215
Calculate route :S216
Generate HMI video stream: S217
Generate navigation broadcast audio stream: S218
Detailed Description of the Invention
[00032] Embodiments of the present invention are described below with reference to the drawings. Many specific details are expounded in the following description so that those skilled in the art can understand and realize the present invention more comprehensively. However, it is obvious to those skilled in the art that the invention can be realized without some of these specific details. In addition, it should be understood that the present invention is not limited to the specific embodiments described. On the contrary, consideration may be given to the use of any combination of the following features and key elements to implement the present invention, regardless of whether they relate to different embodiments . Therefore , the following aspects , features, embodiments and advantages merely serve an explanatory purpose, and should not be regarded as key elements or definitions of the claims, unless explicitly stated in the claims. [00033] The system provided in the present invention for realizing an in-vehicle infotainment function comprises an onboard computer device and a cloud device. The onboard computer device can acquire vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, send the acquired data to the cloud device, and realize the in-vehicle infotainment function according to a data stream coming from the cloud device and directly presentable by an onboard human-machine interactive device. The user of the vehicle can input an infotainment-function-related request via an HMI (e.g. touch screen) of the onboard computer device; based on the infotainment-function-related request from the user, the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data. The data stream directly presentable by the onboard human-machine interactive device may for example be an HMI video data stream and/or audio data stream. The cloud device performs data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device. Data transmission between the onboard computer device and the cloud device is carried out by means of a 5G network .
[00034] The system provided in the present invention for realizing an in-vehicle infotainment function may further comprise a mobile terminal device. The mobile terminal device can serve as a temporary standby solution when a fault occurs in the 5G network between the onboard computer device and the cloud device. Specifically, either one of the following two standby solutions may be used:
First standby solution
[00035] The mobile terminal device is in communicative connection with the onboard computer device in a wireless or wired manner (e.g. by BLE (Bluetooth Low Energy) , WIFI or USB) , and the onboard computer device can test the communication quality of the 5G network between itself and the cloud device; if it detects that a fault has occurred in 5G network communication between the onboard computer device and the cloud device, the onboard computer device sends the vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data to the mobile terminal device; by means of the mobile terminal device, emergency or limited-function data processing is performed on the data from the onboard computer device, so as to obtain the data stream directly presentable by the onboard human-machine interactive device, and the obtained data stream is sent to the onboard computer device. The onboard computer device realizes an associated in-vehicle infotainment function according to the data stream coming from the mobile terminal device and directly presentable by the onboard human-machine interactive device. Specifically, the mobile terminal device generates a data stream capable of realizing audio/video stream processing, parking assistance , navigation and voice recognition functions .
Second standby solution
[00036] The mobile terminal device is in communicative connection with the onboard computer device in a wireless or wired manner and in communicative connection with the cloud device via a 5G network; if a fault occurs in 5G network communication between the onboard computer device and the cloud device, the mobile terminal device serves as a router to realize data transmission between the onboard computer device and the cloud device.
[00037] Now referring to fig. 1, this shows a system for realizing an in-vehicle infotainment function according to a particular embodiment of the present invention. The system comprises an onboard computer device and a cloud device.
[00038] As shown in fig. 1, the cloud device performs almost all of the data processing work to generate a data stream directly presentable by an onboard human-machine interactive device, to realize an in-vehicle infotainment function. Specifically, as shown in fig. 1, the cloud device generates a data stream capable of realizing radio , telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management functions.
[00039] Now referring to fig. 2, this shows a system for realizing an in-vehicle infotainment function according to another particular embodiment of the present invention. The system comprises an onboard computer device, a cloud device and a mobile terminal device.
[00040] The onboard computer device has a baseband module, a vehicle control module and an entertainment system module, and also has an interface for performing data exchange, e.g. an interface for performing data exchange with a speaker, display, camera, USB, Ethernet and CAN bus. The baseband module provides network connection processing. The vehicle control module provides power supply management of the entire onboard computer device. The entertainment system module comprises a switched virtual circuit (Svc) , a component (Infra) and an operating system (OS) . The switched virtual circuit (Svc) can realize the following functions: data acquisition, sending/receiving data, audio/video presentation and processing priority determination. The component (Infra) can realize the following functions : TCP/IP (can be used to test the communication quality of the 5G network to determine whether a communication fault exists) , compression, encryption/decryption and caching data and response. The operating system (OS) supports functions such as SPI , I2C, I2S, UART , SDE and PMIC.
[00041] The cloud device comprises a display layer, an intermediate layer and a system component layer. The cloud device generates a data stream to realize in-vehicle infotainment functions such as radio, telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management.
[00042] The mobile terminal device has an emergency processing APP, to provide audio/video stream processing, navigation, parking assistance and voice recognition functions.
[00043] Figs. 3A and 3B show application scenarios in which the system is used to realize a navigation function in the prior art and the present invention respectively.
[00044] As shown in fig. 3A, in the prior art, an onboard computer device is responsible for receiving a GPS signal , parsing the GPS signal, correcting the GPS signal, storing a map, loading the map, displaying the map, sending a route calculation request to a cloud device, receiving route information sent by the cloud device and displaying broadcast navigation information via an onboard human-machine interactive device. The cloud device is only responsible for calculating a navigation route. Thus, in the prior art, the onboard computer device is responsible for a large number of data processing tasks; the route information fed back by the cloud device cannot be presented by the onboard human-machine interactive device directly.
[00045] As shown in fig. 3B, in the system of the present invention, the onboard computer device is only responsible for receiving and sending GPS signals, sending screen click coordinates, and displaying video and playing audio. The cloud device is responsible for parsing a GPS signal, correcting the GPS signal, parsing a user request, storing a map, loading the map, calculating a route, generating an HMI video stream and generating a navigation broadcast audio stream. Thus, in the present invention, the cloud device is responsible for almost all of the data processing work; the HMI video stream and navigation broadcast audio stream fed back by the cloud device can be presented directly by the onboard human-machine interactive device . [00046] In the present invention, data processing work which is currently performed by the onboard computer device is transferred to the cloud device, thereby reducing the software and hardware expenses of the onboard computer device, lowering the cost of the onboard computer device and shortening the research and development cycle.
[00047] In the present invention, due to the high transmission bandwidth and low delay of the 5G network, the process of data transmission between the onboard computer device and the cloud device will not affect the implementation of the in-vehicle infotainment function.
[00048] In the present invention, data processing is performed by means of the mobile terminal device to realize a travelling-safety-related in-vehicle infotainment function, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device.
[00049] In the present invention, the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device, thereby providing a temporary standby solution when a fault occurs in 5G network communication between the onboard computer device and the cloud device .
[00050] Although the present invention has been disclosed above with preferred embodiments, the present invention is not limited to this. Any change or modification made by those skilled in the art without departing from the spirit and scope of the present invention should be included in the scope of protection thereof. Thus, the scope of protection of the present invention shall be the scope defined by the claims.

Claims

Claims
[00051] 1. A system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a cloud device, characterized in that
the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, sends the acquired data to the cloud device, and realizes the in-vehicle infotainment function according to a data stream coming from the cloud device and directly presentable by an onboard human-machine interactive device ;
the cloud device performs data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device ;
data transmission between the onboard computer device and the cloud device is carried out by means of a 5G network.
[00052] 2. The system as claimed in claim 1, wherein the system further comprises a mobile terminal device, which is in communicative connection with the onboard computer device in a wireless or wired manner and in communicative connection with the cloud device via a 5G network; if a fault occurs in 5G network communication between the onboard computer device and the cloud device, the mobile terminal device is used as a router to realize data transmission between the onboard computer device and the cloud device.
[00053] 3. The system as claimed in claim 1, wherein the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data on the basis of an infotainment-function-related request from a user. [00054] 4. The system as claimed in claim 1, wherein the data stream directly presentable by the onboard human-machine interactive device is an HMI video data stream and/or audio data stream.
[00055] 5. The system as claimed in claim 1, wherein the onboard computer device comprises a baseband module, a vehicle control module, an entertainment system module , and an interface for performing data exchange.
[00056] 6. The system as claimed in claim 1, wherein the cloud device generates a data stream capable of realizing radio, telephone, multimedia, navigation, reversing assistance, ADAS, Bluetooth, voice recognition, parking assistance and sound management functions .
[00057] 7. A system for realizing an in-vehicle infotainment function, the system comprising an onboard computer device and a mobile terminal device, the mobile terminal device being in communicative connection with the onboard computer device in a wireless or wired manner, characterized in that
[00058] the onboard computer device acquires vehicle infotainment-function-related sensor data, vehicle operating condition data and/or user-inputted data by means of a CAN bus or cable harness connection to a sensor, the onboard computer device sends the acquired data to the mobile terminal device, and realizes the in-vehicle infotainment function according to a data stream coming from the mobile terminal device and directly presentable by an onboard human-machine interactive device;
[00059] the mobile terminal device performs emergency or limited-function data processing on the data from the onboard computer device and thereby obtains the data stream directly presentable by the onboard human-machine interactive device, and sends the obtained data stream to the onboard computer device.
[00060] 8. The system as claimed in claim 7, wherein the data stream directly presentable by the onboard human-machine interactive device is an HMI video data stream and/or audio data stream.
[00061] 9. The system as claimed in claim 7, wherein the onboard computer device comprises a baseband module, a vehicle control module, an entertainment system module , and an interface for performing data exchange.
[00062] 10. The system as claimed in claim 7, wherein the mobile terminal device performs emergency or limited-function data processing and thereby obtains a data stream capable of realizing audio/video stream processing, parking assistance, navigation and voice recognition functions.
[00063] 11. The system as claimed in claim 7, wherein the mobile terminal device is in communicative connection with the onboard computer device by BLE , WIFI or USB.
[00064] 12. The system as claimed in claim 7, wherein the onboard computer device tests communication quality of a 5G network between itself and a cloud device; if it detects that a fault has occurred in the 5G network, the onboard computer device performs data exchange with the mobile terminal device to realize the in-vehicle infotainment function.
[00065] 13. The system as claimed in claim 7, wherein the onboard computer device acquires the sensor data, vehicle operating condition data and/or user-inputted data on the basis of an infotainment-function-related request from a user.
PCT/EP2020/067893 2019-06-26 2020-06-25 System for realizing in-vehicle infotainment function WO2020260494A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910560950.2A CN110278277A (en) 2019-06-26 2019-06-26 For realizing the system of on-vehicle information amusement function
CN201910560950.2 2019-06-26

Publications (1)

Publication Number Publication Date
WO2020260494A1 true WO2020260494A1 (en) 2020-12-30

Family

ID=67963326

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2020/067893 WO2020260494A1 (en) 2019-06-26 2020-06-25 System for realizing in-vehicle infotainment function

Country Status (2)

Country Link
CN (1) CN110278277A (en)
WO (1) WO2020260494A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113671285A (en) * 2021-07-29 2021-11-19 江铃汽车股份有限公司 Electromagnetic compatibility test system of vehicle-mounted entertainment system
CN115441963A (en) * 2022-08-31 2022-12-06 重庆长安汽车股份有限公司 Vehicle-mounted entertainment equipment testing method and system, electronic equipment and readable storage medium
US11647164B2 (en) 2021-06-25 2023-05-09 Nio Technology (Anhui) Co., Ltd. Methods and systems for camera sharing between autonomous driving and in-vehicle infotainment electronic control units

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111294767A (en) * 2020-01-17 2020-06-16 浙江吉利新能源商用车集团有限公司 Intelligent network vehicle data processing method, system, device and storage medium
CN111954046B (en) * 2020-07-10 2022-06-21 浙江联控技术有限公司 Vehicle-mounted application data transmission method and system
CN112435494A (en) * 2020-11-20 2021-03-02 大陆投资(中国)有限公司 Roadside equipment and method for reducing safety risk of entering and exiting tunnel portal
CN114115540A (en) * 2021-11-25 2022-03-01 东风悦享科技有限公司 Intelligent entertainment interaction system and control method for vehicle cabin

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160286029A1 (en) * 2013-08-02 2016-09-29 Audi Ag Method for providing a function in a computer system of a vehicle
FR3059193A1 (en) * 2017-03-31 2018-05-25 Continental Automotive France METHOD FOR IMPLEMENTING AN ON-CAR SERVICE IN A VEHICLE USING RESOURCES PRESENTED ON A REMOTE SERVER
US20180279201A1 (en) * 2017-03-21 2018-09-27 Ford Global Technologies, Llc Method and apparatus for efficient vehicle data reporting

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8866604B2 (en) * 2013-02-14 2014-10-21 Ford Global Technologies, Llc System and method for a human machine interface
US20180009316A1 (en) * 2015-01-07 2018-01-11 Green Ride Ltd. Vehicle-user human-machine interface apparatus and systems

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160286029A1 (en) * 2013-08-02 2016-09-29 Audi Ag Method for providing a function in a computer system of a vehicle
US20180279201A1 (en) * 2017-03-21 2018-09-27 Ford Global Technologies, Llc Method and apparatus for efficient vehicle data reporting
FR3059193A1 (en) * 2017-03-31 2018-05-25 Continental Automotive France METHOD FOR IMPLEMENTING AN ON-CAR SERVICE IN A VEHICLE USING RESOURCES PRESENTED ON A REMOTE SERVER

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11647164B2 (en) 2021-06-25 2023-05-09 Nio Technology (Anhui) Co., Ltd. Methods and systems for camera sharing between autonomous driving and in-vehicle infotainment electronic control units
CN113671285A (en) * 2021-07-29 2021-11-19 江铃汽车股份有限公司 Electromagnetic compatibility test system of vehicle-mounted entertainment system
CN115441963A (en) * 2022-08-31 2022-12-06 重庆长安汽车股份有限公司 Vehicle-mounted entertainment equipment testing method and system, electronic equipment and readable storage medium

Also Published As

Publication number Publication date
CN110278277A (en) 2019-09-24

Similar Documents

Publication Publication Date Title
WO2020260494A1 (en) System for realizing in-vehicle infotainment function
US11204753B2 (en) Information distribution system and in-vehicle device
US9919598B2 (en) Mobile terminal, image display apparatus mounted in vehicle and data processing method using the same
CN109429096B (en) Sound main unit for vehicle, vehicle having the same, and vehicle control method
EP3584714B1 (en) Information providing system and method thereof
US10938963B2 (en) Electronic device for performing communication with external electronic device
JP2010130553A (en) In-vehicle device
CN107222637A (en) A kind of connection method and device, onboard system, terminal, storage medium
US20210131819A1 (en) Portable vehicle touch screen device utilizing functions of smart phone
US10769944B2 (en) Method for processing message and electronic device implementing the same
KR20180024209A (en) Usb communication control method of usb accessory
US20240143375A1 (en) Signal processing device and display apparatus for vehicle including the same
US20140130063A1 (en) Systems and methods for low overhead remote procedure calls
WO2024114796A1 (en) Vehicle usb firmware upgrade method and device, and vehicle
CN109981778B (en) Method, device, equipment and storage medium for realizing service of content distribution network
CN112231019A (en) Map engine architecture based on distributed microservice
CN109669898B (en) System and method for aggregating vehicle data from infotainment application accessories
EP4366247A1 (en) Signal processing device and communication device for vehicle having same
EP4339778A1 (en) Signal processing apparatus and communication apparatus for vehicle, comprising same
US20220270481A1 (en) Information processing device, vehicle, information processing method, and program
KR20140044213A (en) Virtual universal serial bus input/output device based on media oriented systems transport network
KR20140012896A (en) Mobile terminal and controlling method thereof
CN118264707A (en) Communication system, method and vehicle
Shu A Multi-Media Gateway for Vehicles
CN204774678U (en) Intelligent terminal integrates system of looking squarely

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20735153

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20735153

Country of ref document: EP

Kind code of ref document: A1