CN114582336A - Interaction method, vehicle-mounted terminal and computer-readable storage medium - Google Patents
Interaction method, vehicle-mounted terminal and computer-readable storage medium Download PDFInfo
- Publication number
- CN114582336A CN114582336A CN202011390032.9A CN202011390032A CN114582336A CN 114582336 A CN114582336 A CN 114582336A CN 202011390032 A CN202011390032 A CN 202011390032A CN 114582336 A CN114582336 A CN 114582336A
- Authority
- CN
- China
- Prior art keywords
- passenger
- vehicle
- control instruction
- terminal
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 61
- 230000003993 interaction Effects 0.000 title claims abstract description 57
- 230000015654 memory Effects 0.000 claims description 35
- 238000004590 computer program Methods 0.000 claims description 15
- 230000002452 interceptive effect Effects 0.000 claims description 5
- 238000004891 communication Methods 0.000 description 13
- 230000006870 function Effects 0.000 description 13
- 238000010586 diagram Methods 0.000 description 6
- 230000008569 process Effects 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000012790 confirmation Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/223—Execution procedure of a spoken command
Landscapes
- Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Lock And Its Accessories (AREA)
Abstract
The application belongs to the technical field of human-computer interaction, and relates to an interaction method, a vehicle-mounted terminal and a computer-readable storage medium, wherein the interaction method is applied to the vehicle-mounted terminal and comprises the following steps: acquiring an owner control instruction and/or a passenger control instruction, wherein the owner control instruction is acquired based on driver voice information, and the passenger control instruction is acquired based on passenger voice information transmitted by a passenger terminal and/or is directly generated and transmitted by the passenger terminal; and controlling the vehicle according to the owner control instruction, and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information. Therefore, the method and the device can realize multi-channel voice interaction control on the basis of not increasing hardware cost, so that all passengers can conveniently control the vehicle by using the voice interaction function of the vehicle, and the control of the vehicle by a driver is not hindered.
Description
Technical Field
The present application relates to the field of human-computer interaction technologies, and in particular, to an interaction method, a vehicle-mounted terminal, and a computer-readable storage medium.
Background
With the progress of society, automobiles have already entered every family, and driving and traveling also become the first choice for people to go out. Most of the current automobiles have a voice interaction function, and a user can input control voice through a vehicle-mounted microphone so as to correspondingly control the automobiles.
However, currently, an in-vehicle microphone for implementing a voice interactive function in an automobile is generally installed at a position of a center console, and thus, a passenger in a rear row cannot or is difficult to implement the voice interactive function of the automobile. If it is easy to think of additionally installing a vehicle-mounted microphone for the rear row in order to allow the rear row passengers to conveniently use the voice interaction function of the automobile, however, this will increase the hardware cost. Therefore, it is considered by those skilled in the art how to enable passengers to conveniently use the voice interaction function of the automobile without increasing the hardware cost, and not to hinder the control of the automobile by the driver.
In response to the above problems, those skilled in the art have sought solutions.
The foregoing description is provided for general background information and is not admitted to be prior art.
Disclosure of Invention
The technical problem to be solved by the present application is to provide an interaction method, a vehicle-mounted terminal, and a computer-readable storage medium, so as to implement a voice interaction function that enables a passenger to conveniently use an automobile without increasing hardware cost, and not to hinder a driver from controlling the automobile, in view of the above-mentioned defects in the prior art.
The application is realized as follows:
the first aspect of the present application provides an interaction method, applied to a vehicle-mounted terminal, including: and acquiring an owner control instruction and/or a passenger control instruction, wherein the owner control instruction is acquired based on the voice information of the driver, and the passenger control instruction is acquired based on the voice information of the passenger sent by the passenger terminal and/or is directly generated and sent by the passenger terminal. And controlling the vehicle according to the owner control instruction, and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information.
The second aspect of the present application further provides an in-vehicle terminal, which includes a memory and a processor, wherein the memory stores a computer program. The processor is adapted to execute a computer program stored in the memory to implement the interaction method as described above.
The third aspect of the present application also provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the interaction method as described above.
The application provides an interaction method, a vehicle-mounted terminal and a computer-readable storage medium, wherein the interaction method is applied to the vehicle-mounted terminal and comprises the following steps: and acquiring an owner control instruction and/or a passenger control instruction, wherein the owner control instruction is acquired based on the voice information of the driver, and the passenger control instruction is acquired based on the voice information of the passenger sent by the passenger terminal and/or is directly generated and sent by the passenger terminal. And controlling the vehicle according to the owner control instruction, and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information. Therefore, the vehicle can be directly controlled according to the voice information of the driver, and/or the passenger receives and sends the voice information of the passenger or a passenger control instruction corresponding to the voice information of the passenger to the vehicle-mounted terminal (namely, the passenger can obtain the voice information of the passenger without additionally installing hardware such as a vehicle-mounted microphone for the passenger) through the passenger terminal (such as a mobile phone, a smart watch and the like) carried by the passenger so that the vehicle-mounted terminal can control the vehicle in the passenger control authority which does not hinder the vehicle used by the driver.
In order to make the aforementioned and other objects, features and advantages of the present application more comprehensible, preferred embodiments accompanied with figures are described in detail below.
Drawings
Fig. 1 is a first flowchart of an interaction method according to a first embodiment of the present application;
FIG. 2 is a second flow chart of the interaction method provided by the first embodiment of the present application;
fig. 3 is a first structural schematic diagram of a vehicle-mounted terminal provided in a second embodiment of the present application;
fig. 4 is a second structural schematic diagram of a vehicle-mounted terminal provided in a second embodiment of the present application;
fig. 5 is a schematic diagram of an interaction scenario provided in a second embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It is to be understood that the embodiments described are only a few embodiments of the present application and not all embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The embodiments of the present application will be described in further detail below with reference to the accompanying drawings.
The first embodiment:
fig. 1 is a first flowchart of an interaction method according to a first embodiment of the present application. Fig. 2 is a second flowchart of the interaction method according to the first embodiment of the present application. For a clear description of the interaction method provided in the first embodiment of the present application, please refer to fig. 1 and fig. 2.
The interaction method provided by the first embodiment of the application can be applied to a vehicle-mounted terminal. The vehicle-mounted terminal can be but is not limited to a vehicle machine, a vehicle central control device and the like.
Specifically, an interaction method provided in a first embodiment of the present application includes:
and S11, acquiring the owner control instruction and/or the passenger control instruction.
Wherein the vehicle owner control instruction is obtained based on the driver voice information.
The passenger control instruction is obtained based on passenger voice information sent by the passenger terminal and/or directly generated and sent by the passenger terminal.
In an alternative embodiment, the passenger terminal may be, but is not limited to, a passenger's cell phone, smart watch, smart bracelet, and the like.
In an alternative embodiment, the process of obtaining the passenger control command in step S11 may include: the passenger terminal acquires passenger voice information and acquires and sends a corresponding passenger control instruction according to the passenger voice information, and then receives the passenger control instruction sent by the passenger terminal; and/or after the passenger terminal acquires and sends passenger voice information, receiving the passenger voice information to acquire a corresponding passenger control instruction according to the passenger voice information.
In other alternative embodiments, in step S11, acquiring the passenger control command corresponding to the passenger voice message sent by the passenger terminal may include: the method comprises the steps that passenger voice information is obtained at a passenger terminal, a corresponding first initial passenger control instruction is obtained according to the passenger voice information, and the first initial passenger control instruction and the passenger voice information are sent, and then the first initial passenger voice control instruction and the passenger voice information are received; performing instruction recognition according to the received passenger voice information to acquire a second initial passenger control instruction; judging whether the first initial passenger control instruction is consistent with the second initial passenger control instruction; if so, taking the first initial passenger control instruction or the second initial passenger control instruction as a final passenger control instruction; and if not, sending confirmation prompt information comprising the first initial passenger control instruction and the second initial passenger control instruction to the passenger terminal, and taking the first initial passenger control instruction or the second initial passenger control instruction corresponding to the confirmation information as a final passenger control instruction when receiving the confirmation information sent by the passenger terminal. Therefore, the interaction method provided by the embodiment can avoid triggering wrong passenger control instructions by performing double recognition and judgment on the passenger voice information.
In an optional embodiment, the passenger voice information may include identification information (e.g. IMEI, IMSI, etc. information of the mobile phone) of the corresponding passenger terminal, and passenger voice data. Further, the passenger voice information may be only the passenger voice data.
In an alternative embodiment, the passenger control command may include identification information of the corresponding passenger terminal (e.g. IMEI, IMSI, etc. information of the mobile phone).
In an alternative embodiment, before obtaining the owner control command and/or the passenger control command in step S11, the method may include: collecting voice information of a driver through a vehicle-mounted microphone; and/or receiving passenger voice information sent by at least one passenger terminal.
In an alternative embodiment, before the step of receiving the voice information of the passenger sent by the at least one passenger terminal, the method may further include: the passenger terminal receives the passenger voice data, performs audio processing (such as noise reduction, echo reduction and the like) on the passenger voice data, and then acquires passenger voice information according to the processed passenger voice data and the identification information of the passenger terminal.
In an alternative embodiment, the vehicle-mounted microphone may be mounted independently and may be mounted in a main driving area, such as a center console, a steering wheel, etc. corresponding to the main driving position. In addition, the vehicle-mounted microphone may also be integrated in the vehicle-mounted terminal, for example, the vehicle-mounted microphone is integrated in a voice control module of the vehicle device, where the voice control module of the vehicle device may be formed in a form of software or hardware or a combination of software and hardware.
In an alternative embodiment, the obtaining of the control command (e.g. the owner control command or the passenger control command) according to the voice message (e.g. the driver voice message or the passenger voice message) may include: and converting the voice data in the voice information into text data, and converting the text data into a corresponding control instruction.
In an alternative embodiment, the step of receiving the passenger voice message transmitted by at least one passenger terminal may comprise: opening a wireless network connection hotspot to establish wireless connection with at least one passenger terminal through the wireless network connection hotspot; and acquiring in-vehicle position information of each passenger terminal in wireless connection, creating a position corresponding table according to the identification information of each passenger terminal and the in-vehicle position information corresponding to each passenger terminal, and storing the position corresponding table.
In an optional implementation manner, the position correspondence table may further include main driving position correspondence information, where the main driving position correspondence information includes vehicle-mounted terminal identification information (e.g., PDSN, VIN code of a vehicle machine), and corresponds to the main driving position.
In an alternative embodiment, the wireless network hotspot may be, but is not limited to, a local area network hotspot (e.g., a WiFi hotspot), a bluetooth hotspot, and the like. Optionally, when the wireless network hotspot is a WiFi hotspot, the WiFi chip of the vehicle-mounted terminal starts the WiFi hotspot (sets a special access point name to distinguish from other hotspots), and the passenger terminal searches and connects to the WiFi hotspot through its own WiFi chip, specifically, the vehicle-mounted WiFi chip allocates an IP address to each access person, and distinguishes each passenger terminal through the MAC address accessed by the passenger terminal and/or information such as IMEI and IMSI of the passenger terminal.
In an optional embodiment, the step of acquiring in-vehicle location information of each passenger terminal in wireless connection, and acquiring and storing the location correspondence table according to the identification information of each passenger terminal and the in-vehicle location information corresponding to each passenger terminal may include: the passenger terminal acquires positioning information of the passenger terminal through an in-vehicle positioning technology, wherein the positioning information comprises identification information and positioning data; the passenger terminal sends the acquired positioning information to the vehicle-mounted terminal; and the vehicle-mounted terminal acquires the in-vehicle position information of the passenger terminal according to the positioning information. Alternatively, for example: installing beacons (e.g., bluetooth signals or WiFi beacons) at different locations within the vehicle such that each beacon broadcasts on multiple channels; the passenger terminal receives wireless broadcast signal data of a plurality of signals broadcast by a plurality of beacons; the passenger terminal takes the wireless broadcast signal data of each channel of a plurality of channels corresponding to each beacon as positioning data and sends the positioning information comprising the positioning data and the identification information to the vehicle-mounted terminal; and the vehicle-mounted terminal acquires the in-vehicle position information of the passenger terminal according to the positioning information.
In an optional embodiment, the obtaining, by the vehicle-mounted terminal, the in-vehicle position information of the passenger terminal according to the positioning information may include: the vehicle-mounted terminal inputs the RSSI value (namely the received signal strength value) of the positioning data in the positioning information into the first classifier to judge the row number of the passenger terminal in the vehicle, and selects the position corresponding to the value with the maximum distribution probability in the row number as the position information in the vehicle by performing function fitting on the RSSI value. The first classifier may be a processing model that identifies the number of rows of the passenger terminals in the vehicle based on RSSI values (received signal strength values), in which the first classifier is established before actual positioning, receives RSSI values of beacons of different bluetooth, wifi, and the like or wireless communication technologies at various positions in the vehicle, performs filtering processing on the RSSI values, and establishes a first classifier model based on the filtered RSSI values.
In an alternative embodiment, the vehicle-mounted terminal may recognize the passenger terminal or the corresponding user's orientation corresponding to the main driving seat according to the in-vehicle position information of the passenger terminal, such as a passenger seat right of the main driving seat, a passenger in the first row behind the main driving seat, a passenger in the second row behind the passenger seat, and so on.
In an optional embodiment, after the step of acquiring in-vehicle location information of each passenger terminal in wireless connection, creating a location correspondence table according to the identification information of each passenger terminal and the in-vehicle location information corresponding to each passenger terminal, and storing the location correspondence table, the step may include: and when the passenger terminal is monitored to be changed in position, carrying out position updating control to update the in-vehicle position information corresponding to the passenger terminal with the changed position in the position corresponding table.
And S12, controlling the vehicle according to the owner control instruction and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information.
In an alternative embodiment, S12, the controlling the vehicle according to the owner control command and/or the passenger control command when the passenger control command conforms to the passenger control authority information may be: and controlling the vehicle through a CAN protocol (or a CAN data transmission bus) according to the control instruction of the vehicle owner or the control instruction of the passenger.
In an alternative embodiment, at step S12, after controlling the vehicle according to the owner control command and/or controlling the vehicle according to the passenger control command when the passenger control command conforms to the passenger control authority information, the method may include: and feeding back corresponding prompt information through the vehicle-mounted sound according to the control condition corresponding to the vehicle owner control instruction, and/or feeding back corresponding prompt information through the vehicle-mounted sound and/or a corresponding passenger terminal according to the control condition corresponding to the passenger control instruction (for example, feeding back corresponding prompt information through a display screen or a loudspeaker of the passenger terminal).
In an alternative embodiment, in step S12, the passenger control authority information corresponds to a control object that does not affect the driving of the driver, such as an air conditioner, a window other than the window of the main driving seat, a seat other than the seat of the main driving seat, a music player, a radio, an atmosphere light in the vehicle, and the like. Specifically, the passenger control command does not conform to the passenger control authority information, for example, the control object corresponding to the passenger control command is a driver control object, such as a windshield wiper, a 360-degree looking-around system, a car driving light (e.g., high beam, low beam, warning light), and the like.
In an alternative embodiment, in the step S12, when the passenger control command matches the passenger control authority information, the controlling the vehicle according to the passenger control command may include: searching the position corresponding table according to the identification information of the passenger terminal sending the passenger control instruction so as to obtain the position information in the vehicle where the passenger terminal is located; determining and controlling a control object of a passenger control instruction according to the in-vehicle position information of the passenger terminal; the control object may include, among other things, passenger control components (e.g., windows, air conditioners, seats, displays for passenger use, doors, speakers, etc.) within the passenger seating area of the vehicle. For example, the corresponding identification information obtained according to the passenger control instruction for the vehicle window is the first IMEI code, the in-vehicle position information corresponding to the first IMEI code is found from the position correspondence table to be the rear row 1 seat, and then the left window of the rear row of the vehicle close to the rear row 1 seat is determined as the control object according to the in-vehicle position information and the passenger control instruction for the vehicle window, so that the left window of the rear row of the vehicle is controlled according to the passenger control instruction.
Based on the same inventive concept as above, the following describes an exemplary case where there are a plurality of passengers:
referring to fig. 2, in an alternative embodiment, the obtaining of the owner control command and/or the passenger control command at step S11 may include: and S21, obtaining passenger control commands corresponding to the passenger voice information sent by the passenger terminals respectively to obtain a plurality of passenger control commands. At step S12: controlling the vehicle according to the owner control instruction, and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction conforms to the passenger control authority information, may include: s22, when the passenger control commands all accord with the passenger control authority information and all aim at the same unified control object in the vehicle, selecting one passenger control command as a target passenger control command according to a preset priority rule; s23: and correspondingly controlling the unified control object in the vehicle according to the target passenger control instruction. Therefore, the interaction method provided by the embodiment can select the control requirement of one passenger according to the preset priority rule when a plurality of passengers send the control requirements for the unified control object in the same vehicle in a short time, so that the unified control object in the vehicle is controlled preferentially according to the control requirements of the passengers, the reasonable control of the unified control object in the vehicle is ensured, and the use experience of a user is improved.
In an alternative embodiment, the control objects are unified in the vehicle, such as music players, radios, air conditioners, vehicle sunroofs, etc.
In an alternative embodiment, the process of selecting one passenger control command as the target passenger control command according to the preset priority rule may include: acquiring the acquisition time corresponding to each passenger control instruction, and taking the passenger control instruction acquired firstly as a target passenger control instruction; and/or acquiring acquisition time corresponding to each passenger control instruction, and taking the passenger control instruction corresponding to the maximum volume in all passenger voice information corresponding to all passenger control instructions as a target passenger control instruction when the acquisition time of all passenger control instructions is the same. Therefore, the interaction method provided by the embodiment realizes multi-channel voice interaction control on the unified control object in the same vehicle, and can rob the control right in time sequence when a plurality of people send control voices, and if the plurality of people send control voices at the same time, the person with large voice takes precedence, thereby ensuring reasonable control of the unified control object in the vehicle and increasing interest.
In an optional embodiment, after the step of performing corresponding control on the unified control object in the vehicle according to the target passenger control command, the method may further include: when a second passenger control instruction for a unified control object in the same vehicle is received again, acquiring and judging an execution factor to determine whether to execute the second passenger control instruction, wherein the execution factor may include second identification information of a passenger terminal corresponding to the second passenger control instruction and/or execution information of a target passenger control instruction; and refusing to execute the second passenger control instruction when the execution factor does not meet the execution condition.
In an alternative embodiment, the process of determining the execution factor may include: judging whether the execution factors meet the execution conditions or not; refusing to execute the second passenger control instruction when the execution factor does not meet the execution condition; and executing the second passenger control instruction when the execution factor meets the execution condition.
In an optional embodiment, when the execution factor does not meet the execution condition, the method may include: the second identification information of the passenger terminal corresponding to the second passenger control instruction is different from the identification information corresponding to the target passenger control instruction; and/or the execution information of the target passenger control command is not finished correspondingly. Therefore, the interaction method provided by the embodiment can reject other passenger control instructions when the control of the target passenger control instruction of one passenger for the unified control object in the vehicle is not executed and the other passenger control instructions of other passengers for the unified control object in the same vehicle are received, so that the completion of the target passenger control instruction can be ensured, the situation that a plurality of passengers compete when the control is not completed is avoided, and the use experience of a user is improved, for example, the target passenger control instruction of the passenger a regulates the air temperature in the vehicle to 20 ℃, and rejects other passengers to control the temperature before the actual temperature is controlled to 20 ℃; as another example, the passenger's target passenger control directive is to play XXX songs, thereby rejecting other passengers' song play requests before the player has not played XXX songs (i.e., during the play of XXX songs, song cutting is not allowed), or the passenger's target passenger control directive is to play XXX songs, thereby rejecting other passengers' song play requests before the player plays XXX songs (i.e., during the play of XXX songs, song cutting is allowed); also for example, the target passenger control command for passenger a is to control the radio to tune to the XXX frequency band, thereby rejecting other passengers' radio tuning requests before the radio tunes to the XXX segment.
The interaction method provided by the first embodiment of the application is applied to a vehicle-mounted terminal, and comprises the following steps: s11, acquiring a vehicle owner control instruction and/or a passenger control instruction; the owner control instruction is obtained based on voice information of a driver, and the passenger control instruction is obtained based on voice information of a passenger sent by a passenger terminal and/or is directly generated and sent by the passenger terminal; and S12, controlling the vehicle according to the owner control instruction and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information. Therefore, the interaction method provided by the first embodiment of the present application can directly control the vehicle according to the voice information of the driver, and/or the passenger receives and sends passenger voice information or a passenger control instruction corresponding to the passenger voice information to the vehicle-mounted terminal through a passenger terminal (such as a mobile phone, a smart watch and the like) carried by the passenger (namely, the passenger can acquire the passenger voice information without additionally installing hardware such as a vehicle-mounted microphone and the like for the passenger) so that the vehicle-mounted terminal can control the vehicle within the passenger control authority which does not obstruct the driver to use the vehicle, therefore, the interaction method provided by the first embodiment of the application can realize that all passengers can conveniently control the vehicle by using the voice interaction function of the vehicle on the basis of not increasing hardware cost, and does not hinder the driver from controlling the vehicle.
Second embodiment:
fig. 3 is a first structural schematic diagram of a vehicle-mounted terminal provided in a second embodiment of the present application. For a clear description of the in-vehicle terminal 1 provided in the first aspect of the second embodiment of the present application, please refer to fig. 3.
A first aspect of a second embodiment of the present application provides a vehicle-mounted terminal 1, including: a processor a101 and a memory a201, wherein the processor a101 is configured to execute the computer program a6 stored in the memory a201 to implement the steps of the interaction method as described in the first embodiment.
In an optional implementation manner, the in-vehicle terminal 1 provided in this embodiment may include at least one processor a101 and at least one memory a 201. Wherein, at least one processor A101 may be referred to as a processing unit A1, and at least one memory A201 may be referred to as a memory unit A2. Specifically, the storage unit a2 stores a computer program a6 that, when executed by the processing unit a1, causes the in-vehicle terminal 1 provided by the present embodiment to implement the steps of the interaction method described in the first embodiment, for example, steps S11 to S12 shown in fig. 1.
In an alternative embodiment, the in-vehicle terminal 1 provided in the present embodiment may include a plurality of memories a201 (simply referred to as a storage unit A2).
Storage unit a2 may be either volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. Among them, the nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic random access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The storage unit a2 described in the embodiments of the present application is intended to comprise, without being limited to, these and any other suitable types of memory.
In an alternative embodiment, the in-vehicle terminal 1 further includes a bus connecting the different components (e.g., the processor a101 and the memory a201, the touch-sensitive display screen a3, etc.).
In an optional implementation manner, the in-vehicle terminal 1 in this embodiment may further include a communication interface (e.g., an I/O interface a4), and the communication interface may be used for communicating with an external device.
In an optional implementation manner, the in-vehicle terminal 1 provided in this embodiment may further include a communication device a 5.
The vehicle-mounted terminal 1 provided by the second embodiment of the present application includes a memory a101 and a processor a201, and the processor a101 is configured to execute the computer program a6 stored in the memory a201 to implement the steps of the interaction method described in the first embodiment, so that the vehicle-mounted terminal 1 provided by this embodiment can implement the control of the vehicle by using the voice interaction function of the vehicle conveniently and conveniently without increasing the hardware cost, and does not hinder the control of the vehicle by the driver.
Fig. 4 is a second structural schematic diagram of the in-vehicle terminal provided in the second embodiment of the present application.
Referring to fig. 4, a vehicle-mounted terminal provided by a second aspect of a second embodiment of the present application includes: a central controller 801 (CPU for short), a read only memory 802 (ROM for short), a random access memory 803 (RAM for short), a communication bus 804, an I/O interface 805, an input unit 806, an output unit 807, a storage unit 808, and a communication unit 809.
In an alternative embodiment, the central controller 801 (CPU), the read only memory 802 (ROM) and the random access memory 803 (RAM) may constitute a processor.
In an optional implementation manner, the vehicle-mounted terminal may implement the interaction method provided in the first embodiment, so that the vehicle-mounted terminal can enable a passenger to conveniently control the vehicle by using the voice interaction function of the vehicle without increasing hardware cost, and does not hinder the driver from controlling the vehicle.
Fig. 5 is a schematic diagram of an interaction scenario provided by a second embodiment of the present application.
Referring to fig. 5, a third aspect of the second embodiment of the present application provides a vehicle-mounted terminal 2 including: processor B1, memory B2, and communications module B3.
Wherein the processor B1 is adapted to execute the computer program stored in the memory B2 for implementing the steps of the interaction method as described in the first embodiment.
In an alternative embodiment, the processor B1 may also be connected to various control objects C3 in the vehicle via a CAN data bus for corresponding control of the control object C3 according to the steps of the interaction method as described in the first embodiment.
In an alternative embodiment, the communication module B3 may be configured to open a wireless network connection hotspot and establish wireless connections with the passenger terminal D1 of the passenger in the passenger seat J2, the passenger terminal D2 of the passenger in the rear row 1 seat J3, and the passenger terminal D3 of the passenger in the rear row 2 seat J4. For example, when the communication module B3 is used to turn on a WiFi hotspot, a WiFi chip may be included in the communication module B3. Each passenger terminal comprises a microphone for receiving voice data of a corresponding passenger; in addition, each passenger terminal can also comprise a voice processing module, and the voice processing module can perform audio processing on the received voice data and/or convert the voice data into a passenger control instruction. Each passenger terminal can be a communication module B3 which packages voice data subjected to audio processing and identification information of the passenger terminal to obtain passenger voice information and then sends the passenger voice information to the vehicle-mounted terminal 2, so that the communication module B3 transmits the passenger voice information to the processor B1 to obtain a corresponding passenger control instruction after being processed by the processor B1; each passenger terminal may also be a communication module that directly converts the processed voice data into a passenger control command (which may include identification information of the passenger terminal), and then directly transmits the passenger control command to the in-vehicle terminal 2.
In an alternative implementation, the vehicle-mounted terminal 2 provided by the present embodiment may further include a sound processor B4. The sound processing module may be connected to an external vehicle-mounted microphone C1, or a built-in vehicle-mounted microphone (not shown in the figure), and is configured to perform audio processing on the driver voice data of the main driving seat J1 acquired by the vehicle-mounted microphone C1, and transmit the processed driver voice data to the processor B1, so that the processor B1 obtains the driver voice information according to the identification information of the vehicle-mounted terminal 2 and the processed driver voice data, and obtains a vehicle owner control instruction according to the driver voice information through a voice processing module (not shown in the figure) in the processor B1.
In an alternative embodiment, the sound processor B4 is connected to the processor B1 and the car audio C2, so that the processor B1 can perform sound processing before controlling the car audio C2 to perform audio output, and the audio output effect of the car audio C2 is guaranteed.
The vehicle-mounted terminal 2 provided by the third aspect of the second embodiment of the present application may implement the interaction method provided by the first embodiment, and therefore, the vehicle-mounted terminal 2 may implement that, on the basis of not increasing hardware cost, a passenger may conveniently control a vehicle using a voice interaction function of the vehicle, and may not hinder a driver from controlling the vehicle.
The second embodiment of the present application further provides a computer-readable storage medium, which stores a computer program a6, and when being executed by the processor a101, the computer program a6 implements the steps of the interaction method as in the first embodiment, for example, the steps shown in fig. 1 are S11 to S12.
In an alternative embodiment, the computer readable storage medium provided by the present embodiments may include any entity or device capable of carrying computer program code, a recording medium, such as ROM, RAM, magnetic disk, optical disk, flash memory, etc.
The computer program a6 stored in the computer-readable storage medium provided by the second embodiment of the present application, when executed by the processor a101, can enable a passenger to conveniently control a vehicle using a voice interaction function of the vehicle without increasing hardware cost of the vehicle, and does not hinder a driver from controlling the vehicle.
The technical features of the embodiments described above may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments described above are not described, but should be considered as being within the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, element, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, element, or apparatus. Without further limitation, the recitation of an element by the phrase "comprising an … …" does not exclude the presence of additional like elements in the process, method, article, component, or apparatus that comprises the element, and further, where similarly-named elements, features, and components in different embodiments of the disclosure may have the same meaning, or may have different meanings, that particular meaning should be determined by their interpretation in the particular embodiment or by further combination with the context of the particular embodiment.
It should be understood that although the terms first, second, third, etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are only used to distinguish one type of information from another. The word "if" as used herein may be interpreted as "at … …" or "when … …" or "in response to a determination", depending on the context. Also, as used herein, the singular forms "a", "an" and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It will be further understood that the terms "comprises," "comprising," "includes" and/or "including," when used in this specification, specify the presence of stated features, steps, operations, elements, components, items, species, and/or groups, but do not preclude the presence, or addition of one or more other features, steps, operations, elements, components, species, and/or groups thereof. The terms "or" and/or "as used herein are to be construed as inclusive or meaning any one or any combination. Thus, "A, B or C" or "A, B and/or C" means "any of the following: a; b; c; a and B; a and C; b and C; A. b and C ". An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some way.
The present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed.
Claims (11)
1. An interaction method is applied to a vehicle-mounted terminal and comprises the following steps:
acquiring an owner control instruction and/or a passenger control instruction, wherein the owner control instruction is acquired based on driver voice information, and the passenger control instruction is acquired based on passenger voice information transmitted by a passenger terminal and/or is directly generated and transmitted by the passenger terminal;
and controlling the vehicle according to the owner control instruction, and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information.
2. The interaction method of claim 1, wherein the step of obtaining owner control instructions and/or passenger control instructions is preceded by the step of:
collecting voice information of a driver through a vehicle-mounted microphone; and/or the presence of a gas in the gas,
and receiving passenger voice information sent by at least one passenger terminal.
3. The interactive method of claim 2, wherein said step of receiving passenger voice messages transmitted by at least one passenger terminal is preceded by the steps of:
opening a wireless network connection hotspot to establish wireless connection with the at least one passenger terminal through the wireless network connection hotspot;
and acquiring in-vehicle position information of each passenger terminal in wireless connection, creating a position corresponding table according to the identification information of each passenger terminal and the in-vehicle position information corresponding to each passenger terminal, and storing the position corresponding table.
4. The interaction method according to claim 3, wherein the step of acquiring in-vehicle location information of each passenger terminal in wireless connection, creating a location correspondence table based on the identification information of each passenger terminal and the in-vehicle location information corresponding to each passenger terminal, and storing the location correspondence table comprises:
and when the passenger terminal is monitored to be subjected to position change, carrying out position updating control to update the in-vehicle position information corresponding to the passenger terminal with the changed position in the position corresponding table.
5. The interaction method according to claim 3, wherein the step of controlling the vehicle according to the passenger control command when the passenger control command conforms to the passenger control authority information comprises:
searching the position corresponding table according to the identification information of the passenger terminal sending the passenger control instruction so as to obtain the in-vehicle position information of the passenger terminal;
determining and controlling a control object of the passenger control instruction according to the in-vehicle position information of the passenger terminal;
wherein the control object comprises a passenger control component within a passenger seating area of a vehicle.
6. The interaction method as claimed in claim 2, wherein the step of obtaining the owner control command and/or the passenger control command comprises:
passenger control instructions corresponding to the passenger voice information sent by the passenger terminals are obtained respectively so as to obtain a plurality of passenger control instructions;
the step of controlling the vehicle according to the owner control instruction and/or controlling the vehicle according to the passenger control instruction when the passenger control instruction accords with the passenger control authority information comprises the following steps:
when the passenger control instructions all accord with passenger control authority information and all aim at the same unified control object in the vehicle, selecting one passenger control instruction as a target passenger control instruction according to a preset priority rule;
and correspondingly controlling the unified control object in the vehicle according to the target passenger control instruction.
7. The interactive method of claim 6, wherein said selecting a passenger control command as a target passenger control command according to a predetermined priority rule comprises:
acquiring acquisition time corresponding to each passenger control instruction, and taking the passenger control instruction acquired firstly as a target passenger control instruction; and/or the presence of a gas in the gas,
and acquiring the acquisition time corresponding to each passenger control instruction, and taking the passenger control instruction corresponding to the maximum volume in all passenger voice information corresponding to all the passenger control instructions as a target passenger control instruction when the acquisition time of all the passenger control instructions is the same.
8. The interaction method according to claim 6, further comprising, after said step of controlling unified in-vehicle control objects in accordance with said target passenger control command, the steps of:
when a second passenger control instruction aiming at the same in-vehicle unified control object is received again, acquiring and judging an execution factor to determine whether to execute the second passenger control instruction, wherein the execution factor comprises second identification information of a passenger terminal corresponding to the second passenger control instruction and/or execution information of the target passenger control instruction;
and refusing to execute the second passenger control instruction when the execution factor does not meet the execution condition.
9. The interactive method of claim 8, wherein said determining the execution factor comprises:
judging whether the execution factor meets the execution condition;
refusing to execute the second passenger control instruction when the execution factor does not meet the execution condition; wherein, when the execution factor does not meet the execution condition, the method comprises the following steps:
the second identification information of the passenger terminal corresponding to the second passenger control instruction is different from the identification information corresponding to the target passenger control instruction; and/or the presence of a gas in the gas,
and the execution information of the target passenger control command is not finished correspondingly.
10. The vehicle-mounted terminal is characterized by comprising a memory and a processor, wherein the memory stores a computer program;
the processor is configured to execute the computer program to implement the interaction method of any one of claims 1 to 9.
11. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, which computer program, when being executed by a processor, carries out the interaction method according to any one of claims 1 to 9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011390032.9A CN114582336A (en) | 2020-12-02 | 2020-12-02 | Interaction method, vehicle-mounted terminal and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011390032.9A CN114582336A (en) | 2020-12-02 | 2020-12-02 | Interaction method, vehicle-mounted terminal and computer-readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114582336A true CN114582336A (en) | 2022-06-03 |
Family
ID=81768006
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011390032.9A Pending CN114582336A (en) | 2020-12-02 | 2020-12-02 | Interaction method, vehicle-mounted terminal and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114582336A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116546069A (en) * | 2023-07-05 | 2023-08-04 | 小米汽车科技有限公司 | Vehicle control method, device, vehicle, adapter, terminal and medium |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108327667A (en) * | 2018-02-06 | 2018-07-27 | 奇瑞汽车股份有限公司 | Vehicle audio control method and device |
| CN108882202A (en) * | 2018-06-27 | 2018-11-23 | 肇庆高新区徒瓦科技有限公司 | A kind of vehicle-mounted exchange method and device based on smart phone |
| CN109637532A (en) * | 2018-12-25 | 2019-04-16 | 百度在线网络技术（北京）有限公司 | Audio recognition method, device, car-mounted terminal, vehicle and storage medium |
| CN110001549A (en) * | 2019-04-17 | 2019-07-12 | 百度在线网络技术（北京）有限公司 | Method for controlling a vehicle and device |
| US20200075006A1 (en) * | 2018-08-29 | 2020-03-05 | Alibaba Group Holding Limited | Method, system, and device for interfacing with a terminal with a plurality of response modes |
| CN111653277A (en) * | 2020-06-10 | 2020-09-11 | 北京百度网讯科技有限公司 | Vehicle voice control method, device, equipment, vehicle and storage medium |
-
2020
- 2020-12-02 CN CN202011390032.9A patent/CN114582336A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108327667A (en) * | 2018-02-06 | 2018-07-27 | 奇瑞汽车股份有限公司 | Vehicle audio control method and device |
| CN108882202A (en) * | 2018-06-27 | 2018-11-23 | 肇庆高新区徒瓦科技有限公司 | A kind of vehicle-mounted exchange method and device based on smart phone |
| US20200075006A1 (en) * | 2018-08-29 | 2020-03-05 | Alibaba Group Holding Limited | Method, system, and device for interfacing with a terminal with a plurality of response modes |
| CN109637532A (en) * | 2018-12-25 | 2019-04-16 | 百度在线网络技术（北京）有限公司 | Audio recognition method, device, car-mounted terminal, vehicle and storage medium |
| CN110001549A (en) * | 2019-04-17 | 2019-07-12 | 百度在线网络技术（北京）有限公司 | Method for controlling a vehicle and device |
| CN111653277A (en) * | 2020-06-10 | 2020-09-11 | 北京百度网讯科技有限公司 | Vehicle voice control method, device, equipment, vehicle and storage medium |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116546069A (en) * | 2023-07-05 | 2023-08-04 | 小米汽车科技有限公司 | Vehicle control method, device, vehicle, adapter, terminal and medium |
| CN116546069B (en) * | 2023-07-05 | 2024-06-04 | 小米汽车科技有限公司 | Vehicle control method, device, vehicle, adapter, terminal and medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3136749B1 (en) | Customization of a vehicle audio system | |
| CA2530849C (en) | Vehicle-state based parameter adjustment system | |
| US9071892B2 (en) | Switching between acoustic parameters in a convertible vehicle | |
| US8559910B2 (en) | OTA initiation method for telematics system in 2G GSM/3G WCDMA network | |
| US8738368B2 (en) | Speech processing responsive to a determined active communication zone in a vehicle | |
| CN113119683B (en) | Control method of vehicle air conditioner, vehicle terminal and server | |
| CN107027171B (en) | System and method for zone configuration | |
| US8050419B2 (en) | Adaptive initial volume settings for a vehicle audio system | |
| CN105936245B (en) | Service provider adaptive vehicle antenna | |
| US20120231821A1 (en) | Vehicle telematics communication for providing hands-free wireless communication | |
| DE102014209992A1 (en) | System and system for interacting with a device in a vehicle and a vehicle | |
| CN105632521B (en) | A kind of random source of sound automatic sound control device based on automobile | |
| US20170169823A1 (en) | Method and Apparatus for Voice Control of a Motor Vehicle | |
| JP2008236448A (en) | Sound signal processing device, hands-free calling device, sound signal processing method, and control program | |
| CN107018176B (en) | Application control to primary connection device from secondary connection device | |
| JP2006523416A (en) | System and method for configuring in-vehicle wireless communication system | |
| JP2003312391A (en) | Automatic adjustment device of onboard instrument | |
| CN110648663A (en) | Vehicle-mounted audio management method, device, equipment, automobile and readable storage medium | |
| CN106922026B (en) | Vehicle and Wi-Fi communication control method thereof | |
| CN107872831B (en) | Optimizing user experience for a vehicle having multiple hotspots | |
| DE102020103125A1 (en) | METHOD AND SYSTEM FOR MASKING PASSENGER NOISE IN A COMMUNITY ENVIRONMENT | |
| US7319924B2 (en) | Method and system for managing personalized settings in a mobile vehicle | |
| CN114582336A (en) | Interaction method, vehicle-mounted terminal and computer-readable storage medium | |
| CN110392363A (en) | A kind of car-mounted terminal control method, device and terminal | |
| DE102017127981B4 (en) | CONTROL THE USE OF WIFI HOTSPOTS IN VEHICLES VIA A PORTABLE WIRELESS DEVICE |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |