CN117953890A

CN117953890A - Volume control method in vehicle, electronic device and storage medium

Info

Publication number: CN117953890A
Application number: CN202410071713.0A
Authority: CN
Inventors: 左晨
Original assignee: Shanghai Jidu Automobile Co Ltd
Current assignee: Shanghai Jidu Automobile Co Ltd
Priority date: 2024-01-17
Filing date: 2024-01-17
Publication date: 2024-04-30

Abstract

The present disclosure provides a volume control method in a vehicle, an electronic device, and a storage medium, the method including: determining a voice dialogue type of a target user in a vehicle in the process of playing audio content by vehicle audio equipment, and determining the level of adjustment willingness of the target user to the current volume of the vehicle audio equipment according to the voice dialogue type, wherein the different levels represent different intensities of adjustment willingness; judging whether the adjustment willingness level meets a preset volume adjustment condition or not, and determining a volume adjustment mode according to the voice dialogue type and the adjustment willingness level under the condition that the adjustment willingness level meets the preset volume adjustment condition; and controlling and adjusting the current volume of the vehicle according to the volume adjustment mode.

Description

Volume control method in vehicle, electronic device and storage medium

Technical Field

The present disclosure relates to the field of vehicle technologies, and in particular, to a volume control method in a vehicle, an electronic device, and a storage medium.

Background

With the development of intelligent automobiles, entertainment facilities in the automobiles are more and more abundant, many people like to listen to music or broadcast while driving to eliminate fatigue, in general, the volume in the automobile has a certain influence on the comfort and safety of the driving process, when passengers in the automobile call or chat demands, the volume of the sound in the automobile needs to be manually adjusted by drivers in the related art, and the volume needs to be manually adjusted again when no demand exists later, so that the efficiency of the mode is low, and the attention of the drivers can be dispersed under many conditions, thereby influencing the driving safety.

Disclosure of Invention

The embodiment of the disclosure at least provides a volume control method in a vehicle, the vehicle, electronic equipment and a storage medium.

In a first aspect, an embodiment of the present disclosure provides a method for controlling volume in a vehicle, including:

In the process of playing audio content by vehicle audio equipment, determining a voice dialogue type of a target user in the vehicle, and determining the adjustment willingness degree grade of the target user on the current volume of the vehicle audio equipment according to the voice dialogue type, wherein the different grades represent different intensities of the adjustment willingness degree;

Judging whether the adjustment willingness level meets a preset volume adjustment condition or not, and determining a volume adjustment mode according to the voice dialogue type and the adjustment willingness level under the condition that the adjustment willingness level meets the preset volume adjustment condition;

and controlling and adjusting the current volume of the vehicle according to the volume adjustment mode.

Based on the above embodiment, the dynamic adjustment of the volume in the vehicle can be realized, specifically, the adjustment willingness degree level of the target user for the current volume can be determined according to the voice dialogue type of the target user in the vehicle, and the volume adjustment mode is determined according to the voice dialogue type and the adjustment willingness degree level under the condition that the adjustment willingness degree level meets the preset volume adjustment condition, so that the volume in the vehicle is adjusted, the efficiency and the accuracy of controlling the volume in the vehicle are improved, and the driving safety is improved.

In an alternative embodiment, determining the type of voice dialog of the target user in the vehicle includes:

Acquiring in-vehicle sound information in the vehicle, carrying out voice information recognition on the in-vehicle sound information, and determining whether voice information exists in the in-vehicle sound information;

under the condition that the voice information is determined to exist, carrying out semantic analysis on the voice information, and determining a dialogue theme of the voice information;

And determining the voice dialogue type of the target user in the vehicle according to the dialogue theme.

In this way, whether a person in the vehicle is speaking can be judged through the sound in the vehicle, and the conversation topic of the voice conversation in the vehicle can be further determined through semantic analysis of voice information, and the conversation topic can reflect the sustainability of the conversation to a certain extent, for example, if the conversation topic is where to eat in a discussion, the conversation can be completed through a plurality of rounds, so that the voice conversation type of a target user in the vehicle can be determined relatively accurately based on the conversation topic.

In an alternative embodiment, determining a voice dialogue type of a target user in the vehicle according to the dialogue topic includes:

Acquiring target image information of a target user corresponding to the voice information;

Acquiring first user state information of the target user according to the target image information;

And determining a dialogue scene of the target user in the vehicle according to the first user state information and the dialogue topic, and determining that the voice dialogue type of the target user in the vehicle is a sustainable type or a non-sustainable type according to the dialogue scene.

In the above embodiment, the voice dialogue type may be determined only by dialogue topic, for example, two passengers discuss recently watched television programs, it may be determined that there is a sustainable voice dialogue in the current car, in some cases, for example, passengers are making a call, at this time, the extracted voice may be a discontinuous dialogue, the dialogue topic extracted by semantic analysis may have a problem of low accuracy, at this time, the voice dialogue type may be determined according to the user status information and dialogue topic, for example, passengers are smiling, making a call and sharing a nearby dialogue scene, and it may be determined that there is a sustainable voice dialogue in the current car. By adopting the implementation mode, the volume in the vehicle can be adjusted according to whether the sustainable voice dialogue exists in the vehicle, the accuracy of judging the sustainable voice dialogue type is improved, and the accuracy of controlling the volume in the vehicle is further improved.

In an alternative embodiment, the voice dialogue type of the target user in the vehicle is a sustainability type, including:

the dialogue topic meets the sustainable dialogue topic condition; or the dialog scene meets a sustainability dialog scene condition.

Accordingly, the voice dialogue type of the target user in the vehicle is a non-sustainable type, which comprises: the voice information does not exist in the sound information in the vehicle; or the dialog theme does not conform to the sustainable dialog theme condition; or the dialog scene does not meet the sustainability dialog scene condition.

In the above embodiment, in the case where no voice information exists in the in-vehicle voice information, it may be determined that the voice dialogue type of the target user in the vehicle is a non-sustainable type, that is, when no person in the vehicle speaks, it may be determined that no sustainable voice dialogue exists in the vehicle; or in the case that the dialog theme does not meet the sustainable dialog theme condition, for example, the dialog is a simple greeting between passengers, it may also be determined that the voice dialog type in the vehicle is a non-sustainable type; and determining a dialogue scene of the target user in the vehicle according to the first user state information and the dialogue topic, and determining that the voice dialogue type of the target user in the vehicle is a non-sustainable type under the condition that the dialogue scene does not meet the sustainable dialogue scene condition, for example, the voice information of the target user is a good song, and the first user state information indicates that the target user is in a backward rest state, wherein the current dialogue scene is considered to be not in accordance with the sustainable dialogue scene condition. Conversely, if the dialog topic or dialog scene meets the sustainability condition, then the voice dialog type of the target user may be determined to be a sustainability type.

That is, by adopting the above embodiment, it can be determined that the voice dialogue type in the vehicle is a non-sustainable type or a sustainable type, and the voice dialogue type affects the adjustment willingness level of the target user to the current volume of the vehicle audio device, thereby improving the accuracy of controlling the volume in the vehicle, helping the driver to acquire traffic road information, and further improving the driving safety.

In an optional embodiment, the determining, according to the voice dialogue type, a willingness level of the target user to adjust the current volume of the vehicle audio device includes: determining that the target user has an adjustment willingness level of the current volume as a first level under the condition that the voice conversation type is a sustainable type, wherein the first level represents that the adjustment willingness level is greater than a preset strength; the determining whether the adjustment willingness level meets a preset volume adjustment condition includes: and under the condition that the intensity of the adjustment willingness level representing the adjustment willingness is larger than the preset intensity, determining that the adjustment willingness level meets the preset volume adjustment condition.

By adopting the embodiment, when the voice dialogue with the sustainability type in the vehicle is detected, the adjustment willingness level of the current volume of the target user is determined to meet the preset volume adjustment condition, namely the target user has a strong willingness to adjust the volume in the vehicle, and then the audio equipment in the vehicle is controlled to adjust the volume, so that the accuracy and the efficiency of controlling the volume in the vehicle can be improved.

In an optional embodiment, the determining, according to the voice dialogue type, a willingness level of the target user to adjust the current volume of the vehicle audio device includes:

acquiring in-vehicle image information and/or in-vehicle ambient light information in the vehicle under the condition that the voice conversation type is a non-sustainable type;

according to the in-car image information, user state identification is carried out, and second user state information of the target user identified in the in-car image information is obtained;

determining the adjustment willingness level of the target user to the current volume according to the second user state information and/or the in-vehicle environment light information;

the determining whether the adjustment willingness level meets a preset volume adjustment condition includes:

Under the condition that the voice conversation type is a non-sustainable type and the intensity of the adjustment willingness level representation adjustment willingness is larger than a preset intensity, determining that the adjustment willingness level meets a preset volume adjustment condition;

And under the condition that the voice conversation type is a non-sustainable type and the intensity of the adjustment willingness level representation adjustment willingness degree is not larger than a preset intensity, determining that the adjustment willingness level does not meet a preset volume adjustment condition.

In the above embodiment, when the in-vehicle voice conversation type is detected to be a non-sustainable type, the in-vehicle image information may be further obtained, for example, the data collected by the in-vehicle camera may be analyzed, the user state may be determined, for example, the passenger sitting in the co-driver position is in a rest state, the adjustment willingness degree of the target user to the current volume may be determined to meet the preset volume adjustment condition, and/or the in-vehicle ambient light information may be obtained, for example, the data collected by the in-vehicle light sensor may be obtained, the analysis of the in-vehicle ambient light information, for example, the cabin light of the rear-row in the vehicle may be in an off state, and the user state indicated by the rear-row ambient light level may be determined to be in a rest state, and the adjustment willingness degree of the target user to the current volume may also be determined to meet the preset volume adjustment condition. It can be known that, by adopting the above embodiment, the in-vehicle middle volume is dynamically adjusted according to the user state information indicated by the multiple information, so that the accuracy of judging whether the adjustment willingness level meets the preset volume adjustment condition or not under the condition that the voice dialogue type is the non-sustainable type is improved, the accuracy and the efficiency of controlling the volume in the vehicle are further improved, and the driver is further helped to concentrate attention on the road, so that the driving safety is improved.

In an optional implementation manner, when determining a volume adjustment mode according to the current volume and the voice dialogue type, the method includes:

determining location information of the target user in the vehicle;

Determining target audio equipment of the position information association area from the audio equipment in the vehicle;

and determining a volume adjustment mode to reduce the current volume of the target audio equipment under the condition that the voice conversation type is the sustainability type and the current volume is larger than or equal to a preset volume threshold value.

In the above embodiment, the audio device associated with the position may be determined according to the position of the target user in the vehicle, for example, the passenger sits on the left side of the rear row, and the associated audio device may be a speaker mounted on the left rear door and a bass unit mounted on a storage board behind the rear seat of the vehicle. Then according to the voice dialogue with the sustainability type in the current car, and the current volume is larger than or equal to a preset volume threshold, for example, the preset volume threshold is 40 db, and the current car volume is 65 db, the volume of the target audio equipment can be determined to be reduced, and meanwhile, the volume of other non-target audio equipment can be kept unchanged. Thus, the dynamic adjustment of the volume in the vehicle can be realized, and different audio devices can be adjusted according to different associated positions, so that the fineness and accuracy in controlling the volume in the vehicle can be improved.

In a second aspect, an optional implementation manner of the disclosure further provides an electronic device, including a processor, and a memory, where the memory stores machine-readable instructions executable by the processor, and the processor is configured to execute the machine-readable instructions stored in the memory, where the machine-readable instructions are executed by the processor, where the processor performs the steps in the first aspect, or any possible implementation manner of the first aspect.

In a third aspect, an optional implementation manner of the disclosure further provides a vehicle, where the vehicle includes the electronic device in any one of the possible implementation manners of the second aspect.

In a fourth aspect, an alternative implementation of the present disclosure further provides a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the steps of the first aspect, or any of the possible implementation manners of the first aspect.

The description of the effects of the volume control device, the electronic apparatus, and the computer-readable storage medium in the vehicle is referred to the description of the volume control method in the vehicle, and is not repeated here.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the aspects of the disclosure.

The foregoing objects, features and advantages of the disclosure will be more readily apparent from the following detailed description of the preferred embodiments taken in conjunction with the accompanying drawings.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings required for the embodiments are briefly described below, which are incorporated in and constitute a part of the specification, these drawings showing embodiments consistent with the present disclosure and together with the description serve to illustrate the technical solutions of the present disclosure. It is to be understood that the following drawings illustrate only certain embodiments of the present disclosure and are therefore not to be considered limiting of its scope, for the person of ordinary skill in the art may admit to other equally relevant drawings without inventive effort.

FIG. 1 illustrates a flow chart of a method of volume control in a vehicle provided by an embodiment of the present disclosure;

FIG. 2 illustrates a schematic diagram of one possible in-vehicle audio device layout provided by an embodiment of the present disclosure;

FIG. 3 shows a schematic diagram of an electronic device provided by an embodiment of the present disclosure;

Fig. 4 shows a schematic diagram of a vehicle provided by an embodiment of the present disclosure.

Detailed Description

It will be appreciated that prior to using the technical solutions disclosed in the embodiments of the present disclosure, the user should be informed and authorized of the type, usage range, usage scenario, etc. of the personal information related to the present disclosure in an appropriate manner according to the relevant legal regulations.

For the purposes of making the objects, technical solutions and advantages of the embodiments of the present disclosure more apparent, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below with reference to the drawings in the embodiments of the present disclosure, and it is apparent that the described embodiments are only some embodiments of the present disclosure, but not all embodiments. The components of the disclosed embodiments generally described and illustrated herein may be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present disclosure is not intended to limit the scope of the disclosure, as claimed, but is merely representative of selected embodiments of the disclosure. All other embodiments, which can be made by those skilled in the art based on the embodiments of this disclosure without making any inventive effort, are intended to be within the scope of this disclosure.

For the convenience of understanding the technical solutions of the present disclosure, technical terms in the embodiments of the present disclosure will be described first:

According to research, when a person in the vehicle has the requirement of adjusting the volume of the audio equipment in the vehicle, the prior art can only manually adjust the volume in the vehicle by rotating a knob or a volume increasing and decreasing key by the person on the vehicle, and in this way, the requirement of a user cannot be met, especially when a driver drives the vehicle, the driver can not pay attention to manually adjust the audio equipment to a proper volume for the passenger, and the driving safety can be seriously influenced.

Based on the above study, the present disclosure provides a method for controlling volume in a vehicle, in which a voice dialogue type of a target user in the vehicle is determined during a process of playing audio content by a vehicle audio device, and a willingness level of the target user to adjust the current volume of the vehicle audio device is determined according to the voice dialogue type; judging whether the current adjustment willingness degree level meets a preset volume adjustment condition, and determining a volume adjustment mode according to the voice dialogue type and the adjustment willingness degree level under the condition that the preset volume adjustment condition is met, so as to control and adjust the current volume of the vehicle. Therefore, the level of the adjustment willingness of the target user to the current volume of the vehicle audio equipment can be determined according to the voice dialogue type in the vehicle, and then the corresponding volume adjustment mode is determined to carry out volume adjustment, so that different requirements of the user to the audio equipment in the vehicle can be met, the volume adjustment meeting the requirements of the user is automatically carried out, the driver is not required to actively intervene and adjust, the driver is helped to keep concentration of attention, and driving safety and riding experience are improved.

The present invention is directed to a method for manufacturing a semiconductor device, and a semiconductor device manufactured by the method.

It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.

For the sake of understanding the present embodiment, first, a detailed description will be given of a method for controlling a volume in a vehicle disclosed in an embodiment of the present disclosure, where an execution body of the method for controlling a volume in a vehicle provided in an embodiment of the present disclosure is generally an electronic device having a certain computing capability, and the electronic device includes, for example: a terminal device or server or other processing device. In some possible implementations, the method of volume control in the vehicle may be implemented by way of a processor invoking computer readable instructions stored in a memory.

The following describes a volume control method in a vehicle provided in an embodiment of the present disclosure, taking an execution subject as an apparatus having processing capability mounted on the vehicle as an example.

Referring to fig. 1, a flowchart of a method for controlling volume in a vehicle according to an embodiment of the disclosure is shown, where the method includes:

s101: and in the process of playing the audio content by the vehicle audio equipment, determining the voice dialogue type of a target user in the vehicle, and determining the adjustment willingness degree grade of the target user on the current volume of the vehicle audio equipment according to the voice dialogue type, wherein different grades represent different intensities of the adjustment willingness degree.

In the solution of the embodiment of the disclosure, the audio device in the vehicle may be a speaker mounted on the vehicle, or may be a sound connected to the audio control unit of the automobile through an audio cable, for example, 3.5mm, or may be a bluetooth sound connected through bluetooth, which is not limited by the embodiment of the disclosure. Wherein, the above-mentioned car-mounted speaker can include 8 speakers at least: the speaker is respectively one on both sides of the front console, the speaker is respectively one on the left and right front row of vehicle doors, the speaker is respectively one on the left and right rear row of vehicle doors, and the speaker is respectively one on the left and right sides of the storage board behind the rear row of seats, which is not limited by the embodiment of the disclosure.

When the audio equipment plays the audio content, the audio playing can be performed at different volumes, and the specific volume can be determined according to the actual requirements of users positioned at different positions.

Based on the above embodiment, the adjustment willingness level of the current volume of the user can be determined according to different voice dialogue types in the vehicle, the determined adjustment willingness level can be compared with the adjustment willingness level in the preset volume adjustment conditions, and if the adjustment willingness level of the user is higher than the preset adjustment willingness level, the preset volume adjustment conditions can be considered to be satisfied. Therefore, different adjustment willingness degree grades can be determined according to different voice dialogue types, whether volume adjustment is carried out or not and how the volume adjustment is carried out are determined, flexibility of a volume adjustment scheme in a vehicle is improved, and accuracy in controlling the volume in the vehicle is improved.

S102: judging whether the adjustment willingness level meets the preset volume adjustment condition, and determining a volume adjustment mode according to the voice dialogue type and the adjustment willingness level under the condition that the adjustment willingness level meets the preset volume adjustment condition.

In this step, the voice dialogue type and the adjustment willingness level determine the direction of current volume adjustment, for example, the voice dialogue type is sustainable, the adjustment willingness level indicates that the adjustment willingness level is higher in intensity, and the volume can be adjusted according to the current sound volume condition, for example, the sound volume of the sound is higher than a preset volume threshold, and the sound volume of the sound is reduced to be lower than the preset volume threshold to adapt to the current sustainable voice dialogue requirement. The specific volume reduction amplitude can be determined according to the difference between the current volume and the preset volume threshold, for example, if the difference is larger, the volume reduction amplitude can be reduced to the preset volume threshold, and if the difference is smaller, the volume reduction amplitude can be reduced to a volume value smaller than the preset volume threshold by a certain volume so as to enable the volume adjustment amplitude of the sound equipment to be within a certain amplitude range while meeting the requirement.

In a specific implementation, a preset noise level criterion may also be obtained, for example: 0-20 db: very quiet and hardly felt; 20-40 dB: quiet as a whisper; 40-60 dB: general indoor talking; 60-70 dB: noisy, lossy nerves; 70-90 db: the noisy and nerve cells are destroyed; 90-100 dB: loud and aggravated, hearing impaired; the standard volume may be set to 20-40 db in the above scale; the volume adjustment mode is determined according to the noise level of the current volume, for example, the noise level of the current volume of the vehicle audio equipment is 20-40 db in the above levels, at this time, the volume adjustment mode can be determined to keep the current volume, for example, the noise level of the current volume is 60-70 db, at this time, the current volume can be reduced to 20-40 db in the above levels, the specific reduced volume amplitude can be determined according to the mapping relation (60-70 db is respectively mapped to 20-40 db), for example, the current volume is 60 db, the current volume can be reduced to 20 db, the current volume is 70 db, and the current volume can be reduced to 40 db, so that the volume reduction amplitude is relatively stable. In addition, the above-mentioned volume adjustment mode can also be determined by combining the indexes of noise, vibration and harshness (Noise, vibration, harshness, NVH) of the automobile, for example, the current sustainable voice dialogue type is that the automobile has larger noise, the adjustment willingness level of the user indicates that the user has strong willingness to adjust the volume, and at the moment, the volume of the audio equipment of the automobile can be increased so as to reduce the influence of the interference sound on the voice dialogue; or for example, the user is not currently engaged in a voice conversation but is in a rest state, and when the adjustment willingness level is determined to indicate that the user has strong willingness to adjust the volume, the volume can be adjusted down to avoid affecting the rest of the user (such a situation can be understood in combination with the following description: in the case that the voice conversation type is a non-sustainable type, the adjustment willingness level for the current volume can be further determined based on the second user state information).

S103: and controlling and adjusting the current volume of the vehicle according to the volume adjustment mode.

In the step, when the volume is adjusted, the audio devices at different positions can be adjusted according to a certain sequence, for example, the rear-row sound closest to the rear-row passengers is adjusted firstly, then the front-row sound is adjusted, in the adjusting process, the state of the target object can be captured in real time through the camera in the vehicle, and meanwhile, the audio devices are adjusted in volume in a continuous smaller range, so that the target object is prevented from being disturbed due to overlarge one-time adjustment range.

The above steps are specifically described below in several exemplary scenarios.

For the step S101, the disclosure provides a possible implementation manner, which specifically includes:

a possible implementation manner, determining a voice dialogue type of a target user in the vehicle includes:

and according to the dialogue theme, the voice dialogue type of the target user in the vehicle is determined.

In the above embodiment, after the in-vehicle sound information is obtained, the information of the audio content being played by the current in-vehicle audio device may be obtained again, and the in-vehicle sound information is subjected to a filtering process based on the information of the audio content, so as to avoid excessive interference of the voice information existing in the audio content to a subsequent judging process. And then the processed sound information in the vehicle can be input into a pre-trained neural network model, and whether the sound information in the vehicle exists or not can be judged by matching the fixed voice frequency with the processed sound information in the vehicle. In the case that the voice information exists, semantic analysis is carried out on the extracted voice information, dialogue topics of the voice information are determined, such as topics of 'last seen movie', 'plan of the weekend', and the like, and whether a plurality of passengers in a vehicle are chatting or a passenger is calling at present can be judged through analysis on continuity of the voice information, such as discontinuous voice information of 'what you are ready to get dry on the weekend', 'what me wants to get together', the passenger can be judged to be calling for chatting, the voice dialogue type of a target user can be determined to be a sustainable type or a non-sustainable type according to the dialogue topics, and the voice dialogue type of the target user can be determined to be a sustainable type when the dialogue topic is 'last seen movie'. Thus, by analyzing the dialogue topic, the voice dialogue type can be accurately determined, thereby helping to improve the accuracy of adjusting the volume.

When talking, people usually have rich facial expressions and limb actions, in order to further improve accuracy of judging a conversation topic and a voice conversation type, target image information of a target user corresponding to the voice information, such as data acquired by a camera in a vehicle, can be acquired, first user state information of the target user is acquired according to the target image information, a conversation scene of the target user in the vehicle is determined according to the first user state information and the conversation topic, and the voice conversation type of the target user in the vehicle is determined to be a sustainable type or a non-sustainable type according to the conversation scene. After the target image information is obtained, expression information and gesture information of the target object can be extracted from the image information, state information of the target object such as agitation, happiness and the like can be judged, a conversation scene of the target user is determined according to the state information and conversation subjects, and then a voice conversation type is determined, for example, the target object smiles and chat about recently eaten delicacies, namely, the user chat scene is determined, the voice conversation type can be determined to be a sustainable type based on the conversation scene, for example, the target object tired chat about how long the target object reaches a destination is determined, the conversation scene is a disposable question-answer scene, and the voice conversation type can be determined to be a non-sustainable type based on the conversation scene. Therefore, by combining the target image information of the target user and the dialogue theme, the accuracy of judging the voice dialogue type can be improved, a more proper volume adjustment mode can be facilitated, and the accuracy of controlling the volume in the vehicle is improved.

Because the voice dialogue with the sustainable type in the vehicle is an important basis for adjusting the volume in the vehicle, in order to further improve the accuracy when the voice dialogue type of the target user is the sustainable type, the voice dialogue type of the target user in the vehicle can be determined to be the sustainable type according to the dialogue topic; and when the voice conversation type of the target user in the vehicle is determined to be the sustainable type or the non-sustainable type according to the first user state information and the conversation topic, determining a conversation scene of the target user in the vehicle according to the first user state information and the conversation topic, and determining that the voice conversation type of the target user in the vehicle is the sustainable type under the condition that the conversation scene meets the condition of the sustainable conversation scene.

Thus, not only can the voice dialogue type of the target user be determined to be the sustainability type through the dialogue topic, but also the dialogue scene of the target user can be determined firstly through the state information of the user and the dialogue topic, for example, the target object is in a concentration state: the target user can judge the dialogue scene as a conference scene by wearing the earphone to watch the handheld notebook computer, and the dialogue topic is the progress of the development work in the week, and under the scene, the speaking content and the frequency of the target object can be at a lower level, but the voice dialogue type is also judged as a sustainable type because the target user is not disturbed by external sounds, namely the audio content played by the audio equipment in the car during the conference. The method can determine whether the dialogue scene accords with the sustainable dialogue scene condition by judging whether the dialogue theme accords with the sustainable dialogue theme condition or not, and can further analyze the user state information and the dialogue theme to determine the dialogue scene, so that the accuracy of judging that the voice dialogue type of the target user is the sustainable type is improved.

Further, the voice dialogue type of the target user may be a sustainable type or a non-sustainable type, and the determination process of the latter may be implemented in several ways, including:

1) In a possible implementation manner, the determining the voice dialogue type of the target user in the vehicle includes:

and under the condition that the voice information is not existed in the in-vehicle voice information, determining that the voice dialogue type of the target user in the vehicle is a non-sustainable type.

2) In another possible implementation manner, the determining, according to the dialog topic, that the voice dialog type of the target user in the vehicle is a non-sustainable type includes: and determining that the voice conversation type of the target user in the vehicle is a non-sustainable type under the condition that the conversation topic does not meet the sustainable conversation topic condition.

3) In another possible implementation manner, the determining that the voice dialogue type of the target user in the vehicle is a non-sustainable type according to the first user state information and the dialogue topic includes: and determining a dialogue scene of the target user in the vehicle according to the first user state information and the dialogue topic, and determining that the voice dialogue type of the target user in the vehicle is a non-sustainable type under the condition that the dialogue scene does not accord with a sustainable dialogue scene condition.

In the above embodiment, it is possible to determine that the voice conversation type of the target user in the vehicle is the non-sustainable type by the above three methods, so as to improve the accuracy of determining that the voice conversation type of the target user is the sustainable type, and reduce the possibility of erroneously adjusting the volume in the vehicle, according to the user status information and the conversation topic, for example, the passenger expression is restless, and the conversation topic is the insurance promotion.

After determining the type of the voice conversation, determining the willingness level of the target user for adjusting the current volume according to the voice conversation type, including:

and under the condition that the voice conversation type is the sustainability type, determining that the adjustment willingness level of the target user on the current volume meets a preset volume adjustment condition. When a sustainable voice dialogue exists in the vehicle, it can be easily understood that the adjustment of the volume in the vehicle is needed, that is, the adjustment willingness level of the target user to the current volume is determined to meet the preset volume adjustment condition. Therefore, when the sustainable voice dialogue exists in the vehicle, the requirement for adjusting the volume can be determined, and the judgment accuracy of the sustainable voice dialogue is improved.

Further, when the voice dialogue type is the sustainable type, the adjustment willingness level can be determined to meet the preset volume adjustment condition, and when the voice dialogue type is the non-sustainable type, the in-vehicle image information and/or the in-vehicle environment light information in the vehicle can be further acquired; according to the in-car image information, user state identification is carried out, and second user state information of the target user identified in the in-car image information is obtained; determining the adjustment willingness level of the target user to the current volume according to the second user state information and/or the in-vehicle environment light information; and under the condition that the voice dialogue type is a non-sustainable type and the intensity of the adjustment willingness degree grade representing the adjustment willingness degree is larger than the preset intensity, determining that the adjustment willingness degree grade meets the preset volume adjustment condition, and under the condition that the intensity of the adjustment willingness degree grade representing the adjustment willingness degree is not larger than the preset intensity, determining that the adjustment willingness degree grade does not meet the preset volume adjustment condition.

For example, data acquired by a camera in a vehicle can be acquired, then the data can be input into a pre-trained neural network model to obtain the state information, for example, a rear passenger is in a rest state, according to the rest state, the adjustment willingness level of the rear passenger to the current volume can be determined to be a first level, the target user is characterized to have the adjustment willingness level which is larger than the preset intensity, and the adjustment willingness level meets the preset volume adjustment condition; for another example, the environment in the vehicle is dim, which can also indicate that the user wants to rest, and the adjustment willingness level of the rear passenger to the current volume can be determined to be the first level. Therefore, when the voice conversation type is of a non-sustainable type, whether the target user meets the preset volume adjustment condition on the adjustment willingness level of the volume in the current vehicle can be further determined based on the user state and/or the in-vehicle environment light information, the accuracy of judging whether the adjustment willingness level meets the preset volume adjustment condition can be further improved, and the accuracy and the efficiency of volume control in the vehicle are further improved.

For step S102, when determining a volume adjustment mode according to the current volume and the voice dialogue type, location information of the target user in the vehicle may be determined; determining target audio equipment of the position information association area from the audio equipment in the vehicle; and under the condition that the voice conversation type is the sustainability type and the current volume is greater than or equal to a preset volume threshold, determining a volume adjustment mode to reduce the current volume of the target audio equipment to a first target volume according to the adjustment willingness level, wherein the first target volume is matched with the adjustment willingness level. For example, the target user may be seated in the vehicle at the left rear row, where it may be determined that the associated target audio device may include at least speakers mounted on the left rear row door, and that the current volume is 45 db greater than the first target volume (determined based on the current adjustment willingness level), may be 30 db, and the speakers on the left rear row door may be lowered such that the current volume is less than 30 db, may be 20 db. Therefore, by reducing the volume of the target audio equipment associated with the position area where the target user is located, the interference of the volume in the vehicle to the target user can be reduced under the condition that the volume of the front-row audio equipment is kept unchanged, the accuracy and fineness of volume control in the vehicle are improved, and a driver or passengers at other positions cannot be influenced to acquire audio content through the audio equipment respectively associated with the positions, so that the driver can acquire more information about roads, and the driving safety is improved.

After the current volume of the vehicle is controlled and adjusted according to the volume adjustment mode, the adjustment willingness degree of the target user can be continuously detected, and when the condition that the preset volume recovery condition is met is detected, the volume of the audio equipment in the vehicle can be recovered to the volume level before the last adjustment. For example, after the speakers in the vehicle are all turned off from the original 45 db, the sound information and the image information in the vehicle are continuously acquired, and when the passenger is detected to be recovered from the rest state to the awake state, and the voice conversation type of the passenger is the non-sustainable type, the speakers in the vehicle can be recovered to 45 db.

It will be appreciated by those skilled in the art that in the above-described method of the specific embodiments, the written order of steps is not meant to imply a strict order of execution but rather should be construed according to the function and possibly inherent logic of the steps.

The following describes an exemplary method for controlling the volume of a vehicle according to an embodiment of the present disclosure in a specific application scenario.

For example, taking two passengers mounted on a taxi as an example, referring to fig. 2, a layout schematic diagram of speakers in the taxi may be shown, where No. 1 and No. 2 represent speakers mounted on two sides of an automobile front console, no. 3 and No. 4 represent speakers mounted on left and right doors of an automobile front row, no. 5 and No. 6 represent speakers mounted on left and right doors of an automobile rear row, and No. 7 and No. 8 represent speakers mounted on left and right sides of a storage board behind a rear seat of the automobile. The 8 speakers can simultaneously play audio contents related to current traffic road information at a volume of 60 db. After the passenger gets on, for example, one passenger sits in the co-driver position and the other passenger sits in the left-hand position of the rear row, i.e. the position behind the driver. The method comprises the steps of obtaining sound information and image information in a vehicle, then directly inputting the information into a pre-trained neural network model, directly obtaining whether the voice types of two passengers and a driver meet preset volume adjustment conditions or not, and also obtaining that the voice types of the passengers at a copilot position are non-sustainable types through analyzing the data, and determining that the voice types of the passengers at the copilot position do not meet the preset volume adjustment conditions by combining the state information of the passengers.

Since the adjustment willingness degree of the rear passengers meets the preset volume adjustment condition, the speakers associated with the rear passengers can be determined to be all 8 speakers in the vehicle, and at this time, the corresponding volume adjustment mode can be determined according to the mapping relationship between the position of the preset target user and the volume, for example, the volume adjustment mode can be: reducing the number 1 loudspeaker arranged on the left side of the automobile front console from original 60 dB to 20 dB; reducing the number 2 loudspeaker arranged on the right side of the automobile front console from original 60 dB to 40 dB; reducing the number 3 loudspeaker arranged on the left side door of the automobile front row from original 60 dB to 20 dB; the method comprises the steps of reducing a number 4 loudspeaker arranged on a right side automobile door of an automobile front row from original 60 dB to 40 dB; closing a No. 5 loudspeaker arranged on a left side door of a rear row of the automobile, namely reducing the original 60 dB to 0 dB; the method comprises the steps of reducing a number 6 loudspeaker arranged on a right side door of a rear row of an automobile from original 60 dB to 10 dB, and closing a number 7 loudspeaker arranged on the left side of a storage plate behind a rear row of the automobile, namely reducing the number from original 60 dB to 0 dB; and reducing the number 8 loudspeaker arranged on the right side of the object placing plate behind the rear seat of the automobile from the original 60 dB to 20 dB, and adjusting the volume of each loudspeaker according to the volume adjusting mode.

Therefore, the driver at the main driving position and the passengers at the assistant driving position can still hear the traffic road information broadcasted in the loudspeaker, the driving safety is improved, meanwhile, the passengers at the rear row are not interfered by the volume in the vehicle, the sustainable voice dialogue can be smoothly carried out, the accuracy and the efficiency of controlling the volume in the vehicle are improved, and the fineness of controlling the volume in the vehicle is improved.

The embodiment of the disclosure further provides an electronic device, as shown in fig. 3, which is a schematic structural diagram of the electronic device provided by the embodiment of the disclosure, including:

A processor 31 and a memory 32; the memory 32 stores machine readable instructions executable by the processor 31, the processor 31 being configured to execute the machine readable instructions stored in the memory 32, the machine readable instructions when executed by the processor 31, the processor 31 being configured to perform the steps of:

In a possible embodiment, the processor 31 is configured to, when determining a voice dialogue type of a target user in the vehicle:

In a possible embodiment, the processor 31 determines a voice dialogue type of the target user in the vehicle according to the dialogue topic, including:

A possible embodiment, the voice conversation type of the target user in the vehicle is a sustainability type, comprising:

The dialogue topic meets the sustainable dialogue topic condition; or alternatively

The dialog scene meets sustainability dialog scene conditions.

A possible embodiment, the voice conversation type of the target user in the vehicle is a non-sustainable type, comprising:

the voice information does not exist in the sound information in the vehicle; or alternatively

The conversation topic does not conform to sustainable conversation topic conditions; or alternatively

The dialog scene does not conform to the sustainability dialog scene condition.

In a possible embodiment, when the processor 31 determines, according to the voice dialogue type, a willingness level of the target user to adjust the current volume of the vehicle audio device, the processor is configured to:

Determining that the target user has an adjustment willingness level of the current volume as a first level under the condition that the voice conversation type is a sustainable type, wherein the first level represents that the adjustment willingness level is greater than a preset strength;

And under the condition that the intensity of the adjustment willingness level representing the adjustment willingness is larger than the preset intensity, determining that the adjustment willingness level meets the preset volume adjustment condition.

In a possible embodiment, the processor 31 is configured to, when determining the volume adjustment mode according to the voice dialogue type and the adjustment willingness level:

determining location information of the target user in the vehicle;

And under the condition that the voice conversation type is the sustainability type and the current volume is greater than or equal to a preset volume threshold, determining a volume adjustment mode to reduce the current volume of the target audio equipment to a first target volume according to the adjustment willingness level, wherein the first target volume is matched with the adjustment willingness level.

The memory 32 includes a memory 321 and an external memory 322; the memory 321 is also referred to as an internal memory, and is used for temporarily storing operation data in the processor 31 and data exchanged with an external memory 322 such as a hard disk, and the processor 31 exchanges data with the external memory 322 via the memory 321.

The specific execution process of the above instruction may refer to the steps of the vehicle volume control method described in the embodiments of the present disclosure, and will not be described herein.

Referring to fig. 4, a schematic diagram of a vehicle according to an embodiment of the disclosure is provided, where the vehicle includes the electronic device in the foregoing embodiment.

In the embodiment of the disclosure, the vehicle is, for example, a fuel vehicle, an electric hybrid vehicle, a ship, an unmanned aerial vehicle, and the like, and the vehicle further includes various sensors, audio devices, a display device, a processing device, and the like, where the electronic device in the above embodiment may be the processing device in the vehicle, for example, the sensor may acquire sound information, image information, and ambient light information in the vehicle, and transmit the sound information, the image information, and the ambient light information to the processing device to process the sound information, the image information, and the ambient light information in the vehicle, so as to determine a voice conversation type of a target user in the vehicle, determine whether an adjustment willingness level of the target user for a current volume meets a preset volume adjustment condition according to the voice conversation type, determine a volume adjustment manner according to the voice conversation type and the adjustment willingness level, and control the current volume of the vehicle according to the volume adjustment manner.

Therefore, the volume of each audio device in the vehicle can be automatically adjusted by determining the level of the willingness degree of the person in the vehicle to adjust the volume in the current vehicle, and the efficiency and the accuracy of controlling the volume in the vehicle are improved.

The disclosed embodiments also provide a computer-readable storage medium having stored thereon a computer program which, when executed by a processor, performs the steps of the method for controlling sound volume in a vehicle described in the above method embodiments. Wherein the storage medium may be a volatile or nonvolatile computer readable storage medium.

The embodiments of the present disclosure further provide a computer program product, where the computer program product carries a program code, where instructions included in the program code may be used to execute the steps of the method for controlling a sound volume in a vehicle described in the foregoing method embodiments, and specifically reference may be made to the foregoing method embodiments, which are not described herein.

The methods of the present application may be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented in software, may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions of the present application are performed in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, a network device, a user device, a core network device, an operation administration maintenance (Operation Administration AND MAINTENANCE, OAM) or other programmable device.

The computer program or instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer program or instructions may be transmitted from one website site, computer, server, or data center to another website site, computer, server, or data center by wired or wireless means. The computer readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server, data center, etc. that integrates one or more available media. The usable medium may be a magnetic medium, e.g., floppy disk, hard disk, tape; but also optical media such as digital video discs; but also semiconductor media such as solid state disks. The computer readable storage medium may be volatile or nonvolatile storage medium, or may include both volatile and nonvolatile types of storage medium.

In addition, each functional unit in each embodiment of the present disclosure may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.

The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a non-volatile computer readable storage medium executable by a processor. Based on such understanding, the technical solution of the present disclosure may be embodied in essence or a part contributing to the prior art or a part of the technical solution, or in the form of a software product stored in a storage medium, including several instructions for causing an electronic device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present disclosure. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

Finally, it should be noted that: the foregoing examples are merely specific embodiments of the present disclosure, and are not intended to limit the scope of the disclosure, but the present disclosure is not limited thereto, and those skilled in the art will appreciate that while the foregoing examples are described in detail, it is not limited to the disclosure: any person skilled in the art, within the technical scope of the disclosure of the present disclosure, may modify or easily conceive changes to the technical solutions described in the foregoing embodiments, or make equivalent substitutions for some of the technical features thereof; such modifications, changes or substitutions do not depart from the spirit and scope of the technical solutions of the embodiments of the disclosure, and are intended to be included within the scope of the present disclosure. Therefore, the protection scope of the present disclosure shall be subject to the protection scope of the claims.

Claims

1. A method of controlling sound volume in a vehicle, comprising:

determining a voice dialogue type of a target user in a vehicle in the process of playing audio content by vehicle audio equipment, and determining the level of adjustment willingness of the target user to the current volume of the vehicle audio equipment according to the voice dialogue type, wherein the different levels represent different intensities of adjustment willingness;

2. The method of claim 1, wherein the determining the type of voice dialog for the target user in the vehicle comprises:

3. The method of claim 2, wherein determining the type of voice dialog for the target user in the vehicle based on the dialog topic comprises:

4. A method according to claim 3, wherein the type of voice dialog of the target user in the vehicle is a sustainability type, comprising:

The dialog scene meets sustainability dialog scene conditions.

5. A method according to claim 3, wherein the type of voice dialog of the target user in the vehicle is of the non-sustainable type, comprising:

The dialog scene does not conform to the sustainability dialog scene condition.

6. The method according to any one of claims 3 to 5, wherein determining, according to the voice conversation type, a level of willingness of the target user to adjust a current volume of the vehicle audio device includes:

7. The method according to any one of claims 3 to 5, wherein determining, according to the voice conversation type, a level of willingness of the target user to adjust a current volume of the vehicle audio device includes:

8. The method of claim 3, wherein said determining a volume adjustment based on said voice dialog type and said adjustment willingness level comprises:

determining location information of the target user in the vehicle;

9. An electronic device, comprising: a processor, a memory storing machine-readable instructions executable by the processor, the processor for executing the machine-readable instructions stored in the memory, the machine-readable instructions when executed by the processor for performing the steps of:

10. A vehicle, characterized in that it comprises an electronic device according to claim 9.

11. A computer-readable storage medium having stored thereon a computer program, characterized by: the computer program implementing the steps of the method of any one of claims 1 to 8 when executed by a processor.