CN111107214A

CN111107214A - Volume adjusting method and device

Info

Publication number: CN111107214A
Application number: CN201911251436.7A
Authority: CN
Inventors: 王立果
Original assignee: Xian Yep Telecommunication Technology Co Ltd
Current assignee: Xian Yep Telecommunication Technology Co Ltd
Priority date: 2019-12-09
Filing date: 2019-12-09
Publication date: 2020-05-05

Abstract

The application provides a volume adjusting method and device. The method comprises the following steps: the method comprises the steps of obtaining first picture information and second picture information through electronic equipment, wherein the first picture information and the second picture information are used for representing the same facial features of the same object in pictures at different shooting moments. And the electronic equipment determines a volume compensation value according to the corresponding relation between the volume and the picture information. The electronic device compensates the current volume of the electronic device based on the volume compensation value. In the application, the electronic equipment can accurately determine the change of the volume of the electronic equipment based on the corresponding relation between the volume and the picture information along with the change of the same facial features of the same object at different shooting moments, so that the process of automatically adjusting the volume of the electronic equipment is realized, the electronic equipment can send out sound which is heard clearly by the appropriate object, the conversation experience of the object is improved, additional equipment does not need to be added, and the equipment cost is reduced.

Description

Volume adjusting method and device

Technical Field

The present disclosure relates to the field of electronic technologies, and in particular, to a volume adjusting method and device.

Background

In daily life, people often use electronic devices such as mobile phones to communicate anytime and anywhere to shorten the distance between the people. When both parties of a call object adopt the electronic equipment to carry out hands-free call, in order to acquire the call with higher quality, both parties of the call often need to manually adjust the volume of the loudspeaker according to the distance between the both parties and the electronic equipment, so that both parties of the call are inconvenient to use the electronic equipment to carry out the call, the call of the electronic equipment is more cumbersome, and the call experience of people is influenced.

Disclosure of Invention

The application provides a volume adjusting method and a volume adjusting device, which are used for solving the problem that a call object is inconvenient to use an electronic device because the call object needs to manually adjust the volume of the electronic device in the existing call process.

In a first aspect, the present application provides a volume adjustment method applied to an electronic device, the method including:

acquiring first picture information and second picture information, wherein the first picture information and the second picture information are used for representing the same facial features of the same call object in pictures at different shooting moments;

determining a volume compensation value according to the corresponding relation between the volume and the picture information, wherein the volume compensation value is related to the first picture information and the second picture information;

compensating the current volume of the electronic equipment based on the volume compensation value.

Optionally, the determining a volume compensation value according to a correspondence between the volume and the picture information includes:

determining a target distance according to a corresponding relation between the distance and the picture information, wherein the target distance is related to the first picture information and the second picture information, and the target distance is used for representing the distance of the call object moving between the shooting time corresponding to the first picture information and the shooting time corresponding to the second picture information;

and determining the volume compensation value according to the corresponding relation between the distance and the volume, wherein the volume compensation value is related to the target distance.

Optionally, the determining the target distance according to the corresponding relationship between the distance and the picture information includes:

determining a first distance corresponding to the first picture information according to a corresponding relation between the distance and the picture information, wherein the first distance is the distance between the call object and the electronic equipment at the shooting time corresponding to the first picture information;

determining a second distance corresponding to the second picture information according to a corresponding relation between the distance and the picture information, wherein the second distance is the distance between the call object and the electronic equipment at the shooting time corresponding to the second picture information;

determining the target distance as an absolute value of a difference between the first distance and the second distance.

Optionally, when the first picture information is used to characterize other facial features except for ears of the call subject, and before determining the volume compensation value according to the correspondence between distance and volume, the method further includes:

and determining the target distance as the sum of the target distance and a third distance, wherein the third distance is the actual distance between the ear of the call object and the facial feature represented by the first picture information.

Optionally, the volume compensation value satisfies the following formula (1);

wherein FL is the target distance, and Δ L is the volume compensation value.

Optionally, the compensating the current volume of the electronic device based on the volume compensation value includes:

and when the second distance is greater than the first distance, increasing and compensating the current volume of the electronic equipment based on the volume compensation value to obtain the compensated volume.

Optionally, the increasing and compensating the current volume of the electronic device based on the volume compensation value to obtain the compensated volume includes:

when the sum of the volume compensation value and the current volume is smaller than the maximum volume value of the electronic equipment, determining the compensated volume as the sum of the volume compensation value and the current volume; alternatively, the first and second electrodes may be,

and when the sum of the volume compensation value and the current volume is greater than or equal to the maximum volume value of the electronic equipment, determining the compensated volume as the maximum volume value.

and when the second distance is smaller than the first distance, based on the volume compensation value, carrying out reduction compensation on the current volume of the electronic equipment to obtain the compensated volume.

Optionally, the performing, based on the volume compensation value, reduction compensation on the current volume of the electronic device to obtain a compensated volume includes:

when the difference value between the current volume and the volume compensation value is larger than the minimum volume value of the electronic equipment, determining the compensated volume as the difference value between the current volume and the volume compensation value; alternatively, the first and second electrodes may be,

and when the difference value between the current volume and the volume compensation value is smaller than or equal to the minimum volume value of the electronic equipment, determining the compensated volume as the minimum volume value.

In a second aspect, the present application provides a volume adjustment device, comprising:

the system comprises an acquisition module, a processing module and a display module, wherein the acquisition module is used for acquiring first picture information and second picture information, and the first picture information and the second picture information are used for representing the same facial features of the same call object in pictures at different shooting moments;

the determining module is used for determining a volume compensation value according to the corresponding relation between the volume and the picture, wherein the volume compensation value is related to the first picture information and the second picture information;

and the compensation module is used for compensating the current volume of the electronic equipment based on the volume compensation value.

Optionally, the determining module is configured to determine a target distance according to a correspondence between a distance and picture information, where the target distance is related to the first picture information and the second picture information, and the target distance is used to indicate a distance that the call target moves between a shooting time corresponding to the first picture information and a shooting time corresponding to the second picture information; and determining the volume compensation value according to the corresponding relation between the distance and the volume, wherein the volume compensation value is related to the target distance.

Optionally, the determining module is specifically configured to determine, according to a correspondence between a distance and picture information, a first distance corresponding to the first picture information, where the first distance is a distance between the call object and the electronic device at a shooting time corresponding to the first picture information; determining a second distance corresponding to the second picture information according to a corresponding relation between the distance and the picture information, wherein the second distance is the distance between the call object and the electronic equipment at the shooting time corresponding to the second picture information; determining the target distance as an absolute value of a difference between the first distance and the second distance.

Optionally, the determining module is further specifically configured to determine that the target distance is a sum of the target distance and a third distance, where the third distance is an actual distance between an ear of the call target and the facial feature represented by the first picture information.

Optionally, the volume compensation value satisfies the following formula (1);

wherein FL is the target distance, and Δ L is the volume compensation value.

Optionally, the compensation module is configured to, when the second distance is greater than the first distance, increase and compensate the current volume of the electronic device based on the volume compensation value, so as to obtain a compensated volume.

Optionally, the compensation module is specifically configured to determine, when a sum of the volume compensation value and the current volume is smaller than a maximum volume value of the electronic device, that the compensated volume is the sum of the volume compensation value and the current volume; or when the sum of the volume compensation value and the current volume is greater than or equal to the maximum volume value of the electronic equipment, determining the compensated volume as the maximum volume value.

Optionally, the compensation module is further configured to, when the second distance is smaller than the first distance, perform reduction compensation on the current volume of the electronic device based on the volume compensation value to obtain a compensated volume.

Optionally, the compensation module is specifically configured to determine, when a difference between the current volume and the volume compensation value is greater than a minimum volume value of the electronic device, that the compensated volume is the difference between the current volume and the volume compensation value; or when the difference between the current volume and the volume compensation value is less than or equal to the minimum volume value of the electronic equipment, determining the compensated volume as the minimum volume value.

In a third aspect, the present application provides an electronic device, comprising: a communication interface, a memory, and a processor;

the memory is used for storing program instructions;

the processor is used for controlling the communication interface to realize the receiving and sending of the electronic equipment;

the processor is used for calling the program instructions in the memory to execute the volume adjustment method in the second aspect and any one of the possible designs of the second aspect.

In a fourth aspect, the present application provides a readable storage medium, where an execution instruction is stored, and when the execution instruction is executed by at least one processor of an electronic device, the electronic device performs the volume adjustment method in any one of the possible designs of the first aspect and the first aspect.

According to the volume adjusting method and device, the electronic equipment is used for obtaining the first picture information and the second picture information, and the first picture information and the second picture information are used for representing the same facial features of the same call object in pictures at different shooting moments. And the electronic equipment determines a volume compensation value according to the corresponding relation between the volume and the picture information, wherein the volume compensation value is related to the first picture information and the second picture information. The electronic device compensates the current volume of the electronic device based on the volume compensation value. In the application, the electronic equipment can accurately determine the change of the volume of the electronic equipment based on the corresponding relation between the volume and the picture information along with the change of the same facial features of the same call object at different shooting moments, so that the process of automatically adjusting the volume of the electronic equipment is realized, the electronic equipment can send out sound which is suitable for the call object to hear clearly, the call experience of the call object is improved, additional equipment does not need to be added, and the equipment cost is reduced.

Drawings

In order to more clearly illustrate the technical solutions in the present application or the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, and it is obvious that the drawings in the following description are some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without inventive exercise.

Fig. 1 is a block diagram of an electronic device according to an embodiment of the present disclosure;

fig. 2 is a flowchart of a volume adjustment method according to an embodiment of the present application;

fig. 3 is a schematic view of a scene of a volume adjustment method according to an embodiment of the present application;

fig. 4 is a flowchart of a volume adjustment method according to an embodiment of the present application;

fig. 5 is a schematic view of a scene of a volume adjustment method according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a volume adjustment device according to an embodiment of the present application;

fig. 7 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

To make the purpose, technical solutions and advantages of the present application clearer, the technical solutions in the present application will be clearly and completely described below with reference to the drawings in the present application, and it is obvious that the described embodiments are some, but not all embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

It should be noted that: like reference numbers and letters refer to like items in the following figures, and thus, once an item is defined in one figure, it need not be further defined and explained in subsequent figures. Meanwhile, in the description of the present application, the terms "first", "second", and the like are used only for distinguishing the description, and are not to be construed as indicating or implying relative importance.

In the practical application process, the call object often uses an electronic device to perform a video call or a voice call. During the conversation, the conversation object can carry out hands-free setting on the loudspeaker in the electronic equipment so as to obtain better conversation experience. At this time, the electronic device often selects a proper volume, so that the speaker can play the sound corresponding to the volume to the call object, and the call object can conveniently and normally talk.

During a call, the call object often moves, which results in a change in the distance between the call object and the electronic device. When the call partner moves to a distance far away from the electronic device, the volume of the electronic device is not changed, so that the sound heard by the call partner is reduced, even the call partner cannot be heard clearly, and the call quality of the call partner is reduced. When the call object moves to a short distance away from the electronic device, the volume of the electronic device is not changed, so that the sound heard by the call object becomes loud, even the phenomenon of harsh ears occurs, and the call experience of the call object is seriously influenced.

In order to solve the above problem, before the call partner moves, the volume of the electronic device may be adjusted in advance to ensure that the call partner can normally call. Therefore, after the call object moves, no matter how far away the call object is from the electronic equipment, the call object can hear the sound corresponding to the volume, and the volume cannot be too large or too small.

However, adjusting the volume of the electronic device in advance brings inconvenience to the call partner, resulting in a reduction in the call experience of the call partner. To solve this problem, a distance monitoring device may be additionally added to the electronic device. And adjusting the volume of the electronic equipment according to the distance change between the call object and the electronic equipment monitored by the distance monitoring equipment. However, the number of peripheral interfaces of the electronic device is limited, and the call partner needs to plug the distance monitoring device before the call starts, and needs to pull the distance monitoring device from the electronic device after the call ends. Therefore, when the distance monitoring equipment is used on the electronic equipment, the equipment cost is increased, and the operation complexity of using the electronic equipment by a call object is improved.

In order to solve the above problems, the present application provides a volume adjustment method, device, apparatus, and computer storage medium. The method and the device for obtaining the face feature change of the same call object in the call process are achieved through a camera of the electronic device or an external device. Whether the volume of the electronic equipment needs to be increased or decreased is determined based on the change of the face features of the same call object, so that the automatic adjustment of the volume is realized, the additional equipment cost does not need to be increased, and the call object can obtain good call experience.

The execution main body of the application is an electronic device, and the electronic device can be an electronic device capable of performing conversation, such as a mobile phone, a tablet computer, a notebook computer, a server, a mobile player and the like, and the application is not limited thereto.

Fig. 1 shows a block diagram of an electronic device 100 according to an embodiment of the present application. As shown in fig. 1, the electronic device 100 includes: a speaker 101, a camera 102, a processor 103, a memory 105, and a peripheral interface 104.

The speaker 101 is connected to the processor 103 for executing volume adjustment commands issued by the processor 103. The speaker 101 is a sound playing device in the electronic device 100, and is used for playing out sound during a video call.

The camera 102 is connected to the processor 103, and is configured to send the acquired picture information to the processor 103. The camera 102 is a camera device on the electronic device 100, and is configured to collect picture information of a call target.

The processor 103 is connected to the speaker 101 for sending sound adjustment commands to the speaker 101. The processor 103 is connected to the camera 102 and configured to receive picture information sent by the camera 102. The processor 103 is connected to the memory 105 and is configured to send information to be stored to the memory 105 or read information to be used from the memory 105. The processor 103 is connected to the peripheral interface 104, and is configured to read information transmitted from an external device through the peripheral interface 104, or transmit information to an external device connected to the peripheral interface 104.

The processor 103 is a data processing device on the electronic device 100. Alternatively, the processor 103 may be divided into an image processing unit, an audio processing unit, and a CPU processing unit. The image processing unit is used for processing the picture information acquired by the camera 102, the audio processing unit is used for calculating a sound adjustment value and sending a command to the loudspeaker 101, and the CPU processing unit is used for reading and writing the corresponding relation and calculating according to the corresponding relation.

The memory 105 is connected to the processor 103 and is used for receiving data which needs to be saved and is sent by the processor 103 or sending data which is requested to be read by the processor 103. The memory 105 is a storage device on the electronic device 100, and is used for reading and writing the cache data in the computing process and the data to be stored.

The peripheral interface 104 is connected to the processor 103, and may be configured to receive information sent by the processor 103 and forward the information to an external device connected thereto. Peripheral interface 104 may also be used to forward information to processor 103 that an external device sends to it.

The peripheral interface may be connected to an external device through a physical interface. The peripheral interface can also be connected with external equipment through a wireless network, Bluetooth and other connection modes. The external devices connected to the peripheral interface 104 may be video devices, audio devices, and the like.

It will be appreciated that the configuration shown in FIG. 1 is merely illustrative and that electronic device 100 may include more or fewer components than shown in FIG. 1 or have a different configuration than shown in FIG. 1. The components shown in fig. 1 may be implemented in hardware, software, or a combination thereof.

Next, a specific implementation process of the volume adjustment method according to the present application is described in detail with the electronic device in fig. 1 as an execution subject.

Fig. 2 shows a flowchart of a volume adjustment method according to an embodiment of the present application. As shown in fig. 2, the method of this embodiment may include:

s101, acquiring first picture information and second picture information, wherein the first picture information and the second picture information are used for representing the same facial features of the same call object in pictures at different shooting moments.

With reference to fig. 1, the electronic device may obtain the first picture information and the second picture information through a camera of the electronic device. Or, the electronic device may call a peripheral interface of the electronic device to obtain the first picture information and the second picture information from the external device.

In order to obtain the first picture information and the second picture information, a camera of the electronic device or an external device shoots a first picture of a call object at a first shooting time, and shoots a second picture of the call object at a second shooting time.

The electronic equipment or the external equipment sends the first picture and the second picture to the electronic equipment, so that the electronic equipment takes the information of one or more facial features of the first picture as first picture information and takes the information of the facial features of the second picture as second picture information.

Or the electronic device or the external device uses the information of one or more facial features of the first picture as the first picture information and uses the information of the facial features of the second picture as the second picture information. And the electronic equipment or the external equipment sends the first picture information and the second picture information to the electronic equipment.

The first picture or the second picture may not be limited to the face picture. Optionally, the electronic device or the external device detects facial features of the picture based on a face detection algorithm, and obtains areas of the first picture information and the second picture information, where the same facial features are used for the first picture information and the second picture information.

The face detection algorithm is used for detecting the facial features of the picture, and the algorithm can be an existing algorithm or an optimized algorithm.

The picture may include one or more facial features. The face feature is used to represent a feature of any one region of the face of the call partner. Optionally, the facial features may include: left eye, right eye, nose (nose head and bridge), nose head, mouth, forehead, chin, left ear, or right ear.

The electronic equipment or the external equipment selects an area containing the same facial features from the first picture and the second picture in the same mode, and information corresponding to the area is respectively used as first picture information and second picture information.

The region may be a minimum region including the same facial feature, or may be a scaled region including the same facial feature, which is not limited in the present application.

For example, the electronic device may select a minimum square region including a mouth from the first picture and the second picture, and use information corresponding to the minimum square region as the first picture information and the second picture information, respectively.

Wherein, the first picture information or the second picture information may include but is not limited to: at least one of width and height information, pixel point information, area, or scaling.

For example, if the first picture information is a minimum square region including a nose of the first picture, the first picture information may include: at least one of the width and height information of the minimum square region, the pixel point information of the minimum square region, the area of the minimum square region, or the scaling of the first picture corresponding to the minimum square region.

In addition, the camera or the external device may send the picture to the electronic device in real time, or may send the picture to the electronic device after the first picture and the second picture are taken, which is not limited in this application.

S102, determining a volume compensation value according to the corresponding relation between the volume and the picture information, wherein the volume compensation value is related to the first picture information and the second picture information.

The electronic device stores the correspondence between the volume and the picture information in a memory of the electronic device. The corresponding relationship may be in a form of a formula, a table, a matrix, or a list, which is not limited in this application.

For example, the correspondence may include: a correspondence between volume and area, a correspondence between volume and scaling, or a correspondence between volume, area and scaling.

As another example, the correspondence relationship may further include: the correspondence between the volume and the intermediate value, and the correspondence between the intermediate value and the picture information.

Further, the electronic device may determine, from the first picture information and the second picture information, a change of the picture information corresponding to the same facial feature, and then determine, according to a correspondence between the volume and the picture information, a volume change caused by the change, to obtain a volume compensation value.

For example, since the picture information may include a plurality of variables, the electronic device may determine the volume compensation value by keeping a part of the variables as the same reference from the first picture information and the second picture information, detecting a change of the other part of the variables, and using the correspondence.

The specific representation form of the volume compensation value is not limited in the present application. Alternatively, the volume compensation value may be maintained in the same unit of measure as the volume of the electronic device to facilitate the compensation operation of the electronic device. For example, when the maximum volume of the electronic device is 15 grids and the minimum volume is 0 grid, the volume compensation value adopts grid as a measurement unit.

And S103, compensating the current volume of the electronic equipment based on the volume compensation value.

The current volume of the electronic equipment is not changed at the shooting time corresponding to the first picture information and at the shooting time corresponding to the second picture information. In order to adapt to the volume of the electronic device, the electronic device may automatically compensate the current volume of the electronic device according to the volume compensation value obtained in S102, so as to ensure that the electronic device sends a sound with a suitable volume, improve the conversation experience of the conversation object, and make the conversation process of the conversation object more convenient.

Next, referring to fig. 3, taking a mobile phone as an example of the electronic device, in a process that the user a uses the mobile phone to perform a video call with the user B, the specific steps of the mobile phone adjusting the current volume based on the volume adjusting method of the present application are as follows:

step 1, the mobile phone takes a first picture of the user a through a camera of the mobile phone, as shown in the left diagram of fig. 3. The mobile phone may determine that the first picture information includes: the smallest rectangular area AA of the first picture, including the mouth, and the scaling of the first picture.

And step 2, the mobile phone shoots a second picture of the user A through the camera of the mobile phone, as shown in the right picture of the figure 3. The mobile phone may determine that the second picture information includes: the smallest rectangular area BB of the second picture containing the mouth, and the scaling of the second picture.

And 3, because the corresponding relation among the volume, the area and the scaling is stored in the mobile phone, the mobile phone can determine the volume compensation value based on the first picture information, the second picture information and the corresponding relation.

And 4, compensating the current volume of the mobile phone by the mobile phone according to the calculated volume compensation value. For example, at the shooting time corresponding to the left and right images in fig. 3, the volume of the mobile phone is 2 frames. The mobile phone can compensate the current volume of the mobile phone according to the volume compensation value of 1 lattice based on the volume of 2 lattices, and the compensated volume is 3 lattices.

According to the volume adjusting method, the electronic equipment is used for acquiring the first picture information and the second picture information, and the first picture information and the second picture information are used for representing the same facial features of the same call object in pictures at different shooting moments. And the electronic equipment determines a volume compensation value according to the corresponding relation between the volume and the picture information, wherein the volume compensation value is related to the first picture information and the second picture information. The electronic device compensates the current volume of the electronic device based on the volume compensation value. In the application, the electronic equipment can accurately determine the change of the volume of the electronic equipment based on the corresponding relation between the volume and the picture information along with the change of the same facial features of the same call object at different shooting moments, so that the process of automatically adjusting the volume of the electronic equipment is realized, the electronic equipment can send out sound which is suitable for the call object to hear clearly, the call experience of the call object is improved, additional equipment does not need to be added, and the equipment cost is reduced.

Based on the embodiments shown in fig. 1 to fig. 3, a specific implementation manner of determining the volume compensation value according to the correspondence between the volume and the picture information in S102 in fig. 2, and the volume compensation value is related to the first picture information and the second picture information, is described in detail with reference to fig. 4.

Fig. 4 shows a flowchart of a volume adjustment method according to an embodiment of the present application. As shown in fig. 4, the method of this embodiment may include:

s201, acquiring first picture information and second picture information, wherein the first picture information and the second picture information are used for representing the same facial features of the same call object in pictures at different shooting moments.

S201 is similar to the implementation manner of S101 in the embodiment of fig. 2, and details of this embodiment are not repeated here.

And S2021, determining a target distance according to the corresponding relation between the distance and the picture information, wherein the target distance is related to the first picture information and the second picture information, and the target distance is used for indicating the distance moved by the call object between the shooting time corresponding to the first picture information and the shooting time corresponding to the second picture information.

When the distance from the call object to the electronic device changes, the area occupied by the call object in the picture also changes. Similarly, the area of the face feature of the call partner in the picture changes accordingly. Therefore, on the basis of the embodiment of fig. 2, the electronic device may increase the intermediate value of the distance, establish the corresponding relationship between the distance and the picture information, and determine the target distance of the call object according to the corresponding relationship between the distance and the picture information. Intermediate values in this application include, but are not limited to, distance.

Wherein the electronic device stores a correspondence between the distance and the picture information in a memory of the electronic device. The corresponding relationship may be in a form of a formula, a table, a matrix, or a list, which is not limited in this application.

The electronic device can determine the target distance in various ways according to the corresponding relationship between the distance and the picture. In the following, two possible implementation manners are adopted to describe a specific process of determining the target distance by the electronic device.

In a possible embodiment, the electronic device may determine a first distance corresponding to the first picture information according to a correspondence between the distance and the picture information, where the first distance is a distance between the call target and the electronic device at a shooting time corresponding to the first picture information. And the electronic equipment determines a second distance corresponding to the second picture information according to the corresponding relation between the distance and the picture information, wherein the second distance is the distance between the call object and the electronic equipment at the shooting moment corresponding to the second picture information. Furthermore, the electronic device may determine an absolute value of a difference between the first distance and the second distance as a target distance, so as to determine a distance moved by the call target from the shooting time corresponding to the first picture information to the shooting time corresponding to the second picture information.

TABLE 1

For convenience of explanation, the correspondence relationship is exemplified by table 1. In table 1, the picture information includes: scaling and area. Wherein the distance represents a distance between the call partner and the electronic device, and is in units of centimeters (cm). The facial features include: left ear, right ear, left eye, right eye, nose, mouth, forehead and chin. In Table 1, mX represents a scaling of m, which is a positive number. When m is larger than 1, mX represents the picture magnified by m times. When m is larger than 1, mX represents that the picture is reduced by m times. When m is equal to 1, mX represents that the picture is not scaled. The four scales of 1X, 2X, 3X and 4X are used for illustration in table 1. Wherein, Sn represents the face of a certain facial feature when the distance is n, and n is a positive integer.

For example, when the first picture information and the second picture information are used to represent a facial feature of the left ear, the electronic device may determine that the scaling is 1X and the area is S1 based on the first picture information. The electronic device then looks up table 1 to obtain that the first distance between the call object and the electronic device is 1 cm. The electronic device may determine that the scaling is 1X and the area is S20 based on the second picture information. The electronic device further queries table 1 to obtain that the second distance between the call object and the electronic device is 20 cm. The electronic device may calculate the target distance to be 19cm difference of the second distance and the first distance.

In another possible embodiment, since the call partner acquires the sound through the ear organ or the sound acquiring device, when the first picture information is used to represent other facial features except the ear of the call partner, the electronic device increases the distance from the facial feature to the ear in the target distance, so that the calculated target distance is more accurate, and further, the accuracy of the volume compensation value is improved, so that the call partner obtains better call quality during the call.

Optionally, the electronic device determines a sum of the target distance and the third distance as the target distance. And the third distance is the actual distance between the ear of the call object and the facial feature represented by the first picture information. The third distance is illustrated using table 2, and specific values for the third distance are obtained by big data statistics, in centimeters (cm).

TABLE 2

Facial features	Third distance (unit: cm)
		Eye(s)	A
Nose	B
		Mouth bar	D
Forehead head	E
		Jaw	F

For example, when the first picture information and the second picture information are used to represent a facial feature of the mouth, after the target distance is obtained in S2021, the electronic device looks up the table 2 to obtain a third distance, and determines the sum of the target distance and the third distance as the target distance, so that the target distance is more accurate.

In addition, when the first picture information and the second picture information are used for representing a facial feature, the electronic device may determine the target distance according to a change corresponding to the facial feature in the first picture information and the second picture information. When the first picture information and the second picture information are used for representing a plurality of facial features, the electronic device can determine a plurality of distances according to the change corresponding to each facial feature in the first picture information and the second picture information. The electronic device then obtains the target distance by taking an average value, a maximum value, a minimum value and the like.

In a specific embodiment, when the first picture information and the second picture information are used to represent a plurality of facial features, the facial features include: nose, mouth and chin. And the electronic equipment respectively determines a first distance and a second distance of each facial feature of the nose, the mouth and the chin according to the corresponding relation between the distances and the picture information. Further, the electronic device calculates a distance 1 of each facial feature of the nose, mouth, and chin based on the first and second distances of each facial feature of the nose, mouth, and chin, respectively.

The electronic device may take the average of the distances 1 of the facial features of the nose, mouth, and chin as the target distance. In addition, since the nose, mouth, and chin are other facial features than the ears of the call partner, the electronic device refers to table 2 to obtain the third distance of each facial feature of the nose, mouth, and chin. And the electronic equipment respectively calculates the distance 2 of each facial feature of the nose, the mouth and the chin according to the third distance and the distance 1 of each facial feature of the nose, the mouth and the chin. The electronic device calculates the target distance from the average of the distances 2 of the facial features of the nose, mouth and chin.

S2022, determining a volume compensation value according to the corresponding relation between the distance and the volume, wherein the volume compensation value is related to the target distance.

When the distance between the call object and the electronic device is changed and the volume of the electronic device is not changed, the sound played by the electronic device heard by the call object becomes larger or smaller. In order to ensure the call quality, the electronic device needs to compensate the volume to compensate for the change of the sound heard by the call partner after the distance is changed. Therefore, based on the description of S2021, the electronic device establishes a correspondence between the distance and the volume using the distance as an intermediate value, and from the correspondence between the distance and the volume, a volume compensation value can be determined.

The electronic device stores a correspondence between the distance and the volume in a memory of the electronic device. The corresponding relationship may be in a form of a formula, a table, a matrix, or a list, which is not limited in this application.

As will be understood by those skilled in the art, the volume compensation value Δ L satisfies the following equation:

wherein r is the distance between the call object and the electronic device, and the unit is meter (m).

Alternatively, based on the above formula, the electronic device may derive: the volume compensation value corresponding to the target distance in S2021 satisfies the following formula (1):

where FL is the target distance in centimeters (cm), and Δ L is the volume compensation value in decibels (dB).

And S203, compensating the current volume of the electronic equipment based on the volume compensation value.

S203 is similar to the implementation manner of S103 in the embodiment of fig. 2, and details of this embodiment are not repeated here.

Next, referring to fig. 5, taking a mobile phone as an example of the electronic device, in a process that the user a uses the mobile phone to perform a video call with the user B, the specific steps of the mobile phone adjusting the current volume based on the volume adjusting method of the present application are as follows:

step 1, the mobile phone takes a first picture of the user a through a camera of the mobile phone, as shown in the upper diagram of fig. 5. The mobile phone may determine that the first picture information includes: the smallest rectangular area AA of the first picture, including the mouth, and the scaling of the first picture.

And step 2, the mobile phone shoots a second picture of the user A through the camera of the mobile phone, as shown in the lower graph of FIG. 5. The mobile phone may determine that the second picture information includes: the smallest rectangular area BB of the second picture containing the mouth, and the scaling of the second picture.

Step 3, since the mobile phone stores the corresponding relationship between the distance and the picture information, the mobile phone can determine the distance D1 between the user a and the electronic device at the shooting time corresponding to the upper diagram of fig. 5 based on the first picture information, i.e. the area of the area AA, and the scaling of the first picture.

The mobile phone can determine the distance D2 between the user a and the electronic device at the shooting time corresponding to the lower diagram of fig. 5 based on the second picture information, i.e. the area of the region BB, and the scaling of the second picture.

And 4, calculating the absolute value of the difference between the distance D1 and the distance D2 by the mobile phone to obtain the target distance.

And step 5, since the first picture information and the second picture information are used for representing the facial feature of the mouth and belong to other facial features except the ears, the mobile phone can look up the table 2 to determine the third distance. And the mobile phone calculates the target distance according to the target distance and the third distance.

Step 5 is optional.

And 6, calculating by the mobile phone according to the target distance calculated in the step 4 or the step 5 through a formula (1) to obtain a volume compensation value.

And 7, compensating the current volume of the mobile phone by the mobile phone according to the calculated volume compensation value. It is assumed that at the shooting time corresponding to the upper diagram of fig. 5 and the lower diagram of fig. 5, the current volume of the mobile phone is 2 frames, and the volume compensation value is 1 frame. The user a is far from the mobile phone from the shooting time corresponding to the upper diagram of fig. 5 to the shooting time corresponding to the lower diagram of fig. 5. Therefore, the mobile phone can obtain 3 compensated volumes.

In the application, the electronic equipment can accurately determine the change of the volume of the electronic equipment based on the corresponding relation among the volume, the distance and the picture information along with the change of the same facial features of the same call object at different shooting moments, so that the process of automatically adjusting the volume of the electronic equipment is realized, the electronic equipment can send out sound which is suitable for the call object to hear clearly, the call experience of the call object is improved, additional equipment does not need to be added, and the equipment cost is reduced. Further, when the first picture information is used for representing other facial features except ears of the call object, the target distance is increased by the distance between the facial features and the ears, the target distance can be more accurate, the accuracy of the volume compensation value is further improved, and the call object obtains better call quality in the call process.

On the basis of the embodiment shown in fig. 4, during the call, the call object may be far away from the electronic device or close to the electronic device. Therefore, the electronic device may compare the magnitude relationship between the first distance and the second distance, and then perform the increase compensation or the decrease compensation on the current volume of the electronic device based on the volume compensation value.

When the second distance is greater than the first distance, the electronic device may determine that the call object moves away from the electronic device from the shooting time corresponding to the first picture information to the shooting time corresponding to the second picture information. The distance between the call object and the electronic equipment is increased, the volume of the electronic equipment is not changed, and the sound heard by the call object is reduced. In order to ensure that the sound heard by the talking object is clear, the electronic equipment can compensate the increase of the volume at the current moment. Therefore, the electronic device can increase and compensate the current volume based on the volume compensation value to obtain the compensated volume.

Because the comfortable volume of the human ear has a fixed threshold, the electronic equipment sets the maximum volume value and the minimum volume value of the electronic equipment according to the comfortable volume threshold of the human ear and by combining the equipment volume threshold of the electronic equipment, so that the electronic equipment can normally operate when the electronic equipment plays sound by using the maximum volume value or the minimum volume value, and a conversation object can clearly hear the content played by the electronic equipment.

Based on the above, when the electronic device performs the increase compensation of the volume, the electronic device may compare the correspondence between the sum of the volume compensation value and the current volume and the maximum volume value of the electronic device. And when the sum of the volume compensation value and the current volume is smaller than the maximum volume value of the electronic equipment, the electronic equipment determines the compensated volume as the sum of the volume compensation value and the current volume. When the sum of the volume compensation value and the current volume is greater than or equal to the maximum volume value of the electronic device, the electronic device determines that the compensated volume is the maximum volume value.

When the second distance is smaller than the first distance, the electronic device may determine that the call object moves closer to the electronic device from the shooting time corresponding to the first picture information to the shooting time corresponding to the second picture information. When the distance between the object and the electronic equipment is reduced and the volume of the electronic equipment is not changed, the sound heard by the call object is increased. In order to ensure that the sound heard by the talking object is appropriate, the electronic device may compensate for the decrease in volume at the current moment. Therefore, the electronic device can perform reduction compensation on the current volume of the electronic device based on the volume compensation value to obtain the compensated volume.

Based on the foregoing, when the electronic device performs the decrease compensation of the volume, the electronic device may use a correspondence between the difference between the previous volume and the volume compensation value and the minimum volume value of the electronic device. And when the difference value between the current volume and the volume compensation value is larger than the minimum volume value of the electronic equipment, the electronic equipment determines that the compensated volume is the difference value between the current volume and the volume compensation value. And when the difference value between the current volume and the volume compensation value is less than or equal to the minimum volume value of the electronic equipment, the electronic equipment determines the compensated volume to be the minimum volume value.

Fig. 6 shows a schematic structural diagram of a volume adjustment device according to an embodiment of the present application, and as shown in fig. 6, a volume adjustment device 10 according to the present embodiment is used to implement operations corresponding to an electronic device in any one of the method embodiments, where the volume adjustment device 10 according to the present embodiment may include:

the obtaining module 11 is configured to obtain first picture information and second picture information, where the first picture information and the second picture information are used to indicate the same facial features in pictures of the same call target at different shooting times.

The determining module 12 is configured to determine a volume compensation value according to a corresponding relationship between volume and picture information, where the volume compensation value is related to the first picture information and the second picture information.

And the compensation module 13 is configured to compensate the current volume of the electronic device based on the volume compensation value.

Optionally, the determining module 12 is configured to determine a target distance according to a corresponding relationship between the distance and the picture information, where the target distance is related to the first picture information and the second picture information, and the target distance is used to indicate a distance that the call target moves between a shooting time corresponding to the first picture information and a shooting time corresponding to the second picture information. And determining a volume compensation value according to the corresponding relation between the distance and the volume, wherein the volume compensation value is related to the target distance.

Optionally, the determining module 12 is specifically configured to determine, according to a correspondence between the distance and the picture information, a first distance corresponding to the first picture information, where the first distance is a distance between the call target and the electronic device at a shooting time corresponding to the first picture information. And determining a second distance corresponding to the second picture information according to the corresponding relation between the distance and the picture information, wherein the second distance is the distance between the call object and the electronic equipment at the shooting time corresponding to the second picture information. The target distance is determined as an absolute value of a difference between the first distance and the second distance.

Optionally, the determining module 12 is further specifically configured to determine the target distance as a sum of the target distance and a third distance, where the third distance is an actual distance between the ear of the call target and the facial feature represented by the first picture information.

Alternatively, the volume compensation value satisfies the following formula (1).

Wherein FL is the target distance and Δ L is the volume compensation value.

Optionally, the compensation module 13 is configured to, when the second distance is greater than the first distance, increase and compensate the current volume of the electronic device based on the volume compensation value, so as to obtain a compensated volume.

Optionally, the compensation module 13 is specifically configured to determine, when the sum of the volume compensation value and the current volume is smaller than the maximum volume value of the electronic device, the compensated volume as the sum of the volume compensation value and the current volume. Or, when the sum of the volume compensation value and the current volume is greater than or equal to the maximum volume value of the electronic device, determining the compensated volume as the maximum volume value.

Optionally, the compensation module 13 is further configured to, when the second distance is smaller than the first distance, perform reduction compensation on the current volume of the electronic device based on the volume compensation value, so as to obtain a compensated volume.

Optionally, the compensation module 13 is specifically configured to determine that the compensated volume is the difference between the current volume and the volume compensation value when the difference between the current volume and the volume compensation value is greater than the minimum volume value of the electronic device. Or when the difference between the current volume and the volume compensation value is less than or equal to the minimum volume value of the electronic equipment, determining the compensated volume as the minimum volume value.

The volume adjustment device 10 provided in the embodiment of the present application may implement the above method embodiment, and for details of the implementation principle and the technical effect, reference may be made to the above method embodiment, which is not described herein again.

In the present application, the volume adjustment device may be divided into functional modules according to the above method examples, for example, each functional module may be divided according to each function, or two or more functions may be integrated into one processing module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. It should be noted that the division of the modules in the embodiments of the present application is schematic, and is only one division of logic functions, and there may be another division manner in actual implementation.

Fig. 7 shows a hardware structure diagram of an electronic device according to an embodiment of the present application. As shown in fig. 7, the electronic device 20 is configured to implement the operations corresponding to the electronic device in any of the method embodiments described above, where the electronic device 20 of this embodiment may include: a memory 21 and a processor 22.

A memory 21 for storing a computer program.

And a processor 22 for executing the computer program stored in the memory to implement the volume adjusting method in the above-described embodiments. Reference may be made in particular to the description relating to the method embodiments described above.

Alternatively, the memory 21 may be separate or integrated with the processor 22.

When the memory 21 is a device separate from the processor 22, the electronic device 20 may further include:

a bus 23 for connecting the memory 21 and the processor 22.

Optionally, this embodiment further includes: a communication interface 24, the communication interface 24 being connectable to the processor 22 via a bus 23. The processor 22 may control the communication interface 23 to implement the above-described receiving and transmitting functions of the electronic device 20.

The electronic device provided in this embodiment may be used to execute the volume adjusting method, and the implementation manner and the technical effect are similar, which are not described herein again.

The present application also provides a computer-readable storage medium including a computer program for implementing the volume adjustment method as in the above embodiments.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described embodiments of the apparatus are merely illustrative, and for example, the division of the modules is only one logical division, and the actual implementation may have another division, for example, a plurality of modules may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.

Modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment.

In addition, functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit. The unit formed by the modules can be realized in a hardware form, and can also be realized in a form of hardware and a software functional unit.

The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions to enable a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present application.

It should be understood that the processor may be a Central Processing Unit (CPU), other general-purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of a method disclosed in connection with the present invention may be embodied directly in a hardware processor, or in a combination of the hardware and software modules within the processor.

The memory may comprise a high-speed RAM memory, and may further comprise a non-volatile storage NVM, such as at least one disk memory, and may also be a usb disk, a removable hard disk, a read-only memory, a magnetic or optical disk, etc.

The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.

The computer-readable storage medium may be implemented by any type or combination of volatile or non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. Which when executed performs steps comprising the method embodiments described above. And the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.

Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit the same. Although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: it is also possible to modify the solutions described in the previous embodiments or to substitute some or all of them with equivalents. And the modifications or the substitutions do not make the essence of the corresponding technical solutions depart from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A volume adjusting method is applied to an electronic device, and comprises the following steps:

2. The method according to claim 1, wherein determining the volume compensation value according to the correspondence between the volume and the picture information comprises:

3. The method according to claim 2, wherein the determining the target distance according to the correspondence between the distance and the picture information comprises:

4. The method according to claim 2, wherein when the first picture information is used for characterizing other facial features except for the ear of the call subject, and before determining the volume compensation value according to the correspondence between distance and volume, the method further comprises:

5. The method according to any one of claims 2 to 4, wherein the volume compensation value satisfies the following formula (1);

wherein FL is the target distance, and Δ L is the volume compensation value.

6. The method of claim 4, wherein compensating the current volume of the electronic device based on the volume compensation value comprises:

7. The method of claim 6, wherein the increasing the current volume of the electronic device based on the volume compensation value to obtain a compensated volume comprises:

8. The method of claim 4, wherein compensating the current volume of the electronic device based on the volume compensation value comprises:

9. The method of claim 8, wherein the compensating for the decrease in the current volume of the electronic device based on the volume compensation value to obtain a compensated volume comprises:

10. A volume adjustment device, comprising: