WO2019047205A1

WO2019047205A1 - Volume adjustment method and device

Info

Publication number: WO2019047205A1
Application number: PCT/CN2017/101192
Authority: WO
Inventors: 庞杰; 许逸君; 张玉磊
Original assignee: 深圳传音通讯有限公司
Priority date: 2017-09-11
Filing date: 2017-09-11
Publication date: 2019-03-14

Abstract

Provided are a volume adjustment method and device. The volume adjustment method is applied to a terminal, and the terminal comprises a camera. The method comprises: firstly, displaying an operating area and a reference line in the operating area to a user, and obtaining, from a camera, a gesture video about the user carrying out a dangling operation on the operating area; then, acquiring, according to the gesture video, a dangling movement trajectory in the operating area when the user carries out the dangling operation; displaying, according to the dangling movement trajectory, a mapping movement trajectory of a virtual mapping icon in the operating area, wherein the movement direction and displacement of the dangling movement trajectory is consistent with that of the mapping movement trajectory; improving the accuracy and efficiency of a gesture operation by means of displaying the mapping movement trajectory of the virtual mapping icon in the operating area; and finally, determining a volume adjustment amount according to the mapping movement trajectory of the virtual mapping icon relative to the reference line. The trajectory of the virtual mapping icon relative to the reference line is used as a basis for determining the volume adjustment amount, thereby reducing the requirements for the accuracy of the user's gesture operation and improving the efficiency of the gesture operation.

Description

音量调节方法和装置Volume adjustment method and device

技术领域Technical field

本申请涉及信号处理技术，尤其涉及一种音量调节方法和装置。The present application relates to signal processing technologies, and in particular, to a volume adjustment method and apparatus.

背景技术Background technique

当前手机、平板电脑等终端已经集成了大多数用户生活、学习、工作中可能用到的功能，尤其是音乐播放、视频播放的功能具有较高的用户使用频率。例如在运动的同时播放音乐、在做菜时播放教学视频。传统终端在声音播放时，通常是根据用户对预设音量按键的点击进行音量调节。对音量调节按键的频繁点击容易缩短按键的使用寿命，导致音量调节按键在长期使用后可靠性降低的问题。Currently, terminals such as mobile phones and tablet computers have integrated functions that most users may use during their life, study, and work. In particular, the functions of music playback and video playback have a high frequency of user usage. For example, playing music while playing, and teaching video while cooking. When the traditional terminal is playing sound, it is usually adjusted according to the user's click on the preset volume button. Frequent clicks on the volume adjustment buttons tend to shorten the life of the buttons, resulting in a problem that the volume adjustment buttons are less reliable after long-term use.

随着触摸屏的发展，现有的音量调节方式，通常是终端在触摸屏上显示功能控件或音量按键。终端根据用户在触摸屏上对功能控件或音量按键的触摸操作进行音量调节。With the development of the touch screen, the existing volume adjustment mode is usually that the terminal displays a function control or a volume button on the touch screen. The terminal adjusts the volume according to the touch operation of the function control or the volume button on the touch screen by the user.

然而，在用户处于跑步、游泳等运动过程中，手上很可能沾有汗液或者水。现有的音量调节方式仍然需要接触终端，以不干净的手指触摸终端的触摸屏，不仅会导致终端表面受到污染，还可能导致终端内部受潮，缩短终端的使用寿命。现有的音量调节方法的可靠性不高。However, during the exercise of the user, such as running, swimming, etc., the hand is likely to be sweat or water. The existing volume adjustment method still needs to contact the terminal, and touching the touch screen of the terminal with a dirty finger not only causes the terminal surface to be contaminated, but also may cause moisture inside the terminal and shorten the service life of the terminal. The reliability of the existing volume adjustment method is not high.

发明内容Summary of the invention

本发明提供一种音量调节方法和装置，以在用户不方便接触终端时，提高音量调节的可靠性。The present invention provides a volume adjustment method and apparatus for improving the reliability of volume adjustment when a user is inconvenient to contact a terminal.

根据本发明的第一方面，提供一种音量调节方法，应用于终端，所述终端包括摄像头，所述方法包括：According to a first aspect of the present invention, a volume adjustment method is provided for a terminal, the terminal includes a camera, and the method includes:

向用户显示操作区和所述操作区内的基准线，并从所述摄像头获得所述用户对所述操作区进行悬空操作的手势视频；Displaying a reference line of the operation area and the operation area to the user, and obtaining, from the camera, a gesture video of the user performing a floating operation on the operation area;

根据所述手势视频，获取所述用户进行悬空操作时在所述操作区的悬空移动轨迹；Acquiring, according to the gesture video, a dangling movement trajectory in the operation area when the user performs a dangling operation;

根据所述悬空移动轨迹，在所述操作区显示虚拟映射图标的映射移动轨迹，其中，所述悬空移动轨迹与所述映射移动轨迹的移动方向和位移一致；Displaying, according to the dangling movement trajectory, a mapping movement trajectory of the virtual map icon in the operation area, where The dangling movement trajectory is consistent with the moving direction and displacement of the mapping movement trajectory;

根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量。A volume adjustment amount is determined according to a mapping movement trajectory of the virtual map icon with respect to the reference line.

在本发明第一方面的一种可选的实施方式中，所述基准线将所述操作区分割为第一子操作区和第二子操作区；In an optional implementation manner of the first aspect of the present invention, the reference line divides the operation area into a first sub-operation area and a second sub-operation area;

所述根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量，包括：Determining a volume adjustment amount according to the mapping movement trajectory of the virtual mapping icon with respect to the reference line, including:

若所述第一子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，并将所述P作为音量增大的所述音量调节量；If there is a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, determining a volume increasing component P according to a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, and The P is the volume adjustment amount that is increased in volume;

若所述第二子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并将所述D作为音量减小的所述音量调节量。If there is a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, determining a volume reduction component D according to a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, and The D is the volume adjustment amount whose volume is reduced.

在上述可选的实施方式中，所述第一子操作区内预设有第一图形；所述第二子操作区内预设有第二图形；In the above optional embodiment, the first sub-operation area is pre-set with a first graphic; the second sub-operation area is pre-set with a second graphic;

所述根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，包括：Determining the volume increase component P according to the mapping movement trajectory of the virtual mapping icon in the first sub-operation area, including:

根据所述映射移动轨迹与所述第一图形相交的第一相交次数，确定所述P，其中，P的大小与所述第一相交次数的大小成正比；Determining the P according to the first intersection number of the mapping movement trajectory intersecting the first graphic, wherein a size of P is proportional to a size of the first intersection number;

相应地，所述根据所述虚拟映射图标在所述第二子操作区内的移动轨迹，确定音量减小分量D，包括：Correspondingly, determining the volume reduction component D according to the movement trajectory of the virtual mapping icon in the second sub-operation area includes:

根据所述映射移动轨迹与所述第二图形相交的第二相交次数，确定所述D，其中，所述D的大小与所述第二相交次数的大小成正比。Determining the D according to a second number of intersections of the mapping movement trajectory and the second figure, wherein a size of the D is proportional to a size of the second number of intersections.

在上述可选的实施方式中，所述第一子操作区内预设有第三图形和第四图形；所述第二子操作区内预设有第五图形和第六图形；In the above optional embodiment, the first sub-operation area is pre-set with a third graphic and a fourth graphic; the second sub-operation area is pre-set with a fifth graphic and a sixth graphic;

以第一子操作区内的所述映射移动轨迹连续与第三图形、第四图形分别相交一次，识别为完成一次第一类动作，将所述映射移动轨迹完成所述第一类动作的次数N确定为所述P，其中，P的大小与所述N的大小成正比；The mapping movement trajectory in the first sub-operation area is continuously intersected with the third graphic and the fourth graphic, respectively, and is identified as the number of times the mapping movement trajectory completes the first type of motion N is determined as the P, wherein the size of P is proportional to the size of the N;

相应地，所述根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，包括：Correspondingly, according to the mapping movement track of the virtual mapping icon in the second sub-operation area, The volume is reduced by the component D, including:

以第二子操作区内的所述映射移动轨迹连续与第五图形、第六图形分别相交一次，识别为完成一次第二类动作，将所述映射移动轨迹完成所述第二类动作的次数M确定为所述D，其中，D的大小与所述M的大小成正比。And the mapping movement trajectory in the second sub-operation area is continuously intersected with the fifth graphic and the sixth graphic, respectively, and is identified as completing the second type of motion, and the mapping movement trajectory completes the second type of motion M is determined to be the D, wherein the size of D is proportional to the size of the M.

在本发明第一方面的一种实施方式以及上述各种实施方式中，所述向用户显示操作区和所述操作区内的基准线，包括：In an embodiment of the first aspect of the present invention, and the foregoing various embodiments, the displaying, by the user, the operating area and the reference line in the operating area includes:

在确定获得触发信息时，向用户显示操作区和所述操作区内的基准线；When determining to obtain the trigger information, displaying the operating area and the reference line in the operating area to the user;

其中，所述获得触发信息，包括以下任一种：The obtaining the trigger information includes any one of the following:

获得与预设触发语音信息一致的语音信息；Obtaining voice information consistent with the preset trigger voice information;

从所述摄像头获得与预设触发图像一致的图像；Obtaining an image consistent with the preset trigger image from the camera;

检测到音视频应用程序被开启。The audio and video application is detected to be turned on.

根据本发明的第二方面，提供一种音量调节装置，应用于终端，所述终端包括摄像头，所述装置包括：According to a second aspect of the present invention, a volume adjustment apparatus is provided for use in a terminal, the terminal comprising a camera, the apparatus comprising:

显示模块，用于向用户显示操作区和所述操作区内的基准线；a display module, configured to display to the user an operating area and a reference line in the operating area;

手势视频获得模块，用于从所述摄像头获得所述用户对所述操作区进行悬空操作的手势视频；a gesture video obtaining module, configured to obtain, from the camera, a gesture video of the user performing a dangling operation on the operation area;

悬空移动轨迹获得模块，用于根据所述手势视频，获取所述用户进行悬空操作时在所述操作区的悬空移动轨迹；a dangling movement trajectory obtaining module, configured to acquire, according to the gesture video, a dangling movement trajectory in the operation area when the user performs a dangling operation;

映射移动轨迹获得模块，用于根据所述悬空移动轨迹，在所述操作区显示虚拟映射图标的映射移动轨迹，其中，所述悬空移动轨迹与所述映射移动轨迹的移动方向和位移一致；a mapping movement trajectory obtaining module, configured to display a mapping movement trajectory of the virtual mapping icon in the operation area according to the dangling movement trajectory, wherein the dangling movement trajectory is consistent with a moving direction and a displacement of the mapping movement trajectory;

音量调节量确定模块，用于根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量。And a volume adjustment amount determining module, configured to determine a volume adjustment amount according to a mapping movement trajectory of the virtual mapping icon with respect to the reference line.

在本发明第二方面的一种可选的实施方式中，所述基准线将所述操作区分割为第一子操作区和第二子操作区；In an optional implementation manner of the second aspect of the present invention, the reference line divides the operation area into a first sub-operation area and a second sub-operation area;

所述音量调节量确定模块用于：The volume adjustment amount determining module is configured to:

若所述第二子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并将所述D作为音量减小的所述音量调节量。If the mapping movement track of the virtual mapping icon is in the second sub-operation area, according to the virtual image A mapping movement trajectory of the icon in the second sub-operation area is determined, a volume reduction component D is determined, and the D is used as the volume adjustment amount for volume reduction.

所述音量调节量确定模块用于：根据所述映射移动轨迹与所述第一图形相交的第一相交次数，确定所述P，其中，P的大小与所述第一相交次数的大小成正比；根据所述映射移动轨迹与所述第二图形相交的第二相交次数，确定所述D，其中，所述D的大小与所述第二相交次数的大小成正比。The volume adjustment amount determining module is configured to: determine the P according to a first intersection number of the mapping movement trajectory and the first graphic, wherein a size of P is proportional to a size of the first intersection number And determining the D according to the second intersection number of the mapping movement trajectory and the second figure, wherein the size of the D is proportional to the size of the second intersection number.

所述音量调节量确定模块用于：以第一子操作区内的所述映射移动轨迹连续与第三图形、第四图形分别相交一次，识别为完成一次第一类动作，将所述映射移动轨迹完成所述第一类动作的次数N确定为所述P，其中，P的大小与所述N的大小成正比；以第二子操作区内的所述映射移动轨迹连续与第五图形、第六图形分别相交一次，识别为完成一次第二类动作，将所述映射移动轨迹完成所述第二类动作的次数M确定为所述D，其中，D的大小与所述M的大小成正比。The volume adjustment amount determining module is configured to: continuously intersect the third graphic and the fourth graphic respectively with the mapping movement track in the first sub-operation area, and identify that the first type of action is completed, and move the mapping The number N of times that the trajectory completes the first type of action is determined as the P, wherein the size of P is proportional to the size of the N; and the mapping movement trajectory in the second sub-operation area is continuous with the fifth graphic, The sixth graphics are respectively intersected once, and are identified as completing a second type of action, and determining the number M of the mapping movement trajectory to complete the second type of motion as the D, wherein the size of the D is equal to the size of the M Just proportional.

在本发明第二方面的一种实施方式以及上述各种实施方式中，所述手势视频获得模块用于：在确定获得触发信息时，向用户显示操作区和所述操作区内的基准线；其中，所述获得触发信息，包括以下任一种：In an embodiment of the second aspect of the present invention, and the foregoing various embodiments, the gesture video obtaining module is configured to: when determining to obtain the trigger information, display the operating area and the reference line in the operating area to the user; The obtaining the trigger information includes any one of the following:

根据本发明的第三方面，提供一种终端，包括：存储器、处理器以及计算机程序，所述计算机程序存储在所述存储器中，所述处理器运行所述计算机程序执行第一方面及第一方面各种可能的所述音量调节方法。According to a third aspect of the present invention, a terminal is provided, comprising: a memory, a processor, and a computer program, wherein the computer program is stored in the memory, the processor running the computer program to execute the first aspect and the first Aspects of the various possible volume adjustment methods.

根据本发明的第四方面，提供一种存储介质，包括：可读存储介质和计算机程序，所述计算机程序用于实现第一方面及第一方面各种可能的所述音量调节方法。According to a fourth aspect of the present invention, there is provided a storage medium comprising: a readable storage medium and a computer program for implementing the first aspect and the first aspect of the various possible volume adjustment methods.

本发明提供的音量调节方法和装置，在开始进行音量调节时，首先向用户显示操作区和操作区内的基准线，并从摄像头获得用户对操作区进行悬空操作的手势视频；然后根据手势视频，获取用户进行悬空操作时在操作区的悬空移动轨迹；接着根据悬空移动轨迹，在操作区显示虚拟映射图标的映射移动轨迹，其中，悬空移动轨迹与映射移动轨迹的移动方向和位移一致；通过在操作区显示虚拟映射图标的映射移动轨迹，增加了用户与终端之间的交互，便于用户通过观察映射移动轨迹而对悬空移动轨迹进行控制，提高手势操作的准确性和效率；最后根据虚拟映射图标相对于基准线的映射移动轨迹，确定音量调节量，以虚拟映射图标相对于基准线的运动轨迹作为确定音量调节量的依据，降低了对用户手势操作精确度的要求，提高了手势操作效率。本发明的音量调节方法无需接触终端，不会对终端的性能产生影响，且手势操作方便，终端也较容易识别，本发明提供的音量调节方法具有较高的可靠性。The volume adjustment method and apparatus provided by the present invention first display a reference line in the operation area and the operation area to the user when starting the volume adjustment, and obtain a gesture video of the user operating the operation area from the camera; and then according to the gesture video Obtaining the trajectory of the dangling movement in the operation area when the user performs the dangling operation; The empty moving track displays a mapping moving track of the virtual mapping icon in the operation area, wherein the hanging moving track is consistent with the moving direction and displacement of the mapped moving track; and the user and the terminal are added by displaying the mapping moving track of the virtual mapping icon in the operating area. The interaction between the two is convenient for the user to control the dangling movement trajectory by observing the mapping movement trajectory, thereby improving the accuracy and efficiency of the gesture operation. Finally, according to the mapping movement trajectory of the virtual mapping icon relative to the reference line, the volume adjustment amount is determined to be virtualized. The motion trajectory of the mapping icon relative to the reference line serves as a basis for determining the volume adjustment amount, which reduces the requirement for the accuracy of the user's gesture operation and improves the efficiency of the gesture operation. The volume adjustment method of the present invention does not need to contact the terminal, does not affect the performance of the terminal, and has convenient gesture operation and easy recognition of the terminal. The volume adjustment method provided by the present invention has high reliability.

附图说明DRAWINGS

为了更清楚地说明本发明实施例或现有技术中的技术方案，下面将对实施例或现有技术描述中所需要使用的附图做简单地介绍，显而易见地，下面描述中的附图是本发明的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings to be used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are Some embodiments of the present invention may also be used to obtain other drawings based on these drawings without departing from the art.

图1是本发明实施例提供的一种音量调节场景示意图；1 is a schematic diagram of a volume adjustment scenario according to an embodiment of the present invention;

图2是本发明实施例提供的一种音量调节方法流程示意图；2 is a schematic flow chart of a volume adjustment method according to an embodiment of the present invention;

图3是本发明实施例提供的另一种音量调节场景示意图；FIG. 3 is a schematic diagram of another volume adjustment scenario according to an embodiment of the present invention; FIG.

图4是本发明实施例提供的再一种音量调节场景示意图；FIG. 4 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention; FIG.

图5是本发明实施例提供的又一种音量调节场景示意图；FIG. 5 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention; FIG.

图6是本发明实施例提供的又一种音量调节场景示意图；FIG. 6 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention; FIG.

图7是本发明实施例提供的又一种音量调节场景示意图；FIG. 7 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention; FIG.

图8是本发明实施例提供的又一种音量调节场景示意图；FIG. 8 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention; FIG.

图9是本发明实施例提供的一种音量调节装置结构示意图；FIG. 9 is a schematic structural diagram of a volume adjustment apparatus according to an embodiment of the present invention; FIG.

图10为本发明提供的一种终端的硬件结构示意图。FIG. 10 is a schematic structural diagram of hardware of a terminal provided by the present invention.

具体实施方式Detailed ways

为使本发明实施例的目的、技术方案和优点更加清楚，下面将结合本发明实施例中的附图，对本发明实施例中的技术方案进行清楚、完整地描述，显然，所描述的实施例仅仅是本发明一部分实施例，而不是全部的实施例。基于本发明中的实施例，本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例，都属于本发明保护的范围。 The technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the drawings in the embodiments of the present invention. It is only a part of the embodiments of the invention, not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

本发明的说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”“第四”等是用于区别类似的对象，而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换，以便这里描述的本发明的实施例能够以除了在这里图示或描述的那些以外的顺序实施。The terms "first", "second", "third", "fourth" and the like in the specification and claims of the present invention and the above drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order. Or prioritization. It is to be understood that the data so used may be interchanged where appropriate, so that the embodiments of the invention described herein can be implemented in a sequence other than those illustrated or described herein.

应当理解，本文中使用的术语“包括”和“具有”以及他们的任何变形，意图在于覆盖不排他的包含，例如，包含了一系列步骤或单元的过程、方法、***、产品或设备不必限于清楚地列出的那些步骤或单元，而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。It is to be understood that the terms "comprises" and "comprises" and "the" and "the" Those steps or units that are clearly listed may include other steps or units that are not explicitly listed or inherent to such processes, methods, products, or devices.

应当理解，本文中使用的术语“和/或”仅仅是一种描述关联对象的关联关系，表示可以存在三种关系，例如，A和/或B，可以表示：单独存在A，同时存在A和B，单独存在B这三种情况。It should be understood that the term "and/or" as used herein is merely an association describing the associated object, indicating that there may be three relationships, for example, A and/or B, which may indicate that A exists separately, while A and B, there are three cases of B alone.

取决于语境，如在此所使用的“若”可以被解释成为“在……时”或“当……时”或“响应于确定”或“响应于检测”。Depending on the context, "if" as used herein may be interpreted as "when" or "when" or "in response to determining" or "in response to detecting."

下面以具体地实施例对本发明的技术方案进行详细说明。下面这几个具体的实施例可以相互结合，对于相同或相似的概念或过程可能在某些实施例不再赘述。The technical solutions of the present invention will be described in detail below with specific embodiments. The following specific embodiments may be combined with each other, and the same or similar concepts or processes may not be described in some embodiments.

本申请中的非接触音量调节模式，是指终端通过摄像头识别用户手势形成的悬空移动轨迹控制音量增减的状态。非接触音量调节模式可以是响应触发信息开启的待触发的操作模式，也可以是终端一直就处于默认的操作模式。The non-contact volume adjustment mode in the present application refers to a state in which the terminal controls the volume increase and decrease by the camera to recognize the suspended movement trajectory formed by the user gesture. The non-contact volume adjustment mode may be an operation mode to be triggered in response to the trigger information being turned on, or the terminal may always be in the default operation mode.

本申请中的手势视频，是终端实施获得的用户对所述操作区进行悬空操作的视频。The gesture video in the present application is a video in which the user obtained by the terminal performs a floating operation on the operation area.

本申请中A与B的匹配，是A与B的相似度大于或等于预设的阈值。The matching between A and B in the present application is that the similarity between A and B is greater than or equal to a preset threshold.

本申请中的单位音量，是指用户调节音量操作时可调节的最小音量值，例如音量调节范围为0～100分贝，单位音量为10分贝，用户从0分贝增加10个单位音量后得到100分贝的调节结果。The unit volume in this application refers to the minimum volume value that can be adjusted when the user adjusts the volume operation. For example, the volume adjustment range is 0 to 100 decibels, the unit volume is 10 decibels, and the user increases the unit volume from 0 decibels to obtain 100 decibels. The result of the adjustment.

图1是本发明实施例提供的一种音量调节场景示意图。FIG. 1 is a schematic diagram of a volume adjustment scenario according to an embodiment of the present invention.

在用户不方便以接触方式操作终端时，本发明提供的音量调节方法，可以让终端在非接触音量调节模式下通过摄像头获取用户的手势，以用户手势形成的悬空移动轨迹控制音量的增减。在图1所示的使用场景中，终端为手机，用户在手机的前置的摄像头前方悬空摆出与预设手势一致的“V”形手势，并来回晃动手势，实现一种不接触手机的音量控制。图1所示的场景中，终端向用户显示了操作区和基准线，其中的基准线可以是如图1中的倾斜设置，但也可以是如图3所示的水平设置。图1中终端还向用户显示了当前的音量状态为5个单位音量。When the user is inconvenient to operate the terminal in a contact manner, the volume adjustment method provided by the present invention allows the terminal to acquire the gesture of the user through the camera in the non-contact volume adjustment mode, and controls the increase and decrease of the volume by the suspended movement track formed by the user gesture. In the usage scenario shown in FIG. 1 , the terminal is a mobile phone, and the user hangs a “V”-shaped gesture that is consistent with the preset gesture in front of the front camera of the mobile phone, and shakes the gesture back and forth to realize a contactless mobile phone. volume control. In the scenario shown in FIG. 1, the terminal displays the operation area and the reference line to the user, wherein the reference line may be the tilt setting as in FIG. 1, but may also be the horizontal setting as shown in FIG. The terminal in Figure 1 also The current volume status is displayed to the user as 5 unit volumes.

图2是本发明实施例提供的一种音量调节方法流程示意图。2 is a schematic flow chart of a volume adjustment method according to an embodiment of the present invention.

图3是本发明实施例提供的另一种音量调节场景示意图。FIG. 3 is a schematic diagram of another volume adjustment scenario according to an embodiment of the present invention.

图2所示实施例所示的音量调节方法，应用于终端，所述终端包括摄像头。本实施例中的终端可以是移动终端，也可以是固定终端。移动终端包括但不限于手机、个人数字助理(Personal Digital Assistant，PDA)、平板电脑、便携设备(例如，便携式计算机)等具有图像采集功能的移动设备。固定终端包括但不限于智能固定电话、控制台等具有图像采集功能的固定设备。本发明实施例一对终端的形式并不限定。图3的应用场景中的终端为手机。The volume adjustment method shown in the embodiment shown in FIG. 2 is applied to a terminal, and the terminal includes a camera. The terminal in this embodiment may be a mobile terminal or a fixed terminal. Mobile terminals include, but are not limited to, mobile devices, personal digital assistants (PDAs), tablets, portable devices (eg, portable computers), and the like having mobile devices. Fixed terminals include, but are not limited to, fixed devices such as smart landlines, consoles, and the like that have image capture functions. The form of a pair of terminals in the embodiment of the present invention is not limited. The terminal in the application scenario of FIG. 3 is a mobile phone.

图2所示的音量调节方法包括以下步骤：The volume adjustment method shown in FIG. 2 includes the following steps:

S110，向用户显示操作区和所述操作区内的基准线，并从所述摄像头获得所述用户对所述操作区进行悬空操作的手势视频。S110. Display a reference line of the operation area and the operation area to the user, and obtain, from the camera, a gesture video of the user performing a dangling operation on the operation area.

具体地，在非接触音量调节模式下，终端在显示屏上显示出如图1和图3所示的音量操作界面，音量操作界面上显示有操作区和操作区内的基准线。其中，基准线可以是如图1所示的直线，也可以是曲线，还可以是闭合曲线，例如圆形、矩形等。基准线可以是如图1所示的以线条显示出来，也可以是以颜色分界来示意，例如图3中操作区被基准线分割为上下两个子操作区，上面的子操作区可以显示颜色为绿色(颜色未示出)，下面的子操作区可以显示颜色为蓝色(颜色未示出)，则绿色和蓝色在基准线位置突变，以示意基准线的位置。Specifically, in the non-contact volume adjustment mode, the terminal displays a volume operation interface as shown in FIG. 1 and FIG. 3 on the display screen, and the operation area and the reference line in the operation area are displayed on the volume operation interface. The reference line may be a straight line as shown in FIG. 1 , a curved line, or a closed curve, such as a circle, a rectangle, or the like. The reference line may be displayed as a line as shown in FIG. 1 or may be indicated by a color boundary. For example, in FIG. 3, the operation area is divided into upper and lower sub-operation areas by the reference line, and the upper sub-operation area can display the color as Green (color not shown), the lower sub-operation area can display the color blue (color not shown), then the green and blue are abruptly changed at the baseline position to indicate the position of the reference line.

本实施例中，在非接触音量调节模式下，获得手势视频。其中，手势视频，是终端实施获得的用户对所述操作区进行悬空操作的视频，并且限定为是从摄像头获得的。进一步地，手势视频可以是从预设的摄像头获得的，例如终端仅仅从其前置的摄像头获得手势视频。In this embodiment, in the non-contact volume adjustment mode, a gesture video is obtained. The gesture video is a video of a user performing a dangling operation on the operation area obtained by the terminal, and is defined as being obtained from a camera. Further, the gesture video may be obtained from a preset camera, for example, the terminal only obtains a gesture video from its front camera.

具体地，终端先对摄像头实时获得的视频进行识别，在确定摄像头获取到的视频是满足条件的视频后，开始获取手势视频。视频是以时间戳顺序显示的若干个帧图片，每个时间点都获得一个帧图片。确定摄像头获取到的视频是满足条件的手势视频的方法，可以是判断帧图片中的图像是否与预设的图像或图形匹配，若是，则获取该帧图片以及该帧图片之后的视频，作为手势视频。Specifically, the terminal first recognizes the video obtained by the camera in real time, and starts to acquire the gesture video after determining that the video acquired by the camera is a video that satisfies the condition. Video is a number of frame pictures displayed in timestamp order, and one frame picture is obtained at each time point. Determining whether the video captured by the camera is a gesture video satisfying the condition, and determining whether the image in the frame image matches the preset image or graphic, and if yes, acquiring the frame image and the video after the frame image as a gesture video.

一种实现方式中，终端中预设有手势图像，例如“V”形手势图像。首先在实时获得的帧图片中识别是否有手势图像，若有，则去除背景提取目标手势图像，若没有则继续获取下一个时间点的帧图片。将目标手势图像与预设的“V”形手势图像进行相似度比较，得到相似度。直到得到的相似度大于或等于80％时，确定摄像头获取到的视频是满足条件的视频，获取该帧图片以及该帧图片之后的视频，作为手势视频。In an implementation manner, a gesture image, such as a “V” shaped gesture image, is pre-set in the terminal. First, it is recognized whether there is a gesture image in the frame image obtained in real time, and if so, the background extraction target gesture image is removed, if not Continue to get the frame picture at the next point in time. Comparing the target gesture image with the preset "V" shaped gesture image to obtain similarity. Until the obtained similarity is greater than or equal to 80%, it is determined that the video acquired by the camera is a video satisfying the condition, and the frame picture and the video after the frame picture are acquired as a gesture video.

另一种实现方式中，终端中预设有手势图形，例如手势图形为“V”形。首先在实时获得的帧图片中识别是否有手势图像，若有，则去除背景提取目标手势图像，若没有则继续获取下一个时间点的帧图片。将目标手势图像进行图形拟合，获得拟合图形，例如“V”形手势的目标手势图像拟合获得的拟合图形是“V”或“U”，其中拟合图形“U”与手势图形“V”的相似度可以判断为90％。将拟合图形与预设的手势图形进行相似度比较，得到相似度。直到得到的相似度大于或等于80％时，确定摄像头获取到的视频是满足条件的视频，获取该帧图片以及该帧图片之后的视频，作为手势视频。In another implementation manner, a gesture graphic is preset in the terminal, for example, the gesture graphic is a “V” shape. First, it is recognized whether there is a gesture image in the frame image obtained in real time, and if so, the background extraction target gesture image is removed, and if not, the frame image of the next time point is continuously acquired. The target gesture image is graphically fitted to obtain a fitted graph, for example, the target gesture image fitting of the “V” shaped gesture is obtained by fitting a “V” or “U”, wherein the fitting graphic “U” and the gesture graphic are The similarity of "V" can be judged as 90%. The similarity is obtained by comparing the fitted graph with the preset gesture graph. Until the obtained similarity is greater than or equal to 80%, it is determined that the video acquired by the camera is a video satisfying the condition, and the frame picture and the video after the frame picture are acquired as a gesture video.

S120，根据所述手势视频，获取所述用户进行悬空操作时在所述操作区的悬空移动轨迹。S120. Acquire, according to the gesture video, a dangling movement trajectory in the operation area when the user performs a dangling operation.

具体地，以手势视频的第一个帧图片中手势图像位置为初始操作位置，在每一个手势视频的帧图片中，都获得手势图像相对于初始操作位置的相对位置，从而得到用户对操作区进行悬空操作时手势运动的相对位置序列。本实施例中的初始操作位置和相对位置序列都具有X和Y两个坐标，即相对位置序列是二维坐标中的相对位置序列。根据相对位置序列可以确定手势视频中用户的悬空移动轨迹。还可以对相对位置序列中各个坐标进行等比例放大或缩小，得到需要尺寸的悬空移动轨迹。或者从相对位置序列获得各个坐标的相对比例，获得悬空移动轨迹的位图。Specifically, the position of the gesture image in the first frame picture of the gesture video is the initial operation position, and the relative position of the gesture image relative to the initial operation position is obtained in the frame picture of each gesture video, thereby obtaining the user operation area. The relative position sequence of the gesture motion when the dangling operation is performed. Both the initial operational position and the relative position sequence in this embodiment have two coordinates, X and Y, that is, the relative position sequence is a relative position sequence in two-dimensional coordinates. The dangling movement trajectory of the user in the gesture video can be determined according to the relative position sequence. It is also possible to scale up or down the respective coordinates in the relative position sequence to obtain a dangling movement trajectory of the required size. Or obtain the relative proportion of each coordinate from the relative position sequence to obtain a bitmap of the dangling movement trajectory.

上述步骤中，手势视频的帧图片中手势图像位置的确定方法可以是：以手势图像中相距最远的两手指顶端连线的中间点的位置，确定为该帧图片中的手势图像位置。例如：以“V”形手势中两手指顶端连线的中间点的位置，为该帧图片中的手势图像位置。In the above steps, the method for determining the position of the gesture image in the frame picture of the gesture video may be: determining the position of the gesture image in the frame picture by using the position of the intermediate point of the top line of the two fingers that are farthest apart in the gesture image. For example, the position of the middle point of the line connecting the top ends of the two fingers in the "V" shape gesture is the position of the gesture image in the frame picture.

S130，根据所述悬空移动轨迹，在所述操作区显示虚拟映射图标的映射移动轨迹，其中，所述悬空移动轨迹与所述映射移动轨迹的移动方向和位移一致。S130. Display, according to the dangling movement trajectory, a mapping movement trajectory of the virtual mapping icon in the operation area, wherein the dangling movement trajectory coincides with a moving direction and a displacement of the mapping movement trajectory.

具体地，针对悬空移动轨迹中的初始操作位置和相对位置序列，在操作区对应获得虚拟映射图标的显示位置，以使得虚拟映射图标跟随用户的手势移动。在操作区显示的虚拟映射图标的映射移动轨迹，可以是与悬空移动轨迹相同大小和形状的轨迹，也可以是等比例缩放后的轨迹。本实施例通过在操作区显示虚拟映射图标的映射移动轨迹，增加了用户与终端之间的交互，便于用户通过观察映射移动轨迹而对悬空移动轨迹进行控制，提高手势操作的准确性和效率。Specifically, for the initial operation position and the relative position sequence in the dangling movement track, the display position of the virtual map icon is obtained correspondingly in the operation area, so that the virtual map icon follows the gesture of the user. The mapping movement track of the virtual map icon displayed in the operation area may be a track of the same size and shape as the dangling movement track, or may be a scaled track. In this embodiment, by displaying the mapping movement trajectory of the virtual mapping icon in the operation area, the interaction between the user and the terminal is increased, and the user is convenient to move the suspension by observing the mapping movement trajectory. The trajectory is controlled to improve the accuracy and efficiency of the gesture operation.

S140，根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量。S140. Determine a volume adjustment amount according to a mapping movement trajectory of the virtual mapping icon with respect to the reference line.

具体地，基准线的两侧分别为用于控制音量增加的第一子操作区和用于控制音量减小的第二子操作区，根据虚拟映射图标在基准线两侧的轨迹来确定音量增大分量P和音量减小分量D。P-D若为正，则将P和D的差值确定为音量增大的音量调节量；P-D若为负，则将P和D的差值确定为音量减小的音量调节量。由于用户以手势悬空操作时较难做到精准地移动定位，如果要求用户手势精准地以某个预设轨迹运动，会造成操作难度大、效率低的问题，本实施例以虚拟映射图标相对于基准线的映射移动轨迹来确定音量调节量，可以降低用户的操作难度，提高手势操作效率。Specifically, two sides of the reference line are respectively a first sub-operation area for controlling volume increase and a second sub-operation area for controlling volume reduction, and the volume increase is determined according to the trajectory of the virtual map icon on both sides of the reference line. The large component P and the volume reduction component D. If P-D is positive, the difference between P and D is determined as the volume adjustment amount of the volume increase; if P-D is negative, the difference between P and D is determined as the volume adjustment amount of the volume reduction. Since it is difficult for the user to accurately move the positioning when the gesture is suspended, if the user is required to accurately move the gesture with a certain predetermined trajectory, the operation is difficult and the efficiency is low. In this embodiment, the virtual mapping icon is compared with the virtual mapping icon. The mapping movement of the reference line determines the volume adjustment amount, which can reduce the operation difficulty of the user and improve the efficiency of the gesture operation.

一种实现方式中，如图3所示，根据虚拟映射图标在基准线两侧的轨迹来确定音量增大分量P和音量减小分量D，具体可以是，基准线两侧分别设置有5个控制幅度范围带，如图3所示，每个幅度范围带指示了增大或减小的音量。在预设的滑动时间内，例如2秒内，以映射移动轨迹在第一子操作区或第二子操作区中最大达到的幅度范围带来确定音量的调节量。如图3所示的映射移动轨迹达到了第一子操作区的第二个幅度范围带，则调节音量增大2个单位音量。In an implementation manner, as shown in FIG. 3, the volume increasing component P and the volume decreasing component D are determined according to the trajectory of the virtual mapping icon on both sides of the reference line, and specifically, five sides of the reference line are respectively disposed. The amplitude range band is controlled, as shown in Figure 3, each amplitude range band indicating an increase or decrease in volume. In a preset sliding time, for example, within 2 seconds, the amplitude range in which the mapping movement trajectory is maximally reached in the first sub-operation area or the second sub-operation area brings about an adjustment amount of the determined volume. If the mapping movement track shown in FIG. 3 reaches the second amplitude range band of the first sub-operation area, the adjustment volume is increased by 2 unit volume.

图4是本发明实施例提供的再一种音量调节场景示意图。FIG. 4 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention.

另一种实现方式中，如图4所示，根据虚拟映射图标在基准线两侧的轨迹来确定音量增大分量P和音量减小分量D，具体可以是，以映射移动轨迹在第一子操作区中绘出闭合圈的次数，来确定P；以映射移动轨迹在第二子操作区中绘出闭合圈的次数，来确定D。虚拟映射图标从第一子操作区内的第一点位置出发，以顺时针或者逆时针方向在第一子操作区内移动，直到再次回到第一点位置，确定为在第一子操作区绘出一次闭合圈。虚拟映射图标从第二子操作区内的第二点位置出发，以顺时针或者逆时针方向在第二子操作区内移动，直到再次回到第二点位置，确定为在第二子操作区绘出一次闭合圈。例如图4所示，用户控制虚拟映射图标在第二子操作区逆时针(也可以是顺时针)划圈2次，终端则减小2个单位音量。第一子操作区和第二子操作区可以限制操作方向，即可以是终端只响应第一子操作区和第二子操作区中顺时针的操作，也可以是终端只响应第一子操作区和第二子操作区中逆时针的操作，也可以不对操作方向进行限制，即可以是响应第一子操作区中顺时针的操作，和第二子操作区中逆时针的操作，也可以是响应第一子操作区中逆时针的操作，和第二子操作区中顺时针的操作。In another implementation manner, as shown in FIG. 4, the volume increasing component P and the volume decreasing component D are determined according to the trajectory of the virtual mapping icon on both sides of the reference line, and specifically, the mapping moving track is in the first sub- The number of times the closed loop is drawn in the operating area is used to determine P; and the number of times the closed loop is drawn in the second sub-operating area by the mapped moving trajectory is determined to determine D. The virtual map icon moves from the first point position in the first sub-operation area, moves in the first sub-operation area in a clockwise or counterclockwise direction, and returns to the first point position again, and is determined to be in the first sub-operation area. Draw a closed loop. The virtual map icon moves from the second point position in the second sub-operation area, moves in the second sub-operation area in a clockwise or counterclockwise direction, and returns to the second point position again, and is determined to be in the second sub-operation area. Draw a closed loop. For example, as shown in FIG. 4, the user control virtual map icon is circled twice in the second sub-operation area counterclockwise (may be clockwise), and the terminal is reduced by 2 unit volumes. The first sub-operation area and the second sub-operation area may limit the operation direction, that is, the terminal may only respond to the clockwise operation in the first sub-operation area and the second sub-operation area, or the terminal may only respond to the first sub-operation area. And the counterclockwise operation in the second sub-operation area, the operation direction may not be limited, that is, it may be in response to a clockwise operation in the first sub-operation area, and a counterclockwise operation in the second sub-operation area, or may be Responding to counterclockwise operation in the first sub-operation area, and clockwise in the second sub-operation area operating.

再一种实现方式中，如图5～8所示，根据虚拟映射图标在基准线两侧的轨迹来确定音量增大分量P和音量减小分量D，具体可以是，以映射移动轨迹在第一子操作区或第二子操作区内满足预设路径来确定P和D。满足预设路径，具体可以是映射移动轨迹与一个预设的块区相交，或者是以预设的顺序与预设的两个或两个以上块区相交，从而满足预设的路径，参见图5～8。In another implementation manner, as shown in FIG. 5-8, the volume increasing component P and the volume decreasing component D are determined according to the trajectory of the virtual mapping icon on both sides of the reference line, and specifically, the mapping moving trajectory is P and D are determined by satisfying a preset path in a sub-operation area or a second sub-operation area. The preset path is met, and specifically, the mapping moving track intersects with a preset block area, or intersects with two or more preset block areas in a preset order, thereby satisfying the preset path, as shown in the figure. 5 to 8.

为了便于用户相对基准线移动操作控制，悬空移动轨迹的初始操作位置对应虚拟映射图标的位置可以是基准线的任意位置。例如将虚拟映射图标的初始显示位置设置在基准线的中间点，参见图4的界面示意。In order to facilitate the user's relative movement movement control with respect to the reference line, the initial operation position of the suspended movement track corresponding to the position of the virtual map icon may be any position of the reference line. For example, the initial display position of the virtual map icon is set at the middle point of the reference line, see the interface diagram of FIG.

本实施例提供的音量调节方法，应用于终端，所述终端包括摄像头，所述方法包括：开始进行音量调节时，首先向用户显示操作区和操作区内的基准线，并从摄像头获得用户对操作区进行悬空操作的手势视频；然后根据手势视频，获取用户进行悬空操作时在操作区的悬空移动轨迹；接着根据悬空移动轨迹，在操作区显示虚拟映射图标的映射移动轨迹，其中，悬空移动轨迹与映射移动轨迹的移动方向和位移一致；通过在操作区显示虚拟映射图标的映射移动轨迹，增加了用户与终端之间的交互，便于用户通过观察映射移动轨迹而对悬空移动轨迹进行控制，提高手势操作的准确性和效率；最后根据虚拟映射图标相对于基准线的映射移动轨迹，确定音量调节量，以虚拟映射图标相对于基准线的运动轨迹作为确定音量调节量的依据，降低了对用户手势操作精确度的要求，提高了手势操作效率。本实施例的音量调节方法无需接触终端，不会对终端的性能产生影响，且手势操作方便，终端也较容易识别，本发明提供的音量调节方法具有较高的可靠性。The volume adjustment method provided in this embodiment is applied to a terminal, and the terminal includes a camera. The method includes: when starting volume adjustment, first displaying a reference line in an operation area and an operation area to a user, and obtaining a user pair from the camera. The operation area performs a gesture video of the floating operation; then, according to the gesture video, acquires a suspended movement track in the operation area when the user performs the floating operation; and then displays a mapping movement track of the virtual mapping icon in the operation area according to the suspended movement track, wherein the suspended movement The trajectory is consistent with the moving direction and displacement of the mapped moving trajectory; by displaying the mapping moving trajectory of the virtual mapping icon in the operating area, the interaction between the user and the terminal is increased, and the user is convenient to control the suspended moving trajectory by observing the mapping moving trajectory. Improving the accuracy and efficiency of the gesture operation; finally determining the volume adjustment amount according to the mapping movement trajectory of the virtual mapping icon with respect to the reference line, and using the motion map of the virtual mapping icon relative to the reference line as the basis for determining the volume adjustment amount, reducing the pair User gesture operation Degree requirements, improve the efficiency of gesture operation. The volume adjustment method of the present embodiment does not need to contact the terminal, and does not affect the performance of the terminal, and the gesture operation is convenient, and the terminal is also easy to recognize. The volume adjustment method provided by the present invention has high reliability.

在图4所示的实施例中，基准线可以是设置为将操作区分割为第一子操作区和第二子操作区，如图4所示第一子操作区是上半个操作区，第二子操作区是下半个操作区。根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量的过程具体可以是：In the embodiment shown in FIG. 4, the reference line may be configured to divide the operation area into the first sub-operation area and the second sub-operation area, and the first sub-operation area is the upper half operation area as shown in FIG. The second sub-operation area is the lower half of the operation area. The process of determining the volume adjustment amount according to the mapping movement trajectory of the virtual mapping icon with respect to the reference line may specifically be:

随着用户手势移动，终端在操作区内显示的映射移动轨迹不断增加，首先分别判断第一子操作区和第二子操作区内是否有映射移动轨迹，然后根据第一子操作区和第二子操作区内的映射移动轨迹来确定音量调节量：As the user gesture moves, the mapping movement track displayed by the terminal in the operation area is continuously increased. First, it is determined whether there is a mapping movement track in the first sub-operation area and the second sub-operation area, and then according to the first sub-operation area and the second The mapping movement track in the sub-operation area determines the volume adjustment amount:

若第一子操作区内有所述虚拟映射图标的映射移动轨迹，说明用户做出了增大音量的手势操作，则根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，并将所述P作为音量增大的所述音量调节量。If there is a mapping movement track of the virtual mapping icon in the first sub-operation area, indicating that the user performs a gesture operation of increasing the volume, according to the mapping movement track of the virtual mapping icon in the first sub-operation area Indeed The volume is increased by the component P, and the P is used as the volume adjustment amount for increasing the volume.

若第二子操作区内有所述虚拟映射图标的映射移动轨迹，说明用户做出了减小音量的手势操作，则根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并将所述D作为音量减小的所述音量调节量。If there is a mapping movement track of the virtual mapping icon in the second sub-operation area, indicating that the user performs a gesture operation of reducing the volume, according to the mapping movement path of the virtual mapping icon in the second sub-operation area The volume reduction component D is determined, and the D is used as the volume adjustment amount for volume reduction.

对于用户悬空操作方式，过于精确的动作要求会加大操作难度，而本实施例以不同作用的第一子操作区和第二子操作区，来区别音量增大还是音量减小的操作，用户仅需要控制手势移动的区域范围就可以分别实现音量增大或者减小，降低了音量增大和音量减小操作的区分难度，使得用户操作更加便捷。For the user's floating operation mode, the too precise action requirement may increase the operation difficulty, and the embodiment uses the first sub-operation area and the second sub-operation area with different functions to distinguish the volume increase operation from the volume reduction operation. It is only necessary to control the range of the area in which the gesture moves, and the volume can be increased or decreased separately, which reduces the difficulty of distinguishing the volume increase and the volume reduction operation, and makes the user operation more convenient.

为了更加清楚地描述根据虚拟映射图标相对于基准线的映射移动轨迹，确定音量调节量的过程，下面以两种实现方式进行更加详细的说明。In order to more clearly describe the process of determining the volume adjustment amount according to the mapping movement trajectory of the virtual map icon with respect to the reference line, a more detailed description will be made below in two implementation manners.

图5是本发明实施例提供的又一种音量调节场景示意图。FIG. 5 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention.

图6是本发明实施例提供的又一种音量调节场景示意图。FIG. 6 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention.

在一种如图5和图6所示的实现方式中，第一子操作区内预设有第一图形；第二子操作区内预设有第二图形。第一图形和第二图形可以是相同的图形，也可以是不同的图形。第一图形和第二图形可以是西瓜、苹果、香蕉等具有实际含义的图形，也可以是直线、曲线、矩形、三角形等简单的几何图形。图5是以直线为第一图形和第二图形进行示意；图6是以矩形为第一图形和第二图形进行示意，但本发明不限于此。In an implementation as shown in FIG. 5 and FIG. 6, a first graphic is pre-set in the first sub-operation area; and a second graphic is pre-configured in the second sub-operation area. The first graphic and the second graphic may be the same graphic or different graphics. The first graphic and the second graphic may be figures having practical meanings such as watermelon, apple, banana, etc., or simple geometric figures such as straight lines, curves, rectangles, and triangles. 5 is a diagram in which a straight line is a first figure and a second figure; FIG. 6 is a diagram in which a rectangle is a first figure and a second figure, but the present invention is not limited thereto.

在获得映射移动轨迹后，判断第一子操作区和第二子操作区内是否有映射移动轨迹，以及映射移动轨迹与第一图形或第二图形的相交情况。After obtaining the mapping movement trajectory, determining whether there is a mapping movement trajectory in the first sub-operation area and the second sub-operation area, and mapping the intersection of the movement trajectory with the first graphic or the second graphic.

若第一子操作区内有虚拟映射图标的映射移动轨迹，根据所述映射移动轨迹与所述第一图形相交的第一相交次数，确定音量增大分量P，其中，P的大小与所述第一相交次数的大小成正比。终端可以是每检测到映射移动轨迹与第一图形一次相交，就增大一个单位音量，并向用户以增大的音量发出提示音，直到在预设时延(例如3秒)内不再检测到新的操作，则将最后获得的第一相交次数确定为音量增大分量P；也可以是以预设时间内检测到的第一相交次数，确定为音量增大分量P，并向用户以增大的音量发出提示音，例如1秒内检测到与第一图形的相交次数为3次，则确定P为3个单位音量，在原始音量基础上增加3个单位音量后向用户发出提示音。向用户以增大的音量发出提示音，可以便于用户听到音量增大后的效果，确定是否需要继续增加音量，或者如图5和图6所示的在增大4个音量后又转为减小1个音量的操作，导致最终增大3个单位音量。 If there is a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, determining a volume increasing component P according to the first intersection number of the mapping movement trajectory and the first graphic, wherein the size of P is The number of first intersections is proportional to the size. The terminal may increase a unit volume every time the detected moving track is intersected with the first graphic, and emit a prompt tone to the user at an increased volume until the preset delay (for example, 3 seconds) is no longer detected. To the new operation, the first obtained number of intersections is determined as the volume increase component P; or the first number of intersections detected in the preset time is determined as the volume increase component P, and is presented to the user The increased volume emits a prompt tone. For example, if the number of intersections with the first graphic is detected to be 3 times within 1 second, it is determined that P is 3 unit volume, and 3 units of volume are added to the original volume to give a prompt tone to the user. . Sending a prompt tone to the user at an increased volume can facilitate the user to hear the effect of the volume increase, determine whether it is necessary to continue to increase the volume, or change to 4 after increasing the volume by 4 as shown in FIG. 5 and FIG. The operation of reducing one volume results in a final increase of 3 unit volumes.

若第二子操作区内有虚拟映射图标的映射移动轨迹，根据所述映射移动轨迹与所述第二图形相交的第二相交次数，确定音量减小分量D，其中，所述D的大小与所述第二相交次数的大小成正比。终端可以是每检测到映射移动轨迹与第二图形一次相交，就减小一个单位音量，并向用户以减小的音量发出提示音，直到在预设时延(例如3秒)内不再检测到新的操作，则将最后获得的第二相交次数确定为音量减小分量D；也可以是以预设时间内检测到的第二相交次数，确定为音量减小分量D，并向用户以减小的音量发出提示音，例如1秒内检测到与第二图形的相交次数为2次，则确定D为2个单位音量，在原始音量基础上减小2个单位音量后向用户发出提示音。向用户以减小的音量发出提示音，可以便于用户听到音量减小后的效果，确定是否需要继续减小音量或者转为增加音量的操作。If there is a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, determining a volume reduction component D according to the second intersection number of the mapping movement trajectory and the second graphic, wherein the size of the D is The magnitude of the second number of intersections is proportional. The terminal may reduce the unit volume by each time the detected moving track is intersected with the second graphic, and emit a prompt tone to the user at a reduced volume until the preset delay (for example, 3 seconds) is no longer detected. To a new operation, the second obtained number of intersections is determined as the volume reduction component D; or the number of second intersections detected in the preset time is determined as the volume reduction component D, and is presented to the user The reduced volume emits a prompt tone. For example, if the number of intersections with the second graphic is detected to be 2 times within 1 second, it is determined that D is 2 unit volume, and the user is prompted to reduce the 2 unit volume by the original volume. sound. The user is prompted to sound at a reduced volume, which makes it easy for the user to hear the effect of the volume reduction and determine whether it is necessary to continue to decrease the volume or to increase the volume.

在图5中，映射移动轨迹与作为第一图形的竖线相交4次，映射移动轨迹与作为第二图形的竖线相交1次，最后的音量调节量为增大3个单位音量。In FIG. 5, the mapping movement trajectory intersects the vertical line as the first figure four times, the mapping movement trajectory intersects the vertical line as the second figure once, and the final volume adjustment amount is increased by three unit volumes.

在图6中，映射移动轨迹与作为第一图形的矩形相交4次，映射移动轨迹与作为第二图形的竖线相交1次，最后的音量调节量为增大3个单位音量。In FIG. 6, the mapping movement trajectory intersects the rectangle as the first figure four times, the mapping movement trajectory intersects the vertical line as the second figure once, and the last volume adjustment amount is increased by three unit volumes.

在图5和图6的实现方式中，用户左右晃动手势以切割第一图形或者第二图形，适于悬空的手势操作方式，并且以第一图形或者第二图形为移动目标，增加了与用户之间的交互，提高了操作效率。In the implementations of FIG. 5 and FIG. 6 , the user shakes the gesture left and right to cut the first graphic or the second graphic, is suitable for the hanging gesture operation mode, and increases the user with the first graphic or the second graphic as the moving target. The interaction between the two increases the efficiency of the operation.

在一种应用方式中，用户在运动时打开音乐播放器听音乐，在需要调节音量时以右手在手机摄像头前摆出“V”形手势，手机识别到用户摆出的“V”形手势后，在显示屏上显示出如图5或者图6所示的音量操作界面，并且在音量操作界面上显示跟踪用户手势移动位置的虚拟映射图标。虚拟映射图标首次显示在基准线的中心位置。如图5或者图6所示的音量操作界面中，屏幕中间的横向基准线将音量操作界面上分割为上下两个子操作区：第一子操作区和第二子操作区。第一子操作区用来感应增加音量的手势，第二子操作区用来感应减小音量的手势。在下述的一种实施例中，第一子操作区中设有第一图形，第二子操作区中设有第二图形，以第一图形和第二图形可以是如图5所示的直线或者图6所示的矩形，也可以是水果或动物卡通图形。用户移动“V”形手势左右晃动，可以是原地晃动，也可以是如图5、6所示的一边左右晃动一边下移，虚拟映射图标随着用户手势的左右晃动而在第一子操作区中形成与第一图像相交的映射移动轨迹。用户晃动“V”形手势，控制虚拟映射图标移动轨迹对第一子操作区里显示的第一图形切割(即相交)了4次，以使得终端将音量增大4个单位音量，再控制虚拟映射图标下移，并控制移动轨迹对第二子操作区里显示的第二图形切割(即相交)1次，以使得终端将音量减小1个单位音量。In one application mode, the user turns on the music player to listen to music while exercising, and when the volume needs to be adjusted, the right hand is placed in front of the mobile phone camera with a "V" shaped gesture, and the mobile phone recognizes the "V" shaped gesture of the user. A volume operation interface as shown in FIG. 5 or FIG. 6 is displayed on the display screen, and a virtual map icon for tracking the movement position of the user gesture is displayed on the volume operation interface. The virtual map icon appears for the first time at the center of the baseline. In the volume operation interface shown in FIG. 5 or FIG. 6, the horizontal reference line in the middle of the screen divides the volume operation interface into two upper and lower sub-operation areas: a first sub-operation area and a second sub-operation area. The first sub-operation area is used to sense a gesture of increasing the volume, and the second sub-operation area is used to sense a gesture of decreasing the volume. In one embodiment, the first sub-operation area is provided with a first graphic, and the second sub-operation area is provided with a second graphic, wherein the first graphic and the second graphic may be a straight line as shown in FIG. Or the rectangle shown in Figure 6 can also be a fruit or animal cartoon graphic. The user moves the "V"-shaped gesture to shake left and right. It can be shaken in place, or it can move down and side as shown in Figures 5 and 6. The virtual map icon moves in the first sub-operation with the left and right shaking of the user gesture. A mapping movement trajectory intersecting the first image is formed in the area. The user shakes the "V" shaped gesture, and controls the virtual mapping icon movement track to cut (ie, intersect) the first graphic displayed in the first sub-operation area 4 times, so that the terminal increases the volume by 4 unit volumes. Then control the virtual map icon to move down, and control the movement track to cut (ie, intersect) the second graphic displayed in the second sub-operation area once, so that the terminal reduces the volume by 1 unit volume.

图7是本发明实施例提供的又一种音量调节场景示意图。FIG. 7 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention.

图8是本发明实施例提供的又一种音量调节场景示意图。FIG. 8 is a schematic diagram of still another volume adjustment scenario according to an embodiment of the present invention.

在一种如图7和图8所示的实现方式中，第一子操作区内预设有第三图形和第四图形；第二子操作区内预设有第五图形和第六图形。图7中第三图形、第四图形、第五图形和第六图形都是直线；图8中第三图形、第四图形、第五图形和第六图形都是矩形。本实现方式中不对第三图形、第四图形、第五图形和第六图形的形状进行限定，仅根据映射移动轨迹和这些图形的相交情况来确定音量调节操作。In an implementation as shown in FIG. 7 and FIG. 8 , the third sub-operation area is pre-arranged with the third graphic and the fourth graphic; and the second sub-operation area is pre-set with the fifth graphic and the sixth graphic. The third figure, the fourth figure, the fifth figure, and the sixth figure in FIG. 7 are all straight lines; the third figure, the fourth figure, the fifth figure, and the sixth figure in FIG. 8 are all rectangles. In the present implementation, the shapes of the third graphic, the fourth graphic, the fifth graphic, and the sixth graphic are not limited, and the volume adjustment operation is determined only according to the mapping movement trajectory and the intersection of the graphics.

判断第一子操作区和第二子操作区内是否有映射移动轨迹，以及映射移动轨迹与第三图形、第四图形、第五图形和第六图形的相交情况。Determining whether there is a mapping movement trajectory in the first sub-operation area and the second sub-operation area, and mapping the intersection of the movement trajectory with the third figure, the fourth figure, the fifth figure, and the sixth figure.

若第一子操作区内有虚拟映射图标的映射移动轨迹，以第一子操作区内的所述映射移动轨迹连续与第三图形、第四图形分别相交一次，识别为完成一次第一类动作，将所述映射移动轨迹完成所述第一类动作的次数N确定为所述P，其中，P的大小与所述N的大小成正比。用户控制虚拟映射图标的移动轨迹先后经过第三图形、第四图形的所在区域，则映射移动轨迹连续与第三图形、第四图形分别相交一次，识别为一次有效的第一类动作，由此降低了用户误操作的可能性。例如，第三图形、第四图形可以是图7所示操作区中间设置的两条相互平行的直线，用户只有左右晃动的幅度连续超出代表第三图形、第四图形的直线时，才会出现映射移动轨迹连续与第三图形、第四图形分别相交一次，才被识别为有效的第一类动作，计为增大一个单位音量。图7所示的映射移动轨迹识别出4次第一动作。If there is a mapping movement track of the virtual mapping icon in the first sub-operation area, the mapping movement track in the first sub-operation area continuously intersects the third graphic and the fourth graphic, respectively, and is recognized as completing the first type of action. And determining, as the P, the number N of times that the mapping movement track completes the first type of action, wherein a size of P is proportional to a size of the N. The moving track of the user-controlled virtual mapping icon passes through the area where the third graphic and the fourth graphic are located, and the mapping moving track continuously intersects the third graphic and the fourth graphic respectively, and is recognized as a valid first-type action. Reduce the possibility of user misuse. For example, the third graphic and the fourth graphic may be two mutually parallel straight lines arranged in the middle of the operation area shown in FIG. 7, and the user only appears when the amplitude of the left and right shaking continuously exceeds the straight line representing the third graphic and the fourth graphic. The mapping movement track continuously intersects the third figure and the fourth figure once, respectively, and is recognized as a valid first type of action, which is counted as increasing a unit volume. The map movement trajectory shown in Fig. 7 recognizes the first action four times.

若第二子操作区内有虚拟映射图标的映射移动轨迹，以第二子操作区内的所述映射移动轨迹连续与第五图形、第六图形分别相交一次，识别为完成一次第二类动作，将所述映射移动轨迹完成所述第二类动作的次数M确定为所述D，其中，D的大小与所述M的大小成正比。本实现方式中以第二子操作区内映射移动轨迹确定D的过程，与本实现方式上述以第一子操作区内映射移动轨迹确定P的过程类似，在此不在赘述。If there is a mapping movement track of the virtual mapping icon in the second sub-operation area, the mapping movement track in the second sub-operation area continuously intersects with the fifth graphic and the sixth graphic, respectively, and is recognized as completing a second type of action. And determining, by the mapping movement track, the number M of the second type of actions as the D, wherein the size of D is proportional to the size of the M. In the implementation manner, the process of determining the D by mapping the movement trajectory in the second sub-operation area is similar to the process of determining the P by the mapping movement trajectory in the first sub-operation area in the present implementation manner, and details are not described herein.

在图7中，映射移动轨迹首先与第三图形相交一次，接着与第四图形相交一次，由此第一次完成了第一类动作，以此规律对映射移动轨迹进行识别，得到图7中映射移动轨迹在第一子操作区内完成了4次第一类动作，在第二子操作区内完成了1次第二类动作，最后的音量调节量为增大3个单位音量。 In FIG. 7, the mapping movement trajectory first intersects the third figure once, and then intersects with the fourth figure once, thereby completing the first type of action for the first time, and identifying the mapping movement trajectory by this rule, which is obtained in FIG. The mapping movement track completes the first type of action 4 times in the first sub-operation area, and performs the second type action in the second sub-operation area, and the final volume adjustment amount is increased by 3 unit volumes.

在图8中，映射移动轨迹首先与第三图形相交一次(图8中加粗示意相交部分的轨迹)，接着与第四图形相交一次，由此第一次完成了第二类动作，然后又与第三图像相交一次，第二次完成了第二类动作，以此规律对映射移动轨迹进行识别，得到图8中映射移动轨迹在第一子操作区内完成了4次第二类动作，在第二子操作区内完成了1次第二类动作，最后的音量调节量为增大3个单位音量。In FIG. 8, the mapping movement trajectory first intersects the third figure once (the trajectory of the intersecting portion is bolded in FIG. 8), and then intersects the fourth figure once, thereby completing the second type of action for the first time, and then Intersecting with the third image once, and completing the second type of action for the second time, the mapping movement trajectory is recognized by the law, and the mapping movement trajectory in FIG. 8 is completed in the first sub-operation area for 4 times of the second type of action. The second type of action is completed once in the second sub-operation area, and the final volume adjustment amount is increased by 3 unit volumes.

在图7和图8所示的实现方式中，用户晃动手势控制虚拟映射图标与两个图标相交，对手势动作进行了限定，降低了用户误操作的可能性。In the implementation modes shown in FIG. 7 and FIG. 8 , the user shaking gesture controls the virtual mapping icon to intersect with the two icons, and limits the gesture action, thereby reducing the possibility of the user erroneously operating.

用户在需要进行图1～8所示的音量调节过程时，可以是向终端发送触发信息以开启非接触音量调节模式，也可以是终端自动在检测到触发信息时就自动进入非接触音量调节模式，用户可以在非接触音量调节模式下的任意时刻进行图1所示的音量调节过程。When the user needs to perform the volume adjustment process shown in FIG. 1-8, the trigger information may be sent to the terminal to enable the non-contact volume adjustment mode, or the terminal may automatically enter the non-contact volume adjustment mode when the trigger information is detected. The user can perform the volume adjustment process shown in FIG. 1 at any time in the non-contact volume adjustment mode.

具体地，终端在确定获得触发信息时，向用户显示操作区和所述操作区内的基准线。其中，所述获得触发信息的方式可以是以下任一种：Specifically, when determining that the trigger information is obtained, the terminal displays the operation area and the reference line in the operation area to the user. The manner of obtaining the trigger information may be any of the following:

一种获得触发信息的方式是：终端获得与预设触发语音信息一致的语音信息。例如，用户对着终端讲话：“打开非接触音量调节模式”，终端通过麦克风获得语音信号并识别得到语义“打开非接触音量调节模式”，与终端预设的触发语义一致，则进入非接触音量调节模式，开始进行图1～8所示的音量调节过程。A way to obtain trigger information is: the terminal obtains voice information consistent with the preset trigger voice information. For example, the user speaks to the terminal: “turn on the non-contact volume adjustment mode”, the terminal obtains the voice signal through the microphone and recognizes the semantic “open non-contact volume adjustment mode”, which is consistent with the trigger semantics preset by the terminal, and enters the non-contact volume. Adjust the mode and start the volume adjustment process shown in Figures 1-8.

另一种获得触发信息的方式是：从所述摄像头获得与预设触发图像一致的图像。例如，用户向终端的摄像头摆出张开五指的手势，终端通过摄像头获得张开五指的手势图像，与终端预设的触发图像一致，则进入非接触音量调节模式，开始进行图1～8所示的音量调节过程。Another way to obtain trigger information is to obtain an image from the camera that is consistent with the preset trigger image. For example, the user puts a gesture of opening a five-finger gesture to the camera of the terminal, and the terminal obtains a gesture image of the five-finger gesture through the camera, and matches the trigger image preset by the terminal, and enters the non-contact volume adjustment mode, and starts the operations of FIG. 1-8. The volume adjustment process shown.

再一种获得触发信息的方式是：检测到音视频应用程序被开启。例如，用户打开音视频应用程序，可以是所有音视频应用程序，也可以是预设的某几个音视频应用程序。终端检测到音视频应用程序被打开，则自动进入非接触音量调节模式，开始进行图1～8所示的音量调节过程。Another way to obtain trigger information is to detect that the audio and video application is turned on. For example, the user opens the audio and video application, which can be all audio and video applications, or a preset number of audio and video applications. When the terminal detects that the audio and video application is turned on, the terminal automatically enters the non-contact volume adjustment mode, and starts the volume adjustment process shown in FIGS. 1-8.

图9是本发明实施例提供的一种音量调节装置结构示意图。FIG. 9 is a schematic structural diagram of a volume adjustment apparatus according to an embodiment of the present invention.

本实施例提供的音量调节装置可以是软件装置，也可以是硬件装置。该音量调节装置应用于终端，所述终端包括摄像头。The volume adjustment device provided in this embodiment may be a software device or a hardware device. The volume adjustment device is applied to a terminal, and the terminal includes a camera.

图9所示的装置包括：The device shown in Figure 9 includes:

显示模块21，用于向用户显示操作区和所述操作区内的基准线； a display module 21, configured to display a reference area of the operation area and the operation area to the user;

手势视频获得模块22，用于从所述摄像头获得所述用户对所述操作区进行悬空操作的手势视频；a gesture video obtaining module 22, configured to obtain, from the camera, a gesture video of the user performing a dangling operation on the operation area;

悬空移动轨迹获得模块23，用于根据所述手势视频，获取所述用户进行悬空操作时在所述操作区的悬空移动轨迹；a dangling movement trajectory obtaining module 23, configured to acquire, according to the gesture video, a dangling movement trajectory in the operation area when the user performs a dangling operation;

映射移动轨迹获得模块24，用于根据所述悬空移动轨迹，在所述操作区显示虚拟映射图标的映射移动轨迹，其中，所述悬空移动轨迹与所述映射移动轨迹的移动方向和位移一致；a mapping movement trajectory obtaining module 24, configured to display a mapping movement trajectory of the virtual mapping icon in the operation area according to the suspended movement trajectory, wherein the suspended movement trajectory is consistent with a moving direction and a displacement of the mapping movement trajectory;

音量调节量确定模块25，用于根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量。The volume adjustment amount determining module 25 is configured to determine a volume adjustment amount according to a mapping movement trajectory of the virtual mapping icon with respect to the reference line.

图9所示实施例的装置对应地可用于执行图2所示方法实施例中终端执行的步骤，其实现原理和技术效果类似，此处不再赘述。The device in the embodiment shown in FIG. 9 is correspondingly used to perform the steps performed by the terminal in the method embodiment shown in FIG. 2, and the implementation principle and technical effects are similar, and details are not described herein again.

在一种实施方式中，所述基准线将所述操作区分割为第一子操作区和第二子操作区；In an embodiment, the reference line divides the operation area into a first sub-operation area and a second sub-operation area;

若所述第二子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并将所述D作为音量减小的所述音量调节量；If there is a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, determining a volume reduction component D according to a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, and The D is the volume adjustment amount that is reduced in volume;

若所述第一子操作区和所述第二子操作区内均有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并根据所述P和D确定所述音量调节量。If the first sub-operation area and the second sub-operation area both have a mapping movement track of the virtual mapping icon, according to the mapping movement track of the virtual mapping icon in the first sub-operation area, Determining the volume up component P, determining a volume reduction component D according to the mapping movement trajectory of the virtual map icon in the second sub-operation area, and determining the volume adjustment amount according to the P and D.

以下用两个进一步的实施例对本实施例中的音量调节量确定模块进行说明：The volume adjustment amount determining module in this embodiment will be described below by using two further embodiments:

在一种进一步的实施例中，所述第一子操作区内预设有第一图形；所述第二子操作区内预设有第二图形；In a further embodiment, the first sub-operation area is pre-set with a first graphic; the second sub-operation area is pre-set with a second graphic;

所述音量调节量确定模块用于：根据所述映射移动轨迹与所述第一图形相交的第一相交次数，确定所述P，其中，P的大小与所述第一相交次数的大小成正比；根据所述映射移动轨迹与所述第二图形相交的第二相交次数，确定所述D，其中，所述D的大小与所述第二相交次数的大小成正比。The volume adjustment amount determining module is configured to: determine the P according to a first intersection number of the mapping movement trajectory and the first graphic, wherein a size of P is proportional to a size of the first intersection number Determining the D according to a second number of intersections of the mapping movement trajectory and the second graphic, wherein the D The size is proportional to the size of the second number of intersections.

在另一种进一步的实施例中，所述第一子操作区内预设有第三图形和第四图形；所述第二子操作区内预设有第五图形和第六图形；In another further embodiment, the first sub-operation area is pre-set with a third graphic and a fourth graphic; and the second sub-operation area is pre-set with a fifth graphic and a sixth graphic;

在图9所示的实施例中，所述手势视频获得模块22具体用于：在确定获得触发信息时，向用户显示操作区和所述操作区内的基准线；其中，所述获得触发信息，包括以下任一种：In the embodiment shown in FIG. 9 , the gesture video obtaining module 22 is specifically configured to: when determining to obtain the trigger information, display the operation area and the reference line in the operation area to the user; wherein the obtaining the trigger information , including any of the following:

图10为本发明提供的一种终端的硬件结构示意图。如图10所示，该终端包括：处理器311以及存储器312；其中FIG. 10 is a schematic structural diagram of hardware of a terminal provided by the present invention. As shown in FIG. 10, the terminal includes: a processor 311 and a memory 312;

存储器312，用于存储计算机程序，该存储器还可以是闪存(flash)。The memory 312 is configured to store a computer program, and the memory may also be a flash.

处理器311，用于执行存储器存储的执行指令，以实现上述音量调节方法中终端执行的各个步骤。具体可以参见前面方法实施例中的相关描述。The processor 311 is configured to execute an execution instruction of the memory storage to implement various steps performed by the terminal in the volume adjustment method. For details, refer to the related description in the foregoing method embodiments.

可选地，存储器312既可以是独立的，也可以跟处理器311集成在一起。Alternatively, the memory 312 can be either independent or integrated with the processor 311.

当所述存储器312是独立于处理器311之外的器件时，所述终端还可以包括：When the memory 312 is a device other than the processor 311, the terminal may further include:

总线313，用于连接所述存储器312和处理器311。A bus 313 is provided for connecting the memory 312 and the processor 311.

本发明还提供一种可读存储介质，可读存储介质中存储有执行指令，当终端的至少一个处理器执行该执行指令时，终端执行上述的各种实施方式提供的音量调节方法。The present invention further provides a readable storage medium having stored therein an execution instruction, and when the at least one processor of the terminal executes the execution instruction, the terminal executes the volume adjustment method provided by the various embodiments described above.

本发明还提供一种程序产品，该程序产品包括执行指令，该执行指令存储在可读存储介质中。终端的至少一个处理器可以从可读存储介质读取该执行指令，至少一个处理器执行该执行指令使得终端实施上述的各种实施方式提供的音量调节方法。The present invention also provides a program product comprising an execution instruction stored in a readable storage medium. At least one processor of the terminal can read the execution instruction from a readable storage medium, and the at least one processor executes the execution instruction such that the terminal implements the volume adjustment method provided by the various embodiments described above.

在上述终端或者服务器的实施例中，应理解，处理器可以是中央处理单元(英文：Central Processing Unit，简称：CPU)，还可以是其他通用处理器、数字信号处理器(英文：Digital Signal Processor，简称：DSP)、专用集成电路(英文：Application Specific Integrated Circuit，简称：ASIC)等。通用处理器可以是微处理器或者该处理器也可以是任何常规的处理器等。结合本申请所公开的方法的步骤可以直接体现为硬件处理器执行完成，或者用处理器中的硬件及软件模块组合执行完成。In the above embodiment of the terminal or the server, it should be understood that the processor may be a central processing unit (English: Central Processing Unit, CPU for short), or may be other general-purpose processors, digital signal processing. (English: Digital Signal Processor, abbreviated as: DSP), ASIC (English: Application Specific Integrated Circuit, ASIC for short). The general purpose processor may be a microprocessor or the processor or any conventional processor or the like. The steps of the method disclosed in connection with the present application may be directly embodied by hardware processor execution or by a combination of hardware and software modules in a processor.

最后应说明的是：以上各实施例仅用以说明本发明的技术方案，而非对其限制；尽管参照前述各实施例对本发明进行了详细的说明，本领域的普通技术人员应当理解：其依然可以对前述各实施例所记载的技术方案进行修改，或者对其中部分或者全部技术特征进行等同替换；而这些修改或者替换，并不使相应技术方案的本质脱离本发明各实施例技术方案的范围。 Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, and are not intended to be limiting; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art will understand that The technical solutions described in the foregoing embodiments may be modified, or some or all of the technical features may be equivalently replaced; and the modifications or substitutions do not deviate from the technical solutions of the embodiments of the present invention. range.

Claims

一种音量调节方法，其特征在于，应用于终端，所述终端包括摄像头，所述方法包括：A volume adjustment method is applied to a terminal, the terminal includes a camera, and the method includes:

向用户显示操作区和所述操作区内的基准线，并从所述摄像头获得所述用户对所述操作区进行悬空操作的手势视频；Displaying a reference line of the operation area and the operation area to the user, and obtaining, from the camera, a gesture video of the user performing a floating operation on the operation area;

根据所述手势视频，获取所述用户进行悬空操作时在所述操作区的悬空移动轨迹；Acquiring, according to the gesture video, a dangling movement trajectory in the operation area when the user performs a dangling operation;

根据所述悬空移动轨迹，在所述操作区显示虚拟映射图标的映射移动轨迹，其中，所述悬空移动轨迹与所述映射移动轨迹的移动方向和位移一致；Displaying, according to the dangling movement trajectory, a mapping movement trajectory of the virtual mapping icon in the operation area, wherein the dangling movement trajectory is consistent with a moving direction and a displacement of the mapping movement trajectory;

根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量。A volume adjustment amount is determined according to a mapping movement trajectory of the virtual map icon with respect to the reference line.
根据权利要求1所述的方法，其特征在于，所述基准线将所述操作区分割为第一子操作区和第二子操作区；The method according to claim 1, wherein the reference line divides the operation area into a first sub-operation area and a second sub-operation area;

所述根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量，包括：Determining a volume adjustment amount according to the mapping movement trajectory of the virtual mapping icon with respect to the reference line, including:

若所述第一子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，并将所述P作为音量增大的所述音量调节量；If there is a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, determining a volume increasing component P according to a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, and The P is the volume adjustment amount that is increased in volume;

若所述第二子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并将所述D作为音量减小的所述音量调节量。If there is a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, determining a volume reduction component D according to a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, and The D is the volume adjustment amount whose volume is reduced.
根据权利要求2所述的方法，其特征在于，所述第一子操作区内预设有第一图形；所述第二子操作区内预设有第二图形；The method according to claim 2, wherein the first sub-operation area is pre-set with a first graphic; and the second sub-operation area is pre-set with a second graphic;

所述根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，包括：Determining the volume increase component P according to the mapping movement trajectory of the virtual mapping icon in the first sub-operation area, including:

根据所述映射移动轨迹与所述第一图形相交的第一相交次数，确定所述P，其中，P的大小与所述第一相交次数的大小成正比；Determining the P according to the first intersection number of the mapping movement trajectory intersecting the first graphic, wherein a size of P is proportional to a size of the first intersection number;

相应地，所述根据所述虚拟映射图标在所述第二子操作区内的移动轨迹，确定音量减小分量D，包括：Correspondingly, determining the volume reduction component D according to the movement trajectory of the virtual mapping icon in the second sub-operation area includes:

根据所述映射移动轨迹与所述第二图形相交的第二相交次数，确定所述D，其中，所述D的大小与所述第二相交次数的大小成正比。Determining the D according to a second number of intersections of the mapping movement trajectory and the second figure, wherein a size of the D is proportional to a size of the second number of intersections.
根据权利要求2所述的方法，其特征在于，所述第一子操作区内预设有第三图形和第四图形；所述第二子操作区内预设有第五图形和第六图形；The method according to claim 2, wherein the first sub-operation area is pre-set with a third map And a fourth graphic; the fifth sub-operation area is pre-set with a fifth graphic and a sixth graphic;

所述根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，包括：Determining the volume increase component P according to the mapping movement trajectory of the virtual mapping icon in the first sub-operation area, including:

以第一子操作区内的所述映射移动轨迹连续与第三图形、第四图形分别相交一次，识别为完成一次第一类动作，将所述映射移动轨迹完成所述第一类动作的次数N确定为所述P，其中，P的大小与所述N的大小成正比；The mapping movement trajectory in the first sub-operation area is continuously intersected with the third graphic and the fourth graphic, respectively, and is identified as the number of times the mapping movement trajectory completes the first type of motion N is determined as the P, wherein the size of P is proportional to the size of the N;

相应地，所述根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，包括：Correspondingly, determining the volume reduction component D according to the mapping movement trajectory of the virtual mapping icon in the second sub-operation area includes:

以第二子操作区内的所述映射移动轨迹连续与第五图形、第六图形分别相交一次，识别为完成一次第二类动作，将所述映射移动轨迹完成所述第二类动作的次数M确定为所述D，其中，D的大小与所述M的大小成正比。And the mapping movement trajectory in the second sub-operation area is continuously intersected with the fifth graphic and the sixth graphic, respectively, and is identified as completing the second type of motion, and the mapping movement trajectory completes the second type of motion M is determined to be the D, wherein the size of D is proportional to the size of the M.
根据权利要求1所述的方法，其特征在于，所述向用户显示操作区和所述操作区内的基准线，包括：The method according to claim 1, wherein the displaying the operating area and the reference line in the operating area to the user comprises:

在确定获得触发信息时，向用户显示操作区和所述操作区内的基准线；When determining to obtain the trigger information, displaying the operating area and the reference line in the operating area to the user;

其中，所述获得触发信息，包括以下任一种：The obtaining the trigger information includes any one of the following:

获得与预设触发语音信息一致的语音信息；Obtaining voice information consistent with the preset trigger voice information;

从所述摄像头获得与预设触发图像一致的图像；Obtaining an image consistent with the preset trigger image from the camera;

检测到音视频应用程序被开启。The audio and video application is detected to be turned on.
一种音量调节装置，其特征在于，应用于终端，所述终端包括摄像头，所述装置包括：A volume adjustment device is applied to a terminal, the terminal includes a camera, and the device includes:

显示模块，用于向用户显示操作区和所述操作区内的基准线；a display module, configured to display to the user an operating area and a reference line in the operating area;

手势视频获得模块，用于从所述摄像头获得所述用户对所述操作区进行悬空操作的手势视频；a gesture video obtaining module, configured to obtain, from the camera, a gesture video of the user performing a dangling operation on the operation area;

悬空移动轨迹获得模块，用于根据所述手势视频，获取所述用户进行悬空操作时在所述操作区的悬空移动轨迹；a dangling movement trajectory obtaining module, configured to acquire, according to the gesture video, a dangling movement trajectory in the operation area when the user performs a dangling operation;

映射移动轨迹获得模块，用于根据所述悬空移动轨迹，在所述操作区显示虚拟映射图标的映射移动轨迹，其中，所述悬空移动轨迹与所述映射移动轨迹的移动方向和位移一致；a mapping movement trajectory obtaining module, configured to display a mapping movement trajectory of the virtual mapping icon in the operation area according to the dangling movement trajectory, wherein the dangling movement trajectory is consistent with a moving direction and a displacement of the mapping movement trajectory;

音量调节量确定模块，用于根据所述虚拟映射图标相对于所述基准线的映射移动轨迹，确定音量调节量。 And a volume adjustment amount determining module, configured to determine a volume adjustment amount according to a mapping movement trajectory of the virtual mapping icon with respect to the reference line.
根据权利要求6所述的装置，其特征在于，所述基准线将所述操作区分割为第一子操作区和第二子操作区；The apparatus according to claim 6, wherein said reference line divides said operation area into a first sub-operation area and a second sub-operation area;

所述音量调节量确定模块用于：The volume adjustment amount determining module is configured to:

若所述第一子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第一子操作区内的映射移动轨迹，确定音量增大分量P，并将所述P作为音量增大的所述音量调节量；If there is a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, determining a volume increasing component P according to a mapping movement trajectory of the virtual mapping icon in the first sub-operation area, and The P is the volume adjustment amount that is increased in volume;

若所述第二子操作区内有所述虚拟映射图标的映射移动轨迹，则根据所述虚拟映射图标在所述第二子操作区内的映射移动轨迹，确定音量减小分量D，并将所述D作为音量减小的所述音量调节量。If there is a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, determining a volume reduction component D according to a mapping movement trajectory of the virtual mapping icon in the second sub-operation area, and The D is the volume adjustment amount whose volume is reduced.
根据权利要求7所述的装置，其特征在于，所述第一子操作区内预设有第一图形；所述第二子操作区内预设有第二图形；The device according to claim 7, wherein the first sub-operation area is pre-set with a first graphic; and the second sub-operation area is pre-set with a second graphic;

所述音量调节量确定模块用于：根据所述映射移动轨迹与所述第一图形相交的第一相交次数，确定所述P，其中，P的大小与所述第一相交次数的大小成正比；根据所述映射移动轨迹与所述第二图形相交的第二相交次数，确定所述D，其中，所述D的大小与所述第二相交次数的大小成正比。The volume adjustment amount determining module is configured to: determine the P according to a first intersection number of the mapping movement trajectory and the first graphic, wherein a size of P is proportional to a size of the first intersection number And determining the D according to the second intersection number of the mapping movement trajectory and the second figure, wherein the size of the D is proportional to the size of the second intersection number.
根据权利要求7所述的装置，其特征在于，所述第一子操作区内预设有第三图形和第四图形；所述第二子操作区内预设有第五图形和第六图形；The apparatus according to claim 7, wherein the first sub-operation area is pre-set with a third graphic and a fourth graphic; and the second sub-operation area is pre-set with a fifth graphic and a sixth graphic ;

所述音量调节量确定模块用于：以第一子操作区内的所述映射移动轨迹连续与第三图形、第四图形分别相交一次，识别为完成一次第一类动作，将所述映射移动轨迹完成所述第一类动作的次数N确定为所述P，其中，P的大小与所述N的大小成正比；以第二子操作区内的所述映射移动轨迹连续与第五图形、第六图形分别相交一次，识别为完成一次第二类动作，将所述映射移动轨迹完成所述第二类动作的次数M确定为所述D，其中，D的大小与所述M的大小成正比。The volume adjustment amount determining module is configured to: continuously intersect the third graphic and the fourth graphic respectively with the mapping movement track in the first sub-operation area, and identify that the first type of action is completed, and move the mapping The number N of times that the trajectory completes the first type of action is determined as the P, wherein the size of P is proportional to the size of the N; and the mapping movement trajectory in the second sub-operation area is continuous with the fifth graphic, The sixth graphics are respectively intersected once, and are identified as completing a second type of action, and determining the number M of the mapping movement trajectory to complete the second type of motion as the D, wherein the size of the D is equal to the size of the M Just proportional.
根据权利要求7所述的装置，其特征在于，所述手势视频获得模块用于：在确定获得触发信息时，向用户显示操作区和所述操作区内的基准线；其中，所述获得触发信息，包括以下任一种：The device according to claim 7, wherein the gesture video obtaining module is configured to display, to the user, an operating area and a reference line in the operating area when determining to obtain trigger information; wherein the obtaining trigger Information, including any of the following:

获得与预设触发语音信息一致的语音信息；Obtaining voice information consistent with the preset trigger voice information;

从所述摄像头获得与预设触发图像一致的图像；Obtaining an image consistent with the preset trigger image from the camera;

检测到音视频应用程序被开启。 The audio and video application is detected to be turned on.