WO2023130956A1 - 一种增强振动提示方法及电子设备 - Google Patents
一种增强振动提示方法及电子设备 Download PDFInfo
- Publication number
- WO2023130956A1 WO2023130956A1 PCT/CN2022/140540 CN2022140540W WO2023130956A1 WO 2023130956 A1 WO2023130956 A1 WO 2023130956A1 CN 2022140540 W CN2022140540 W CN 2022140540W WO 2023130956 A1 WO2023130956 A1 WO 2023130956A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- electronic device
- intensity
- vibration
- time
- music
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 102
- 230000002708 enhancing effect Effects 0.000 claims abstract description 7
- 230000006870 function Effects 0.000 claims description 39
- 230000015654 memory Effects 0.000 claims description 28
- 230000033764 rhythmic process Effects 0.000 claims description 27
- 238000004422 calculation algorithm Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 8
- 238000004904 shortening Methods 0.000 abstract description 9
- 230000000694 effects Effects 0.000 description 32
- 238000010586 diagram Methods 0.000 description 15
- 238000004891 communication Methods 0.000 description 12
- 230000004044 response Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 230000005291 magnetic effect Effects 0.000 description 7
- 238000007726 management method Methods 0.000 description 7
- 230000001965 increasing effect Effects 0.000 description 6
- 238000010295 mobile communication Methods 0.000 description 6
- 230000005236 sound signal Effects 0.000 description 5
- 229920001621 AMOLED Polymers 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 4
- 230000001413 cellular effect Effects 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000033001 locomotion Effects 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 239000011295 pitch Substances 0.000 description 2
- 239000002096 quantum dot Substances 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000001020 rhythmical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000000737 periodic effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035939 shock Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M19/00—Current supply arrangements for telephone systems
- H04M19/02—Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone or busy tone
- H04M19/04—Current supply arrangements for telephone systems providing ringing current or supervisory tones, e.g. dialling tone or busy tone the ringing-current being generated at the substations
Definitions
- the present application relates to the field of terminals, in particular to a method for enhancing vibration prompts and electronic equipment.
- the electronic device can output prompt information when a call is received, a new message is received, an alarm clock is ringing, etc., and the prompt information includes music prompts, vibration prompts, and the like.
- the vibration prompt may specifically vibrate along with the rhythm of the music.
- the vibration is sometimes strong and sometimes weak, and sometimes it does not vibrate for a period of time, which easily causes the user to not feel the vibration prompt information.
- the present application provides an enhanced vibration prompting method and an electronic device, and the method is applied to the electronic device.
- This method can realize that when the electronic device detects an event, it outputs enhanced vibration information according to the music feature corresponding to the event, so that the user turns off the music prompt and only turns on the enhanced vibration prompt, or when the music prompt cannot be heard in a noisy environment , the enhanced vibration effect can still be felt to prevent the user from ignoring the corresponding event.
- the present application provides a method for enhancing vibration reminders, the method is applied to an electronic device, and the method includes: the electronic device detects a first event, and the music corresponding to the first event includes: a first subsection, The second subsection; the electronic device vibrates at a first intensity for a first time, and vibrates at a second intensity for a second time; wherein, the first time, the first intensity, the second time and the second Intensity, conforming to any one or more of the following: the first intensity and the second intensity are both greater than or equal to the third intensity, and the third intensity corresponds to the strongest music in the first subsection and the second subsection Intensity; where the duration of the first subsection is less than or equal to the first value, the length of the first time is greater than the duration; or, the time between the first subsection and the second subsection Where the interval is greater than or equal to the second value, the interval between the first time and the second time is smaller than the time interval.
- the method before the electronic device detects the first event, the method further includes: the electronic device acquires standard vibrate information based on the music; the standard vibrate information includes: the third time, the third time The corresponding fourth intensity, the fourth time and the fourth time correspond to the fifth intensity; the third time is equal to the duration of the first subsection, and the fourth time is equal to the duration of the second subsection; the fourth The intensity corresponds to the sound intensity in the first subsection, and the fifth intensity corresponds to the sound intensity in the second subsection; the third intensity is greater than or equal to the fourth intensity and the fifth intensity.
- the electronic device can enhance the vibration effect based on the standard vibration information, which not only retains the relationship between the vibration effect and the characteristics of the music, but also enhances the tactile experience of the vibration to a certain extent, which not only improves the fun of the vibration prompt, but also enhances the vibration prompt. sense of experience.
- the first event includes: an incoming call, a message, a notification, an alarm clock, a reminder event, starting a game, or playing a video.
- the electronic device can output enhanced vibration prompt information in various scenarios to improve user experience.
- the music corresponding to the first event is set by the user or set by default by the electronic device.
- the music corresponding to the first event is pre-stored in the electronic device, or obtained by the electronic device from other devices.
- the user can set the music corresponding to the enhanced vibration in various ways to improve the user experience.
- the electronic device vibrates at a first intensity within a first time, and before vibrating at a second intensity within a second time, the method further includes: the electronic device starts an enhanced vibration function, and the enhanced vibration The function is to vibrate the electronic device with the first intensity during the first time, and vibrate with the second intensity during the second time.
- the enhanced vibration function can be selected whether to be applied to the electronic device according to the user's preference.
- the method further includes: the electronic device receives a first operation, and the first operation is used to trigger the electronic device to start the enhanced vibration function.
- the first operation specifically includes: acting on the enhanced vibration function option provided by the setting application; acting on the enhanced vibration function option provided by the pull-down notification bar; or a voice command input by the user.
- the method further includes: the electronic device receives a second operation, the first The second operation is used to set the enhancement level; when the enhancement level is higher, the first time, the first intensity, the second time and the second intensity meet any one or more of the following: the third intensity is greater ; The longer the length of the first time; or, the shorter the time interval.
- the user can set the level of enhanced vibration according to personal preferences to meet the individual needs of the user.
- the duration of the first sub-segment and the duration of the second sub-segment are acquired by the user, or acquired by the electronic device through an algorithm.
- the electronic device can obtain the characteristics of the music in various ways, thereby improving the practicability of the solution.
- both the first subsection and the second subsection include one or more of the following: melody, rhythm or beat of the music.
- the enhanced vibration effect can be associated with the melody, rhythm or beat of the music, and the interest of the vibration prompt can be improved.
- the first intensity is the same as the second intensity.
- the enhanced vibration intensity can be kept at a constant value, reducing the workload of the electronic equipment.
- the electronic device includes a linear motor, and the electronic device vibrates at a first intensity for a first time, and vibrates at a second intensity for a second time specifically includes: the electronic device drives the linear motor to Vibrate at a first intensity for a first time and at a second intensity for a second time.
- the electronic device adopts a linear motor with excellent vibration performance, which can output a better enhanced vibration effect.
- the method further includes: the electronic device plays the music.
- the electronic device can not only play music but also output enhanced vibration prompt information corresponding to the music, so as to bring a dual experience of hearing and touch to the user and bring a more comprehensive prompt effect.
- the present application provides a chip, the chip is applied to an electronic device, the chip includes one or more processors, and the processor is used to invoke computer instructions to make the electronic device perform any one of the first aspect described method.
- the present application provides a computer-readable storage medium, the computer-readable storage medium includes instructions, and when the instructions are run on an electronic device, the electronic device executes the method described in any one of the first aspect. method.
- the present application provides an electronic device, which includes one or more processors and one or more memories; wherein, the one or more memories are coupled to the one or more processors, and the one or more The or multiple memories are used to store computer program codes, the computer program codes include computer instructions, and when the one or more processors execute the computer instructions, the electronic device is made to perform the method as described in any one of the first aspect.
- FIG. 1 is a schematic diagram of a hardware architecture of an electronic device 100 provided in an embodiment of the present application
- FIG. 2 is a schematic diagram of the software architecture of the electronic device 100 provided by the embodiment of the present application.
- 3A-3C are schematic diagrams of a set of user interfaces provided by the embodiment of the present application.
- FIG. 4 is a schematic flowchart of a method for enhancing vibration prompts provided by an embodiment of the present application
- FIG. 5 is a schematic diagram of a music waveform provided by an embodiment of the present application.
- Fig. 6 is a schematic diagram of an algorithm framework for extracting music features provided by the embodiment of the present application.
- FIG. 7 is a schematic diagram of a standard vibration-associated waveform provided by the embodiment of the present application.
- Fig. 8 is a schematic diagram of an enhanced follow-up vibration waveform provided by the embodiment of the present application.
- FIG. 9 is a schematic flowchart of a method for prolonging the sub-section vibration time provided by the embodiment of the present application.
- FIG. 10 is a schematic flowchart of a method for shortening the time interval between adjacent sub-segments provided by the embodiment of the present application.
- Fig. 11 is a schematic diagram of another enhanced follow-up vibration waveform provided by the embodiment of the present application.
- first and second are used for descriptive purposes only, and cannot be understood as implying or implying relative importance or implicitly specifying the quantity of indicated technical features. Therefore, the features defined as “first” and “second” may explicitly or implicitly include one or more of these features. In the description of the embodiments of the present application, unless otherwise specified, the “multiple” The meaning is two or more.
- UI user interface
- the term "user interface (UI)” in the following embodiments of this application is a medium interface for interaction and information exchange between an application program or an operating system and a user, and it realizes the difference between the internal form of information and the form acceptable to the user. conversion between.
- the user interface is the source code written in a specific computer language such as java and extensible markup language (XML).
- the source code of the interface is parsed and rendered on the electronic device, and finally presented as content that can be recognized by the user.
- the commonly used form of user interface is the graphical user interface (graphic user interface, GUI), which refers to the user interface related to computer operation displayed in a graphical way. It may be text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, Widgets, and other visible interface elements displayed on the display screen of the electronic device.
- Melody is the primary element of music. Specifically, it refers to the melody formed by the melody formed by notes of different pitches (high and low sounds) and different time values (length of sounds) in a certain beat through a certain rhythm.
- Rhythm refers to the organizational form formed by the length and strength of sounds.
- the length of the sound can be identified by notes of different durations, such as whole note, half note, quarter note, and eighth note; there are strong beats and weak beats in music, and strong and weak beats Generally, it is stipulated by the time signature of the beat, such as four-two beats, four-three beats, eight-three beats, four-four beats, eight-six beats, and so on.
- Beat refers to the periodic and regular repetition of strong beats and weak beats to form a beat.
- the beat specifically refers to the total length of notes in each measure in the score.
- a piece of music is four or four beats, that is, quarter notes are taken as a beat, and each measure has 4 beats.
- the second beat is weak
- the third beat is the second strongest
- the fourth beat is weak, that is, strong-weak-second-strong-weak.
- the rhythm of a piece of music is formed by organically organizing the length of the sound and the strong and weak beats according to the needs.
- the melody includes three factors: the pitch of the sound, the length of the sound and the beat.
- Rhythm only includes the length of the sound and the strength of the sound (ie beat).
- melody, rhythm and beat are not concepts at the same level, all three can reflect the characteristics of a piece of music in terms of movement.
- melody, rhythm and beat have strict definitions in music score theory.
- the feature of the music described in the subsequent embodiments of the present application can be any one of the strictly defined melody, rhythm or beat above;
- Rhythm or beat is the musical characteristic obtained by combining any two or more of these three.
- the embodiment of the present application does not limit the specific definition of the characteristics of the music, as long as the characteristics of the music can reflect the characteristics of a certain piece of music to a certain extent.
- an electronic device uses an algorithm to obtain relatively strictly differentiated information such as melody, rhythm, and beat from a piece of music, it can accurately obtain the characteristics of any piece of music.
- a non-algorithm is used to obtain information such as melody, rhythm, and beat from a piece of music, for example, when the human ear feels the melody, rhythm, and beat of the music to obtain the characteristics of the music, such a non-algorithmic implementation of obtaining music features way, can fully satisfy the user's listening experience.
- this application mainly defines the characteristics of music as the latter, that is, on the basis of the user's auditory experience, any one of melody, rhythm or beat The characteristics of the music obtained by combining one or more kinds.
- the feature of the music may also be referred to as the "beat" of the music, and the “beat” here is just a common vocabulary used to describe the feature of the music in daily life.
- this application provides an enhanced vibration prompt method, which mainly combines the characteristics of music and uses motors to provide tactile experience, thus bringing users a more comprehensive and comprehensive experience. details as follows:
- the electronic device can first obtain the characteristics of a piece of music, and obtain standard vibration-associated information according to the characteristics of the music.
- the enhanced with-vibration information is obtained by any one or more of the following methods: the vibration intensity within the start and end time of each sub-segment in the standard with-vibration information is enhanced to be greater than or equal to the vibration intensity in the standard with-vibration information The maximum value; prolong the duration of the sub-segment whose vibration duration is less than the first value in the standard on-demand information; or shorten the interval between two adjacent sub-segments greater than the second value in the standard on-vibration information.
- the electronic device drives the motor to vibrate according to the above-mentioned enhanced vibration-associated information.
- the main function of the standard vibration information is: based on the standard vibration information, obtain enhanced vibration information that not only matches the characteristics of the music, but also meets the requirements of the user's vibration prompt effect, and then provides users with both interesting and meaningful information. Intense tactile vibration experience. details as follows:
- the standard vibration information is to obtain the vibration information that best matches the melody, rhythm or beat of the music according to the characteristics of the music.
- the enhanced standard vibration information is obtained by enhancing the weak vibration, prolonging the short vibration, and shortening the sub-segment interval, so as to bring a vibration prompt effect with a stronger tactile experience to the user.
- obtaining standard vibration-related information is a transitional step in obtaining enhanced vibration-related information.
- the enhanced vibration-related information based on the standard vibration-related information can not only retain the original characteristics of the music to a certain extent, but also improve the effect of vibration prompts to a certain extent. In this way, considering from two dimensions, it can fully meet the needs of users for vibration prompts. effect requirements.
- the standard accompanying vibration information is an intermediate result used to obtain enhanced accompanying vibration information.
- other methods can also be used to directly extract the final enhanced accompanying vibration vibration information without obtaining the intermediate result of standard vibration information.
- the electronic device when the electronic device turns on music (also known as ringing) prompts and enhanced vibration (also known as vibration) prompts, and when the electronic device plays music-like prompt information, it can drive the motor to vibrate according to the characteristics of the music at the same time, so that the motor output and The music corresponding to the ringing bell has the same or similar rhythm and dynamic enhanced vibration effect, which makes the prompt information more interesting.
- music also known as ringing
- enhanced vibration also known as vibration
- the motor will vibrate according to the enhanced vibration information, which can increase the vibration intensity or extend the original short vibration time Or shorten the vibration interval.
- Electronic devices can be cell phones, cameras, smart watches, sports bracelets, tablets, ultra-mobile personal computers (UMPCs), netbooks, as well as cellular phones, personal digital assistants (PDAs), enhanced Reality (augmented reality, AR) equipment, virtual reality (virtual reality, VR) equipment, artificial intelligence (artificial intelligence, AI) equipment, wearable equipment, vehicle equipment, smart home equipment and/or smart city equipment, etc.
- PDAs personal digital assistants
- enhanced Reality augmented reality, AR
- virtual reality virtual reality
- AI artificial intelligence
- wearable equipment wearable equipment
- vehicle equipment smart home equipment and/or smart city equipment
- smart city equipment etc.
- FIG. 1 exemplarily shows a schematic diagram of a hardware architecture of an electronic device 100 .
- the electronic device 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone interface 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, a display screen 194, and a subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
- SIM subscriber identification module
- the sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, bone conduction sensor 180M, etc.
- the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100 .
- the electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
- the illustrated components can be realized in hardware, software or a combination of software and hardware.
- the processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
- application processor application processor, AP
- modem processor graphics processing unit
- GPU graphics processing unit
- image signal processor image signal processor
- ISP image signal processor
- controller memory
- video codec digital signal processor
- DSP digital signal processor
- baseband processor baseband processor
- neural network processor neural-network processing unit, NPU
- the controller may be the nerve center and command center of the electronic device 100 .
- the controller can generate an operation control signal according to the instruction opcode and timing signal, and complete the control of fetching and executing the instruction.
- a memory may also be provided in the processor 110 for storing instructions and data.
- the memory in processor 110 is a cache memory.
- the memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 110 is reduced, thereby improving the efficiency of the system.
- the processor 110 when it detects that there is prompt information output, such as an incoming call, an alarm clock, a short message, or a reminder of a memo event, it can obtain the corresponding music file from the memory, and extract the corresponding enhanced music file from the music file. vibration information, and then control the vibration of the motor according to the enhanced vibration information.
- prompt information output such as an incoming call, an alarm clock, a short message, or a reminder of a memo event
- the present application does not limit the method for the processor 110 to extract the corresponding enhanced on-resonance information from the music file. For example:
- the processor 110 can directly obtain the music features from the music file, then calculate the standard vibration-related information based on the music features, and finally calculate the enhanced vibration-related information based on the standard vibration-related information .
- the features of the music directly obtained may be comprehensive feature information manually extracted from the music in advance. For the characteristics of music, please refer to the previous definition, so I won’t go into details here.
- the processor 110 can use an algorithm to calculate the characteristics of the music from the music file, then calculate the standard vibration-related information based on the music characteristics, and finally calculate the enhanced vibration information based on the standard vibration-related information. Vibration information.
- the feature of the music obtained through calculation may be any one of melody, rhythm or beat in the music. For the characteristics of music, you can refer to the definition above, so I won’t go into details here.
- the processor 110 can directly obtain the enhanced vibration-associated information according to the characteristics of the music without first calculating the standard vibration-associated information.
- the internal memory 121 may include one or more random access memories (random access memory, RAM) and one or more non-volatile memories (non-volatile memory, NVM).
- RAM random access memory
- NVM non-volatile memory
- the external memory interface 120 can be used to connect an external non-volatile memory, so as to expand the storage capacity of the electronic device 100 .
- the external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and video are stored in an external non-volatile memory.
- music files corresponding to various prompt information, music characteristics, standard on-demand information and enhanced on-vibrator information, etc. may be pre-stored in the memory.
- the music file stored in the memory includes information about the feature of the music that has been manually obtained in advance.
- Motor 191 may generate enhanced vibration cues.
- the motor 191 can be used for enhanced vibration prompts when the electronic device detects events such as incoming calls, messages, notifications, alarm clocks, reminder events, starting games, or playing videos, and can also be used for touch vibration feedback.
- touch operations applied to different applications may correspond to different vibration feedback effects.
- the motor 191 may also correspond to different vibration feedback effects for touch operations acting on different areas of the display screen 194 .
- Different application scenarios (such as: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects.
- the touch vibration feedback effect can also support customization.
- the specific type of the motor 191 is a linear motor.
- the linear motor Compared with the traditional rotor motor, the linear motor shortens the vibration delay time and avoids the vibration tailing phenomenon. A better vibration experience can be brought to the user.
- the linear motor is mainly composed of a stator and a mover.
- the mover is mainly composed of a special mass block, a spring, and a magnet.
- the stator is composed of a flexible printed circuit board (FPC) and a surrounding coil. When the linear motor receives the drive signal, the stator coil in the linear motor is energized.
- FPC flexible printed circuit board
- the stator will be affected by the magnetic field force and will move in a specific direction.
- the mover is driven to move horizontally, that is, left and right, so as to generate a sense of shock.
- the working principle of the linear motor is similar to that of a pile driver.
- the linear motor mainly converts electrical energy into mechanical energy, directly converts electrical energy into linear motion mechanical energy, and drives the spring mass to perform linear motion, thereby generating vibration. This vibration brings The user's vibration is similar to the effect of "da da da”.
- the wireless communication function of the electronic device 100 can be realized by the antenna 1 , the antenna 2 , the mobile communication module 150 , the wireless communication module 160 , a modem processor, a baseband processor, and the like.
- the antenna 1 of the electronic device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.
- the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, so that when the electronic device 100 receives a cellular call, it can output, for example, enhanced vibration prompt information to remind the user that it can communicate with other devices through wireless communication technology. communication.
- the antenna 2 of the electronic device 100 is coupled to the wireless communication module 160, so that when the electronic device 100 receives a network call, it can output, for example, enhanced vibration prompt information to remind the user that it can communicate with other devices through wireless communication technology. communication.
- the electronic device 100 realizes the display function through the GPU, the display screen 194 , and the application processor.
- the GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
- Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
- the display screen 194 is used to display images, videos and the like.
- the display screen 194 includes a display panel.
- the display panel may be a liquid crystal display (LCD).
- the display panel can also use organic light-emitting diodes (organic light-emitting diode, OLED), active-matrix organic light-emitting diodes or active-matrix organic light-emitting diodes (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diodes (flex light-emitting diode, FLED), miniled, microLed, micro-oled, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
- the electronic device 100 may include 1 or N display screens 194 , where N is a positive integer greater than 1.
- the display screen 194 of the electronic device may display relevant setting options for prompt information such as sound and vibration.
- the user can set the type of prompt information on the sound and vibration details page or in the drop-down notification bar, that is, set the sound mode, such as music (also known as ringing) prompt, enhanced vibration (also known as vibration) prompt, mute (also known as Do Not Disturb), notification bar prompts, or any one or more of indicator light prompts.
- the option of enhanced vibration prompt may specifically be enabled by default by the electronic device, or may be manually selected by the user to enable enhanced vibration, and the like.
- the embodiment of the present application does not limit this.
- Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
- the processor 110 when the processor 110 obtains the features of the music from the music file through an algorithm, the calculation can be performed by a digital signal processor.
- a digital signal processor For the introduction of the algorithm, please refer to the method embodiment below, which will not be discussed here. repeat.
- Video codecs are used to compress or decompress digital video.
- the electronic device 100 may support one or more video codecs.
- the electronic device 100 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4 and so on.
- MPEG moving picture experts group
- the video codec when the processor 110 obtains the features of the music from the music file through an algorithm, the video codec can also decompress the compressed music file, so that the digital signal processor can process the decompressed music file. Calculation, so as to obtain the characteristics of the music, for the introduction of the algorithm, refer to the method embodiment in the following text, and will not go into details here.
- the electronic device 100 can implement audio functions through the audio module 170 , the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. Such as music playback, recording, etc.
- the audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
- the audio module 170 may also be used to encode and decode audio signals.
- the audio module 170 may be set in the processor 110 , or some functional modules of the audio module 170 may be set in the processor 110 .
- Speaker 170A also referred to as a "horn" is used to convert audio electrical signals into sound signals.
- Electronic device 100 can listen to music through speaker 170A, or listen to hands-free calls.
- Receiver 170B also called “earpiece” is used to convert audio electrical signals into sound signals.
- the receiver 170B can be placed close to the human ear to receive the voice.
- the earphone interface 170D is used for connecting wired earphones.
- the earphone interface 170D can be a USB interface 130, or a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
- OMTP open mobile terminal platform
- CTIA cellular telecommunications industry association of the USA
- the above-mentioned audio module 170 can convert the digital signal into an analog signal for music prompt information, and play it through the speaker 170A or the earphone connected to the earphone interface 170D.
- the electronic device 100 may detect that the user acts on the controls displayed on the display screen 194 through the pressure sensor 180A and/or the touch sensor 180K, so as to execute corresponding functions. For example, it may be detected that the user activates the enhanced vibration function, and then the electronic device 100 activates the enhanced vibration function, so that the motor can output enhanced vibration prompt information according to the above-mentioned enhanced vibration prompt method.
- the keys 190 include a power key, a volume key and the like.
- the key 190 may be a mechanical key. It can also be a touch button.
- the electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100 .
- the user can increase, decrease or turn off the volume of the music through the volume keys.
- Electronic device 100 may be equipped with Or a portable terminal device with other operating systems, the embodiment of the present application does not limit the operating system adopted by the electronic device 100 .
- the software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture.
- the embodiment of this application uses a layered architecture
- the system is taken as an example to illustrate the software structure of the electronic device 100 .
- FIG. 2 exemplarily shows a schematic diagram of a software architecture of the electronic device 100 .
- the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
- the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, Android Runtime (Android Runtime) and system libraries, and the kernel layer from top to bottom.
- the application layer can consist of a series of application packages.
- the application package may include application programs such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message, or may also include setting applications not shown in FIG. 2 .
- the setting application can provide the user with related options for setting prompt information such as sound and vibration.
- related options such as sound and vibration.
- the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
- the application framework layer includes some predefined functions.
- the application framework layer can include window managers, content providers, view systems, phone managers, resource managers, notification managers, and so on.
- Android Runtime includes core library and virtual machine. Android Runtime is responsible for the scheduling and management of the Android system.
- the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
- the application layer and the application framework layer run in virtual machines.
- the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
- the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
- a system library can include multiple function modules. For example: surface manager (surface manager), media library (Media Libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
- the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
- the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
- the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
- the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
- 2D graphics engine is a drawing engine for 2D drawing.
- the kernel layer is the layer between hardware and software.
- the kernel layer includes at least a motor driver, a display driver, a camera driver, an audio driver, and a sensor driver.
- the motor driving may drive the motor to vibrate according to the enhanced vibration-related information acquired by the processor 110 .
- FIG. 3A exemplarily shows a setting interface displayed by an electronic device.
- the user interface 310 is a user interface provided by a setting application of the electronic device.
- the user interface 310 displays a series of setting options, including a sound and vibration option 311 , the user can click on this option to enter the details page of the sound and vibration, specifically refer to the user interface shown in FIG. 3B .
- FIG. 3B exemplarily shows a detail page corresponding to sound and vibration displayed by the electronic device.
- the user interface 320 is a detail page corresponding to sound and vibration.
- the user interface 320 displays a sound mode setting module 321 , a volume adjustment module 322 , a ringtone setting module 323 and so on.
- the sound mode setting module 321 displays three mode options, including: a ringing option 321A, an enhanced vibration option 321B and a silent option 321C.
- the electronic device 100 When the user selects the ringing option 321A, when the electronic device 100 detects events such as incoming calls, messages, notifications, alarm clocks, reminder events, starting games or playing videos, etc., it can ring to remind the user. Specifically, the audio module 170 of the electronic device 100 prompts the user by playing music corresponding to events such as incoming calls, messages, notifications, alarm clocks, reminder events, starting games, or playing videos.
- the electronic device 100 can prompt the user by outputting enhanced vibration effects. Specifically, the motor of the electronic device 100 can start a game or play During events such as videos, the features of the corresponding music are vibrated to prompt the user.
- the electronic device 100 When the user selects the mute option 321C, when the electronic device 100 detects an incoming call, message, notification, alarm clock, reminder event, starting a game, or playing a video, the electronic device 100 will not output music and vibration prompt information.
- the volume adjustment module 322 respectively displays a volume control bar for adjusting the ringing, that is, 322A; and a music control bar for adjusting the corresponding ringing, that is, 322B.
- the user can control the volume level by sliding left and right in the above two control bars respectively.
- ringtone option 323A for incoming calls
- option 323B for message ringtones
- option 323C for notification ringtones
- option 323D for alarm clock ringtones.
- the user can select ringing music corresponding to incoming calls, messages, notifications, alarm clocks, and reminder events by selecting corresponding options.
- the ringing music here may be a music file pre-stored in the electronic device 100 before the electronic device 100 leaves the factory, or a music file downloaded by the user, which is not limited in this embodiment of the present application.
- FIG. 3B may also be used to set enhancement level options.
- the enhancement level is related to the vibration intensity and vibration time of the motor. Specifically, when the enhancement level is higher, the vibration intensity of the motor can be greater, or the time interval between each sub-segment during the motor vibration process is shorter, so that the electronic device The output vibration effect is stronger.
- FIG. 3A- FIG. 3B only exemplarily show an implementation manner in which the electronic device 100 activates the enhanced vibration function.
- the user can also pull down the notification bar and select the enhanced vibration option provided in the notification bar to make the electronic device 100 turn on the enhanced vibration function; or, the user can also make the electronic device turn on by inputting a voice command.
- Enhanced vibration function The embodiment of the present application does not limit the method for enabling the enhanced vibration function.
- the user selects the option corresponding to the enhanced vibration 321B shown in FIG.
- the alarm clock ringtone is set to music "Classic"
- the electronic device detects events such as incoming calls, messages, notifications, alarm clocks, and reminder events, it will output an enhanced vibration effect corresponding to the characteristics of the music. details as follows:
- FIG. 3C exemplarily shows a schematic diagram of a scene when an electronic device detects an incoming call.
- the electronic device 100 when the electronic device 100 detects an incoming call, the electronic device 100 not only controls the display screen 194 to display the incoming call prompt interface 330 , but also controls the motor to output an enhanced vibration effect corresponding to the music "Light" of the incoming call.
- the electronic device 100 detects an incoming call, the ringing of the electronic device 100 is turned off, or the user's electronic device 100 is placed in a pocket or on a table, or the user is in a noisy environment, so that The user cannot hear the music "Light".
- the user can still feel that the electronic device 100 controls the motor to output the enhanced vibration effect corresponding to the music "Light" of the incoming call, thereby avoiding the occurrence of similar events such as missed calls and improving the user experience.
- FIG. 3C only exemplarily shows that when an event such as an incoming call is detected, the electronic device outputs enhanced vibration prompt information corresponding to incoming call music.
- the electronic device detects two conflicting events, for example, when the electronic device outputs the enhanced vibration prompt information corresponding to the music in the video/game during the process of playing a video/playing a game, it detects When an incoming call, message, notification, alarm clock or memo event is received, the electronic device can switch to output the enhanced vibration information corresponding to the music of the incoming call, message, notification, alarm clock or memo event, until the user answers/hangs up the call, View information, notifications or reminder events, or turn off the alarm clock, to trigger the electronic device to stop outputting the enhanced vibration information corresponding to the music of the incoming call, information, notification, alarm clock or reminder event, or until the electronic device automatically stops outputting the incoming call, message, The electronic device will continue to output the enhanced vibration prompt information corresponding to the music in the video/in
- the electronic device 100 when the user selects the ring option 321A and the enhanced vibration option 321B, when the electronic device 100 detects events such as incoming calls, messages, notifications, alarm clocks, reminder events, starting games or playing videos, the electronic device not only The corresponding music will be output to prompt the user, and the corresponding enhanced vibration effect will be output according to the characteristics of the music to prompt the user.
- the electronic device 100 outputting the corresponding enhanced vibration effect according to the characteristic point of the music please refer to the detailed introduction of the method flow in the following, and details will not be repeated here.
- Fig. 4 exemplarily shows the flow of the enhanced vibration prompt method provided by the present application.
- the method flow specifically includes:
- the electronic device acquires features of the music based on the music corresponding to the specific event.
- the electronic device 100 when the electronic device 100 detects events such as incoming calls, messages, notifications, alarm clocks, and reminders, the electronic device 100 will obtain the corresponding information when the events such as incoming calls, messages, notifications, alarm clocks, and reminders ring respectively. music file, and then obtain the characteristics of the music from the music file.
- the electronic device 100 when the electronic device 100 detects that the user sets the music for ringing events such as incoming calls, messages, notifications, alarm clocks, and reminders, the electronic device can obtain the corresponding music data for the above events according to the set music. Music file, and obtain the characteristic of music from this music file.
- the corresponding music files when events such as incoming calls, messages, notifications, alarm clocks, and reminders ring respectively may be set by default by the electronic device 100 . It can also be re-selected by the user.
- the method for the user to set the music corresponding to the above-mentioned events when the bell rings for details, refer to the introduction to FIG. 3B in the UI embodiment above, and details will not be repeated here.
- the characteristics of a piece of music include: the start and end times of the music corresponding to the multiple subsections in the piece of music, and information such as the sound intensity and frequency of the music in each subsection.
- multiple subsections in a piece of music can be specifically divided according to one or more features in the melody, rhythm and beat of the music, as follows:
- the specific implementation method of the electronic device 100 acquiring music features according to the music file is as follows:
- Mode 1 music features are pre-stored in the music file, and the processor 110 of the electronic device 100 can directly extract the music features after acquiring the music file from the memory.
- the feature of the music is pre-stored in the music file, and the feature of the music may be obtained manually.
- FIG. 5 exemplarily shows a schematic diagram of a music waveform.
- the waveform schematic diagram of the piece of music may be, for example, the "Light" music corresponding to the above-mentioned incoming call ringing.
- the horizontal axis of the music waveform is the time when the music is played, and the vertical axis is the intensity of the sound when the music is played, that is, the boost level.
- the developer can extract the features of the "Light” music while listening to the music "Light".
- the features of the "Light” music include: the start and end time of each sub-section, and the sound intensity and frequency of the music in each sub-section, etc. .
- subsection 1 is from the second second to the end of the third second
- subsection 2 is from the fifth second to the end of the sixth second
- subsection 3 is from the eighth second
- subsection 4 is from the 12th second to the end of the 14th second
- subsection 5 is from the 16th second to the end of the 19th second
- subsection 6 is from the 23rd second to the end of the 25th second .
- the developer records the intensity and frequency of the music in each subsection.
- the frequency of the music in subsection 1 is 50-200 hertz (Hz)
- the sound intensity is 40db
- the frequency of the music in subsection 1 is 250-500Hz
- the sound intensity is 50db
- the frequency of the music in subsection 3 is It is greater than 500Hz
- the sound intensity is 60db, etc. I will not repeat them here.
- the aforementioned developer for extracting music features may be a professional musician with a strong sense of music and knowledge of music theory.
- Method 2 There is no pre-stored music feature in the music file.
- the processor 110 of the electronic device 100 obtains the music file from the memory, the processor 110 can call the video codec to decompress the music file, and then the digital signal processor passes through The algorithm calculates the decompressed music file, and can extract the characteristics of the music.
- the algorithm for extracting music features specifically includes: extracting by music beat point, extracting by frequency, extracting by different loudness, extracting by combining frequency and loudness, and extracting by AI/neural network, etc.
- FIG. 6 exemplarily shows a schematic diagram of an algorithm framework for extracting music features.
- the algorithm framework includes modules such as high-pass, band-pass and low-pass filters, frequency response thresholds, and starting points of marked features.
- the video codec in the electronic device 100 decompresses the music file to obtain a music stream.
- a music stream contains human voices and various instrument sounds, so the decompressed music stream is a multi-channel complex music stream. Therefore, the high-frequency components, mid-frequency components and low-frequency components in the music stream are extracted respectively through high-pass, band-pass and low-pass filters. Then the obtained high-frequency components, mid-frequency components and low-frequency components are integrated into a simple music stream.
- the frequency response threshold 1 is used to mark the feature point where the frequency of the music signal in the high-frequency component is higher than the first preset frequency, and then proceed at the turning point from greater than the first preset frequency to less than the first preset frequency Mark the feature points once, and simultaneously extract the frequency and sound intensity of each pair of music streams between feature points greater than the first preset frequency and smaller than the first preset frequency.
- the frequency response threshold 2 is used to mark the feature point where the frequency of the music signal in the intermediate frequency component is greater than the second preset frequency, and then proceed from the turning point that is greater than the second preset frequency to less than the second preset frequency Mark the feature points once, and simultaneously extract the frequency and sound intensity of each pair of music streams between feature points greater than the second preset frequency and smaller than the second preset frequency.
- the frequency response threshold 3 is used to mark the feature point where the frequency of the music signal in the intermediate frequency component is greater than the third preset frequency, and then proceed from the turning point greater than the third preset frequency to less than the third preset frequency Mark the feature points once, and simultaneously extract the frequency and sound intensity of each pair of music streams between feature points greater than the third preset frequency and smaller than the third preset frequency.
- the music streams marked with characteristic start and stop points respectively output by frequency response threshold 1, frequency response threshold 2 and frequency response threshold 3 are synthesized into a music stream, which carries music features, including characteristic start and stop points (equivalent to Sub-section start and end points), and the frequency, sound intensity and other information of each sub-section.
- the electronic device acquires enhanced on-resonance information based on the characteristics of the music.
- the electronic device 100 acquires corresponding standard vibration-associated information according to the characteristics of the music, and then acquires enhanced vibration-associated information based on the standard vibration-associated information. In another practicable manner, the electronic device 100 may directly acquire corresponding enhanced vibration-associated information according to the characteristics of the music.
- the embodiment of the present application specifically takes the basis of obtaining music features manually as an example, and then introduces the above-mentioned first possible implementation mode, which is as follows:
- the electronic device 100 acquires corresponding standard vibration information according to the characteristics of the music, and the standard vibration information includes the start and end time of motor vibration, vibration intensity and vibration frequency in each sub-section.
- FIG. 7 exemplarily shows a schematic diagram of a standard vibration-on-demand waveform generated according to the standard vibration-on-demand information.
- the standard vibration-associated waveform includes multiple sections of vibration, and the start and end times of each section of vibration correspond to the start and end times of the feature points in the music waveform shown in FIG. 5 above.
- the vibration duration, vibration intensity and vibration frequency may be the same or different.
- the duration of the motor vibration is the duration of a feature in a certain section of music playing.
- the duration of the vibration of the first section (subsection 1a) is the same as the duration of subsection 1 artificially extracted from the music waveform
- the duration of the vibration of the second section (subsection 2a) is the same as that manually extracted from the music waveform.
- Subsegment 2 has the same duration and so on.
- the intensity of the vibration is in one-to-one correspondence with the intensity of the music.
- the corresponding vibration intensity of the music whose sound intensity is higher than the first level is the first vibration intensity
- the corresponding vibration intensity of the music whose sound intensity is less than or equal to the first level and greater than the second level is the second vibration intensity
- the sound intensity is less than or equal to
- the music whose sound level is greater than the third level corresponds to the third vibration intensity
- the music whose sound intensity is less than or equal to the third level corresponds to the fourth vibration intensity.
- the sound intensity of the first level is greater than that of the second level, and the sound intensity of the second level is greater than that of the third level; the first vibration intensity is greater than the second vibration intensity, and the second vibration intensity is greater than the third vibration intensity,
- the third vibration intensity is greater than the fourth vibration intensity.
- the vibration intensity in the subsection 1 of the music waveform is less than the third grade, then the vibration intensity in the subsection 1 of the standard vibration-associated waveform is the fourth vibration intensity.
- the vibration intensity in subsection 3 in the standard vibration-associated waveform is the third vibration intensity.
- the vibration intensity in sub-section 3 in the standard vibration-associated waveform is the second vibration intensity. It can be understood that the classification of sound intensity level and vibration intensity here is only an example, and in some other embodiments, the above division result may include more or less levels, which is not limited in this embodiment of the present application.
- the vibration frequency corresponds to the frequency of the music one by one. Specifically, when the frequency of the music is greater than the first preset frequency, the first preset frequency is used to vibrate, and when the frequency of the music is lower than the first preset frequency, the second preset frequency is used to vibrate.
- the music frequency level division and the vibration frequency division here are only examples, and in some other embodiments, the above division results may include more or less levels, which is not limited in this embodiment of the present application.
- the electronic device 100 acquires the enhanced vibration-related information based on the standard vibration-related information.
- the enhanced vibration-associated information includes the start and end time of motor vibration, vibration intensity and vibration frequency in each sub-section.
- the method of obtaining enhanced vibration-related information based on standard vibration-related information may be any of the following, or in combination with any of the following, specifically as follows:
- Mode 1 The vibration intensity in each sub-segment of the standard vibration-related information is enhanced to obtain enhanced vibration-related information.
- FIG. 8 exemplarily shows the enhanced vibration-with-vibration waveform 1 outputted by the enhanced vibration-with-resonance information acquired in way 1.
- the intensity of the enhanced vibration waveform 1 is greater than or equal to the maximum value of the vibration intensity in the standard follow-up vibration waveform (ie, the first vibration intensity mentioned above).
- the starting and ending time of each section of the enhanced vibration waveform 1 is consistent with the standard accompanying vibration waveform, and the frequency of each section of vibration is also consistent with the standard accompanying vibration waveform. That is to say, the vibration frequency and start-stop time of the subsection 1a in the enhanced waveform 1 with vibration are the same as the subsection 1 in the standard waveform with vibration, and the subsection 2a in the enhanced waveform 1 with vibration is the same as the subsection 2a in the waveform with standard vibration.
- the vibration frequency of sub-section 2, the start and end time of vibration are the same, and so on.
- Mode 2 Extend the vibration time in each sub-segment of the standard vibration-with-vibration information when the vibration time period is smaller than the second value, so as to obtain the enhanced vibration-with-vibration information.
- FIG. 9 exemplarily shows a flowchart of a method for prolonging the vibration time of a subsection.
- the electronic device can judge whether the vibration time of each sub-segment in the standard vibration-with-wave waveform is less than or equal to a first value according to the standard vibration-with-wave waveform shown in FIG. 7 , and the first value is, for example, 1 second.
- the vibration time of the subsection is less than (including equal to) 1 second, then the vibration time of the subsection is extended by a certain value (for example, 0.5 seconds); when the vibration time of the subsection is determined to be greater than 1 second, then keep the subsection The vibration time of the segment remains unchanged.
- the vibration intensity of each sub-section is kept consistent with the vibration intensity of the standard follow-up vibration waveform, and the vibration frequency is also kept consistent.
- the various sub-sections are integrated to obtain an enhanced follow-up waveform.
- the method for prolonging the vibration time of the sub-section includes: prolonging the vibration termination time of the sub-section, and/or, prolonging the vibration duration by advancing the vibration start time of the sub-section.
- Mode 3 shorten the vibration time interval between two adjacent sub-segments in the standard vibration-related information, which is greater than the second value, so as to obtain enhanced vibration-related information.
- FIG. 10 exemplarily shows a flowchart of a method for shortening sub-segment intervals.
- the electronic device can determine whether the time interval between two adjacent sub-segments in the standard vibration-related waveform is greater than or equal to a second value according to the standard vibration-related waveform shown in Figure 7, and the second value is, for example, 3 seconds.
- the vibration time of the determined sub-section is greater than (including equal to) 3 seconds, the time interval is shortened by a certain value (for example, 1 second); when the time interval of the determined sub-section is less than 3 seconds, the adjacent sub-section is maintained The time interval remains unchanged.
- the vibration intensity of each sub-section is kept consistent with the vibration intensity of the standard follow-up vibration waveform, and the vibration frequency is also kept consistent.
- the various sub-sections are integrated to obtain an enhanced follow-up waveform.
- the method for shortening the time interval of adjacent sub-segments includes: shortening the time interval of adjacent sub-segments by extending the end time of the previous sub-segment or advancing the start time of the next sub-segment.
- FIG. 11 exemplarily shows the enhanced vibration-with-resonance waveform 2 outputted by the enhanced vibration-with-resonance information obtained in ways 2 and 3 at the same time.
- the vibration intensity of each sub-section in the enhanced vibration waveform 2 is consistent with the vibration intensity of the follow-up vibration waveform, and the vibration frequency is also consistent.
- the vibration time is uniformly increased for short vibrations whose vibration duration is less than or equal to a preset time (for example, 1 second) in the vibration-associated waveform.
- a preset time for example, 1 second
- the two vibrations corresponding to sub-section 1 and sub-section 2 last for 1 second respectively, which are short vibrations. Therefore, the time of sub-section 1 and sub-section 2 should be extended by a certain value For example, for 0.5 seconds, the corresponding sub-segment 1b and sub-segment 2b are also obtained.
- the termination time of the previous sub-segment or the start time of the subsequent sub-segment is advanced if the time interval between each sub-segment in the vibration-associated waveform is greater than or equal to a second value (for example, 3 seconds).
- a second value for example, 3 seconds.
- the time interval between sub-segment 3 and sub-segment 4 in the standard follow-up waveform shown in Fig. 7 is 3 seconds, therefore, the termination time of sub-segment 3 is extended to obtain sub-segment 3b.
- the time interval between sub-segment 5 and sub-segment 6 in the standard follow-up waveform shown in FIG. 7 is 3 seconds, therefore, the termination time of sub-segment 5 is extended to obtain sub-segment 5b.
- any multiple of the above methods 1-3 can be used in combination. For example, increase the vibration intensity while increasing the short vibration time; or increase the vibration intensity while shortening the vibration interval; or increase the short vibration time while shortening the vibration interval; or both increase the vibration intensity and increase the short vibration time while shortening the vibration interval.
- the electronic device detects a specific event.
- the specific time includes incoming calls, messages, notifications, alarm clocks, or memos.
- the electronic device can detect an event such as an incoming cellular call or an incoming network call through the mobile communication module or the wireless communication module.
- the electronic device can detect the information through the mobile communication module.
- the electronic device may detect the notification through the wireless communication module.
- the electronic device can detect events such as an alarm clock or a memo.
- the electronic device drives the motor to vibrate based on the corresponding enhanced vibration-associated information.
- the electronic device 100 acquires the enhanced vibration-related information described in step S402 above, it can control the vibration of the motor according to the vibration start and end time, vibration intensity and vibration frequency of each sub-segment in the enhanced vibration-related information. Therefore, the effect brought by the vibration of the motor and the effect of playing music when the bell rings have the same rhythm and dynamic feeling.
- the electronic device 100 drives the motor to vibrate based on the enhanced vibration-associated information
- the electronic device needs to enable the enhanced vibration function in advance. For example, it may be turned on before any of the above steps S401-S403.
- the above-mentioned enhanced vibration function may be enabled by default on the electronic device 100, or it may be the enhanced vibration option 321B provided by the user through the selection setting application shown in Fig. 3A-Fig.
- the enhanced vibration option provided in the column, or through voice commands, etc., to trigger the electronic device 100 to turn on the enhanced vibration function.
- Effect 1 When the electronic device 100 detects incoming calls, messages, notifications, alarm clocks, and reminder events, etc., if the electronic device 100 turns on music prompts and vibration prompts in advance, that is, when the ringing function and enhanced vibration function are turned on, the electronic device will The 100 will vibrate along with the characteristics of the music, and at the same time give the user auditory and tactile prompts, increasing the interest of the prompts.
- Effect 2 If the volume/specification/performance of the motor configured in the electronic device is average, in the absence of ringing music playing, that is, when the user only turns on the enhanced vibration prompt, if the electronic device 100 is placed in a pocket, table, or backpack
- the musical sense is weak in some time periods in the ringing music
- all parts with weak musical sense can be enhanced by increasing the vibration intensity, prolonging the short vibration time, or compressing the vibration interval.
- the corresponding vibration effect This prevents users from missing calls, or missing information, notifications, alarm clocks, or reminder events, etc., thereby improving user experience.
- all or part of them may be implemented by software, hardware, firmware or any combination thereof.
- software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
- the computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the present application will be generated in whole or in part.
- the computer can be a general purpose computer, a special purpose computer, a computer network, or other programmable devices.
- the computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website, computer, server or data center Transmission to another website site, computer, server, or data center by wired (eg, coaxial cable, optical fiber, DSL) or wireless (eg, infrared, wireless, microwave, etc.) means.
- the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or a data center integrated with one or more available media.
- the available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a Solid State Disk).
- the processes can be completed by computer programs to instruct related hardware.
- the programs can be stored in computer-readable storage media.
- When the programs are executed may include the processes of the foregoing method embodiments.
- the aforementioned storage medium includes: ROM or random access memory RAM, magnetic disk or optical disk, and other various media that can store program codes.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
本申请提供了一种增强振动提示方法及电子设备,该方法应用于电子设备中。该方法包括:电子设备可以先获取一首音乐的特征,并根据该首音乐的特征获取标准随振信息,该标准随振信息包括:驱动马达进行一次振动中,每个子段振动的起止时间,每个子段起止时间内的振动强度和频率等。之后,基于标准随振信息并通过以下任意一项或多项方法获取增强随振信息:将标准随振信息中每个子段起止时间内的振动强度增强至大于等于标准随振信息中振动强度的最大值;将标准随振信息中振动持续时间小于第一值的子段的持续时间延长;或者,将标准随振信息中相邻两个子段之间的间隔时间大于第二值的间隔缩短。最后,电子设备根据获取到的增强随振信息,驱动马达振动。
Description
本申请要求于2022年01月10日提交中国专利局、申请号为202210022946.2、申请名称为“一种基于振动增强音乐的方法及电子设备”的中国专利申请,以及要求于2022年01月18日提交中国专利局、申请号为202210055372.9、申请名称为“一种增强振动提示方法及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及终端领域,尤其涉及一种增强振动提示方法及电子设备。
电子设备在例如来电、接收到新消息以及闹钟响铃等情况下可以输出提示信息,该提示信息包括:音乐提示和振动提示等等。其中,振动提示具体可以随着音乐节奏进行振动。但是,由于音乐节奏的不稳定,振动时强时弱,时而一段时间内不振动,这样容易导致用户感受不到振动提示信息。
发明内容
本申请提供了一种增强振动提示方法及电子设备,该方法应用于电子设备中。该方法可以实现,电子设备检测到事件时,根据事件对应的音乐特征输出增强振动信息,使得用户在关闭音乐提示仅开启增强振动提示的情况下,或者在嘈杂的环境中听不到音乐提示时,仍然可感触到增强振动效果,避免用户忽略对应的事件。
第一方面,本申请提供了一种增强振动提示方法,该方法应用于电子设备中,该方法包括:该电子设备检测到第一事件,该第一事件对应的音乐包括:第一子段、第二子段;该电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动;其中,该第一时间、该第一强度、该第二时间和该第二强度,符合以下任意一项或多项:该第一强度、该第二强度均大于或等于第三强度,该第三强度对应于该第一子段和该第二子段中最强的音乐强度;在该第一子段的持续时间小于或等于第一值的情况下,该第一时间的长度大于该持续时间;或者,在该第一子段和该第二子段之间的时间间隔大于或等于第二值的情况下,该第一时间和该第二时间之间的间隔小于该时间间隔。
采用第一方面提供的方法后,在没有响铃音乐播放的情况下,即用户仅开启增强振动提示时,若电子设备100被置于口袋、桌上、背包中时,尽管响铃音乐中有的时间段内乐感较弱,但或通过将振动强度提高,或者将短振的时间延长,或者将振动间隔压缩,从而实现增强了乐感较弱的部分所对应的振动效果。从而避免用户漏接电话,或者漏看信息、通知、闹钟或者备忘事件等,从而提高用户体验感。
结合第一方面提供的方法,在该电子设备检测到第一事件之前,该方法还包括:该电子设备基于该音乐获取标准随振信息;该标准随振信息包括:第三时间、第三时间对应的该第四强度、第四时间和第四时间对应第五强度;该第三时间等于该第一子段的持续时间, 该第四时间等于该第二子段的持续时间;该第四强度对应该第一子段内的音强,该第五强度对应该第二子段内的音强;该第三强度大于或等于该第四强度和该第五强度。
这样,电子设备可以基于标准振动信息进行增强振动效果,既保留了振动效果随音乐特点的变化关系,又在一定程度增强振动的触觉体验,既提高了振动提示的趣味性,又增强了振动提示体验感。
结合第一方面提供的方法,该第一事件包括:来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频。
这样,电子设备可以在多种场景下输出增强振动提示信息,提高用户体验感。
结合第一方面提供的方法,该第一事件对应的音乐由用户设置或者由电子设备默认设置。
这样,增加用户与电子设备的交互,提高个性化设置选项,用户可以选择个人喜爱的音乐,以体验该音乐对应的增强振动效果。
结合第一方面提供的方法,该第一事件对应的音乐预先存储于该电子设备中,或者,由该电子设备从其他设备中获取。
这样,用户可以通过多种方式设置增强振动对应的音乐,提高用户体验感。
结合第一方面提供的方法,该电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动之前,该方法还包括:该电子设备开启增强振动功能,该增强振动功能用于该电子设备在该第一时间内以该第一强度振动,在该第二时间内以该第二强度振动。
这样,增强振动功能可以根据用户喜好,选择是否应用在电子设备中。
结合第一方面提供的方法,在该电子设备开启增强振动功能之前,该方法还包括:该电子设备接收第一操作,该第一操作用于触发该电子设备开启该增强振动功能。
结合第一方面提供的方法,该第一操作具体为:作用于设置应用提供的增强振动功能选项;作用于下拉通知栏提供的增强振动功能选项;或者,用户输入的语音指令。
这样,用户可以通过多种操作方式开启增强振动功能,提高本方案的可实施性。
结合第一方面提供的方法,在该电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动之前,该方法还包括:该电子设备接收第二操作,该第二操作用于设置增强等级;当该增强等级越高,该第一时间、该第一强度、该第二时间和该第二强度,符合以下任意一项或多项:该第三强度越大;该第一时间的长度越长;或者,该时间间隔越短。
这样,用户可以根据个人喜好,设置增强振动的等级,满足用户的个性化需求。
结合第一方面提供的方法,该第一子段的持续时间和该第二子段的持续时间,由用户获取,或者由电子设备通过算法获取。
这样,电子设备可以通过多种方式获取音乐的特征,进而提高本方案的可实施性。
结合第一方面提供的方法,该第一子段、该第二子段均包括以下一项或多项:该音乐的旋律、节奏或者节拍。
这样,可以使得增强振动效果与音乐的旋律、节奏或者节拍相关联,提高振动提示的趣味性。
结合第一方面提供的方法,该第一强度和该第二强度相同。
这样,可以使得增强振动强度为一个定值,减少电子设备的工作量。
结合第一方面提供的方法,该电子设备包括线性马达,该电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动具体包括:该电子设备驱动该线性马达在第一时间内以第一强度振动,在第二时间内以第二强度振动。
这样,电子设备采用振动性能优良的线性马达,能够输出更好的增强振动效果。
结合第一方面提供的方法,该电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动的同时,该方法还包括:该电子设备播放该音乐。
这样,电子设备可以在检测到某个事件时,既播放音乐又输出音乐对应的增强振动提示信息,从而给用户带来听觉与触觉上的双重体验,带来更加综合全面的提示效果。
第二方面,本申请提供了一种芯片,该芯片应用于电子设备,该芯片包括一个或多个处理器,该处理器用于调用计算机指令以使得该电子设备执行如第一方面中任一项描述的方法。
第三方面,本申请提供了一种计算机可读存储介质,该计算机可读存储介质包括指令,当该指令在电子设备上运行时,使得该电子设备执行如第一方面中任一项描述的方法。
第四方面,本申请提供了一种电子设备,该电子设备包括一个或多个处理器和一个或多个存储器;其中,该一个或多个存储器与该一个或多个处理器耦合,该一个或多个存储器用于存储计算机程序代码,该计算机程序代码包括计算机指令,当该一个或多个处理器执行该计算机指令时,使得该电子设备执行如第一方面中任一项描述的方法。
图1为本申请实施例提供的电子设备100的硬件架构示意图;
图2为本申请实施例提供的电子设备100的软件架构示意图;
图3A-图3C为本申请实施例提供的一组用户界面示意图;
图4为本申请实施例提供的一种增强振动提示方法流程示意图;
图5为本申请实施例提供的一种音乐波形示意图;
图6为本申请实施例提供的一种提取音乐特征的算法框架示意图;
图7为本申请实施例提供的标准随振波形示意图;
图8为本申请实施例提供的一种增强随振波形示意图;
图9为本申请实施例提供的一种延长子段振动时间的方法流程示意图;
图10为本申请实施例提供的一种缩短相邻子段时间间隔的方法流程示意图;
图11为本申请实施例提供的另一种增强随振波形示意图。
下面将结合附图对本申请实施例中的技术方案进行清楚、详尽地描述。其中,在本申请实施例的描述中,除非另有说明,“/”表示或的意思,例如,A/B可以表示A或B;文本中的“和/或”仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如,A和/ 或B,可以表示:单独存在A,同时存在A和B,单独存在B这三种情况。
以下,术语“第一”、“第二”仅用于描述目的,而不能理解为暗示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括一个或者更多个该特征,在本申请实施例的描述中,除非另有说明,“多个”的含义是两个或两个以上。
在本申请中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本申请所描述的实施例可以与其它实施例相结合。
本申请以下实施例中的术语“用户界面(user interface,UI)”,是应用程序或操作***与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间的转换。用户界面是通过java、可扩展标记语言(extensible markup language,XML)等特定计算机语言编写的源代码,界面源代码在电子设备上经过解析,渲染,最终呈现为用户可以识别的内容。用户界面常用的表现形式是图形用户界面(graphic user interface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的文本、图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素。
首先,介绍本申请涉及到的音乐相关概念,包括旋律、节奏和节拍等。这些概念在乐谱理论中有着的严格定义,具体如下:
旋律是音乐的首要要素,具体是指不同音高(音的高低)、不同时值(音的长短)的音符在一定的节拍中通过一定的节奏进行周旋与律动所形成的曲调就是旋律。
节奏是指,由音的长短与强弱拍位所构成的组织形态。具体的,在乐谱中,音的长短可由不同时值的音符来标识,例如全音符、二分音符、四分音符和八分音符等;音乐中有强拍和弱拍之分,强弱拍位一般由拍子的拍号来规定,例如四二拍、四三拍、八三拍、四四拍以及八六拍等等。
节拍是指,强拍和弱拍周期性地有规律地重复进行而形成了节拍。节拍具体是指在乐谱中每一小节的音符总长度,如一首音乐是四四拍,就是以4分音符为一拍,每小节4拍子,节拍的强弱交替规律是每小节第一拍强、第二拍弱、第三拍次强、第四拍弱,即强-弱-次强-弱。把音的长短与强弱拍位这两方面根据需要有机地组织起来,就形成了一首音乐的节奏。
可见,旋律包含了音的高低、音的长短和节拍三个因素。节奏只包含了音的长短和音的强弱(即节拍)两个方面的因素。虽然,旋律、节奏和节拍这三者不是同一层次上的概念,但这三者都能在移动程度上反应出一首音乐的特征。
根据上文所述,可知旋律、节奏以及节拍在乐谱理论中有着严格的定义。但是,从用户的听觉体验的角度出发,用户难以将一首音乐中的旋律、节奏以及节拍等严格区分。因此,本申请后续实施例中所述的音乐的特征既可以是上文严格定义的旋律、节奏或者节拍中的任意一种;或者音乐的特征还可以是在用户听觉体验基础上,从旋律、节奏或者节拍这三者中任意两种或多种结合得到的音乐特征。本申请实施例对音乐的特征的具体定义不 作限制,只要该音乐的特征在一定程度上能够反映出某段音乐的特征即可。
针对一首音乐,当电子设备采用算法实现从一首音乐中获取相对严格区分的旋律、节奏以及节拍等信息时,可以准确获取到任意一首音乐的特征。当采用非算法实现从一首音乐中获取旋律、节奏以及节拍等信息时,例如通过人耳感受音乐的旋律、节奏以及节拍等信息以获取音乐的特征时,这样的非算法实现获取音乐特征的方式,可以充分满足用户的听觉体验。因此考虑到既满足用户听觉体验并且降低对音乐文件的处理分析难度,本申请主要将音乐的特征定义为后者,即在用户听觉体验基础上,从旋律、节奏或者节拍这三者中任意一种或多种结合得到的音乐的特征。
在另一些实施例中,还可以将音乐的特征称为音乐的“拍子”,这里的“拍子”只是日常生活中,对音乐的特征进行描述的常用词汇。
考虑到音乐具有上述旋律、节奏以及节拍等特征,本申请提供了一种增强振动提示方法,主要结合音乐的特征并使用马达提供触觉体验,从而为用户带来了更加综合、全面的体验感。具体如下:
在本申请提供的增强振动提示方法中,电子设备可以先获取一首音乐的特征,并根据该首音乐的特征获取标准随振信息,该标准随振信息包括:驱动马达进行一次振动中,每个子段振动的起止时间,每个子段起止时间内的振动强度和频率等。之后,基于标准随振信息并通过以下任意一项或多项方法获取增强随振信息:将标准随振信息中每个子段起止时间内的振动强度增强至大于等于标准随振信息中振动强度的最大值;将标准随振信息中振动持续时间小于第一值的子段的持续时间延长;或者,将标准随振信息中相邻两个子段之间的间隔时间大于第二值的间隔缩短。最后,电子设备根据上述增强随振信息,驱动马达振动。
其中,标准随振信息主要作用为:基于该标准随振信息,获取到既与音乐的特征匹配,又能满足用户振动提示效果要求的增强随振信息,进而为用户提供既具有趣味性又具有强烈触感的振动体验。具体如下:
首先,标准随振信息是根据音乐的特点获取到与该音乐的旋律、节奏或节拍最匹配的振动信息。
其次,考虑到一首音乐存在节奏感较弱的部分、节奏段的部分或者节奏间隔长的部分,从而导致标准随振信息中所存在的弱振、短振以及相邻子段间隔过大而导致带给用户较弱的触觉体验的问题。因此,进一步根据该标准随振信息,通过增强弱振、延长短振以及缩短子段间隔来获取增强标准随振信息,从而为用户带来更强触觉体验的振动提示效果。
可见,获取标准随振信息是获取增强随振信息的一个过渡步骤。在基于标准随振信息得到的增强随振信息,不仅能在一定程度上保留音乐原本的特征,同时还在一定程度上提高振动提示效果,这样从两个维度考虑,可以充分满足用户对振动提示效果的要求。
总之,标准随振信息是用来为获取增强随振信息而到的一个中间结果,在本申请另一些实施例中,也可以通过其他方法实现从音乐的特帧中直接提取到最终的增强随振信息,无需获取标准随振信息这一中间结果。
可见,采用本申请提供的增强振动提示方法后面具有以下优点:
第一,在电子设备开启音乐(又称响铃)提示和增强振动(又称振动)提示时,电子设备播放音乐类的提示信息时,可以同时根据音乐的特征驱动马达振动,使得马达输出和响铃对应的音乐有着同样的或者相似的节奏动感的增强振动效果,使得提示信息更加具有趣味性。
第二,在电子设备关闭音乐(又称响铃)提示且仅开启增强振动(又称振动)提示时,马达会根据增强随振信息来振动,可以增强振动强度,或者延长原始的短振时间或者缩短振动间隔。
这样可以进一步保证用户可以从触觉获知较为强烈的振动提示信息,不会错过来电、闹钟、短信以及备忘事件等等。解决了,由于音乐旋律、节拍或节奏的不稳定,导致振动时强时弱,时而一段时间内不振动,使得用户感受不到振动提示信息,进而错过重要电话、信息、通知、闹钟或者备忘事件等等。
接下来,先介绍申请提供的增强振动提示所应用的电子设备,包括电子设备的形态、软硬件架构等等。
电子设备可以是手机、相机、智能手表、运动手环、平板电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、上网本,以及蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备、人工智能(artificial intelligence,AI)设备、可穿戴式设备、车载设备、智能家居设备和/或智慧城市设备等等。本申请实施例对此不作限制。
参考图1,图1示例性示出了电子设备100的硬件架构示意图。
如图1所示,电子设备100可以包括:处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。其中传感器模块180可以包括压力传感器180A,陀螺仪传感器180B,气压传感器180C,磁传感器180D,加速度传感器180E,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,触摸传感器180K,环境光传感器180L,骨传导传感器180M等。
可以理解的是,本申请实施例示意的结构并不构成对电子设备100的具体限定。在本申请另一些实施例中,电子设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
其中,控制器可以是电子设备100的神经中枢和指挥中心。控制器可以根据指令操作码和时序信号,产生操作控制信号,完成取指令和执行指令的控制。
处理器110中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器110中的存储器为高速缓冲存储器。该存储器可以保存处理器110刚用过或循环使用的指令或数据。如果处理器110需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器110的等待时间,因而提高了***的效率。
在本申请实施例中,处理器110检测到有提示信息输出时,例如来电、闹钟、短信、备忘事件提醒时,可以从存储器中获取对应的音乐文件,从该音乐文件中提取对应的增强随振信息,然后根据该增强随振信息控制马达振动。
其中,本申请对处理器110从音乐文件中提取对应的增强随振信息的方法不作限制。例如:
在本申请一些实施例中,处理器110可以直接从该音乐文件中获取音乐的特征,然后根据该音乐的特征计算得到标准随振信息,最后基于该标准随振信息再计算得到增强随振信息。这种情况下,直接获取的音乐的特征可以是预先经过人工从该首音乐中提取的综合特征信息。关于音乐的特征可以参考前文定义,在此暂不赘述。
在本申请另一些实施例中,处理器110可以采用算法从该音乐文件中计算得到音乐的特征,然后根据该音乐的特征计算得到标准随振信息,最后基于该标准随振信息再计算得到增强随振信息。这种情况下,经过计算获取的音乐的特征可以是音乐中的旋律、节奏或节拍中的任意一种。关于音乐的特征可以参考前文的定义,在此暂不赘述。
可理解的是,处理器110可以根据音乐的特征直接获取到增强随振信息,无需先计算标准随振信息,本申请对根据音乐的特征计算增强随振信息的具体实现过程不作限制。
内部存储器121可以包括一个或多个随机存取存储器(random access memory,RAM)和一个或多个非易失性存储器(non-volatile memory,NVM)。
外部存储器接口120可以用于连接外部的非易失性存储器,实现扩展电子设备100的存储能力。外部的非易失性存储器通过外部存储器接口120与处理器110通信,实现数据存储功能。例如将音乐,视频等文件保存在外部的非易失性存储器中。
在本申请实施例中,上述存储器中可以预先存储有各种提示信息对应的音乐文件、音乐的特征、标准随振信息以及增强随振信息等。
在处理器110直接从音乐文件中获取音乐的特征的情况下,存储器中存储的该音乐文件中包含,预先通过人工的方式获取的音乐的特征的相关信息。
马达191可以产生增强振动提示。马达191可以用于在电子设备检测到来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频等事件时进行增强振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的 振动反馈效果。触摸振动反馈效果还可以支持自定义。
在本申请实施例中,马达191的具体类型为线性马达。线性马达相比传统的转子马达来说,缩短了振动延迟时间以及避免了振动拖尾现象。可以为用户带来更好的振动体验。具体的,线性马达主要由定子和动子组成,动子主要是由特制质量块、弹簧、磁铁构成,定子则是由软性线路板(Flexible Printed Circuit board)FPC和环绕线圈构成。当线性马达接收到驱动信号后,线性马达中的定子线圈通电,由于磁场的存在,根据物理学家奥斯特发现的电流的磁效应,定子将受到磁场力的作用,会沿着特定的方向例如横向即左右方向带动动子运动,从而可以产生震感。可见,线性马达的工作原理则是类似于打桩机,线性马达主要是将电能转化为机械能,将电能直接转换为直线运动机械能,驱动弹簧质量块进行线性运动,从而产生振动,这种振动带给用户的震感类似于“哒哒哒”的效果。
电子设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
在一些实施例中,电子设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得电子设备100可以通过无线通信技术与网络以及其他设备通信。
在本申请实施例中,电子设备100的天线1和移动通信模块150耦合,使得电子设备100在接收到蜂窝来电时,能够输出例如增强振动提示信息,以提醒用户可以通过无线通信技术与其他设备通信。
在本申请实施例中,电子设备100的天线2和无线通信模块160耦合,使得电子设备100在接收到网络来电时,能够输出例如增强振动提示信息,以提醒用户可以通过无线通信技术与其他设备通信。
电子设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏194和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器110可包括一个或多个GPU,其执行程序指令以生成或改变显示信息。
显示屏194用于显示图像,视频等。显示屏194包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD)。显示屏面板还可以采用有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),miniled,microLed,micro-oled,量子点发光二极管(quantum dot light emitting diodes,QLED)等制造。在一些实施例中,电子设备100可以包括1个或N个显示屏194,N为大于1的正整数。
在本申请实施例中,电子设备的显示屏194可以显示有声音与振动等提示信息的相关设置选项。具体的,用户可以在声音与振动详情页中或者在下拉通知栏中,设置提示信息的种类,即设置声音模式,例如音乐(又称响铃)提示、增强振动(又称振动)提示、静音(又称免打扰)、通知栏提示或者指示灯提示中的任意一种或多种。
其中,增强振动提示的选项,具体可以是电子设备默认开启的,也可以是用户手动选择开启增强振动等等。本申请实施例对此不作限制。
关于显示屏194显示有声音与振动等提示信息相关设置选项的用户界面具体可以参考后文的对图3A-图3B所示的UI实施例的描述,在此暂不赘述。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当电子设备100在频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
在本申请实施例,当处理器110从音乐文件中通过算法方式获取音乐的特征时,具体可以通过数字信号处理器进行计算,关于算法的介绍,具体参考后文方法实施例,在此暂不赘述。
视频编解码器用于对数字视频压缩或解压缩。电子设备100可以支持一种或多种视频编解码器。这样,电子设备100可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
在本申请实施例,当处理器110从音乐文件中通过算法方式获取音乐的特征时,视频编解码器还可以将压缩的音乐文件进行解压,以供数字信号处理器对解压后的音乐文件进行计算,从而得到音乐的特征,关于算法的介绍,具体参考后文方法实施例,在此暂不赘述。
电子设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块170用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块170还可以用于对音频信号编码和解码。在一些实施例中,音频模块170可以设置于处理器110中,或将音频模块170的部分功能模块设置于处理器110中。
扬声器170A,也称“喇叭”,用于将音频电信号转换为声音信号。电子设备100可以通过扬声器170A收听音乐,或收听免提通话。
受话器170B,也称“听筒”,用于将音频电信号转换成声音信号。当电子设备100接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
耳机接口170D用于连接有线耳机。耳机接口170D可以是USB接口130,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
在本申请实施例中,上述音频模块170可以将用于音乐提示信息,由数字信号转化为模拟信号,通过扬声器170A或者耳机接口170D连接的耳机进行播放。
在本申请实施例中,电子设备100可以通过压力传感器180A和/或触摸传感器180K,检测到用户作用于显示屏194中显示的控件,以执行对应的功能。例如,可以检测到用户开启,增强振动功能的操作,然后电子设备100开启增强振动功能,使得马达可以根据上文所述的增强振动提示方法,输出增强振动提示信息。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。电子设备100可以接收按键输入,产生与电子设备100的用户设置以及功能控制有关的键信号输入。
在本申请实施例中,用户可以通过音量键来提高、降低或者关闭音乐的音量。
接下来,参考图2,图2示例性示出了电子设备100的软件架构示意图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android***分为四层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android Runtime)和***库,以及内核层。
应用程序层可以包括一系列应用程序包。
如图2所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,短信息等应用程序,或者还可以包括图2未示出的设置应用。
其中,设置应用中可以为用户提供用于设置声音与振动等提示信息的相关选项,具体可以参考后文对图3A-图3B所示的UI实施例的描述,在此暂不赘述。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图2所示,应用程序框架层可以包括窗口管理器,内容提供器,视图***,电话管理器,资源管理器,通知管理器等。
Android Runtime包括核心库和虚拟机。Android Runtime负责安卓***的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
***库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(Media Libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子***进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
内核层是硬件和软件之间的层。内核层至少包含马达驱动、显示驱动,摄像头驱动,音频驱动,传感器驱动。
在本申请实施例中,马达驱动可以根据处理器110获取到的增强随振信息,驱动马达进行振动。
基于上文介绍的电子设备100的软硬件架构,接下来结合下文图3A-图3C所示UI实 施例,来介绍本申请提供的增强振动提示方法。
参考图3A,图3A示例性示出电子设备显示的设置界面。
如图3A所示,用户界面310为电子设备的设置应用提供的用户界面。该用户界面310中显示有一系列设置选项,其中包括有声音与振动选项311,用户可以通过点击该选项进入到声音与振动的详情页,具体参考图3B所示的用户界面。
参考图3B,图3B示例性示出电子设备显示的声音与振动对应的详情页。
如图3B所示,用户界面320为声音与振动对应的详情页。该用户界面320中显示有声音模式设置模块321、音量调节模块322以及铃声设置模块323等等。
其中,声音模式设置模块321显示有三个模式选项,包括:响铃选项321A、增强振动选项321B和静音选项321C。
上述三个选项对应的名称仅为示例,不应构成对本申请的限制,例如选项321B的名称即“增强振动”仅为示例,在本申请另一些实施例中,“增强振动”还可以被称为“振动”,本申请实施例对321B选项对应的名称不作显示,其对应的具体功能如下记载:
当用户选中响铃选项321A时,则电子设备100检测到有来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频等事件时,可以响铃来提示用户。具体的,电子设备100的音频模块170通过播放来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频等事件分别对应的音乐,以提示用户。
当用户选中增强振动选项321B时,则电子设备100可以通过输出增强振动效果来提示用户,具体的,电子设备100的马达可以根据上述来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频等事件时分别对应的音乐的特征进行振动,以提示用户。
当用户选中静音选项321C时,则电子设备100检测到有来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频等事件时,不输出音乐以及振动的提示信息。
其中,音量调节模块322分别显示有用于调节响铃时的音量控制条,即322A;和,用于调节那种对应的响铃时的音乐控制条,即322B。用户可以通过分别在上述两个控制条中左右滑动,以控制音量的高低。
其中,铃声设置模块323中,显示有来电铃声选项323A、信息铃声选项323B、通知铃声选项323C以及闹钟铃声选项323D。用户可以通过选择对应的选项,以选择来电、信息、通知、闹钟以及备忘事件对应的响铃音乐。这里的响铃音乐,可以是电子设备100出厂前预先存储在电子设备100中的音乐文件,也可以是用户自行下载的音乐文件,本申请实施例对此不作限制。
可以理解的是,图3B所示的内容仅为示例,在本申请另一些实施例中,图3B还可以报用于设置增强等级选项。该增强等级与马达振动强度、振动时间有关,具体的,当增强等级越高时,马达的振动强度可以越大,或者马达振动过程中每个子段之间的时间间隔越短,从而使得电子设备输出的振动效果越强烈。
可以理解的是,图3A-图3B仅仅示例性示出电子设备100开启增强振动功能的一种实施方式。在本申请另一些实施例中,用户还可以通过下拉通知栏,通过选择通知栏中提供的增强振动选项,使得电子设备100开启增强振动功能;或者,用户还可以通过输入语音 指令使得电子设备开启增强振动功能。本申请实施例对开启增强振动功能的方法不作限制。
假设用户,用户选择了图3B所示的增强振动321B对应的选项,并将来电铃声设置为音乐“Light”,将信息铃声设置为音乐“Shine”,将通知铃声设置为音乐“Light”,并且将闹钟铃声设置为音乐“Classic”时,则电子设备在检测到有来电、信息、通知、闹钟以及备忘事件等事件时,则会输出对应音乐的特征所对应的增强振动的效果。具体如下:
参考图3C,图3C示例性示出电子设备检测到来电时的场景示意图。
如图3C所示,电子设备100检测到来电时,电子设备100不仅会控制的显示屏194显示来电提示界面330,电子设备100还会控制马达输出来电音乐“Light”对应的增强振动效果。
可见,在电子设备100检测到来电时,即是电子设备100的响铃被关闭,或者用户的电子设备100被置于口袋亦或是被置于桌子上,或者用户处于嘈杂的环境中,使得用户听不到音乐“Light”。但是,用户仍然可以感受到,电子设备100控制马达输出来电音乐“Light”对应的增强振动效果,从而避免了漏接电话等类似事件的发生,提高用户体验感。
可以理解的是,图3C仅仅示例性示出,电子设备在检测到一个事件例如来电时,输出来电音乐对应的增强振动提示信息。在本申请另一些实施例中,当电子设备检测到两个冲突事件时,例如,电子设备在播放视频/打游戏的过程中输出视频中/游戏中音乐对应的增强振动提示信息时,又检测到来电、信息、通知、闹钟或者备忘事件时,则电子设备可以切换至输出来电、信息、通知、闹钟或者备忘事件的音乐多对应的增强振动信息,直至用户通过接听/挂断电话,查看信息、通知或备忘事件,或者关闭闹钟,以触发电子设备停止输出来电、信息、通知、闹钟或者备忘事件的音乐多对应的增强振动信息,或者直至电子设备自动停止输出来电、信息、通知、闹钟或者备忘事件的音乐多对应的增强振动信息后,电子设备才会继续输出视频中/游戏中音乐对应的增强振动提示信息。
可以理解的是,当用户选中响铃选项321A和增强振动选项321B时,则电子设备100检测到有来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频等事件时,电子设备不仅会输出对应的音乐以提示用户,还会根据音乐的特征输出对应的增强振动效果以提示用户。关于电子设备100根据音乐的特地点输出对应的增强振动效果的详细实现方法具体可以参考后文的方法流程的详细介绍,在此暂不赘述。
接下来结合图4来详细介绍本申请提供的增强振动提示方法。
图4示例性示出本申请提供的增强振动提示方法流程。该方法流程具体包括:
S401,电子设备基于特定事件对应的音乐获取该音乐的特征。
在一些实施例中,当电子设备100检测到有来电、信息、通知、闹钟以及备忘等事件时,电子设备100会获取来电、信息、通知、闹钟以及备忘等事件分别响铃时对应的音乐文件,然后从该音乐文件中获取音乐的特征。
在另一些实施例中,当电子设备100检测到用户设置来电、信息、通知、闹钟以及备忘等事件在响铃时的音乐后,电子设备可以根据设置好的音乐,获取上述事件分别对应的 音乐文件,并从该音乐文件中获取音乐的特征。
其中,来电、信息、通知、闹钟以及备忘等事件分别响铃时对应的音乐文件,可以是电子设备100默认设置的。也可以是用户重新选择的。关于用户设置上述事件在响铃时分别对应的音乐的方法,具体可以参考前文UI实施例中对图3B的介绍,在此暂不赘述。
一首音乐的特征包括:该首音乐中多个子段对应的音乐的起止时间,以及各个子段内音乐的音强和频率等信息。其中,一首音乐中的多个子段具体可以根据音乐的旋律、节奏和节拍中的一个或多个特征划分,具体如下:
其中,电子设备100根据音乐文件获取音乐的特征的具体实现方法如下:
方式1:音乐文件中预先存储有音乐的特征,电子设备100的处理器110从存储器获取音乐文件后可以直接提取该音乐的特征。其中,音乐文件中预先存储有音乐的特征,可以是通过人工方式获取音乐的特征。
通过人工的方式获取音乐的特征的具体实现如下:
参考图5,图5示例性示出一首音乐波形示意图。
如图5所示,该首音乐的波形示意图例如可以是上文所述的来电响铃对应的“Light”音乐。该音乐波形的横轴为播放音乐时的时间,纵轴为播放音乐时声音的强度即升压级。
开发人员可以在听该首音乐“Light”的同时提取“Light”音乐的特征,该“Light”音乐的特征包括:每个子段的起止时间,以及每个子段内音乐的音强和频率等信息。
例如,从该首音乐响起时,记录到子段1为从第2秒开始到第3秒结束,子段2为从第5秒开始到6第秒结束,子段3为从第8秒开始到第9秒结束,子段4为从第12秒开始到第14秒结束,子段5为从第16秒开始到第19秒结束,子段6为从第23秒开始到第25秒结束。
此外,开发人员还会记录,该音乐在每个子段中的音强和频率。例如子段1中的音乐的频率为50-200赫兹(Hz),音强为40db,子段1中的音乐的频率为250-500Hz,音强为50db,子段3中的音乐的频率为大于500Hz,音强为60db等等这里不在一一赘述。
此外,上述用于提取音乐特征的开发人员可以是具备较强的乐感和乐理知识的专业音乐人士。
方式2:音乐文件中没有预先存储有音乐的特征,电子设备100的处理器110从存储器获取音乐文件后,处理器110可以调用视频编解码器将该音乐文件进行解压,然后数字信号处理器通过算法对解压后的音乐文件进行计算,可以提取该音乐的特征。其中提取音乐特征的算法具体包括:通过音乐节拍点来提取,通过频率来提取,通过不同响度来提取,通过频率与响度两者结合提取,以及通过AI/神经网络来提取处理等等。
本申请实施例仅以通过频率来提取音乐特征的算法进行介绍。具体实现如下:
参考图6,图6示例性示出提取音乐特征的算法框架示意图。
如图6所示,该算法框架包括高通、带通以及低通滤波器、频响门限,和标记特征起始点等模块。
首先,电子设备100中的视频编解码器将音乐文件解压后,获取到音乐流,通常一首音乐流中包含人声以及各种乐器声,所以解压后的音乐流是一个多音道的复杂音乐流。因 此,先通过高通、带通以及低通滤波器分别提取音乐流中的高频分量、中频分量和低频分量。然后将获取到的高频分量、中频分量和低频分量整合为一个简单音乐流。
之后,将简单音乐流分别输入频响门限1、频响门限2和频响门限3。其中,频响门限1用于将高频分量中的音乐信号频率大于第一预设频率的地方进行特征点的标记,从大于第一预设频率到小于第一预设频率的转折处再进行一次特征点标记,同时提取每一对从大于第一预设频率到小于第一预设频率的特征点之间的音乐流的频率和音强。同理,频响门限2用于将中频分量中的音乐信号频率大于第二预设频率的地方进行特征点的标记,从大于第二预设频率到小于第二预设频率的转折处再进行一次特征点标记,同时提取每一对从大于第二预设频率到小于第二预设频率的特征点之间的音乐流的频率和音强。同理,频响门限3用于将中频分量中的音乐信号频率大于第三预设频率的地方进行特征点的标记,从大于第三预设频率到小于第三预设频率的转折处再进行一次特征点标记,同时提取每一对从大于第三预设频率到小于第三预设频率的特征点之间的音乐流的频率和音强。
最后,将频响门限1、频响门限2和频响门限3分别输出的标记有特征起止点的音乐流合成为一个音乐流,该音乐流中携带有音乐特征,包括特征起止点(相当于子段起止点),和每个子段的频率、音强等信息。
S402,电子设备基于音乐的特征获取增强随振信息。
具体的,在一种可实施的方式中,电子设备100根据音乐的特征获取对应的标准随振信息,然后基于标准随振信息获取增强随振信息。在另一种可实施的方式中,电子设备100可以直接根据音乐的特征获取对应的增强随振信息。
本申请实施例具体以通过人工的方式获取音乐特征的基础为例,接下来介绍上述第一种可实施方式,具体如下:
首先,电子设备100根据音乐的特征获取对应的标准随振信息,该标准随振信息包括每个子段中,马达振动起止时间、振动强度和振动频率。
参考图7,图7示例性示出根据标准随振信息生成的标准随振波形示意图。
如图7所示,该标准随振波形,包括多段振动,每段振动的起止时间对应上文图5所示的音乐波形中的特征点的起止时间。每段振动中,振动持续时间、振动强度以及振动频率可能相同可能不同。
其中,马达振动的持续时间即某段音乐播放中特征的持续时间。例如,第一段(子段1a)振动的持续时间和人工从音乐波形中提取的子段1的持续时间相同,第二段(子段2a)振动的持续时间和人工从音乐波形中提取的子段2的持续时间相同等等。
其中,振动的强度则与音乐强度一一对应。具体的,音强大于第一等级的音乐其对应的振动强度为第一振动强度,音强小于等于第一等级大于第二等级的音乐其对应的振动强度为第二振动强度,音强小于等于第二等级大于第三等级的音乐其对应的振动强度为第三振动强度,音强小于等于第三等级的音乐其对应的振动强度为第四振动强度。其中,第一等级的音强大于第二等级的音强,第二等级的音强大于第三等级的音强;第一振动强度大于第二振动强度,第二振动强度大于第三振动强度,第三振动强度大于第四振动强度。例如,音乐波形中子段1中的音强小于第三等级,则标准随振波形中子段1中的振动强度为 第四振动强度。又例如,音乐波形中子段3中的前一小节音强小于等于第二等级大于第三等级,则标准随振波形中子段3中的振动强度为第三振动强度。又例如,音乐波形中子段3中的后一小节音强小于等于第一等级大于第二等级,则标准随振波形中子段3中的振动强度为第二振动强度。可以理解的是,这里的音强等级划分和振动强度划分仅为示例,在其他一些实施例中,上述划分结果可以包括更多或者更少的等级,本申请实施例对此不作限制。
其中,振动频率与音乐的频率一一对应。具体的,当音乐的频率大于第一预设频率,则采用第一预设频率振动,当音乐的频率小于第一预设频率,则采用第二预设频率振动。可以理解的是,这里的音乐频率等级划分和振动频率划分仅为示例,在其他一些实施例中,上述划分结果可以包括更多或者更少的等级,本申请实施例对此不作限制。
之后,电子设备100基于标准随振信息获取增强随振信息。该增强随振信息包括每个子段中,马达振动起止时间、振动强度和振动频率。
在本申请实施例中,基于标准随振信息获取增强随振信息的方式可以是以下任意一种,或者结合以下任意多种,具体如下:
方式1:将标准随振信息中每个子段内的振动强度都增强以得到增强随振信息。参考图8,图8示例性示出采用方式1获取的增强随振信息所输出的增强随振波形1。
如图8所示,该增强振动波形1的强度大于等于标准随振波形中振动强度的最大值(即上文所述的第一振动强度)。并且,该增强振动波形1的每段振动的起止时间与标准随振波形一致、每段振动频率也与标准随振波形一致。也就是说,增强随振波形1中的子段1a与标准随振波形中的子段1的振动频率、振动起止时间一样,增强随振波形1中的子段2a与标准随振波形中的子段2的振动频率、振动起止时间一样等等。
方式2:将标准随振信息中每个子段内振动时间段小于第二值的振动时间延长,以得到增强随振信息。
参考图9,图9示例性示出延长子段振动时间的方法流程图。
如图9所示,电子设备可以根据图7所示的标准随振波形,判断标准随振波形中各个子段的振动时间是否小于或等于第一值,该第一值例如为1秒钟。当确定子段的振动时间小于(包含等于)1秒钟,则将该子段的振动时间延长一定值(例如0.5秒);当确定子段的振动时间大于1秒钟时,则保持该子段的振动时间不变。此外,保持每个子段内段振动的强度与标准随振波形的振动强度保持一致、振动频率也保持一致。最后,整合各个子段以得到增强随振波形。
其中,延长子段的振动时间的方法包括:通过延长子段的振动终止时间,和/或,通过提前子段的振动起始时间,以延长振动持续时间。
方式3:将标准随振信息中相邻两个子段振动时间间隔大于第二值的间隔缩短,以得到增强随振信息。
参考图10,图10示例性示出缩短子段间隔的方法流程图。
如图10所示,电子设备可以根据图7所示的标准随振波形,判断标准随振波形中相邻两个子段之间的时间间隔是否大于或等于第二值,该第二值例如为3秒钟。当确定子段的振动时间大于(包含等于)3秒钟,则将该时间间隔缩短一定值(例如1秒);当确定子段 的时间间隔小于3秒钟时,则保持该相邻子段的时间间隔不变。此外,保持每个子段内段振动的强度与标准随振波形的振动强度保持一致、振动频率也保持一致。最后,整合各个子段以得到增强随振波形。
其中,缩短相邻子段的时间间隔的方法包括:通过将前一个子段的终止时间延长或者后一个子段的起始时间提前,以缩短相邻子段的时间间隔。
参考图11,图11示例性示出同时采用方式2和方式3获取的增强随振信息所输出的增强随振波形2。
如图11所示,该增强振动波形2中的每个子段内段振动的强度与随振波形的振动强度保持一致、振动频率也保持一致。
并且,将随振波形中振动持续时间少于等于预设时间(例如1秒)的短振,统一增加振动时间。例如,图7所示的标准随振波形中子段1和子段2对应的两段振动分别持续时间都为1秒,为短振,因此,将子段1和子段2的时间分别延长一定值例如0.5秒也得到对应的子段1b和子段2b。
此外,还将随振波形中每个子段之间的时间间隔大于等于第二值(例如3秒)的前一个子段的终止时间延长或者后一个子段的起始时间提前。例如,图7所示的标准随振波形中子段3和子段4之间的时间间隔为3秒钟,因此,将子段3的终止时间延长,得到子段3b。例如,图7所示的标准随振波形中子段5和子段6之间的时间间隔为3秒钟,因此,将子段5的终止时间延长,得到子段5b。
上述方式1-3中任意多项可以结合使用。例如,既增强振动强度同时增加短振时间;或者既增强振动强度同时缩短振动间隔;或者既增加短振时间同时缩短振动间隔;或者既增强振动强度、也增加短振时间同时还缩短振动间隔。
S403,电子设备检测到特定事件。
该特定时间包括来电、信息、通知、闹钟或者备忘录等。
具体的,电子设备可以通过移动通信模块或者无线通信模块检测到蜂窝来电或者网络来电等事件。或者,电子设备可以通过移动通信模块检测到信息。或者,电子设备可以通过无线通信模块检测到通知。或者电子设备可以检测到闹钟或者备忘录等事件。
S404,电子设备响应于检测到的特定事件,基于对应的增强随振信息驱动马达振动。
具体的,电子设备100在获取当上述步骤S402所述的增强随振信息后,可以根据该增强随振信息中的每个子段的振动起止时间、振动强度和振动频率控制马达振动。从而使得马达振动带来的效果与响铃时播放音乐的效果有着共同节奏动感。
值得注意的是,在电子设备100基于增强随振信息驱动马达振动之前,电子设备需要预先开启增强振动功能。例如,可以在上述步骤S401-S403中任意步骤之前开启。
上述增强振动功能可以是电子设备100默认开启的,也可以是用户通过上文UI实施例中图3A-图3B所示的选择设置应用提供的增强振动选项321B,或者是用户通过,选择下拉通知栏中提供的增强振动选项,或者是通过语音指令等方式,以触发电子设备100开启 增强振动功能。
在采用本申请提供的增强振动提示方法后,可以实现以下效果:
效果1:在电子设备100检测到来电、信息、通知、闹钟以及备忘事件等时,若电子设备100预先开启音乐提示和振动提示,即开启响铃功能和增强振动功能的情况下,电子设备100会伴随着音乐的特点进行振动,同时带给用户听觉上的和触觉上的提示,增加了提示的趣味性。
效果2:如果电子设备配置的马达的体积/规格/性能一般,在没有响铃音乐播放的情况下,即用户仅开启增强振动提示时,若电子设备100被置于口袋、桌上、背包中时,尽管响铃音乐中有的时间段内乐感较弱,但或通过将振动强度提高,或者将短振的时间延长,或者将振动间隔压缩,从而实现增强了乐感较弱的部分所对应的振动效果。从而避免用户漏接电话,或者漏看信息、通知、闹钟或者备忘事件等,从而提高用户体验感。
本申请的各实施方式可以任意进行组合,以实现不同的技术效果。
在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。所述计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行所述计算机程序指令时,全部或部分地产生按照本申请所述的流程或功能。所述计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。所述计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,所述计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线)或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。所述计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。所述可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘Solid State Disk)等。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程,该流程可以由计算机程序来指令相关的硬件完成,该程序可存储于计算机可读取存储介质中,该程序在执行时,可包括如上述各方法实施例的流程。而前述的存储介质包括:ROM或随机存储记忆体RAM、磁碟或者光盘等各种可存储程序代码的介质。
总之,以上所述仅为本发明技术方案的实施例而已,并非用于限定本发明的保护范围。凡根据本发明的揭露,所作的任何修改、等同替换、改进等,均应包含在本发明的保护范围之内。
Claims (17)
- 一种增强振动提示方法,其特征在于,所述方法应用于电子设备中,所述方法包括:所述电子设备检测到第一事件,所述第一事件对应的音乐包括:第一子段、第二子段;所述电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动;其中,所述第一时间、所述第一强度、所述第二时间和所述第二强度,符合以下任意一项或多项:所述第一强度、所述第二强度均大于或等于第三强度,所述第三强度对应于所述第一子段和所述第二子段中最强的音乐强度;在所述第一子段的持续时间小于或等于第一值的情况下,所述第一时间的长度大于所述持续时间;或者,在所述第一子段和所述第二子段之间的时间间隔大于或等于第二值的情况下,所述第一时间和所述第二时间之间的间隔小于所述时间间隔。
- 根据权利要求1所述的方法,其特征在于,在所述电子设备检测到第一事件之前,所述方法还包括:所述电子设备基于所述音乐获取标准随振信息;所述标准随振信息包括:第三时间、所述第三时间对应的所述第四强度、第四时间和所述第四时间对应第五强度;所述第三时间等于所述第一子段的持续时间,所述第四时间等于所述第二子段的持续时间;所述第四强度对应所述第一子段内的音强,所述第五强度对应所述第二子段内的音强;所述第三强度大于或等于所述第四强度和所述第五强度。
- 根据权利要求1或2所述的方法,其特征在于,所述第一事件包括:来电、信息、通知、闹钟、备忘事件、开启游戏或者播放视频。
- 根据权利要求1-3中任一项所述的方法,其特征在于,所述第一事件对应的音乐由用户设置或者由电子设备默认设置。
- 根据权利要求1-4中任一项所述的方法,其特征在于,所述第一事件对应的音乐预先存储于所述电子设备中,或者,由所述电子设备从其他设备中获取。
- 根据权利要求1-5中任一项所述的方法,其特征在于,所述电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动之前,所述方法还包括:所述电子设备开启增强振动功能,所述增强振动功能用于所述电子设备在所述第一时间内以所述第一强度振动,在所述第二时间内以所述第二强度振动。
- 根据权利要求6所述的方法,其特征在于,在所述电子设备开启增强振动功能之前,所述方法还包括:所述电子设备接收第一操作,所述第一操作用于触发所述电子设备开启所述增强振动功能。
- 根据权利要求7所述的方法,其特征在于,所述第一操作具体为:作用于设置应用提供的增强振动功能选项;作用于下拉通知栏提供的增强振动功能选项;或者,用户输入的语音指令。
- 根据权利要求1-8中任一项所述的方法,其特征在于,在所述电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动之前,所述方法还包括:所述电子设备接收第二操作,所述第二操作用于设置增强等级;当所述增强等级越高,所述第一时间、所述第一强度、所述第二时间和所述第二强度,符合以下任意一项或多项:所述第三强度越大;所述第一时间的长度越长;或者,所述时间间隔越短。
- 根据权利要求1-9中任一项所述的方法,其特征在于,所述第一子段的持续时间和所述第二子段的持续时间,由用户获取,或者由电子设备通过算法获取。
- 根据权利要求1-10中任一项所述的方法,其特征在于,所述第一子段、所述第二子段均包括以下一项或多项:所述音乐的旋律、节奏或者节拍。
- 根据权利要求1-11中任一项所述的方法,其特征在于,所述第一强度和所述第二强度相同。
- 根据权利要求1-12中任一项所述的方法,其特征在于,所述电子设备包括线性马达,所述电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动具体包括:所述电子设备驱动所述线性马达在第一时间内以第一强度振动,在第二时间内以第二强度振动。
- 根据权利要求1-13中任一项所述的方法,其特征在于,所述电子设备在第一时间内以第一强度振动,在第二时间内以第二强度振动的同时,所述方法还包括:所述电子设备播放所述音乐。
- 一种芯片,所述芯片应用于电子设备,所述芯片包括一个或多个处理器,所述处理器用于调用计算机指令以使得所述电子设备执行如权利要求1-14中任一项所述的方法。
- 一种计算机可读存储介质,包括指令,其特征在于,当所述指令在电子设备上运行时,使得所述电子设备执行如权利要求1-14中任一项所述的方法。
- 一种电子设备,其特征在于,所述电子设备包括一个或多个处理器和一个或多个存储器;其中,所述一个或多个存储器与所述一个或多个处理器耦合,所述一个或多个存储器用于存储计算机程序代码,所述计算机程序代码包括计算机指令,当所述一个或多个处理器执行所述计算机指令时,使得所述电子设备执行如权利要求1-14中任一项所述的方法。
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP22893956.7A EP4236285A4 (en) | 2022-01-10 | 2022-12-21 | IMPROVED VIBRATION PROMPT METHOD AND ELECTRONIC DEVICE |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202210022946.2 | 2022-01-10 | ||
CN202210022946 | 2022-01-10 | ||
CN202210055372.9 | 2022-01-18 | ||
CN202210055372.9A CN116456035B (zh) | 2022-01-10 | 2022-01-18 | 一种增强振动提示方法及电子设备 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2023130956A1 true WO2023130956A1 (zh) | 2023-07-13 |
Family
ID=87060430
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/140540 WO2023130956A1 (zh) | 2022-01-10 | 2022-12-21 | 一种增强振动提示方法及电子设备 |
Country Status (3)
Country | Link |
---|---|
EP (1) | EP4236285A4 (zh) |
CN (1) | CN118138691A (zh) |
WO (1) | WO2023130956A1 (zh) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060011042A1 (en) * | 2004-07-16 | 2006-01-19 | Brenner David S | Audio file format with mapped vibrational effects and method for controlling vibrational effects using an audio file format |
WO2015188581A1 (zh) * | 2014-06-13 | 2015-12-17 | 中兴通讯股份有限公司 | 一种利用音频控制马达震动的方法及装置 |
CN108777747A (zh) * | 2018-08-09 | 2018-11-09 | 瑞声科技(新加坡)有限公司 | 一种振动方法、移动终端和计算机可读存储介质 |
CN112269895A (zh) * | 2020-11-06 | 2021-01-26 | Oppo广东移动通信有限公司 | 一种振动控制方法、装置及计算机可读存储介质 |
CN112637422A (zh) * | 2020-12-31 | 2021-04-09 | Oppo广东移动通信有限公司 | 振动调节方法、装置、存储介质以及电子设备 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20100069736A (ko) * | 2008-12-17 | 2010-06-25 | 삼성전자주식회사 | 휴대 단말기의 컨텐츠 재생 장치 및 재생 방법 |
JP2021177264A (ja) * | 2018-07-31 | 2021-11-11 | ソニーグループ株式会社 | 情報処理装置、情報処理方法、及び、プログラム |
-
2022
- 2022-01-18 CN CN202410368383.1A patent/CN118138691A/zh active Pending
- 2022-12-21 WO PCT/CN2022/140540 patent/WO2023130956A1/zh unknown
- 2022-12-21 EP EP22893956.7A patent/EP4236285A4/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060011042A1 (en) * | 2004-07-16 | 2006-01-19 | Brenner David S | Audio file format with mapped vibrational effects and method for controlling vibrational effects using an audio file format |
WO2015188581A1 (zh) * | 2014-06-13 | 2015-12-17 | 中兴通讯股份有限公司 | 一种利用音频控制马达震动的方法及装置 |
CN108777747A (zh) * | 2018-08-09 | 2018-11-09 | 瑞声科技(新加坡)有限公司 | 一种振动方法、移动终端和计算机可读存储介质 |
CN112269895A (zh) * | 2020-11-06 | 2021-01-26 | Oppo广东移动通信有限公司 | 一种振动控制方法、装置及计算机可读存储介质 |
CN112637422A (zh) * | 2020-12-31 | 2021-04-09 | Oppo广东移动通信有限公司 | 振动调节方法、装置、存储介质以及电子设备 |
Non-Patent Citations (1)
Title |
---|
See also references of EP4236285A4 |
Also Published As
Publication number | Publication date |
---|---|
EP4236285A4 (en) | 2024-05-22 |
CN118138691A (zh) | 2024-06-04 |
EP4236285A1 (en) | 2023-08-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP7222112B2 (ja) | 歌の録音方法、音声補正方法、および電子デバイス | |
WO2021147415A1 (zh) | 实现立体声输出的方法及终端 | |
CN109448761B (zh) | 播放歌曲的方法和装置 | |
CN109327608A (zh) | 歌曲分享的方法、终端、服务器和*** | |
KR20180097382A (ko) | 전자 장치에서 진동 제공 방법 및 장치 | |
CN108922562A (zh) | 演唱评价结果显示方法及装置 | |
CN109243479B (zh) | 音频信号处理方法、装置、电子设备及存储介质 | |
CN112015943A (zh) | 一种哼唱识别方法及相关设备 | |
CN114245271A (zh) | 音频信号处理方法及电子设备 | |
WO2022127211A1 (zh) | 震动方法、装置、电子设备和可读存储介质 | |
WO2022267468A1 (zh) | 一种声音处理方法及其装置 | |
CN112435641B (zh) | 音频处理方法、装置、计算机设备及存储介质 | |
WO2022068694A1 (zh) | 电子设备及其唤醒方法 | |
CN108053821B (zh) | 生成音频数据的方法和装置 | |
CN114694646A (zh) | 一种语音交互处理方法及相关装置 | |
CN115378302A (zh) | 线性马达的控制方法、装置、设备及可读存储介质 | |
CN117714588A (zh) | 一种卡顿抑制方法及电子设备 | |
WO2023130956A1 (zh) | 一种增强振动提示方法及电子设备 | |
WO2023207149A1 (zh) | 一种语音识别方法和电子设备 | |
CN113449068A (zh) | 一种语音交互方法及电子设备 | |
CN116456035B (zh) | 一种增强振动提示方法及电子设备 | |
CN115359156A (zh) | 音频播放方法、装置、设备和存储介质 | |
CN114495988B (zh) | 一种输入信息的情感处理方法及电子设备 | |
CN115914456B (zh) | 音频处理方法、电子设备及计算机可读存储介质 | |
CN116567489B (zh) | 一种音频数据处理方法及相关装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2022893956 Country of ref document: EP Effective date: 20230523 |