WO2019228141A1 - 电子设备控制方法、装置、存储介质及电子设备 - Google Patents

电子设备控制方法、装置、存储介质及电子设备 Download PDF

Info

Publication number
WO2019228141A1
WO2019228141A1 PCT/CN2019/085566 CN2019085566W WO2019228141A1 WO 2019228141 A1 WO2019228141 A1 WO 2019228141A1 CN 2019085566 W CN2019085566 W CN 2019085566W WO 2019228141 A1 WO2019228141 A1 WO 2019228141A1
Authority
WO
WIPO (PCT)
Prior art keywords
content
electronic device
displayed
instruction
instruction content
Prior art date
Application number
PCT/CN2019/085566
Other languages
English (en)
French (fr)
Inventor
刘嘉飞
达剑
熊万江
李海泉
周伍润
董治
朱忠磊
文昭彦
高亮
李冠
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2019228141A1 publication Critical patent/WO2019228141A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223Execution procedure of a spoken command

Definitions

  • the present application relates to the technical field of electronic devices, and in particular, to a method, a device, a storage medium, and an electronic device for controlling an electronic device.
  • the embodiments of the present application provide a method, a device, a storage medium, and an electronic device for controlling an electronic device, which can improve the operating efficiency of the electronic device.
  • An embodiment of the present application provides a method for controlling an electronic device, which is applied to an electronic device.
  • the method includes:
  • An embodiment of the present application provides an electronic device control device, which is applied to an electronic device.
  • the device includes:
  • An information acquisition module configured to acquire a user's voice information when the electronic device is in a state of a screen
  • a first extraction module configured to extract instruction content in the voice information, where the instruction content is used to instruct the electronic device to display content to be displayed related to the instruction content;
  • a first determining module configured to determine whether the instruction content satisfies an execution condition
  • the display module is configured to display the content to be displayed according to the instruction content if the instruction content meets an execution condition.
  • An embodiment of the present application further provides a storage medium.
  • a computer program is stored in the storage medium, and when the computer program runs on a computer, the computer executes the method for controlling an electronic device according to the foregoing embodiment.
  • An embodiment of the present application further provides an electronic device.
  • the electronic device includes a processor and a memory.
  • the memory stores a computer program, and the processor calls the computer program stored in the memory for:
  • the electronic device control method according to the above embodiment is executed.
  • FIG. 1 is a schematic flowchart of an electronic device control method according to an embodiment of the present application.
  • FIG. 2 is another schematic flowchart of another method for controlling an electronic device according to an embodiment of the present application.
  • FIG. 3 is a schematic diagram of an implementation process for determining whether an instruction content satisfies an execution condition according to an embodiment of the present application.
  • FIG. 4 is a schematic diagram of an implementation process of displaying content to be displayed according to an instruction content according to an embodiment of the present application.
  • FIG. 5 is an application scenario of an electronic device control method according to an embodiment of the present application.
  • FIG. 6 is another application scenario of the electronic device control method according to the embodiment of the present application.
  • FIG. 7 is a schematic structural diagram of an electronic device control apparatus according to an embodiment of the present application.
  • FIG. 8 is another schematic structural diagram of an electronic device control apparatus according to an embodiment of the present application.
  • FIG. 9 is a schematic structural diagram of a display module according to an embodiment of the present application.
  • FIG. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
  • FIG. 11 is another schematic structural diagram of an electronic device according to an embodiment of the present application.
  • module may be a software object executing on the computing system.
  • the different components, modules, engines, and services described in this article can be implemented on this computing system.
  • the devices and methods described herein can be implemented in software, and of course, they can also be implemented in hardware, which are all within the protection scope of this application.
  • an embodiment herein means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the present application.
  • the appearances of this phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are they independent or alternative embodiments that are mutually exclusive with other embodiments. It is clearly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
  • the embodiments of the present application provide a method, a device, a storage medium, and an electronic device for controlling an electronic device. Each will be described in detail below.
  • the electronic device may be a smart phone, a tablet computer, or the like.
  • the electronic device in the embodiment of the present application may include a smart phone or a portable computer with a wireless communication module, for example, a tablet computer, a laptop computer, etc., or may be a wearable, handheld Computers, such as smart wearers and personal digital assistants (PDAs), are not limited here.
  • a smart phone or a portable computer with a wireless communication module for example, a tablet computer, a laptop computer, etc.
  • a wearable, handheld Computers such as smart wearers and personal digital assistants (PDAs)
  • PDAs personal digital assistants
  • the electronic device control method may run in an operating system of the electronic device, which may include, but is not limited to, a Windows operating system, a Mac OS operating system, an Android operating system, an IOS operating system, and Linux.
  • the operating system, the Ubuntu operating system, and the Windows Phone operating system are not limited in the embodiments of the present application.
  • An embodiment of the present application provides a method for controlling an electronic device, which is applied to an electronic device.
  • the method includes:
  • the method may further include:
  • the determining whether the instruction content satisfies an execution condition may include:
  • the control authority includes at least high or low;
  • displaying the content to be displayed according to the instruction content may include:
  • Extracting keywords of the instruction content the keywords including content anchors related to the content to be displayed;
  • the content target word includes one or more of an application, a time point, a sender, or designated content of the content to be displayed.
  • displaying the content to be displayed according to the instruction content may include: displaying the content to be displayed through an AOD state within a preset duration.
  • the method further includes: determining whether the electronic device is in a screen state by calling hardware status information stored in a status register.
  • FIG. 1 is a flowchart of an electronic device control method provided by an embodiment of the present application.
  • the method is applied to the electronic device described in the foregoing embodiment, and may include the following process:
  • the screen state of the electronic device can also be understood as the display screen in the electronic device is in the off state or the standby state under the lock screen.
  • whether the display screen is in the on-screen state can be determined by the electronic device calling the hardware status information stored in the status register, or by other methods that can determine the status of the display screen, such as detecting the driving of the display screen or by detecting The working voltage of the display screen is determined in other ways, which is not limited here.
  • the voice information is audio information including a voice of a user, and the voice of the user may include specific sentence content, and the voice information may be obtained through a microphone of the electronic device.
  • the electronic device can continuously obtain the ambient sound through the microphone, store the ambient sound into the cache, and perform real-time matching.
  • a voice instruction preceding the wake-up word may be set to wake up the function of extracting the voice information. For example, if “Xiaoou” is used as the wake-up word, when the electronic device matches that the voice spoken by the user contains “Xiaoou”, the voice information behind the “Xiaoou” wake-up word is obtained, and the voice information in the voice information is extracted. The contents of the instructions to facilitate later analysis.
  • the instruction content may be some voice instructions composed of the user's natural language, such as "display the unread short message of sender A".
  • the voice instruction is used to instruct the electronic device to acquire and display the unread short message of the sender A.
  • the voice information in order to extract the content of the instruction, may be converted into content information (such as text information) that can be understood by the electronic device, and then the content information is matched with a plurality of pre-stored instructions, and the matching is only successful
  • content is used as the instruction content.
  • the instruction may be formulated according to user needs, and this application is not limited here.
  • the content to be displayed may be a short message or an MMS message included in an electronic device, or an instant message or an application notification in a third-party application.
  • the content to be displayed may be text, audio, video, or a multimedia form in which various types of information are combined with each other. This application does not limit the specific content form to be displayed.
  • an action trigger signal for triggering the execution of displaying the content to be displayed may be generated according to the instruction content, and the electronic device may perform a corresponding action by monitoring the action trigger signal.
  • the voice instruction may also instruct the electronic device to perform an action of displaying the content to be displayed in other ways.
  • the execution condition may be determining whether the instruction in the instruction content can be located to the content to be displayed, so as to ensure that the content to be displayed can be correctly obtained by the electronic device.
  • the instruction in the instruction content can be accurately located to the content to be displayed, it can be determined that the instruction content meets the execution conditions, otherwise it is determined that the instruction content does not meet the execution conditions.
  • the content of the voice message is "display unread message”. Then by extracting the instruction content in the voice information, "display” and "unread message” can be obtained. At this time, because the "unread message” may be the text message content of the electronic device or the unread content of an application, the "unread message” cannot be used to locate which message the user needs to display, so that the display and instructions cannot be performed. The process of content-related content to be displayed, so that the content of the instruction does not satisfy the execution condition according to the conclusion.
  • the module can determine without a doubt that the content to be displayed to be displayed is the content of the "recent unread message”. Therefore, according to the instruction content, a process of displaying content to be displayed related to the instruction content can be executed, and thus the instruction content can be judged to satisfy the execution condition according to the conclusion.
  • a matching determination may be performed by calling a name database in the electronic device.
  • the name database can store name data such as application name, message sender name, and of course, it can also include other name data related to the location where the message was obtained.
  • the instruction in the instruction content can match the pre-stored name data in the name database and meet certain instruction rules, it can be explained that the instruction in the instruction content can meet the execution conditions, otherwise it does not meet the execution conditions.
  • the keywords "application A”, “sender A”, and “unread messages” can be extracted according to the content of the instruction. If the database contains the above keywords, and the system determines that the position of the content to be displayed can be determined through the above keywords, it can be determined that the instructions in the instruction content can satisfy the execution conditions.
  • the missing location information (such as the application name, sender name, etc.) may be sent to the user according to the matching result. For example, in the above example, if the content of the instruction is "show unread messages from sender A", and there are at least two places where the message is acquired due to different applications, the electronic device can play a voice prompt through the speaker, or The display screen displays a form of prompt information, and shows the user "Please determine the application where the message is located" to further determine the exact location of the message to improve the success rate and accuracy of information acquisition.
  • the acquisition instruction of the content to be displayed may be triggered according to the instruction content, and the acquisition instruction is used to trigger the electronic device to locate the content interface of the content to be displayed that the user needs to display according to keywords in the instruction content, and then pass Display the content interface where the content to be displayed is displayed to display the content to be displayed.
  • the content interface of the content to be displayed can be located through a name database for matching.
  • each pre-stored name in the name database can be associated with the relevant information position in the application. For example, if the name database contains "Sender A”, it can be associated with the message viewing interface of "Sender A” in the SMS program. If the keyword of the "sender A" exists in the instruction content, the name in the database can be used to jump to the message viewing interface of the "sender A".
  • an interface can be established between the application and the recognition module of the voice instruction, and the content interface of the application on the system and the content to be displayed can be called through the interface. , And display the content to be displayed in the content interface.
  • the content interface is displayed.
  • the electronic device control method can extract the instruction content in the voice information when the electronic device is in the screen state, and determine whether the instruction content meets the execution conditions. If it is, the content to be displayed related to the instruction content is displayed according to the instruction content. .
  • the user's voice information can more conveniently and directly acquire and display the content to be displayed that the user needs to display, thereby improving the operating efficiency of the electronic device.
  • FIG. 2 another implementation process of the electronic device control method provided by the embodiment of the present application is shown in the figure, including the following implementation process:
  • the screen state of the electronic device can also be understood as the display screen in the electronic device is in the off state or the standby state under the lock screen.
  • whether the display screen is in the on-screen state can be determined by the electronic device calling the hardware status information stored in the status register, or by other methods that can determine the status of the display screen, such as detecting the driving of the display screen or by detecting The working voltage of the display screen is determined in other ways, which is not limited here.
  • the voice information is audio information including a voice of a user, and the voice of the user may include specific sentence content, and the voice information may be obtained through a microphone of the electronic device.
  • the electronic device can continuously obtain the ambient sound through the microphone, store the ambient sound into the cache, and perform real-time matching.
  • a voice instruction preceding the wake-up word may be set to wake up the function of extracting the voice information. For example, if “Xiaoou” is used as the wake-up word, when the electronic device matches that the voice spoken by the user contains “Xiaoou”, the voice information behind the “Xiaoou” wake-up word is obtained, and the voice information in the voice information is extracted The contents of the instructions to facilitate later analysis.
  • the instruction content may be some voice instructions composed of the user's natural language, such as "display the unread short message of sender A".
  • the voice instruction is used to instruct the electronic device to acquire and display the unread short message of the sender A.
  • the voice information in order to extract the content of the instruction, may be converted into content information (such as text information) that can be understood by the electronic device, and then the content information is matched with a plurality of pre-stored instructions, and the matching is only successful
  • content is used as the instruction content.
  • the instruction may be formulated according to user needs, and this application is not limited here.
  • the content to be displayed may be a short message or an MMS message included in an electronic device, or an instant message or an application notification in a third-party application.
  • the content to be displayed may be text, audio, video, or a multimedia form in which various types of information are combined with each other. This application does not limit the specific content form to be displayed.
  • an action trigger signal for triggering the execution of displaying the content to be displayed may be generated according to the instruction content, and the electronic device may perform a corresponding action by monitoring the action trigger signal.
  • the voice instruction may also instruct the electronic device to perform an action of displaying the content to be displayed in other ways.
  • the voiceprint features in the voice information can be extracted by an extraction algorithm known to those skilled in the art.
  • the voiceprint feature may include one or more combinations of broadband voiceprint, narrowband voiceprint, amplitude voiceprint, contour voiceprint, time-spectrum voiceprint, and cross-section voiceprint, which are not exhaustively listed here.
  • the electronic device may store the voiceprint characteristics of the user in advance.
  • the electronic device may have voiceprint characteristics of users A and B pre-stored. After obtaining the voiceprint characteristics of a user ’s voice information, the voiceprint characteristics may be compared with the voiceprint characteristics of the user pre-stored in the electronic device. It is determined whether the user is an A user or a B user.
  • a voiceprint feature comparison algorithm known to those skilled in the art may be used to process and compare the acquired voiceprint feature with the voiceprint feature of a pre-stored user to determine whether they match. If there are multiple pre-stored users, a weighted score or a matching method may be used to determine whether the voice print features of the pre-stored users match the acquired voice print features. Of course, other methods can also be used to determine whether the user corresponding to the acquired voiceprint feature is a preset user, which is not limited in this application.
  • voiceprint characteristics of a user match the voiceprint characteristics of the pre-stored user A or user B, it is determined that the user is a preset user, and the instruction corresponding to the voice information is continued to be executed.
  • the information operates the electronic device to improve the security of the electronic device.
  • the authority of the user may be classified, and it is determined whether the user corresponding to the voiceprint feature is a preset type of user. For example, a user A and a user B are classified as a user A, a user C is a user B, and the electronic device may be set to determine that the user corresponding to the voiceprint feature is only when the voiceprint feature matches the user of the class A. Preset users.
  • the execution condition may be determining whether the instruction in the instruction content can be located to the content to be displayed, so as to ensure that the content to be displayed can be correctly obtained by the electronic device.
  • the instruction in the instruction content can be accurately located to the content to be displayed, it can be determined that the instruction content meets the execution conditions, otherwise it is determined that the instruction content does not meet the execution conditions.
  • a matching determination may be performed by calling a name database in the electronic device.
  • the name database can store name data such as application name, message sender name, and of course, it can also include other name data related to the location where the message was obtained.
  • the instruction in the instruction content can match the pre-stored name data in the name database and meet certain instruction rules, it can be explained that the instruction in the instruction content can meet the execution conditions, otherwise it does not meet the execution conditions.
  • the missing location information (such as the application name, sender name, etc.) may be sent to the user according to the matching result. For example, in the above example, if the content of the instruction is "show unread messages from sender A", and there are at least two places where the message is acquired due to different applications, the electronic device can play a voice prompt through the speaker, or The display screen displays a form of prompt information, and shows the user "Please determine the application where the message is located" to further determine the exact location of the message to improve the success rate and accuracy of information acquisition.
  • the acquisition instruction of the content to be displayed may be triggered according to the instruction content, and the acquisition instruction is used to trigger the electronic device to locate the content interface of the content to be displayed that the user needs to display according to the keywords in the instruction content, and then pass Display the content interface where the content to be displayed is displayed to display the content to be displayed.
  • the content interface of the content to be displayed can be located through a name database for matching.
  • each pre-stored name in the name database can be associated with the relevant information position in the application.
  • the content interface is displayed.
  • the process of acquiring and processing the content to be displayed according to the content of the instruction content is continued.
  • the voiceprint feature in the voice message is a non-preset user, it can be determined that the user does not have the right to control the electronic device, then directly exit the process of acquiring and processing the content to be displayed according to the content of the instruction content, and The message is locked to prevent it from being disclosed to anyone who does not have control of the electronic device.
  • FIG. 3 an implementation process for determining whether the content of an instruction meets an execution condition according to an embodiment of the present application is shown.
  • the content that needs to be displayed may have different degrees of importance, such as private messages in instant applications, encrypted documents, images, etc., which are more important content; and general text messages, etc., are relatively less important content.
  • determining whether the instruction content meets execution conditions may include:
  • control permission such as high or low
  • the control permission of the encrypted file is set to high, and the encrypted file can be unlocked and displayed only when the user permission of the user is high.
  • control permission may be set during a file encryption process. If a user encrypts a file, the control permission of the file may be set to high. If the user does not encrypt a file, the control permission of the file can be set to low by default.
  • control authority of different objects can also be set according to the actual situation, for example, set to three or more levels of "high”, “medium”, and “low”, or use other distinctions Ways to determine the control rights of different content to protect the information security of important content and improve the security of important content according to different control rights.
  • Voiceprint features in voice messages can correspond to different user rights.
  • the user permission may be set when the voiceprint feature of the user is entered, or may be set in the user management interface of the electronic device after the voiceprint feature of the user is entered, and the specific implementation is The method can be determined according to the actual situation, which is not limited in this application.
  • the user authority of the user may be matched with the control authority required to execute the instruction content. If the user authority is matched, it is determined that the instruction content meets the execution conditions, otherwise it is not satisfied.
  • control authority required to execute the instruction content when the control authority required to execute the instruction content is set to "high”, only users with user authority "high” can execute the instruction content and display the content to be displayed.
  • control authority of the content to be displayed corresponding to the instruction content is low, that is, the control authority required to execute the instruction content is set to "low”, then the user's authority can be executed "high” or "low” content.
  • the instruction content indicates the level of control authority of the content to be displayed to be displayed, and the user authority of the user.
  • the matching is performed, and the content to be displayed is displayed only to users who have successfully matched.
  • the information security of important content can be protected according to different control rights, and the security of important content can be improved.
  • FIG. 4 an implementation process of displaying content to be displayed according to an embodiment of the present application is shown.
  • the implementation process includes:
  • the content anchor word is a word used to locate a content to be displayed.
  • FIG. 5 an application scenario of an electronic device control method according to an embodiment of the present application is shown in the figure.
  • FIG. 5 shows that the content of the instruction in the voice message is "display unread message of sender A in application A".
  • the content anchors related to the content to be displayed can be extracted: “A application”, “sender A”, and “unread message”.
  • the content anchor is used to determine a location of the content to be displayed.
  • the content anchor may include one or more of an application, a time point, a sender, or designated content of the content to be displayed.
  • FIG. 6 another application scenario of the electronic device control method provided by the embodiment of the present application is shown in the figure.
  • the application to which the content to be displayed belongs can be determined as the A application according to “Application A”, and the application to which the content to be displayed belongs can be determined as the sender according to “Sender A”. A, then "Unread Message" can determine that the content to be displayed is an unread message.
  • the position of the content to be displayed of the instruction content is an unread message of sender A in the A application, and thus the specific position of the content to be displayed can be located according to the content locator .
  • the location of the content to be displayed may refer to the location of the content interface of the content to be displayed, such as the content interface of the electronic device in FIG. 6.
  • the location of the content to be displayed may also be the location of the content code corresponding to the content to be displayed.
  • the electronic device can obtain the content code and display the content code in a preset manner.
  • acquiring and displaying the content to be displayed may be a content interface for acquiring and displaying the content to be displayed.
  • the “A application” can be opened first.
  • “A application” includes “sender A”, “sender B”, and “sender” Messages from senders such as "person C”.
  • senders such as "person C”.
  • the content interface of sender A can be located again.
  • the content interface displays the content to be displayed as "Hey, why don't you have dinner together tonight?" After obtaining the content interface, the content interface can be displayed.
  • acquiring and displaying the content to be displayed may be acquiring and displaying a content code corresponding to the content to be displayed.
  • the content code may be displayed in a preset manner. For example, "Hey, would you like to have a meal tonight?"
  • the location of the content to be displayed can be quickly determined, and the display content can be obtained and displayed according to the location of the content to be displayed, which can further improve the execution of obtaining the content to be displayed. Efficiency and accuracy, and further improve the success rate of displaying the content to be displayed through voice information control.
  • displaying the content to be displayed according to the instruction content includes: displaying the content to be displayed through an AOD state within a preset duration.
  • this state displays content such as text, numbers, or patterns on the black background of the display screen for a long time to remind the user of some commonly used information, such as the current time, News, etc. It can be understood that the specific display content and display mode can be determined according to the actual situation, which is not limited in this application.
  • Displaying the content to be displayed through the AOD mode can display a certain amount of information without unlocking the electronic device, which can ensure the security of the device and save the power of the electronic device.
  • a preset display duration can be set, and the content to be displayed is displayed in the display duration.
  • the content to be displayed may be displayed only within the display duration, so that the display is turned off after the user has viewed the content to be displayed, so as to prevent other users from observing the content, thereby further improving the confidentiality of the content to be displayed.
  • This embodiment provides an electronic device control device, which is applied to an electronic device.
  • the device may include:
  • An information acquisition module is configured to acquire a user's voice information when the electronic device is in a state of a screen.
  • a first extraction module is configured to extract instruction content in the voice information, where the instruction content is used to instruct the electronic device to display content to be displayed related to the instruction content.
  • a first determining module is configured to determine whether the instruction content meets an execution condition.
  • the display module is configured to display the content to be displayed according to the instruction content if the instruction content meets an execution condition.
  • the apparatus may further include:
  • a second extraction module is configured to extract voiceprint features in the voice information.
  • a second determination module is configured to determine whether the voiceprint feature is a voiceprint feature of a preset user; if so, execute a process of determining whether the instruction content meets an execution condition.
  • the display module may include:
  • An extraction submodule is used to extract keywords of the instruction content, where the keywords include content anchors related to the content to be displayed.
  • a determining submodule configured to determine a location of the content to be displayed according to the content anchor.
  • a display submodule configured to acquire and display the content to be displayed from a location of the content to be displayed.
  • the content target word includes one or more of an application, a time point, a sender, or designated content of the content to be displayed.
  • the first judgment module may be configured to:
  • the control authority includes at least high or low;
  • the display module may be configured to:
  • the content to be displayed is displayed in an AOD state within a preset duration.
  • the information acquisition module may be further configured to:
  • the electronic device control apparatus 500 includes an information acquisition module 501, a first extraction module 502, a first determination module 503, and a display module. 504.
  • the information acquisition module 501 is configured to acquire a user's voice information when the electronic device is in a screen-resting state.
  • the screen state of the electronic device can also be understood as the display screen in the electronic device is in the off state or the standby state under the lock screen.
  • whether the display screen is in the on-screen state can be determined by the electronic device calling the hardware status information stored in the status register, or by other methods that can determine the status of the display screen, such as detecting the driving of the display screen or by detecting The working voltage of the display screen is determined in other ways, which is not limited here.
  • the voice information is audio information including a voice of a user, and the voice of the user may include specific sentence content, and the voice information may be obtained through a microphone of the electronic device.
  • the electronic device can continuously obtain the ambient sound through the microphone, store the ambient sound into the cache, and perform real-time matching.
  • a first extraction module 502 is configured to extract instruction content in the voice information, where the instruction content is used to instruct the electronic device to display content to be displayed related to the instruction content.
  • a voice instruction preceding the wake-up word may be set to wake up the function of extracting the voice information. For example, if “Xiaoou” is used as the wake-up word, when the electronic device matches that the voice spoken by the user contains “Xiaoou”, the voice information behind the “Xiaoou” wake-up word is obtained, and the voice information in the voice information is extracted. The contents of the instructions to facilitate later analysis.
  • the instruction content may be some voice instructions composed of the user's natural language, such as "display the unread short message of sender A".
  • the voice instruction is used to instruct the electronic device to acquire and display the unread short message of the sender A.
  • the voice information in order to extract the content of the instruction, may be converted into content information (such as text information) that can be understood by the electronic device, and then the content information is matched with a plurality of pre-stored instructions, and the matching is only successful
  • content is used as the instruction content.
  • the instruction may be formulated according to user needs, and this application is not limited here.
  • the content to be displayed may be a short message or an MMS message included in an electronic device, or an instant message or an application notification in a third-party application.
  • the content to be displayed may be text, audio, video, or a multimedia form in which various types of information are combined with each other. This application does not limit the specific content form to be displayed.
  • an action trigger signal for triggering the execution of displaying the content to be displayed may be generated according to the instruction content, and the electronic device may perform a corresponding action by monitoring the action trigger signal.
  • the voice instruction may also instruct the electronic device to perform an action of displaying the content to be displayed in other ways.
  • a first determining module 503 is configured to determine whether the instruction content meets an execution condition.
  • the execution condition may be determining whether the instruction in the instruction content can be located to the content to be displayed, so as to ensure that the content to be displayed can be correctly obtained by the electronic device.
  • the instruction in the instruction content can be accurately located to the content to be displayed, it can be determined that the instruction content meets the execution conditions, otherwise it is determined that the instruction content does not meet the execution conditions.
  • a matching determination may be performed by calling a name database in the electronic device.
  • the name database can store name data such as application name, message sender name, and of course, it can also include other name data related to the location where the message was obtained.
  • the instruction in the instruction content can match the pre-stored name data in the name database and meet certain instruction rules, it can be explained that the instruction in the instruction content can meet the execution conditions, otherwise it does not meet the execution conditions.
  • the missing location information (such as the application name, sender name, etc.) may be sent to the user according to the matching result. For example, in the above example, if the content of the instruction is "show unread messages from sender A", and there are at least two places where the message is acquired due to different applications, the electronic device can play a voice prompt through the speaker, or The display screen displays a form of prompt information, and shows the user "Please determine the application where the message is located" to further determine the exact location of the message to improve the success rate and accuracy of information acquisition.
  • a display module 504 is configured to display the content to be displayed according to the instruction content if the instruction content meets an execution condition.
  • the acquisition instruction of the content to be displayed may be triggered according to the instruction content, and the acquisition instruction is used to trigger the electronic device to locate the content interface of the content to be displayed that the user needs to display according to the keywords in the instruction content, and then pass Display the content interface where the content to be displayed is displayed to display the content to be displayed.
  • the content interface of the content to be displayed can be located through a name database for matching.
  • each pre-stored name in the name database can be associated with the relevant information position in the application. For example, if the name database contains "Sender A”, it can be associated with the message viewing interface of "Sender A” in the SMS program. If the keyword of the "sender A" exists in the instruction content, the name in the database can be used to jump to the message viewing interface of the "sender A".
  • an interface can be established between the application and the recognition module of the voice instruction, and the content interface of the application on the system and the content to be displayed can be called through the interface. , And display the content to be displayed in the content interface.
  • the content interface is displayed.
  • the electronic device control device can extract the instruction content in the voice information when the electronic device is in the screen state, and determine whether the instruction content meets the execution conditions. If it is, the content to be displayed related to the instruction content is displayed according to the instruction content. .
  • the user's voice information can more conveniently and directly acquire and display the content to be displayed that the user needs to display, thereby improving the operating efficiency of the electronic device.
  • the electronic device control apparatus 500 includes an information acquisition module 501, a first extraction module 502, a first determination module 503, and a display module. 504, further including: a second extraction module 505 and a second judgment module 506.
  • the second extraction module 505 is configured to extract voiceprint features in the voice information.
  • the voiceprint feature may include one or more features such as a broadband voiceprint, a narrowband voiceprint, an amplitude voiceprint, a contour voiceprint, a time-spectrum voiceprint, and a cross-section voiceprint, which are not exhaustively listed here.
  • the second determination module 506 is configured to determine whether the voiceprint feature is a voiceprint feature of a preset user; if so, execute a process of determining whether the content of the instruction satisfies an execution condition.
  • the electronic device may store the voiceprint characteristics of the user in advance.
  • a voiceprint feature comparison algorithm known to those skilled in the art may be used to process and compare the acquired voiceprint feature with the voiceprint feature of a pre-stored user to determine whether they match. If there are multiple pre-stored users, a weighted score or a matching method may be used to determine whether the voice print features of the pre-stored users match the acquired voice print features. Of course, other methods can also be used to determine whether the user corresponding to the acquired voiceprint feature is a preset user, which is not limited in this application.
  • voiceprint characteristics of a user match the voiceprint characteristics of the pre-stored user A or user B, it is determined that the user is a preset user, and the instruction corresponding to the voice information is continued to be executed.
  • the information operates the electronic device to improve the security of the electronic device.
  • the authority of the user may be classified, and it is determined whether the user corresponding to the voiceprint feature is a preset type of user.
  • the display module 504 includes an extraction submodule 5041, a determination submodule 5042, and a display submodule 5043.
  • the extraction sub-module 5041 is configured to extract keywords of the instruction content, and the keywords include content anchors related to the content to be displayed.
  • the content anchor word is a word used to locate a content to be displayed.
  • the content anchor may include one or more of an application, a time point, a sender, or designated content of the content to be displayed.
  • a determining sub-module 5042 is configured to determine the location of the content to be displayed according to the content anchor.
  • the location of the content to be displayed may refer to the location of the content interface of the content to be displayed, such as the content interface of the electronic device in FIG. 6.
  • the location of the content to be displayed may also be the location of the content code corresponding to the content to be displayed.
  • the electronic device can obtain the content code and display the content code in a preset manner.
  • a display sub-module 5043 is configured to obtain and display content to be displayed from a location where the content is to be displayed.
  • acquiring and displaying the content to be displayed may be a content interface for acquiring and displaying the content to be displayed.
  • acquiring and displaying the content to be displayed may be acquiring and displaying a content code corresponding to the content to be displayed. After the electronic device obtains the content code, the content code may be displayed in a preset manner.
  • the location of the content to be displayed can be quickly determined, and the display content can be obtained and displayed according to the location of the content to be displayed, which can further improve the execution of obtaining the content to be displayed. Efficiency and accuracy, and further improve the success rate of displaying the content to be displayed through voice information control.
  • the electronic device control device belongs to the same concept as the electronic device control method in the foregoing embodiment, and the electronic device control device may run the electronic device control method provided in the embodiment.
  • the electronic device control device may run the electronic device control method provided in the embodiment.
  • any method refer to the embodiment of the electronic device control method, and any combination may be used to form an optional embodiment of the present application, which is not repeated here.
  • an electronic device is also provided, and the electronic device may be a device such as a smart phone or a tablet computer.
  • the electronic device 600 includes a processor 601 and a memory 602. The processor 601 and the memory 602 are electrically connected.
  • the processor 601 is the control center of the electronic device 600. It uses various interfaces and lines to connect various parts of the entire electronic device.
  • the processor 601 runs or loads a computer program stored in the memory 602, and calls data stored in the memory 602 to execute the electronic Various functions of the device and processing data, so as to monitor the overall electronic equipment.
  • the processor 601 in the electronic device 600 will load the instructions corresponding to the process of one or more computer programs into the memory 602 according to the following steps, and the processor 601 will run and store the memory 602
  • a computer program in the computer to implement various functions, such as:
  • the processor 601 may further perform the following processes:
  • the processor 601 may further perform the following processes:
  • the control authority including at least high or low; determine the user authority of the user to which the voiceprint feature belongs according to the voiceprint feature in the voice information; determine the user authority Whether the control authority required to execute the instruction content is satisfied; if so, it is determined that the instruction content satisfies an execution condition.
  • the processor 601 may further perform the following processes:
  • Extracting keywords of the instruction content the keywords including content anchors related to the content to be displayed; determining the location of the content to be displayed according to the content anchors; and from the location of the content to be displayed The position acquires and displays the content to be displayed.
  • the processor 601 may further perform the following processes:
  • the content to be displayed is displayed in an AOD state within a preset duration.
  • the processor 601 may perform the following processes:
  • the memory 602 may be used to store computer programs and data.
  • the computer program stored in the memory 602 contains instructions executable by the processor.
  • Computer programs can be composed of various functional modules.
  • the processor 601 executes various computer programs and data processing by running a computer program stored in the memory 602. For example: when the electronic device is in the screen state, obtaining the user's voice information; extracting the instruction content in the voice information, the instruction content is used to instruct the electronic device to display the to-be-displayed information related to the instruction content Content; judging whether the instruction content meets execution conditions; if so, displaying the content to be displayed according to the instruction content.
  • the electronic device 600 further includes a display screen 603, a control circuit 604, a radio frequency circuit 605, an input unit 606, an audio circuit 607, a sensor 608, and a power source 609.
  • the processor 601 is electrically connected to the display screen 603, the control circuit 604, the radio frequency circuit 605, the input unit 606, the audio circuit 607, the sensor 608, and the power source 609, respectively.
  • the display screen 603 may be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device. These graphical user interfaces may be composed of images, text, icons, videos, and any combination thereof.
  • the control circuit 604 is electrically connected to the display screen 603 and is used to control the display screen 603 to display information.
  • the radio frequency circuit 605 is used to transmit and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic device through wireless communication, and transmit and receive signals to and from the network device or other electronic device.
  • the input unit 606 can be used to receive inputted numbers, character information, or user characteristic information (such as fingerprints), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.
  • the input unit 606 may include a fingerprint recognition module.
  • the audio circuit 607 can provide an audio interface between the user and the electronic device through a speaker or a microphone.
  • the sensor 608 is used to collect external environment information.
  • the sensor 608 may include an ambient brightness sensor, an acceleration sensor, a light sensor, a motion sensor, and other sensors.
  • the power supply 609 is used to supply power to various components of the electronic device 600.
  • the power supply 609 may be logically connected to the processor 601 through a power management system, so as to implement functions such as managing charging, discharging, and power consumption management through the power management system.
  • the electronic device 600 may further include a camera, a Bluetooth module, and the like, and details are not described herein again.
  • the electronic device provided in the embodiment of the present application can extract the instruction content in the voice information and determine whether the instruction content meets the execution conditions when the electronic device is in the state of the screen, and if it is displayed, it is related to the instruction content according to the instruction content. To be displayed.
  • the user's voice information can more conveniently and directly obtain and display the content to be displayed that the user needs to display, thereby improving the operating efficiency of the electronic device.
  • a storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor to execute any of the foregoing electronic device control methods, for example:
  • the program may be stored in a computer-readable storage medium.
  • the storage medium may include: Read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), magnetic disks or optical disks, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请实施例公开了一种电子设备控制方法,包括在所述电子设备处于息屏状态时,获取用户的语音信息;提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;判断所述指令内容是否满足执行条件;若是,则根据所述指令内容显示所述待显示内容。

Description

电子设备控制方法、装置、存储介质及电子设备
本申请要求于2018年05月30日提交中国专利局、申请号为201810539561.7、申请名称为“电子设备控制方法、装置、存储介质及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及电子设备技术领域,尤其涉及一种电子设备控制方法、装置、存储介质及电子设备。
背景技术
在智能设备的应用越来越广的今天,用户使用智能设备中的应用程序可以实现多种功能。
在智能设备的实际应用中,用户需要经常查看各种内容,如短信或者是其他应用程序推送的文字内容,甚至是图片、短视频等流媒体内容。在一般情况下,用户需要先解锁智能设备,并寻找并打开该对应的位置,如短信通知栏或者是应用程序的消息显示页面等,以查看该待显示内容。
发明内容
本申请实施例提供一种电子设备控制方法、装置、存储介质及电子设备,可以提升电子设备的操作效率。
本申请实施例提供一种电子设备控制方法,应用于电子设备,所述方法包括:
在所述电子设备处于息屏状态时,获取用户的语音信息;
提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;
判断所述指令内容是否满足执行条件;
若是,则根据所述指令内容显示所述待显示内容。
本申请实施例提供了一种电子设备控制装置,应用于电子设备,所述装置包括:
信息获取模块,用于在所述电子设备处于息屏状态时,获取用户的语音信息;
第一提取模块,用于提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;
第一判断模块,用于判断所述指令内容是否满足执行条件;以及
显示模块,用于若所述指令内容满足执行条件,则根据所述指令内容显示所述待显示内容。
本申请实施例还提供了一种存储介质,所述存储介质中存储有计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行如上实施例所述的电子设备控制方法。
本申请实施例还提供了一种电子设备,所述电子设备包括处理器和存储器,所述存储器中存储有计算机程序,所述处理器通过调用所述存储器中存储的所述计算机程序,用于执行如上实施例所述的电子设备控制方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1是本申请实施例提供的电子设备控制方法的实现流程示意图。
图2是本申请实施例提供的电子设备控制方法的另一实现流程示意图。
图3是本申请实施例提供的判断指令内容是否满足执行条件的实现流程示意图。
图4是本申请实施例提供的根据指令内容显示待显示内容的实现流程示意图。
图5是本申请实施例提供的电子设备控制方法的应用场景。
图6是本申请实施例提供的电子设备控制方法的另一应用场景。
图7是本申请实施例提供的电子设备控制装置的结构示意图。
图8是本申请实施例提供的电子设备控制装置的另一结构示意图。
图9是本申请实施例提供的显示模块的结构示意图。
图10是本申请实施例提供的电子设备的一种结构示意图。
图11是本申请实施例提供的电子设备的另一种结构示意图。
具体实施方式
请参照图示,其中相同的组件符号代表相同的组件,本申请的原理是以实施在一适当的运算环境中来举例说明。以下的说明是基于所例示的本申请具体实施例,其不应被视为限制本申请未在此详述的其它具体实施例。
本文所使用的术语“模块”可为在该运算***上执行的软件对象。本文所述的不同组件、模块、引擎及服务可为在该运算***上的实施对象。而本文所述的装置及方法可以以软件的方式进行实施,当然也可在硬件上进行实施,均在本申请保护范围之内。
在本文中提及“实施例”意味着,结合实施例描述的特定特征、结构或特性可以包含在本申请的至少一个实施例中。在说明书中的各个位置出现该短语并不一定均是指相同的实施例,也不是与其它实施例互斥的独立的或备选的实施例。本领域技术人员显式地和隐式地理解的是,本文所描述的实施例可以与其它实施例相结合。
本申请实施例提供一种电子设备控制方法、装置、存储介质及电子设备。以下将分别进行详细说明。该电子设备可以是智能手机、平板电脑等设备。
本申请实施例中的电子设备,可以包括智能手机(Smart Phone),或者具有无线通信模块的便携式计算机,例如,平板电脑(Tablet Computer)、笔记本电脑(Laptop)等,还可以是穿戴式、手持式的计算机,如智能穿戴设备(Smart wearer)、个人数字助理(Personal Digital Assistant,PDA)等设备,在此不作限定。
当该方法应用在该电子设备时,其中,该电子设备控制方法可运行在电子设备的操作***中,可包括但不限于Windows操作***、Mac OS操作***、Android操作***、IOS操作***、Linux操作***、Ubuntu操作***、Windows Phone操作***等等,本申请实施例不作限定。
本申请实施例提供一种电子设备控制方法,应用于电子设备,所述方法包括:
在所述电子设备处于息屏状态时,获取用户的语音信息;
提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;
判断所述指令内容是否满足执行条件;
若是,则根据所述指令内容显示所述待显示内容。
在一种实施方式中,在所述判断所述指令内容是否满足执行条件之前,还可以包括:
提取所述语音信息中的声纹特征;
判断所述声纹特征是否为预设用户的声纹特征;
若是,则执行判断所述指令内容是否满足执行条件。
在一种实施方式中,所述判断所述指令内容是否满足执行条件,可以包括:
确定执行所述指令内容所需的控制权限,所述控制权限至少包括高或低;
根据所述语音信息中的声纹特征,确定所述声纹特征所属用户的用户权限;
判断所述用户权限是否满足执行所述指令内容所需的控制权限;
若是,则确定所述指令内容满足执行条件。
在一种实施方式中,所述根据所述指令内容显示所述待显示内容,可以包括:
提取所述指令内容的关键词,所述关键词包括与所述待显示内容相关的内容定位词;
根据所述内容定位词确定所述待显示内容的所在位置;
从所述待显示内容的所在位置获取并显示所述待显示内容。
在一种实施方式中,所述内容定位词包括所述待显示内容的所属应用、时间点、发件人或指定内容的一个或多个。
在一种实施方式中,所述根据所述指令内容显示所述待显示内容,可以包括:在预设时长内通过AOD状态显示所述待显示内容。
在一种实施方式中,所述方法还包括:通过调用状态寄存器存储的硬件状态信息来判断所述电子设备是否处于息屏状态。
请参阅图1,图中为本申请实施例提供的一种电子设备控制方法的实现流程。
如图1所示,该方法应用于如上实施例所述的电子设备,可以包括如下流程:
101、在所述电子设备处于息屏状态时,获取用户的语音信息。
其中,电子设备的息屏状态也可以理解为电子设备中的显示屏处于关闭状态或者是锁屏下的待机状态。
在一些实施例中,显示屏是否处于息屏状态,可以通过电子设备调用状态寄存器存储的硬件状态信息来判断,或者是通过其他可以确定显示屏状态的方式,如检测显示屏的驱动或者通过检测显示屏的工作电压等其他方式确定,在此不作限定。
其中,语音信息为包含用户说话声的音频信息,该用户的说话声可以包含特定的语句内容,该语音信息可以通过电子设备的麦克风获取。具体的,电子设备可以通过麦克风持续获取环境音,将环境音存入缓存并进行实时匹配。
102、提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容。
在一些实施例中,为了触发提取语音信息中的指令内容,可以设置前置唤醒词的语音指令来唤醒语音信息的提取功能。例如,将“小欧”作为唤醒词,当电子设备匹配到用户说出的语音里包含“小欧”时,则获取在“小欧”唤醒词后面的语音信息,并提取该语音信息中的指令内容,以方便后面的分析。
其中,指令内容可以是一些由用户的自然语言组成的语音指令,例如“显示发件人A的未读短信”。该语音指令则用于指示电子设备获取并显示发件人A的未读短信。
在一些实施例中,为了实现提取指令内容,可以将语音信息转化为电子设备可以理解的内容信息(例如文字信息),然后将该内容信息与预存的多个指令进行匹配,并仅将匹配成功的内容作为指令内容。当然,该指令可以是根据用户需要进行制定,本申请在此不作限定。
其中,待显示内容可以是电子设备自带的短信、彩信功能里的短信信息或者彩信信息,还可以是第三方应用程序中的即时消息、应用通知等。该待显示内容可以是文字、音频、视频或者是多种信息相互结合的多媒体形式。本申请不限定具体的待显示内容形式。
在一些实施例中,当提取到该指令内容后,可以根据指令内容生成用于触发执行显示待显示内容的动作触发信号,电子设备可以通过监测该动作触发信号来执行相应的动作。可以理解的,除了上述实施方式,该语音指令还可以采用其他方式指示电子设备执行显示待显示内容的动作。
103、判断所述指令内容是否满足执行条件。
在一些实施例中,判断指令内容是否满足执行条件,该执行条件可以是确定指令内容中的指令是否可定位到待显示内容,以保证该待显示内容可以被电子设备正确获取。当该指令内容中的指令可以准确定位到待显示内容时,可以确定该指令内容满足执行条件,反 之则确定该指令内容不满足执行条件。
例如,若存在语音信息的内容为“显示未读消息”。则通过提取该语音信息中的指令内容可得“显示”、“未读消息”。此时因为“未读消息”可能是电子设备的短信内容,也可能是某应用的未读内容,因此通过“未读消息”不能定位到用户需要显示哪条消息,以使得无法执行显示与指令内容相关的待显示内容的流程,由此可以根据该结论判断该指令内容不满足执行条件。
又例如,若指令内容为“显示最近一条未读短信”,则可以通过该指令内容定位到电子设备需要获取的待显示内容为“最近一条未读短信”,且该电子设备只包含唯一的短信模块,则根据该“最近一条未读短信”可以毫无疑义地确定需要显示的待显示内容为“最近一条未读短信”的内容。因此,通过该指令内容可以执行显示与指令内容相关的待显示内容的流程,由此可以根据该结论判断该指令内容满足执行条件。
在一些实施例中,判断指令内容中的指令是否可定位到待显示内容,可以通过调用电子设备中的名称数据库来进行匹配确定。该名称数据库中可以存储着应用名称、消息发件人名称等名称数据,当然还可以包括其他与消息获取位置相关的名称数据。
在匹配过程中,若指令内容中的指令可以与该名称数据库中的预存名称数据匹配,且满足一定的指令规则,可以说明该指令内容中的指令可以满足执行条件,反之则不满足执行条件。
例如,若指令内容为“显示A应用中发件人A的未读消息”,此时可以根据该指令内容提取到关键词为“A应用”、“发件人A”以及“未读消息”,若数据库中包含有上述关键词,且***判断通过上述关键词可以确定待显示内容的位置,则可以确定该指令内容中的指令可以满足执行条件。
但是,假设指令内容为“显示发件人A的未读消息”,此时若“应用A”以及“应用B”均包含该“发件人A”的未读消息,使得该消息的获取位置有至少两处,通过上述指令内容不能准确地定位待显示内容的获取位置,则可以确定该指令内容中的指令不能满足执行条件。
在一些实施例中,若该指令内容中的指令不能满足执行条件,则可以根据匹配结果,将缺少的位置信息(如应用名称、发件人名称等)向用户发送获取提示。例如,上述举例中若指令内容为“显示发件人A的未读消息”,且消息的获取位置因为所属应用的不同导致有至少两处,此时电子设备可以通过扬声器播放语音提示,或者是显示屏显示提示信息的形式,向用户展示“请确定消息所在的应用”来进一步确定该消息的准确位置,以提高信息获取的成功率以及准确率。
104、若是,则根据所述指令内容显示所述待显示内容。
在一些实施例中,可以根据该指令内容触发对待显示内容的获取指令,利用获取指令触发电子设备根据该指令内容中的关键词,定位到用户需要显示的待显示内容所在的内容界面,再通过显示该待显示内容所在的内容界面来对待显示内容进行显示。
一方面,可以通过用于匹配的名称数据库定位到该待显示内容的内容界面。具体的,名称数据库中的每个预存名称,均可以与应用中的相关信息位置进行关联。例如,名称数据库包含“短信发件人A”,则可以与短信程序中的“发件人A”的消息查看界面进行关联。若指令内容中存在该“发件人A”的关键词时,可以通过该数据库中的名称即可跳转至“发件人A”的消息查看界面。为了执行指令内容的内容,如“显示未读短信”,还可以通过在应用以及语音指令的识别模块之间上设立接口,通过该接口调出该应用在***上与该待显示内容的内容界面,并将该内容界面中的待显示内容进行显示。
另一方面,可以通过***中自带的搜索功能,搜索到该指令内容中的关键词后,再通过搜索功能中自带的跳转程序来跳转至该待显示内容的内容界面,并将该内容界面进行显 示。
当然,除了通过显示该待显示内容所在的内容界面来对待显示内容进行显示,还可以是从该内容界面中将需要显示的待显示内容进行提取,并将提取出的待显示内容进行显示。
由上可知,该电子设备控制方法可以在电子设备处于息屏状态下,提取语音信息中的指令内容,并判断指令内容是否满足执行条件,若是则根据指令内容显示与指令内容相关的待显示内容。本申请实施例可以在电子设备处于息屏状态下,通过用户的语音信息更加方便、直接地获取并显示用户所需显示的待显示内容,提升电子设备的操作效率。
如图2所示,图中示出了本申请实施例提供的电子设备控制方法的另一实现流程,包括以下实现流程:
201、在电子设备处于息屏状态时,获取用户的语音信息。
其中,电子设备的息屏状态也可以理解为电子设备中的显示屏处于关闭状态或者是锁屏下的待机状态。
在一些实施例中,显示屏是否处于息屏状态,可以通过电子设备调用状态寄存器存储的硬件状态信息来判断,或者是通过其他可以确定显示屏状态的方式,如检测显示屏的驱动或者通过检测显示屏的工作电压等其他方式确定,在此不作限定。
其中,语音信息为包含用户说话声的音频信息,该用户的说话声可以包含特定的语句内容,该语音信息可以通过电子设备的麦克风获取。具体的,电子设备可以通过麦克风持续获取环境音,将环境音存入缓存并进行实时匹配。
202、提取语音信息中的指令内容,所述指令内容用于指示电子设备显示与指令内容相关的待显示内容。
在一些实施例中,为了触发提取语音信息中的指令内容,可以设置前置唤醒词的语音指令来唤醒语音信息的提取功能。例如,将“小欧”作为唤醒词,当电子设备匹配到用户说出的语音里包含“小欧”时,则获取在“小欧”唤醒词后面的语音信息,并提取该语音信息中的指令内容,以方便后面的分析。
其中,指令内容可以是一些由用户的自然语言组成的语音指令,例如“显示发件人A的未读短信”。该语音指令则用于指示电子设备获取并显示发件人A的未读短信。
在一些实施例中,为了实现提取指令内容,可以将语音信息转化为电子设备可以理解的内容信息(例如文字信息),然后将该内容信息与预存的多个指令进行匹配,并仅将匹配成功的内容作为指令内容。当然,该指令可以是根据用户需要进行制定,本申请在此不作限定。
其中,待显示内容可以是电子设备自带的短信、彩信功能里的短信信息或者彩信信息,还可以是第三方应用程序中的即时消息、应用通知等。该待显示内容可以是文字、音频、视频或者是多种信息相互结合的多媒体形式。本申请不限定具体的待显示内容形式。
在一些实施例中,当提取到该指令内容后,可以根据指令内容生成用于触发执行显示待显示内容的动作触发信号,电子设备可以通过监测该动作触发信号来执行相应的动作。可以理解的,除了上述实施方式,该语音指令还可以采用其他方式指示电子设备执行显示待显示内容的动作。
203、提取所述语音信息中的声纹特征。
提取语音信息中的声纹特征,可以通过本领域技术人员所知的提取算法对语音信息中的声纹特征进行提取。该声纹特征可以包括宽带声纹、窄带声纹、振幅声纹、等高线声纹、时间波谱声纹、断面声纹等特征的一种或多种结合,在此不尽数列举。
204、判断声纹特征是否为预设用户的声纹特征。
其中,为了确定用户的身份,电子设备可以预先存储用户的声纹特征。
例如,电子设备可以预存有A用户以及B用户的声纹特征,当获得某用户的语音信息 的声纹特征后,可以将该声纹特征与电子设备中预存用户的声纹特征进行比对,以确定该用户是否是A用户或者B用户。
在一些实施例中,可以通过本领域技术人员所知的声纹特征比对算法来对获取到的声纹特征与预存用户的声纹特征进行处理、比对,以确定其是否匹配。若预存的用户有多个,可以采用权重打分或者采用匹配度的方式,来确定是否有预存用户的声纹特征与该获取到的声纹特征匹配。当然,还可以采用其他方式来确定获取到的声纹特征对应的用户是否为预设用户,本申请在此不作限定。
若某用户的声纹特征与预存的A用户或者B用户的声纹特征匹配,则确定该用户为预设用户,并继续执行该语音信息对应的指令。
若某用户的声纹特征与预存的A用户或者B用户的声纹特征均不匹配,则确定该用户不是预设用户,可以不响应后续的调整流程,以使得不符合要求的用户无法通过语音信息对该电子设备进行操作,提高电子设备的安全性。
在一些实施例中,为了增强电子设备的安全性,可以为用户的权限进行分类,并判断声纹特征对应的用户是否为预设类型的用户。例如,将A用户和B用户归为A类用户,C用户为B类用户,电子设备可以设定成只有在当声纹特征符合A类用户的情况下才能确定该声纹特征对应的用户为预设用户。
当然,还可以是其他分类方式,以提供多种不同的用户分类方案,用于区分不同类别的用户。
205、判断指令内容是否满足执行条件。
在一些实施例中,判断指令内容是否满足执行条件,该执行条件可以是确定指令内容中的指令是否可定位到待显示内容,以保证该待显示内容可以被电子设备正确获取。当该指令内容中的指令可以准确定位到待显示内容时,可以确定该指令内容满足执行条件,反之则确定该指令内容不满足执行条件。
在一些实施例中,判断指令内容中的指令是否可定位到待显示内容,可以通过调用电子设备中的名称数据库来进行匹配确定。该名称数据库中可以存储着应用名称、消息发件人名称等名称数据,当然还可以包括其他与消息获取位置相关的名称数据。
在匹配过程中,若指令内容中的指令可以与该名称数据库中的预存名称数据匹配,且满足一定的指令规则,可以说明该指令内容中的指令可以满足执行条件,反之则不满足执行条件。
在一些实施例中,若该指令内容中的指令不能满足执行条件,则可以根据匹配结果,将缺少的位置信息(如应用名称、发件人名称等)向用户发送获取提示。例如,上述举例中若指令内容为“显示发件人A的未读消息”,且消息的获取位置因为所属应用的不同导致有至少两处,此时电子设备可以通过扬声器播放语音提示,或者是显示屏显示提示信息的形式,向用户展示“请确定消息所在的应用”来进一步确定该消息的准确位置,以提高信息获取的成功率以及准确率。
206、根据指令内容显示待显示内容。
在一些实施例中,可以根据该指令内容触发对待显示内容的获取指令,利用获取指令触发电子设备根据该指令内容中的关键词,定位到用户需要显示的待显示内容所在的内容界面,再通过显示该待显示内容所在的内容界面来对待显示内容进行显示。
一方面,可以通过用于匹配的名称数据库定位到该待显示内容的内容界面。具体的,名称数据库中的每个预存名称,均可以与应用中的相关信息位置进行关联。
另一方面,可以通过***中自带的搜索功能,搜索到该指令内容中的关键词后,再通过搜索功能中自带的跳转程序来跳转至该待显示内容的内容界面,并将该内容界面进行显示。
当然,除了通过显示该待显示内容所在的内容界面来对待显示内容进行显示,还可以是从该内容界面中将需要显示的待显示内容进行提取,并将提取出的待显示内容进行显示。
在一些实施例中,在根据该指令内容获取并显示待显示内容之前,还可以是必须根据声纹识别的结果来决定是否执行该流程。
例如,若语音信息中的声纹特征所指向的用户为预设用户,则继续执行根据指令内容的内容获取并处理待显示内容的流程。
若语音信息中的声纹特征所指向的用户为非预设用户,可以确定该用户无权控制该电子设备,则直接退出根据指令内容的内容获取并处理待显示内容的流程,并且可对该消息进行上锁,避免向无权控制该电子设备的人泄露该消息。
由上可知,通过获取语音信息中的声纹特征,并根据声纹特征判断该声纹特征是否为预设用户的声纹特征,若是,则再继续执行判断指令内容是否满足执行条件的流程,可以避免让电子设备的非拥有者获取到拥有者的的消息,在有效提升语音信息控制过程中的信息安全性的前提下,不额外增加用户的操作步骤,同样方便、直接地获取并显示用户所需显示的待显示内容。
参见图3,图中示出了本申请实施例提供的判断指令内容是否满足执行条件的实现流程。
需要显示的内容可能有不同的重要程度,例如即时应用中的私密消息,以及被加密的文档、图像等,就是比较重要的内容;而一般的短信消息等,就是相对没那么重要的内容。
在一些实施例中,为了平衡不同重要程度的内容的安全性以及识别效率,当提取声纹特征后,判断指令内容是否满足执行条件,可以包括:
301、确定执行指令内容所需的控制权限,所述控制权限至少包括高或低;
每一指令内容所需要执行显示的对象,均可以设置一个控制权限,如高或者低。例如,将加密文件的控制权限设置成高,只有当用户的用户权限为高时才可以将该加密文件进行解锁并显示。
在一些实施例中,该控制权限可以在文件加密过程中进行设置,若用户对某文件进行加密,则可以将该文件的控制权限设置成高。若用户未对某文件进行加密,则可以将该文件的控制权限默认设置成低。
当然,还可以根据应用来进行设定,例如将个人微信中的消息的控制权限设置成高,只有当用户的用户权限为高时,才可以读取该个人微信中的消息。
可以理解的,除了上述设置方式,还可以根据实际情况对不同对象的控制权限进行设定,例如设置成“高”、“中”、“低”三个等级或更多等级,或者采用其他区分方式来确定不同内容的控制权限,以根据不同的控制权限来保护重要内容的信息安全,提高重要内容的安全性。
302、根据语音信息中的声纹特征,确定声纹特征所属用户的用户权限;
语音信息中的声纹特征,可以对应不同的用户权限。
在一些实施例中,该用户权限可以在录入该用户的声纹特征的时候进行设置,也可以是在录入完成用户的声纹特征以后,在电子设备的用户管理界面中进行设置,具体的实现方式可以根据实际情况而定,本申请在此不作限定。
303、判断用户权限是否满足执行指令内容所需的控制权限;若是,则确定指令内容满足执行条件。
在一些实施例中,当确定该声纹特征对应的用户后,可以将用户的用户权限与执行指令内容所需的控制权限进行匹配,若匹配则确定指令内容满足执行条件,反之则不满足。
例如,当执行指令内容所需的控制权限设置成“高”时,只有用户权限为“高”的用户才可以执行该指令内容,将待显示内容进行显示。当该指令内容所对应的待显示内容的 控制权限较低,也即执行指令内容所需的控制权限设置成“低”时,则用户的权限为“高”或者“低”都可以执行该指令内容。
由上可知,通过在待显示内容上设置不同的控制权限,并当获取到语音信息的指令内容后,将指令内容中指示所需显示的待显示内容的控制权限的高低,与用户的用户权限进行匹配,并只为匹配成功的用户显示该待显示内容,可以根据不同的控制权限来保护重要内容的信息安全,提高重要内容的安全性。
参见图4,图中示出了本申请实施例提供的显示待显示内容的实现流程。
该实现流程包括:
401、提取指令内容的关键词,所述关键词包括与待显示内容相关的内容定位词;
其中,内容定位词即用于定位待显示内容所在位置的词。
结合图5,图中示出了本申请实施例提供的电子设备控制方法的应用场景。
图5中示出了语音信息中的指令内容为“显示A应用中发件人A的未读消息”。通过上述指令内容可以提取到与待显示内容相关的内容定位词为:“A应用”、“发件人A”以及“未读消息”。该内容定位词用于确定该待显示内容的所在位置。
在一些实施例中,内容定位词可以包括待显示内容的所属应用、时间点、发件人或指定内容的一个或多个。
402、根据内容定位词确定待显示内容的所在位置;
结合图6,图中示出了本申请实施例提供的电子设备控制方法的另一应用场景。
如图6所示,在一些实施例中,根据“A应用”可以确定该待显示内容所属的应用为A应用,根据“发件人A”可以确定该待显示内容所属的应用为发件人A,然后“未读消息”可以确定该待显示内容为未读消息。
当上述内容定位词结合后,可以确定该指令内容的待显示内容位置为A应用中发件人A的未读消息,由此即可根据上述内容定位词定位到该待显示内容具体的所在位置。
在一些实施例中,待显示内容的所在位置,可以指的是该待显示内容的内容界面的所在位置,例如图6中的电子设备的内容界面。
在另一些实施例中,待显示内容的所在位置,还可以是该待显示内容对应的内容代码的所在位置。当获知该待显示内容对应的内容代码,电子设备可以获取该内容代码并以预设的方式对该内容代码进行展示。
403、从待显示内容的所在位置获取并显示待显示内容。
在一些实施例中,获取并显示该待显示内容,可以是获取并显示该待显示内容的内容界面。例如图6应用场景中,通过上述指令内容的内容定位词,可以首先打开该“A应用”,此时“A应用”中包含“发件人A”、“发件人B”以及“发件人C”等发件人的消息,此时通过“发件人A”以及“未读消息”的内容定位词,可以再次定位到发件人A的内容界面,该内容界面显示有待显示内容为“嘿,今晚要不一起去吃个饭?”的消息内容。当获取该内容界面后,可以对该内容界面进行显示。
在另一些实施例中,获取并显示该待显示内容,可以是获取并显示该待显示内容对应的内容代码。当电子设备获取到该内容代码后,可以用预设的方式对该内容代码进行展示。如在息屏界面上对“嘿,今晚要不一起去吃个饭?”进行显示。
由上可知,通过提取指令内容中的内容定位词,可以快速确定该待显示内容的所在位置,并根据该待显示内容的所在位置获取并显示带显示内容,可以进一步提高获取待显示内容的执行效率以及准确性,并进一步提高通过语音信息控制显示待显示内容的成功率。
在一些实施例中,根据指令内容显示所述待显示内容,包括:在预设时长内通过AOD状态显示待显示内容。
在AOD(Always On Display)模式中,该状态会通过在显示屏的黑色背景中长时间显 示文字、数字或者图案等内容,以通过上述常亮的内容提示用户一些常用的信息,例如当前时间、消息等。可以理解的,具体的显示内容以及显示方式可以根据实际情况而定,本申请在此不作限定。
通过AOD模式显示待显示内容,可以无需对电子设备解锁即可显示一定信息量的内容,可以保证设备的安全性,并起到节省电子设备电量的效果。
在一些实施例中,通过AOD模式在显示屏上显示待显示内容,可以设定一个预设的显示时长,并将该显示待显示内容在该显示时长中进行显示。该待显示内容可以只在该显示时长内进行显示,从而在用户看过该待显示内容后即关闭显示,以避免其他用户观察到该内容,以进一步提高待显示内容的保密性。
本实施例提供一种电子设备控制装置,应用于电子设备,所述装置可以包括:
信息获取模块,用于在所述电子设备处于息屏状态时,获取用户的语音信息。
第一提取模块,用于提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容。
第一判断模块,用于判断所述指令内容是否满足执行条件。
显示模块,用于若所述指令内容满足执行条件,则根据所述指令内容显示所述待显示内容。
在一种实施方式中,所述装置还可以包括:
第二提取模块,用于提取所述语音信息中的声纹特征。
第二判断模块,用于判断所述声纹特征是否为预设用户的声纹特征;若是,则执行判断所述指令内容是否满足执行条件的流程。
在一种实施方式中,所述显示模块可以包括:
提取子模块,用于提取所述指令内容的关键词,所述关键词包括与所述待显示内容相关的内容定位词。
确定子模块,用于根据所述内容定位词确定所述待显示内容的所在位置。
显示子模块,用于从所述待显示内容的所在位置获取并显示所述待显示内容。
在一种实施方式中,所述内容定位词包括所述待显示内容的所属应用、时间点、发件人或指定内容的一个或多个。
在一种实施方式中,所述第一判断模块可以用于:
确定执行所述指令内容所需的控制权限,所述控制权限至少包括高或低;
根据所述语音信息中的声纹特征,确定所述声纹特征所属用户的用户权限;
判断所述用户权限是否满足执行所述指令内容所需的控制权限;
若是,则确定所述指令内容满足执行条件。
在一种实施方式中,所述显示模块可以用于:
在预设时长内通过AOD状态显示所述待显示内容。
在一种实施方式中,所述信息获取模块还可以用于:
通过调用状态寄存器存储的硬件状态信息来判断所述电子设备是否处于息屏状态。
如图7所示,图中示出了本申请实施例提供的电子设备控制装置的结构,该电子设备控制装置500包括信息获取模块501、第一提取模块502、第一判断模块503以及显示模块504。
其中,信息获取模块501,用于在所述电子设备处于息屏状态时,获取用户的语音信息。
其中,电子设备的息屏状态也可以理解为电子设备中的显示屏处于关闭状态或者是锁屏下的待机状态。
在一些实施例中,显示屏是否处于息屏状态,可以通过电子设备调用状态寄存器存储 的硬件状态信息来判断,或者是通过其他可以确定显示屏状态的方式,如检测显示屏的驱动或者通过检测显示屏的工作电压等其他方式确定,在此不作限定。
其中,语音信息为包含用户说话声的音频信息,该用户的说话声可以包含特定的语句内容,该语音信息可以通过电子设备的麦克风获取。具体的,电子设备可以通过麦克风持续获取环境音,将环境音存入缓存并进行实时匹配。
第一提取模块502,用于提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容。
在一些实施例中,为了触发提取语音信息中的指令内容,可以设置前置唤醒词的语音指令来唤醒语音信息的提取功能。例如,将“小欧”作为唤醒词,当电子设备匹配到用户说出的语音里包含“小欧”时,则获取在“小欧”唤醒词后面的语音信息,并提取该语音信息中的指令内容,以方便后面的分析。
其中,指令内容可以是一些由用户的自然语言组成的语音指令,例如“显示发件人A的未读短信”。该语音指令则用于指示电子设备获取并显示发件人A的未读短信。
在一些实施例中,为了实现提取指令内容,可以将语音信息转化为电子设备可以理解的内容信息(例如文字信息),然后将该内容信息与预存的多个指令进行匹配,并仅将匹配成功的内容作为指令内容。当然,该指令可以是根据用户需要进行制定,本申请在此不作限定。
其中,待显示内容可以是电子设备自带的短信、彩信功能里的短信信息或者彩信信息,还可以是第三方应用程序中的即时消息、应用通知等。该待显示内容可以是文字、音频、视频或者是多种信息相互结合的多媒体形式。本申请不限定具体的待显示内容形式。
在一些实施例中,当提取到该指令内容后,可以根据指令内容生成用于触发执行显示待显示内容的动作触发信号,电子设备可以通过监测该动作触发信号来执行相应的动作。可以理解的,除了上述实施方式,该语音指令还可以采用其他方式指示电子设备执行显示待显示内容的动作。
第一判断模块503,用于判断所述指令内容是否满足执行条件。
在一些实施例中,判断指令内容是否满足执行条件,该执行条件可以是确定指令内容中的指令是否可定位到待显示内容,以保证该待显示内容可以被电子设备正确获取。当该指令内容中的指令可以准确定位到待显示内容时,可以确定该指令内容满足执行条件,反之则确定该指令内容不满足执行条件。
在一些实施例中,判断指令内容中的指令是否可定位到待显示内容,可以通过调用电子设备中的名称数据库来进行匹配确定。该名称数据库中可以存储着应用名称、消息发件人名称等名称数据,当然还可以包括其他与消息获取位置相关的名称数据。
在匹配过程中,若指令内容中的指令可以与该名称数据库中的预存名称数据匹配,且满足一定的指令规则,可以说明该指令内容中的指令可以满足执行条件,反之则不满足执行条件。
但是,假设指令内容为“显示发件人A的未读消息”,此时若“应用A”以及“应用B”均包含该“发件人A”的未读消息,使得该消息的获取位置有至少两处,通过上述指令内容不能准确地定位待显示内容的获取位置,则可以确定该指令内容中的指令不能满足执行条件。
在一些实施例中,若该指令内容中的指令不能满足执行条件,则可以根据匹配结果,将缺少的位置信息(如应用名称、发件人名称等)向用户发送获取提示。例如,上述举例中若指令内容为“显示发件人A的未读消息”,且消息的获取位置因为所属应用的不同导致有至少两处,此时电子设备可以通过扬声器播放语音提示,或者是显示屏显示提示信息的形式,向用户展示“请确定消息所在的应用”来进一步确定该消息的准确位置,以提高 信息获取的成功率以及准确率。
显示模块504,用于若所述指令内容满足执行条件,则根据所述指令内容显示所述待显示内容。
在一些实施例中,可以根据该指令内容触发对待显示内容的获取指令,利用获取指令触发电子设备根据该指令内容中的关键词,定位到用户需要显示的待显示内容所在的内容界面,再通过显示该待显示内容所在的内容界面来对待显示内容进行显示。
一方面,可以通过用于匹配的名称数据库定位到该待显示内容的内容界面。具体的,名称数据库中的每个预存名称,均可以与应用中的相关信息位置进行关联。例如,名称数据库包含“短信发件人A”,则可以与短信程序中的“发件人A”的消息查看界面进行关联。若指令内容中存在该“发件人A”的关键词时,可以通过该数据库中的名称即可跳转至“发件人A”的消息查看界面。为了执行指令内容的内容,如“显示未读短信”,还可以通过在应用以及语音指令的识别模块之间上设立接口,通过该接口调出该应用在***上与该待显示内容的内容界面,并将该内容界面中的待显示内容进行显示。
另一方面,可以通过***中自带的搜索功能,搜索到该指令内容中的关键词后,再通过搜索功能中自带的跳转程序来跳转至该待显示内容的内容界面,并将该内容界面进行显示。
当然,除了通过显示该待显示内容所在的内容界面来对待显示内容进行显示,还可以是从该内容界面中将需要显示的待显示内容进行提取,并将提取出的待显示内容进行显示。
由上可知,该电子设备控制装置可以在电子设备处于息屏状态下,提取语音信息中的指令内容,并判断指令内容是否满足执行条件,若是则根据指令内容显示与指令内容相关的待显示内容。本申请实施例可以在电子设备处于息屏状态下,通过用户的语音信息更加方便、直接地获取并显示用户所需显示的待显示内容,提升电子设备的操作效率。
参见图8,图中示出了本申请实施例提供的电子设备控制装置的另一结构,该电子设备控制装置500包括信息获取模块501、第一提取模块502、第一判断模块503以及显示模块504,还包括:第二提取模块505、第二判断模块506。
其中,第二提取模块505用于提取语音信息中的声纹特征。
提取语音信息中的声纹特征,可以通过本领域技术人员所知的提取算法对语音信息中的声纹特征进行提取。该声纹特征可以包括宽带声纹、窄带声纹、振幅声纹、等高线声纹、时间波谱声纹、断面声纹等特征等一种或多种结合,在此不尽数列举。
第二判断模块506,用于判断声纹特征是否为预设用户的声纹特征;若是,则执行判断指令内容是否满足执行条件的流程。
其中,为了确定用户的身份,电子设备可以预先存储用户的声纹特征。
在一些实施例中,可以通过本领域技术人员所知的声纹特征比对算法来对获取到的声纹特征与预存用户的声纹特征进行处理、比对,以确定其是否匹配。若预存的用户有多个,可以采用权重打分或者采用匹配度的方式,来确定是否有预存用户的声纹特征与该获取到的声纹特征匹配。当然,还可以采用其他方式来确定获取到的声纹特征对应的用户是否为预设用户,本申请在此不作限定。
若某用户的声纹特征与预存的A用户或者B用户的声纹特征匹配,则确定该用户为预设用户,并继续执行该语音信息对应的指令。
若某用户的声纹特征与预存的A用户或者B用户的声纹特征均不匹配,则确定该用户不是预设用户,可以不响应后续的调整流程,以使得不符合要求的用户无法通过语音信息对该电子设备进行操作,提高电子设备的安全性。
在一些实施例中,为了增强电子设备的安全性,可以为用户的权限进行分类,并判断声纹特征对应的用户是否为预设类型的用户。
当然,还可以是其他分类方式,以提供多种不同的用户分类方案,用于区分不同类别的用户。
由上可知,通过获取语音信息中的声纹特征,并根据声纹特征判断该声纹特征是否为预设用户的声纹特征,若是,则再继续执行判断指令内容是否满足执行条件的流程,可以避免让电子设备的非拥有者获取到拥有者的的消息,在有效提升语音信息控制过程中的信息安全性的前提下,不额外增加用户的操作步骤,同样方便、直接地获取并显示用户所需显示的待显示内容。
参见图9,图中示出了本申请实施例提供的显示模块的结构,所述显示模块504包括:提取子模块5041、确定子模块5042以及显示子模块5043。
其中,提取子模块5041,用于提取指令内容的关键词,所述关键词包括与待显示内容相关的内容定位词。
其中,内容定位词即用于定位待显示内容所在位置的词。
在一些实施例中,内容定位词可以包括待显示内容的所属应用、时间点、发件人或指定内容的一个或多个。
确定子模块5042,用于根据内容定位词确定待显示内容的所在位置。
在一些实施例中,待显示内容的所在位置,可以指的是该待显示内容的内容界面的所在位置,例如图6中的电子设备的内容界面。
在另一些实施例中,待显示内容的所在位置,还可以是该待显示内容对应的内容代码的所在位置。当获知该待显示内容对应的内容代码,电子设备可以获取该内容代码并以预设的方式对该内容代码进行展示。
显示子模块5043,用于从待显示内容的所在位置获取并显示待显示内容。
在一些实施例中,获取并显示该待显示内容,可以是获取并显示该待显示内容的内容界面。
在另一些实施例中,获取并显示该待显示内容,可以是获取并显示该待显示内容对应的内容代码。当电子设备获取到该内容代码后,可以用预设的方式对该内容代码进行展示。
由上可知,通过提取指令内容中的内容定位词,可以快速确定该待显示内容的所在位置,并根据该待显示内容的所在位置获取并显示带显示内容,可以进一步提高获取待显示内容的执行效率以及准确性,并进一步提高通过语音信息控制显示待显示内容的成功率。
本申请实施例中,所述电子设备控制装置与上文实施例中的一种电子设备控制方法属于同一构思,在所述电子设备控制装置上可以运行所述电子设备控制方法实施例中提供的任一方法,其具体实现过程详见所述电子设备控制方法实施例,并可以采用任意结合形成本申请的可选实施例,此处不再赘述。
在本申请又一实施例中还提供一种电子设备,该电子设备可以是智能手机、平板电脑等设备。如图10所示,电子设备600包括处理器601及存储器602。其中,处理器601与存储器602电性连接。
处理器601是电子设备600的控制中心,利用各种接口和线路连接整个电子设备的各个部分,通过运行或加载存储在存储器602内的计算机程序,以及调用存储在存储器602内的数据,执行电子设备的各种功能和处理数据,从而对电子设备进行整体监控。
在本实施例中,电子设备600中的处理器601会按照如下的步骤,将一个或一个以上的计算机程序的进程对应的指令加载到存储器602中,并由处理器601来运行存储在存储器602中的计算机程序,从而实现各种功能,如:
在所述电子设备处于息屏状态时,获取用户的语音信息;提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;判断所述指令内容是否满足执行条件;若是,则根据所述指令内容显示所述待显示内容。
在一些实施方式中,处理器601进一步可以执行以下流程:
提取所述语音信息中的声纹特征;判断所述声纹特征是否为预设用户的声纹特征;若是,则执行判断所述指令内容是否满足执行条件的流程。
在一些实施方式中,处理器601进一步可以执行以下流程:
确定执行所述指令内容所需的控制权限,所述控制权限至少包括高或低;根据所述语音信息中的声纹特征,确定所述声纹特征所属用户的用户权限;判断所述用户权限是否满足执行所述指令内容所需的控制权限;若是,则确定所述指令内容满足执行条件。
在一些实施方式中,处理器601进一步可以执行以下流程:
提取所述指令内容的关键词,所述关键词包括与所述待显示内容相关的内容定位词;根据所述内容定位词确定所述待显示内容的所在位置;从所述待显示内容的所在位置获取并显示所述待显示内容。
在一些实施方式中,处理器601进一步可以执行以下流程:
在预设时长内通过AOD状态显示所述待显示内容。
在一些实施方式中,处理器601可以执行以下流程:
通过调用状态寄存器存储的硬件状态信息来判断所述电子设备是否处于息屏状态。
存储器602可用于存储计算机程序和数据。存储器602存储的计算机程序中包含有可在处理器中执行的指令。计算机程序可以组成各种功能模块。处理器601通过运行存储在存储器602的计算机程序,从而执行各种功能计算机程序以及数据处理。例如:在所述电子设备处于息屏状态时,获取用户的语音信息;提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;判断所述指令内容是否满足执行条件;若是,则根据所述指令内容显示所述待显示内容。
在一些实施例中,如图11所示,电子设备600还包括:显示屏603、控制电路604、射频电路605、输入单元606、音频电路607、传感器608以及电源609。其中,处理器601分别与显示屏603、控制电路604、射频电路605、输入单元606、音频电路607、传感器608以及电源609电性连接。
显示屏603可用于显示由用户输入的信息或提供给用户的信息以及电子设备的各种图形用户接口,这些图形用户接口可以由图像、文本、图标、视频和其任意组合来构成。
控制电路604与显示屏603电性连接,用于控制显示屏603显示信息。
射频电路605用于收发射频信号,以通过无线通信与网络设备或其他电子设备建立无线通讯,与网络设备或其他电子设备之间收发信号。
输入单元606可用于接收输入的数字、字符信息或用户特征信息(例如指纹),以及产生与用户设置以及功能控制有关的键盘、鼠标、操作杆、光学或者轨迹球信号输入。其中,输入单元606可以包括指纹识别模组。
音频电路607可通过扬声器、传声器提供用户与电子设备之间的音频接口。
传感器608用于采集外部环境信息。传感器608可以包括环境亮度传感器、加速度传感器、光传感器、运动传感器、以及其他传感器。
电源609用于给电子设备600的各个部件供电。在一些实施例中,电源609可以通过电源管理***与处理器601逻辑相连,从而通过电源管理***实现管理充电、放电、以及功耗管理等功能。
尽管图11中未示出,电子设备600还可以包括摄像头、蓝牙模块等,在此不再赘述。
由上可知,本申请实施例提供的电子设备,可以在电子设备处于息屏状态下,提取语音信息中的指令内容,并判断指令内容是否满足执行条件,若是则根据指令内容显示与指令内容相关的待显示内容。本申请实施例可以在电子设备处于息屏状态下,通过用户的语音信息更加方便、直接地获取并显示用户所需显示的待显示内容,提升电子设备的操作效 率。
在一些实施例中,还提供了一种存储介质,该存储介质中存储有多条指令,该指令适于由处理器加载以执行上述任一电子设备控制方法,例如:
在所述电子设备处于息屏状态时,获取用户的语音信息;提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;判断所述指令内容是否满足执行条件;若是,则根据所述指令内容显示所述待显示内容。
本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取记忆体(RAM,Random Access Memory)、磁盘或光盘等。
在描述本申请的概念的过程中使用了术语“一”和“所述”以及类似的词语(尤其是在所附的权利要求书中),应该将这些术语解释为既涵盖单数又涵盖复数。此外,除非本文中另有说明,否则在本文中叙述数值范围时仅仅是通过快捷方法来指代属于相关范围的每个独立的值,而每个独立的值都并入本说明书中,就像这些值在本文中单独进行了陈述一样。另外,除非本文中另有指明或上下文有明确的相反提示,否则本文中所述的所有方法的步骤都可以按任何适当次序加以执行。本申请的改变并不限于描述的步骤顺序。除非另外主张,否则使用本文中所提供的任何以及所有实例或示例性语言(例如,“例如”)都仅仅为了更好地说明本申请的概念,而并非对本申请的概念的范围加以限制。在不脱离精神和范围的情况下,所属领域的技术人员将易于明白多种修改和适应。
以上对本申请实施例所提供的电子设备控制方法、装置、存储介质及电子设备进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (20)

  1. 一种电子设备控制方法,应用于电子设备,其中,所述方法包括:
    在所述电子设备处于息屏状态时,获取用户的语音信息;
    提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;
    判断所述指令内容是否满足执行条件;
    若是,则根据所述指令内容显示所述待显示内容。
  2. 如权利要求1所述的电子设备控制方法,其中,在所述判断所述指令内容是否满足执行条件之前,还包括:
    提取所述语音信息中的声纹特征;
    判断所述声纹特征是否为预设用户的声纹特征;
    若是,则执行判断所述指令内容是否满足执行条件。
  3. 如权利要求2所述的电子设备控制方法,其中,所述判断所述指令内容是否满足执行条件,包括:
    确定执行所述指令内容所需的控制权限,所述控制权限至少包括高或低;
    根据所述语音信息中的声纹特征,确定所述声纹特征所属用户的用户权限;
    判断所述用户权限是否满足执行所述指令内容所需的控制权限;
    若是,则确定所述指令内容满足执行条件。
  4. 如权利要求1所述的电子设备控制方法,其中,所述根据所述指令内容显示所述待显示内容,包括:
    提取所述指令内容的关键词,所述关键词包括与所述待显示内容相关的内容定位词;
    根据所述内容定位词确定所述待显示内容的所在位置;
    从所述待显示内容的所在位置获取并显示所述待显示内容。
  5. 如权利要求4所述的电子设备控制方法,其中,所述内容定位词包括所述待显示内容的所属应用、时间点、发件人或指定内容的一个或多个。
  6. 如权利要求1所述的电子设备控制方法,其中,所述根据所述指令内容显示所述待显示内容,包括:
    在预设时长内通过AOD状态显示所述待显示内容。
  7. 如权利要求1所述的电子设备控制方法,其中,所述方法还包括:
    通过调用状态寄存器存储的硬件状态信息来判断所述电子设备是否处于息屏状态。
  8. 一种电子设备控制装置,应用于电子设备,其中,所述装置包括:
    信息获取模块,用于在所述电子设备处于息屏状态时,获取用户的语音信息;
    第一提取模块,用于提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;
    第一判断模块,用于判断所述指令内容是否满足执行条件;以及
    显示模块,用于若所述指令内容满足执行条件,则根据所述指令内容显示所述待显示内容。
  9. 如权利要求8所述的电子设备控制装置,其中,所述装置还包括:
    第二提取模块,用于提取所述语音信息中的声纹特征;以及
    第二判断模块,用于判断所述声纹特征是否为预设用户的声纹特征;若是,则执行判断所述指令内容是否满足执行条件的流程。
  10. 如权利要求8所述的电子设备控制装置,其中,所述显示模块,包括:
    提取子模块,用于提取所述指令内容的关键词,所述关键词包括与所述待显示内容相关的内容定位词;
    确定子模块,用于根据所述内容定位词确定所述待显示内容的所在位置;
    显示子模块,用于从所述待显示内容的所在位置获取并显示所述待显示内容。
  11. 如权利要求8所述的电子设备控制装置,其中,所述第一判断模块用于:
    确定执行所述指令内容所需的控制权限,所述控制权限至少包括高或低;
    根据所述语音信息中的声纹特征,确定所述声纹特征所属用户的用户权限;
    判断所述用户权限是否满足执行所述指令内容所需的控制权限;
    若是,则确定所述指令内容满足执行条件。
  12. 如权利要求8所述的电子设备控制装置,其中,所述显示模块用于:
    在预设时长内通过AOD状态显示所述待显示内容。
  13. 一种存储介质,其中,所述存储介质中存储有计算机程序,当所述计算机程序在计算机上运行时,使得所述计算机执行权利要求1-7任意一项所述的电子设备控制方法。
  14. 一种电子设备,其中,所述电子设备包括处理器和存储器,所述存储器中存储有计算机程序,所述处理器通过调用所述存储器中存储的所述计算机程序,用于执行:
    在所述电子设备处于息屏状态时,获取用户的语音信息;
    提取所述语音信息中的指令内容,所述指令内容用于指示所述电子设备显示与所述指令内容相关的待显示内容;
    判断所述指令内容是否满足执行条件;
    若是,则根据所述指令内容显示所述待显示内容。
  15. 如权利要求14所述的电子设备,其中,所述处理器用于执行:
    提取所述语音信息中的声纹特征;
    判断所述声纹特征是否为预设用户的声纹特征;
    若是,则执行判断所述指令内容是否满足执行条件。
  16. 如权利要求15所述的电子设备,其中,所述处理器用于执行:
    确定执行所述指令内容所需的控制权限,所述控制权限至少包括高或低;
    根据所述语音信息中的声纹特征,确定所述声纹特征所属用户的用户权限;
    判断所述用户权限是否满足执行所述指令内容所需的控制权限;
    若是,则确定所述指令内容满足执行条件。
  17. 如权利要求14所述的电子设备,其中,所述处理器用于执行:
    提取所述指令内容的关键词,所述关键词包括与所述待显示内容相关的内容定位词;
    根据所述内容定位词确定所述待显示内容的所在位置;
    从所述待显示内容的所在位置获取并显示所述待显示内容。
  18. 如权利要求17所述的电子设备,其中,所述内容定位词包括所述待显示内容的所属应用、时间点、发件人或指定内容的一个或多个。
  19. 如权利要求14所述的电子设备,其中,所述处理器用于执行:
    在预设时长内通过AOD状态显示所述待显示内容。
  20. 如权利要求14所述的电子设备,其中,所述处理器用于执行:
    通过调用状态寄存器存储的硬件状态信息来判断所述电子设备是否处于息屏状态。
PCT/CN2019/085566 2018-05-30 2019-05-05 电子设备控制方法、装置、存储介质及电子设备 WO2019228141A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201810539561.7A CN108803988A (zh) 2018-05-30 2018-05-30 电子设备控制方法、装置、存储介质及电子设备
CN201810539561.7 2018-05-30

Publications (1)

Publication Number Publication Date
WO2019228141A1 true WO2019228141A1 (zh) 2019-12-05

Family

ID=64089490

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/085566 WO2019228141A1 (zh) 2018-05-30 2019-05-05 电子设备控制方法、装置、存储介质及电子设备

Country Status (2)

Country Link
CN (1) CN108803988A (zh)
WO (1) WO2019228141A1 (zh)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108803988A (zh) * 2018-05-30 2018-11-13 Oppo广东移动通信有限公司 电子设备控制方法、装置、存储介质及电子设备
CN109524013B (zh) * 2018-12-18 2022-07-22 北京猎户星空科技有限公司 一种语音处理方法、装置、介质和智能设备
CN111161722B (zh) * 2019-12-04 2023-08-29 深圳创维-Rgb电子有限公司 一种息屏画面显示方法、终端及存储介质
CN113641437B (zh) * 2021-08-16 2023-06-16 深圳技德智能科技研究院有限公司 一种Linux兼容Android的应用界面旋转方法及装置
CN116312513A (zh) * 2023-02-13 2023-06-23 陕西省君凯电子科技有限公司 一种智能语音控制***

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103730120A (zh) * 2013-12-27 2014-04-16 深圳市亚略特生物识别科技有限公司 电子设备的语音控制方法及***
CN107621918A (zh) * 2017-09-08 2018-01-23 维沃移动通信有限公司 息屏显示内容的设置方法及移动终端
CN108803988A (zh) * 2018-05-30 2018-11-13 Oppo广东移动通信有限公司 电子设备控制方法、装置、存储介质及电子设备

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106847284A (zh) * 2017-03-09 2017-06-13 深圳市八圈科技有限公司 电子设备、计算机可读存储介质及语音交互方法
CN106992012A (zh) * 2017-03-24 2017-07-28 联想(北京)有限公司 语音处理方法及电子设备
CN108021622A (zh) * 2017-11-21 2018-05-11 北京金山安全软件有限公司 一种信息确定方法、装置、电子设备及存储介质

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103730120A (zh) * 2013-12-27 2014-04-16 深圳市亚略特生物识别科技有限公司 电子设备的语音控制方法及***
CN107621918A (zh) * 2017-09-08 2018-01-23 维沃移动通信有限公司 息屏显示内容的设置方法及移动终端
CN108803988A (zh) * 2018-05-30 2018-11-13 Oppo广东移动通信有限公司 电子设备控制方法、装置、存储介质及电子设备

Also Published As

Publication number Publication date
CN108803988A (zh) 2018-11-13

Similar Documents

Publication Publication Date Title
WO2019228141A1 (zh) 电子设备控制方法、装置、存储介质及电子设备
WO2019096008A1 (zh) 身份识别方法、计算机设备及存储介质
US11604891B2 (en) Displaying sensitive content based on whether others are around user
US11269981B2 (en) Information displaying method for terminal device and terminal device
CN108847242B (zh) 电子设备控制方法、装置、存储介质及电子设备
US9372997B2 (en) Displaying private information on personal devices
US20120167170A1 (en) Method and apparatus for providing passive user identification
CN108877793B (zh) 应用控制方法、装置、存储介质及电子设备
US20230153520A1 (en) Message Display Method and Electronic Device
US11176228B2 (en) Application interface display method, apparatus, and terminal, and storage medium
CN111884908B (zh) 联系人标识显示方法、装置及电子设备
CN107145780B (zh) 恶意软件检测方法及装置
CN110414232B (zh) 恶意程序预警方法、装置、计算机设备及存储介质
CN108376096B (zh) 一种消息显示方法及移动终端
CN106548144B (zh) 一种虹膜信息的处理方法、装置及移动终端
US20160294823A1 (en) Displaying content based on device orientation
WO2016173453A1 (zh) 活体鉴别方法、信息生成方法和终端
WO2019007371A1 (zh) 一种防止信息被盗的方法、存储设备及移动终端
CN111142724A (zh) 一种显示控制方法及电子设备
WO2021109615A1 (zh) 一种信息获取方法、终端及计算机存储介质
WO2023024970A1 (zh) 信息处理方法、相关设备及可读存储介质
WO2019024646A1 (zh) 应用管控方法、装置及电子设备
US9648497B2 (en) Mobile terminal and login control method thereof
WO2017193645A1 (zh) 一种显示数据的方法、装置和终端
CN108762712A (zh) 电子设备控制方法、装置、存储介质及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19810660

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19810660

Country of ref document: EP

Kind code of ref document: A1