WO2022252872A1 - 设备控制方法、装置、电子设备及存储介质 - Google Patents

设备控制方法、装置、电子设备及存储介质 Download PDF

Info

Publication number
WO2022252872A1
WO2022252872A1 PCT/CN2022/088704 CN2022088704W WO2022252872A1 WO 2022252872 A1 WO2022252872 A1 WO 2022252872A1 CN 2022088704 W CN2022088704 W CN 2022088704W WO 2022252872 A1 WO2022252872 A1 WO 2022252872A1
Authority
WO
WIPO (PCT)
Prior art keywords
instruction
recommended
time period
content
electronic device
Prior art date
Application number
PCT/CN2022/088704
Other languages
English (en)
French (fr)
Inventor
池卓哲
沈志鹏
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2022252872A1 publication Critical patent/WO2022252872A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue

Definitions

  • the present application relates to the technical field of terminals, and more specifically, to a device control method, device, electronic device, and storage medium.
  • electronic devices are usually equipped with digital voice assistants to assist users in controlling the electronic devices.
  • the user can control the electronic device to start the application program he needs by voice.
  • the embodiments of the present application propose a device control method, device, electronic device, and storage medium, so as to improve the above problems.
  • the embodiment of the present application provides a device control method, which is applied to an electronic device, and the electronic device includes a digital voice assistant.
  • the method includes: displaying the instruction content of the recommended instruction; An operation is triggered to execute the recommended instruction through the digital voice assistant.
  • an embodiment of the present application provides a device control device, which runs on an electronic device, the electronic device includes a digital voice assistant, and the device includes: an instruction display unit for displaying the instruction content of the recommended instruction; A unit, configured to execute the recommended instruction through the digital voice assistant in response to a trigger operation acting on the instruction content.
  • the embodiment of the present application provides an electronic device, including one or more processors and a memory; one or more programs are stored in the memory and configured to be executed by the one or more processors Execute to implement the method described above.
  • the embodiment of the present application provides a computer-readable storage medium, where a program code is stored in the computer-readable storage medium, wherein the above-mentioned method is executed when the program code is executed by a processor.
  • FIG. 1 shows a flow chart of a device control method proposed by an embodiment of the present application
  • FIG. 2 shows a schematic diagram of displaying recommended instructions in an embodiment of the present application
  • FIG. 3 shows a schematic diagram of a display area displaying recommended instructions occupying a display position of an application icon in an embodiment of the present application
  • FIG. 4 shows another schematic diagram showing recommended instructions in the embodiment of the present application
  • FIG. 5 shows a schematic diagram of a triggering recommendation instruction in the embodiment of the present application
  • FIG. 6 shows a flow chart of a device control method proposed in another embodiment of the present application.
  • FIG. 7 shows a flowchart of an implementation of S210 in FIG. 6;
  • Figure 8 shows a schematic diagram of the corresponding date in the embodiment of the present application.
  • FIG. 9 shows a schematic diagram of recording the time period of the executed instruction and the location of the electronic device in the embodiment of the present application.
  • FIG. 10 shows a schematic diagram of determining a recommended instruction in an embodiment of the present application.
  • FIG. 11 shows a flow chart of a device control method proposed in another embodiment of the present application.
  • FIG. 12 shows another schematic diagram of determining a recommended instruction in the embodiment of the present application.
  • FIG. 13 shows a flow chart of a device control method proposed in another embodiment of the present application.
  • FIG. 14 shows a flow chart of a device control method proposed in another embodiment of the present application.
  • Fig. 15 shows a schematic diagram showing the execution instruction result of the digital voice assistant in the embodiment of the present application
  • FIG. 16 shows a schematic diagram of displaying speech recognition content in an embodiment of the present application.
  • FIG. 17 shows a schematic diagram of an interface displaying instruction execution results in an embodiment of the present application.
  • Figure 18 shows a schematic diagram of adding a card on the desktop in the embodiment of the present application.
  • Fig. 19 shows a schematic diagram of moving a card from the desktop to the negative screen in the embodiment of the present application
  • Fig. 20 shows a schematic diagram of moving a card from the negative screen to the desktop in the embodiment of the present application
  • Figure 21 shows a schematic diagram of removing the card from the desktop in the embodiment of the present application.
  • Fig. 22 shows a schematic diagram of removing a card from the negative screen in the embodiment of the present application
  • FIG. 23 shows a structural block diagram of an electronic device for executing a device control method according to an embodiment of the present application in real time in the present application
  • FIG. 24 shows a structural block diagram of an electronic device for executing a device control method according to an embodiment of the present application
  • Fig. 25 shows a storage unit used to store or carry program codes for implementing the device control method according to the embodiment of the present application in real time of the present application.
  • Voice assistants are increasingly used in electronic devices.
  • the user can first operate the electronic device to call out the voice assistant, and then trigger the voice assistant through voice input to control the electronic device after the voice assistant is called out.
  • the voice assistant can control the electronic device to start the installed music software.
  • related voice assistants require the user to operate the electronic device to call out the voice assistant first, and only after the voice assistant is called out can the voice command be input through the voice assistant, which will result in a longer interaction path with the user. Furthermore, in some scenarios, it may be inconvenient for the user to make a sound, so it is inconvenient for the user to use the voice assistant to control the electronic device.
  • the inventor proposed the device control method, device, electronic device and storage medium in the embodiment of the present application.
  • the electronic device will first display the instruction content of the recommended instruction, and then act on the instruction content in response
  • the trigger operation of the digital voice assistant executes the recommended instruction. Therefore, through the above-mentioned method, the electronic device can actively present the instruction content of the recommended instruction to the user, and can trigger the execution of the recommended instruction through the digital voice assistant through a trigger operation directly acting on the instruction content, so that the user can use it when it is inconvenient to speak.
  • Scenarios for example, in meeting scenarios or public places
  • the actual voice input operation of the user can be replaced by the trigger operation acting on the instruction content, so as to realize the execution of instructions through the digital voice assistant, thereby improving the digital voice assistant. user experience.
  • the method provided in this embodiment may further include the following process: Obtaining a recommended instruction based on historical control instructions corresponding to the current environmental parameters of the device.
  • the method provided in this embodiment may also include the following process: obtaining the historical time period corresponding to the current time period, and using the correspondingly executed control instructions in the historical time period as instructions to be processed; obtaining the same The number of times the pending instruction is executed in the corresponding historical time period; obtain the distance between the position of the same pending instruction and the current position each time it is executed in the corresponding historical time period, so as to obtain multiple reference distances; based on each pending instruction Corresponding to the number of times and the plurality of reference distances, a recommended instruction is determined from the pending instructions.
  • the method provided in this embodiment may further include the following process: obtaining a recommended value corresponding to each instruction to be processed, the recommended value being the ratio of the first value to the second value, and the first value is the product of the number of times and a reference value, and the second value is an average value of the plurality of reference distances; the pending instruction corresponding to the largest recommended value is used as the recommended instruction.
  • the method provided in this embodiment may further include the following process: obtaining the historical time period corresponding to the current time period; if there is an executed control instruction corresponding to the historical time period, the historical time
  • the control instruction corresponding to the execution in the segment is regarded as the pending instruction; if there is no corresponding executed control instruction in the historical time segment, the next historical time segment adjacent to the historical time segment corresponds to the executed control command.
  • the correspondingly executed control instruction is regarded as the instruction to be processed.
  • the environmental parameters of the device include at least one parameter of a time period and a location.
  • the method provided in this embodiment may further include the following process: performing speech content recognition in response to a trigger operation acting on the first control in the second area of the specified interface; executing the recognized speech content corresponding instructions.
  • the method provided in this embodiment may further include the following procedure: cancel displaying the instruction content of the recommendation instruction, and display the recognized voice content in the first area.
  • the specified interface includes a card interface displayed on the screen of the electronic device.
  • the method provided by this embodiment may further include the following process: determine the recommended instruction based on the current display scene of the device, wherein the current location is determined according to the application running in the foreground in the device. display scene.
  • the method provided in this embodiment may further include the following procedure: if there is no corresponding executed control instruction within the historical time period, then determine the recommended instruction based on the display scene where the device is located.
  • the method provided by this embodiment may further include the following process: if the time difference between the next time period adjacent to the historical time period corresponding to the execution of the control instruction and the historical time period is greater than When specifying the time difference, the recommended command is determined based on the display scene in which the device is located.
  • the method provided in this embodiment may further include the following process: displaying the instruction content of the recommended instruction in the display area of the desktop, where the display area is the same as the application icon in the desktop display area at the same level.
  • the method provided in this embodiment may further include the following process: displaying a pop-up window, and displaying the instruction content of the recommended instruction in the pop-up window.
  • the electronic device is configured with a switch control, and the switch control is used to control whether the electronic device obtains the recommended instruction and displays the instruction content of the recommended instruction.
  • the method provided in this embodiment may also include the following Process: If it is detected that the switch control representation is in the on state, determine the currently recommended instruction to be displayed, and display the instruction content of the currently required displayed recommended instruction in the pop-up window.
  • the method provided in this embodiment may further include the following process: if it is detected that the switch control representation is in an off state, stop determining the recommendation instruction.
  • the method provided in this embodiment may further include the following process: if it is detected that a physical button combination corresponding to the instruction content is pressed, determine that there is a touch operation acting on the instruction content.
  • FIG. 1 is a flow chart of a device control method proposed in an embodiment of the present application, which is applied to electronic devices. The method includes:
  • S110 Display the instruction content of the recommended instruction, where the recommended instruction is generated by the digital voice assistant.
  • the recommended instruction can be understood as a control instruction actively presented to the user by the electronic device, and the electronic device can be controlled by triggering the control instruction.
  • the electronic device may determine the recommendation instruction in multiple ways.
  • the electronic device may determine the currently recommended instruction to be displayed based on the historical control instruction. For example, the electronic device can infer the user's electronic device usage habit of the day or week based on the electronic device usage habit of the previous day or the previous week, and then determine which electronic device the user will control within a certain period of time to determine The corresponding recommended instruction to be displayed. For example, if the current day is the Saturday of the 18th week, the electronic device may infer the specific recommended instructions displayed by the electronic device on that day according to the control commands executed by the electronic device on the Saturday of the 17th week. For another example, if the current time is 10:15, the electronic device may infer the recommended instruction to be displayed at the current time based on the control instructions executed between 10:00 and 11:00 every day of the previous week.
  • the electronic device may determine the recommendation instruction based on the display scene where the electronic device is currently located. Wherein, the electronic device may determine the current display scene according to the application program running in the foreground in the electronic device.
  • the current display scene is a video playback scene; if the application program running in the foreground in the electronic device is a text content browsing program, then the current Scene is a text display scene.
  • the display position of the recommended instruction may also have multiple implementations.
  • the recommended instruction can be displayed in the display area 11 of the desktop 10 .
  • the "XX instruction" in the display area 11 can be understood as the instruction content of a recommended instruction.
  • the display area 11 may be a display area at the same level as the application icons on the desktop 10 .
  • the same level can be understood as that if the display area 11 is in contact with the display position of the application icon during the movement of the desktop, it will occupy the display position of the application icon.
  • the recommended instruction may also be displayed in a pop-up window 12 displayed in a floating manner.
  • the electronic device may display the pop-up window 12 and display the recommendation instruction in the pop-up window 12 when it is determined that display of the recommendation instruction is required.
  • the pop-up window 12 may block other content displayed by the electronic device.
  • the electronic device detects that there is a sliding operation on the pop-up window 12, the pop-up window 12 can be moved out along the sliding direction of the sliding operation.
  • the display area of an electronic device is a sliding operation on the pop-up window 12.
  • the sliding operation may include a pressing operation and a sliding phase continuous with the pressing operation, where the continuation of the pressing operation can be understood as the object performing the pressing operation directly starts to enter the sliding phase while maintaining contact with the screen.
  • the sliding operation acting on the pop-up window 12 can be understood as that the pressing operation included in the sliding operation directly acts on the pop-up window 12 .
  • timing for displaying the recommended instruction may be determined in various ways.
  • the display of the recommended instruction can be started in the display area .
  • a switch control may be configured in the electronic device, and the switch control is used to control whether the electronic device acquires the recommended instruction and displays the recommended instruction. In this way, if the electronic device detects that the switch control representation is in the on state, it will start to determine the recommended instructions that need to be displayed at present, and display the determined recommended instructions through a pop-up window. If the electronic device detects that the switch control representation is in an off state, it will stop determining the recommended instruction.
  • S120 Execute the recommended instruction by the digital voice assistant in response to a trigger operation acting on the instruction content.
  • the touch operation acting on the instruction content may include a click operation, a long press operation, or a double-tap operation, etc., acting on the instruction content.
  • the electronic device may execute the recommended instruction through the digital voice assistant.
  • the digital voice assistant can control the electronic device to display the interface 13 shown in the right image of FIG. 5 , and the detailed content of today's weather is displayed in the interface 13 .
  • a correspondence between physical button combinations and instruction content may be established. Then in this way, if it is detected that the physical button combination corresponding to the command content is pressed, it is determined that there is a touch operation acting on the command content.
  • the combination of physical keys is a combination of a power key and a volume up key, then it may be determined that a touch operation acting on the command content is detected when the power key and the volume up key are pressed together.
  • the combination of physical keys is a combination of a volume up key and a volume down key, then it may be determined that a touch operation acting on the instruction content is detected when the volume up key and the volume down key are both pressed together.
  • executing the recommended instruction by the digital voice assistant may be understood as executing the recommended instruction by the digital voice assistant.
  • the digital voice assistant can query the weather through the network, and then send the result of the query through the interface (for example, The interface 13) in Fig. 5 is displayed.
  • S110 and S120 can be executed by the digital voice assistant itself, so in this way, the digital voice assistant can display the recommended instructions and also be responsible for detecting whether there is an action on the instruction content. Trigger operation, and then execute the recommended instruction directly after the recommended instruction is triggered. Furthermore, S110 and S120 can be performed by modules other than the digital voice assistant in the electronic device. In this way, when the recommended instruction needs to be executed by the digital voice assistant, the recommended instruction can be transmitted to the digital voice assistant. , so that the digital voice assistant can execute the recommended instruction.
  • the device control method provided in this embodiment first displays the instruction content of the recommended instruction, and then executes the recommended instruction through the digital voice assistant in response to a trigger operation acting on the instruction content. Therefore, through the above-mentioned method, the electronic device can actively present the instruction content of the recommended instruction to the user, and can trigger the execution of the recommended instruction through the digital voice assistant through a trigger operation directly acting on the instruction content, so that the user can use it when it is inconvenient to speak.
  • the user's actual voice input operation can be replaced by the trigger operation acting on the instruction content, so as to realize the execution of the instruction through the digital voice assistant, thereby improving the user experience of the digital voice assistant.
  • FIG. 6 is a flow chart of a device control method proposed in an embodiment of the present application. The method includes:
  • S210 Obtain a recommended instruction based on historical control instructions corresponding to the current environmental parameters of the device, and the recommended instruction is generated by the digital voice assistant.
  • the electronic device when the electronic device executes the control instruction, it may record the environment when the control instruction is executed, so as to obtain the environmental parameters of the device corresponding to the control instruction. That is to say, the parameter of the environment in which the device is located can be used to record the environment in which the instruction is executed.
  • the environmental parameters of the device may include at least one parameter of a time period and a location. Wherein, the time period represents the time period when the control instruction is executed, and the location represents the position of the electronic device when the control instruction is executed.
  • the environmental parameters of the device include a time period
  • the recommended instructions are obtained based on the historical control instructions corresponding to the current environmental parameters of the device, including:
  • S211 Obtain a historical time period corresponding to the current time period, and use a correspondingly executed control instruction within the historical time period as an instruction to be processed.
  • the time period in the embodiment of the present application may be a time period obtained by dividing the time of the same day.
  • the time of a day can be divided with an interval of 1 hour, then 23 time periods can be obtained, and the length of each time period is 1 hour.
  • the time of a day can also be divided with an interval of 15 minutes, and 96 time periods can be obtained, and the length of each time period is 15 minutes.
  • the user may have the same operation habit at the same time period on different days.
  • a user may use an electronic device to open a food delivery application to order food between 11:00 and 12:00 every day on weekdays, which means that the electronic device will execute once every day between 11:00 and 12:00 on weekdays.
  • Control commands to control the food delivery app Then, by obtaining the historical time period corresponding to the current time period, the electronic device can obtain the control instructions executed in the historical time period, and then infer the current time period based on the control instructions executed in the historical time period. The control instruction that the user most likely needs to execute in the segment.
  • the same time period in the date corresponding to the previous time period on the date where the current time period is located may be used as the corresponding historical time period.
  • the date whose corresponding sorting position is the same in the time period is the corresponding date.
  • the time period of one week is used as the time period, and the seven dates from the 3rd to the 9th are included in the previous time period.
  • the current time period is the time period in the 12th
  • the current The date of the time period is the 12th
  • the sorting of the 12th in the current time period is the third day
  • the 12th corresponds to the date in the previous time period, that is, it is also sorted in the previous time period The 5th of the third day.
  • the current time period is the time period from 11:00 to 11:15
  • the historical time period corresponding to the current time period is the time period from 11:00 to 11:15 on the 5th.
  • the current time period is the time period in the 16th
  • the date of the current time period is the 16th
  • the sorting of the 16th in the current time cycle is the seventh day
  • the 16th corresponds to the previous
  • the date in the time period is the 9th that is also sorted on the seventh day in the previous time period. If the current time period is the time period from 11:00 to 12:00, then the historical time period corresponding to the current time period is the time period from 11:00 to 12:00 on the 9th.
  • the executed control instructions recorded in chronological order within the historical time period include instruction A, instruction B, instruction A, instruction C, and instruction A. Then, in this historical time period, instruction A executed 3 words, instruction B executed 1 word, and instruction C executed 1 time.
  • S213 Obtain the distance between the current position and the position when the same instruction to be processed is executed each time within the corresponding historical time period, so as to obtain multiple reference distances.
  • control instructions commanded by the electronic device may be more work-related commands, for example, start a food delivery application program, or start an information inquiry program, or start a taxi hailing program, etc.
  • control instructions executed by the electronic device may be more life-related instructions, for example, starting a shopping application program, querying the weather, and so on. Therefore, by recording the position of the control instruction when it is executed, it is beneficial to more accurately determine the recommended instruction required by the user at a certain moment or within a time period.
  • the electronic device when the control command is commanded, in addition to recording the time (or time period) when the control command is executed, the electronic device can also record the time when the control command is commanded.
  • the execution time and execution location of the control instructions executed by the electronic device every day may be recorded (namely, location 1 and location 2 in the figure).
  • the record of control instructions is carried out with 7 days as a time period, for example, in one day of the time period shown in the figure, the executed control instructions include instruction A, instruction B, instruction C and instruction D .
  • the location of the electronic device when instruction A is executed includes location 1 .
  • S214 Determine recommended instructions from the pending instructions based on the number of times corresponding to each pending instruction and the plurality of reference distances.
  • the determining the recommended instruction from the pending instructions based on the number of times corresponding to each pending instruction and the plurality of reference distances includes:
  • the recommended value is a ratio of a first value to a second value
  • the first value is a product of the number of times and a reference value
  • the second value is the multiple mean of the reference distances.
  • the reference value can be configured according to actual needs, for example, the reference value can be configured as 1000.
  • the pending instruction corresponding to the largest recommended value is used as the recommended instruction.
  • one week is taken as a time period. Then it means that in the process of determining the recommended instruction for a certain date in the current time period, it will be determined based on the date corresponding to the date in the previous time period. For example, if the current time period is the time period on the 13th of the current time period, then the 13th corresponds to the date of the 6th in the previous time period. Among them, the electronic device will divide the same date into N time periods, if the current time period is the second time period on the 13th, then the historical time period corresponding to the second time period on the 13th is the time period on the 6th second time period. Among them, the control instructions executed in the second time period of No.
  • instruction A include instruction A, instruction B, and instruction D, wherein, the number of executions of instruction A is 3 times, the number of executions of instruction B is 2 times, and instruction D The number of executions is 1 time.
  • the locations corresponding to instruction A during the three executions are respectively location 1, location 2, and location 3.
  • the corresponding positions of instruction B during the two executions are site 2 and site 3 respectively.
  • the location corresponding to instruction D in one execution process is location 2.
  • the recommended values corresponding to instruction B and instruction D can be calculated based on the same method, and if the corresponding recommended value with the largest value is instruction A, then instruction A will be used as the recommended instruction. Furthermore, the electronic device will use instruction A as the recommended instruction at the beginning of the second time period on the 13th.
  • S220 Display the instruction content of the recommended instruction.
  • This embodiment provides a device control method, so that the electronic device can actively present the instruction content of the recommended instruction to the user through the above method, and can trigger the execution of the recommendation through the digital voice assistant by directly acting on the trigger operation of the instruction content Instructions, so that the user can replace the user's actual voice input operation with the trigger operation acting on the instruction content in the scene where it is inconvenient to speak, so as to realize the execution of instructions through the digital voice assistant, thereby improving the digital voice assistant. user experience.
  • the current environment parameters of the device can also be combined, and then the recommended instructions for display can be obtained from the historical control instructions corresponding to the current environment parameters of the device, so that the recommended instructions can be more suitable
  • the usage habit of the user of the electronic device improves the intelligence of the electronic device to determine the recommended instruction, and also enables the user to control the electronic device more conveniently.
  • FIG. 11 is a flow chart of a device control method proposed in an embodiment of the present application. The method includes:
  • the user may not use the electronic device during some period of time, and the electronic device may not execute the control instruction during this period of time. Then, in order to make it possible to recommend the instructions required by the user with a greater probability in each time period, the current control instruction can be determined based on the control instruction executed in the next historical time period corresponding to the executed control instruction adjacent to the historical time period. control commands during the time period.
  • the historical time period corresponding to the second time period of the day is the second time period of the corresponding date. time period, then if there is no control command executed in the second time period of the corresponding date, the query will start from the next time period adjacent to the second time period of the corresponding date until the corresponding control command is queried.
  • the execution time period of is used as the next historical time period corresponding to the execution of the control instruction. For example, if the historical time period corresponding to the current time period is the second time period in the corresponding date, then the historical time period corresponding to the execution of the control instruction will be queried from the third time period adjacent to the second time period. If a control command is executed in the third time period of the corresponding date directly, the third time period will be taken as the next adjacent historical time period corresponding to the executed control command.
  • S340 Obtain the number of execution times of the same instruction to be processed within the corresponding historical time period.
  • S350 Obtain the distance between the current position and the position when the same instruction to be processed is executed each time within the corresponding historical time period, so as to obtain multiple reference distances.
  • S360 Based on the number of times corresponding to each instruction to be processed and the plurality of reference distances, determine a recommended instruction from the instructions to be processed, where the recommended instruction is generated by a digital voice assistant.
  • the determined recommended instruction may be instruction C.
  • This embodiment provides a device control method, so that the electronic device can actively present the instruction content of the recommended instruction to the user through the above method, and can trigger the execution of the recommendation through the digital voice assistant by directly acting on the trigger operation of the instruction content Instructions, so that the user can replace the user's actual voice input operation with the trigger operation acting on the instruction content in the scene where it is inconvenient to speak, so as to realize the execution of instructions through the digital voice assistant, thereby improving the digital voice assistant. user experience.
  • the corresponding historical time period adjacent The next control instruction corresponding to the historical time period of the executed control instruction is used as the pending instruction, which is beneficial to enable the electronic device to display the recommended instruction in each time period, and improves the integrity of the recommended instruction display.
  • FIG. 13 is a flow chart of a device control method proposed in an embodiment of the present application. The method includes:
  • S410 Determine a recommended instruction based on a display scene where the electronic device is located, where the recommended instruction is generated by a digital voice assistant.
  • the current control of the electronic device by the user may be related to the display scene in which the electronic device is currently located. For example, if the electronic device is currently running an application program related to travel, the user may inquire about the weather in a certain place, or inquire whether there is a bus ticket to a certain place. Furthermore, when the electronic device detects that it is currently in a travel content display scene, the determined recommendation instruction may be "inquire about the weather of XX" or "inquire about the train ticket to XX".
  • S430 Execute the recommended instruction by the digital voice assistant in response to a trigger operation acting on the instruction content.
  • the current time period is the tenth time period of the day
  • the historical time period corresponding to the tenth time period is the tenth time period in the corresponding date of the day
  • the recommended instruction may be determined based on the display scene where the electronic device is located.
  • the next adjacent historical time period will correspond to the execution of the control command.
  • the control instructions within the execution time period are regarded as pending instructions.
  • the time gap between the next adjacent time period and the historical time period is relatively large, there may be a certain gap between the displayed recommended instruction and the actual demand of the user.
  • the time period of the historical time period is the time period from 7:00 to 7:15
  • the next adjacent time period in which the control instruction is executed is the time period from 17:00 to 17:15 .
  • the time difference can be configured by the user, for example, it can be 1 hour or 2 hours.
  • This embodiment provides a device control method, so that the electronic device can actively present the instruction content of the recommended instruction to the user through the above method, and can trigger the execution of the recommendation through the digital voice assistant by directly acting on the trigger operation of the instruction content Instructions, so that the user can replace the user's actual voice input operation with the trigger operation acting on the instruction content in the scene where it is inconvenient to speak, so as to realize the execution of instructions through the digital voice assistant, thereby improving the digital voice assistant. user experience.
  • the recommended instruction can be determined according to the display scene where the electronic device is located, which is beneficial for the displayed recommended instruction to better match the current usage of the electronic device, so as to increase the probability of the recommended instruction being triggered. This will increase the use of digital voice assistants.
  • FIG. 14 is a flow chart of a device control method proposed in an embodiment of the present application. The method includes:
  • S510 Display the instruction content of the recommended instruction in the first area of the designated interface, where the recommended instruction is generated by the digital voice assistant.
  • the specified interface includes an interface of a card displayed on the screen of the electronic device. Then in this way, please refer to FIG. 2 again, the display area 11 shown in FIG. 2 can be the interface of the card.
  • S520 Execute the recommended instruction by the digital voice assistant in response to a trigger operation acting on the instruction content.
  • S530 Perform speech content recognition in response to a trigger operation acting on the first control in the second area of the designated interface.
  • the first control can be provided as an input interface in the specified interface, so that the user can It is convenient to input other control commands by voice.
  • the instruction content "XX instruction" of the recommended instruction is displayed in the first area of the card 20, and the first Control 21, if it is detected that there is a trigger operation acting on the first control 21, the electronic device can start to collect voice content, and perform voice content recognition on the collected voice. For example, if the recognized voice content is "Saturday's weather", then the digital voice assistant will start to inquire about the weather on Saturday, and display the inquired content through the interface 13 . In this way, the two entrances of text instruction (the instruction content of the recommended instruction is displayed in the form of text) and voice interaction (voice recognition content) complement each other, and the voice instruction card (for example, card 20) is improved. The usage rate of digital voice assistants has also increased.
  • the display of the instruction content of the recommendation instruction is cancelled, and the recognized voice content is displayed in the first area.
  • the speech recognition content “how's the weather on Saturday” may be displayed in the first area of the card 21 in the middle image of FIG.
  • the directive content of the directive may be displayed in the first area of the card 21 in the middle image of FIG.
  • the digital voice assistant can also display the second control during the process of executing the recommended instruction or the instruction corresponding to the recognized voice content, so that after detecting the trigger operation acting on the second control, the voice can continue Recognition of content, and execution of instructions corresponding to the recognized voice content.
  • the control 30 is the aforementioned second control. If a trigger operation acting on the control 30 is detected, the recognition of the voice content can be continued, and the command corresponding to the recognized voice content can be executed. .
  • the recommendation instruction may be displayed in the form of a card (for example, the aforementioned card 20).
  • the card displaying the recommended instruction can be added through the desktop editing mode.
  • the left image of Figure 18 shows the style of entering the desktop editing mode.
  • a control named "Add Card” is displayed on the desktop.
  • the electronic device can display the style shown in the middle image of Figure 18, and the middle image of Figure 18 shows the types of cards that can be added to the desktop .
  • the electronic device will display the pattern shown in the right image of Figure 18, in which it will display An interface for displaying the selected card on the desktop, and controls for further operations, the controls for further operations include a control named "Cancel” and a control named "Add”. If it is detected that there is a control named "Add”, then the electronic device will add a card corresponding to the voice assistant (for example, the aforementioned card 20 ) on the desktop.
  • the voice assistant for example, the aforementioned card 20
  • the cards added to the desktop can be moved to the negative screen of the electronic device by dragging for placement.
  • the card 20 can be dragged along the direction shown by the dotted arrow in the left image of FIG. 19 , and the card 20 is moved to the position shown in the middle image of FIG. 19 .
  • the electronic device will switch the interface until it switches to the interface 40 shown in the right side of FIG. 19 .
  • the card that is dragged to one screen negative can also be moved to the interface for storing application icons again.
  • the card 20 that is one screen negative can be dragged along the direction indicated by the dotted arrow shown in the left image in FIG. 20 , and dragged to the middle image in FIG. 20 In the position shown, after the card 20 remains at the position shown in the middle image in FIG. Store the application icon), after the electronic device displays the desktop 10, you can continue to drag the card 20 and move to the desired position in the desktop 10 for placement, thereby realizing dragging the card 20 from the negative screen to the desktop 10 for placement.
  • the displayed card for displaying the recommended instruction may also be removed from the desktop or the negative screen.
  • a floating interface may be triggered by long pressing the card, and a control for removing the card is displayed in the floating interface.
  • a floating interface 41 may be displayed, and a name named "remove " control, if it is detected that there is a touch operation on the control named "Remove", then the card 20 will be removed from the desktop 10 .
  • FIG. 21 in the case where the card 20 is displayed on the desktop 10 if an operation of long pressing the card 20 is detected, a floating interface 41 may be displayed, and a name named "remove " control, if it is detected that there is a touch operation on the control named "Remove", then the card 20 will be removed from the desktop 10 .
  • FIG. 21 in the case where the card 20 is displayed on the desktop 10 if an operation of long pressing the card 20 is detected, a floating interface 41 may be displayed, and a name named "remove " control, if it is detected that
  • This embodiment provides a device control method, so that the electronic device can actively present the instruction content of the recommended instruction to the user through the above method, and can trigger the execution of the recommendation through the digital voice assistant by directly acting on the trigger operation of the instruction content Instructions, so that the user can replace the user's actual voice input operation with the trigger operation acting on the instruction content in the scene where it is inconvenient to speak, so as to realize the execution of instructions through the digital voice assistant, thereby improving the digital voice assistant. user experience.
  • the first control in addition to displaying the instruction content of the recommended instruction, the first control will also be displayed in the second area of the specified interface, so that the user can also use the first control to trigger voice content recognition, so that electronic
  • the device can simultaneously provide instruction triggering methods for recommending instructions and receiving user input, which is conducive to improving the utilization rate of digital voice assistants.
  • FIG. 23 is a structural block diagram of an equipment control device proposed in an embodiment of the present application.
  • the device includes:
  • the instruction display unit 510 is configured to display the instruction content of the recommended instruction, the recommended instruction is generated by the digital voice assistant.
  • the instruction execution unit 520 is configured to execute the recommendation instruction through the digital voice assistant in response to a trigger operation acting on the instruction content.
  • the instruction display unit 510 is further configured to obtain recommended instructions based on historical control instructions corresponding to current environmental parameters of the device.
  • the environmental parameters of the device include a time period
  • the instruction display unit 510 is specifically configured to obtain the historical time period corresponding to the current time period, and take the correspondingly executed control instructions within the historical time period as pending instruction; obtain the number of executions of the same pending instruction in the corresponding historical time period; obtain the distance between the position of the same pending instruction and the current position each time it is executed in the corresponding historical time period, so as to obtain multiple reference distances; based on each The number of times corresponding to each instruction to be processed and the plurality of reference distances, and the recommended instruction is determined from the instructions to be processed.
  • the instruction display unit 510 is specifically configured to obtain a recommended value corresponding to each instruction to be processed, the recommended value is a ratio of a first value to a second value, and the first value is the number of times to a reference value The product of the second value is the mean value of the multiple reference distances; the pending instruction with the largest corresponding recommended value is used as the recommended instruction.
  • the instruction display unit 510 is specifically configured to acquire the historical time period corresponding to the current time period; if the historical time period corresponds to an executed control instruction, display the corresponding executed control instruction in the historical time period As an instruction to be processed; if there is no corresponding executed control instruction in the historical time period, the corresponding executed control instruction in the historical time period corresponding to the next executed control instruction adjacent to the historical time period is used as the pending Processing instructions.
  • the environmental parameters of the device include at least one parameter of a time period and a location.
  • the instruction display unit 510 is specifically configured to display the instruction content of the recommended instruction in the first area of the designated interface.
  • the instruction executing unit 520 is further specifically configured to perform voice content recognition in response to a trigger operation acting on the first control in the second area of the designated interface; and execute the command corresponding to the recognized voice content.
  • the instruction display unit 510 is further specifically configured to cancel displaying the instruction content of the recommended instruction before executing the instruction corresponding to the recognized voice content, and display the recognized voice content in the first area middle.
  • the specified interface may include an interface of a card displayed on the screen of the electronic device.
  • the instruction display unit 510 is further configured to determine the recommended instruction based on the current display scene of the device, wherein the current display scene is determined according to the application running in the foreground in the device.
  • the instruction display unit 510 is further configured to determine a recommended instruction based on a display scene where the device is located if there is no corresponding executed control instruction within the historical time period.
  • the instruction display unit 510 is further configured to: if the time difference between the next time period adjacent to the historical time period corresponding to the execution of the control instruction and the historical time period is greater than the specified time difference, based on The display scene in which the device is located determines the recommended instruction.
  • the instruction display unit 510 is further configured to display the instruction content of the recommended instruction in a display area of the desktop, wherein the display area is a display area at the same level as the application icons in the desktop.
  • the instruction display unit 510 is further configured to display a pop-up window, and display the instruction content of the recommended instruction in the pop-up window.
  • the instruction display unit 510 is further configured to determine the currently recommended instruction to be displayed after detecting that the switch control representation is in an on state, and display the currently required displayed recommended instruction in the pop-up window content of the command.
  • the instruction display unit 510 is further configured to stop determining the recommended instruction after detecting that the switch control symbol is in an off state.
  • the instruction display unit 510 is further configured to determine that there is a touch operation on the instruction content if it is detected that the physical button combination corresponding to the instruction content is pressed.
  • the device control device provided in the present application will firstly display the instruction content of the recommended instruction, and then execute the recommended instruction through the digital voice assistant in response to a trigger operation acting on the instruction content. Therefore, through the above-mentioned method, the electronic device can actively present the instruction content of the recommended instruction to the user, and can trigger the execution of the recommended instruction through the digital voice assistant through a trigger operation directly acting on the instruction content, so that the user can use it when it is inconvenient to speak.
  • the user's actual voice input operation can be replaced by the trigger operation acting on the instruction content, so as to realize the execution of the instruction through the digital voice assistant, thereby improving the user experience of the digital voice assistant.
  • the embodiment of the present application also provides another electronic device 200 that can implement the aforementioned device control method.
  • the electronic device 200 includes one or more (only one is shown in the figure) processors 102 , memory 104 and network module 106 coupled to each other.
  • the memory 104 stores programs capable of executing the contents of the foregoing embodiments, and the processor 102 can execute the programs stored in the memory 104 .
  • the processor 102 may include one or more processing cores.
  • the processor 102 uses various interfaces and lines to connect various parts of the entire electronic device 200, and executes or executes instructions, programs, code sets or instruction sets stored in the memory 104, and calls data stored in the memory 104 to execute Various functions of the electronic device 200 and processing data.
  • the processor 102 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware.
  • DSP Digital Signal Processing
  • FPGA Field-Programmable Gate Array
  • PLA Programmable Logic Array
  • the processor 102 may integrate one or a combination of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a modem, and the like.
  • CPU Central Processing Unit
  • GPU Graphics Processing Unit
  • the CPU mainly handles the operating system, user interface and application programs, etc.
  • the GPU is used to render and draw the displayed content
  • the modem is used to handle wireless communication. It can be understood that the above modem may also not be integrated into the processor 102, but implemented by a communication chip alone.
  • the memory 104 may include random access memory (Random Access Memory, RAM), and may also include read-only memory (Read-Only Memory). Memory 104 may be used to store instructions, programs, codes, sets of codes, or sets of instructions.
  • the memory 104 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.) , instructions for implementing the following method embodiments, and the like.
  • device control means may be stored in the memory 104 .
  • the device controlled by the device may be the aforementioned device 500 .
  • the storage data area can also store data created by the terminal 100 during use (such as phonebook, audio and video data, chat record data) and the like.
  • the network module 106 is used to receive and send electromagnetic waves, realize mutual conversion between electromagnetic waves and electrical signals, and communicate with communication networks or other devices, such as audio playback devices.
  • the network module 106 may include various existing circuit elements for performing these functions, such as antennas, radio frequency transceivers, digital signal processors, encryption/decryption chips, Subscriber Identity Module (SIM) cards, memory, etc. .
  • SIM Subscriber Identity Module
  • the network module 106 can communicate with various networks such as the Internet, intranet, wireless network or communicate with other devices through the wireless network.
  • the wireless network mentioned above may include a cellular telephone network, a wireless local area network or a metropolitan area network.
  • the network module 106 can perform information exchange with the base station.
  • the sensor module 108 may include at least one sensor.
  • the sensor module 108 may include, but is not limited to: a light sensor, a motion sensor, a pressure sensor, an infrared heat sensor, a distance sensor, an acceleration sensor, and other sensors.
  • the pressure sensor may be a sensor that detects the pressure generated by pressing on the electronic device 200 . That is, the pressure sensor detects pressure generated by contact or press between the user and the electronic device, eg, contact or press between the user's ear and the mobile terminal. Therefore, the pressure sensor can be used to determine whether contact or pressure occurs between the user and the electronic device 200, and the magnitude of the pressure.
  • the acceleration sensor can detect the magnitude of acceleration in various directions (generally three axes), and can detect the magnitude and direction of gravity when it is stationary, and can be used to identify the application of the posture of the electronic device 200 (such as horizontal and vertical screen switching, related games, Magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.
  • the electronic device 200 may also be configured with other sensors such as a gyroscope, a barometer, a hygrometer, and a thermometer, which will not be described in detail here.
  • the camera 110 may include a color lens and an NIR lens.
  • the color lens can be used to collect images in a specified color mode
  • the NIR lens can be used to collect images in a near-infrared mode.
  • FIG. 25 shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application.
  • Program codes are stored in the computer-readable medium 800, and the program codes can be invoked by a processor to execute the methods described in the foregoing method embodiments.
  • the computer readable storage medium 800 may be an electronic memory such as flash memory, EEPROM (Electrically Erasable Programmable Read Only Memory), EPROM, hard disk, or ROM.
  • the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium (non-transitory computer-readable storage medium).
  • the computer-readable storage medium 800 has a storage space for program code 810 for executing any method steps in the above-mentioned methods. These program codes can be read from or written into one or more computer program products.
  • Program code 810 may, for example, be compressed in a suitable form.
  • a device control method, device, electronic device, and storage medium provided by the present application will first display the instruction content of the recommended instruction, and then execute the recommended instruction through the digital voice assistant in response to a trigger operation acting on the instruction content . Therefore, through the above-mentioned method, the electronic device can actively present the instruction content of the recommended instruction to the user, and can trigger the execution of the recommended instruction through the digital voice assistant through a trigger operation directly acting on the instruction content, so that the user can use it when it is inconvenient to speak.
  • the user's actual voice input operation can be replaced by the trigger operation acting on the instruction content, so as to realize the execution of the instruction through the digital voice assistant, thereby improving the user experience of the digital voice assistant.
  • first and second are used for descriptive purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.
  • the features defined as “first” and “second” may explicitly or implicitly include at least one of these features.
  • “plurality” means at least two, such as two, three, etc., unless otherwise specifically defined.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Multimedia (AREA)
  • General Health & Medical Sciences (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请实施例公开了一种设备控制方法、装置、电子设备及存储介质,会先显示推荐指令的指令内容,然后响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。

Description

设备控制方法、装置、电子设备及存储介质
相关申请的交叉引用
本申请要求于2021年5月31日提交的申请号为202110601591.8的中国申请的优先权,其在此出于所有目的通过引用将其全部内容并入本文。
技术领域
本申请涉及终端技术领域,更具体地,涉及一种设备控制方法、装置、电子设备以及存储介质。
背景技术
随着语音识别技术的发展,电子设备中通常都配置有数字语音助手以辅助用户对电子设备进行控制。例如,用户可以通过语音的方式控制电子设备启动自己所需的应用程序等。
发明内容
鉴于上述问题,本申请实施例提出了一种设备控制方法、装置、电子设备以及存储介质,以改善上述问题。
第一方面,本申请实施例提供了一种设备控制方法,应用于电子设备,所述电子设备包括数字语音助手,所述方法包括:显示推荐指令的指令内容;响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
第二方面,本申请实施例提供了一种设备控制装置,运行于电子设备,所述电子设备包括数字语音助手,所述装置包括:指令显示单元,用于显示推荐指令的指令内容;指令执行单元,用于响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
第三方面,本申请实施例提供了一种电子设备,包括一个或多个处理器以及存储器;一个或多个程序被存储在所述存储器中并被配置为由所述一个或多个处理器执行以实现上述的方法。
第四方面,本申请实施例提供了一种计算机可读存储介质,所述计算机可读存储介质中存储有程序代码,其中,在所述程序代码被处理器运行时执行上述的方法。
附图说明
为了更清楚地说明本申请实施例中的技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1示出了本申请一实施例提出的一种设备控制方法的流程图;
图2示出了本申请实施例中一种显示推荐指令的示意图;
图3示出了本申请实施例中一种显示推荐指令的显示区域挤占应用程序图标的显示位置的示意图;
图4示出了本申请实施例中另一种显示推荐指令的示意图;
图5示出了本申请实施例中一种触发推荐指令的示意图;
图6示出了本申请另一实施例提出的一种设备控制方法的流程图;
图7示出了图6中的S210的一种实施方式的流程图;
图8示出了本申请实施例中对应的日期的示意图;
图9示出了本申请实施例中记录所执行指令的所在时间段以及电子设备所在位置的示意图;
图10示出了本申请实施例中一种确定推荐指令的示意图;
图11示出了本申请又一实施例提出的一种设备控制方法的流程图;
图12示出了本申请实施例中另一种确定推荐指令的示意图;
图13示出了本申请再一实施例提出的一种设备控制方法的流程图;
图14示出了本申请再一实施例提出的一种设备控制方法的流程图;
图15示出了本申请实施例中显示数字语音助手的执行指令结果的示意图;
图16示出了本申请实施例中显示语音识别内容的示意图;
图17示出了本申请实施例中显示指令执行结果的界面的示意图;
图18示出了本申请实施例中在桌面添加卡片的示意图;
图19示出了本申请实施例中将卡片从桌面移动到负一屏的示意图;
图20示出了本申请实施例中将卡片从负一屏移动到桌面的示意图;
图21示出了本申请实施例中将卡片从桌面进行移出的示意图;
图22示出了本申请实施例中将卡片从负一屏进行移出的示意图;
图23示出了本申请实时中的用于执行根据本申请实施例的设备控制方法的电子设备的结构框图;
图24示出了本申请的用于执行根据本申请实施例的设备控制方法的电子设备的结构框图;
图25示出了本申请实时中的用于保存或者携带实现根据本申请实施例的设备控制方法的程序代码的存储单元。
具体实施方式
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
语音助手在电子设备中的运用越来越广泛。在电子设备中安装有语音助手的情况下,用户可以先操作电子设备调出语音助手,然后在语音助手调出后,通过语音输入的方式触发语音助手来对电子设备进行控制。例如,在语音助手调出后,用户通过语音输入了“启动音乐软件”,那么语音助手则可以控制电子设备启动所安装的音乐软件。
发明人在对相关的语音助手进行研究后发现,相关的语音助手在用户体验上还有待提升。例如,相关的语音助手需要用户操作电子设备来先进行语音助手的调出,在将语音助手调出之后才能通过语音助手进行语音指令的输入,进而会造成与用户之间的交互路径较长。再者,在一些场景下用户可能不方便进行发声,那么用户则不太方便使用语音助手进行电子设备的控制。
因此,发明人提出了本申请实施例中的设备控制方法、装置、电子设备及存储介质,在该设备控制方法中,电子设备会先显示推荐指令的指令内容,然后响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景(例如,在会议场景或者公共场合下)下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:基于当前的设备所处环境参数对应的历史控制指令,得到推荐指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:获取当前的时间段对应的历史时间段,并将所述历史时间段内对应执行的控制指令作为待处理指令;获取同一待处理指令在对应历史时间段内执行的次数;获取同一待处理指令在对应历史时间段内每次被执行时的位置与当前位置的距离,以得到多个参考距离;基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:获取每个待处理指令对应的推荐值,所述推荐值为第一值与第二值的比,所述第一值为所述次数与参考值的乘积,所述第二值为所述多个参考距离的均值;将对应的推荐值最大的待处理指令,作为推荐指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:获取当前的时间段对应的历史时间段;若所述历史时间段内对应有已执行的控制指令,将所述历史时间段内对应执行的控制指令作为待处理指令;若所述历史时间段内未对应有已执行的控制指令,将与所述历史时间段相邻的下一个对应有执行的控制指令的历史时间段内所对应执行的控制指令作为待处理指令。
在一种实施方式中,所述设备所处环境参数包括时间段和位置中的至少一个参数。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:响应作用于所述指定界面的第二区域中第一控件的触发操作,进行语音内容识别;执行所识别到的语音内容对应的指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:取消显示所述推荐指令的指令内容,并将识别到的语音内容显示在所述第一区域中。
在一种实施方式中,所述指定界面包括显示在电子设备屏幕中的卡片的界面。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:基于当前的设备所处的显示场景,确定推荐指令,其中,根据所述设备中处于前台运行的应用程序确定当前所处的显示场景。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:若所述历史时间段内未对应有已执行的控制指令,则基于设备所处的显示场景确定推荐指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:若与所述历史时间段所相邻的下一个对应有控制指令执行的时间段与所述历史时间段的时间差距大于指定时间差值时,基于设备所处的显示场景确定推荐指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:在桌面的显示区域中显示所述推荐指令的指令内容,其中,所述显示区域为与所述桌面中的应用图标在同一层级的显示区域。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:显示弹窗,并在所述弹窗中显示所述推荐指令的指令内容。
在一种实施方式中,所述电子设备中配置有开关控件,所述开关控件用于控制电子设备是否获取推荐指令以及进行推荐指令的指令内容的显示,本实施例提供的方法还可以包括如下流程:若检测到所述开关控件表征处于开启状态后,确定当前所需显示的推荐指令,在所述弹窗中显示所述当前所需显示的推荐指令的指令内容。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:若检测到所述开关控件表征处于关闭状态后,停止确定推荐指令。
在一种实施方式中,本实施例提供的方法还可以包括如下流程:若检测到与所述指令内容对应的物理按键组合被按压,确定有作用于所述指令内容的触控操作。
下面将结合附图来对本申请所包括的实施例进行介绍。
请参阅图1,图1所示为本申请一实施例提出的一种设备控制方法的流程图,应用于电子设备,该方法包括:
S110:显示推荐指令的指令内容,所述推荐指令由数字语音助手生成。
其中,推荐指令可以理解为电子设备主动呈现给用户的控制指令,通过触发该控制指令可以对电子设备进行控制。其中,在本申请实施例中,电子设备可以有多种方式来确定推荐指令。
作为一种方式,电子设备可以基于历史控制指令来确定当前所要显示的推荐指令。例如,电子设备可以根据前一天或者前一周的电子设备使用习惯来推测当天或者当周用户使用电子设备的习惯,进而确定出用户会在某个时间段内进行哪种电子设备的控制,以确定所对应要显示的推荐指令。例如,若当天为第18周的周六,那么电子设备则可以根据第17周的周六电子设备所执行的控制指令来推测电子设备当天所具体会显示的推荐指令。再例如,若当前时间为10点15分,那么电子设备可以基于前一周每天的10点到11点之间所执行的控制指令来推测当前时间所需要显示的推荐指令。
作为另外一种方式,电子设备可以基于电子设备当前所处的显示场景来确定推荐指令。其中,电子设备可以根据电子设备中处于前台运行的应用程序来确定当前所处的显示场景。可选的,若电子设备中处于前台运行的为视频播放程序,那么当前所处的显示场景为视频播放场景,若电子设备中处于前台运行的应用程序为文本内容浏览程序,那么当前所处的场景为文本显示场景。
其中,在本申请实施例中,推荐指令的显示位置也可以有多种实施方式。
作为一种方式,如图2所示,推荐指令可以显示在桌面10中的显示区域11中。其中,显示区域11中的“XX指令”可以理解为一种推荐指令的指令内容。在这种方式中,显示区域11可以为与桌面10中的应用图标在同一层级的显示区域。其中,同一层级可以理解为显示区域11在桌面移动过程中如果与应用图标的显示位置有接触,则会挤占应用图标的显示位置。示例性的,如图3所示,在桌面编辑模式下,若将显示区域11沿图3中最左侧图像中虚线箭头所示的方向进行移动,并移动到图3的中间图像中所示的位置的情况下,显示区域11会与名称为“聊天”的应用图标重合,对应的,名称为“聊天”的应用图标则会沿图3的中间图像中虚线箭头所示的方向进行移动,并移动到图3的右侧图像中所示的位置,从而使得显示区域11挤占了名称为“聊天”的应用图标原本的显示位置。在从图3的右侧图像所示的情况下退出桌面编辑模式后,显示区域11和桌面中的应用图标为保持当前的显示位置。
作为另外一种方式,如图4所示,推荐指令还可以显示在悬浮显示的弹窗12中。在这种方式下,电子设备在确定需要进行推荐指令显示的情况下,可以显示弹窗12并将推荐指令显示在弹窗12中。其中,弹窗12可能会对电子设备所显示的其他内容进行遮挡,可选的,若电子设备检测到有作用于弹窗12的滑动操作,则可以沿滑动操作的滑动方向将弹窗12移出电子设备的显示区域。需要说明的是,滑动操作可以包括按压操作以及与按压操作连续的滑动阶段,其中,与按压操作连续可以理解为进行按压操作的物体在保持与屏幕接触的情况下直接开始进入滑动阶段。作用于弹窗12的滑动操作可以理解为滑动操作所包括的按压操作是直接作用于弹窗12的。
其中,推荐指令进行显示的时机可以根据多种方式进行确定。
作为一种方式,通过在桌面中所配置的显示区域来对推荐指令进行显示的这种方式中,可以 在显示区域被配置到桌面进行显示以后,则可以开始在显示区域中进行推荐指令的显示。
作为另外一种方式,通过弹窗来进行推荐指令显示的这种方式中,电子设备中可以配置有开关控件,该开关控件用于控制电子设备是否获取推荐指令以及进行推荐指令的显示。在这种方式下,若电子设备检测到开关控件表征处于开启状态后,则会开始确定当前所需显示的推荐指令,并将确定得到的推荐指令通过弹窗的方式进行显示。若电子设备检测到开关控件表征处于关闭状态后,则会停止确定推荐指令。
S120:响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
作为一种方式,作用于指令内容的触控操作可以包括作用于指令内容的点击操作、长时间按压操作或者双击操作等。例如,若电子设备检测到作用于指令内容的点击操作,那么电子设备则可以通过所述数字语音助手执行所述推荐指令。示例性的,如图5所示,若显示的推荐指令的指令内容为“今天天气”,且如图5的中间图像中所示的有作用于“今天天气”的点击操作,那么则数字语音助手则可以控制电子设备显示图5的右侧图像中所示的界面13,在该界面13中显示今天天气的详细内容。
作为另外一种方式,可以建立物理按键组合与指令内容的对应关系。那么在这种方式下,若检测到与指令内容对应的物理按键组合被按压,则确定有作用于指令内容的触控操作。示例性的,若物理按键组合为电源键和音量增加键的组合,那么则可以在检测到电源键和音量增加键被共同按压时,确定检测到作用于指令内容的触控操作。再例如,若物理按键组合为音量增加键和音量降低键的组合,那么则可以在检测到音量增加键和音量降低键被共同按压时,确定检测到作用于指令内容的触控操作。
其中,通过数字语音助手来执行推荐指令可以理解为由数字语音助手来执行推荐指令。例如,若推荐指令的指令内容为“今天天气”,那么在通过数字语音助手来执行该推荐指令的过程中,数字语音助手则可以通过网络进行天气查询,然后将查询的结果通过界面(例如,图5中的界面13)进行显示。
其中,在本申请实施例中,S110和S120可以本身就由数字语音助手进行执行,那么在这种方式下,数字语音助手则可以进行推荐指令的显示以及还负责检测是否有作用于指令内容的触发操作,进而在推荐指令被触发后直接进行推荐指令的执行。再者,S110和S120可以由电子设备中数字语音助手以外的模块来执行,那么在这种方式下,对于在需要通过数字语音助手来执行推荐指令时,则可以将推荐指令传输给数字语音助手,以便由数字语音助手来对推荐指令进行执行。
本实施例提供的一种设备控制方法,会先显示推荐指令的指令内容,然后响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。
请参阅图6,图6所示为本申请一实施例提出的一种设备控制方法的流程图,该方法包括:
S210:基于当前的设备所处环境参数对应的历史控制指令,得到推荐指令,所述推荐指令由数字语音助手生成。
可选的,在本申请实施例中,电子设备在执行控制指令时可以对控制指令执行时的环境进行记录,从而得到控制指令对应的设备所处环境参数。也就是说,设备所处环境参数可以用于记录指令在被执行时所处环境。在本申请实施例中,设备所处环境参数可以包括时间段以及位置中的至少一个参数。其中,时间段表征控制指令在被执行时所处的时间段,位置则表征控制指令被执行时电子设备所处的位置。
作为一种方式,如图7所示,所述设备所处环境参数包括时间段,所述基于所述当前的设备所处环境参数对应的历史控制指令,得到推荐指令,包括:
S211:获取当前的时间段对应的历史时间段,并将所述历史时间段内对应执行的控制指令作为待处理指令。
其中,本申请实施例中的时间段可以为对同一天的时间进行划分后得到的时间段。例如,可以以1小时为间隔对一天的时间进行划分,那么则可以得到23个时间段,并且每个时间段的长度为1个小时。再者,也可以以15分钟为一个间隔对一天的时间进行划分,则可以得到96个时间段,并且每个时间段的长度为15分钟。
需要说明的是,用户可能会在不同日的同一时间段具有相同的操作习惯。例如,用户可能会在工作日每天的11点到12点之间使用电子设备打开外卖应用程序进行点外卖,那么也就意味着 电子设备在工作日每天的11点到12点之间都会执行一次控制外卖应用程序的控制指令。那么电子设备通过获取当前的时间段对应的历史时间段的方式,则可以获取到在历史时间段内执行的控制指令有哪些,进而根据历史时间段所执行的控制指令来推测出在当前的时间段内用户最有可能所需执行的控制指令。
那么在本申请实施例中,可以将与当前的时间段所在日期对应于前一个时间周期的日期中的相同时间段作为对应的历史时间段。其中,对应的排序位置在时间周期中相同的日期为对应的日期。
示例性的,如图8所示,以一周时间为时间周期,在前一个时间周期中包括有3号到9号这七个日期,若当前的时间段为12号中的时间段,那么当前的时间段所在的日期为12号,而12号在当前时间周期中的排序为第三天,则12号对应于前一个时间周期中的日期,也就为在前一个时间周期中同样排序在第三天的5号。若当前的时间段为11点到11点15分这个时间段,那么当前的时间段对应的历史时间段则为5号的11点到11点15分这个时间段。再例如,若当前的时间段为16号中的时间段,那么当前的时间段所在的日期为16号,而16号在当前时间周期中的排序为第七天,则16号对应于前一个时间周期中的日期,也就为在前一个时间周期中同样排序在第七天的9号。若当前的时间段为11点到12点这个时间段,那么当前的时间段对应的历史时间段则为9号的11点到12点这个时间段。
S212:获取同一待处理指令在对应历史时间段内执行的次数。
如前述内容所示,在记录每个控制指令在执行时所处的时间段的情况下,则在确定推荐指令的过程中,则可以获取到历史时间段内一共有哪些控制指令被执行过,以及同一个控制指令被执行的次数。示例性的,在历史时间段内沿时间顺序所记录的执行的控制指令包括指令A、指令B、指令A、指令C以及指令A。那么在该历史时间段指令A执行了3词,指令B执行了1词,指令C执行了1次。
S213:获取同一待处理指令在对应历史时间段内每次被执行时的位置与当前位置的距离,以得到多个参考距离。
其中,需要说明的是,一些控制指令的执行与电子设备当前所处的位置可能是有一定关系的。例如,若电子设备处于用户的工作地点,那么电子设备所指令的控制指令可能更多的是与工作相关的指令,例如,启动外卖应用程序,或者启动信息查询程序,再或者启动打车程序等。再例如,若电子设备是处于用户的居住地,那么电子设备可能所执行的控制指令更多的是与生活相关的指令,例如,启动购物应用程序,查询天气等。因此,通过记录控制指令在被执行时的位置有利于更加准确的确定出用户在某个时刻或者时间段内所需要的推荐指令。对应的,在本申请实施例中,当控制指令在被指令时除了会记录控制指令在被执行时所在的时刻(或者所处的时间段)外,还可以记录控制指令在被指令时电子设备所处的位置。示例性的,如图9所示,可以记录电子设备每天所执行的控制指令的执行时刻以及执行位置(即图中的地点1和地点2)。例如,图9中是以7天为一个时间周期进行控制指令的记录,例如,在图中所示的时间周期的一天中,执行的控制指令包括有指令A、指令B、指令C以及指令D。其中,指令A在被执行时电子设备的位置包括地点1。
S214:基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令。
可选的,所述基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令,包括:
获取每个待处理指令对应的推荐值,所述推荐值为第一值与第二值的比,所述第一值为所述次数与参考值的乘积,所述第二值为所述多个参考距离的均值。其中,参考值可以根据实际需要进行配置,例如,可以将参考值配置为1000。
将对应的推荐值最大的待处理指令,作为推荐指令。
下面再通过附图10,对推荐指令的确定过程进行再次说明。
如图10所示,在图10所示的示例中以一周时间为一个时间周期。那么也就意味着,在确定当前时间周期中的某个日期的推荐指令的过程中,会基于该日期对应于前一个时间周期中的日期进行确定。例如,若当前的时间段是当前时间周期的13号中的时间段,那么13号对应于前一个时间周期中的日期为6号。其中,电子设备会将同一日期划分为N个时间段,若当前的时间段为13号的第二个时间段,那么与13号的第二个时间段所对应的历史时间段为6号的第二个时间段。其中,在6号的第二个时间段内执行的控制指令包括指令A、指令B以及指令D,其中,指令A的执行的次数为3次,指令B的执行的次数为2次,指令D的执行的次数为1次。其中,指令A在3次执行过程中所对应的位置分别为地点1、地点2以及地点3。指令B在2次执行过程中所对 应的位置分别为地点2以及地点3。指令D在1次执行过程中所对应的位置为地点2。
那么在获取指令对应的推荐值的过程中,若参考值为1000,那么所对应的第一值为1000×3=3000。若当前的位置为地点4,且地点1与地点4的距离d1,地点2与地点4的距离d2,地点3与地点4的距离d3,那么对于指令A对应的多个参考距离包括d1、d2以及第d3,而对于d1、d2以及第d3进行均值计算后的值可以为d4,那么指令A所对应的第二值则为d4。那么指令A对应的推荐值为3000/d4。对应的,可以基于相同的方式计算得到指令B和指令D对应的推荐值,若对应的推荐值最大的为指令A,那么则会将指令A作为推荐指令。进而电子设备会在13号的第二个时间段开始的时候将指令A作为推荐指令。
S220:显示推荐指令的指令内容。
S230:响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
本实施例提供的一种设备控制方法,从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。并且,在本申请实施例中,还可以结合当前的设备所处环境参数,进而从当前的设备所处环境参数对应的历史控制指令中得到进行显示的推荐指令,从而使得推荐指令能够更加贴合电子设备用户的使用习惯,提升了电子设备确定推荐指令的智能化程度,也使得用户可以更加便利的对电子设备进行控制。
请参阅图11,图11所示为本申请一实施例提出的一种设备控制方法的流程图,该方法包括:
S310:获取当前的时间段对应的历史时间段。
S320:若所述历史时间段内对应有已执行的控制指令,将所述历史时间段内对应执行的控制指令作为待处理指令。
S330:若所述历史时间段内未对应有已执行的控制指令,将与所述历史时间段相邻的下一个对应有执行的控制指令的历史时间段内所对应执行的控制指令作为待处理指令。
需要说明的是,在一些时间段内用户可能并未使用电子设备,那么在这个时间段内电子设备可能就未进行控制指令的执行。那么为了使得在每个时间段都可以能够更大概率的推荐用户所需的指令,则可以基于与历史时间段相邻的下一个对应有执行的控制指令的历史时间段内执行的控制指令来确定当前的时间段内的控制指令。
示例性的,如图12所示,若当前的时间段依然为当天(当前日期)的第二个时间段,那么与当天的第二个时间段对应的历史时间段则为对应日期的第二个时间段,那么若对应日期的第二个时间段内没有执行过的控制指令,则会以该对应日期的第二个时间段相邻的下一个时间段开始进行查询,直到查询到对应有控制指令的执行的时间段作为下一个对应有控制指令执行的历史时间段。例如,当前的时间段对应的历史时间段为对应日期中的第二个时间段,那么则会从与第二个时间段相邻的第三个时间段开始查询对应有控制指令执行的历史时间段,若直接查询到对应日期中的第三个时间段有控制指令执行,则会将第三个时间段作为相邻的下一个对应有执行的控制指令的历史时间段。
S340:获取同一待处理指令在对应历史时间段内执行的次数。
S350:获取同一待处理指令在对应历史时间段内每次被执行时的位置与当前位置的距离,以得到多个参考距离。
S360:基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令,所述推荐指令由数字语音助手生成。
示例性的,若基于图12中所示的对应日期的第三个时间段中的控制指令进行推荐指令的确定,那么所确定的推荐指令可以为指令C。
S370:显示推荐指令的指令内容。
S380:响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
本实施例提供的一种设备控制方法,从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。并且,在本实施例中,在获取待处理指令的过程中,会在当前的时间段所对应的历史时间段内未对应有已执行的控制指令的情况下,可以将对应的历史时间段相邻的下一个对应有已执行控制指令的历史时间段对应的控制指令作为待处理指令,从而有利于使得电 子设备可以在每个时间段都能够进行推荐指令的显示,提升了推荐指令显示的完整性。
请参阅图13,图13所示为本申请一实施例提出的一种设备控制方法的流程图,该方法包括:
S410:基于电子设备所处的显示场景确定推荐指令,所述推荐指令由数字语音助手生成。
需要说明的是,用户当前对电子设备所进行的控制可能会与电子设备当前所处于的显示场景是相关的。例如,若电子设备当前正在运行有关旅游的应用程序,那么用户可能对会某个地方的天气进行查询,或者查询还有没有到某个地方的车票。进而,电子设备在检测到当前处于旅游内容显示场景时,则所确定的推荐指令可以为“查询XX的天气”或者“查询去XX的火车票”。
S420:显示推荐指令的指令内容。
S430:响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
需要说明的是,在前述实施例中介绍了在将一天时间划分为多个时间段的情况下下,可能会存在当前的时间段所对应的历史时间段内没有对应执行过的控制指令的情况,那么在本申请实施例中,作为另外一种方式,对于前述基于当前的时间段对应的历史时间段来确定推荐指令的这种方式中,可以在检测到当前的时间段对应的历史时间段没有对应执行过的控制指令的情况下,基于电子设备所处的显示场景确定推荐指令。示例性的,若当前的时间段为当天中的第十个时间段,且该第十个时间段对应的历史时间段为当天对应日期中的第十个时间段,那么在当天对应日期中的第十个时间段有对应执行过的控制指令的情况下,则会直接基于当天对应日期中的第十个时间段内执行过的控制指令待处理指令,进而基于带处理指令来确定出推荐指令。若在当天对应日期中的第十个时间段有没有对应执行过的控制指令的情况下,则可以基于电子设备所处的显示场景确定推荐指令。
再者,还需要说明的是,在前述实施例中若当前的时间段所对应的历史时间段没有对应有控制指令的执行,则会将该历史时间段所相邻的下一个对应有控制指令执行的时间段内的控制指令作为待处理指令。在一种情况下,若相邻的下一个时间段与历史时间段的时间差距比较大,则可能会造成所显示的推荐指令与用户当前的需求实际有一定差距。例如,历史时间段所处的时间段为7点到7点15分这个时间段,而所查询到的有控制指令执行的相邻的下一个时间段为17点到17点15分这个时间段。那么作为一种方式,可以在查询到与历史时间段所相邻的下一个对应有控制指令执行的时间段与历史时间段的时间差距大于指定时间差值时,则基于电子设备所处的显示场景确定推荐指令。其中,时间差值可以由用户进行配置,例如可以为1个小时,也可以为2个小时。
本实施例提供的一种设备控制方法,从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。并且,在本申请实施例中可以根据电子设备所处的显示场景来确定推荐指令,进而有利于是的所显示的推荐指令更加匹配当前的电子设备使用情况,以提升推荐指令被触发的概率,进而提升数字语音助手的使用率。
请参阅图14,图14所示为本申请一实施例提出的一种设备控制方法的流程图,该方法包括:
S510:在指定界面的第一区域中显示推荐指令的指令内容,所述推荐指令由数字语音助手生成。
作为一种方式,指定界面包括显示在电子设备屏幕中的卡片的界面。那么在这种方式下,请再参阅图2,图2中所示的显示区域11则可以为卡片的界面。
S520:响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
S530:响应作用于所述指定界面的第二区域中第一控件的触发操作,进行语音内容识别。
需要说明的是,在一些情况下,若用户当前并不想触发推荐指令对应的指令内容,而是想输入其他的指令,那么在指定界面中则可以提供第一控件作为一个输入接口,以便用户可以便利的通过语音的方式输入其他的控制指令。
S540:执行所识别到的语音内容对应的指令。
示例性的,以指定界面为卡片的界面为例,如图15所示,在卡片20中的第一区域中显示有推荐指令的指令内容“XX指令”,在第二区域中显示有第一控件21,若检测到有作用于第一控件21的触发操作,则电子设备则可以开始进行语音内容的采集,并对所采集的语音进行语音内容识别。例如,所识别到的语音内容为“周六天气”,那么数字语音助手则会开始查询周六的天气,并通过界面13来显示所查询到的内容。那么通过这种方式使得,实现了文本指令(推荐指令的指令内容是以文本的形式进行显示的)和语音交互(语音识别内容)两个入口相互补充,提升语音指令卡 片(例如,卡片20)的使用率,也提升了数字语音助手的使用率。
作为一种方式,所述执行所识别到的语音内容对应的指令之前还包括:
取消显示所述推荐指令的指令内容,并将识别到的语音内容显示在所述第一区域中。示例性的,如图16所示,对于语音识别内容“周六天气怎么样”可以显示在图16的中间图像中的卡片21的第一区域中,进而使得用语音识别内容替换掉原本的推荐指令的指令内容。
作为一种方式,数字语音助手在执行推荐指令或者执行所识别到的语音内容对应的指令的过程中还可以显示第二控件,以便在检测到作用于第二控件的触发操作后,继续进行语音内容的识别,以及执行所识别到的语音内容对应的指令。示例性的,如图17所示,控件30为前述的第二控件,若检测到作用于控件30的触发操作,则可以继续进行语音内容的识别,以及执行所识别到的语音内容对应的指令。
在本申请实施例中,可以通过卡片(例如,前述的卡片20)的形式对推荐指令进行显示。而对于该显示推荐指令的卡片可以通过桌面编辑模式进行添加。示例性的,如图18所示,图18的左侧图像所示为进入桌面编辑模式的样式,在桌面编辑模式下,在桌面上显示有名称为“添加卡片”的控件,若检测到有作用于名称为“添加卡片”的控件的触控操作,那么则电子设备可以显示图18的中间图像中所示的样式,在图18的中间图像中显示有可以进行添加到桌面的卡片的类型。若检测到有作用于图18的中间图像中的名称为“语音助手”的卡片的触控操作,那么则电子设备会显示图18的右侧图像中所示的样式,在该样式中会显示所选中的卡片在桌面进行显示的界面,以及进行进一步操作的控件,该进一步进行操作的控件包括名称为“取消”的控件和名称为“添加”的控件。若检测到有作用于名称为“添加”的控件,那么则电子设备会在桌面中添加语音助手对应的卡片(例如,前述的卡片20)。
再者,对于添加到桌面的卡片,可以通过拖动的方式移动到电子设备的负一屏进行放置。示例性的,如图19所示,对于卡片20可以沿图19的左侧图像中的虚线箭头所示的方向进行拖动,并使得卡片20移动到图19的中间图像中所示的位置,在卡片20保持为图19的中间图像中所示的位置的情况下,电子设备会进行界面的切换,直到切换为图19的右侧图中所示的负一屏的界面40。在电子设备显示负一屏的界面40后,可以继续拖动卡片20并移动到图19的右侧图中所示的位置进行放置,从而实现将卡片20从存放应用图标的界面拖动到负一屏进行放置。
对应的,被拖动到负一屏的卡片也可以被再次移动到存放应用图标的界面。示例性的,如图20所示,可以将负一屏的卡片20沿图20中的左侧图像中所示的虚线箭头所指方向进行拖动,并拖动到图20中的中间图像中所示的位置,在卡片20保持在图20中的中间图像中所示的位置后,电子设备可以对所显示的界面进行切换,并切换为图20的右侧图像中所示的桌面10(存放应用图标的界面),在电子设备显示桌面10后,可以继续拖动卡片20并移动到桌面10中所需位置进行放置,从而实现将卡片20从负一屏拖动到桌面10进行放置。
再者,对于所显示的用于显示推荐指令的卡片,也可以从桌面或者负一屏中进行移除。例如,可以通过长按卡片实现触发显示悬浮界面,在该悬浮界面中显示有对卡片进行移除的控件。示例性的,如图21所示,在卡片20显示在桌面10的情况下,若检测到长按卡片20的操作,则可以显示悬浮界面41,在悬浮界面41中显示有名称为“移除”控件,若检测到有作用于名称为“移除”控件的触控操作,那么则会将卡片20从桌面10中进行移除。对应的,如图22所示,在卡片20显示在负一屏的界面40的情况下,若检测到长按卡片20的操作,则可以显示悬浮界面41,在悬浮界面41中显示有名称为“移除”控件,若检测到有作用于名称为“移除”控件的触控操作,那么则会将卡片20从负一屏的界面40中进行移除。
本实施例提供的一种设备控制方法,从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。并且,在本实施例中除了会显示推荐指令的指令内容外,还会在指定界面的第二区域中显示第一控件,进而使得用户还可以通过第一控件来触发进行语音内容识别,以便电子设备可以同时提供进行指令推荐和接收用户的输入这两种指令的触发方式,有利于提升数字语音助手的使用率。
请参阅图23,图23所示为本申请一实施例提出的一种设备控制装置的结构框图,该装置包括:
指令显示单元510,用于显示推荐指令的指令内容,所述推荐指令由数字语音助手生成。
指令执行单元520,用于响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
作为一种方式,指令显示单元510,还用于基于当前的设备所处环境参数对应的历史控制指令,得到推荐指令。可选的,所述设备所处环境参数包括时间段,指令显示单元510,具体用于获取当前的时间段对应的历史时间段,并将所述历史时间段内对应执行的控制指令作为待处理指令;获取同一待处理指令在对应历史时间段内执行的次数;获取同一待处理指令在对应历史时间段内每次被执行时的位置与当前位置的距离,以得到多个参考距离;基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令。
可选的,指令显示单元510,具体用于获取每个待处理指令对应的推荐值,所述推荐值为第一值与第二值的比,所述第一值为所述次数与参考值的乘积,所述第二值为所述多个参考距离的均值;将对应的推荐值最大的待处理指令,作为推荐指令。
可选的,指令显示单元510,具体用于获取当前的时间段对应的历史时间段;若所述历史时间段内对应有已执行的控制指令,将所述历史时间段内对应执行的控制指令作为待处理指令;若所述历史时间段内未对应有已执行的控制指令,将与所述历史时间段相邻的下一个对应有执行的控制指令的历史时间段内所对应执行的控制指令作为待处理指令。
可选的,所述设备所处环境参数包括时间段和位置中的至少一个参数。
作为一种方式,指令显示单元510,具体用于在指定界面的第一区域中显示推荐指令的指令内容。在这种方式下,指令执行单元520,还具体用于响应作用于所述指定界面的第二区域中第一控件的触发操作,进行语音内容识别;执行所识别到的语音内容对应的指令。可选的,指令显示单元510,还具体用于在执行所识别到的语音内容对应的指令之前,取消显示所述推荐指令的指令内容,并将识别到的语音内容显示在所述第一区域中。其中,指定界面可以包括显示在电子设备屏幕中的卡片的界面。
作为一种方式,指令显示单元510,还用于基于当前的设备所处的显示场景,确定推荐指令,其中,根据所述设备中处于前台运行的应用程序确定当前所处的显示场景。
可选的,指令显示单元510,还用于若所述历史时间段内未对应有已执行的控制指令,则基于设备所处的显示场景确定推荐指令。
可选的,指令显示单元510,还用于若与所述历史时间段所相邻的下一个对应有控制指令执行的时间段与所述历史时间段的时间差距大于指定时间差值时,基于设备所处的显示场景确定推荐指令。
可选的,指令显示单元510,还用于在桌面的显示区域中显示所述推荐指令的指令内容,其中,所述显示区域为与所述桌面中的应用图标在同一层级的显示区域。
可选的,指令显示单元510,还用于显示弹窗,并在所述弹窗中显示所述推荐指令的指令内容。
可选的,指令显示单元510,还用于若检测到所述开关控件表征处于开启状态后,确定当前所需显示的推荐指令,在所述弹窗中显示所述当前所需显示的推荐指令的指令内容。
可选的,指令显示单元510,还用于若检测到所述开关控件表征处于关闭状态后,停止确定推荐指令。
可选的,指令显示单元510,还用于若检测到与所述指令内容对应的物理按键组合被按压,确定有作用于所述指令内容的触控操作。
本申请提供的一种设备控制装置,会先显示推荐指令的指令内容,然后响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。
需要说明的是,本申请中装置实施例与前述方法实施例是相互对应的,装置实施例中具体的原理可以参见前述方法实施例中的内容,此处不再赘述。
下面将结合图24对本申请提供的一种电子设备进行说明。
请参阅图24,基于上述的设备控制方法、装置,本申请实施例还提供的另一种可以执行前述设备控制方法的电子设备200。电子设备200包括相互耦合的一个或多个(图中仅示出一个)处理器102、存储器104以及网络模块106。其中,该存储器104中存储有可以执行前述实施例中内容的程序,而处理器102可以执行该存储器104中存储的程序。
其中,处理器102可以包括一个或者多个处理核。处理器102利用各种接口和线路连接整个电子设备200内的各个部分,通过运行或执行存储在存储器104内的指令、程序、代码集或指令集,以及调用存储在存储器104内的数据,执行电子设备200的各种功能和处理数据。可选地,处理器102可以采用 数字信号处理(Digital Signal Processing,DSP)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)、可编程逻辑阵列(Programmable Logic Array,PLA)中的至少一种硬件形式来实现。处理器102可集成中央处理器(Central Processing Unit,CPU)、图像处理器(Graphics Processing Unit,GPU)和调制解调器等中的一种或几种的组合。其中,CPU主要处理操作***、用户界面和应用程序等;GPU用于负责显示内容的渲染和绘制;调制解调器用于处理无线通信。可以理解的是,上述调制解调器也可以不集成到处理器102中,单独通过一块通信芯片进行实现。
存储器104可以包括随机存储器(Random Access Memory,RAM),也可以包括只读存储器(Read-Only Memory)。存储器104可用于存储指令、程序、代码、代码集或指令集。存储器104可包括存储程序区和存储数据区,其中,存储程序区可存储用于实现操作***的指令、用于实现至少一个功能的指令(比如触控功能、声音播放功能、图像播放功能等)、用于实现下述各个方法实施例的指令等。例如,存储器104中可以存储有设备控制的装置。该设备控制的装置可以为前述的装置500。存储数据区还可以存储终端100在使用中所创建的数据(比如电话本、音视频数据、聊天记录数据)等。
所述网络模块106用于接收以及发送电磁波,实现电磁波与电信号的相互转换,从而与通讯网络或者其他设备进行通讯,例如和音频播放设备进行通讯。所述网络模块106可包括各种现有的用于执行这些功能的电路元件,例如,天线、射频收发器、数字信号处理器、加密/解密芯片、用户身份模块(SIM)卡、存储器等等。所述网络模块106可与各种网络如互联网、企业内部网、无线网络进行通讯或者通过无线网络与其他设备进行通讯。上述的无线网络可包括蜂窝式电话网、无线局域网或者城域网。例如,网络模块106可以与基站进行信息交互。
传感器模块108可以包括至少一种传感器。具体地,传感器模块108可包括但并不限于:光传感器、运动传感器、压力传感器、红外热传感器、距离传感器、加速度传感器、以及其他传感器。
其中,压力传感器可以检测由按压在电子设备200产生的压力的传感器。即,压力传感器检测由用户和电子设备之间的接触或按压产生的压力,例如由用户的耳朵与移动终端之间的接触或按压产生的压力。因此,压力传感器可以用来确定在用户与电子设备200之间是否发生了接触或者按压,以及压力的大小。
其中,加速度传感器可检测各个方向上(一般为三轴)加速度的大小,静止时可检测出重力的大小及方向,可用于识别所述电子设备200姿态的应用(比如横竖屏切换、相关游戏、磁力计姿态校准)、振动识别相关功能(比如计步器、敲击)等。另外,所述电子设备200还可配置陀螺仪、气压计、湿度计、温度计等其他传感器,在此不再赘述,
摄像头110可以包括有彩色镜头和NIR镜头。其中,彩色镜头可以用于采集指定色彩模式图像,NIR镜头可以用于采集近红外模式图像。
请参考图25,其示出了本申请实施例提供的一种计算机可读存储介质的结构框图。该计算机可读介质800中存储有程序代码,所述程序代码可被处理器调用执行上述方法实施例中所描述的方法。
计算机可读存储介质800可以是诸如闪存、EEPROM(电可擦除可编程只读存储器)、EPROM、硬盘或者ROM之类的电子存储器。可选地,计算机可读存储介质800包括非易失性计算机可读介质(non-transitory computer-readable storage medium)。计算机可读存储介质800具有执行上述方法中的任何方法步骤的程序代码810的存储空间。这些程序代码可以从一个或者多个计算机程序产品中读出或者写入到这一个或者多个计算机程序产品中。程序代码810可以例如以适当形式进行压缩。
本申请提供的一种设备控制方法、装置、电子设备及存储介质,会先显示推荐指令的指令内容,然后响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。从而通过上述方式使得电子设备可以主动的向用户呈现推荐指令的指令内容,并且可以通过直接作用于指令内容的触发操作来触发通过数字语音助手执行该推荐指令,进而使得用户可以在不便于发声的场景下,可以通过作用于指令内容的触发操作来替代用户实际的语音输入的操作,以实现通过数字语音助手进行指令的执行,从而提升了数字语音助手的用户使用体验。
在本说明书的描述中,参考术语“一个实施例”、“一些实施例”、“示例”、“具体示例”、或“一些示例”等的描述意指结合该实施例或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施例或示例中。在本说明书中,对上述术语的示意性表述不必须针对的是相同的实施例或示例。而且,描述的具体特征、结构、材料或者特点可以在任一个或多个实施例或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。
此外,术语“第一”、“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。由此,限定有“第一”、“第二”的特征可以明示或者隐含地包括至少一个该特征。在本申请的描述中,“多个”的含义是至少两个,例如两个,三个等,除非另有明确具体的 限定。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不驱使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。

Claims (20)

  1. 一种设备控制方法,其中,应用于电子设备,所述电子设备包括数字语音助手,所述方法包括:
    显示推荐指令的指令内容,所述推荐指令由数字语音助手生成;
    响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
  2. 根据权利要求1所述的方法,其中,所述显示推荐指令的指令内容之前还包括:
    基于当前的设备所处环境参数对应的历史控制指令,得到推荐指令。
  3. 根据权利要求1所述的方法,其中,所述显示推荐指令的指令内容之前还包括:
    基于当前的设备所处的显示场景,确定推荐指令,其中,根据所述设备中处于前台运行的应用程序确定当前所处的显示场景。
  4. 根据权利要求2所述的方法,其中,所述设备所处环境参数包括时间段,所述基于所述当前的设备所处环境参数对应的历史控制指令,得到推荐指令,包括:
    获取当前的时间段对应的历史时间段,并将所述历史时间段内对应执行的控制指令作为待处理指令;
    获取同一待处理指令在对应历史时间段内执行的次数;
    获取同一待处理指令在对应历史时间段内每次被执行时的位置与当前位置的距离,以得到多个参考距离;
    基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令。
  5. 根据权利要求4所述的方法,其中,所述基于每个待处理指令对应的所述次数以及所述多个参考距离,从所述待处理指令中确定推荐指令,包括:
    获取每个待处理指令对应的推荐值,所述推荐值为第一值与第二值的比,所述第一值为所述次数与参考值的乘积,所述第二值为所述多个参考距离的均值;
    将对应的推荐值最大的待处理指令,作为推荐指令。
  6. 根据权利要求4所述的方法,其中,所述获取当前的时间段对应的历史时间段,并将所述历史时间段内对应执行的控制指令作为待处理指令,包括:
    获取当前的时间段对应的历史时间段;
    若所述历史时间段内对应有已执行的控制指令,将所述历史时间段内对应执行的控制指令作为待处理指令;
    若所述历史时间段内未对应有已执行的控制指令,将与所述历史时间段相邻的下一个对应有执行的控制指令的历史时间段内所对应执行的控制指令作为待处理指令。
  7. 根据权利要求6所述的方法,其中,所述方法还包括:
    若所述历史时间段内未对应有已执行的控制指令,则基于设备所处的显示场景确定推荐指令。
  8. 根据权利要求6所述的方法,其中,所述方法还包括:
    若与所述历史时间段所相邻的下一个对应有控制指令执行的时间段与所述历史时间段的时间差距大于指定时间差值时,基于设备所处的显示场景确定推荐指令。
  9. 根据权利要求2所述的方法,其中,所述设备所处环境参数包括时间段和位置中的至少一个参数。
  10. 根据权利要求1-9任一所述的方法,其中,所述显示推荐指令的指令内容,包括:在指定界面的第一区域中显示推荐指令的指令内容;所述方法还包括:
    响应作用于所述指定界面的第二区域中第一控件的触发操作,进行语音内容识别;
    执行所识别到的语音内容对应的指令。
  11. 根据权利要求10所述的方法,其中,所述执行所识别到的语音内容对应的指令 之前还包括:
    取消显示所述推荐指令的指令内容,并将识别到的语音内容显示在所述第一区域中。
  12. 根据权利要求10所述的方法,其中,所述指定界面包括显示在电子设备屏幕中的卡片的界面。
  13. 根据权利要求1-12任一所述的方法,其中,所述显示推荐指令的指令内容,包括:
    在桌面的显示区域中显示所述推荐指令的指令内容,其中,所述显示区域为与所述桌面中的应用图标在同一层级的显示区域。
  14. 根据权利要求1-12任一所述的方法,其中,所述显示推荐指令的指令内容,包括:
    显示弹窗,并在所述弹窗中显示所述推荐指令的指令内容。
  15. 根据权利要求14所述的方法,其中,所述电子设备中配置有开关控件,所述开关控件用于控制电子设备是否获取推荐指令以及进行推荐指令的指令内容的显示,所述在所述弹窗中显示所述推荐指令的指令内容,包括:
    若检测到所述开关控件表征处于开启状态后,确定当前所需显示的推荐指令,在所述弹窗中显示所述当前所需显示的推荐指令的指令内容。
  16. 根据权利要求15所述的方法,其中,所述方法还包括:
    若检测到所述开关控件表征处于关闭状态后,停止确定推荐指令。
  17. 根据权利要求1-16任一所述的方法,其中,所述响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令之前还包括:
    若检测到与所述指令内容对应的物理按键组合被按压,确定有作用于所述指令内容的触控操作。
  18. 一种设备控制装置,其中,运行于电子设备,所述电子设备包括数字语音助手,所述装置包括:
    指令显示单元,用于显示推荐指令的指令内容,所述推荐指令由数字语音助手生成;
    指令执行单元,用于响应作用于所述指令内容的触发操作,通过所述数字语音助手执行所述推荐指令。
  19. 一种电子设备,其中,包括一个或多个处理器以及存储器;一个或多个程序被存储在所述存储器中并被配置为由所述一个或多个处理器执行权利要求1-17任一所述的方法。
  20. 一种计算机可读存储介质,其中,所述计算机可读存储介质中存储有程序代码,其中,在所述程序代码被处理器运行时执行权利要求1-17任一所述的方法。
PCT/CN2022/088704 2021-05-31 2022-04-24 设备控制方法、装置、电子设备及存储介质 WO2022252872A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110601591.8A CN115421682A (zh) 2021-05-31 2021-05-31 设备控制方法、装置、电子设备及存储介质
CN202110601591.8 2021-05-31

Publications (1)

Publication Number Publication Date
WO2022252872A1 true WO2022252872A1 (zh) 2022-12-08

Family

ID=84230527

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/088704 WO2022252872A1 (zh) 2021-05-31 2022-04-24 设备控制方法、装置、电子设备及存储介质

Country Status (2)

Country Link
CN (1) CN115421682A (zh)
WO (1) WO2022252872A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10380208B1 (en) * 2015-12-28 2019-08-13 Amazon Technologies, Inc. Methods and systems for providing context-based recommendations
CN110647274A (zh) * 2019-08-15 2020-01-03 华为技术有限公司 一种界面显示方法及设备
CN110910872A (zh) * 2019-09-30 2020-03-24 华为终端有限公司 语音交互方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10380208B1 (en) * 2015-12-28 2019-08-13 Amazon Technologies, Inc. Methods and systems for providing context-based recommendations
CN110647274A (zh) * 2019-08-15 2020-01-03 华为技术有限公司 一种界面显示方法及设备
CN110910872A (zh) * 2019-09-30 2020-03-24 华为终端有限公司 语音交互方法及装置

Also Published As

Publication number Publication date
CN115421682A (zh) 2022-12-02

Similar Documents

Publication Publication Date Title
CN111061574B (zh) 一种对象分享方法及电子设备
CN109062479B (zh) 分屏应用切换方法、装置、存储介质和电子设备
CN108762954B (zh) 一种对象分享方法及移动终端
CN110798397B (zh) 文件发送方法、装置和电子设备
CN113360238A (zh) 消息处理方法、装置、电子设备和存储介质
CN108664190B (zh) 页面显示方法、装置、移动终端以及存储介质
US11455491B2 (en) Method and device for training image recognition model, and storage medium
CN108491149B (zh) 一种分屏显示方法及终端
CN109491738B (zh) 一种终端设备的控制方法及终端设备
CN108984066B (zh) 一种应用程序图标显示方法及移动终端
CN108710458B (zh) 一种分屏控制方法和终端设备
CN111104029B (zh) 快捷标识生成方法、电子设备及介质
KR101709427B1 (ko) 정보를 선택하는 방법 및 디바이스
CN112068762A (zh) 应用程序的界面显示方法、装置、设备及介质
CN109189303B (zh) 文本编辑方法及移动终端
CN111127595A (zh) 图像处理方法及电子设备
CN109032491A (zh) 数据处理方法、装置以及移动终端
CN109144447A (zh) 分屏窗口调节方法、装置、存储介质及电子设备
CN109542307B (zh) 一种图像处理方法、设备和计算机可读存储介质
CN109194810B (zh) 显示控制方法及相关产品
CN108628534B (zh) 一种字符展示方法及移动终端
CN109032465B (zh) 数据处理方法、装置以及移动终端
CN112181252B (zh) 截屏方法、装置及电子设备
CN111610909B (zh) 一种截图方法、装置及电子设备
CN111049977B (zh) 一种闹钟提醒方法及电子设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22814919

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22814919

Country of ref document: EP

Kind code of ref document: A1