CN113542488B

CN113542488B - Method, device and storage medium for controlling controlled terminal using terminal device

Info

Publication number: CN113542488B
Application number: CN202110738860.5A
Authority: CN
Inventors: 赵安宁; 赵杨晨; 万晓山; 孟庆霞
Original assignee: Hisense Mobile Communications Technology Co Ltd
Current assignee: Hisense Mobile Communications Technology Co Ltd
Priority date: 2021-06-30
Filing date: 2021-06-30
Publication date: 2024-03-15
Anticipated expiration: 2041-06-30
Also published as: CN113542488A

Abstract

The application discloses a method, equipment and storage medium for controlling a controlled terminal by adopting terminal equipment. The method is used for solving the problem that the terminal equipment is complex in control operation on the controlled terminal. In the embodiment of the application, the call demand of the user is sensed, and the first control panel of the controlled terminal can be displayed on the call interface in the call scene; the first control panel is used for controlling the controlled terminal, so that a user can execute operation on the first control panel to control the controlled terminal. Therefore, the user can conveniently control the controlled terminal without adjusting the call interface to the control interface of the controlled terminal, so that the application can automatically sense the use requirement of a call scene and simplify the control operation of the controlled terminal in the scene.

Description

Method, device and storage medium for controlling controlled terminal using terminal device

Technical Field

The present invention relates to the field of terminal devices, and in particular, to a method, an apparatus, and a storage medium for controlling a controlled terminal using a terminal device.

Background

With the development of technology and the interconnection of everything, more and more products change the form of the products. Many home appliances can not only control the home appliance by their own physical keys or a dedicated remote control, but also now can be controlled using a terminal device. The television or television box may be controlled by the cell phone, for example by mounting a remote control for the television or television box on the cell phone.

However, in the related art, the terminal device controls the intelligent device to only passively receive the command and passively output the content. The terminal equipment lacks judgment and interaction of the current situation of the user, so that the terminal equipment is complex to operate in a special scene and cannot adjust the household equipment in real time according to the current situation of the user.

Disclosure of Invention

The purpose of the application is to provide a method, equipment and storage medium for controlling a controlled terminal by adopting terminal equipment, which are used for solving the problem that the control operation of the terminal equipment on the controlled terminal is complex.

In a first aspect, an embodiment of the present application provides a method for controlling a controlled terminal by using a terminal device, including:

responding to the voice call instruction, and displaying a first control panel of the controlled terminal;

and based on the user operation of the first control panel, sending a control instruction to the controlled terminal.

In some embodiments, the first control panel includes a virtual volume adjustment control, and the sending, based on a user operation on the first control panel, a control instruction to the controlled terminal includes:

and responding to the user operation of the virtual volume adjustment control, and sending a volume adjustment instruction to the controlled terminal.

In some embodiments, the first control panel includes a virtual screen recording control, and the sending, based on a user operation on the first control panel, a control instruction to the controlled terminal includes:

and responding to the user operation of the virtual screen recording control, and sending a screen recording instruction to the controlled terminal.

In some embodiments, the method further comprises:

selecting a communication link capable of communicating with the controlled terminal;

and executing the operation of sending the control instruction to the controlled terminal by adopting the communication link.

In some embodiments, the selecting a communication link capable of communicating with the controlled terminal comprises:

and transmitting confirmation information to the controlled terminal by adopting a Bluetooth communication mode, and if receiving the reply information transmitted by the controlled terminal, selecting a communication link as the communication link of the Bluetooth communication mode.

In some embodiments, the method further comprises:

if the communication between the controlled terminal and the Bluetooth communication mode fails, acquiring a wireless network address of the controlled terminal;

and if the wireless network address is based on the wireless network address, determining that the wireless network address is the same as the controlled terminal, wherein the selected communication link is a communication link of a wireless network communication mode.

In some embodiments, before ending the voice call, the method further comprises:

responding to touch operation of the entity volume adjustment control, and displaying a second control panel;

and sending the control instruction to the controlled terminal based on the user operation aiming at the second control panel.

In some embodiments, the second control panel includes at least one of a virtual volume adjustment control, a virtual screen recording control, and any one or combination of the following: the media volume control, the ringtone volume control, and the notification volume control.

Second aspect the present application also provides a terminal device, the device comprising: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform: responding to the voice call instruction, and displaying a first control panel of the controlled terminal;

In some embodiments, the first control panel includes a virtual volume adjustment control, and when a control instruction is sent to the controlled terminal based on a user operation of the first control panel, the processor is configured to:

In some embodiments, the first control panel includes a virtual screen recording control, and when a control instruction is sent to the controlled terminal based on a user operation of the first control panel, the processor is configured to:

In some embodiments, the processor is further configured to:

In some embodiments, in performing the selecting and the communication link of the controlled terminal that is capable of communication, the processor is configured to:

In some embodiments, the processor is further configured to:

In some embodiments, prior to ending the voice call, the processor is further configured to:

In a third aspect, another embodiment of the present application further provides a computer readable storage medium, where the computer readable storage medium stores a computer program for causing a computer to perform any one of the methods provided in the embodiments of the first aspect of the present application.

According to the embodiment of the application, the use requirement of the conversation scene can be automatically sensed, a user can conveniently control the controlled terminal without adjusting the conversation interface to the control interface of the controlled terminal, the cooperative intelligence of the controlled terminal and the control equipment is increased, the control operation of the controlled terminal in the scene is simplified, and the user experience is enhanced.

Additional features and advantages of the application will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application. The objectives and other advantages of the application will be realized and attained by the structure particularly pointed out in the written description and claims thereof as well as the appended drawings.

Drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are needed in the embodiments of the present application will be briefly described below, and it is obvious that the drawings that are described below are only some embodiments of the present application, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.

Fig. 1A is an application scenario diagram of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

Fig. 1B is a schematic structural diagram of a terminal device provided in an embodiment of the present application;

fig. 1C is a schematic software architecture diagram of a terminal device according to an embodiment of the present application;

fig. 2 is an overall flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 3A is a schematic diagram of a voice call interface in the related art and a schematic diagram of a first control panel provided in the present application, where the method for controlling a controlled terminal by using a terminal device is provided in the embodiment of the present application;

fig. 3B is a schematic diagram of a first control panel according to an embodiment of the present application, where the first control panel uses a method for controlling a controlled terminal by using a terminal device;

fig. 4 is a schematic diagram of a volume adjustment interface of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 5 is a schematic diagram of screen recording by using a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 6A is a schematic diagram of a second control panel according to an embodiment of the present application, where the second control panel is a method for controlling a controlled terminal by using a terminal device;

fig. 6B is a schematic diagram of performing television recording in a second control panel by using a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

Fig. 6C is a schematic diagram of click volume adjustment using a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 7 is a flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 8 is a flowchart of recommending a volume mode by using a method for controlling a controlled terminal by a terminal device according to an embodiment of the present application;

fig. 9 is a schematic diagram of adjusting a volume to a recommended volume by using a method for controlling a controlled terminal by a terminal device according to an embodiment of the present application;

fig. 10 is an overall flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application;

fig. 11 is a schematic diagram of setting a television to a recommended volume by using a method for controlling a controlled terminal by a terminal device according to an embodiment of the present application.

Detailed Description

In order to enable those skilled in the art to better understand the technical solutions of the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

It should be noted that the terms "first," "second," and the like in the description and in the claims are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that embodiments of the present application described herein may be implemented in sequences other than those illustrated or otherwise described herein. The implementations described in the following exemplary examples are not representative of all implementations consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present application as detailed in the accompanying claims.

The inventor researches and discovers that with the development of technology and the interconnection of everything, more and more products change the form of the products. Many home appliances can not only control the home appliance by their own physical keys or a dedicated remote control, but also now can be controlled using a terminal device. The television or television box may be controlled by the cell phone, for example by mounting a remote control for the television or television box on the cell phone.

For example: before, the television is only an entertainment tool for watching programs of all television stations, the function is quite single, and the remote controller is the only operation tool. But more intelligent entertainment interaction functions and social functions are gradually added to the television at present, and the television can be operated even through the terminal equipment. Under the interaction scene of the current television and the user, the television can only passively accept the command and passively output the content, and the terminal equipment lacks judgment and interaction on the current situation of the user and cannot control the television according to the current situation of the user.

In view of this, the present application proposes a method, apparatus and storage medium for controlling a controlled terminal using a terminal apparatus, for solving the above-mentioned problems. The inventive concepts of the present application can be summarized as follows: the terminal equipment senses the call demand of a user, and can display a first control panel of the controlled terminal on a call interface under a call scene; the first control panel is used for controlling the controlled terminal, so that a user can execute operation on the first control panel to control the controlled terminal. Therefore, in the embodiment of the application, the call scene can be intelligently identified, the first control panel is displayed on the call interface in the call scene, and a user can conveniently control the controlled terminal according to the call requirement, so that the user can conveniently control the controlled terminal without adjusting the call interface to the control interface of the controlled terminal, the application can automatically sense the use requirement of the call scene, and the control operation of the controlled terminal in the scene is simplified. For example, when an incoming call comes, the first control panel is displayed in time, and the user does not need to search for and switch to an application for controlling the television to temporarily adjust the volume of the television. The volume of the television can be adjusted in the incoming call interface, and for example, if the user is watching the interesting interface, the television can be controlled to record in the incoming call interface.

Fig. 1A is an application scenario diagram of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application. The drawings include: a network 10, a terminal device 20, a controlled terminal 30;

wherein: when there is a voice call, the terminal device 20 displays a first control panel of the controlled terminal 30 in response to the voice call instruction; based on the user operation on the first control panel, the terminal device transmits a control instruction to the controlled terminal through the network 10.

It should be appreciated that the controlled terminal may be a refrigerator, a television, a sound box, an intelligent kitchen appliance or other electronic equipment with a media playing function.

In the description herein, only a single terminal device is described in detail, but it should be understood by those skilled in the art that the controlled terminal 30 and the terminal device 20 are shown to be intended to represent the operation of the controlled terminal controlled by the terminal device according to the technical solution of the present disclosure. The detailed description of the single terminal device and the controlled terminal is for at least convenience of explanation, and does not imply that the number, type, location, etc. of the terminal device and the controlled terminal are limited. It should be noted that the underlying concepts of the example embodiments of the present application are not altered if additional modules are added to or individual modules are removed from the illustrated environment.

The method for controlling the controlled terminal by using the terminal device according to the embodiment of the present application is described in detail below with reference to the accompanying drawings.

First, fig. 1B shows a schematic configuration of a terminal device 100.

The embodiment will be specifically described below taking the terminal device 100 as an example. It should be understood that the terminal device 100 shown in fig. 1B is only one example, and that the terminal device 100 may have more or fewer components than shown in fig. 1B, may combine two or more components, or may have a different configuration of components. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and/or application specific integrated circuits.

A hardware configuration block diagram of the terminal device 100 according to an exemplary embodiment is exemplarily shown in fig. 1B. As shown in fig. 1B, the terminal device 100 includes: radio Frequency (RF) circuitry 110, memory 120, display unit 130, camera 140, sensor 150, audio circuitry 160, wireless fidelity (Wireless Fidelity, wi-Fi) module 170, processor 180, bluetooth module 181, and power supply 190.

The RF circuit 110 may be used for receiving and transmitting signals during the process of receiving and transmitting information or communication, and may receive downlink data of the base station and then transmit the downlink data to the processor 180 for processing; uplink data may be sent to the base station. Typically, RF circuitry includes, but is not limited to, antennas, at least one amplifier, transceivers, couplers, low noise amplifiers, diplexers, and the like.

Memory 120 may be used to store software programs and data. The processor 180 performs various functions of the terminal device 100 and data processing by running software programs or data stored in the memory 120. Memory 120 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device. The memory 120 stores an operating system that enables the terminal device 100 to operate. The memory 120 in the present application may store an operating system and various application programs, and may also store a screen file for executing the method described in the embodiments of the present application.

The display unit 130 may be used to receive input digital or character information, generate signal inputs related to user settings and function controls of the terminal device 100, and in particular, the display unit 130 may include a touch screen 131 provided at the front surface of the terminal device 100, and may collect touch operations on or near the user, such as clicking buttons, dragging scroll boxes, and the like.

The display unit 130 may also be used to display information input by a user or information provided to the user and a graphical user interface (graphical user interface, GUI) of various menus of the terminal device 100. Specifically, the display unit 130 may include a display 132 provided on the front surface of the terminal device 100. The display 132 may be configured in the form of a liquid crystal display, light emitting diodes, or the like. The display unit 130 may be used to display the first control panel or the second control panel described in the present application.

The touch screen 131 may cover the display screen 132, or the touch screen 131 and the display screen 132 may be integrated to implement the input and output functions of the terminal device 100, and after integration, the touch screen may be simply referred to as a touch display screen. The display unit 130 may display an application program and corresponding operation steps.

The camera 140 may be used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the processor 180 for conversion into a digital image signal.

The terminal device 100 may further comprise at least one sensor 150, such as an acceleration sensor 151, a distance sensor 152, a fingerprint sensor 153, a temperature sensor 154. The terminal device 100 may also be configured with other sensors such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, light sensors, motion sensors, and the like.

Audio circuitry 160, speaker 161, microphone 162 may provide an audio interface between the user and terminal device 100. The audio circuit 160 may transmit the received electrical signal converted from audio data to the speaker 161, and the speaker 161 converts the electrical signal into a sound signal and outputs the sound signal. The terminal device 100 may also be configured with a volume button for adjusting the volume of the sound signal. On the other hand, the microphone 162 converts the collected sound signal into an electrical signal, which is received by the audio circuit 160 and converted into audio data, which is output to the RF circuit 110 to be transmitted to, for example, another terminal person to output the audio data to the memory 120 for further processing.

Wi-Fi belongs to a short-range wireless transmission technology, and the terminal device 100 can help a user to send and receive e-mail, browse web pages, access streaming media and the like through the Wi-Fi module 170, so that wireless broadband internet access is provided for the user.

The processor 180 is a control center of the terminal device 100, connects various parts of the entire terminal using various interfaces and lines, and performs various functions of the terminal device 100 and processes data by running or executing software programs stored in the memory 120 and calling data stored in the memory 120. In some embodiments, the processor 180 may include one or more processing units; the processor 180 may also integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., and a baseband processor that primarily handles wireless communications. It will be appreciated that the baseband processor described above may not be integrated into the processor 180. The processor 180 may run an operating system, application programs, user interface displays and touch responses, and the processing methods described in the embodiments of the present application. In addition, the processor 180 is coupled with the display unit 130.

The bluetooth module 18l is configured to interact with other bluetooth devices having bluetooth modules via a bluetooth protocol. For example, the terminal device 100 may establish a bluetooth connection with a wearable electronic device (e.g., a smart watch) also provided with a bluetooth module through the bluetooth module 181, thereby performing data interaction.

The terminal device 100 also includes a power supply 190 (e.g., a battery) that provides power to the various components. The power supply may be logically connected to the processor 180 through a power management system, so that functions of managing charge, discharge, power consumption, etc. are implemented through the power management system. The terminal device 100 may also be configured with a power button for powering on and off the terminal, and locking the screen, etc.

Fig. 1C is a software configuration block diagram of the terminal device 100 of the embodiment of the present application.

The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system may be divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively.

The application layer may include a series of application packages.

As shown in fig. 1C, the application package may include applications for cameras, gallery, calendar, talk, map, navigation, WLAN, bluetooth, music, video, short message, etc.

The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer includes a number of predefined functions.

As shown in FIG. 1C, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.

The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like.

The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, short messages, etc.

The view system includes visual controls, such as controls to display text, controls to display pictures, and the like. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a short message notification icon may include a view displaying text and a view displaying a picture.

The telephony manager is used to provide the communication functions of the terminal device 100. Such as the management of call status (including on, hung-up, etc.).

The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.

The notification manager allows the application to display notification information (e.g., message digest of short message, message content) in a status bar, can be used to convey notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the terminal vibrates, and an indicator light blinks.

Android run time includes a core library and virtual machines. Android run time is responsible for scheduling and management of the Android system.

The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.

The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.

The system library may include a plurality of functional modules. For example: surface manager (surface manager), media Libraries (Media Libraries), three-dimensional graphics processing Libraries (e.g., openGL ES), 2D graphics engines (e.g., SGL), etc.

The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.

Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio video encoding formats, such as: MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.

The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.

A 2D (one way of animation) graphics engine is a drawing engine for 2D drawing.

The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.

The terminal device 100 in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a notebook computer, or the like.

As shown in fig. 2, a flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application is shown, where: in step 201: responding to the voice call instruction, and displaying a first control panel of the controlled terminal;

in one embodiment, the voice call indication may be an incoming call, an outgoing call, of a telephone; the method can also be a voice call request and a video call request of the instant messaging application; other indications with call functionality are also suitable for the present application.

In step 202: and sending a control instruction to the controlled terminal based on the user operation of the first control panel.

In some embodiments, when the user goes home from work, he/she is watching television in living room alone or listening to programs through the intelligent audio, because the user is tired in working for one day, he/she often picks up favorite programs or songs and appropriately increases the volume to relax the mood, if the phone suddenly calls important, he/she often hurry to find the remote controller, and then answer the phone after controlling the television volume through the remote controller, or voice calls the intelligent audio to turn down the volume, or walks to the audio to manually adjust. This not only lengthens the time to make a call, but also makes the user feel restless when making a call, and the user misses the program being watched during the telephone communication process, thereby making the user experience poor.

In this embodiment of the present application, as shown in fig. 3A, a virtual volume adjustment control is set in the first control panel, and based on a user operation on the first control panel, when sending a control instruction to the controlled terminal, the method may be implemented as follows: and responding to the user operation of the virtual volume adjustment control, and sending a volume adjustment instruction to the controlled terminal. The voice call interface in the related art is shown in the left image of fig. 3A, and the first control panel provided in the embodiment of the present application may be an interface (shown in the right image of fig. 3A) obtained by fusing the new function of the present application with the voice call interface in the related art; in another embodiment, as shown in fig. 3B, the first control panel may be displayed in the form of a floating window above the voice call interface in the related art, where the size of the floating window and the position in the voice call interface may be adjusted by the user, for example: if the scaling mark appears by long-time pressing of the floating window by the user, the floating window can be dragged to change the size of the floating window; the position of the floating window can be changed by long pressing other positions except the scaling mark in the floating window and dragging the floating window, and the floating window can be closed by clicking the fork number at the upper right corner.

In the detailed description of fig. 3A, when the user watches television together with family members at home, the volume of the television is often increased because the number of people watching television is relatively large or the hearing of the elder is not very good. When the terminal equipment comes to a telephone or the user is in the process of talking, the user often goes away from a room or an outdoor relatively far away from the television for processing because the user is beside the family. The family also turns down the television volume in order not to affect the user's things, thus creating a negative experience for multiple people. Therefore, the user may click the television volume mute key to mute the television, or the user may not want to mute the television but only want to turn down the volume of the television, as shown in fig. 4, may slide the television mute flag right into the volume adjustment interface as shown in fig. 4 (sliding any virtual adjustment control may enter the volume adjustment interface). It should be appreciated that sliding is but one embodiment of entering a volume adjustment interface, other embodiments are for example: double click, long press, dragging, etc. are also applicable to the present application.

In this application implementation, through adjusting the volume at the conversation in-process, avoided the too big influence of volume conversation also avoided the too little looking of influence other people of volume, great promotion user's experience feel.

In order to avoid missing the program being watched during the telephone communication process, in this embodiment of the present application, as shown in the right image of fig. 3A, a virtual screen recording control is further set in the first control panel, and based on the user operation on the first control panel, when sending the control instruction to the controlled terminal, the method may be implemented as follows: and responding to the user operation of the virtual screen recording control, and sending a screen recording instruction to the controlled terminal. The virtual recording control is further arranged in the first control panel, and a user can control the peripheral sound box to record through clicking the sound box recording control shown in fig. 3A.

For example: the user plays the story with the audio amplifier, but user's cell-phone has received the incoming call this moment, and then the user can be in the conversation process or before answering the phone, and the audio amplifier record of motor, the record is the content that the audio amplifier was playing this moment. By the method, the user can be prevented from missing the content concerned by the user in the conversation process.

For example: as shown in fig. 5, when the user clicks the television screen, the television starts to record the screen at this time, so that the user can end the screen recording, and the television screen recording becomes to end the screen recording after the screen recording is started, and the duration of the screen recording is displayed below.

According to the embodiment of the application, the virtual screen recording control and the virtual recording control are set, so that the screen recording of the television and the recording of the sound box in the conversation process are realized, the problem that a user misses the content because of conversation is avoided, and the experience of the user is greatly improved.

In the embodiment of the application, the terminal equipment and the controlled terminal can communicate through a communication link, and when the communication requirement with the controlled terminal exists, the communication link which is in communication connection with the controlled terminal is selected; and then, using the communication link, performing an operation of transmitting a control instruction to the controlled terminal.

If no communication link is established, a communication mode can be selected to establish communication connection with the controlled terminal. In this embodiment of the present application, the communication link may be bluetooth communication or wireless communication, and since bluetooth communication has the advantage of fast communication speed and stable signal compared with wireless communication, in this embodiment of the present application, a communication connection may be established with a controlled terminal by preferentially adopting a bluetooth communication manner.

In some embodiments, if the communication mode adopted is a bluetooth communication mode, the terminal device sends acknowledgement information to the controlled terminal, and if the reply information sent by the controlled terminal is received, it can be determined that the communication link of bluetooth communication is successfully established. In order to avoid communication delay caused by long waiting for the reply information sent by the controlled terminal, in the embodiment of the application, a waiting time is set, and the reply information sent by the controlled terminal is received in the waiting time, namely, the communication link is established in a mode of successfully passing through Bluetooth communication.

Through the Bluetooth communication mode, communication between the terminal equipment and the controlled terminal is realized, the Bluetooth communication mode is adopted, the communication speed is improved, and signals are stable in the communication process.

In the embodiment of the present application, a communication link may also be established by adopting a wireless network communication manner, and may be implemented as a preferred bluetooth communication, where when any of the following two situations is satisfied, wireless network communication may be considered:

1. bluetooth connection timeout

In another embodiment, if the reply of the controlled terminal is not received after the waiting time, it is determined that the communication with the controlled terminal based on the bluetooth communication mode fails, and the communication can be performed by adopting a wireless network communication mode. In the wireless network communication process, firstly, terminal equipment acquires a wireless network address of a controlled terminal; and determining whether the controlled terminal is in the same wireless network or not based on the wireless network address, if so, establishing a communication link through a communication mode of the wireless network, and then selecting the communication link for communication.

By selecting the wireless network communication mode under the condition of Bluetooth failure, the method for controlling the controlled terminal by adopting the terminal equipment provided by the embodiment of the application is more universal, and the application range is enlarged.

2. N bluetooth connection failures

Since bluetooth communication has a significant advantage over wireless network communication, an upper limit of the number of connection failures of bluetooth communication can also be set in the embodiment of the present application. After the Bluetooth connection fails, the adopted Bluetooth connection mode can be continued until the failure times reach the upper limit, and then the wireless communication mode is adopted.

For example: setting the upper limit of the connection failure times to be 5 times, re-connection is tried again after the first bluetooth connection failure until the wireless network communication is reselected 5 times after the failure. By the method, the probability of success of Bluetooth communication is greatly increased.

In this embodiment of the present application, in addition to displaying the first control panel by using the above method, and adjusting the volume based on the first control panel, it is also possible to: and responding to the pressing operation of the entity volume control, displaying a second control panel, and sending a control instruction to the controlled terminal based on the user operation aiming at the second control panel.

In some embodiments, the controls included in the second control panel and the first control panel may be the same or different. The second control panel comprises at least one of a virtual volume adjustment control and a virtual screen recording control, and comprises any one or combination of the following controls: a media volume adjustment control, a ring volume adjustment control, a notification volume adjustment control, etc. As shown in fig. 6A, the second control panel may include: virtual screen recording control, audio amplifier record control, TV volume control, audio amplifier volume control, media volume control, ringtone volume control, notification volume control. The user can adjust the volume of the controlled terminals such as the television and the sound box in the second control panel through the television volume adjustment control and the sound box volume adjustment control, and can also adjust the volume of the built-in functions such as media, ringtones and notices of the terminal equipment through other volume adjustment controls; in addition, as shown in fig. 6B, the duration of the recording may also be determined by dragging a dragging bar of the television recording, and the duration of the recording may also be determined by dragging a dragging bar of the sound box recording. When dragging, the recorded time length can be displayed for the user to confirm.

The virtual volume adjustment control in the embodiment of the present application may be a button displayed in a screen, as shown in fig. 6C, where double clicking on the virtual volume adjustment control causes a volume adjustment button, clicking on a +number button to increase the volume, and clicking on a-number button to decrease the volume. Of course, the virtual volume control may also be a volume adjustment bar, and dragging the volume adjustment bar as shown in fig. 6B may implement zooming in or zooming out of the volume.

When the virtual volume adjustment control is a button displayed in a screen, a control instruction is sent to the controlled terminal once within a preset time based on user operation; for example: setting the preset time to be one second, and if the user continuously clicks the television for two times of mute in one second, sending a mute instruction to the television only once; if the virtual volume control is a volume adjustment bar, continuously sending a control instruction to the controlled terminal based on user operation; for example: and the user continuously drags the television volume adjusting bar, and then a volume adjusting instruction is sent to the television in real time.

By the method, if the user continuously clicks the virtual volume control in the preset time under the condition that the virtual volume control is a key, the control instruction can be sent once, or n times of control instructions can be sent in the preset time according to the clicking times of the user, but the controlled terminal only executes once; by the method, the resource waste caused by frequently adjusting the equipment according to the control instruction can be effectively saved.

In the embodiment of the present application, in order to determine a reasonable volume recommended value in the case of using wireless network communication, a method for controlling a controlled terminal by using a terminal device is also provided based on the same inventive concept, and the following detailed description is given with reference to the accompanying drawings:

as shown in fig. 7, a flowchart of a method for controlling a controlled terminal by using a terminal device according to an embodiment of the present application is shown, where:

in step 701: responding to the voice call instruction, and detecting the network environment of the controlled terminal;

in some embodiments, when detecting a network environment, a wireless network address prefix of a controlled terminal may be acquired; if the wireless network address prefix of the controlled terminal is the same as that of the controlled terminal, the controlled terminal is determined to be in the same wireless network.

In step 702: if the wireless network is the same as the controlled terminal, determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and/or the first distance between the wireless network and the controlled terminal.

For ease of understanding, the following description is given in three cases:

1. using the signal strength difference and the first distance

1) First determining signal strength difference and then determining first distance

In this embodiment of the present application, in order to determine a reasonable volume, in this embodiment of the present application, the recommended volume may be determined based on the signal strength difference and the first distance, which may be specifically implemented as: determining a signal strength difference from a signal strength of the controlled terminal;

If the signal intensity difference is larger than a first preset value, taking the current volume of the controlled terminal as a recommended volume; if the signal intensity difference is smaller than or equal to a first preset value, adopting a volume value corresponding to the first distance as a recommended volume.

In the embodiment of the application, the fact that the signal strength difference is larger than the first preset value indicates that the distance between the current terminal equipment and the controlled terminal is longer, so that the volume of the controlled terminal does not need to be adjusted. When the signal strength difference is smaller than or equal to a first preset value, the distance between the terminal equipment and the controlled terminal is relatively short, so that the sound volume value of the controlled terminal needs to be adjusted at the moment; when the volume value is adjusted, the recommended volume value corresponding to the current first distance can be determined in a table look-up mode. The table of first distances corresponding to recommended volume values may be determined experimentally by an experimenter in advance and stored in memory for subsequent use.

For example: as shown in table 1, the table of the first distance and the recommended volume value is only an example, and is not exact experimental data.

TABLE 1

2) First determining a first distance and then determining a signal strength difference

In this embodiment of the present application, the sequence of determining the signal intensity difference and the first distance is not limited, and if the first distance is determined first and then the recommended volume is determined according to the signal intensity difference, the method may be implemented as follows: if the first distance is larger than the second distance, the current volume of the controlled terminal is used as the recommended volume; if the first distance is larger than the third distance, the current volume of the controlled terminal is used as the recommended volume; the second distance is greater than the third distance; and if the first distance is smaller than or equal to the third distance, adopting a volume value corresponding to the signal intensity difference as the recommended volume of the controlled terminal.

In the embodiment of the present application, when the first distance is greater than the second distance and the third distance, the current distance between the terminal device and the controlled terminal is indicated to be far, and the volume of the controlled terminal does not affect the terminal device, so the current volume can be used as the recommended volume at this time, and when the first distance is less than the third distance, the current distance between the terminal device and the controlled terminal is indicated to be near, but there are two cases at this time: the controlled terminal and the terminal equipment are in one room, and the controlled terminal and the terminal equipment are not in one room, and the wall is arranged in the middle of the controlled terminal and the terminal equipment, so that the condition is determined by determining the signal strength difference at the moment: if the signal intensity difference is larger than a second preset value, the current volume of the controlled terminal is used as the recommended volume; and if the signal intensity difference is smaller than or equal to a second preset value, adopting a volume value corresponding to the first distance as the recommended volume.

The fact that the signal strength difference is larger than the second preset value indicates that wall separation exists between the terminal equipment and the controlled terminal, and the volume of the controlled terminal cannot influence the terminal equipment at the moment, so that the current volume can be used as the recommended volume at the moment; when the signal intensity difference is smaller than or equal to a second preset value, the controlled terminal and the terminal equipment are in the same room at the moment, and the recommended sound volume value corresponding to the current first distance can be determined through a table look-up mode at the moment.

It should be noted that the first preset value and the second preset value are both experimental measurements and may be the same or different.

For example: as shown in table 2, assuming that the second preset value is 2, the signal strength difference and the recommended volume value are mapped as follows, it should be understood that the data in table 2 is only an example and is not exact experimental data.

TABLE 2

By combining the first distance and the signal intensity difference, the recommended volume can be accurately determined, the user can adjust the volume of the controlled terminal according to the recommended volume, and the experience of the user is greatly improved.

2. By signal strength only

In order to make the present application more generic, in the embodiment of the present application, the determination of the recommended volume may be performed by using only the signal strength, which may be specifically implemented as follows: if the signal intensity difference between the current volume and the controlled terminal is larger than a third preset value, the current volume of the controlled terminal is used as the recommended volume; and if the signal intensity difference between the signal intensity and the controlled terminal is smaller than or equal to a third preset value, adopting a volume value corresponding to the signal intensity difference as a recommended volume.

In the embodiment of the application, the signal strength difference is larger than the third preset value, which indicates that the distance between the terminal equipment and the controlled terminal is longer, so that the current volume of the controlled terminal can be used as the recommended volume; if the signal intensity difference is smaller than or equal to the third preset value, the distance between the terminal equipment and the controlled terminal is relatively short, at this time, table lookup can be performed according to the difference between the terminal equipment and the controlled terminal so as to determine the recommended volume, and the table corresponding to the signal intensity difference and the recommended volume value can be determined in advance by an experimenter according to experiments and stored in a memory for subsequent use.

For example: as shown in table 3, assuming that the third preset value is 2, the signal intensity difference and the recommended volume value are mapped as follows, it should be understood that the data in table 3 is only an example and is not exact experimental data.

Poor signal strength	Recommended volume
		A	Current volume
B	E decibel
		C	F decibel
D	G decibel

TABLE 3 Table 3

The recommended volume is determined only by adopting the signal strength, so that the application is more universal.

3. By only a first distance

In this embodiment of the present application, the determining the recommended volume by using the first distance may be implemented as follows: if the first distance is larger than the fourth distance, the current volume of the controlled terminal is used as the recommended volume; and if the first distance is smaller than or equal to the fourth distance, adopting a volume value corresponding to the first distance as the recommended volume.

In the embodiment of the application, the first distance being greater than the fourth distance indicates that the distance between the terminal equipment and the controlled terminal is longer, and the volume of the controlled terminal does not influence the terminal equipment, so that the current volume can be used as the recommended volume at the moment; the first distance is smaller than or equal to the fourth distance, which means that the distance between the terminal equipment and the controlled terminal is relatively short, at this time, the recommended volume can be determined by looking up a table according to the first distance between the terminal equipment and the controlled terminal, and a table corresponding to the value of the recommended volume can be determined in advance by an experimenter according to experiments and stored in a memory for subsequent use.

For example: as shown in table 4, assuming that the fourth distance is 8 meters, the signal strength difference and the recommended volume value are mapped as follows, and it should be noted that the data in table 4 is only an example and not accurate experimental data.

TABLE 4 Table 4

The second distance, the third distance and the fourth distance can be input by a user or can be a default value.

In step 703: and sending a volume control instruction to the controlled terminal based on the recommended volume.

In the embodiment of the present application, as shown in fig. 6B, the recommended volume is displayed in the control panel of the controlled terminal; based on the recommended volume, sending a volume control instruction to the controlled terminal, which may be implemented to respond to a selection operation of the recommended volume, and sending a volume control instruction to set the volume to the recommended volume to the controlled terminal. In another embodiment, the recommended volume may be displayed in the call interface in the form of a floating ball, as shown in fig. 3A and 3B.

In one embodiment, in order to save the operation steps of the user, the user may set the volume of the controlled terminal in the recommended volume mode in the volume setting in advance, and then the terminal device directly adjusts the volume of the controlled terminal to the recommended volume when the voice call is performed next time, which may be specifically implemented as steps as shown in fig. 8:

In step 801: responding to the voice call instruction, and detecting the network environment of the controlled terminal;

in step 802: if the wireless network is the same as the controlled terminal, determining the recommended volume of the controlled terminal based on the signal strength of the wireless network and/or the first distance between the controlled terminals;

in step 803: determining that the recommended volume mode is in an enabled state;

in step 804: based on the recommended volume, a volume control instruction is sent to instruct the controlled terminal to adjust the volume to the recommended volume.

By the method, the situation that the volume of the controlled terminal is manually adjusted to be the recommended volume each time by a user is avoided, operation steps of the user are saved, and user experience is improved.

For ease of understanding, the control panel-based volume adjustment procedure of the present application is illustrated below:

for example: the user receives the voice call and displays the first control panel in time, as shown in fig. 9, the user can control the volume in the first control panel, if the user wants to adjust the volume of the television, the user slides the volume mute key displayed in the screen, enters the second control panel, and the user can drag the volume of the television to the recommended volume in the second control panel. Of course, the user may select recommended volumes displayed in the first control panel and in the second control panel for control. The specific flow is shown in fig. 10:

In step 1001: receiving a voice call instruction;

in step 1002: judging whether the connection mode between the terminal equipment and the television is Bluetooth connection or not, if so, entering a step 1003, and if not, entering a step 1004;

in step 1003: the terminal equipment sends confirmation information to the television;

in step 1004: determining whether the terminal equipment and the television are in the same network; step 1007 is entered if the network is the same network, and step 1001 is entered if the network is not the same network; if not in the same network, execution may return to 1002;

in step 1005: determining whether the terminal equipment receives the reply message of the television within a preset time, if so, entering a step 1007, and if so, entering a step 1006;

in step 1006: the terminal equipment sends a control instruction to the television;

in step 1007: and determining the recommended volume according to the signal intensity difference and/or the first distance between the terminal equipment and the television.

In step 1008: it is determined whether the recommended volume mode is in, if so, step 1014 is performed, otherwise step 1009 is performed.

In step 1009: displaying a first control panel (shown in fig. 9), wherein the first control panel comprises a floating ball, a virtual volume adjusting control and a virtual screen recording control, and the floating ball is a recommended volume control;

In step 1010: determining the operation type of the user aiming at the first control panel, and if the user is a click operation, entering a step 1011; if the user is a drag operation, go to step 1012; if the volume selected by the user is the recommended volume, go to step 1013;

in step 1011: if multiple clicking operations are received within the preset time, a control instruction is sent to the television once, and the volume of the television is adjusted according to the control instruction;

in step 1012: continuously sending control instructions to the television, and adjusting the volume of the television according to the control instructions;

in step 1013: based on the recommended volume, sending a volume control instruction to the television;

in step 1014: the volume of the television is set to the recommended volume based on the recommended volume, as shown in fig. 11, and the user is prompted in the interface that the television has been adjusted to the recommended volume.

Based on the same inventive concept, the embodiments of the present application also provide a control device of a controlled terminal, the device including at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any one of the methods described above.

It should be noted that although several units or sub-units of the apparatus are mentioned in the above detailed description, such a division is merely exemplary and not mandatory. Indeed, the features and functions of two or more of the elements described above may be embodied in one element in accordance with embodiments of the present application. Conversely, the features and functions of one unit described above may be further divided into a plurality of units to be embodied.

Furthermore, although the operations of the methods of the present application are depicted in the drawings in a particular order, this is not required to or suggested that these operations must be performed in this particular order or that all of the illustrated operations must be performed in order to achieve desirable results. Additionally or alternatively, certain steps may be omitted, multiple steps combined into one step to perform, and/or one step decomposed into multiple steps to perform.

It will be appreciated by those skilled in the art that embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.

The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.

These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.

It will be apparent to those skilled in the art that various modifications and variations can be made in the present application without departing from the spirit or scope of the application. Thus, if such modifications and variations of the present application fall within the scope of the claims and the equivalents thereof, the present application is intended to cover such modifications and variations.

Claims

1. A method for controlling a controlled terminal using a terminal device, the method being applied to the terminal device, the method comprising:

responding to the voice call instruction, and detecting the network environment of the controlled terminal;

if the control terminal is in the same wireless network with the controlled terminal, determining the recommended volume of the controlled terminal based on the signal strength difference between the control terminal and the signal strength and the first distance between the control terminal and the signal strength difference between the control terminal and the first distance between the control terminal and the signal strength difference between the control terminal and the controlled terminal and the first distance between the control terminal and the signal strength difference between the control terminal and the controlled;

If the terminal equipment is determined to be in the recommended volume mode, sending a volume control instruction to the controlled terminal based on the recommended volume; otherwise, displaying a first control panel of the controlled terminal; the first control panel comprises a virtual recording control, and the virtual recording control;

based on the user operation of the first control panel, a control instruction is sent to the controlled terminal;

the sending a control instruction to the controlled terminal based on the user operation of the first control panel includes:

responding to the user operation of the virtual screen recording control, and sending a screen recording instruction to the controlled terminal; or (b)

Responding to user operation of a user on a virtual recording control, and sending a recording instruction to the controlled terminal;

the determining the recommended volume of the controlled terminal based on the signal strength difference between the signal strength of the controlled terminal and the first distance between the controlled terminal comprises:

if the first distance is smaller than the third distance and the signal intensity difference is larger than a second preset value, the current volume of the controlled terminal is used as recommended volume;

and if the first distance is smaller than the third distance and the signal intensity difference is smaller than or equal to the second preset value, adopting a volume value corresponding to the first distance as a recommended volume.

2. The method of claim 1, wherein the first control panel includes a virtual volume adjustment control, and wherein the sending control instructions to the controlled terminal based on user operation of the first control panel includes:

3. The method according to claim 1, wherein the method further comprises:

4. A method according to claim 3, wherein said selecting a communication link with which said controlled terminal is capable of communicating comprises:

5. A method according to claim 3, characterized in that the method further comprises:

6. The method of claim 1, wherein prior to ending the voice call, the method further comprises:

in response to a touch operation of the physical volume adjustment control, a second control panel is presented,

7. The method of claim 6, wherein the second control panel comprises at least one of a virtual volume adjustment control, a virtual screen recording control, and any one or combination of the following: the media volume control, the ringtone volume control, and the notification volume control.

8. A terminal device comprising at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the method of any one of claims 1-7.

9. A computer storage medium, characterized in that the computer storage medium stores a computer program for causing a computer to perform the method of any one of claims 1-7.