WO2020244266A1 - 智能电视的远程控制方法、移动终端和智能电视 - Google Patents

智能电视的远程控制方法、移动终端和智能电视 Download PDF

Info

Publication number
WO2020244266A1
WO2020244266A1 PCT/CN2020/078402 CN2020078402W WO2020244266A1 WO 2020244266 A1 WO2020244266 A1 WO 2020244266A1 CN 2020078402 W CN2020078402 W CN 2020078402W WO 2020244266 A1 WO2020244266 A1 WO 2020244266A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
screenshot
remote control
control operation
server
Prior art date
Application number
PCT/CN2020/078402
Other languages
English (en)
French (fr)
Inventor
管春辉
丁科芝
Original Assignee
聚好看科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 聚好看科技股份有限公司 filed Critical 聚好看科技股份有限公司
Publication of WO2020244266A1 publication Critical patent/WO2020244266A1/zh

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334Recording operations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/4424Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85Assembly of content; Generation of multimedia applications
    • H04N21/858Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H04N21/8586Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot by using a URL

Definitions

  • Some embodiments of the present application relate to smart TV technology, and in particular to a remote control method of a smart TV, a mobile terminal, and a smart TV.
  • Smart TV is a TV product with a chip equipped with an operating system and an application platform that can realize two-way human-computer interaction and integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.
  • smart TVs are becoming more and more popular.
  • this application provides a remote control method for a smart TV, including: the smart TV receives a remote control operation instruction and a second screen capture request information sent by a mobile terminal; and the remote control is not completed on the smart TV When the corresponding control operation corresponding to the operation instruction, it does not respond to the second screenshot request information; when the smart TV completes the corresponding control operation corresponding to the remote control operation instruction, responds to the second screenshot request information to intercept and send The mobile terminal sends the current display interface of the smart TV.
  • this application provides a remote control method for a smart TV, including: the smart TV receives a remote control operation instruction and a second screen capture request information sent by a mobile terminal from a server; When the remote control operation instruction corresponds to the corresponding control operation, it does not respond to the second screenshot request information; when the smart TV completes the corresponding control operation corresponding to the remote control operation instruction, responds to the second screenshot request information to intercept and merge Upload the current display interface of the smart TV to the server, so that the mobile terminal can obtain the intercepted current display interface of the smart TV.
  • this application provides a remote control method for a smart TV, including: the smart TV receives a remote control operation instruction sent by a server; and the corresponding control operation corresponding to the remote control operation instruction is not completed on the smart TV When the current display interface of the smart TV is not intercepted; when the smart TV completes the corresponding control operation corresponding to the remote control operation instruction, the current display interface of the smart TV is intercepted and uploaded to the server, so that The current display interface of the intercepted smart TV is acquired by the mobile terminal.
  • the present application provides a remote control method for a smart TV, including: the smart TV receives first screen capture request information, the first screen capture request information carries first identification information, and the first identification information is a mobile terminal It is determined after receiving the user's operation on the preset control; the smart TV intercepts the current display interface of the smart TV according to the first screenshot request information, and generates a first screenshot according to the first identification information; The smart TV uploads the first screenshot to the server, so that the mobile terminal obtains the first screenshot according to the first identification information.
  • the present application provides a remote control method for a smart TV, including: receiving a user's operation on a preset control, sending first screenshot request information, the first screenshot request information carrying first identification information, The first screen capture request information is used to make the smart TV capture the current display interface of the smart TV, generate and upload a first screenshot to the server, the first identification information is used to identify the first screenshot; the mobile terminal Polling the server according to the first identification information, and receiving and displaying the first screenshot of the server in response to the polling feedback.
  • the present application provides a mobile terminal, including: a display; a processor, the processor is configured to: receive a user's operation on a preset control, and send first screen capture request information, where the first screen capture request information carries First identification information, the first screen capture request information is used to make the smart TV capture the current display interface of the smart TV, generate and upload a first screenshot to the server, the first identification information is used to identify the first screen A screenshot; the mobile terminal polls the server according to the first identification information, and receives and displays the first screenshot of the server in response to the polling feedback on the display.
  • the present application provides a smart TV, including: a display; a processor, the processor is configured to: the smart TV receives a remote control operation instruction sent by a server; when the smart TV has not completed the remote control During the corresponding control operation corresponding to the operation instruction, the current display interface of the display is not intercepted; when the smart TV completes the corresponding control operation corresponding to the remote control operation instruction, the current display interface of the display is intercepted and uploaded to the server Display an interface, so that the mobile terminal can obtain the current display interface of the intercepted display.
  • FIG. 1 is a schematic diagram of an application scenario of some embodiments of this application.
  • FIG. 2 is a block diagram of the hardware configuration of the smart TV 200 in some embodiments of the application.
  • FIG. 3 is a block diagram of the hardware configuration of the control device 100 in some embodiments of the application.
  • FIG. 4 is a schematic diagram of the functional configuration of the smart TV 200 in some embodiments of the application.
  • 5A is a schematic diagram of software configuration in a smart TV 200 in some embodiments of the application.
  • FIG. 5B is a schematic diagram of the configuration of applications in the smart TV 200 in some embodiments of the application.
  • 6A is an interactive flowchart of a remote control method for a smart TV according to some embodiments of the application.
  • FIG. 6B is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 6C is a schematic diagram of an interface of some embodiments of this application.
  • Figure 6D is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 7A is an interaction flowchart of another remote control method for a smart TV according to some embodiments of the application.
  • FIG. 7B is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 8 is a schematic diagram of a system architecture according to some embodiments of the application.
  • FIG. 9A is an interactive flowchart of another remote control method for a smart TV according to some embodiments of the application.
  • FIG. 9B is a schematic diagram of an interface of some embodiments of this application.
  • Figure 9C is a schematic diagram of an interface of some embodiments of this application.
  • Figure 9D is a schematic diagram of an interface of some embodiments of this application.
  • Figure 9E is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 10 is an interactive flowchart of another remote control method for a smart TV according to some embodiments of the application.
  • FIG. 11A is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 11B is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 11C is a schematic diagram of an interface of some embodiments of this application.
  • FIG. 12 is a schematic structural diagram of a mobile terminal according to some embodiments of this application.
  • FIG. 13 is a schematic structural diagram of another mobile terminal according to some embodiments of the application.
  • FIG. 14 is a schematic structural diagram of a smart TV according to some embodiments of the application.
  • module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that can perform functions related to the element.
  • remote control refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance.
  • infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect to the electronic device, and it may also include at least one of functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors.
  • RF radio frequency
  • a handheld touch remote control uses a user interface in a touch screen to replace most of the physical built-in hard keys in general remote control devices.
  • gesture used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.
  • Fig. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. As shown in FIG. 1, the user can operate the smart TV 200 through the mobile terminal 300 and the control device 100.
  • the control device 100 can be a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-distance communication methods, etc., to control the smart TV 200 through wireless or other wired methods.
  • the user can control the smart TV 200 by inputting user instructions through keys on the remote control, voice input, and control panel input.
  • the user can control the Smart TV 200 by inputting corresponding control commands through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch button, etc. on the remote control. Function.
  • mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the smart TV 200.
  • an application running on a smart device is used to control the smart TV 200.
  • the application can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the mobile terminal 300 can install a software application with the smart TV 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication.
  • the mobile terminal 300 can be used to establish a control command protocol with the smart TV 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the smart TV 200 can be realized by controlling the user interface of the mobile terminal 300. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the smart TV 200 to realize the synchronous display function.
  • the smart TV 200 also performs data communication with the server 400 through multiple communication methods.
  • the smart TV 200 may be allowed to communicate through at least one of a local area network (LAN), a wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the smart TV 200.
  • the smart TV 200 receives software program updates through sending and receiving information, and interacting with an electronic program guide (EPG), or accessing a remotely stored digital media library.
  • EPG electronic program guide
  • the server 400 can be one group or multiple groups, and can be one type or multiple types of servers.
  • the server 400 provides other network service content such as video on demand and advertising services.
  • the smart TV 200 may include a liquid crystal display, an OLED display, and a projection display device.
  • the specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the smart TV 200 can make some changes in performance and configuration as required.
  • the smart TV 200 may additionally provide a smart network TV function that provides computer support functions.
  • Fig. 2 exemplarily shows a block diagram of the hardware configuration of the smart TV 200 according to an exemplary embodiment.
  • the smart TV 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, and an audio processor 60-2, At least one of a display 280, an audio output 270, a memory 290, a power supply, and an infrared receiver.
  • the display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images, and a component of the menu control interface.
  • the display 280 includes a display screen component for presenting a picture, and a driving component for driving image display.
  • Display video content it can come from broadcast TV content, or it can be said that various broadcast signals that can be received through wired or wireless communication protocols. Or, it can display various image content received from the network server through the network communication protocol.
  • the display 280 simultaneously displays a user manipulation UI interface generated in the smart TV 200 and used to control the smart TV 200.
  • the display 280 it also includes a driving component for driving the display.
  • the display 280 is a projection display, it may also include a projection device and a projection screen.
  • the display may be a plasma display screen, a liquid crystal display screen, an OLED display screen, or a combination of an optical lens and an optical projection screen.
  • the communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types.
  • the communication interface 230 may be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 or other network communication protocol chips or near field communication protocol chips, and an infrared receiver (not shown in the figure).
  • the smart TV 200 can establish control signal and data signal transmission and reception with an external control device or content providing device through the communication interface 230.
  • the infrared receiver can be used as an interface device for receiving infrared control signals of the control device 100 (such as an infrared remote control, etc.).
  • the detector 240 is used by the smart TV 200 to collect signals from the external environment or interact with the outside.
  • the detector 240 may include a light receiver 242, which is a sensor for collecting the intensity of ambient light, and can adaptively display parameter changes by collecting ambient light.
  • image collector 241 such as camera, camera, etc.
  • image collector 241 can be used to collect external environment scenes, as well as to collect user attributes or interact with user gestures, can adaptively change display parameters, can also recognize user gestures to achieve The function of interaction between users.
  • the detector 240 may also include a temperature sensor.
  • the smart TV 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the color temperature of the displayed image of the smart TV 200 can be adjusted to be relatively cool, or when the temperature is relatively low, the color temperature of the displayed image of the smart TV 200 can be adjusted to be relatively warm.
  • the detector 240 may also include a sound collector, such as a microphone, which may be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the smart TV 200, or to collect environmental sound for Recognizing the environmental scene type, the smart TV 200 can adapt to the environmental noise adaptively.
  • a sound collector such as a microphone
  • the input/output interface 250 is used for data transmission between the smart TV 200 controlled by the controller 210 and other external devices. Such as receiving data such as video signals and audio signals from external devices, or commands and instructions.
  • the input/output interface 250 may include, but is not limited to, the following: a high-definition multimedia interface HDMI interface 251, an analog or data high-definition component input interface 253, a composite video input interface 252, a USB input interface 254, and an RGB port (not shown in the figure) Out) Wait for any one or more interfaces.
  • the input/output interface 250 may also form a composite input/output interface with the aforementioned multiple interfaces.
  • the tuner and demodulator 220 receives broadcast and TV signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate the frequency of the TV channel selected by the user from multiple wireless or cable broadcast and TV signals
  • modulation and demodulation processing such as amplification, mixing and resonance
  • the tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV signal frequency selected by the user and the TV signal carried by the frequency.
  • the tuner and demodulator 220 can receive signals according to different TV signal broadcasting formats, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals; and according to different modulation types, it can be digitally modulated or The modulation method can be simulated. According to different types of received TV signals, analog signals and digital signals can be used.
  • the tuner demodulator 220 may also be in an external device, such as an external set-top box.
  • the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them to the smart TV 200 through the input/output interface 250.
  • the video processor 260-1 is used to receive external video signals and perform decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis and other video processing in accordance with the standard codec protocol of the input signal At least one of the signals can be directly displayed or played on the smart TV 200.
  • the video processor 260-1 includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, and a display formatting module.
  • the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.
  • the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
  • An image synthesis module such as an image synthesizer, is used to superimpose and mix the GUI signal generated by the graphics generator with the zoomed video image according to user input or itself to generate an image signal for display.
  • the frame rate conversion module is used to convert the frame rate of the input video, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate, and the usual format is realized by such as frame insertion.
  • the display formatting module is used to convert the video output signal after receiving the frame rate conversion, and change the signal to conform to the display format signal, such as outputting RGB data signals.
  • the audio processor 260-2 is used to receive external audio signals, and perform at least one of decompression and decoding, as well as noise reduction, digital-to-analog conversion, and amplification processing, according to the standard codec protocol of the input signal, to obtain The sound signal played in the speaker.
  • the video processor 260-1 may include one or more chips.
  • the audio processor 260-2 may also include one or more chips.
  • the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the controller 210 into one or more chips.
  • the audio output 272 under the control of the controller 210, receives the sound signal output by the audio processor 260-2, such as a speaker 272, and other than the speaker 272 carried by the smart TV 200, it can be output to the generator of an external device External audio output terminal 274, such as: external audio interface or headphone jack, etc.
  • the power supply under the control of the controller 210, provides power supply support for the smart TV 200 with power input from an external power supply.
  • the power supply may include a built-in power supply circuit installed inside the smart TV 200, or may be an external power supply installed in the smart TV 200, and a power interface for external power supply is provided in the smart TV 200.
  • the user input interface is used to receive user input signals and then send the received user input signals to the controller 210.
  • the user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.
  • the user inputs user commands through the remote control 100 or the mobile terminal 300, the user input interface is based on the user's input, and the smart TV 200 responds to the user's input through the controller 210.
  • the user may input a user command through a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.
  • the controller 210 controls the work of the smart TV 200 and responds to user operations through various software control programs stored in the memory 290.
  • the controller 210 includes RAM213 and ROM214, graphics processor 216, CPU processor 212, communication interface 218, such as: first interface 218-1 to nth interface 218-n, and at least one of the communication buses One.
  • RAM213 and ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected by a bus.
  • ROM213, used to store various system startup instructions.
  • the CPU processor 212 runs the system start-up instruction in the ROM, and copies the temporary data of the operating system stored in the memory 290 to the RAM 213, so that Start running to start the operating system.
  • the CPU processor 212 copies the temporary data of the various application programs in the memory 290 to the RAM 213, and then starts to run and start the various application programs.
  • the graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive commands input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display 280.
  • the CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.
  • the CPU processor 212 may include multiple processors.
  • the multiple processors may include a main processor and multiple or one sub-processors.
  • the main processor is used to perform some operations of the smart TV 200 in the pre-power-on mode, and/or to display images in the normal mode.
  • the controller 210 may control the overall operation of the display device 100. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.
  • the object may be any one of selectable objects, such as a hyperlink or an icon.
  • Operations related to the selected object for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon.
  • the user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the smart TV 200 or a voice command corresponding to the voice spoken by the user.
  • the memory 290 includes storing various software modules used to drive the smart TV 200.
  • various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is used for signal communication between various hardware in the postpartum care smart TV 200, and the underlying software module that sends processing and control signals to the upper module.
  • the detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.
  • the voice recognition module includes a voice parsing module and a voice command database module.
  • the display control module is a module for controlling the display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces.
  • the communication module is a module used for control and data communication with external devices.
  • the browser module is a module used to perform data communication between browsing servers.
  • the service module is used to provide various services and modules including various applications.
  • the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.
  • Fig. 3 exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment.
  • the control device 100 includes at least one of a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.
  • the control device 100 is configured to control the smart TV 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions that the smart TV 200 can recognize and respond to, and activate the interactive intermediary between the user and the smart TV 200. For example, by operating the channel addition and subtraction keys on the control device 100, the smart TV 200 responds to the channel addition and subtraction operation.
  • control device 100 may be a smart device.
  • the control device 100 can install various applications for controlling the smart TV 200 according to user requirements.
  • the mobile terminal 300 or other smart electronic devices can perform similar functions to control the device 100 after installing an application that controls the smart TV 200.
  • the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 300 or other smart electronic devices by installing applications to realize the function of controlling the physical keys of the device 100.
  • the controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface 218, and a communication bus.
  • the controller 110 is used to control the operation and operation of the control device 100, as well as communication and cooperation between internal components, and external and internal data processing functions.
  • the communication interface 130 realizes the communication of control signals and data signals with the smart TV 200 under the control of the controller 110. For example, the received user input signal is sent to the smart TV 200.
  • the communication interface 130 may include at least one of other near field communication modules such as a WiFi chip, a Bluetooth module, and an NFC module.
  • the user input/output interface 140 where the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144.
  • the user can realize the user instruction input function through voice, touch, gesture, pressing and other actions.
  • the input interface converts the received analog signal into a digital signal and the digital signal into a corresponding instruction signal, and sends it to the smart TV 200.
  • the output interface includes an interface for sending the received user instruction to the smart TV 200.
  • it may be an infrared interface or a radio frequency interface.
  • the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the smart TV 200 via the infrared sending module.
  • a radio frequency signal interface a user input instruction needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the smart TV 200 by the radio frequency transmitting terminal.
  • control device 100 includes at least one of a communication interface 130 and an output interface.
  • the control device 100 is configured with a communication interface 130, such as: WiFi, Bluetooth, NFC and other modules, which can encode user input commands through WiFi protocol, or Bluetooth protocol, or NFC protocol, and send to smart TV 200.
  • the memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller 110.
  • the memory 190 can store various control signal instructions input by the user.
  • the power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. Can battery and related control circuit.
  • FIG. 4 exemplarily shows a functional configuration diagram of the smart TV 200 according to an exemplary embodiment.
  • the memory 290 is used to store an operating system, application programs, content, user data, etc., and executes the system operation of driving the smart TV 200 and responds to various operations of the user under the control of the controller 210.
  • the memory 290 may include volatile and/or non-volatile memory.
  • the memory 290 is specifically used to store operating programs that drive the controller 210 in the smart TV 200, and store various applications built in the smart TV 200, various applications downloaded by users from external devices, and various graphic users related to the applications Interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications.
  • the memory 290 is used to store system software such as an OS kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.
  • the memory 290 is specifically used to store driver programs and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input/output interface of the detector 240.
  • the memory 290 may store software and/or programs.
  • the software programs used to represent an operating system (OS) include, for example, a kernel, middleware, application programming interface (API), and/or application programs.
  • OS operating system
  • the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller , To achieve control or management of system resources.
  • the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, and an optical receiver At least one of a module 2909, a power control module 2910, an operating system 2911, and other application programs 2912, a browser module, and so on.
  • the controller 210 executes various software programs in the memory 290, such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.
  • various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.
  • FIG. 5A exemplarily shows a configuration block diagram of the software system in the smart TV 200 according to an exemplary embodiment.
  • the operating system 2911 includes operating software for processing various basic system services and performing hardware-related tasks, and serves as a medium for data processing completed between application programs and hardware components.
  • part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.
  • part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device.
  • the drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.
  • the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of its display content.
  • the communication module 2911-2 is used to connect to other peripherals via related communication interfaces and communication networks.
  • the user interface module 2911-3 is used to provide objects for displaying the user interface, which can be accessed by various applications and can realize user operability.
  • the control application 2911-4 is used for controllable process management, including runtime applications.
  • the event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand and implemented in the application 2912 at the same time to monitor various user input events. , According to the recognition results of various events or sub-events, it will implement one or more sets of pre-defined operation processing procedures.
  • the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.
  • the event recognition module 2914-1 is used to input the definitions of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute the corresponding one or more groups of processing programs .
  • the event or sub-event refers to the input detected by one or more sensors in the smart TV 200 and the input of an external control device (such as the control device 100).
  • an external control device such as the control device 100.
  • one or more sub-events in the remote control include various forms, including but not limited to one or a combination of pressing up/down/left/right/, the OK key, and pressing the key.
  • non-physical buttons such as moving, pressing, and releasing.
  • the interface layout manager 2913 which directly or indirectly receives various user input events or sub-events monitored by the event transmission system 2914, is used to update the layout of the user interface, including but not limited to the position of each control or sub-control in the interface, and the container
  • the size, position, level, etc. of the interface are related to various execution operations.
  • the application layer 2912 contains various applications that can also be executed on the smart TV 200.
  • the application program may include but is not limited to one or more application programs, such as: live TV application, video on demand application, media center application, application center, game application, etc. At least one of live TV pictures, video-on-demand VOD icons, media center icons, application center icons, and game application icons may be displayed on the display interface.
  • Live TV applications can provide live TV through different sources.
  • a live TV application may use input from cable TV, wireless broadcasting, satellite services, or other types of live TV services to provide TV signals.
  • the live TV application can display the video of the live TV signal on the smart TV 200.
  • Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage containing stored video programs.
  • Media center applications can provide various multimedia content playback applications.
  • the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.
  • Application center can provide storage of various applications.
  • the application program may be a game, an application program, or some other application program that is related to a computer system or other equipment but can be run in a smart TV.
  • the application center can obtain these applications from different sources, store them in the local storage, and then run on the smart TV 200.
  • the TV for example, the smart TV 200
  • the TV has powerful functions and many interface interactions.
  • the smart TV cannot be controlled quickly and accurately.
  • the control efficiency of smart TV is low.
  • some embodiments of the present application provide a remote control method for a smart TV, which allows a remote user to intuitively obtain the current status of the smart TV that needs to be controlled, and remotely control the smart TV , Improve the control efficiency of smart TV.
  • the remote user may be a parent or young person who has certain operating experience.
  • the remote user may control the smart TV at home to provide help for the elderly or children at home.
  • the display device and the mobile terminal in the above-mentioned embodiments are only used as an exemplary introduction, and not as a specific limitation of the display device and/or the mobile device.
  • the mobile terminal can realize remote control of the smart TV 200 through the remote control method of the smart TV in some embodiments of the present application, improve the control efficiency of the smart TV, and enhance the user experience.
  • the following embodiments are illustrated around specific scenarios.
  • the mobile terminal may be a personal computer (Personal Computer, PC for short) or other mobile terminals, etc.
  • the mobile terminal may also be called User Equipment (UE for short), access terminal, user unit, user station , Mobile station, mobile station, user terminal, terminal, wireless communication equipment, user agent or user device.
  • Other mobile terminals can be smart phones, cellular phones, cordless phones, tablet computers, personal digital assistant (PDA) devices, handheld devices with wireless communication functions, or other processing devices connected to wireless modems, and vehicle-mounted devices , Wearable devices, etc.
  • the mobile terminal has an interface for communicating with a cellular network and/or a wireless local area network (Wireless Local Area Networks, WLAN for short).
  • WLAN Wireless Local Area Networks
  • FIG. 6A is an interaction flowchart of a remote control method for a smart TV according to some embodiments of this application.
  • the mobile terminal involved in this embodiment may be any of the above-mentioned mobile terminals.
  • the mobile terminal of this embodiment Methods can include:
  • Step S101 In response to the user's operation, the mobile terminal sends first screenshot request information, the first screenshot request information carries first identification information, and the first identification information is configured to enable the smart TV to identify the first screenshot request information according to the first identification information The corresponding screenshot.
  • the user sends the first screenshot request information for the operation of the preset control.
  • the preset control may be at least one of a “remote monitoring” control, a “click me to re-capture the screen” control, and the like.
  • the mobile terminal may receive a user's trigger and generate a first signal for requesting to turn on remote control.
  • the mobile terminal when it displays a user interface, it can receive a user's trigger and generate a first signal for requesting to turn on remote control.
  • the user's trigger can be a click operation on a certain control on the mobile terminal's user interface.
  • a signal may be a signal for clicking on the control corresponding to the remote control request.
  • the click can be generated by the user's finger, stylus, or other control objects that can be detected by the touch screen.
  • the mobile terminal After the user opens the preset application, the mobile terminal first displays the first user interface 61 shown in FIG. 6B.
  • the first user interface 61 includes a status bar 612, a navigation bar 613, and a content view. 611.
  • the status bar 612 is used to present the signal, time, power and other information of the mobile terminal itself, and is located at the top of the entire first user interface.
  • the navigation bar 613 may also be referred to as a title bar for displaying titles (for example, "My").
  • the content view 611 is used to display various information. This embodiment takes the content view in the form of a list as an example for illustration.
  • the content view may include one or more column bars.
  • Each of the items can be in the form of a single picture or text, or a combination of pictures and text.
  • each item is in the form of text, such as "My Shopping", “Remote Monitoring” and so on.
  • Each column will be distinguished by a dividing line, and it is possible to display only the column without setting a dividing line.
  • Each column in the list is set as a selection control. For example, when the user clicks on the corresponding position of the "Play History" text, the control is triggered and enters the interface corresponding to the control.
  • the interface corresponding to the "Play History” control is It is configured to display the user's viewing history; when the user's finger clicks on the selection control corresponding to the "remote monitoring” text, the mobile terminal is triggered to generate the first signal and jump to the user interface 62 as shown in FIG. 6C.
  • the mobile terminal in response to the first signal, sends first screen capture request information to the smart TV corresponding to the first signal.
  • the first screen capture request information carries first identification information, and the first identification information may be time. Any one or a combination of stamp, random number, or other identification information, the first identification information is used to uniquely identify the file (for example, a screenshot), for example, the first identification information may be a timestamp and a random number, The random number can be a 5-digit random number.
  • the smart TV corresponding to the first signal means that after the user clicks on the “remotely monitored” control (ie, screenshot operation), the mobile terminal generates a first signal indicating that the “remotely monitored” control is selected. The mobile terminal is triggered to query the bound smart smart TV, and the TV is the smart TV corresponding to the first signal.
  • the mobile terminal may directly send the first screenshot request information to the smart TV via the local area network.
  • the first screen capture request information is sent to the smart TV through a server.
  • the server may be a single server or include an interconnection server and a message forwarding server, wherein the interconnection server is connected to the message forwarding server, and the message The forwarding server is connected to the smart TV.
  • the mobile terminal can first send the first screenshot request information to the interconnection server.
  • the interconnection server sends the first screenshot request information to the message forwarding server, and the message forwarding server forwards the first screenshot request information to the smart TV. TV.
  • the mobile terminal can directly send the first screen capture request information in response to the user's operation.
  • the mobile terminal After receiving the user's operation, the mobile terminal directly obtains the current system time of the mobile terminal, and according to the current system time and randomness of the mobile terminal The number, or the time of the current system of the mobile terminal and the unique identifier that characterizes the mobile terminal, generates the first screen capture request message.
  • the first screen capture request information includes the time and random number of the current system of the mobile terminal, or the time of the current system of the mobile terminal and a unique identifier that characterizes the mobile terminal. This can simplify the software process and improve system efficiency.
  • the user after starting the application, the user can call the interface of the application to send the first screen capture request information.
  • the user operation corresponding to the first screenshot request information is the user's first operation.
  • Step S102 The smart TV intercepts the current display interface of the smart TV in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to the image server.
  • the smart TV receives the first screen capture request information sent by the server, and in response to the first screen capture request information, the smart TV captures the current display interface of the smart TV, and uses the first identification information to view the current display interface. Name the screenshot, and upload the first screenshot to the image server.
  • the image server may generate a uniform resource locator (Uniform Resource Locator, URL
  • Uniform Resource Locator
  • the image server is one of the servers, and the server may also include at least one of a semantic analysis server, a message forwarding server, and an application server.
  • Step S103 The mobile terminal obtains a first screenshot from the image server according to the first identification information, and displays the first screenshot.
  • the mobile terminal may receive and obtain the URL corresponding to the first identification information from the image server according to the first identification information, and obtain the first screenshot according to the URL, and the first screenshot is used to display the smart TV.
  • the current state so that the user can remotely operate and control the smart TV based on the current state.
  • the mobile terminal can display the first screenshot on the display screen.
  • the mobile terminal may send polling information containing the first identification information to the image server, and the server feeds back to the mobile terminal according to the polling information.
  • the mobile terminal may also send the first screenshot request information to the image server at the same time.
  • the first instruction containing the first identification information, the image server continuously matches the screenshots corresponding to the first identification information in the first instruction in the uploaded images (for example, the screenshot with the name of the first identification information), and the screenshot or The URL corresponding to the screenshot is sent to the mobile terminal.
  • the mobile terminal may send the first identification information to the image server, and the image server obtains a URL corresponding to the first identification information according to the first identification information, obtains a screenshot based on the URL, and returns the screenshot to the mobile terminal.
  • the terminal After the user selects the "remote monitoring" control, the terminal generates a first signal that indicates that the "remote monitoring" control is selected.
  • the mobile terminal responds to the first signal and the mobile terminal switches
  • the user interface currently displayed, the second user interface 62 shown in FIG. 6C is displayed on the display screen.
  • the second user interface 62 may include a status bar 621, a navigation bar 622, a content view 623 and a button 624.
  • the content view 623 can be in the form of a collection view, which displays information in a tiled form, with pictures as the theme and text as auxiliary information.
  • the content view 623 shown in Figure 6C can display the first screenshot. When the first screenshot is not obtained , The window corresponding to the content view can display the prompt information that the screenshot of the current display interface has not been obtained or the screenshot of the smart TV display interface at the previous point in time.
  • the mobile terminal sends first screen capture request information in response to the user's control operation of selecting "remote monitoring".
  • the first screen capture request information carries first identification information, and the first identification information is configured to enable the smart TV According to the first identification information to identify the screenshot corresponding to the first screenshot request information, the smart TV intercepts the current display interface of the smart TV in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to the image server, and the mobile terminal
  • One identification information obtains the first screenshot from the image server and displays the first screenshot, which is used to display the current state of the smart TV, so that the user can remotely control the smart TV based on the current state, and improve the accuracy of the smart TV control Rate and efficiency.
  • the window corresponding to the content view will also display the first identifier corresponding to the screenshot while displaying the screenshot.
  • the first identifier includes a timestamp
  • the user can determine the window corresponding to the content view through the displayed first identifier. What moment is the screenshot shown.
  • the second user interface may also present different remote control operations in text form at the same time, for example, "return to homepage", “turn off the TV”, “volume down 5", etc.
  • These text-presented controls correspond to different commonly used control instructions. For example, if the user selects the control of'return to homepage', the mobile terminal can send the first control instruction to the smart TV, and the smart TV will follow the received first control Instruction to return to the home page; the user selects the control of'volume reduction by 5', the mobile terminal can send a second control instruction to the smart TV, and the smart TV will perform the operation of reducing the volume by 5 according to the received second control instruction.
  • These commonly used control commands can be adjusted according to the user's historical operations.
  • the interactive interface also includes an input control 624.
  • the user operates the input control 624, and the mobile terminal receives the voice/text input by the user.
  • the input control 624 includes a "press and hold" button 6242 and a switch button 6241.
  • the user presses Hold this button 6242 the mobile terminal receives the voice input by the user through the microphone, the user clicks the switch button 6241, and the mobile terminal displays a text input box on the second user interface to receive the text input by the user in the text input box.
  • the second user interface 62 after the remote monitoring is turned on, the mobile terminal can send the first screen capture request information to the smart TV. After entering the user interaction interface for displaying screenshots, the mobile terminal can receive the user's refresh of the user interaction interface.
  • the user interaction interface shows the screenshot of the current display interface of the smart TV to the user, so that the user can clearly know the current status of the smart TV, and perform remote control operations on the smart TV.
  • the remote control operation can be realized by inputting the corresponding voice/text in the user interface , It can also be realized by the way that the user selects common command controls.
  • the mobile terminal may establish a one-to-one binding relationship with a smart TV, or log in the same account with a smart TV, so as to realize remote control of the smart TV through the above method.
  • the mobile terminal may also establish a binding relationship with multiple smart TVs, or log in to the same account with multiple smart TVs, so that remote control of multiple smart TVs can be realized by the above method.
  • One achievable way, the smart TV that the mobile terminal turns on for remote control this time is the smart TV that was remotely controlled last time, and the other achievable way is to respond to the mobile terminal and simultaneously correspond to multiple smart devices (smart TVs, smart gateways, etc.) Before the display of the mobile terminal switches to the second user interface 62 of FIG.
  • the display of the mobile terminal displays a third user interface 64 as shown in FIG. 6D.
  • the third user interface 64 may include multiple smart TV selection buttons 641, to switch to the second user interface 62 of the smart TV corresponding to the button 641 when the user clicks the corresponding button 641.
  • the mobile terminal may send a scan request carrying mobile terminal ID information and/or account information to the server, and the server queries the smart TV corresponding to the mobile terminal ID information and/or account information according to the pre-bound relationship, if If a communication connection is established between the smart TV and the server, the mobile terminal and the smart TV are connected.
  • the scan request may be sent after the mobile terminal starts the application corresponding to this application, or it may be sent after the user selects a preset control in the application (for example, the ‘remote monitoring’ control).
  • the mobile terminal after the mobile terminal and the smart TV establish a communication connection, the mobile terminal sends the first screen capture request information to the smart TV through the server.
  • a certain command sent by a mobile terminal and a command with the same name sent by the server may be different in specific format, but both need to contain the same information (for example, first identification information such as timestamp, random number, etc.) .
  • the smart TV and the mobile terminal may be located in the same local area network, and the mobile terminal and the smart TV can directly communicate in the local area network without a server.
  • the interface shown in FIG. 6D is displayed according to the first instruction to display the bound device; or when there are multiple bound devices or no bound device
  • the interface shown in FIG. 6D is displayed according to the first instruction, and the interface shown in FIG. 6C is directly displayed according to the first instruction when there is a unique binding device.
  • the mobile terminal determines the binding device corresponding to the first instruction, and then sends the first screen capture request to the corresponding binding device And control the display interface to jump to the interface shown in Figure 6C.
  • the first screen capture request may also be generated and issued in response to a screen capture operation input by the user.
  • the mobile terminal and the server in response to the user selecting the “click me to re-capture the screen” control 6231, the mobile terminal and the server send a first screenshot request to update the screenshot of the smart TV displayed in the display interface 62. This is beneficial for users to obtain screenshots of the TV at any time to understand whether the smart TV responds to the control of the mobile terminal.
  • Fig. 7A is an interactive flowchart of another remote control method for a smart TV according to some embodiments of the application. As shown in Fig. 7A, the remote control method may further include:
  • Step S201 The mobile terminal generates a remote control operation instruction in response to the user's operation.
  • the mobile terminal can receive a user's trigger and generate a second signal for sending a remote control operation instruction.
  • the mobile terminal when it displays the second user interface 62 as shown in FIG. 7B, it may receive user input and generate a second signal for sending a remote control operation instruction.
  • the second signal may be a user click and remote control Generated by the control corresponding to the operation instruction.
  • the click can be generated by the user's finger, stylus, or other control objects that can be detected by the touch screen.
  • the second signal may also be generated based on the voice/text input by the user by operating the input control 624.
  • the "return to home page” control, "turn off TV” control, "volume plus 5", “return to the previous level” control, and "switch to HDMI” control in the interface shown in Figure 7B correspond to the smart TV
  • the operating instructions for controlling the state of itself if the user enters the command sentence of "push weather message", "search for wolf", this instruction corresponds to the operation instruction of providing corresponding functions to the smart TV through the application server.
  • the user can input "return to homepage” through the input control 624, and the mobile terminal generates the second signal according to the user input, and sends a corresponding control instruction according to the second signal.
  • the control instruction is used for the smart TV to perform corresponding operations, for example,
  • the control instruction corresponding to the "return to homepage” is the first control instruction, and the smart TV performs the operation of returning to the homepage according to the first control instruction.
  • the mobile terminal may display the remote control operation instruction input by the user on the currently displayed user interface.
  • a display frame is added to the second user interface 62 as shown in FIG. 7B.
  • the text of the remote control operation instruction input by the user is displayed in the display box, and the display effect can be as shown in FIG. 7B.
  • the second user interface also includes a display box 1.
  • the display box 1 displays The text of the remote control operation instruction, for example, "return to home page".
  • the mobile terminal directly generates a remote control operation instruction in response to the user's operation, and the user's operation corresponding to the remote control operation instruction is the user's second operation.
  • the mobile terminal after receiving the "return to home page" instruction input by the user, the mobile terminal directly generates a remote control operation instruction corresponding to the "return to home page” instruction. This can simplify the software process and improve system efficiency.
  • Step S202 Identify the type of remote control operation instruction.
  • One achievable way is that the mobile terminal recognizes the type of remote control operation instruction, and the other achievable way is that the mobile terminal sends the remote control operation instruction to the semantic recognition server, and the semantic recognition server responds to the type of remote control operation instruction Identify it.
  • the interconnection server 31 is connected to the mobile terminal 1, the application server 32, the semantic recognition server 33, and the message forwarding server 34, and the message forwarding server 34 is also connected to
  • the smart TV 2 is connected, and the smart TV 2 can also be connected to the mobile terminal 1 through a local area network.
  • the mobile terminal sends the remote control operation instruction to the interconnection server 31, and the interconnection server 31 forwards the remote control operation instruction to the semantic recognition server 33.
  • the semantic recognition server 33 recognizes the remote control operation instruction and determines the The type of remote control operation instruction is TV playback control or application function control.
  • the TV playback control instruction refers to the instruction for the smart TV to operate and control the smart TV itself
  • the application function instruction refers to the instruction that the application server can respond to and generate media content for pushing to the TV.
  • TV playback control specifically refers to operating instructions used to control the state of the smart TV itself, such as instructions for controlling volume, instructions for switching channels, etc.
  • application function control specifically refers to The smart TV provides operating instructions for corresponding functions, such as pushing media resources of the application server to the smart TV.
  • Step S203 If the type of the remote control operation instruction is a TV playback control type, the remote control operation instruction is sent to the smart TV, so that the smart TV performs corresponding control operations according to the remote control operation instruction.
  • the remote control operation instruction is sent to the smart TV, and the smart TV performs corresponding control operations according to the remote control operation instruction.
  • the remote control operation instruction can be sent to the smart TV through the interconnection server 31 and the message forwarding server 34.
  • the remote control operation command is to decrease the volume of the TV by 5.
  • Step S204 If the type of the remote control operation instruction is an application function control type, send the remote control operation instruction to the corresponding application server, so that the application server pushes the corresponding media content to the smart TV according to the remote control operation instruction.
  • the mobile terminal sends the remote control operation instruction to the corresponding application server, or the TV sends the remote control operation instruction to the server in response to the mobile terminal’s remote control operation instruction, and the application server
  • the remote control operation instruction pushes the corresponding media content to the smart TV, and the smart TV plays the media content.
  • the remote control operation instruction can be sent to the application server 32 through the interconnection server 31.
  • the mobile terminal receives a user's trigger and generates a first signal for requesting to start remote control.
  • the mobile terminal sends first screenshot request information, and the first screenshot request information carries the first identifier Information
  • the smart TV intercepts the current display interface of the smart TV according to the first screen capture request information, generates a first screenshot according to the first identification information and uploads it to the image server, the mobile terminal obtains the first screenshot from the image server according to the first identification information, and Display the first screenshot, the first screenshot is used to show the current state of the smart TV, so that the user can remotely control the smart TV based on the current state
  • the mobile terminal receives the user's trigger and generates a second for sending remote control operation instructions Signal to identify the type of remote control operation instruction.
  • the remote control operation instruction is sent to the smart TV so that the smart TV performs corresponding control operations according to the remote control operation instruction
  • the type of the remote control operation instruction is application function control
  • the remote control operation instruction is sent to the corresponding application server, so that the application server pushes the corresponding media content to the smart TV according to the remote control operation instruction, thereby realizing the remote control of the smart TV Control, improve the control efficiency of smart TV.
  • all the instructions of the mobile terminal are only sent to the smart TV, and the smart TV determines whether the received instruction is for the operation of the smart TV or the user sends a request to the server.
  • the mobile terminal does not recognize the control operation instruction, but directly sends it to the smart TV through the server.
  • the smart TV receives the control operation instruction, after identifying the remote operation instruction, if the remote control operation instruction is If the type of the smart TV is the TV playback control type, the smart TV performs the corresponding control operation according to the remote control operation instruction. If the type of the remote control operation instruction is the application function control type, the smart TV sends the remote control operation instruction to the corresponding application server to Make the application server push the corresponding media content to the smart TV according to the remote control operation instruction.
  • Figure 9A is an interactive flowchart of another smart TV remote control method according to some embodiments of the application.
  • This embodiment relates to the second screenshot request information, which is different from the first screenshot request information.
  • the second screenshot request information is used for
  • the smart TV acquires a second screenshot, which is the result of remotely controlling the smart TV based on the above first screenshot to learn whether the remote operation is successful.
  • the method of this application may further include:
  • Step S301 The mobile terminal sends second screenshot request information.
  • the second screenshot request information is used to make the smart TV acquire a second screenshot after responding to the remote operation instruction, and the second screenshot request information carries second identification information.
  • the mobile terminal may send the second screenshot request message after sending the remote control operation instruction, or while sending the remote control instruction, so that the mobile terminal can obtain a new screenshot image to show the smart TV response
  • the user can use the new screenshot image displayed on the mobile terminal to determine the next step.
  • the second screen capture request may be triggered by the mobile terminal after receiving a refresh operation from the user.
  • the user sends the second screen capture request while sending the remote operation control instruction.
  • the smart TV responds to the TV playback control instruction or receives the content issued by the server in response to the application function instruction, it responds to the second screen capture request to take a screenshot and upload it.
  • the mobile terminal may send the second screen capture request information to the smart TV through the local area network; or, the mobile terminal may send the second screen capture request information to the smart TV through the interconnection server 31 and the message forwarding server 34.
  • the second screenshot request information is used to request the smart TV to re-take the current display interface of the smart TV, and generate a second screenshot according to the second identification information and upload it to the image server;
  • Step S302 The smart TV re-intercepts the current display interface of the smart TV according to the second screen capture request information, and generates a second screenshot according to the second identification information and uploads it to the image server.
  • the second screenshot is used to display the remote control operation instruction. Operation result.
  • the smart TV receives the second screen capture request information, and in response to the second screen capture request information, the smart TV captures the current display interface of the smart TV again to generate a second screenshot, and names the second screenshot with the second identification information , Upload to the image server.
  • the image server may generate a URL corresponding to the second identification information, and store the second screenshot, which is used to display the operation result of the above remote control operation instruction.
  • the TV after the TV receives the remote operation control command and the second screen capture request information, it determines whether the TV has responded to the remote operation control command, and responds to the second screen capture request after responding to the remote operation control command.
  • the TV after responding to the TV playback control instruction, or after receiving the content issued by the server in response to the application function instruction, responding to the second screen capture request to take a screenshot and upload it.
  • the TV receives the second screen capture request, and the second screen capture request determines whether the TV is responding to the remote operation control command within a preset time period of receiving the remote operation control command, and if it is responding to the remote operation control command During the process of responding to the control command (that is, the corresponding operation is performed according to the command, but the operation is still not completed), the response to the second screen capture request is temporarily suspended and the screen capture operation is not performed, and the progress of the response to the remote operation control command is monitored. After the response to the remote operation control instruction is completed (that is, the corresponding operation is performed according to the instruction, and the operation has been completed), the second screen capture request is responded to. If the response to the remote operation control instruction has been completed (that is, if the corresponding operation is performed according to the instruction, the operation has been completed), the second screen capture request is directly responded to.
  • responding to the remote operation control instruction means that the smart TV executes an operation corresponding to the remote instruction, or the smart TV receives a push file corresponding to the remote operation control instruction sent by the server.
  • the smart TV in response to receiving the second screen capture request, directly responds to the second screen capture request without receiving the remote operation control instruction.
  • Step S303 The mobile terminal obtains a second screenshot from the image server according to the second identification information, and displays the second screenshot, which is used to display the operation result of the remote control operation instruction.
  • the mobile terminal may obtain the URL corresponding to the second identification information from the image server according to the second identification information, and obtain the second screenshot according to the URL, and the second screenshot is used to show the remote control of the smart TV The result of the instruction.
  • the mobile terminal can display the second screenshot on the display screen, so that the user can determine whether the remote operation is successful.
  • the first screen capture request and the second screen capture request may include the same fields, and the content of the fields may change with the scene or time.
  • the corresponding screenshots can also be generated in a similar way.
  • the user can select to present the remote control command shown in Figure 7B after being input, the mobile terminal responds to sending the remote control operation command, the mobile terminal is shown in Figure 7B A display box is added to the second user interface 62 shown, and the instruction sending status is displayed in the display box.
  • the display box 2 displays the text of the instruction sending status, for example, the text "Sending the instruction to the TV".
  • the mobile terminal obtains the screenshot corresponding to the second identification information from the image server, it displays as shown in Figure 9C on the touch screen.
  • the content view in the second user interface 62 displays the screenshot corresponding to the second identification information, that is, the screenshot displayed in the window 6232 corresponding to the content view shown in FIG. 9B is updated to Screenshot corresponding to the second identification information.
  • the screenshot corresponding to the second identification information is received.
  • the second identification information is obtained on the mobile terminal.
  • the screenshot state of the smart TV screen displayed in the window corresponding to the content view shown in FIG. 9C is updated to the screenshot corresponding to the second identification information as shown in FIG. 9D or FIG. 9E.
  • the screenshot is re-acquired as shown in Figure 9D. If the screenshot in the window 6232 does not display the homepage, it means that the current smart TV has not operated in accordance with the remote operation control instruction of "return to homepage” issued in Figure 7B, and the user needs to re- Trigger the "return to home page” remote operation control command. If the newly acquired screenshot displays the home page as shown in FIG. 9E, it means that the current smart TV has operated in accordance with the remote operation control instruction of "return to home page” issued in FIG. 7B.
  • the second screen capture request information is sent through the mobile terminal.
  • the second screen capture request information is used to enable the smart TV to obtain a second screenshot after responding to the remote operation instruction.
  • the second screen capture request information carries second identification information, and the smart TV is based on
  • the second screenshot request information re-takes the current display interface of the smart TV, and generates a second screenshot according to the second identification information and uploads it to the image server.
  • the second screenshot is used to display the operation result of the remote control operation instruction.
  • the second identification information obtains a second screenshot from the image server, and displays the second screenshot.
  • the second screenshot is used to display the operation result of the remote control operation instruction and improve the control efficiency of the smart TV.
  • the smart TV does not need to be triggered by the second screen capture request.
  • the smart TV executes the operation corresponding to the remote operation command and automatically takes a screenshot after the remote operation control command. It may be pre-appointed identification information, and the mobile terminal can poll the server according to the pre-predetermined identification information after issuing a remote operation control instruction.
  • FIG. 10 is an interaction flowchart of another remote control method for a smart TV according to some embodiments of the application. As shown in FIG. 10, the method in this embodiment may further include:
  • Step S401 In response to the user's operation, the mobile terminal sends device query request information, and the device query request information is used to obtain the names of currently available devices.
  • the mobile terminal receives the user's operation and generates a third signal, and in response to the third signal, the mobile terminal sends device query request information.
  • the mobile terminal When the mobile terminal displays a user interface, it can receive a user trigger and generate a third signal for opening the remote monitoring interface.
  • the third signal can be click and Remotely monitor the corresponding controls.
  • the click can be generated by the user's finger, stylus, or other control objects that can be detected by the touch screen.
  • the mobile terminal may send a device query request to the interconnection server to obtain the names of currently available devices, for example, the names of devices such as a smart TV in a bedroom at home and a smart TV in a living room.
  • the mobile terminal directly sends the device query request information in response to the received user operation, and at the same time triggers a signal to open the remote monitoring interface 62. This can simplify the software process and improve system efficiency.
  • Step S402 The currently available device name sent by the interconnection server to the mobile terminal, and the available device name is displayed in a list on the remote monitoring interface displayed by the mobile terminal.
  • the currently available device name is used to request remote control of the corresponding smart TV.
  • the mobile terminal can select a device from the currently available device names to perform the remote control described in the foregoing embodiments.
  • the mobile terminal may display a third user interface 64 as shown in FIG. 6D on which selection buttons 641 of each available device are displayed to provide the user with a selection of available devices.
  • the mobile terminal can respond to the user's operation by sending device query request information to the interconnection server.
  • the device query request information is used to obtain the currently available device name.
  • the currently available device name sent by the interconnection server to the mobile terminal is The available device name is used to request remote control of the corresponding smart TV, so as to realize the flexible selection of the smart TV for remote control and effective remote control of the smart TV.
  • the remote control operation instruction may be generated by the user selecting the control, or the user may input voice through the control 6242, or input text through the control 6241.
  • the mobile device When the user enters through text, the mobile device generates a display box 1 according to the input text and sends the input text to the semantic recognition server, and the semantic recognition server parses the input text to generate remote operation control instructions and send them to the Internet server;
  • the mobile device When the user inputs through the control, the mobile device will generate the display box 1 according to the text corresponding to the control and send the preset remote operation control instruction corresponding to the control to the Internet server; when inputting by voice, the mobile device will The speech is sent to the speech parsing server, and the implicit parsing server sends the parsed text to the mobile terminal to generate the display box 1 and sends the parsed text to the semantic recognition server, and the semantic recognition server parses the parsed text to generate remote operation control The instruction is sent to the Internet server.
  • the mobile terminal may also receive a user's trigger on the second user interface 62 and generate a second signal for sending a remote control operation instruction, for example, through a second user
  • the button 624 of the interface 62 inputs the voice, and the voice is "Turn off the TV".
  • the mobile terminal can send the remote control operation instruction to turn off the TV to the TV through the method of the above-mentioned embodiment of the application, so that the TV performs the operation of turning off the TV.
  • the terminal displays a display box 3 through the second user interface 62, and the display box 3 displays the text of the remote control operation instruction, for example, "turn off the TV". As shown in the second user interface of FIG.
  • the second user interface 62 may also display a display box 4, and the display box 4 displays the text of the instruction sending state, for example, "Sending instruction to TV".
  • the smart TV after the smart TV responds to the remote operation instruction to turn off the TV, it performs a shutdown operation and sends a shutdown response message to the mobile terminal.
  • the mobile terminal may perform the shutdown response message as shown in FIG. 11B according to the shutdown response message.
  • the content view shows a display box 5, which can display the text of the current status of the TV, for example, "Your TV has been turned off" to remind the user that the remote operation cannot continue.
  • the remote operation control command received by the TV is an operation other than the shutdown operation, the shutdown response message is not fed back, but a new screenshot is fed back.
  • the screenshot status of the TV screen displayed in the window corresponding to the content view shown in Minekou 6232 may be updated to display "No TV screenshot information is obtained" text.
  • FIG. 12 is a schematic structural diagram of a mobile terminal according to some embodiments of this application.
  • the mobile terminal of this embodiment may include: a receiving module 11, a processing module 12, and a sending module 13, wherein the processing module 12,
  • the sending module 13 sends the first screenshot request information
  • the first screenshot request information carries first identification information
  • the first identification information is used to make the smart TV according to the
  • the first identification information identifies a screenshot corresponding to the first screen capture request information
  • the first screen capture request information is used to enable the smart TV to capture the current display interface of the smart TV, and will be based on the first identification information Upload the generated first screenshot to the image server
  • the processing module 12 is further configured to poll the image server according to the first identification information, and receive and display the first image server responding to the polling feedback.
  • a screenshot is further configured to poll the image server according to the first identification information, and receive and display the first image server responding to the polling feedback.
  • the processing module 12 is further configured to receive user operations through the receiving module 11 and generate remote control operation instructions of the TV playback control type, where the remote control operation instructions of the TV playback control type are responsive to the smart TV, Instructions for the operation and control of the smart TV itself; the processing module 12 is also used to send a second screenshot request through the sending module 13, and the second screenshot request information is used to make the smart TV respond to the remote control of the TV playback control class After the operation instruction, a second screenshot is obtained.
  • the second screenshot request information carries second identification information, and the second identification information is used to enable the smart TV to identify the second screenshot; the processing module 12 is also used to poll according to the second identification information
  • the image server receives and displays the second screenshot of the image server in response to the polling feedback through the receiving module 11.
  • the processing module 12 is further configured to receive user operations through the receiving module 11 and generate remote control operation instructions of application function instructions, where the remote control operation instructions of the application function instructions refer to the application server can respond, And generate instructions for pushing media content to the TV; the processing module 12 is also used to send a second screenshot request through the sending module 13, and the second screenshot request information is used to make the smart TV respond to the push of the application server After the media content, a second screenshot is obtained.
  • the second screenshot request information carries second identification information, and the second identification information is used to enable the smart TV to identify the second screenshot; the processing module 12 is also used to poll according to the second identification information
  • the image server receives and displays the second screenshot of the image server in response to the polling feedback through the receiving module 11.
  • the processing module 12 may control the sending module 13 to send the first screenshot request information or the second screenshot request information to the smart TV via a local area network; or, the processing module 12 may control the sending module 13 to forward the message via an interconnect server
  • the server sends the first screen capture request information or the second screen capture request information to the smart TV, and a long connection is established between the message forwarding server and the smart TV.
  • the processing module 12 is further configured to send device query request information through the sending module 13 in response to the user's operation before sending the first screen capture request information, where the device query request information is used to obtain the name of the currently available device;
  • the module 11 is also used to receive the currently available device name, and the currently available device name is used to request remote control of the corresponding smart TV.
  • the first identification information includes a current timestamp.
  • the mobile terminal of this embodiment can be used to implement the technical solutions executed by the mobile terminal in the foregoing method embodiments, and its implementation principles and technical effects are similar, and will not be repeated here.
  • FIG. 13 is a schematic structural diagram of another mobile terminal according to some embodiments of the application.
  • the device of this embodiment may include: a memory 21 and a processor 22, where the memory 21 is used to store computer programs and process The device 22 is used to execute the computer program to implement the methods described in the foregoing embodiments.
  • the device in this embodiment can be used to implement the technical solution of the mobile terminal in the above method embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.
  • FIG. 14 is a schematic structural diagram of a smart TV according to some embodiments of the application.
  • the smart TV of this embodiment may include: a receiving module 31, a processing module 32, and a sending module 33, wherein the receiving module 31, Used to receive first screenshot request information, where the first screenshot request information carries first identification information, and the first identification information is used by the smart TV to identify the screenshot corresponding to the first screenshot request information according to the first identification information
  • the processing module 32 is used to capture the current display interface of the smart TV according to the first screen capture request information, and to generate a first screenshot according to the first identification information; the processing module 32 is also used to pass the sending module 33 Upload the first screenshot to the image server.
  • the receiving module 31 is also used to receive remote control operation instructions of the TV playback control type, and perform corresponding control operations according to the remote control operation instructions; or, the processing module 32 is also used to receive and play applications through the receiving module 31
  • the media content pushed by the server is pushed by the application server to the smart TV according to the remote control operation instruction of the application function control class.
  • the receiving module 31 is further configured to receive second screenshot request information.
  • the second screenshot request information is used to make the smart TV obtain a second screenshot after responding to a remote control operation instruction, and the second screenshot request information carries Second identification information;
  • the processing module 32 is configured to re-capture the current display interface of the smart TV according to the second screen capture request information and after responding to a remote control operation instruction, and generate a second screenshot according to the second identification information , Upload the second screenshot to the image server through the sending module 33, and the second screenshot is used to display the operation result of the remote control operation instruction.
  • the application provides a mobile terminal, including: a display; a processor, the processor is configured to: receive a user's operation on a preset control, and send a first screenshot request message, the first screenshot request
  • the information carries first identification information
  • the first screenshot request information is used to enable the smart TV to intercept the current display interface of the smart TV, generate and upload a first screenshot to the server, and the first identification information is used to identify the The first screenshot;
  • the mobile terminal polls the server according to the first identification information, and receives and displays the first screenshot of the server in response to the polling feedback on the display.
  • the present application provides a smart TV, including: a display; a processor, the processor is configured to: the smart TV receives a remote control operation instruction sent by a server; before the smart TV has not completed the During the corresponding control operation corresponding to the remote control operation instruction, the current display interface of the display is not intercepted; when the smart TV completes the corresponding control operation corresponding to the remote control operation instruction, intercept and upload the display to the server The current display interface of the display, so that the mobile terminal can obtain the current display interface of the intercepted display.
  • the smart TV of this embodiment can be used to implement the technical solution of the smart TV in the above method embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.
  • Some embodiments of the present application further provide a computer storage medium, where the computer storage medium is used to store a computer program, and the computer program is used to implement the method described in any of the foregoing embodiments when the computer program is executed. Its realization principle and technique and technical effect are similar, so it will not be repeated here.
  • a person of ordinary skill in the art can understand that all or part of the steps in the foregoing method embodiments can be implemented by a program instructing relevant hardware.
  • the aforementioned program can be stored in a computer readable storage medium.
  • the steps including the foregoing method embodiments are executed; and the foregoing storage medium includes: ROM, RAM, magnetic disk, or optical disk and other media that can store program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Databases & Information Systems (AREA)
  • Software Systems (AREA)
  • User Interface Of Digital Computer (AREA)
  • Selective Calling Equipment (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请一些实施例提供一种智能电视的远程控制方法、移动终端和智能电视。本申请的智能电视的远程控制方法,所述智能电视接收移动终端发送的远程控制操作指令和第二截屏请求信息;在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不响应所述第二截屏请求信息;在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,响应所述第二截屏请求信息截取并向所述移动终端发送所述智能电视的当前显示界面。本申请一些实施例可以提升智能电视的控制准确率和效率。

Description

智能电视的远程控制方法、移动终端和智能电视
本申请要求于2019年06月06日提交中国专利局、申请号为201910486755.X、申请名称为“智能电视的远程控制方法、移动终端和智能电视”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请一些实施例涉及智能电视技术,尤其涉及一种智能电视的远程控制方法、移动终端和智能电视。
背景技术
智能电视,是具备搭载操作***的芯片,拥有应用平台,可实现双向人机交互功能,集影音、娱乐、数据等多种功能于一体,以满足用户多样化和个性化需求的电视产品。随着互联网的发展,智能电视越来越普及。
使用遥控器对智能电视进行相应控制,以满足用户使用需求,例如,观看电视剧、新闻等。然而,智能电视功能强大,界面交互较多,通过遥控器对智能电视进行操控存在一定复杂度,对于老人或者孩子而言,不能快速准确的对智能电视进行相应控制。
发明内容
第一方面,本申请提供了一种智能电视的远程控制方法,包括:所述智能电视接收移动终端发送的远程控制操作指令和第二截屏请求信息;在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不响应所述第二截屏请求信息;在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,响应所述第二截屏请求信息截取并向所述移动终端发送所述智能电视的当前显示界面。
第二方面,本申请提供了一种智能电视的远程控制方法,包括:所述智能电视从服务器接收移动终端发送的远程控制操作指令和第二截屏请求信息;在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不响应所述第二截屏请求信息;在所述智能电视完 成所述远程控制操作指令对应的相应控制操作时,响应所述第二截屏请求信息截取并向所述服务器上传所述智能电视的当前显示界面,以使的所述移动终端获取到所述截取的智能电视的当前显示界面。
第三方面,本申请提供了一种智能电视的远程控制方法,包括:所述智能电视接收服务器发送的远程控制操作指令;在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述智能电视的当前显示界面;在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,截取并向所述服务器上传所述智能电视的当前显示界面,以使的移动终端获取到所述截取的智能电视的当前显示界面。
第四方面,本申请提供了一种智能电视的远程控制方法,包括:智能电视接收第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一标识信息是移动终端在接收到用户对预设控件的操作后确定的;所述智能电视根据所述第一截屏请求信息截取所述智能电视的当前显示界面,并根据所述第一标识信息生成第一截图;所述智能电视上传所述第一截图至服务器,以使所述移动终端根据所述第一标识信息获取所述第一截图。
第五方面,本申请提供了一种智能电视的远程控制方法,包括:接收用户对预设控件的操作,发送第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一截屏请求信息用于使得所述智能电视截取所述智能电视的当前显示界面,生成并上传第一截图至服务器,所述第一标识信息用于标识所述第一截图;所述移动终端根据所述第一标识信息轮询所述服务器,并接收并显示所述服务器响应所述轮询反馈的所述第一截图。
第六方面,本申请提供了一种移动终端,包括:显示器;处理器,所述处理器用于:接收用户对预设控件的操作,发送第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一截屏请求信息用于使得所述智能电视截取所述智能电视的当前显示界面,生成并上传第一截图至服务器,所述第一标识信息用于标识所述第一截图;所述移动终端根据所述第一标识信息轮询所述服务器,并接收并在所述显示器显示所述服务器响应所述轮询反馈的所述第一截图。
第七方面,本申请提供了一种智能电视,包括:显示器;处理器,所述处理器用于:所述智能电视接收服务器发送的远程控制操作指令;在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述显示器的当前显示界面;在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,截取并向所述服务器上传所述显示器的当前显示界面,以使的移动终端获取到所述截取的显示器的当前显示界面。
附图说明
为了更清楚地说明本申请一些实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动性的前提下,还可以根据这些附图获得其他的附图。
图1为本申请一些实施例的一种应用场景示意图;
图2为本申请一些实施例中智能电视200的硬件配置框图;
图3为本申请一些实施例中控制设备100的硬件配置框图;
图4为本申请一些实施例中智能电视200的功能配置示意图;
图5A为本申请一些实施例中智能电视200中软件配置示意图;
图5B为本申请一些实施例中智能电视200中应用程序的配置示意图;
图6A为本申请一些实施例的一种智能电视的远程控制方法的交互流程图;
图6B为本申请一些实施例的一种界面示意图;
图6C为本申请一些实施例的一种界面示意图;
图6D为本申请一些实施例的一种界面示意图
图7A为本申请一些实施例的另一种智能电视的远程控制方法的交互流程图;
图7B为本申请一些实施例的一种界面示意图;
图8为本申请一些实施例的一种***架构的示意图;
图9A为本申请一些实施例的另一种智能电视的远程控制方法的交互流程图;
图9B为本申请一些实施例的一种界面示意图;
图9C为本申请一些实施例的一种界面示意图
图9D为本申请一些实施例的一种界面示意图
图9E为本申请一些实施例的一种界面示意图
图10为本申请一些实施例的另一种智能电视的远程控制方法的交互流程图;
图11A为本申请一些实施例的一种界面示意图;
图11B为本申请一些实施例的一种界面示意图;
图11C为本申请一些实施例的一种界面示意图;
图12为本申请一些实施例的一种移动终端的结构示意图;
图13为本申请一些实施例的另一种移动终端的结构示意图;
图14为本申请一些实施例的一种智能电视的结构示意图。
具体实施方式
为使本申请一些实施例的目的、技术方案和优点更加清楚,下面将结合本申请一些实施例中的附图,对本申请一些实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本文所涉及的术语“第一”、“第二”等是用于区别类似的对象,而不必用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换,以便这里描述的本申请的实施例例如能够以除了在这里图示或描述的那些以外的顺序实施。此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、***、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本申请中使用的术语“模块”,是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。
本申请中使用的术语“遥控器”,是指电子设备(如本申请中公开的显示设备)的一个组件,通常可在较短的距离范围内无线控制电子设备。一般使用红外线和/或射频(RF)信号和/或蓝牙与电子设备连接,也可以包括WiFi、无线USB、蓝牙、动作传感器等功能模块中的至少一个。例如:手持式触摸遥控器,是以触摸屏中用户界面取代一般遥控装置中的大部分物理内置硬键。
本申请中使用的术语“手势”,是指用户通过一种手型的变化或手部运动等动作,用于表达预期想法、动作、目的/或结果的用户行为。
图1中示例性示出了根据实施例中显示设备与控制装置之间操作场景的示意图。如图1中示出,用户可通过移动终端300和控制装置100操作智能电视200。
其中,控制装置100可以遥控器,包括红外协议通信或蓝牙协议通信,及其他短距离通信方式等,通过无线或其他有线方式来控制智能电视200。用户可以通过遥控器上按键,语音输入、控制面板输入等输入用户指令,来控制智能电视200。如:用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令,来实现控制智能电视200的功能。
在一些实施例中,也可以使用移动终端、平板电脑、计算机、笔记本电脑、和其他智能设备以控制智能电视200。例如,使用在智能设备上运行的应用程序控制智能电视200。该 应用程序通过配置可以在与智能设备关联的屏幕上,在直观的用户界面(UI)中为用户提供各种控制。
示例的,移动终端300可与智能电视200安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作的和数据通信的目的。如:可以实现用移动终端300与智能电视200建立控制指令协议,将遥控控制键盘同步到移动终端300上,通过控制移动终端300上用户界面,实现控制智能电视200的功能。也可以将移动终端300上显示音视频内容传输到智能电视200上,实现同步显示功能。
如图1中还示出,智能电视200还与服务器400通过多种通信方式进行数据通信。可允许智能电视200通过局域网(LAN)、无线局域网(WLAN)和其他网络中的至少一个进行通信连接。服务器400可以向智能电视200提供各种内容和互动。示例的,智能电视200通过发送和接收信息,以及电子节目指南(EPG)互动,接收软件程序更新,或访问远程储存的数字媒体库。服务器400可以一组,也可以多组,可以一类或多类服务器。通过服务器400提供视频点播和广告服务等其他网络服务内容。
智能电视200,从显示类型的角度区分,可以包括液晶显示器、OLED显示器、投影显示设备。具体显示设备类型,尺寸大小和分辨率等不作限定,本领技术人员可以理解的是,智能电视200可以根据需要做性能和配置上一些改变。
智能电视200除了提供广播接收电视功能之外,还可以附加提供计算机支持功能的智能网络电视功能。
图2中示例性示出了根据示例性实施例中智能电视200的硬件配置框图。如图2中示出,智能电视200中包括控制器210、调谐解调器220、通信接口230、检测器240、输入\输出接口250、视频处理器260-1,音频处理器60-2,显示器280,音频输出270、存储器290,供电电源、红外接收器中的至少一个。
显示器280,用于接收源自视频处理器260-1输入的图像信号,进行显示视频内容和图像以及菜单操控界面的组件。显示器280包括用于呈现画面的显示屏组件,以及驱动图像显示的驱动组件。显示视频内容,可以来自广播电视内容,也可以是说,可通过有线或无线通信协议接收的各种广播信号。或者,可显示来自网络通信协议接收来自网络服务器端发送的各种图像内容。
同时,显示器280,同时显示智能电视200中产生且用于控制智能电视200的用户操控UI界面。
以及,根据显示器280类型不同,还包括用于驱动显示的驱动组件。或者,倘若显示器 280为一种投影显示器,还可以包括一种投影装置和投影屏幕。在一些实施例中,显示器可以为等离子显示屏,液晶显示屏,OLED显示屏,还可以为光学透镜和光学投影屏幕的组合。
通信接口230是用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如:通信接口230可以是Wifi芯片231,蓝牙通信协议芯片232,有线以太网通信协议芯片233等其他网络通信协议芯片或近场通信协议芯片,以及红外接收器(图中未示出)。
智能电视200可以通过通信接口230与外部控制设备或内容提供设备之间建立控制信号和数据信号发送和接收。以及,红外接收器,可用于接收控制装置100(如:红外遥控器等)红外控制信号的接口器。
检测器240,是智能电视200用于采集外部环境或与外部交互的信号。检测器240可包括光接收器242,用于采集环境光线强度的传感器,可以通过采集环境光可以自适应性显示参数变化等。
以及包括图像采集器241,如相机、摄像头等,可以用于采集外部环境场景,以及用于采集用户的属性或与用户交互手势,可以自适应变化显示参数,也可以识别用户手势,以实现与用户之间互动的功能。
在其他一些实施例中,检测器240,还可包括温度传感器等,如通过感测环境温度,智能电视200可自适应调整图像的显示色温。如当温度偏高的环境时,可调整智能电视200显示图像色温偏冷色调,或当温度偏低的环境时,可以调整智能电视200显示图像偏暖色调。
在其他一些实施例中,检测器240,还可包括声音采集器等,如麦克风,可以用于接收用户的声音,包括用户控制智能电视200的控制指令的语音信号,或采集环境声音,用于识别环境场景类型,智能电视200可以自适应适应环境噪声。
输入/输出接口250,在控制器210的控制智能电视200与外部其他设备间数据传输。如接收外部设备的视频信号和音频信号、或命令指令等数据。
其中,输入/输出接口250可以包括,但不限于如下:可以高清多媒体接口HDMI接口251、模拟或数据高清分量输入接口253、复合视频输入接口252、USB输入接口254、RGB端口(图中未示出)等任一个或多个接口。
在其他一些实施例中,输入/输出接口250也可以上述多个接口形成复合性的输入/输出接口。
调谐解调器220,通过有线或无线接收方式接收广播电视信号,可以进行放大、混频和谐振等调制解调处理,从多多个无线或有线广播电视信号中解调出用户所选择电视频道频率中所携带的电视音视频信号,以及EPG数据信号。
调谐解调器220,可根据用户选择,以及由控制器210控制,响应用户选择的电视信号频率以及该频率所携带的电视信号。
调谐解调器220,可以接收信号的途径,根据电视信号广播制式不同,有很多种,诸如:地面广播、有线广播、卫星广播或互联网广播信号等;以及根据调制类型不同,可以数字调制,也可以模拟调制方式。根据接收电视信号种类不同,可以模拟信号和数字信号。
在其他一些实施例中,调谐解调器220也可在外置设备中,如外置机顶盒等。这样,机顶盒通过调制解调后输出电视音视频信号,经过输入/输出接口250输入智能电视200中。
视频处理器260-1,用于将接收外部视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等等视频处理中的至少一个,可得到直接可智能电视200上显示或播放的信号。
示例的,视频处理器260-1,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等中的至少一个。
其中,解复用模块,用于对输入音视频数据流进行解复用处理,如输入MPEG-2,则解复用模块进行解复用成视频信号和音频信号等。
视频解码模块,则用于对解复用后的视频信号进行处理,包括解码和缩放处理等。
图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示的图像信号。
帧率转换模块,用于对转换输入视频帧率,如将60Hz帧率转换为120Hz帧率或240Hz帧率,通常的格式采用如插帧方式实现。
显示格式化模块,则用于将接收帧率转换后视频输出信号,改变信号以符合显示格式的信号,如输出RGB数据信号。
音频处理器260-2,用于接收外部的音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等处理中的至少一个,得到可以在扬声器中播放的声音信号。
在其他一些实施例中,视频处理器260-1可以包括一颗或多颗芯片组成。音频处理器260-2,也可以包括一颗或多颗芯片组成。
以及,在其他一些实施例中,视频处理器260-1和音频处理器260-2,可以单独的芯片,也可以于控制器210一起集成在一颗或多颗芯片中。
音频输出272,在控制器210的控制下接收音频处理器260-2输出的声音信号,如:扬声器272,以及除了智能电视200自身携带的扬声器272之外,可以输出至外接设备的发生 装置的外接音响输出端子274,如:外接音响接口或耳机接口等。
供电电源,在控制器210控制下,将外部电源输入的电力为智能电视200提供电源供电支持。供电电源可以包括安装智能电视200内部的内置电源电路,也可以是安装在智能电视200外部电源,在智能电视200中提供外接电源的电源接口。
用户输入接口,用于接收用户的输入信号,然后,将接收用户输入信号发送给控制器210。用户输入信号可以是通过红外接收器接收的遥控器信号,可以通过网络通信模块接收各种用户控制信号。
在一些实施例中,用户通过遥控器100或移动终端300输入用户命令,用户输入接口则根据用户的输入,智能电视200则通过控制器210响应用户的输入。
在一些实施例中,用户可在显示器280上显示的图形用户界面(GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。
控制器210,通过存储在存储器290上中各种软件控制程序,来控制智能电视200的工作和响应用户的操作。
如图2所示,控制器210包括RAM213和ROM214以及图形处理器216、CPU处理器212、通信接口218,如:第一接口218-1到第n接口218-n,以及通信总线中的至少一个。其中,RAM213和ROM214以及图形处理器216、CPU处理器212、通信接口218通过总线相连接。
ROM213,用于存储各种***启动的指令。在一些实施例中,如在收到开机信号时,智能电视200电源开始启动,CPU处理器212运行ROM中***启动指令,将存储在存储器290的操作***的临时数据拷贝至RAM213中,以使开始运行启动操作***。当操作***启动完成后,CPU处理器212再将存储器290中各种应用程序的临时数据拷贝至RAM213中,然后,开始运行启动各种应用程序。
图形处理器216,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等。包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象。以及包括渲染器,产生基于运算器得到的各种对象,进行渲染的结果显示在显示器280上。
在一些实施例中,CPU处理器212,用于执行存储在存储器290中操作***和应用程序指令。以及根据接收外部输入的各种交互指令,来执行各种应用程序、数据和内容,以便最 终显示和播放各种音视频内容。
在一些实施例中,CPU处理器212,可以包括多个处理器。多个处理器可包括一个主处理器以及多个或一个子处理器。主处理器,用于在预加电模式中执行智能电视200一些操作,和/或在正常模式下显示画面的操作。多个或一个子处理器,用于在待机模式等状态下一种操作。
控制器210可以控制显示设备100的整体操作。例如:响应于接收到用于选择在显示器280上显示UI对象的用户命令,控制器210便可以执行与由用户命令选择的对象有关的操作。
在一些实施例中,所述对象可以是可选对象中的任何一个,例如超链接或图标。与所选择的对象有关操作,例如:显示连接到超链接页面、文档、图像等操作,或者执行与所述图标相对应程序的操作。用于选择UI对象用户命令,可以是通过连接到智能电视200的各种输入装置(例如,鼠标、键盘、触摸板等)输入命令或者与由用户说出语音相对应的语音命令。
存储器290,包括存储用于驱动智能电视200的各种软件模块。如:存储器290中存储的各种软件模块,包括:基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等。
在一些实施例中,基础模块用于产后护理智能电视200中各个硬件之间信号通信、并向上层模块发送处理和控制信号的底层软件模块。检测模块用于从各种传感器或用户输入接口中收集各种信息,并进行数模转换以及分析管理的管理模块。
在一些实施例中,语音识别模块中包括语音解析模块和语音指令数据库模块。显示控制模块用于控制显示器280进行显示图像内容的模块,可以用于播放多媒体图像内容和UI界面等信息。通信模块,用于与外部设备之间进行控制和数据通信的模块。浏览器模块,用于执行浏览服务器之间数据通信的模块。服务模块,用于提供各种服务以及各类应用程序在内的模块。
在一些实施例中,存储器290还用存储接收外部数据和用户数据、各种用户界面中各个项目的图像以及焦点对象的视觉效果图等。
图3中示例性示出了根据示例性实施例中控制设备100的配置框图。如图3所示,控制设备100包括控制器110、通信接口130、用户输入/输出接口140、存储器190、供电电源180中的至少一种。
控制设备100被配置为控制智能电视200,以及可接收用户的输入操作指令,且将操作指令转换为智能电视200可识别和响应的指令,起用用户与智能电视200之间交互中介作 用。如:用户通过操作控制设备100上频道加减键,智能电视200响应频道加减的操作。
在一些实施例中,控制设备100可是一种智能设备。如:控制设备100可根据用户需求安装控制智能电视200的各种应用。
在一些实施例中,如图1所示,移动终端300或其他智能电子设备,可在安装操控智能电视200的应用之后,可以起到控制设备100类似功能。如:用户可以通过安装应用,在移动终端300或其他智能电子设备上可提供的图形用户界面的各种功能键或虚拟按钮,以实现控制设备100实体按键的功能。
控制器110包括处理器112和RAM113和ROM114、通信接口218以及通信总线。控制器110用于控制控制设备100的运行和操作,以及内部各部件之间通信协作以及外部和内部的数据处理功能。
通信接口130在控制器110的控制下,实现与智能电视200之间控制信号和数据信号的通信。如:将接收到的用户输入信号发送至智能电视200上。通信接口130可包括WiFi芯片、蓝牙模块、NFC模块等其他近场通信模块中至少之一种。
用户输入/输出接口140,其中,输入接口包括麦克风141、触摸板142、传感器143、按键144等其他输入接口中至少一者。如:用户可以通过语音、触摸、手势、按压等动作实现用户指令输入功能,输入接口通过将接收的模拟信号转换为数字信号,以及数字信号转换为相应指令信号,发送至智能电视200。
输出接口包括将接收的用户指令发送至智能电视200的接口。在一些实施例中,可以红外接口,也可以是射频接口。如:红外信号接口时,需要将用户输入指令按照红外控制协议转化为红外控制信号,经红外发送模块进行发送至智能电视200。再如:射频信号接口时,需将用户输入指令转化为数字信号,然后按照射频控制信号调制协议进行调制后,由射频发送端子发送至智能电视200。
在一些实施例中,控制设备100包括通信接口130和输出接口中至少一者。控制设备100中配置通信接口130,如:WiFi、蓝牙、NFC等模块,可将用户输入指令通过WiFi协议、或蓝牙协议、或NFC协议编码,发送至智能电视200.
存储器190,用于在控制器110的控制下存储驱动和控制控制设备200的各种运行程序、数据和应用。存储器190,可以存储用户输入的各类控制信号指令。
供电电源180,用于在控制器110的控制下为控制设备100各元件提供运行电力支持。可以电池及相关控制电路。
图4中示例性示出了根据示例性实施例中智能电视200功能配置示意图。如图4所示, 存储器290用于存储操作***、应用程序、内容和用户数据等,在控制器210控制下执行驱动智能电视200的***运行以及响应用户的各种操作。存储器290可以包括易失性和/或非易失性存储器。
存储器290,具体用于存储驱动智能电视200中控制器210的运行程序,以及存储智能电视200内置各种应用程序,以及用户从外部设备下载的各种应用程序、以及与应用相关各种图形用户界面,以及与图形用户界面相关的各种对象,用户数据信息,以及各种支持应用的内部数据。存储器290用于存储OS内核、中间件和应用等***软件,以及存储输入的视频数据和音频数据、及其他用户数据。
存储器290,具体用于存储音视频处理器260-1和260-2、显示器280、通信接口230、调谐解调器220、检测器240输入/输出接口等驱动程序和相关数据。
在一些实施例中,存储器290可以存储软件和/或程序,用于表示操作***(OS)的软件程序包括,例如:内核、中间件、应用编程接口(API)和/或应用程序。示例性的,内核可控制或管理***资源,或其它程序所实施的功能(如所述中间件、API或应用程序),以及内核可以提供接口,以允许中间件和API,或应用访问控制器,以实现控制或管理***资源。
示例的,存储器290,包括广播接收模块2901、频道控制模块2902、音量控制模块2903、图像控制模块2904、显示控制模块2905、音频控制模块2906、外部指令识别模块2907、通信控制模块2908、光接收模块2909、电力控制模块2910、操作***2911、以及其他应用程序2912、浏览器模块等等中的至少一种。控制器210通过运行存储器290中各种软件程序,来执行诸如:广播电视信号接收解调功能、电视频道选择控制功能、音量选择控制功能、图像控制功能、显示控制功能、音频控制功能、外部指令识别功能、通信控制功能、光信号接收功能、电力控制功能、支持各种功能的软件操控平台、以及浏览器功能等其他应用。
图5A中示例性示出了根据示例性实施例中智能电视200中软件***的配置框图。
如图5A中所示,操作***2911,包括用于处理各种基础***服务和用于实施硬件相关任务的执行操作软件,充当应用程序和硬件组件之间完成的数据处理的媒介。一些实施例中,部分操作***内核可以包含一系列软件,用以管理显示设备硬件资源,并为其他程序或软件代码提供服务。
其他一些实施例中,部分操作***内核可包含一个或多个设备驱动器,设备驱动器可以是操作***中的一组软件代码,帮助操作或控制显示设备关联的设备或硬件。驱动器可以包含操作视频、音频和/或其他多媒体组件的代码。示例的,包括显示屏、摄像头、Flash、WiFi和音频驱动器。
其中,可访问性模块2911-1,用于修改或访问应用程序,以实现应用程序的可访问性和对其显示内容的可操作性。
通信模块2911-2,用于经由相关通信接口和通信网络与其他外设的连接。
用户界面模块2911-3,用于提供显示用户界面的对象,以供各应用程序可访问,可实现用户可操作性。
控制应用程序2911-4,用于可控制进程管理,包括运行时间应用程序等。
事件传输***2914,可在操作***2911内或应用程序2912中实现,以一些实施例中,一方面在在操作***2911内实现,同时在应用程序2912中实现,用于监听各种用户输入事件,将根据各种事件指代响应各类事件或子事件的识别结果,而实施一组或多组预定义的操作的处理程序。
其中,事件监听模块2914-1,用于监听用户输入接口输入事件或子事件。
事件识别模块2914-1,用于对各种用户输入接口输入各类事件的定义,识别出各种事件或子事件,且将其传输给处理用以执行其相应一组或多组的处理程序。
其中,事件或子事件,是指智能电视200中一个或多个传感器检测的输入,以及外界控制设备(如控制设备100等)的输入。如:语音输入各种子事件,手势识别的手势输入,以及控制设备的遥控按键指令输入的子事件等。示例的,遥控器中一个或多个子事件包括多种形式,包括但不限于按键按上/下/左右/、确定键、按键按住等中一个或组合。以及非实体按键的操作,如移动、按住、释放等操作。
界面布局管理器2913,直接或间接接收来自于事件传输***2914监听到各用户输入事件或子事件,用于更新用户界面的布局,包括但不限于界面中各控件或子控件的位置,以及容器的大小或位置、层级等与界面布局相关各种执行操作。
如图5B中所示,应用程序层2912包含也可在智能电视200执行的各种应用程序。应用程序可包含但不限于一个或多个应用程序,如:直播电视应用程序、视频点播应用程序、媒体中心应用程序、应用程序中心、游戏应用等。显示界面上可以显示直播电视图片,视频点播VOD图标,媒体中心图标,应用程序中心图标,游戏应用图标中的至少一个。
直播电视应用程序,可以通过不同的信号源提供直播电视。例如,直播电视应用程可以使用来自有线电视、无线广播、卫星服务或其他类型的直播电视服务的输入提供电视信号。以及,直播电视应用程序可在智能电视200上显示直播电视信号的视频。
视频点播应用程序,可以提供来自不同存储源的视频。不同于直播电视应用程序,视频点播提供来自某些存储源的视频显示。例如,视频点播可以来自云存储的服务器端、来自包 含已存视频节目的本地硬盘储存器。
媒体中心应用程序,可以提供各种多媒体内容播放的应用程序。例如,媒体中心,可以为不同于直播电视或视频点播,用户可通过媒体中心应用程序访问各种图像或音频所提供服务。
应用程序中心,可以提供储存各种应用程序。应用程序可以是一种游戏、应用程序,或某些和计算机***或其他设备相关但可以在智能电视中运行的其他应用程序。应用程序中心可从不同来源获得这些应用程序,将它们储存在本地储存器中,然后在智能电视200上可运行。
如上所述,电视(例如,智能电视200)功能强大,界面交互较多,通过遥控器对智能电视进行操控存在一定复杂度,对于老人或者孩子而言,不能快速准确的对智能电视进行相应控制,智能电视的控制效率较低。
为了解决上述技术问题,本申请一些实施例提供一种智能电视的远程控制方法,该远程控制方法可以使得远程用户直观的获取需要进行控制的智能电视的当前状态,并对该智能电视进行远程控制,提升智能电视的控制效率。例如,远程用户可以是家长或年轻人,其具有一定操作经验,远程用户可以对家中的智能电视进行控制,以为家中老人或孩子提供帮助。
在一些实施例中,上述实施例中的显示设备、移动终端仅作为一种示例性的介绍,而不作为为显示设备和/或移动设备的具体限定。
以图1所示场景为例进行说明,移动终端可以通过本申请一些实施例的智能电视的远程控制方法,实现对智能电视200的远程控制,提升智能电视的控制效率,提升用户使用体验。下述实施例围绕具体场景进行举例说明。
其中,该移动终端可以是个人电脑(Personal Computer,简称:PC)或者其他移动终端等,该移动终端也可以称为用户设备(User Equipment,简称:UE)、接入终端、用户单元、用户站、移动站、移动台、用户终端、终端、无线通信设备、用户代理或用户装置。其他移动终端可以是智能手机、蜂窝电话、无绳电话、平板电脑、个人数字处理(Personal Digital Assistant,简称:PDA)设备、具有无线通信功能的手持设备或连接到无线调制解调器的其它处理设备、车载设备、可穿戴设备等。在本申请一些实施例中,该移动终端具有与蜂窝网络和/或无线局域网络(Wireless Local Area Networks,简称:WLAN)进行通信的接口。
其具体实现方式可以参见下述实施例的解释说明。
图6A为本申请一些实施例的一种智能电视的远程控制方法的交互流程图,本实施例所涉及的移动终端可以是如上述任一种移动终端,如图6A所示,本实施例的方法可以包括:
步骤S101、移动终端响应于用户的操作,发送第一截屏请求信息,该第一截屏请求信息携带第一标识信息,第一标识信息被配置使智能电视根据第一标识信息标识第一截屏请求信息对应的截图。
在一些实施例中,用户对预设控件的操作,发送第一截屏请求信息。预设控件可以是“远程监控”控件,“点我重新截取屏幕”控件等中的至少一个。
在一些实施例中,移动终端可以接收用户的触发并生成用于请求开启远程控制的第一信号。
其中,移动终端在显示一用户界面时,可以接收用户的触发并生成用于请求开启远程控制的第一信号,用户的触发可以是对移动终端用户界面上的某一控件的点击操作,该第一信号可以是点击与开启远程控制请求对应的控件的信号。点击可以是由用户的手指、触控笔或其它可以被触控显示屏所检测到的控制物体作用产生。
作为一个示例,请参考图6B,在用户打开预设应用后,移动终端首先显示如图6B所示的第一用户界面61,该第一用户界面61包括状态栏612、导航栏613和内容视图611,其中,该状态栏612用于呈现移动终端自身的信号、时间、电量等信息,位于整个第一用户界面的顶部,该导航栏613也可以称为标题栏,用于显示标题(例如,“我的”),于状态栏下方,该内容视图611用于展示各个信息,本实施例以列表形式的内容视图为例做举例说明,内容视图可以包括一条或多条栏目条,内容视图中的每一条可以是单条的图片形式或文本形式,也可以是图文结合的方式,例如,如图6B所示,每一条为文字形式,例如,“我的购物”、“远程监控”等。各栏目条之间会用分割线进行区分,可以不设置分割线只显示栏目条。该列表中的每一栏目条被设置为选择控件,例如:当用户点击“播放历史”文字对应位置的时候,触发该控件,并进入该控件对应的界面,“播放历史”控件对应的界面被配置为展示用户的观看历史;当用户的手指点击“远程监控”文字对应的选择控件时,触发移动终端生成该第一信号并跳转至如图6C所示的用户界面62。
其中,移动终端响应于该第一信号,移动终端向与该第一信号对应的智能电视发送第一截屏请求信息,该第一截屏请求信息携带第一标识信息,该第一标识信息可以是时间戳、随机数、或者其他标识信息中任意一项或其组合,该第一标识信息用于唯一标识文件(例如,截图),举例而言,该第一标识信息可以是时间戳和随机数,该随机数可以是5位随机数。与该第一信号对应的智能电视在一些实施例中是指,用户在点击“远程监控的”控件(即截 屏操作)后,移动终端生成表征“远程监控的”控件被选中的第一信号,触发移动终端查询绑定的智能智能电视,该电视就是和第一信号对应的智能电视。
在一些实施例中,移动终端可以通过局域网将该第一截屏请求信息直接发送到智能电视。
在一些实施例中,通过服务器将该第一截屏请求信息发送到智能电视,例如,该服务器可以是单个服务器或包括互联服务器和消息转发服务器,其中,该互联服务器与消息转发服务器连接,该消息转发服务器与智能电视连接,移动终端可以先将第一截屏请求信息发送给互联服务器,互联服务器将该第一截屏请求信息发送给消息转发服务器,消息转发服务器将该第一截屏请求信息转发给智能电视。
在一些实施例中,移动终端可以响应用户的操作直接发送第一截屏请求信息,移动终端在接收到用户的操作后,直接获取移动终端当前***的时间,并根据移动终端当前***的时间和随机数,或移动终端当前***的时间和表征本移动终端的唯一标识,生成第一截屏请求信息。第一截屏请求信息中包含移动终端当前***的时间和随机数,或移动终端当前***的时间和表征本移动终端的唯一标识。如此可以简化软件流程提升***效率。示例性的,用户启动应用之后,即可调用应用的接口进行第一截屏请求信息的发送。
在一些实施例用对应第一截屏请求信息的用户操作是用户的第一操作。
步骤S102、智能电视响应于第一截屏请求信息截取智能电视的当前显示界面,生成第一截图,并上传第一截图至图像服务器。
在一些实施例中,智能电视接收到服务器发送的第一截屏请求信息,响应于该第一截屏请求信息,智能电视截取智能电视的当前显示界面,以该第一标识信息对该当前显示界面的截图进行命名,并将生成的第一截图上传至图像服务器。图像服务器可以生成与该第一标识信息对应的统一资源定位符(Uniform Resource Locator,URL|),并存储该第一截图。本申请实施例的图像服务器可以用于存储各个时刻智能电视显示界面的截图。
在一些实施例中,图像服务器是服务器中的一种,服务器还可以包括语义解析服务器,消息转发服务器,应用服务器等中的至少有一个。
步骤S103、移动终端根据第一标识信息从图像服务器获取第一截图,并显示第一截图。
在一些实施例中,移动终端可以接收并根据该第一标识信息,从图像服务器获取与该第一标识信息对应的URL,根据URL获取该第一截图,该第一截图用于展示智能电视的当前状态,以使得用户基于当前状态对智能电视进行远程操作控制。移动终端可以通过显示屏显示该第一截图。
在一些实施例中,移动终端可以向图像服务器发送包含第一标识信息的轮询信息,服务 器根据轮询信息向移动终端反馈,移动终端也可以在发送第一截屏请求信息的同时向图像服务器发送包含第一标识信息的第一指令,图像服务器在上传的图像中不断匹配和第一指令中第一标识信息相对应截图(例如名称为第一标识信息的截图),并把匹配成功的截图或截图对应的URL发给移动终端。
在一些实施例中,移动终端可以将该第一标识信息发送给图像服务器,图像服务器根据该第一标识信息获取与其对应的URL,并基于URL获取截图,向移动终端返回该截图。
以上述示例做进一步举例说明,请参考图6B,在用户选中“远程监控”的控件后,终端生成表征“远程监控”控件被选中的第一信号,移动终端响应于第一信号,移动终端切换当前显示的用户界面,在显示屏上显示如图6C所示的第二用户界面62,在该第二用户界面62可以包括状态栏621、导航栏622、内容视图623和按钮624,该内容视图623可以是集合视图形式,将信息用平铺的形式展现,以图片为主题,文字为辅助信息,如图6C所示的内容视图623可以展示该第一截图,在未获取到第一截图时,内容视图对应的窗口可以展示未获取到当前显示界面截图的提示信息或上一个时间点的智能电视显示界面截图。
在一些实施例中,通过移动终端响应于用户的选中“远程监控”的控件操作,发送第一截屏请求信息,该第一截屏请求信息携带第一标识信息,第一标识信息被配置使智能电视根据第一标识信息标识第一截屏请求信息对应的截图,智能电视响应于第一截屏请求信息截取智能电视的当前显示界面,生成第一截图,并上传第一截图至图像服务器,移动终端根据第一标识信息从图像服务器获取第一截图,并显示第一截图,该第一截图用于展示智能电视的当前状态,以使得用户可以基于当前状态对智能电视进行远程控制,提升智能电视的控制准确率和效率。
在一些实施例中,内容视图对应的窗口在展示截图的同时还会展示截图对应的第一标识,第一标识包含时间戳时,用户即可通过展示的第一标识来判断内容视图对应的窗口展示的截图是什么时刻的。
在一些实施例中,该第二用户界面中还可以同时以文字形式呈现不同远程控制操作,例如,“返回到主页”、“关闭电视”、“音量减5”等。这些文字呈现的控件分别对应不同的常用的控制指令,例如:用户选择‘返回到主页’的控件,则移动终端可以将第一控制指令发送给智能电视,智能电视会根据接收到的第一控制指令进行返回到主页的操作;用户选择‘音量减5’的控件,则移动终端可以将第二控制指令发送给智能电视,智能电视会根据接收到的第二控制指令进行音量减少5的操作。这些常用的控制指令可以根据用户的历史操作进行调整。该交互界面中还包括输入控件624,用户对该输入控件624进行操作,移动终 端接收用户输入的语音/文本,例如,该输入控件624包括“按住说话”按钮6242和切换按钮6241,用户按住该按钮6242,移动终端通过话筒接收用户输入的语音,用户点击切换按钮6241,移动终端在第二用户界面上显示文本输入框,以在文本输入框中接收用户输入的文本。通过该第二用户界面62,可以在开启远程监控后,移动终端可以向智能电视发送第一截屏请求信息,在进入展示截图的用户交互界面后,移动终端可以接收用户对用户交互界面中的刷新控件625来重新发送截屏请求信息。用户交互界面将智能电视当前显示界面的截图展示给用户,使得用户可以清楚获知智能电视的当前状态,对智能电视进行远程控制操作,该远程控制操作可以通过在用户界面输入相应的语音/文本实现,还可以通过用户选择常用指令控件的方式来实现。
在一些实施例中,移动终端可以与智能电视建立有一对一的绑定关系,或者与一个智能电视登录相同的账号,从而通过上述方法实现对该智能电视的远程控制。在一些实施例中,移动终端也可以与多个智能电视建立绑定关系,或者与多个智能电视登录相同的账号,从而可以通过上述方法实现对多个智能电视的远程控制。一种可实现方式,移动终端本次开启远程控制的智能电视为上一次远程控制的智能电视,另一种可实现方式,响应于移动终端同时对应多个智能设备(智能电视,智能网关等),在移动终端的显示器切换至图6C的第二用户界面62之前,移动终端的显示器显示如图6D所示的第三用户界面64,该第三用户界面64可以包括多个智能电视的选择按钮641,以在用户点击相应的按钮641时,切换至该按钮641对应的智能电视的第二用户界面62。
在一些实施例中,移动终端可以发送携带移动终端ID信息和/或账号信息的扫描请求给服务器,服务器根据预先绑定的关系,查询移动终端ID信息和/或账号信息对应的智能电视,如果智能电视和服务器建立有通信连接则,则连通该移动终端和智能电视。
在一些实施例中,扫描请求可以是在移动端启动本申请对应的应用后发出的,也可以是用户选中应用中的预设控件(例如:‘远程监控’控件)后发出的。
在一些实施例中,在移动终端和智能电视建立通信连接后,移动终端通过服务器发送第一截屏请求信息给智能电视。
在一些实施例中,移动终端发出的某一个指令和服务器发送的相同命名的指令,在具体格式上可以有区别,但均需包含相同的信息(例如时间戳,随机数等第一标识信息)。
在一些实施例中,智能电视和移动终端可以位于同一局域网中,移动终端和智能电视无需服务器可以直接在局域网内进行通信连接。
在一些实施例总,用户选中“远程监控”的控件后,根据所述第一指令显示图6D所示 的界面,以呈现绑定的设备;或者是在存在多个绑定设备或没有绑定设备时根据所述第一指令显示图6D所示的界面,在存在唯一绑定设备时根据所述第一指令直接显示图6C所示的界面。在显示图6D所示的界面后,根据用户选择的对应不同绑定设备的“选择控件”,移动终端确定第一指令对应的绑定设备,然后将第一截屏请求发送给对应的绑定设备并控制显示界面跳转至图6C所示的界面。
在一些实施例中,第一截屏请求还可以响应于用户输入的截屏操作生成并发出。示例性的,在如图6C所示的界面中,响应于用户选中“点我重新截取屏幕”控件6231,移动终端相服务器发送第一截屏请求以更新显示界面62中显示的智能电视的截图。这样有利于用户随时获取电视的截图以了解智能电视是否响应了移动终端的控制。
图7A为本申请一些实施例的另一种智能电视的远程控制方法的交互流程图,如图7A所示,远程控制方法还可以包括:
步骤S201、移动终端响应于用户的操作,生成远程控制操作指令。
一种可实现方式,移动终端可以接收用户的触发并生成用于发送远程控制操作指令的第二信号。
作为一种示例,移动终端在显示如图7B的第二用户界面62时,可以接收用户的输入并生成用于发送远程控制操作指令的第二信号,该第二信号可以是用户点击与远程控制操作指令对应的控件生成的。点击可以是由用户的手指、触控笔或其它可以被触控显示屏所检测到的控制物体作用产生。该第二信号也可以是根据用户通过操作输入控件624输入的语音/文本生成的。
例如,图7B所示的界面中“返回到主页”控件、“关闭电视”控件、“音量加5”、“返回到上一级”控件、“切换到HDMI”控件等对应的是对智能电视本身的状态进行控制的操作指令,如果用户输入了“推送天气消息”,“搜索战狼”的命令语句,该指令对应通过应用服务器以向智能电视提供相应功能的操作指令。用户可以通过输入控件624输入“返回到主页”,移动终端根据用户输入产生该第二信号,并根据该第二信号发送相应的控制指令,该控制指令用于智能电视进行相应的操作,例如,与该“返回到主页”对应的控制指令为第一控制指令,智能电视根据该第一控制指令进行返回到主页的操作。
作为一种示例,响应于该第二信号,移动终端可以在当前显示的用户界面上显示用户输入的远程控制操作指令,例如,在如图7B所示的第二用户界面62中增加显示显示框,在显示框中显示用户输入的远程控制操作指令的文本,其显示效果可以如图7B所示,如图7B所示该第二用户界面中还包括显示框1,该显示框1中显示有该远程控制操作指令的文本,例 如,“返回到主页”。
在另一些实施例中,移动终端响应于用户的操作直接生成远程控制操作指令,对应远程控制操作指令的用户的操作是用户的第二操作。示例性的,移动终端在接收到用户输入的“返回主页”指令后,直接生成对应“返回主页”指令的远程控制操作指令。如此可以简化软件流程提升***效率。
步骤S202、识别远程控制操作指令的类型。
一种可实现方式,由移动终端对远程控制操作指令的类型进行识别,另一种可实现方式,移动终端将远程控制操作指令发送给语义识别服务器,由语义识别服务器对远程控制操作指令的类型进行识别。
作为一种示例,参照图8所示的***架构,如图8所示,互联服务器31分别与移动终端1、应用服务器32、语义识别服务器33、消息转发服务器34连接,消息转发服务器34还与智能电视2连接,智能电视2还可以通过局域网与移动终端1连接。响应于该第二信号,移动终端将远程控制操作指令发送给互联服务器31,互联服务器31转发该远程控制操作指令至语义识别服务器33,语义识别服务器33对该远程控制操作指令进行识别,确定该远程控制操作指令的类型是电视播放控制类,还是应用功能控制类。其中,电视播放控制类指令是指用于智能电视可响应的对于智能电视本身进行操作和控制的指令,应用功能类指令是指应用服务器可以响应的,并生成用于推送给电视的媒体内容的指令,例如:电视播放控制类具体指用于对智能电视本身的状态进行控制的操作指令,如,控制音量的指令、切换频道的指令等,应用功能控制类具体指用于通过应用服务器以向智能电视提供相应功能的操作指令,如,向智能电视推送应用服务器的媒体资源。
步骤S203、若远程控制操作指令的类型为电视播放控制类,则向智能电视发送所述远程控制操作指令,以使智能电视根据远程控制操作指令进行相应的控制操作。
当远程控制操作指令的类型为电视播放控制类时,向智能电视发送该远程控制操作指令,智能电视根据该远程控制操作指令进行相应控制操作。例如,可以通过互联服务器31和消息转发服务器34将该远程控制操作指令发送至智能电视。例如,该远程控制操作指令为电视音量减5。
步骤S204、若远程控制操作指令的类型为应用功能控制类,则向对应的应用服务器发送远程控制操作指令,以使应用服务器根据远程控制操作指令向智能电视推送相应的媒体内容。
当远程控制操作指令的类型为应用功能控制类时,移动终端向对应的应用服务器发送远程控制操作指令,或者,电视响应于移动终端的远程控制操作指令向服务器发送远程控制操 作指令,应用服务器根据该远程控制操作指令向智能电视推送相应的媒体内容,智能电视对该媒体内容进行播放。例如,可以通过互联服务器31将该远程控制操作指令发送至应用服务器32。
本实施例,通过移动终端接收用户的触发并生成用于请求开启远程控制的第一信号,移动终端响应于该第一信号,发送第一截屏请求信息,该第一截屏请求信息携带第一标识信息,智能电视根据第一截屏请求信息截取智能电视的当前显示界面,并根据第一标识信息生成第一截图并上传至图像服务器,移动终端根据第一标识信息从图像服务器获取第一截图,并显示第一截图,该第一截图用于展示智能电视的当前状态,以使得用户可以基于当前状态对智能电视进行远程控制,移动终端接收用户的触发并生成用于发送远程控制操作指令的第二信号,识别远程控制操作指令的类型,若远程控制操作指令的类型为电视播放控制类,则向智能电视发送所述远程控制操作指令,以使智能电视根据远程控制操作指令进行相应的控制操作,若远程控制操作指令的类型为应用功能控制类,则向对应的应用服务器发送远程控制操作指令,以使应用服务器根据远程控制操作指令向智能电视推送相应的媒体内容,从而实现对智能电视的远程控制,提升智能电视的控制效率。
在一些实施例中,移动终端所有的指令仅发送给智能电视,智能电视判断接收到的指令是用于智能电视的操作还是用户发送对服务器的请求。示例性的,在步骤S201之后,移动终端不进行控制操作指令的识别,而是直接通过服务器发送给智能电视,智能电视在接收到控制操作指令后,识别远程操作指令后,若远程控制操作指令的类型为电视播放控制类,则智能电视根据远程控制操作指令进行相应的控制操作,若远程控制操作指令的类型为应用功能控制类,则智能电视向对应的应用服务器发送远程控制操作指令,以使应用服务器根据远程控制操作指令向智能电视推送相应的媒体内容。
图9A为本申请一些实施例的另一种智能电视的远程控制方法的交互流程图,本实施例涉及第二截屏请求信息,与第一截屏请求信息的作用不同,第二截屏请求信息用于智能电视获取第二截图,该第二截图是基于上述第一截图对智能电视进行远程控制的结果,以获知远程操作是否成功,如图9A所示,本申请的方法还可以包括:
步骤S301、移动终端发送第二截屏请求信息,该第二截屏请求信息用于使得智能电视响应远程操作指令后获取第二截图,该第二截屏请求信息携带第二标识信息。
在一些实施例中,移动终端可以在发送完远程控制操作指令后,或者在发送远程控制指令的同时,发送第二截屏请求信息,以使得移动终端可以获取新的截屏图像,来展示智能电视响应远程操作指令后的截图或新时刻的截图。用户可以通过移动终端展示的新的截屏图像 来判断下一步所需要进行的操作。
在一些实施例中,第二截屏请求可以由移动终端在接收到用户的刷新操作后触发。在另一些实施例中,用户在发送远程操作控制指令的同时发送第二截屏请求。智能电视在响应电视播放控制类指令后,或者接收到服务器响应应用功能类指令下发的内容后,响应第二截屏请求进行截屏并上传。
移动终端可以通过局域网向智能电视发送第二截屏请求信息;或者,移动终端通过互联服务器31和消息转发服务器34向智能电视发送第二截屏请求信息。该第二截屏请求信息用于请求智能电视重新截取智能电视的当前显示界面,并根据该第二标识信息生成第二截图并上传至所述图像服务器;
步骤S302、智能电视根据第二截屏请求信息重新截取智能电视的当前显示界面,并根据第二标识信息生成第二截图并上传至图像服务器,该第二截图用于展示所述远程控制操作指令的操作结果。
智能电视接收到该第二截屏请求信息,响应于该第二截屏请求信息,智能电视重新截取智能电视的当前显示界面以生成第二截图,并以该第二标识信息对该第二截图进行命名,上传至图像服务器。图像服务器可以生成与该第二标识信息对应的URL,并存储该第二截图,该第二截图用于展示上述远程控制操作指令的操作结果。
在一些实施例中,电视接收到远程操作控制指令和第二截屏请求信息后,确定电视是否对远程操作控制指令进行了响应,在对远程操作控制指令进行响应后进行对第二截屏请求的响应,示例性的,在响应电视播放控制类指令后,或者接收到服务器响应应用功能类指令下发的内容后,响应第二截屏请求进行截屏并上传。
在一些实施例中,电视接收到第二截屏请求,且第二截屏请求在接收到远程操作控制指令的预设时间长度内,确定电视是否在对远程操作控制指令进行响应,如果正在对远程操作控制指令进行响应的过程中(即根据指令进行对应的操作,但是操作仍未完成),则暂缓对第二截屏请求的响应不进行截屏操作,监测对远程操作控制指令进行响应的进度,待对远程操作控制指令响应完成后(即根据指令进行对应的操作,操作已经完成)再响应第二截屏请求。如果对远程操作控制指令已经响应完成(即根据指令进行对应的操作,操作已经完成)则直接响应第二截屏请求。
在一些实施例中,对远程操作控制指令进行响应是指智能电视执行远程指令对应的操作,或者智能电视接收服务器发送的对应远程操作控制指令的推送文件。
在一些实施例中,智能电视响应于接收到第二截屏请求,未接受到远程操作控制指令, 直接响应第二截屏请求。
步骤S303、移动终端根据第二标识信息从图像服务器获取第二截图,并显示第二截图,该第二截图用于展示该远程控制操作指令的操作结果。
在一些实施例中,移动终端可以根据该第二标识信息,从图像服务器获取与该第二标识信息对应的URL,根据URL获取该第二截图,该第二截图用于展示智能电视的远程控制指令的结果。移动终端可以通过显示屏显示该第二截图,以使用户确定远程操作是否成功。
在一些实施例中,第一截屏请求和第二截屏请求可以包含相同的字段,字段内容可以随场景或时间进行变化。对应的截图生成也可以采用相似的方式。
在一些实施例中,请参考图9B-图9E,用户可以通过选择呈现的在如图7B所示的远程控制指令被输入后,移动终端响应于发送远程控制操作指令,移动终端在如图7B所示的第二用户界面62中增加显示显示框,在显示框中显示指令发送状态,其显示效果可以参见图9B所示的第二用户界面,在第二用户界面上显示有显示框2,显示框2中显示有指令发送状态的文本,例如,“正在发送指令到电视”的文字,移动终端在从图像服务器获取第二标识信息对应的截图后,在触控显示屏上显示如图9C所示的第二用户界面62,该第二用户界面62中的内容视图中显示有该第二标识信息对应的截图,即将图9B所示的内容视图对应的窗口6232中所展示的截图更新为第二标识信息对应的截图。在一些实施例中,由于处理速度或网速的原因,移动终端获取到第二标识信息对应的截图的时间较长,在新的远程操作控制指令发出后,在接收到第二标识信息对应的截图之前,还可以在将窗口6232中所展示的原来的截图截图更新为智能电视屏幕截取状态图片以表征正在获取第二标识信息对应的截图,如图9C所示,在移动终端获取到第二标识信息对应的截图后再将图9C所示的内容视图对应的窗口中所展示的智能电视屏幕截取状态更新为第二标识信息对应的截图如图9D或图9E所示。
如果重新获取到的截图如图9D所示窗口6232中的截图如果没有显示主页,意味着当前智能电视并未按照图7B时所发出的“返回主页”的远程操作控制指令进行操作,需要用户重新触发“返回主页”的远程操作控制指令。如果重新获取到的截图如图9E所示显示主页,意味着当前智能电视按照图7B时所发出的“返回主页”的远程操作控制指令进行了操作。
本实施例,通过移动终端发送第二截屏请求信息,该第二截屏请求信息用于使得智能电视响应远程操作指令后获取第二截图,该第二截屏请求信息携带第二标识信息,智能电视根据第二截屏请求信息重新截取智能电视的当前显示界面,并根据第二标识信息生成第二截图并上传至图像服务器,该第二截图用于展示所述远程控制操作指令的操作结果,移动终端根 据第二标识信息从图像服务器获取第二截图,并显示第二截图,该第二截图用于展示该远程控制操作指令的操作结果,提升智能电视的控制效率。
在一些实施例中智能电视无需第二截屏请求的触发,在接收到远程操作控制指令后,智能电视执行远程操作指令对应的操作并在远程操作控制指令后自动截屏进行响应,截屏生成的图片标识可以是预先约定好的标识信息,移动终端在发出远程操作控制指令后可以根据预先预定好的标识信息在服务器进行轮询。
图10为本申请一些实施例的另一种智能电视的远程控制方法的交互流程图,如图10所示,本实施例的方法还可以包括:
步骤S401、移动终端响应于用户的操作,发送设备查询请求信息,该设备查询请求信息用于获取当前可用设备名称。
一种可实现方式,移动终端接收用户的操作并生成第三信号,响应于该第三信号,移动终端发送设备查询请求信息。
本实施例的方法步骤可以在上述任一实施例之前,移动终端在显示一用户界面时,可以接收用户触发的并生成用于打开远程监控界面的第三信号,该第三信号可以是点击与远程监控对应的控件。点击可以是由用户的手指、触控笔或其它可以被触控显示屏所检测到的控制物体作用产生。移动终端可以向互联服务器发送设备查询请求,以获取当前可用设备名称,例如,家中卧室的智能电视、客厅的智能电视等设备的名称。
在一些实施方式中,移动终端响应于接收到的用户的操作,直接发送设备查询请求信息,同时触发打开远程监控界面62的信号。如此可以简化软件流程提升***效率。
步骤S402、互联服务器向移动终端发送的当前可用设备名称,并将所述可用设备名称以列表形式展示在所述移动终端显示的远程监控界面。
该当前可用设备名称用于请求远程控制相应的智能电视。
移动终端可以在该当前可用设备名称中选取一个设备进行上述各实施例所述的远程控制。例如,移动终端可以显示如图6D所示的第三用户界面64,在该第三用户界面64上显示各个可用设备的选择按钮641,以向用户提供可用设备的选择。
本实施例,可以通过移动终端响应于用户的操作,向互联服务器发送设备查询请求信息,该设备查询请求信息用于获取当前可用设备名称,互联服务器向移动终端发送的当前可用设备名称,该当前可用设备名称用于请求远程控制相应的智能电视,从而实现灵活选取进行远程控制的智能电视,远程对智能电视进行有效控制。
在一些实施例中,远程控制操作指令的产生可以是用户选在控件,或用户通过控件6242 进行语音输入,或者通过6241的控件进行文本的输入。在用户通过文本输入时,移动设备会根据输入的文本生成显示框1并将所述输入的文本发给语义识别服务器,语义识别服务器解析所述输入的文本生成远程操作控制指令发送给互联网服务器;在用户通过控件输入时,移动设备会根据控件对应的文本生成显示框1并将所述控件对应的预设远程操作控制指令发给互联网服务器;在通过语音进行输入时,移动设备会将输入的语音发送给语音解析服务器,隐隐解析服务器将解析出的文本发给移动终端以生成显示框1并将解析出的文本发给语义识别服务器,语义识别服务器解析所述解析出的文本生成远程操作控制指令发送给互联网服务器。
在一些实施例中,参照图11A-图11C所示,移动终端还可以在第二用户界面62上接收用户的触发并生成用于发送远程控制操作指令的第二信号,例如,通过第二用户界面62的按钮624输入语音,该语音为“关闭电视”,移动终端可以通过本申请上述实施例的方法,将关闭电视的远程控制操作指令发送给电视,以使得电视执行关闭电视的操作,移动终端由第二用户界面62显示显示框3,该显示框3中显示有远程控制操作指令的文本,例如,“关闭电视”。如图11A的第二用户界面所示,该第二用户界面62还可以显示显示框4,显示框4显示有指令发送状态的文本,例如,“正在发送指令到电视”。在一些实施例中,如图11B所示,在智能电视响应该关闭电视的远程操作指令后,进行关机操作,并发送关机响应信息给移动终端,移动终端可以根据关机响应消息在图11B所示的内容视图显示显示框5,该显示框5中可以显示电视当前状态的文本,例如,“您的电视已关机…….”以提示用户远程操作无法再继续进行。在电视机接收到的远程操作控制指令是关机操作以外的其他操作时,不反馈关机响应消息,而反馈新的截图。
在一些实施例中,在移动终端未获取到电视的截图时,可以将矿口6232所示的内容视图对应的窗口中所展示的电视屏幕截取状态更新为显示“未获取到电视截屏信息”的文本。
图12为本申请一些实施例的一种移动终端的结构示意图,如图12所示,本实施例的移动终端可以包括:接收模块11、处理模块12和发送模块13,其中,处理模块12,用于响应于接收模块11接收到的用户操作,通过发送模块13发送第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一标识信息用于使智能电视根据所述第一标识信息标识所述第一截屏请求信息对应的截图,所述第一截屏请求信息用于使得所述智能电视截取所述智能电视的当前显示界面,并将根据所述第一标识信息将生成的第一截图上传至图像服务器;所述处理模块12,还用于根据第一标识信息轮询所述图像服务器,并接收并显示所述图 像服务器响应所述轮询反馈的所述第一截图。
可选的,处理模块12还用于通过接收模块11接收用户的操作并生成电视播放控制类的远程控制操作指令,其中,该电视播放控制类的远程控制操作指令是指智能电视可响应的,对于智能电视本身进行操作和控制的指令;处理模块12还用于通过发送模块13发送第二截屏请求,该第二截屏请求信息用于使得所述智能电视响应所述电视播放控制类的远程控制操作指令后获取第二截图,第二截屏请求信息携带第二标识信息,第二标识信息用于使所述智能电视标识所述第二截图;处理模块12还用于根据第二标识信息轮询所述图像服务器,通过接收模块11接收并显示所述图像服务器响应所述轮询反馈的所述第二截图。
可选的,处理模块12还用于通过接收模块11接收用户的操作并生成应用功能类指令的远程控制操作指令,其中,该应用功能类指令的远程控制操作指令是指应用服务器可以响应的,并生成用于推送给电视的媒体内容的指令;处理模块12还用于通过发送模块13发送第二截屏请求,该第二截屏请求信息用于使得所述智能电视响应所述应用服务器的推送的媒体内容后获取第二截图,第二截屏请求信息携带第二标识信息,第二标识信息用于使所述智能电视标识所述第二截图;处理模块12还用于根据第二标识信息轮询所述图像服务器,通过接收模块11接收并显示所述图像服务器响应所述轮询反馈的所述第二截图。
可选的,处理模块12可以控制发送模块13通过局域网向所述智能电视发送所述第一截屏请求信息或第二截屏请求信息;或者,处理模块12可以控制发送模块13通过互联服务器和消息转发服务器向所述智能电视发送所述第一截屏请求信息或第二截屏请求信息,所述消息转发服务器与所述智能电视之间建立有长连接。
可选的,处理模块12还用于在发送第一截屏请求信息之前,响应于用户的操作,通过发送模块13发送设备查询请求信息,所述设备查询请求信息用于获取当前可用设备名称;接收模块11还用于接收当前可用设备名称,所述当前可用设备名称用于请求远程控制相应的智能电视。
可选的,所述第一标识信息包括当前时间戳。
本实施例的移动终端,可以用于执行上述方法实施例中移动终端所执行的技术方案,其实现原理和技术效果类似,此处不再赘述。
图13为本申请一些实施例的另一种移动终端的结构示意图,如图13所示,本实施例的装置可以包括:存储器21和处理器22,其中,存储器21用于存储计算机程序,处理器22用于执行所述计算机程序,以实现上述各个实施例所述的方法。
本实施例的装置,可以用于执行上述方法实施例中移动终端的技术方案,其实现原理和 技术效果类似,此处不再赘述。
图14为本申请一些实施例的一种智能电视的结构示意图,如图14所示,本实施例的智能电视可以包括:接收模块31、处理模块32和发送模块33,其中,接收模块31,用于接收第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一标识信息用于智能电视根据所述第一标识信息标识所述第一截屏请求信息对应的截图;处理模块32,用于根据所述第一截屏请求信息截取所述智能电视的当前显示界面,并根据所述第一标识信息生成第一截图;所述处理模块32,还用于通过发送模块33上传所述第一截图至图像服务器。
可选的,接收模块31还用于接收电视播放控制类的远程控制操作指令,根据所述远程控制操作指令进行相应控制操作;或者,处理模块32还用于通过而接收模块31接收并播放应用服务器推送的媒体内容,所述媒体内容为所述应用服务器根据应用功能控制类的远程控制操作指令推送给智能电视的。
可选的,接收模块31还用于接收第二截屏请求信息,所述第二截屏请求信息用于使得所述智能电视响应远程控制操作指令后获取第二截图,所述第二截屏请求信息携带第二标识信息;处理模块32用于根据所述第二截屏请求信息,在响应远程控制操作指令后,重新截取所述智能电视的当前显示界面,并根据所述第二标识信息生成第二截图,通过发送模块33上传所述第二截图至所述图像服务器,所述第二截图用于展示所述远程控制操作指令的操作结果。
在一些实施例中,本申请提供了一种移动终端,包括:显示器;处理器,所述处理器用于:接收用户对预设控件的操作,发送第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一截屏请求信息用于使得所述智能电视截取所述智能电视的当前显示界面,生成并上传第一截图至服务器,所述第一标识信息用于标识所述第一截图;所述移动终端根据所述第一标识信息轮询所述服务器,并接收并在所述显示器显示所述服务器响应所述轮询反馈的所述第一截图。
在一些实施例中,本申请提供了一种智能电视,包括:显示器;处理器,所述处理器用于:所述智能电视接收服务器发送的远程控制操作指令;在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述显示器的当前显示界面;在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,截取并向所述服务器上传所述显示器的当前显示界面,以使的移动终端获取到所述截取的显示器的当前显示界面。
本实施例的智能电视,可以用于执行上述方法实施例中智能电视的技术方案,其实现原 理和技术效果类似,此处不再赘述。
本申请一些实施例还提供一种计算机存储介质,所述计算机存储介质用于存储计算机程序,所述计算机程序执行时用于实现如上述任一实施例所述的方法。其实现原理和技和技术效果类似,此处不再赘述。
此外,术语“包括”和“具有”以及他们的任何变形,意图在于覆盖不排他的包含,例如,包含了一系列步骤或单元的过程、方法、***、产品或设备不必限于清楚地列出的那些步骤或单元,而是可包括没有清楚地列出的或对于这些过程、方法、产品或设备固有的其它步骤或单元。
本领域普通技术人员可以理解:实现上述各方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成。前述的程序可以存储于一计算机可读取存储介质中。该程序在执行时,执行包括上述各方法实施例的步骤;而前述的存储介质包括:ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。

Claims (15)

  1. 一种智能电视的远程控制方法,其特征在于,包括:
    所述智能电视接收服务器发送的远程控制操作指令;
    在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述智能电视的当前显示界面;
    在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,截取并向所述服务器上传所述智能电视的当前显示界面,以使的移动终端获取到所述截取的智能电视的当前显示界面。
  2. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    接收服务器发送的第二截屏请求信息,所述第二截屏请求信息包含第二标识信息,所述第二标识是所述移动终端确定的;
    所述在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,截取并向所述服务器上传所述智能电视的当前显示界面,包括:
    在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,响应于所述第二截屏请求,截取所述智能电视的当前显示界面;
    根据所述第二标识信息对截取的所述智能电视的当前显示界面进行命名并将命名后的所述智能电视的当前显示界面上传至所述服务器,以使所述移动终端根据所述第二标识信息获取到所述命名后的所述智能电视的当前显示界面。
  3. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    接收服务器发送的第二截屏请求信息,所述第二截屏请求信息包含第二标识信息,所述第二标识是所述移动终端确定的;
    所述在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述智能电视的当前显示界面包括:
    响应于所述第二截屏请求,在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述智能电视的当前显示界面;
    监测对远程操作控制指令进行响应的进度;
    在所述智能电视完成所述远程控制操作指令对应的相应控制操作后,截取所述智能电视的当前显示界面;
    根据所述第二标识信息对截取的所述智能电视的当前显示界面进行命名并将命名后的所述智能电视的当前显示界面上传至所述服务器,以使所述移动终端根据所述第二标识信息获 取到所述命名后的所述智能电视的当前显示界面。
  4. 如权利要求1所述的方法,其特征在于,所述方法还包括:
    接收服务器发送的第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一标识信息是移动终端在接收到用户对预设控件的操作后确定的;
    所述智能电视根据所述第一截屏请求信息截取所述智能电视的当前显示界面,并根据所述第一标识信息生成第一截图;
    所述智能电视上传所述第一截图至服务器,以使所述移动终端根据所述第一标识信息获取所述第一截图。
  5. 一种智能电视的远程控制方法,其特征在于,包括:
    所述智能电视从服务器接收移动终端发送的远程控制操作指令和第二截屏请求信息;
    在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不响应所述第二截屏请求信息;
    在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,响应所述第二截屏请求信息截取并向所述服务器上传所述智能电视的当前显示界面,以使的所述移动终端获取到所述截取的智能电视的当前显示界面。
  6. 一种智能电视的远程控制方法,其特征在于,包括:
    所述智能电视接收移动终端发送的远程控制操作指令和第二截屏请求信息;
    在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不响应所述第二截屏请求信息;
    在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,响应所述第二截屏请求信息截取并向所述移动终端发送所述智能电视的当前显示界面。
  7. 一种智能电视的远程控制方法,其特征在于,包括:
    智能电视接收第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一标识信息是移动终端在接收到用户对预设控件的操作后确定的;
    所述智能电视根据所述第一截屏请求信息截取所述智能电视的当前显示界面,并根据所述第一标识信息生成第一截图;
    所述智能电视上传所述第一截图至服务器,以使所述移动终端根据所述第一标识信息获取所述第一截图。
  8. 如权利要求7所述的方法,其特征在于,所述方法还包括:
    所述智能电视接收服务器发送的远程控制操作指令,根据所述远程控制操作指令进行相 应控制操作,其中所述远程控制操作指令是根据所述移动端接收到的用户输入确定的。
  9. 如权利要求8所述的方法,其特征在于,所述方法还包括:
    所述智能电视接收第二截屏请求信息,所述第二截屏请求信息用于使得所述智能电视响应远程控制操作指令后获取第二截图,所述第二截屏请求信息携带第二标识信息;
    所述智能电视根据所述第二截屏请求信息,在完成所述远程控制操作指令对应的控制操作后,截取所述智能电视的当前显示界面,并根据所述第二标识信息生成第二截图,上传所述第二截图至所述服务器,以使所述移动终端根据所述第二标识信息获取所述第二截图。
  10. 一种智能电视的远程控制方法,其特征在于,包括:
    接收用户对预设控件的操作,发送第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一截屏请求信息用于使得所述智能电视截取所述智能电视的当前显示界面,生成并上传第一截图至服务器,所述第一标识信息用于标识所述第一截图;
    所述移动终端根据所述第一标识信息轮询所述服务器,并接收并显示所述服务器响应所述轮询反馈的所述第一截图。
  11. 如权利要求10所述的方法,其特征在于,所述方法还包括:
    接收用户的操作生成并发送远程控制操作指令,其中,所述远程控制操作指令用于对智能电视本身进行操作和控制;
    发送第二截屏请求,所述第二截屏请求信息用于获取所述智能电视响应所述远程控制操作指令后的第二截图,所述第二截屏请求信息携带第二标识信息,所述第二标识信息用于使所述智能电视标识所述第二截图;
    所述移动终端根据所述第二标识信息轮询所述服务器,接收并显示所述服务器响应所述轮询反馈的所述第二截图。
  12. 如权利要求10所述的方法,其特征在于,所述方法还包括:
    响应于用户的操作,生成远程控制操作指令;
    识别远程控制操作指令的类型;
    若远程控制操作指令的类型为用于对智能电视本身进行操作和控制的电视播放控制类,则向智能电视发送所述远程控制操作指令,以使智能电视根据远程控制操作指令进行相应的控制操作;
    若远程控制操作指令的类型为用于控制应用服务器进行推送的应用功能控制类,则向对应的应用服务器发送远程控制操作指令,以使应用服务器根据远程控制操作指令向智能电视推送相应的媒体内容。
  13. 如权利要求12所述的方法,其特征在于,所述方法还包括:
    发送第二截屏请求,所述第二截屏请求信息用于使得所述智能电视响应所述电视播放控制类的远程控制操作指令后获取第二截图或使得所述智能电视响应所述应用服务器的推送的媒体内容后获取第二截图,所述第二截屏请求信息携带第二标识信息,所述第二标识信息用于使所述智能电视标识所述第二截图;
    根据所述第二标识信息轮询所述图像服务器,接收并显示所述图像服务器响应所述轮询反馈的所述第二截图。
  14. 一种移动终端,其特征在于,包括:
    显示器;
    处理器,所述处理器用于:
    接收用户对预设控件的操作,发送第一截屏请求信息,所述第一截屏请求信息携带第一标识信息,所述第一截屏请求信息用于使得所述智能电视截取所述智能电视的当前显示界面,生成并上传第一截图至服务器,所述第一标识信息用于标识所述第一截图;
    所述移动终端根据所述第一标识信息轮询所述服务器,并接收并在所述显示器显示所述服务器响应所述轮询反馈的所述第一截图。
  15. 一种智能电视,其特征在于,包括:
    显示器;
    处理器,所述处理器用于:
    所述智能电视接收服务器发送的远程控制操作指令;
    在所述智能电视未完成所述远程控制操作指令对应的相应控制操作时,不截取所述显示器的当前显示界面;
    在所述智能电视完成所述远程控制操作指令对应的相应控制操作时,截取并向所述服务器上传所述显示器的当前显示界面,以使的移动终端获取到所述截取的显示器的当前显示界面。
PCT/CN2020/078402 2019-06-05 2020-03-09 智能电视的远程控制方法、移动终端和智能电视 WO2020244266A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910486755.XA CN110087124A (zh) 2019-06-05 2019-06-05 智能电视的远程控制方法、终端设备和智能电视
CN201910486755.X 2019-06-05

Publications (1)

Publication Number Publication Date
WO2020244266A1 true WO2020244266A1 (zh) 2020-12-10

Family

ID=67423664

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/078402 WO2020244266A1 (zh) 2019-06-05 2020-03-09 智能电视的远程控制方法、移动终端和智能电视

Country Status (2)

Country Link
CN (1) CN110087124A (zh)
WO (1) WO2020244266A1 (zh)

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110087124A (zh) * 2019-06-05 2019-08-02 聚好看科技股份有限公司 智能电视的远程控制方法、终端设备和智能电视
CN111142655A (zh) * 2019-12-10 2020-05-12 上海博泰悦臻电子设备制造有限公司 交互方法、终端及计算机可读存储介质
CN111385654B (zh) * 2020-03-04 2021-06-22 四川长虹电器股份有限公司 基于中间件的智能电视模拟量参数控制方法
CN113495702B (zh) * 2020-03-18 2023-10-24 聚好看科技股份有限公司 一种互动邀请处理方法及显示设备
CN113453079B (zh) * 2020-03-24 2022-08-26 海信视像科技股份有限公司 一种双***大小双屏应用返回的控制方法及显示设备
CN113542576A (zh) * 2020-04-15 2021-10-22 华为技术有限公司 图像采集方法、装置和电子设备
CN113568688B (zh) * 2020-04-29 2023-06-06 RealMe重庆移动通信有限公司 一种视图切换方法、装置、电子设备和存储介质
CN111683278A (zh) * 2020-06-22 2020-09-18 深圳创维-Rgb电子有限公司 智能家电设备远程协助方法、装置和移动终端
CN112187959B (zh) * 2020-11-27 2021-06-22 蘑菇车联信息科技有限公司 车载电脑的远程控制方法、***、电子设备与存储介质
CN112804732B (zh) * 2021-01-14 2023-03-14 Oppo广东移动通信有限公司 识别电子设备的方法、装置及电子设备
CN112765526B (zh) * 2021-02-05 2022-04-29 腾讯科技(深圳)有限公司 一种页面截图方法、装置、终端设备及介质
CN114153698B (zh) * 2021-12-06 2024-04-19 京东方艺云(杭州)科技有限公司 显示监控方法、装置、电子设备和可读存储介质
CN116016472B (zh) * 2023-02-20 2023-06-09 北京格如灵科技有限公司 客户端交互方法、装置、计算机设备及介质
CN116233342B (zh) * 2023-03-13 2023-09-12 深圳市中南高科技有限公司 一种电视机主板智能控制方法、电视机主板以及电视机

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404641A (zh) * 2011-12-06 2012-04-04 深圳Tcl新技术有限公司 使用智能手机遥控电视机的方法和***
CN103281575A (zh) * 2013-03-28 2013-09-04 四川长虹电器股份有限公司 一种智能电视新型控制方法
US20140240440A1 (en) * 2013-02-28 2014-08-28 Lg Uplus Corp. Method for sharing function between terminals and terminal thereof
CN105282587A (zh) * 2015-07-13 2016-01-27 深圳市美贝壳科技有限公司 一种基于手机的同步可视化控制智能电视的方法
CN105635756A (zh) * 2015-12-29 2016-06-01 Tcl海外电子(惠州)有限公司 远程控制智能电视的方法及***
CN110087124A (zh) * 2019-06-05 2019-08-02 聚好看科技股份有限公司 智能电视的远程控制方法、终端设备和智能电视

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105812892A (zh) * 2014-12-29 2016-07-27 深圳Tcl数字技术有限公司 电视的动态显示画面的截取方法、装置及***
CN105338399A (zh) * 2015-10-29 2016-02-17 小米科技有限责任公司 图像获取方法及装置
KR20170092408A (ko) * 2016-02-03 2017-08-11 엘지전자 주식회사 디지털 디바이스 및 그 제어 방법
CN105592364B (zh) * 2016-02-25 2021-01-05 腾讯科技(深圳)有限公司 跨终端的截屏图片获取方法和装置
CN108616643A (zh) * 2016-12-12 2018-10-02 阿里巴巴集团控股有限公司 通过计算设备控制手机的方法、装置及***
CN107085842B (zh) * 2017-04-01 2020-04-10 上海讯陌通讯技术有限公司 自学习多路图像融合的实时矫正方法及***
CN108513062B (zh) * 2018-03-06 2021-03-23 Oppo广东移动通信有限公司 终端的控制方法及装置、可读存储介质和计算机设备
CN108540844B (zh) * 2018-03-28 2021-06-01 聚好看科技股份有限公司 远程控制电视的方法及装置
CN109413490A (zh) * 2018-11-08 2019-03-01 四川长虹电器股份有限公司 基于移动端截取电视画面的方法
CN109800555A (zh) * 2019-02-22 2019-05-24 百度在线网络技术(北京)有限公司 访问控制方法和装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102404641A (zh) * 2011-12-06 2012-04-04 深圳Tcl新技术有限公司 使用智能手机遥控电视机的方法和***
US20140240440A1 (en) * 2013-02-28 2014-08-28 Lg Uplus Corp. Method for sharing function between terminals and terminal thereof
CN103281575A (zh) * 2013-03-28 2013-09-04 四川长虹电器股份有限公司 一种智能电视新型控制方法
CN105282587A (zh) * 2015-07-13 2016-01-27 深圳市美贝壳科技有限公司 一种基于手机的同步可视化控制智能电视的方法
CN105635756A (zh) * 2015-12-29 2016-06-01 Tcl海外电子(惠州)有限公司 远程控制智能电视的方法及***
CN110087124A (zh) * 2019-06-05 2019-08-02 聚好看科技股份有限公司 智能电视的远程控制方法、终端设备和智能电视

Also Published As

Publication number Publication date
CN110087124A (zh) 2019-08-02

Similar Documents

Publication Publication Date Title
WO2020244266A1 (zh) 智能电视的远程控制方法、移动终端和智能电视
WO2021109410A1 (zh) 设备唤醒的方法及显示设备
WO2021212668A1 (zh) 一种投屏显示方法及显示设备
WO2021135068A1 (zh) 一种声音输出设备的选择控制方法及显示设备
WO2021203530A1 (zh) 显示设备及电视节目的推送方法
WO2021109418A1 (zh) 视频资源的显示方法、移动终端及服务器
WO2021164177A1 (zh) 播放媒体资源的方法、显示设备及移动终端
WO2021031623A1 (zh) 显示设备、分享文件的方法和服务器
CN111277884A (zh) 视频播放方法及设备
US11877034B2 (en) Display apparatus and channel control method
CN111770370A (zh) 显示设备、服务器及媒资推荐的方法
WO2022048203A1 (zh) 一种输入法控件的操控提示信息的显示方法及显示设备
CN112004157A (zh) 一种多轮语音交互方法及显示设备
CN111954059A (zh) 屏保的展示方法及显示设备
CN112199064A (zh) 一种浏览器应用与***平台的交互方法及显示设备
CN111083538A (zh) 一种背景图像的显示方法及设备
CN111654729B (zh) 一种账号登录状态的更新方法及显示设备
WO2021139045A1 (zh) 播放媒体项目的方法及显示设备
WO2021184575A1 (zh) 显示设备和显示方法
WO2021212667A1 (zh) 一种多媒资数据显示方法及显示设备
CN114079819A (zh) 一种内容显示方法及显示设备
CN112004125A (zh) 媒体资源播放方法及显示设备
CN111857363A (zh) 一种输入法交互方法及显示设备
CN111897641A (zh) 微服务监控调度方法及显示设备
CN112199560B (zh) 一种设置项的搜索方法及显示设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20819584

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20819584

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 29/03/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 20819584

Country of ref document: EP

Kind code of ref document: A1