WO2022078065A1 - Display device resource playing method and display device - Google Patents

Display device resource playing method and display device Download PDF

Info

Publication number
WO2022078065A1
WO2022078065A1 PCT/CN2021/113742 CN2021113742W WO2022078065A1 WO 2022078065 A1 WO2022078065 A1 WO 2022078065A1 CN 2021113742 W CN2021113742 W CN 2021113742W WO 2022078065 A1 WO2022078065 A1 WO 2022078065A1
Authority
WO
WIPO (PCT)
Prior art keywords
display device
mode
audio
earphone
user
Prior art date
Application number
PCT/CN2021/113742
Other languages
French (fr)
Chinese (zh)
Inventor
王丽娟
魏强
Original Assignee
青岛海信传媒网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 青岛海信传媒网络技术有限公司 filed Critical 青岛海信传媒网络技术有限公司
Publication of WO2022078065A1 publication Critical patent/WO2022078065A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs

Definitions

  • the present application relates to the field of display technology, and in particular, to a method for playing resources of a display device and a display device.
  • the resources played by the display device include video resources and audio resources.
  • the video resources and the audio resources are played synchronously, so that the user can hear the sound of things in the video while watching the video resources.
  • the resource can also be expressed as a program of the display device.
  • Each program has its corresponding PSI (Program Specific Information), which includes PMT (Program Map Table), audio information describing the program, and program specific information in the PSI. video information, etc.
  • PSI Program Specific Information
  • PMT Program Map Table
  • audio information describing the program and program specific information in the PSI.
  • video information etc.
  • the PMT also contains narration information, which conveys a visual image in concise and vivid language, which can help the blind or visually impaired to experience the visual image of the image presented by the video resource.
  • the present application provides a display device resource playback method and display device
  • the present application provides a display device, including: a display for displaying video resources in resources played by the display device; a controller for performing: detecting whether the display device is connected to a headset; connecting the headset to the display device In the case of , the current headphone mode of the display device is detected; the headphone mode is used to indicate which audio output device the display device uses to play the audio resource in the resource; in the case that the headphone mode is a headphone and a speaker, the detection The audio mode of the display device; the audio mode is used to indicate whether the resource played by the display device is in the visually impaired mode; the visually impaired mode is used to indicate that the resource played by the display device contains narration information; In the case of barrier mode, the narration output mode of the display device is detected; the narration output mode is used to indicate which audio output device the display device uses to play the narration information in the resource; according to the headphone mode and the narration output mode , select the corresponding audio output device to play the audio resource and narration information in the resource.
  • the present application also provides a method for playing a display device resource, including: detecting whether the display device is connected to an earphone; if the display device is connected to the earphone, detecting the current earphone mode of the display device; the earphone mode is used to represent Which audio output device is used by the display device to play the audio resource in the resource; in the case that the earphone mode is an earphone and a speaker, the audio mode of the display device is detected; the audio mode is used to indicate whether the resource played by the display device is is the visually impaired mode; the visually impaired mode is used to indicate that the resources played by the display device contain narration information; when the audio mode is the visually impaired mode, the narration output mode of the display device is detected; the narration output mode It is used to indicate which audio output device the display device uses to play the narration information in the resource; according to the earphone mode and the narration output mode, select the corresponding audio output device to play the audio resource and narration information in the resource.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control apparatus according to some embodiments
  • FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments
  • FIG. 3 exemplarily shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments
  • FIG. 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments
  • FIG. 5 exemplarily shows a schematic diagram of displaying an icon control interface of an application in the display device 200 according to some embodiments
  • FIG. 6 is a schematic diagram of a setting interface shown in an embodiment of the application.
  • FIG. 7 is a schematic diagram of an audio mode interface shown in an embodiment of the application.
  • FIG. 8 is a schematic diagram of a second audio mode interface shown in an embodiment of the application.
  • FIG. 9 is a schematic diagram of a third audio mode interface shown in an embodiment of the application.
  • FIG. 10 is a schematic diagram of a fourth audio mode interface shown in an embodiment of the application.
  • FIG. 11 is a schematic diagram of a fifth audio mode interface shown in an embodiment of the application.
  • FIG. 12 is a schematic diagram of a second setting interface shown in an embodiment of the application.
  • FIG. 13 is a control flow chart of a controller 250 shown in an embodiment of the application.
  • FIG. 14 is a flowchart of a method for playing resources on a display device according to an embodiment of the application.
  • remote control refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance.
  • infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included.
  • RF radio frequency
  • a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
  • gesture used in this application refers to a user's behavior that is used by a user to express an expected thought, action, purpose/or result through an action such as a change of hand shape or hand movement.
  • FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment.
  • a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .
  • control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., and controls the display device 200 by wireless or other wired methods.
  • the user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like.
  • the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.
  • mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 .
  • the display device 200 is controlled using an application running on the smart device.
  • the app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.
  • UI intuitive user interface
  • the display device may not use the above-mentioned smart device or control device to receive instructions, but receive user control through touch or gesture.
  • the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication.
  • a control command protocol can be established between the mobile terminal 300 and the display device 200
  • the remote control keyboard can be synchronized to the mobile terminal 300
  • the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300.
  • the audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.
  • the display device 200 also performs data communication with the server 400 through various communication methods.
  • the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
  • the server 400 may provide various contents and interactions to the display device 200 .
  • the display device 200 interacts by sending and receiving information, and electronic program guide (EPG), receiving software program updates, or accessing a remotely stored digital media library.
  • EPG electronic program guide
  • the server 400 may be a cluster or multiple clusters, and other network service contents such as video-on-demand and advertising services are provided through the server 400 .
  • the display device 200 may be a liquid crystal display, an OLED display, or a projection display device.
  • the specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
  • the display device 200 may additionally provide a smart IPTV function that provides computer-supported functions, including but not limited to, IPTV, smart TV, Internet Protocol TV (IPTV), and the like, in addition to the broadcast receiving TV function.
  • a smart IPTV function that provides computer-supported functions, including but not limited to, IPTV, smart TV, Internet Protocol TV (IPTV), and the like, in addition to the broadcast receiving TV function.
  • FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the exemplary embodiment.
  • the display device 200 includes a controller 250, a tuner 210, a communicator 220, a detector 230, an input/output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, At least one of the user interface 265 and the external device interface 240 .
  • the display 275 is used for receiving the image signal output from the first processor, and performing components for displaying video content and images and a menu manipulation interface.
  • the display 275 includes a display screen component for presenting pictures, and a driving component for driving image display.
  • display 275 is used to present a user-manipulated UI interface generated in display device 200 and used to control display device 200 .
  • a driving component for driving the display is also included.
  • display 275 is a projection display, and may also include a projection device and projection screen.
  • Communicator 220 may be used for components that communicate with external devices or external servers according to various communication protocol types.
  • the communicator 220 may include at least one of a Wifi module 221, a Bluetooth module 222, a wired Ethernet module 223 and other network communication protocol modules or near field communication protocol modules, and an infrared receiver.
  • the display apparatus 200 may establish control signal and data signal transmission and reception between the external control apparatus 100 or the content providing apparatus through the communicator 220 .
  • the user interface 265 can be used to receive infrared control signals from the control device 100 (eg, an infrared remote control, etc.).
  • the control device 100 eg, an infrared remote control, etc.
  • the detector 230 may be used for the display device 200 to collect external environment or external interaction signals.
  • the detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light.
  • the detector 230 may also include an image collector 232, such as a camera, a camera, etc., which can be used to collect external environment scenes, as well as to collect user attributes or interactive gestures with the user, and can adaptively change display parameters and recognize user gestures. , in order to realize the function of interaction with users.
  • the detector 230 may further include a sound collector 231 or the like, such as a microphone, which may be used to receive the user's voice.
  • a voice signal including a control instruction of the user to control the display device 200, or collecting ambient sounds is used to identify the type of the environment scene, so that the display device 200 can adaptively adapt to the ambient noise.
  • the input/output interface 255 is configured to enable data transfer between the controller 250 and other external devices or other controllers 250 . Such as receiving video signal data and audio signal data of external equipment, or command instruction data, etc.
  • the external device interface 240 may include, but is not limited to, the following: any one or more of a high-definition multimedia interface HDMI interface, an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. interface. It is also possible to form a composite input/output interface by a plurality of the above-mentioned interfaces.
  • the tuner and demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, frequency mixing, and resonance, and can perform modulation and demodulation processing from multiple wireless receivers.
  • the audio and video signal may include the TV audio and video signal carried in the frequency of the TV channel selected by the user, and the EPG data signal.
  • the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.
  • the set-top box outputs the modulated and demodulated television audio and video signals of the received broadcast television signals to the main device, and the main device receives the audio and video signals through the first input/output interface.
  • the controller 250 controls the operation of the display device and responds to user operations.
  • the controller 250 may control the overall operation of the display apparatus 200 .
  • the controller 250 may perform an operation related to the object selected by the user command.
  • the controller 250 includes a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a graphics processor 253 (Graphics Processing Unit, GPU), a central processing unit At least one of a processor 254 (Central Processing Unit, CPU), an input/output interface 255 and a communication bus 256 (Bus).
  • the communication bus connects the various components.
  • RAM 251 is used to store temporary data for the operating system or other running programs.
  • ROM 252 is used to store various system startup instructions.
  • ROM 252 is used to store a basic input output system, called a Basic Input Output System (BIOS). It is used to complete the power-on self-check of the system, the initialization of each functional module in the system, the driver program of the basic input/output of the system, and the boot operating system.
  • BIOS Basic Input Output System
  • the power supply of the display device 200 starts to start, and the CPU executes the system start-up instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to facilitate startup or operation operating system.
  • the CPU copies the temporary data of various application programs in the memory to the RAM 251, and then, in order to start or run various application programs.
  • processor 254 executes operating system and application program instructions stored in memory. And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.
  • processor 254 may include multiple processors.
  • the plurality of processors may include a main processor and one or more sub-processors.
  • the main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode.
  • One or more sub-processors for an operation in a state such as standby mode.
  • the graphics processor 253 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and the like. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for displaying on a display.
  • various graphic objects such as: icons, operation menus, and user input instructions to display graphics and the like. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for displaying on a display.
  • the video processor 270 is configured to receive an external video signal, perform video processing according to the standard codec protocol of the input signal, and obtain a signal directly displayed or played on the display device 200 .
  • the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
  • the graphics processor 253 may be integrated with the video processor, or may be separately configured.
  • the processing of the graphics signal output to the display may be performed.
  • different functions may be performed respectively. For example, GPU+FRC (Frame Rate Conversion)) architecture.
  • the audio processor 280 is configured to receive an external audio signal, perform decompression and decoding, and noise reduction, digital-to-analog conversion, and amplification processing according to a standard codec protocol of the input signal to obtain a The sound signal played in the speaker.
  • the video processor 270 may comprise one or more chips.
  • the audio processor may also include one or more chips.
  • the video processor 270 and the audio processor 280 may be separate chips, or may be integrated into one or more chips together with the controller.
  • the audio output under the control of the controller 250, receives the sound signal output by the audio processor 280, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to an external device.
  • the external audio output terminal of the device such as an external audio interface or an earphone interface, etc., may also include a short-range communication module in the communication interface, such as a Bluetooth module for outputting sound from a Bluetooth speaker.
  • the power supply 290 under the control of the controller 250, provides power supply support for the display device 200 with the power input from the external power supply.
  • the power supply 290 may include a built-in power supply circuit installed inside the display device 200 , or may be an external power supply installed in the display device 200 to provide an external power supply interface in the display device 200 .
  • the user interface 265 is used for receiving user input signals, and then sending the received user input signals to the controller 250 .
  • the user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.
  • the user inputs user commands through the control device 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 250 .
  • the user may input user commands on a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the graphical user interface (GUI).
  • GUI graphical user interface
  • the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
  • the memory 260 includes storing various software modules for driving the display device 200 .
  • various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
  • the basic module is used for signal communication between various hardwares in the display device 200, and is a low-level software module that sends processing and control signals to the upper-layer module.
  • FIG. 3 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment.
  • the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .
  • the control apparatus 100 is configured to control the display device 200 , and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, so as to play an interactive intermediary role between the user and the display device 200 .
  • the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.
  • control apparatus 100 may be a smart device.
  • control apparatus 100 may install various applications for controlling the display device 200 according to user requirements.
  • the mobile terminal 300 or other intelligent electronic device can perform a similar function of the control apparatus 100 after installing the application for operating the display device 200 .
  • the user can install the application, various function keys or virtual buttons of the graphical user interface available on the mobile terminal 300 or other intelligent electronic devices, so as to realize the function of the physical key of the control apparatus 100 .
  • Controller 110 includes processor 112 and RAM 113 and ROM 114.
  • the controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
  • the communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110 .
  • the received user input signal is sent to the display device 200 .
  • the communication interface 130 may include at least one of the WiFi chip 131, the Bluetooth module 132, the NFC module 133 and other near field communication modules.
  • the user input/output interface 140 wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a key 144.
  • the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc.
  • the input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200.
  • the output interface includes an interface for transmitting received user instructions to the display device 200 .
  • it can be an infrared interface or a radio frequency interface.
  • the infrared signal interface when used, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 through the infrared sending module.
  • the radio frequency signal interface when a radio frequency signal interface is used, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmission terminal.
  • control device 100 includes at least one of a communication interface 130 and an input-output interface 140 .
  • the control device 100 is configured with a communication interface 130, such as modules such as WiFi, Bluetooth, NFC, etc., which can send user input instructions to the display device 200 through WiFi protocol, Bluetooth protocol, or NFC protocol encoding.
  • the memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller.
  • the memory 190 can store various control signal instructions input by the user.
  • the power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller. Can battery and related control circuit.
  • the system is divided into four layers, from top to bottom, they are an application layer (referred to as “application layer”), an application framework layer (referred to as “framework layer”) ”), the Android runtime and the system library layer (referred to as the “system runtime layer”), and the kernel layer.
  • application layer an application layer
  • frame layer an application framework layer
  • Android runtime the Android runtime
  • system library layer the system library layer
  • kernel layer the kernel layer
  • At least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, a clock program, a camera application, etc. built into the operating system; they may also be developed by a third party applications developed by the author.
  • the framework layer provides an application programming interface (API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action.
  • the application program can access the resources in the system and obtain the services of the system during execution through the API interface.
  • the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: an activity manager (Activity Manager) uses Interacts with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers on the user interface and desktop widgets.
  • an activity manager uses Interacts with all activities running in the system
  • Location Manager is used to provide system services or applications with access to system location services
  • Package Manager is used to retrieve files currently installed on the device Various information related to the application package
  • Notification Manager Notification Manager
  • Window Manager Window Manager
  • the activity manager is used to: manage the life cycle of each application and the usual navigation and fallback functions, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening the , back (including switching the currently displayed user interface in the display window to the upper-level user interface of the currently displayed user interface), and the like.
  • the window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (for example, reducing the display window to display, shaking display, twisting deformation display, etc.), etc.
  • the system runtime layer provides support for the upper layer, that is, the framework layer.
  • the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.
  • the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensors, pressure sensors, etc.), etc.
  • the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensors, pressure sensors, etc.), etc.
  • the display device receives an input operation (such as a split-screen operation) performed by the user on the display screen, and the kernel layer can generate corresponding input operations according to the input operation. Enter an event and report the event to the application framework layer.
  • the window mode (such as multi-window mode) and window position and size corresponding to the input operation are set by the activity manager of the application framework layer.
  • the window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.
  • the application layer contains at least one application that can display corresponding icon controls in the display, such as: live TV application icon control, video on demand application icon control, media center application Program icon controls, application center icon controls, game application icon controls, etc.
  • the live TV application may provide live TV from different sources.
  • a live TV application may provide a TV signal using input from cable, over-the-air, satellite services, or other types of live TV services.
  • the live TV application may display the video of the live TV signal on the display device 200 .
  • a video-on-demand application may provide video from various storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. For example, video-on-demand can come from the server side of cloud storage, from local hard disk storage containing existing video programs.
  • the media center application may provide various multimedia content playback applications.
  • a media center may provide services other than live TV or video-on-demand, where users can access various images or audio through a media center application.
  • the application center may provide storage of various applications.
  • An application can be a game, an application, or some other application that is related to a computer system or other device but can be run on a Smart TV.
  • the application center can obtain these applications from various sources, store them in local storage, and then run them on the display device 200 .
  • the resources played by the display device 200 include video resources and audio resources.
  • the video resources and the audio resources are played synchronously, so that the user can hear the sounds of things in the video while watching the video resources.
  • the resource can also be expressed as a program of the display device.
  • Each program has its corresponding PSI (Program Specific Information), which includes PMT (Program Map Table), audio information describing the program, and program specific information in the PSI. video information, etc.
  • PSI Program Specific Information
  • PMT Program Map Table
  • audio information describing the program and program specific information in the PSI.
  • video information etc.
  • the PMT also contains narration information, which conveys a visual image in concise and vivid language, which can help the blind or visually impaired to experience the visual image of the image presented by the video resource.
  • narration information is usually not needed to assist in the perception of visual images, and the output of narration information will affect users with normal vision to experience the background music (such as bird calls, rain) in audio resources, etc. Affects the real feelings of users with normal vision on the video resource picture.
  • the embodiments of the present application provide a display device resource playback method and display device, which can select the corresponding audio output according to the headphone mode, the audio mode when the display device 200 is connected to the headphones, and the narration output mode in the visually impaired mode.
  • the device plays audio resources and narration information. It can meet the resource playback requirements of both visually impaired users and sighted users. When visually impaired users and normal sighted users watch resources at the same time, the narration information provided for visually impaired users will not affect the audio content of sighted users. The resource viewing experience of different users.
  • the display device 200 provided in this embodiment of the present application may include at least a display 275 and a controller 250 .
  • the display 275 can display the video resources in the resources played by the display device 200, and the controller 250 can obtain some current peripheral connection states and mode settings of the display device 200, and control the display 275 to perform corresponding mode display and control audio Resource and narration information output.
  • the peripheral device connection state of the display device 200 is the connection state of the earphone, and the controller 250 needs to determine whether the display device 200 is connected to the earphone device in addition to the speaker itself. Whether to connect headphones or not requires users to choose according to their own needs.
  • the audio resources can be played in two ways: the headset, the headset and the speaker. The audio resources are played by the headset and the audio resources are played by the headset and the speaker at the same time; without connecting the headset, the audio resources can only be played by the display device 200. speaker to play.
  • FIG. 6 is a schematic diagram of a setting interface according to an embodiment of the present application.
  • the controller 250 detects that the display device 200 is connected to the headset.
  • the headset mode on the setting interface as shown in FIG. 6 needs to be set to the highlighted optional state, and then Allows the user to choose how the audio resource is played.
  • the earphone mode specifically includes earphones, earphones and speakers. When the earphone mode is earphone, it means that the user chooses to play audio resources through the earphone; when the earphone mode is earphone and speaker, it means that the user chooses to play audio resources through the earphone and the speaker at the same time.
  • the controller 250 After the user selects a specific headphone mode, the controller 250 detects the current headphone mode, and then determines in what manner to play the audio resource.
  • the earphone and speaker modes are usually selected, so that different users can listen to audio resources through different devices without interfering with each other.
  • the audio mode of the display device 200 needs to be selected as the visually impaired mode, so that the visually impaired user can listen to the narration information in the resource.
  • FIG. 7 is a schematic diagram of an audio mode interface according to an embodiment of the present application.
  • the controller 250 needs to adjust the audio mode on the audio mode interface to the visually impaired mode.
  • the narration output mode will become a highlighted optional mode, and the user can select a specific narration output mode at this time.
  • the narration output mode on the audio mode interface is grayed out and not selectable, as shown in FIG.
  • the speaker of the device 200 outputs narration information.
  • the display device 200 can currently play audio through earphones and speakers.
  • the users need to choose which device to use to play the narration. information, that is, select the narration output mode.
  • the narration output mode can be selected as headphones, so that visually impaired users can listen to audio resources and narration information at the same time through headphones, while sighted users can listen only through the speakers of the display device 200. audio resources.
  • the controller 250 detects the user's selection, it needs to adjust the narration output mode on the audio mode interface to the earphone, as shown in FIG. 7 , at this time, the earphone plays the audio resource and the narration information at the same time, and the speaker plays the audio resource.
  • the narration output mode can be selected as the speaker, so that the visually impaired user can listen to the audio resources and the narration information through the speaker of the display device 200 at the same time, while the sighted user can only listen to the narration information through the headset audio resources.
  • the controller 250 detects the user's selection, it needs to adjust the narration output mode on the audio mode interface to the speaker, as shown in FIG. 9 , at this time, the speaker plays the audio resource and the narration information at the same time, and the earphone plays the audio resource.
  • the controller 250 If the user selects the narration output mode as all, the visually impaired user and the sighted user can listen to the audio resources and narration information by selecting headphones or speakers. In this case, after the controller 250 detects the user's selection, it needs to adjust the narration output mode on the audio mode interface to all, as shown in FIG.
  • the solutions of the embodiments of the present application can meet the resource playback requirements of both visually impaired users and normal vision users.
  • visually impaired users can use headphones alone to listen to audio resources.
  • Visually impaired users can use the speakers of the display device 200 to listen to audio resources; or visually impaired users can use the speakers of the display device 200 to listen to audio resources and narration information, while visually impaired users can use headphones alone to listen to audio resources .
  • the narration information provided for visually impaired users will not affect the audio content of visually impaired users, and the resource appreciation experience of different users can be guaranteed at the same time.
  • the controller 250 detects that the display device 200 is connected to an earphone, the earphone mode is earphone and speaker, and the audio mode is the normal mode, it means that the user viewing the display device 200 does not need to listen to the narration information, and the control 250
  • the audio mode on the audio mode interface needs to be adjusted to the normal mode, as shown in FIG. 11 , and the controller 250 selects the earphone and the speaker to play audio resources at the same time without playing the narration information.
  • the controller 250 if the controller 250 detects that the display device 200 is connected to an earphone and the earphone mode is earphone, it means that the user only chooses to use the earphone to play audio resources, and the speaker of the display device 200 has no sound output. At this time, the controller 250 needs to adjust the headset mode on the setting interface shown in FIG. 6 to the headset, and the adjusted setting interface is shown in FIG. 12 . In this case, the narration output mode on the audio mode interface becomes a grayed-out non-selectable state, and regardless of whether the controller 250 continues to detect that the audio mode is the normal mode or the visually impaired mode, it will only be played by the headphones. When the audio mode is the normal mode, the controller 250 selects the earphone to play only the audio resource; when the audio mode is the visually impaired mode, the controller 250 selects the earphone to simultaneously play the audio resource and the narration information.
  • the controller 250 detects that the display device 200 is not connected to an earphone, it indicates that the user only selects to use the speaker of the display device 200 to play the audio resource. At this time, the control 250 needs to gray out the headphone mode on the setting interface as shown in FIG. 6 and adjust it to an unavailable state to indicate that there is no headphone connection. In this case, the narration output mode on the audio mode interface will also become a grayed out non-selectable state, and no matter whether the controller 250 continues to detect that the audio mode is the normal mode or the visually impaired mode, it will only be played by the speaker. When the audio mode is the normal mode, the controller 250 selects the speaker of the display device 200 to play only the audio resource; when the audio mode is the visually impaired mode, the controller 250 selects the speaker of the display device 200 to simultaneously play the audio resource and the narration information.
  • the solutions in the above embodiments of the present application can be referred to as shown in FIG. 13 .
  • the controller 250 can perform different processing procedures for whether the display device 200 is connected to an earphone; for different earphone modes, the controller 250 can also perform different processing procedures. Processing flow; at the same time, in different headphone modes or when the headphone is not connected, the controller 250 may also perform different processing procedures for different audio modes. It can be seen that when the visually impaired user and the normal vision user use the display device 200 at the same time, the solution in the embodiment of the present application can provide the visually impaired user and the normal vision user with resource playback services in various ways according to the user's needs and selection.
  • the user's selection of various modes is completed by inputting instructions to the display device 200, and the input methods include but are not limited to remote control input, voice input, etc.
  • the remote controller indirectly inputs instructions to the display device 200, and the voice input means that the user directly inputs instructions to the display device 200 through voice.
  • FIG. 14 is a flowchart of a method for playing resources on a display device according to an embodiment of the application. As shown in FIG. 14 , the method may be implemented by control components such as the controller 250, and may specifically include the following steps:
  • Step S101 detecting whether the display device 200 is connected to an earphone.
  • Step S102 in the case that the display device 200 is connected to an earphone, the current earphone mode of the display device 200 is detected.
  • Step S103 in the case that the earphone mode is the earphone and the speaker, the audio mode of the display device 200 is detected.
  • Step S104 when the audio mode is the visually impaired mode, the narration output mode of the display device 200 is detected.
  • Step S105 according to the headphone mode and the narration output mode, select the audio resource and narration information in the playback resources of the corresponding audio output device.
  • the earphone mode is an earphone and a speaker
  • the audio mode is a visually impaired mode
  • the narration output mode is an earphone
  • the earphone mode is an earphone and a speaker
  • the audio mode is a visually impaired mode
  • the narration output mode is a speaker
  • the earphone mode is earphone and speaker
  • the audio mode is the visually impaired mode
  • the narration output mode is all
  • the earphone mode is an earphone and a speaker
  • the audio mode is a normal mode
  • the audio mode of the display device 200 is detected; in the case that the audio mode is a visually impaired mode , select the headset to play audio resources and narration information.
  • the audio mode of the display device 200 is detected; when the audio mode is the normal mode, Select the headset to play the audio source.
  • the audio mode of the display device 200 when the display device 200 is connected without headphones, the audio mode of the display device 200 is detected; when the audio mode is the visually impaired mode, the audio mode of the display device 200 is selected.
  • the speakers play audio resources and narration information.
  • the audio mode of the display device 200 when the display device 200 is connected without headphones, the audio mode of the display device 200 is detected; when the audio mode is the normal mode, the speaker of the display device 200 is selected Play audio resources.

Abstract

The present application provides a display device resource playing method and a display device. According to the present application, a corresponding audio output device can be selected to play audio resources and speak aside information according to an earphone mode and an audio mode at the time of a display device being connected to an earphone and a speak aside output mode under a visual impairment mode. According to embodiments of the present application, the resource playing requirements of a user having visual impairment and a user having normal vision can be satisfied at the same time; when the user having visual impairment and the user having normal vision watch resources at the same time, the user having visual impairment can listen to the audio resources and speak aside information by using the earphone alone, and the user having normal vision can listen to the audio resources by using a loudspeaker of the display device; or, the user having visual impairment can listen to the audio resources and speak aside information by using the loudspeaker of the display device, and the user having normal vision can listen to the audio resources by using the earphone alone.

Description

显示设备资源播放方法及显示设备Display device resource playback method and display device
本申请要求在2020年10月12日提交中国专利局、申请号为202011084672.7、名称为“显示设备资源播放方法及显示设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application with the application number of 202011084672.7 and the title of "Display Device Resource Playing Method and Display Device" filed with the Chinese Patent Office on October 12, 2020, the entire contents of which are incorporated in this application by reference .
技术领域technical field
本申请涉及显示技术领域，尤其涉及一种显示设备资源播放方法及显示设备。The present application relates to the field of display technology, and in particular, to a method for playing resources of a display device and a display device.
背景技术Background technique
显示设备播放的资源包括视频资源和音频资源，通常，视频资源与音频资源是同步播放的，以便用户在观看到视频资源的同时听到视频中的事物的声音等。The resources played by the display device include video resources and audio resources. Usually, the video resources and the audio resources are played synchronously, so that the user can hear the sound of things in the video while watching the video resources.
资源也可以表示成显示设备的节目，每个节目都有其对应的PSI(Program Specific Information，节目特殊信息)，在PSI中包含PMT(Program Map Table，节目映射表)、描述节目的音频信息和视频信息等。其中，PMT中还包含旁白信息，旁白信息用简洁、生动的语言传达了一种视觉画面，能够帮助盲人或者视力受损的人体验到视频资源呈现画面的视觉形象。The resource can also be expressed as a program of the display device. Each program has its corresponding PSI (Program Specific Information), which includes PMT (Program Map Table), audio information describing the program, and program specific information in the PSI. video information, etc. Among them, the PMT also contains narration information, which conveys a visual image in concise and vivid language, which can help the blind or visually impaired to experience the visual image of the image presented by the video resource.
发明内容SUMMARY OF THE INVENTION
本申请提供了一种显示设备资源播放方法及显示设备，The present application provides a display device resource playback method and display device,
第一方面，本申请提供了一种显示设备，包括：显示器，用于展示显示设备所播放的资源中的视频资源；控制器，用于执行：检测显示设备是否连接耳机；在显示设备连接耳机的情况下，检测显示设备当前的耳机模式；所述耳机模式用于表示显示设备通过哪种音频输出设备播放所述资源中的音频资源；在所述耳机模式为耳机和扬声器的情况下，检测显示设备的音频模式；所述音频模式用于表示显示设备播放的资源是否为视障模式；所述视障模式用于表示显示设备所播放的资源中包含旁白信息；在所述音频模式为视障模式的情况下，检测显示设备的旁白输出模式；所述旁白输出模式用于表示显示设备通过哪种音频输出设备播放所述资源中的旁白信息；根据所述耳机模式和所述旁白输出模式，选择对应的音频输出设备播放所述资源中的音频资源和旁白信息。In a first aspect, the present application provides a display device, including: a display for displaying video resources in resources played by the display device; a controller for performing: detecting whether the display device is connected to a headset; connecting the headset to the display device In the case of , the current headphone mode of the display device is detected; the headphone mode is used to indicate which audio output device the display device uses to play the audio resource in the resource; in the case that the headphone mode is a headphone and a speaker, the detection The audio mode of the display device; the audio mode is used to indicate whether the resource played by the display device is in the visually impaired mode; the visually impaired mode is used to indicate that the resource played by the display device contains narration information; In the case of barrier mode, the narration output mode of the display device is detected; the narration output mode is used to indicate which audio output device the display device uses to play the narration information in the resource; according to the headphone mode and the narration output mode , select the corresponding audio output device to play the audio resource and narration information in the resource.
第二方面，本申请还提供了一种显示设备资源播放方法，包括：检测显示设备是否连接耳机；在显示设备连接耳机的情况下，检测显示设备当前的耳机模式；所述耳机模式用于表示显示设备通过哪种音频输出设备播放所述资源中的音频资源；在所述耳机模式为耳机和扬声器的情况下，检测显示设备的音频模式；所述音频模式用于表示显示设备播放的资源是否为视障模式；所述视障模式用于表示显示设备所播放的资源中包含旁白信息；在所述音频模式为视障模式的情况下，检测显示设备的旁白输出模式；所述旁白输出模式用于表示显示设备通过哪种音频输出设备播放所述资源中的旁白信息；根据所述耳机模式和所述旁白输出模式，选择对应的音频输出设备播放所述资源中的音频资源和旁白信息。In a second aspect, the present application also provides a method for playing a display device resource, including: detecting whether the display device is connected to an earphone; if the display device is connected to the earphone, detecting the current earphone mode of the display device; the earphone mode is used to represent Which audio output device is used by the display device to play the audio resource in the resource; in the case that the earphone mode is an earphone and a speaker, the audio mode of the display device is detected; the audio mode is used to indicate whether the resource played by the display device is is the visually impaired mode; the visually impaired mode is used to indicate that the resources played by the display device contain narration information; when the audio mode is the visually impaired mode, the narration output mode of the display device is detected; the narration output mode It is used to indicate which audio output device the display device uses to play the narration information in the resource; according to the earphone mode and the narration output mode, select the corresponding audio output device to play the audio resource and narration information in the resource.
附图说明Description of drawings
下面将对实施例中所需要使用的附图作简单地介绍，显而易见地，对于本领域普通技术人员而言，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。The accompanying drawings required in the embodiments will be briefly introduced below. Obviously, for those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.
图1中示例性示出了根据一些实施例的显示设备与控制装置之间操作场景的示意图；FIG. 1 exemplarily shows a schematic diagram of an operation scene between a display device and a control apparatus according to some embodiments;
图2中示例性示出了根据一些实施例的显示设备200的硬件配置框图；FIG. 2 exemplarily shows a hardware configuration block diagram of a display device 200 according to some embodiments;
图3中示例性示出了根据一些实施例的控制装置100的硬件配置框图；FIG. 3 exemplarily shows a hardware configuration block diagram of the control apparatus 100 according to some embodiments;
图4中示例性示出了根据一些实施例的显示设备200中软件配置示意图；FIG. 4 exemplarily shows a schematic diagram of software configuration in the display device 200 according to some embodiments;
图5中示例性示出了根据一些实施例的显示设备200中应用程序的图标控件界面显示示意图；FIG. 5 exemplarily shows a schematic diagram of displaying an icon control interface of an application in the display device 200 according to some embodiments;
图6为本申请实施例示出的一种设置界面的示意图；6 is a schematic diagram of a setting interface shown in an embodiment of the application;
图7为本申请实施例示出的一种音频模式界面的示意图；7 is a schematic diagram of an audio mode interface shown in an embodiment of the application;
图8为本申请实施例示出的第二种音频模式界面的示意图；8 is a schematic diagram of a second audio mode interface shown in an embodiment of the application;
图9为本申请实施例示出的第三种音频模式界面的示意图；9 is a schematic diagram of a third audio mode interface shown in an embodiment of the application;
图10为本申请实施例示出的第四种音频模式界面的示意图；10 is a schematic diagram of a fourth audio mode interface shown in an embodiment of the application;
图11为本申请实施例示出的第五种音频模式界面的示意图；11 is a schematic diagram of a fifth audio mode interface shown in an embodiment of the application;
图12为本申请实施例示出的第二种设置界面的示意图；12 is a schematic diagram of a second setting interface shown in an embodiment of the application;
图13为本申请实施例示出的一种控制器250控制流程图；FIG. 13 is a control flow chart of a controller 250 shown in an embodiment of the application;
图14为本申请实施例示出的一种显示设备资源播放方法的流程图。FIG. 14 is a flowchart of a method for playing resources on a display device according to an embodiment of the application.
具体实施方式Detailed ways
为使本申请的目的、实施方式和优点更加清楚，下面将结合本申请示例性实施例中的附图，对本申请示例性实施方式进行清楚、完整地描述，显然，所描述的示例性实施例仅是本申请一部分实施例，而不是全部的实施例。In order to make the objectives, implementations and advantages of the present application clearer, the exemplary embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the exemplary embodiments of the present application. Obviously, the exemplary embodiments described It is only a part of the embodiments of the present application, but not all of the embodiments.
基于本申请描述的示例性实施例，本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例，都属于本申请所附权利要求保护的范围。此外，虽然本申请中公开内容按照示范性一个或几个实例来介绍，但应理解，可以就这些公开内容的各个方面也可以单独构成一个完整实施方式。Based on the exemplary embodiments described in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts shall fall within the protection scope of the appended claims of this application. Furthermore, although the disclosures in this application have been presented in terms of illustrative example or instances, it should be understood that various aspects of this disclosure may also constitute a complete embodiment in isolation.
需要说明的是，本申请中对于术语的简要说明，仅是为了方便理解接下来描述的实施方式，而不是意图限定本申请的实施方式。除非另有说明，这些术语应当按照其普通和通常的含义理解。It should be noted that the brief description of the terms in the present application is only for the convenience of understanding the embodiments described below, rather than intended to limit the embodiments of the present application. Unless otherwise specified, these terms are to be understood according to their ordinary and ordinary meanings.
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体，而不必然意味着限定特定的顺序或先后次序，除非另外注明(Unless otherwise indicated)。应该理解这样使用的用语在适当情况下可以互换，例如能够根据本申请实施例图示或描述中给出那些以外的顺序实施。The terms "first", "second", "third", etc. in the description and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and are not necessarily meant to limit specific Order or precedence unless otherwise indicated. It should be understood that the terms so used are interchangeable under appropriate circumstances, eg, can be implemented in an order other than those given in the illustration or description of the embodiments of the present application.
此外，术语“包括”和“具有”以及他们的任何变形，意图在于覆盖但不排他的包含，例如，包含了一系列组件的产品或设备不必限于清楚地列出的那些组件，而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。Furthermore, the terms "comprising" and "having" and any variations thereof, are intended to cover but not exclusively include, for example, a product or device incorporating a series of components is not necessarily limited to those explicitly listed, but may include No other components are expressly listed or inherent to these products or devices.
本申请中使用的术语“遥控器”，是指电子设备(如本申请中公开的显示设备)的一个组件，通常可在较短的距离范围内无线控制电子设备。一般使用红外线和/或射频(RF)信号和/或蓝牙与电子设备连接，也可以包括WiFi、无线USB、蓝牙、动作传感器等功能模块。例如：手持式触摸遥控器，是以触摸屏中用户界面取代一般遥控装置中的大部分物理内置硬键。As used in this application, the term "remote control" refers to a component of an electronic device, such as the display device disclosed in this application, that can wirelessly control the electronic device, usually over a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example, a hand-held touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.
本申请中使用的术语“手势”，是指用户通过一种手型的变化或手部运动等动作，用于表达预期想法、动作、目的/或结果的用户行为。The term "gesture" used in this application refers to a user's behavior that is used by a user to express an expected thought, action, purpose/or result through an action such as a change of hand shape or hand movement.
图1中示例性示出了根据实施例中显示设备与控制装置之间操作场景的示意图。如图1中示出，用户可通过移动终端300和控制装置100操作显示设备200。FIG. 1 exemplarily shows a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in FIG. 1 , a user may operate the display apparatus 200 through the mobile terminal 300 and the control apparatus 100 .
在一些实施例中，控制装置100可以是遥控器，遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信，及其他短距离通信方式等，通过无线或其他有线方式来控制显示设备200。用户可以通过遥控器上按键，语音输入、控制面板输入等输入用户指令，来控制显示设备200。如：用户可以通过遥控器上音量加减键、频道控制键、上/下/左/右的移动按键、语音输入按键、菜单键、开关机按键等输入相应控制指令，来实现控制显示设备200的功能。In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., and controls the display device 200 by wireless or other wired methods. The user can control the display device 200 by inputting user instructions through keys on the remote control, voice input, control panel input, and the like. For example, the user can control the display device 200 by inputting corresponding control commands through the volume up/down key, channel control key, up/down/left/right movement keys, voice input key, menu key, power-on/off key, etc. on the remote control. function.
在一些实施例中，也可以使用移动终端、平板电脑、计算机、笔记本电脑、和其他智能设备以控制显示设备200。例如，使用在智能设备上运行的应用程序控制显示设备200。该应用程序通过配置可以在与智能设备关联的屏幕上，在直观的用户界面(UI)中为用户提供各种控制。In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the display device 200 . For example, the display device 200 is controlled using an application running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.
在一些实施例中，显示设备可以不使用上述的智能设备或控制设备接收指令，而是通过触摸或者手势等接收用户的控制。In some embodiments, the display device may not use the above-mentioned smart device or control device to receive instructions, but receive user control through touch or gesture.
在一些实施例中，移动终端300可与显示设备200安装软件应用，通过网络通信协议实现连接通信，实现一对一控制操作的和数据通信的目的。如：可以实现用移动终端300与显示设备200建立控制指令协议，将遥控控制键盘同步到移动终端300上，通过控制移动终端300上用户界面，实现控制显示设备200的功能。也可以将移动终端300上显示音视频内容传输到显示设备200上，实现同步显示功能。In some embodiments, the mobile terminal 300 may install a software application with the display device 200 to implement connection communication through a network communication protocol, so as to achieve the purpose of one-to-one control operation and data communication. For example, a control command protocol can be established between the mobile terminal 300 and the display device 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the display device 200 can be realized by controlling the user interface on the mobile terminal 300. The audio and video content displayed on the mobile terminal 300 may also be transmitted to the display device 200 to implement a synchronous display function.
如图1中还示出，显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。示例的，显示设备200通过发送和接收信息，以及电子节目指南(EPG)互动，接收软件程序更新，或访问远程储存的数字媒体库。服务器400可以是一个集群，也可以是多个集群，通过服务器400提供视频点播和广告服务等其他网络服务内容。As also shown in FIG. 1 , the display device 200 also performs data communication with the server 400 through various communication methods. The display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200 . For example, the display device 200 interacts by sending and receiving information, and electronic program guide (EPG), receiving software program updates, or accessing a remotely stored digital media library. The server 400 may be a cluster or multiple clusters, and other network service contents such as video-on-demand and advertising services are provided through the server 400 .
显示设备200，可以液晶显示器、OLED显示器、投影显示设备。具体显示设备类型，尺寸大小和分辨率等不作限定，本领技术人员可以理解的是，显示设备200可以根据需要做性能和配置上一些改变。The display device 200 may be a liquid crystal display, an OLED display, or a projection display device. The specific display device type, size and resolution are not limited. Those skilled in the art can understand that the display device 200 can make some changes in performance and configuration as required.
显示设备200除了提供广播接收电视功能之外，还可以附加提供计算机支持功能的智能网络电视功能，包括但不限于，网络电视、智能电视、互联网协议电视(IPTV)等。The display device 200 may additionally provide a smart IPTV function that provides computer-supported functions, including but not limited to, IPTV, smart TV, Internet Protocol TV (IPTV), and the like, in addition to the broadcast receiving TV function.
图2中示例性示出了根据示例性实施例中显示设备200的硬件配置框图。FIG. 2 exemplarily shows a block diagram of the hardware configuration of the display device 200 according to the exemplary embodiment.
在一些实施例中，显示设备200中包括控制器250、调谐解调器210、通信器220、 检测器230、输入/输出接口255、显示器275，音频输出接口285、存储器260、供电电源290、用户接口265、外部装置接口240中的至少一种。In some embodiments, the display device 200 includes a controller 250, a tuner 210, a communicator 220, a detector 230, an input/output interface 255, a display 275, an audio output interface 285, a memory 260, a power supply 290, At least one of the user interface 265 and the external device interface 240 .
显示器275，用于接收源自第一处理器输出的图像信号，进行显示视频内容和图像以及菜单操控界面的组件。The display 275 is used for receiving the image signal output from the first processor, and performing components for displaying video content and images and a menu manipulation interface.
显示器275，包括用于呈现画面的显示屏组件，以及驱动图像显示的驱动组件。The display 275 includes a display screen component for presenting pictures, and a driving component for driving image display.
在一些实施例中，显示器275用于呈现显示设备200中产生且用于控制显示设备200的用户操控UI界面。根据显示器275类型不同，还包括用于驱动显示的驱动组件。In some embodiments, display 275 is used to present a user-manipulated UI interface generated in display device 200 and used to control display device 200 . Depending on the type of display 275, a driving component for driving the display is also included.
在一些实施例中，显示器275为一种投影显示器，还可以包括一种投影装置和投影屏幕。In some embodiments, display 275 is a projection display, and may also include a projection device and projection screen.
通信器220可用于根据各种通信协议类型与外部设备或外部服务器进行通信的组件。例如：通信器220可以包括Wifi模块221，蓝牙模块222，有线以太网模块223等其他网络通信协议模块或近场通信协议模块，以及红外接收器中的至少一种。显示设备200可以通过通信器220与外部控制装置100或内容提供设备之间建立控制信号和数据信号发送和接收。 Communicator 220 may be used for components that communicate with external devices or external servers according to various communication protocol types. For example, the communicator 220 may include at least one of a Wifi module 221, a Bluetooth module 222, a wired Ethernet module 223 and other network communication protocol modules or near field communication protocol modules, and an infrared receiver. The display apparatus 200 may establish control signal and data signal transmission and reception between the external control apparatus 100 or the content providing apparatus through the communicator 220 .
用户接口265，可用于接收控制装置100(如：红外遥控器等)红外控制信号。The user interface 265 can be used to receive infrared control signals from the control device 100 (eg, an infrared remote control, etc.).
检测器230可用于显示设备200采集外部环境或与外部交互的信号。The detector 230 may be used for the display device 200 to collect external environment or external interaction signals.
检测器230包括光接收器，用于采集环境光线强度的传感器，可以通过采集环境光可以自适应性显示参数变化等。检测器230还可以包括图像采集器232，如相机、摄像头等，可以用于采集外部环境场景，以及用于采集用户的属性或与用户交互手势，可以自适应变化显示参数，也可以识别用户手势，以实现与用户之间互动的功能。The detector 230 includes a light receiver, a sensor for collecting ambient light intensity, and can adaptively display parameter changes and the like by collecting ambient light. The detector 230 may also include an image collector 232, such as a camera, a camera, etc., which can be used to collect external environment scenes, as well as to collect user attributes or interactive gestures with the user, and can adaptively change display parameters and recognize user gestures. , in order to realize the function of interaction with users.
在一些实施例中，检测器230还可以包括声音采集器231等，如麦克风，可以用于接收用户的声音。示例性的，包括用户控制显示设备200的控制指令的语音信号，或采集环境声音，用于识别环境场景类型，使得显示设备200可以自适应适应环境噪声。In some embodiments, the detector 230 may further include a sound collector 231 or the like, such as a microphone, which may be used to receive the user's voice. Exemplarily, a voice signal including a control instruction of the user to control the display device 200, or collecting ambient sounds, is used to identify the type of the environment scene, so that the display device 200 can adaptively adapt to the ambient noise.
如图2所示，输入/输出接口255被配置为，可进行控制器250与外部其他设备或其他控制器250之间的数据传输。如接收外部设备的视频信号数据和音频信号数据、或命令指令数据等。As shown in FIG. 2 , the input/output interface 255 is configured to enable data transfer between the controller 250 and other external devices or other controllers 250 . Such as receiving video signal data and audio signal data of external equipment, or command instruction data, etc.
在一些实施例中，外部装置接口240可以包括，但不限于如下：可以高清多媒体接口HDMI接口、模拟或数据高清分量输入接口、复合视频输入接口、USB输入接口、RGB端口等任一个或多个接口。也可以是上述多个接口形成复合性的输入/输出接口。In some embodiments, the external device interface 240 may include, but is not limited to, the following: any one or more of a high-definition multimedia interface HDMI interface, an analog or data high-definition component input interface, a composite video input interface, a USB input interface, an RGB port, etc. interface. It is also possible to form a composite input/output interface by a plurality of the above-mentioned interfaces.
在一些实施例中，如图2所示，调谐解调器210被配置为，通过有线或无线接收方式接收广播电视信号，可以进行放大、混频和谐振等调制解调处理，从多个无线或有线广播电视信号中解调出音视频信号，该音视频信号可以包括用户所选择电视频道频率中所携带的电视音视频信号，以及EPG数据信号。In some embodiments, as shown in FIG. 2 , the tuner and demodulator 210 is configured to receive broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, frequency mixing, and resonance, and can perform modulation and demodulation processing from multiple wireless receivers. Or demodulate the audio and video signal from the cable broadcast TV signal, the audio and video signal may include the TV audio and video signal carried in the frequency of the TV channel selected by the user, and the EPG data signal.
在一些实施例中，控制器250和调谐解调器210可以位于不同的分体设备中，即调谐解调器210也可在控制器250所在的主体设备的外置设备中，如外置机顶盒等。这样，机顶盒将接收到的广播电视信号调制解调后的电视音视频信号输出给主体设备，主体设备经过第一输入/输出接口接收音视频信号。In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait. In this way, the set-top box outputs the modulated and demodulated television audio and video signals of the received broadcast television signals to the main device, and the main device receives the audio and video signals through the first input/output interface.
在一些实施例中，控制器250，通过存储在存储器上中各种软件控制程序，来控制显示设备的工作和响应用户的操作。控制器250可以控制显示设备200的整体操作。 例如：响应于接收到用于选择在显示器275上显示UI对象的用户命令，控制器250便可以执行与由用户命令选择的对象有关的操作。In some embodiments, the controller 250, through various software control programs stored on the memory, controls the operation of the display device and responds to user operations. The controller 250 may control the overall operation of the display apparatus 200 . For example, in response to receiving a user command for selecting a UI object to be displayed on the display 275, the controller 250 may perform an operation related to the object selected by the user command.
如图2所示，控制器250包括随机存取存储器251(Random Access Memory，RAM)、只读存储器252(Read-Only Memory,ROM)、图形处理器253(Graphics Processing Unit，GPU)、中央处理器254(Central Processing Unit，CPU)、输入/输出接口255以及通信总线256(Bus)中的至少一种。其中，通信总线连接各个部件。As shown in FIG. 2, the controller 250 includes a random access memory 251 (Random Access Memory, RAM), a read-only memory 252 (Read-Only Memory, ROM), a graphics processor 253 (Graphics Processing Unit, GPU), a central processing unit At least one of a processor 254 (Central Processing Unit, CPU), an input/output interface 255 and a communication bus 256 (Bus). Among them, the communication bus connects the various components.
在一些实施例中，RAM 251用于存储操作***或其他正在运行中的程序的临时数据。In some embodiments, RAM 251 is used to store temporary data for the operating system or other running programs.
在一些实施例中，ROM 252用于存储各种***启动的指令。In some embodiments, ROM 252 is used to store various system startup instructions.
在一些实施例中，ROM 252用于存储一个基本输入输出***，称为基本输入输出***(Basic Input Output System，BIOS)。用于完成对***的加电自检、***中各功能模块的初始化、***的基本输入/输出的驱动程序及引导操作***。In some embodiments, ROM 252 is used to store a basic input output system, called a Basic Input Output System (BIOS). It is used to complete the power-on self-check of the system, the initialization of each functional module in the system, the driver program of the basic input/output of the system, and the boot operating system.
在一些实施例中，在收到开机信号时，显示设备200电源开始启动，CPU运行ROM 252中***启动指令，将存储在存储器的操作***的临时数据拷贝至RAM 251中，以便于启动或运行操作***。当操作***启动完成后，CPU再将存储器中各种应用程序的临时数据拷贝至RAM 251中，然后，以便于启动或运行各种应用程序。In some embodiments, when the power-on signal is received, the power supply of the display device 200 starts to start, and the CPU executes the system start-up instruction in the ROM 252, and copies the temporary data of the operating system stored in the memory to the RAM 251, so as to facilitate startup or operation operating system. After the startup of the operating system is completed, the CPU copies the temporary data of various application programs in the memory to the RAM 251, and then, in order to start or run various application programs.
在一些实施例中，处理器254，用于执行存储在存储器中操作***和应用程序指令。以及根据接收外部输入的各种交互指令，来执行各种应用程序、数据和内容，以便最终显示和播放各种音视频内容。In some embodiments, processor 254 executes operating system and application program instructions stored in memory. And various application programs, data and content are executed according to various interactive instructions received from the external input, so as to finally display and play various audio and video content.
在一些示例性实施例中，处理器254，可以包括多个处理器。多个处理器可包括一个主处理器以及一个或多个子处理器。主处理器，用于在预加电模式中执行显示设备200一些操作，和/或在正常模式下显示画面的操作。一个或多个子处理器，用于在待机模式等状态下一种操作。In some exemplary embodiments, processor 254 may include multiple processors. The plurality of processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the display device 200 in the pre-power-on mode, and/or an operation of displaying a picture in the normal mode. One or more sub-processors for an operation in a state such as standby mode.
在一些实施例中，图形处理器253，用于产生各种图形对象，如：图标、操作菜单、以及用户输入指令显示图形等。包括运算器，通过接收用户输入各种交互指令进行运算，根据显示属性显示各种对象。以及包括渲染器，对基于运算器得到的各种对象，进行渲染，上述渲染后的对象用于显示在显示器上。In some embodiments, the graphics processor 253 is used to generate various graphic objects, such as: icons, operation menus, and user input instructions to display graphics and the like. It includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display properties. and includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for displaying on a display.
在一些实施例中，视频处理器270被配置为将接收外部视频信号，根据输入信号的标准编解码协议，进行视频处理，可得到直接可显示设备200上显示或播放的信号。In some embodiments, the video processor 270 is configured to receive an external video signal, perform video processing according to the standard codec protocol of the input signal, and obtain a signal directly displayed or played on the display device 200 .
在一些实施例中，视频处理器270，包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等。In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
在一些实施例中，图形处理器253可以和视频处理器可以集成设置，也可以分开设置，集成设置的时候可以执行输出给显示器的图形信号的处理，分离设置的时候可以分别执行不同的功能，例如GPU+FRC(Frame Rate Conversion))架构。In some embodiments, the graphics processor 253 may be integrated with the video processor, or may be separately configured. When the integrated setting is performed, the processing of the graphics signal output to the display may be performed. When the separate setting is performed, different functions may be performed respectively. For example, GPU+FRC (Frame Rate Conversion)) architecture.
在一些实施例中，音频处理器280，用于接收外部的音频信号，根据输入信号的标准编解码协议，进行解压缩和解码，以及降噪、数模转换、和放大处理等处理，得到可以在扬声器中播放的声音信号。In some embodiments, the audio processor 280 is configured to receive an external audio signal, perform decompression and decoding, and noise reduction, digital-to-analog conversion, and amplification processing according to a standard codec protocol of the input signal to obtain a The sound signal played in the speaker.
在一些实施例中，视频处理器270可以包括一颗或多颗芯片组成。音频处理器，也可以包括一颗或多颗芯片组成。In some embodiments, the video processor 270 may comprise one or more chips. The audio processor may also include one or more chips.
在一些实施例中，视频处理器270和音频处理器280，可以单独的芯片，也可以 于控制器一起集成在一颗或多颗芯片中。In some embodiments, the video processor 270 and the audio processor 280 may be separate chips, or may be integrated into one or more chips together with the controller.
在一些实施例中，音频输出，在控制器250的控制下接收音频处理器280输出的声音信号，如：扬声器286，以及除了显示设备200自身携带的扬声器之外，可以输出至外接设备的发生装置的外接音响输出端子，如：外接音响接口或耳机接口等，还可以包括通信接口中的近距离通信模块，例如：用于进行蓝牙扬声器声音输出的蓝牙模块。In some embodiments, the audio output, under the control of the controller 250, receives the sound signal output by the audio processor 280, such as the speaker 286, and in addition to the speaker carried by the display device 200 itself, can be output to an external device. The external audio output terminal of the device, such as an external audio interface or an earphone interface, etc., may also include a short-range communication module in the communication interface, such as a Bluetooth module for outputting sound from a Bluetooth speaker.
供电电源290，在控制器250控制下，将外部电源输入的电力为显示设备200提供电源供电支持。供电电源290可以包括安装显示设备200内部的内置电源电路，也可以是安装在显示设备200外部电源，在显示设备200中提供外接电源的电源接口。The power supply 290, under the control of the controller 250, provides power supply support for the display device 200 with the power input from the external power supply. The power supply 290 may include a built-in power supply circuit installed inside the display device 200 , or may be an external power supply installed in the display device 200 to provide an external power supply interface in the display device 200 .
用户接口265，用于接收用户的输入信号，然后，将接收用户输入信号发送给控制器250。用户输入信号可以是通过红外接收器接收的遥控器信号，可以通过网络通信模块接收各种用户控制信号。The user interface 265 is used for receiving user input signals, and then sending the received user input signals to the controller 250 . The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.
在一些实施例中，用户通过控制装置100或移动终端300输入用户命令，用户输入接口则根据用户的输入，显示设备200则通过控制器250响应用户的输入。In some embodiments, the user inputs user commands through the control device 100 or the mobile terminal 300 , the user input interface is based on the user's input, and the display device 200 responds to the user's input through the controller 250 .
在一些实施例中，用户可在显示器275上显示的图形用户界面(GUI)输入用户命令，则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者，用户可通过输入特定的声音或手势进行输入用户命令，则用户输入接口通过传感器识别出声音或手势，来接收用户输入命令。In some embodiments, the user may input user commands on a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
存储器260，包括存储用于驱动显示设备200的各种软件模块。如：第一存储器中存储的各种软件模块，包括：基础模块、检测模块、通信模块、显示控制模块、浏览器模块、和各种服务模块等中的至少一种。The memory 260 includes storing various software modules for driving the display device 200 . For example, various software modules stored in the first memory include at least one of a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.
基础模块用于显示设备200中各个硬件之间信号通信、并向上层模块发送处理和控制信号的底层软件模块。The basic module is used for signal communication between various hardwares in the display device 200, and is a low-level software module that sends processing and control signals to the upper-layer module.
图3示例性示出了根据示例性实施例中控制装置100的配置框图。如图3所示，控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器190、供电电源180。FIG. 3 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment. As shown in FIG. 3 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory 190 , and a power supply 180 .
控制装置100被配置为控制显示设备200，以及可接收用户的输入操作指令，且将操作指令转换为显示设备200可识别和响应的指令，起用用户与显示设备200之间交互中介作用。如：用户通过操作控制装置100上频道加减键，显示设备200响应频道加减的操作。The control apparatus 100 is configured to control the display device 200 , and can receive the user's input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, so as to play an interactive intermediary role between the user and the display device 200 . For example, the user operates the channel addition and subtraction keys on the control device 100, and the display device 200 responds to the channel addition and subtraction operation.
在一些实施例中，控制装置100可是一种智能设备。如：控制装置100可根据用户需求安装控制显示设备200的各种应用。In some embodiments, the control apparatus 100 may be a smart device. For example, the control apparatus 100 may install various applications for controlling the display device 200 according to user requirements.
在一些实施例中，如图1所示，移动终端300或其他智能电子设备，可在安装操控显示设备200的应用之后，可以起到控制装置100类似功能。如：用户可以通过安装应用，在移动终端300或其他智能电子设备上可提供的图形用户界面的各种功能键或虚拟按钮，以实现控制装置100实体按键的功能。In some embodiments, as shown in FIG. 1 , the mobile terminal 300 or other intelligent electronic device can perform a similar function of the control apparatus 100 after installing the application for operating the display device 200 . For example, the user can install the application, various function keys or virtual buttons of the graphical user interface available on the mobile terminal 300 or other intelligent electronic devices, so as to realize the function of the physical key of the control apparatus 100 .
控制器110包括处理器112和RAM 113和ROM 114。控制器用于控制控制装置100的运行和操作，以及内部各部件之间通信协作以及外部和内部的数据处理功能。 Controller 110 includes processor 112 and RAM 113 and ROM 114. The controller is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.
通信接口130在控制器110的控制下，实现与显示设备200之间控制信号和数据信号的通信。如：将接收到的用户输入信号发送至显示设备200上。通信接口130可 包括WiFi芯片131、蓝牙模块132、NFC模块133等其他近场通信模块中至少之一种。The communication interface 130 realizes the communication of control signals and data signals with the display device 200 under the control of the controller 110 . For example, the received user input signal is sent to the display device 200 . The communication interface 130 may include at least one of the WiFi chip 131, the Bluetooth module 132, the NFC module 133 and other near field communication modules.
用户输入/输出接口140，其中，输入接口包括麦克风141、触摸板142、传感器143、按键144等其他输入接口中至少一者。如：用户可以通过语音、触摸、手势、按压等动作实现用户指令输入功能，输入接口通过将接收的模拟信号转换为数字信号，以及数字信号转换为相应指令信号，发送至显示设备200。The user input/output interface 140, wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a key 144. For example, the user can implement the user command input function through actions such as voice, touch, gesture, pressing, etc. The input interface converts the received analog signal into a digital signal, and converts the digital signal into a corresponding command signal, and sends it to the display device 200.
输出接口包括将接收的用户指令发送至显示设备200的接口。在一些实施例中，可以红外接口，也可以是射频接口。如：红外信号接口时，需要将用户输入指令按照红外控制协议转化为红外控制信号，经红外发送模块进行发送至显示设备200。再如：射频信号接口时，需将用户输入指令转化为数字信号，然后按照射频控制信号调制协议进行调制后，由射频发送端子发送至显示设备200。The output interface includes an interface for transmitting received user instructions to the display device 200 . In some embodiments, it can be an infrared interface or a radio frequency interface. For example, when the infrared signal interface is used, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the display device 200 through the infrared sending module. For another example, when a radio frequency signal interface is used, the user input command needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the display device 200 by the radio frequency transmission terminal.
在一些实施例中，控制装置100包括通信接口130和输入输出接口140中至少一者。控制装置100中配置通信接口130，如：WiFi、蓝牙、NFC等模块，可将用户输入指令通过WiFi协议、或蓝牙协议、或NFC协议编码，发送至显示设备200。In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input-output interface 140 . The control device 100 is configured with a communication interface 130, such as modules such as WiFi, Bluetooth, NFC, etc., which can send user input instructions to the display device 200 through WiFi protocol, Bluetooth protocol, or NFC protocol encoding.
存储器190，用于在控制器的控制下存储驱动和控制控制设备200的各种运行程序、数据和应用。存储器190，可以存储用户输入的各类控制信号指令。The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller. The memory 190 can store various control signal instructions input by the user.
供电电源180，用于在控制器的控制下为控制装置100各元件提供运行电力支持。可以电池及相关控制电路。The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller. Can battery and related control circuit.
参见图4，在一些实施例中，将***分为四层，从上至下分别为应用程序(Applications)层(简称“应用层”)，应用程序框架(Application Framework)层(简称“框架层”)，安卓运行时(Android runtime)和***库层(简称“***运行库层”)，以及内核层。Referring to FIG. 4 , in some embodiments, the system is divided into four layers, from top to bottom, they are an application layer (referred to as “application layer”), an application framework layer (referred to as “framework layer”) ”), the Android runtime and the system library layer (referred to as the “system runtime layer”), and the kernel layer.
在一些实施例中，应用程序层中运行有至少一个应用程序，这些应用程序可以是操作***自带的窗口(Window)程序、***设置程序、时钟程序、相机应用等；也可以是第三方开发者所开发的应用程序。In some embodiments, at least one application program runs in the application program layer, and these application programs may be a Window program, a system setting program, a clock program, a camera application, etc. built into the operating system; they may also be developed by a third party applications developed by the author.
框架层为应用程序层的应用程序提供应用编程接口(application programming interface，API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心，这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口，可在执行中访问***中的资源和取得***的服务。The framework layer provides an application programming interface (API) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which decides to let the applications in the application layer take action. The application program can access the resources in the system and obtain the services of the system during execution through the API interface.
如图4所示，本申请实施例中应用程序框架层包括管理器(Managers)，内容提供者(Content Provider)等，其中管理器包括以下模块中的至少一个：活动管理器(Activity Manager)用与和***中正在运行的所有活动进行交互；位置管理器(Location Manager)用于给***服务或应用提供了***位置服务的访问；文件包管理器(Package Manager)用于检索当前安装在设备上的应用程序包相关的各种信息；通知管理器(Notification Manager)用于控制通知消息的显示和清除；窗口管理器(Window Manager)用于管理用户界面上的括图标、窗口、工具栏、壁纸和桌面部件。As shown in FIG. 4 , the application framework layer in the embodiment of the present application includes managers (Managers), content providers (Content Provider), etc., wherein the manager includes at least one of the following modules: an activity manager (Activity Manager) uses Interacts with all activities running in the system; Location Manager is used to provide system services or applications with access to system location services; Package Manager is used to retrieve files currently installed on the device Various information related to the application package; Notification Manager (Notification Manager) is used to control the display and clearing of notification messages; Window Manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers on the user interface and desktop widgets.
在一些实施例中，活动管理器用于：管理各个应用程序的生命周期以及通常的导航回退功能，比如控制应用程序的退出(包括将显示窗口中当前显示的用户界面切换到***桌面)、打开、后退(包括将显示窗口中当前显示的用户界面切换到当前显示的用户界面的上一级用户界面)等。In some embodiments, the activity manager is used to: manage the life cycle of each application and the usual navigation and fallback functions, such as controlling the exit of the application (including switching the user interface currently displayed in the display window to the system desktop), opening the , back (including switching the currently displayed user interface in the display window to the upper-level user interface of the currently displayed user interface), and the like.
在一些实施例中，窗口管理器用于管理所有的窗口程序，比如获取显示屏大小，判断是否有状态栏，锁定屏幕，截取屏幕，控制显示窗口变化(例如将显示窗口缩小显示、抖动显示、扭曲变形显示等)等。In some embodiments, the window manager is used to manage all window programs, such as obtaining the size of the display screen, judging whether there is a status bar, locking the screen, taking screenshots, and controlling the change of the display window (for example, reducing the display window to display, shaking display, twisting deformation display, etc.), etc.
在一些实施例中，***运行库层为上层即框架层提供支撑，当框架层被使用时，安卓操作***会运行***运行库层中包含的C/C++库以实现框架层要实现的功能。In some embodiments, the system runtime layer provides support for the upper layer, that is, the framework layer. When the framework layer is used, the Android operating system will run the C/C++ library included in the system runtime layer to implement the functions to be implemented by the framework layer.
在一些实施例中，内核层是硬件和软件之间的层。如图4所示，内核层至少包含以下驱动中的至少一种：音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器，温度传感器，触摸传感器、压力传感器等)等。In some embodiments, the kernel layer is the layer between hardware and software. As shown in Figure 4, the kernel layer at least includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, touch sensors, pressure sensors, etc.), etc.
在一些实施例中，对于具备触控功能的显示设备，以分屏操作为例，显示设备接收用户作用于显示屏上的输入操作(如分屏操作)，内核层可以根据输入操作产生相应的输入事件，并向应用程序框架层上报该事件。由应用程序框架层的活动管理器设置与该输入操作对应的窗口模式(如多窗口模式)以及窗口位置和大小等。应用程序框架层的窗口管理根据活动管理器的设置绘制窗口，然后将绘制的窗口数据发送给内核层的显示驱动，由显示驱动在显示屏的不同显示区域显示与之对应的应用界面。In some embodiments, for a display device with a touch function, taking a split-screen operation as an example, the display device receives an input operation (such as a split-screen operation) performed by the user on the display screen, and the kernel layer can generate corresponding input operations according to the input operation. Enter an event and report the event to the application framework layer. The window mode (such as multi-window mode) and window position and size corresponding to the input operation are set by the activity manager of the application framework layer. The window management of the application framework layer draws the window according to the settings of the activity manager, and then sends the drawn window data to the display driver of the kernel layer, and the display driver displays the corresponding application interface in different display areas of the display screen.
在一些实施例中，如图5中所示，应用程序层包含至少一个应用程序可以在显示器中显示对应的图标控件，如：直播电视应用程序图标控件、视频点播应用程序图标控件、媒体中心应用程序图标控件、应用程序中心图标控件、游戏应用图标控件等。In some embodiments, as shown in FIG. 5, the application layer contains at least one application that can display corresponding icon controls in the display, such as: live TV application icon control, video on demand application icon control, media center application Program icon controls, application center icon controls, game application icon controls, etc.
在一些实施例中，直播电视应用程序，可以通过不同的信号源提供直播电视。例如，直播电视应用程可以使用来自有线电视、无线广播、卫星服务或其他类型的直播电视服务的输入提供电视信号。以及，直播电视应用程序可在显示设备200上显示直播电视信号的视频。In some embodiments, the live TV application may provide live TV from different sources. For example, a live TV application may provide a TV signal using input from cable, over-the-air, satellite services, or other types of live TV services. And, the live TV application may display the video of the live TV signal on the display device 200 .
在一些实施例中，视频点播应用程序，可以提供来自不同存储源的视频。不同于直播电视应用程序，视频点播提供来自某些存储源的视频显示。例如，视频点播可以来自云存储的服务器端、来自包含已存视频节目的本地硬盘储存器。In some embodiments, a video-on-demand application may provide video from various storage sources. Unlike live TV applications, video-on-demand provides a display of video from certain storage sources. For example, video-on-demand can come from the server side of cloud storage, from local hard disk storage containing existing video programs.
在一些实施例中，媒体中心应用程序，可以提供各种多媒体内容播放的应用程序。例如，媒体中心，可以为不同于直播电视或视频点播，用户可通过媒体中心应用程序访问各种图像或音频所提供服务。In some embodiments, the media center application may provide various multimedia content playback applications. For example, a media center may provide services other than live TV or video-on-demand, where users can access various images or audio through a media center application.
在一些实施例中，应用程序中心，可以提供储存各种应用程序。应用程序可以是一种游戏、应用程序，或某些和计算机***或其他设备相关但可以在智能电视中运行的其他应用程序。应用程序中心可从不同来源获得这些应用程序，将它们储存在本地储存器中，然后在显示设备200上可运行。In some embodiments, the application center may provide storage of various applications. An application can be a game, an application, or some other application that is related to a computer system or other device but can be run on a Smart TV. The application center can obtain these applications from various sources, store them in local storage, and then run them on the display device 200 .
显示设备200播放的资源包括视频资源和音频资源，通常，视频资源与音频资源是同步播放的，以便用户在观看到视频资源的同时听到视频中的事物的声音等等。The resources played by the display device 200 include video resources and audio resources. Usually, the video resources and the audio resources are played synchronously, so that the user can hear the sounds of things in the video while watching the video resources.
资源也可以表示成显示设备的节目，每个节目都有其对应的PSI(Program Specific Information，节目特殊信息)，在PSI中包含PMT(Program Map Table，节目映射表)、描述节目的音频信息和视频信息等。其中，PMT中还包含旁白信息，旁白信息用简洁、生动的语言传达了一种视觉画面，能够帮助盲人或者视力受损的人体验到视频资源呈现画面的视觉形象。The resource can also be expressed as a program of the display device. Each program has its corresponding PSI (Program Specific Information), which includes PMT (Program Map Table), audio information describing the program, and program specific information in the PSI. video information, etc. Among them, the PMT also contains narration information, which conveys a visual image in concise and vivid language, which can help the blind or visually impaired to experience the visual image of the image presented by the video resource.
但是，当具有视力障碍的用户和视力正常的用户同时观看显示设备资源时，视力 障碍和视力正常的用户都会听到旁白信息。对于视力正常的用户来说，通常并不需要旁白信息来辅助感受视觉画面，而旁白信息的输出会影响视力正常的用户感受音频资源中的背景音乐(比如鸟叫声、下雨声)等，影响视力正常的用户对视频资源画面的真实感受。However, when a visually impaired user and a sighted user view display device resources at the same time, both the sighted and sighted user will hear the narration information. For users with normal vision, narration information is usually not needed to assist in the perception of visual images, and the output of narration information will affect users with normal vision to experience the background music (such as bird calls, rain) in audio resources, etc. Affects the real feelings of users with normal vision on the video resource picture.
基于以上问题，本申请实施例提供了一种显示设备资源播放方法及显示设备，能够根据显示设备200连接耳机时的耳机模式、音频模式以及视障模式下的旁白输出模式，选择对应的音频输出设备播放音频资源和旁白信息。可以同时满足视力障碍用户和视力正常用户的资源播放需求，当视力障碍用户和视力正常用户同时观看资源时，为视力障碍用户提供的旁白信息并不会影响视力正常用户的音频内容，可以同时保证不同用户的资源观看体验。Based on the above problems, the embodiments of the present application provide a display device resource playback method and display device, which can select the corresponding audio output according to the headphone mode, the audio mode when the display device 200 is connected to the headphones, and the narration output mode in the visually impaired mode. The device plays audio resources and narration information. It can meet the resource playback requirements of both visually impaired users and sighted users. When visually impaired users and normal sighted users watch resources at the same time, the narration information provided for visually impaired users will not affect the audio content of sighted users. The resource viewing experience of different users.
本申请实施例提供的显示设备200至少可以包括显示器275和控制器250。其中，显示器275可以展示显示设备200所播放的资源中的视频资源，控制器250可以获取显示设备200当前的一些外设连接状态和模式设置情况，并且控制显示器275进行相应的模式显示以及控制音频资源和旁白信息输出。The display device 200 provided in this embodiment of the present application may include at least a display 275 and a controller 250 . The display 275 can display the video resources in the resources played by the display device 200, and the controller 250 can obtain some current peripheral connection states and mode settings of the display device 200, and control the display 275 to perform corresponding mode display and control audio Resource and narration information output.
本申请实施例中，显示设备200的外设连接状态即耳机的连接状态，控制器250需要判断显示设备200除本身具有的扬声器外是否还连接了耳机设备。是否连接耳机需要用户根据自己的需求进行选择。连接耳机之后，音频资源的播放方式就包括了耳机、耳机和扬声器两种，分别是由耳机播放音频资源以及由耳机和扬声器同时播放音频资源；而不连接耳机，音频资源只能由显示设备200的扬声器播放。In the embodiment of the present application, the peripheral device connection state of the display device 200 is the connection state of the earphone, and the controller 250 needs to determine whether the display device 200 is connected to the earphone device in addition to the speaker itself. Whether to connect headphones or not requires users to choose according to their own needs. After the headset is connected, the audio resources can be played in two ways: the headset, the headset and the speaker. The audio resources are played by the headset and the audio resources are played by the headset and the speaker at the same time; without connecting the headset, the audio resources can only be played by the display device 200. speaker to play.
图6为本申请实施例示出的一种设置界面的示意图。当用户选择在显示设备200上连接耳机之后，控制器250检测到显示设备200连接了耳机，此时需要将如图6所示的设置界面上的耳机模式设为高亮的可选状态，进而可以让用户选择音频资源的播放方式。其中，耳机模式具体包括耳机、耳机和扬声器两种，其中耳机模式为耳机时表示用户选择由耳机播放音频资源；耳机模式为耳机和扬声器时表示用户选择由耳机和扬声器同时播放音频资源。FIG. 6 is a schematic diagram of a setting interface according to an embodiment of the present application. After the user chooses to connect the headset to the display device 200, the controller 250 detects that the display device 200 is connected to the headset. At this time, the headset mode on the setting interface as shown in FIG. 6 needs to be set to the highlighted optional state, and then Allows the user to choose how the audio resource is played. The earphone mode specifically includes earphones, earphones and speakers. When the earphone mode is earphone, it means that the user chooses to play audio resources through the earphone; when the earphone mode is earphone and speaker, it means that the user chooses to play audio resources through the earphone and the speaker at the same time.
用户在选择了具体的耳机模式后，控制器250检测到当前的耳机模式，进而确定通过何种方式播放音频资源。After the user selects a specific headphone mode, the controller 250 detects the current headphone mode, and then determines in what manner to play the audio resource.
当视力障碍的用户和视力正常的用户共同观看显示设备200时，通常是选择耳机和扬声器模式，以便不同的用户通过不同的设备收听到音频资源，互不干扰。When a visually impaired user and a sighted user watch the display device 200 together, the earphone and speaker modes are usually selected, so that different users can listen to audio resources through different devices without interfering with each other.
并且，当视力障碍的用户和视力正常的用户共同观看显示设备200时，需要将显示设备200的音频模式选择为视障模式，以便视力障碍的用户收听到资源中的旁白信息。Moreover, when a visually impaired user and a sighted user watch the display device 200 together, the audio mode of the display device 200 needs to be selected as the visually impaired mode, so that the visually impaired user can listen to the narration information in the resource.
图7为本申请实施例示出的一种音频模式界面的示意图。如图7所示，控制器250在检测到音频模式后，需要将音频模式界面上音频模式调整为视障模式。并且，只有在耳机模式为耳机和扬声器时，如图7所示的音频模式中，旁白输出模式才会变为高亮的可选模式，此时用户可以选择具体的旁白输出方式。而当耳机模式为耳机或者显示设备200没有连接耳机时，音频模式界面上的旁白输出模式为置灰的不可选状态，如图8所示，即只能由耳机输出旁白信息或者只能由显示设备200的扬声器输出旁白信息。FIG. 7 is a schematic diagram of an audio mode interface according to an embodiment of the present application. As shown in FIG. 7 , after detecting the audio mode, the controller 250 needs to adjust the audio mode on the audio mode interface to the visually impaired mode. Moreover, only when the headphone mode is headphone and speaker, in the audio mode as shown in FIG. 7 , the narration output mode will become a highlighted optional mode, and the user can select a specific narration output mode at this time. However, when the headphone mode is headphone or the display device 200 is not connected to the headphone, the narration output mode on the audio mode interface is grayed out and not selectable, as shown in FIG. The speaker of the device 200 outputs narration information.
如图6和图7所示，显示设备200当前可以通过耳机和扬声器共同播放音频，但 是为了方便视力障碍用户和视力正常用户共同收听且互不影响，用户们还要选择通过何种设备播放旁白信息，即选择旁白输出模式。旁白输出模式包括三种，耳机、扬声器和全部。As shown in FIG. 6 and FIG. 7 , the display device 200 can currently play audio through earphones and speakers. However, in order to facilitate the visually impaired users and normal vision users to listen to each other without affecting each other, the users need to choose which device to use to play the narration. information, that is, select the narration output mode. There are three narration output modes, Headphones, Speakers, and All.
如果视力障碍的用户使用耳机收听，那么可以选择旁白输出模式为耳机，这样视力障碍的用户就可以通过耳机同时收听到音频资源和旁白信息，而视力正常的用户可以通过显示设备200的扬声器只收听音频资源。这种情况下，控制器250检测到用户的选择后，需要将音频模式界面上的旁白输出模式调整为耳机，如图7所示，此时，耳机同时播放音频资源和旁白信息，扬声器播放音频资源。If visually impaired users listen with headphones, the narration output mode can be selected as headphones, so that visually impaired users can listen to audio resources and narration information at the same time through headphones, while sighted users can listen only through the speakers of the display device 200. audio resources. In this case, after the controller 250 detects the user's selection, it needs to adjust the narration output mode on the audio mode interface to the earphone, as shown in FIG. 7 , at this time, the earphone plays the audio resource and the narration information at the same time, and the speaker plays the audio resource.
如果视力障碍的用户使用扬声器收听，那么可以选择旁白输出模式为扬声器，这样视力障碍的用户就可以通过显示设备200的扬声器同时收听到音频资源和旁白信息，而视力正常的用户可以通过耳机只收听音频资源。这种情况下，控制器250检测到用户的选择后，需要将音频模式界面上的旁白输出模式调整为扬声器，如图9所示，此时，扬声器同时播放音频资源和旁白信息，耳机播放音频资源。If a visually impaired user listens through a speaker, the narration output mode can be selected as the speaker, so that the visually impaired user can listen to the audio resources and the narration information through the speaker of the display device 200 at the same time, while the sighted user can only listen to the narration information through the headset audio resources. In this case, after the controller 250 detects the user's selection, it needs to adjust the narration output mode on the audio mode interface to the speaker, as shown in FIG. 9 , at this time, the speaker plays the audio resource and the narration information at the same time, and the earphone plays the audio resource.
如果用户选择旁白输出模式为全部，那么视力障碍的用户和视力正常的用户选择耳机或者扬声器都可以收听到音频资源和旁白信息。这种情况下，控制器250检测到用户的选择后，需要将音频模式界面上的旁白输出模式调整为全部，如图10所示，此时，耳机和扬声器同时播放音频资源和旁白信息。If the user selects the narration output mode as all, the visually impaired user and the sighted user can listen to the audio resources and narration information by selecting headphones or speakers. In this case, after the controller 250 detects the user's selection, it needs to adjust the narration output mode on the audio mode interface to all, as shown in FIG.
由以上方案可知，本申请实施例的方案，可以同时满足视力障碍用户和视力正常用户的资源播放需求，当视力障碍用户和视力正常用户同时观看资源时，视力障碍用户可以单独使用耳机收听音频资源和旁白信息，视力正常的用户可以使用显示设备200的扬声器收听音频资源；或者视力障碍的用户可以使用显示设备200的扬声器收听音频资源和旁白信息，而视力障碍的用户可以单独使用耳机收听音频资源。这样，为视力障碍用户提供的旁白信息并不会影响视力正常用户的音频内容，可以同时保证不同用户的资源欣赏体验。It can be seen from the above solutions that the solutions of the embodiments of the present application can meet the resource playback requirements of both visually impaired users and normal vision users. When visually impaired users and normal vision users watch resources at the same time, visually impaired users can use headphones alone to listen to audio resources. Visually impaired users can use the speakers of the display device 200 to listen to audio resources; or visually impaired users can use the speakers of the display device 200 to listen to audio resources and narration information, while visually impaired users can use headphones alone to listen to audio resources . In this way, the narration information provided for visually impaired users will not affect the audio content of visually impaired users, and the resource appreciation experience of different users can be guaranteed at the same time.
在一些实施例中，如果控制器250检测到显示设备200连接了耳机、耳机模式为耳机和扬声器以及音频模式为正常模式，此时说明观看显示设备200的用户没有收听旁白信息的需求，控制250需要将音频模式界面上的音频模式调整为正常模式，如图11所示，并且，控制器250选择耳机和扬声器同时播放音频资源，而不会播放旁白信息。In some embodiments, if the controller 250 detects that the display device 200 is connected to an earphone, the earphone mode is earphone and speaker, and the audio mode is the normal mode, it means that the user viewing the display device 200 does not need to listen to the narration information, and the control 250 The audio mode on the audio mode interface needs to be adjusted to the normal mode, as shown in FIG. 11 , and the controller 250 selects the earphone and the speaker to play audio resources at the same time without playing the narration information.
在一些实施例中，如果控制器250检测到显示设备200连接了耳机，并且耳机模式为耳机，那么说明用户只选择使用耳机播放音频资源，显示设备200的扬声器无声音输出。此时，控制器250需要将如图6所示的设置界面上的耳机模式调整为耳机，调整后的设置界面如图12所示。这种情况下，音频模式界面上的旁白输出模式变为置灰的不可选状态，无论控制器250继续检测到音频模式为正常模式还是视障模式，都只会由耳机进行播放。当音频模式为正常模式时，控制器250选择耳机只播放音频资源；当音频模式为视障模式时，控制器250选择耳机同时播放音频资源和旁白信息。In some embodiments, if the controller 250 detects that the display device 200 is connected to an earphone and the earphone mode is earphone, it means that the user only chooses to use the earphone to play audio resources, and the speaker of the display device 200 has no sound output. At this time, the controller 250 needs to adjust the headset mode on the setting interface shown in FIG. 6 to the headset, and the adjusted setting interface is shown in FIG. 12 . In this case, the narration output mode on the audio mode interface becomes a grayed-out non-selectable state, and regardless of whether the controller 250 continues to detect that the audio mode is the normal mode or the visually impaired mode, it will only be played by the headphones. When the audio mode is the normal mode, the controller 250 selects the earphone to play only the audio resource; when the audio mode is the visually impaired mode, the controller 250 selects the earphone to simultaneously play the audio resource and the narration information.
在一些实施例中，如果控制器250检测到显示设备200未连接耳机，说明用户只选择使用显示设备200的扬声器播放音频资源。此时，控制250需要将如图6所示的设置界面上的耳机模式置灰并且调整为不可用状态，用以表示无耳机连接。这种情况下，音频模式界面上的旁白输出模式也会变为置灰的不可选状态，无论控制器250继 续检测到音频模式为正常模式还是视障模式，都只会由扬声器进行播放。当音频模式为正常模式时，控制器250选择显示设备200的扬声器只播放音频资源；当音频模式为视障模式时，控制器250选择显示设备200的扬声器同时播放音频资源和旁白信息。In some embodiments, if the controller 250 detects that the display device 200 is not connected to an earphone, it indicates that the user only selects to use the speaker of the display device 200 to play the audio resource. At this time, the control 250 needs to gray out the headphone mode on the setting interface as shown in FIG. 6 and adjust it to an unavailable state to indicate that there is no headphone connection. In this case, the narration output mode on the audio mode interface will also become a grayed out non-selectable state, and no matter whether the controller 250 continues to detect that the audio mode is the normal mode or the visually impaired mode, it will only be played by the speaker. When the audio mode is the normal mode, the controller 250 selects the speaker of the display device 200 to play only the audio resource; when the audio mode is the visually impaired mode, the controller 250 selects the speaker of the display device 200 to simultaneously play the audio resource and the narration information.
本申请上述实施例中的方案可以参照图13所示，针对于显示设备200是否连接了耳机，控制器250可以进行不同的处理流程；针对于不同的耳机模式，控制器250也可以进行不同的处理流程；同时，在不同的耳机模式下或者不连接耳机时，针对于不同的音频模式，控制器250也可以进行不同的处理流程。可见，在视力障碍用户和视力正常用户同时使用显示设备200时，本申请实施例中的方案可以根据用户的需求与选择，为视力障碍用户和视力正常用户提供多种方式的资源播放服务。The solutions in the above embodiments of the present application can be referred to as shown in FIG. 13 . The controller 250 can perform different processing procedures for whether the display device 200 is connected to an earphone; for different earphone modes, the controller 250 can also perform different processing procedures. Processing flow; at the same time, in different headphone modes or when the headphone is not connected, the controller 250 may also perform different processing procedures for different audio modes. It can be seen that when the visually impaired user and the normal vision user use the display device 200 at the same time, the solution in the embodiment of the present application can provide the visually impaired user and the normal vision user with resource playback services in various ways according to the user's needs and selection.
另外，本申请实施例中，用户对各种模式的选择操作均是通过向显示设备200输入指令完成的，输入的方式包括但不限于遥控器输入、语音输入等，其中遥控器输入为用户通过遥控器间接向显示设备200输入指令，语音输入为用户通过语音直接向显示设备200输入指令。In addition, in the embodiment of the present application, the user's selection of various modes is completed by inputting instructions to the display device 200, and the input methods include but are not limited to remote control input, voice input, etc. The remote controller indirectly inputs instructions to the display device 200, and the voice input means that the user directly inputs instructions to the display device 200 through voice.
图14为本申请实施例示出的一种显示设备资源播放方法的流程图。如图14所示，该方法可以由控制器250等控制部件实施，具体可以包括如下步骤：FIG. 14 is a flowchart of a method for playing resources on a display device according to an embodiment of the application. As shown in FIG. 14 , the method may be implemented by control components such as the controller 250, and may specifically include the following steps:
步骤S101，检测显示设备200是否连接耳机。Step S101, detecting whether the display device 200 is connected to an earphone.
步骤S102，在显示设备200连接耳机的情况下，检测显示设备200当前的耳机模式。Step S102 , in the case that the display device 200 is connected to an earphone, the current earphone mode of the display device 200 is detected.
步骤S103，在耳机模式为耳机和扬声器的情况下，检测显示设备200的音频模式。Step S103, in the case that the earphone mode is the earphone and the speaker, the audio mode of the display device 200 is detected.
步骤S104，在音频模式为视障模式的情况下，检测显示设备200的旁白输出模式。Step S104 , when the audio mode is the visually impaired mode, the narration output mode of the display device 200 is detected.
步骤S105，根据耳机模式和旁白输出模式，选择对应的音频输出设备播放资源中的音频资源和旁白信息。Step S105 , according to the headphone mode and the narration output mode, select the audio resource and narration information in the playback resources of the corresponding audio output device.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接耳机、所述耳机模式为耳机和扬声器、所述音频模式为视障模式以及所述旁白输出模式为耳机的情况下，选择耳机和显示设备200的扬声器同时播放音频资源，以及，选择耳机播放旁白信息。In some embodiments, in the above display device resource playback method, when the display device 200 is connected to an earphone, the earphone mode is an earphone and a speaker, the audio mode is a visually impaired mode, and the narration output mode is an earphone, select The headset and the speaker of the display device 200 play audio resources simultaneously, and the headset is selected to play the narration information.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接耳机、所述耳机模式为耳机和扬声器、所述音频模式为视障模式以及所述旁白输出模式为扬声器的情况下，选择耳机和显示设备200的扬声器同时播放音频资源，以及，选择显示设备200的扬声器播放旁白信息。In some embodiments, in the above display device resource playback method, when the display device 200 is connected to an earphone, the earphone mode is an earphone and a speaker, the audio mode is a visually impaired mode, and the narration output mode is a speaker, select The headset and the speaker of the display device 200 play audio resources at the same time, and the speaker of the display device 200 is selected to play the narration information.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接耳机、所述耳机模式为耳机和扬声器、所述音频模式为视障模式以及所述旁白输出模式为全部的情况下，选择耳机和显示设备200的扬声器同时播放音频资源和旁白信息。In some embodiments, in the above display device resource playback method, when the display device 200 is connected to an earphone, the earphone mode is earphone and speaker, the audio mode is the visually impaired mode, and the narration output mode is all, select The headphones and the speakers of the display device 200 simultaneously play the audio resource and the narration information.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接耳机、所述耳机模式为耳机和扬声器以及所述音频模式为正常模式的情况下，选择耳机和扬声器同时播放音频资源。In some embodiments, in the above display device resource playback method, when the display device 200 is connected to an earphone, the earphone mode is an earphone and a speaker, and the audio mode is a normal mode, the earphone and the speaker are selected to simultaneously play the audio resource.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接耳机并且所述耳机模式为耳机的情况下，检测显示设备200的音频模式；在所述音频模式为视障模式的情况下，选择耳机播放音频资源和旁白信息。In some embodiments, in the above display device resource playback method, when the display device 200 is connected to an earphone and the earphone mode is an earphone, the audio mode of the display device 200 is detected; in the case that the audio mode is a visually impaired mode , select the headset to play audio resources and narration information.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接耳机并且所 述耳机模式为耳机的情况下，检测显示设备200的音频模式；在所述音频模式为正常模式的情况下，选择耳机播放音频资源。In some embodiments, in the above display device resource playback method, when the display device 200 is connected to an earphone and the earphone mode is an earphone, the audio mode of the display device 200 is detected; when the audio mode is the normal mode, Select the headset to play the audio source.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接未耳机的情况下，检测显示设备200的音频模式；在所述音频模式为视障模式的情况下，选择显示设备200的扬声器播放音频资源和旁白信息。In some embodiments, in the above-mentioned display device resource playback method, when the display device 200 is connected without headphones, the audio mode of the display device 200 is detected; when the audio mode is the visually impaired mode, the audio mode of the display device 200 is selected The speakers play audio resources and narration information.
在一些实施例中，上述显示设备资源播放方法，在显示设备200连接未耳机的情况下，检测显示设备200的音频模式；在所述音频模式为正常模式的情况下，选择显示设备200的扬声器播放音频资源。In some embodiments, in the above display device resource playback method, when the display device 200 is connected without headphones, the audio mode of the display device 200 is detected; when the audio mode is the normal mode, the speaker of the display device 200 is selected Play audio resources.
为了方便解释，已经结合具体的实施方式进行了上述说明。但是，上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导，可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用，从而使得本领域技术人员更好的使用所述实施方式以及适于具体使用考虑的各种不同的变形的实施方式。For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussions are not intended to be exhaustive or to limit implementations to the specific forms disclosed above. Numerous modifications and variations are possible in light of the above teachings. The above embodiments are chosen and described to better explain the principles and practical applications, so as to enable those skilled in the art to better utilize the described embodiments and various modified embodiments suitable for specific use considerations.

Claims (10)

  1. 一种显示设备，包括：A display device comprising:
    显示器，用于展示显示设备所播放的资源中的视频资源；A display for displaying video resources in the resources played by the display device;
    控制器，用于执行：Controller, which executes:
    检测显示设备是否连接耳机；Detect whether the display device is connected to the headset;
    在显示设备连接耳机的情况下，检测显示设备当前的耳机模式；所述耳机模式用于表示显示设备通过哪种音频输出设备播放所述资源中的音频资源；In the case that the display device is connected to an earphone, the current earphone mode of the display device is detected; the earphone mode is used to indicate which audio output device the display device uses to play the audio resource in the resource;
    在所述耳机模式为耳机和扬声器的情况下，检测显示设备的音频模式；所述音频模式用于表示显示设备播放的资源是否为视障模式；所述视障模式用于表示显示设备所播放的资源中包含旁白信息；In the case that the earphone mode is an earphone and a speaker, the audio mode of the display device is detected; the audio mode is used to indicate whether the resource played by the display device is a visually impaired mode; the visually impaired mode is used to indicate that the display device plays 's resources contain narration information;
    在所述音频模式为视障模式的情况下，检测显示设备的旁白输出模式；所述旁白输出模式用于表示显示设备通过哪种音频输出设备播放所述资源中的旁白信息；In the case that the audio mode is the visually impaired mode, the narration output mode of the display device is detected; the narration output mode is used to indicate which audio output device the display device uses to play the narration information in the resource;
    根据所述耳机模式和所述旁白输出模式，选择对应的音频输出设备播放所述资源中的音频资源和旁白信息。According to the headphone mode and the narration output mode, a corresponding audio output device is selected to play the audio resources and narration information in the resources.
  2. 根据权利要求1所述的显示设备，所述控制器，还用于执行：The display device according to claim 1, the controller, further configured to execute:
    在所述耳机模式为耳机和扬声器并且所述旁白输出模式为耳机的情况下，选择耳机和显示设备的扬声器同时播放音频资源，以及，选择耳机播放旁白信息。When the earphone mode is earphone and speaker and the narration output mode is earphone, the earphone and the speaker of the display device are selected to play audio resources simultaneously, and the earphone is selected to play the narration information.
  3. 根据权利要求1所述的显示设备，所述控制器，还用于执行：The display device according to claim 1, the controller, further configured to execute:
    在所述耳机模式为耳机和扬声器并且所述旁白输出模式为扬声器的情况下，选择耳机和显示设备的扬声器同时播放音频资源，以及，选择显示设备的扬声器播放旁白信息。When the earphone mode is earphone and speaker and the narration output mode is speaker, the earphone and the speaker of the display device are selected to play audio resources simultaneously, and the speaker of the display device is selected to play the narration information.
  4. 根据权利要求1所述的显示设备，所述控制器，还用于执行：The display device according to claim 1, the controller, further configured to execute:
    在所述耳机模式为耳机和扬声器并且所述旁白输出模式为全部的情况下，选择耳机和显示设备的扬声器同时播放音频资源和旁白信息。In the case that the earphone mode is earphone and speaker and the narration output mode is all, the earphone and the speaker of the display device are selected to play audio resources and narration information at the same time.
  5. 根据权利要求1所述的显示设备，所述控制器，还用于执行：The display device according to claim 1, the controller, further configured to execute:
    在所述耳机模式为耳机和扬声器并且所述音频模式为正常的情况下，选择耳机和扬声器同时播放音频资源。When the headphone mode is headphone and speaker and the audio mode is normal, the headphone and speaker are selected to play audio resources at the same time.
  6. 根据权利要求1所述的显示设备，所述控制器，还用于执行：The display device according to claim 1, the controller, further configured to execute:
    在显示设备连接耳机并且所述耳机模式为耳机的情况下，检测显示设备的音频模式；In the case that the display device is connected to an earphone and the earphone mode is an earphone, detecting the audio mode of the display device;
    在所述音频模式为视障模式的情况下，选择耳机播放音频资源和旁白信息。In the case that the audio mode is the visually impaired mode, select headphones to play audio resources and narration information.
  7. 根据权利要求6所示的显示设备，所述控制器，还用于执行：According to the display device shown in claim 6, the controller is further configured to execute:
    在所述音频模式为正常模式的情况下，选择耳机播放音频资源。In the case that the audio mode is the normal mode, the earphone is selected to play the audio resource.
  8. 根据权利要求1所述的显示设备，所述控制器，还用于执行：The display device according to claim 1, the controller, further configured to execute:
    在显示设备连接未耳机的情况下，检测显示设备的音频模式；Detect the audio mode of the display device when the display device is connected without headphones;
    在所述音频模式为视障模式的情况下，选择显示设备的扬声器播放音频资源和旁白信息。When the audio mode is the visually impaired mode, the speaker of the display device is selected to play the audio resource and the narration information.
  9. 根据权利要求8所述的显示设备，所述控制器，还用于执行：The display device according to claim 8, the controller, further configured to perform:
    在所述音频模式为正常模式的情况下，选择显示设备的扬声器播放音频资源。When the audio mode is the normal mode, the speaker of the display device is selected to play the audio resource.
  10. 一种显示设备资源播放方法，包括：A display device resource playback method, comprising:
    检测显示设备是否连接耳机；Detect whether the display device is connected to the headset;
    在显示设备连接耳机的情况下，检测显示设备当前的耳机模式；所述耳机模式用于表示显示设备通过哪种音频输出设备播放所述资源中的音频资源；In the case that the display device is connected to an earphone, the current earphone mode of the display device is detected; the earphone mode is used to indicate which audio output device the display device uses to play the audio resource in the resource;
    在所述耳机模式为耳机和扬声器的情况下，检测显示设备的音频模式；所述音频模式用于表示显示设备播放的资源是否为视障模式；所述视障模式用于表示显示设备所播放的资源中包含旁白信息；In the case that the earphone mode is an earphone and a speaker, the audio mode of the display device is detected; the audio mode is used to indicate whether the resource played by the display device is a visually impaired mode; the visually impaired mode is used to indicate that the display device plays 's resources contain narration information;
    在所述音频模式为视障模式的情况下，检测显示设备的旁白输出模式；所述旁白输出模式用于表示显示设备通过哪种音频输出设备播放所述资源中的旁白信息；In the case that the audio mode is the visually impaired mode, the narration output mode of the display device is detected; the narration output mode is used to indicate which audio output device the display device uses to play the narration information in the resource;
    根据所述耳机模式和所述旁白输出模式，选择对应的音频输出设备播放所述资源中的音频资源和旁白信息。According to the headphone mode and the narration output mode, a corresponding audio output device is selected to play the audio resources and narration information in the resources.
PCT/CN2021/113742 2020-10-12 2021-08-20 Display device resource playing method and display device WO2022078065A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202011084672.7A CN112214190A (en) 2020-10-12 2020-10-12 Display equipment resource playing method and display equipment
CN202011084672.7 2020-10-12

Publications (1)

Publication Number Publication Date
WO2022078065A1 true WO2022078065A1 (en) 2022-04-21

Family

ID=74054517

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/113742 WO2022078065A1 (en) 2020-10-12 2021-08-20 Display device resource playing method and display device

Country Status (2)

Country Link
CN (1) CN112214190A (en)
WO (1) WO2022078065A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110390927B (en) * 2019-06-28 2021-11-23 北京奇艺世纪科技有限公司 Audio processing method and device, electronic equipment and computer readable storage medium
CN112214190A (en) * 2020-10-12 2021-01-12 青岛海信传媒网络技术有限公司 Display equipment resource playing method and display equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5896129A (en) * 1996-09-13 1999-04-20 Sony Corporation User friendly passenger interface including audio menuing for the visually impaired and closed captioning for the hearing impaired for an interactive flight entertainment system
CN110390927A (en) * 2019-06-28 2019-10-29 北京奇艺世纪科技有限公司 Audio-frequency processing method, device, electronic equipment and computer readable storage medium
CN110798774A (en) * 2019-12-10 2020-02-14 深圳市思考力科技有限公司 Special earphone with function of bystanders explanation for seeing film by blind person
CN112214190A (en) * 2020-10-12 2021-01-12 青岛海信传媒网络技术有限公司 Display equipment resource playing method and display equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5896129A (en) * 1996-09-13 1999-04-20 Sony Corporation User friendly passenger interface including audio menuing for the visually impaired and closed captioning for the hearing impaired for an interactive flight entertainment system
CN110390927A (en) * 2019-06-28 2019-10-29 北京奇艺世纪科技有限公司 Audio-frequency processing method, device, electronic equipment and computer readable storage medium
CN110798774A (en) * 2019-12-10 2020-02-14 深圳市思考力科技有限公司 Special earphone with function of bystanders explanation for seeing film by blind person
CN112214190A (en) * 2020-10-12 2021-01-12 青岛海信传媒网络技术有限公司 Display equipment resource playing method and display equipment

Also Published As

Publication number Publication date
CN112214190A (en) 2021-01-12

Similar Documents

Publication Publication Date Title
CN111757171A (en) Display device and audio playing method
WO2021135068A1 (en) Selection control method for sound output device, and display device
WO2022073392A1 (en) Picture display method, and display device
CN111752518A (en) Screen projection method of display equipment and display equipment
CN112272417B (en) double-Bluetooth sound box reconnection method and display device
CN112612443B (en) Audio playing method, display device and server
CN112019782B (en) Control method and display device of enhanced audio return channel
CN112118400B (en) Display method of image on display device and display device
WO2022078065A1 (en) Display device resource playing method and display device
WO2022048203A1 (en) Display method and display device for manipulation prompt information of input method control
CN112188279A (en) Channel switching method and display equipment
CN113438539A (en) Digital television program recording method and display equipment
CN112153440A (en) Display device and display system
CN112243141A (en) Display method and display equipment for screen projection function
CN111954059A (en) Screen saver display method and display device
CN112306604B (en) Progress display method and display device for file transmission
CN112399217B (en) Display device and method for establishing communication connection with power amplifier device
CN111954043B (en) Information bar display method and display equipment
CN111818654B (en) Channel access method and display device
CN112637957A (en) Display device and communication method of display device and wireless sound box
CN112104950B (en) Volume control method and display device
CN114302197A (en) Voice separation control method and display device
CN114390190A (en) Display equipment and method for monitoring application to start camera
CN113971049A (en) Background service management method and display device
WO2022100252A1 (en) Display device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21879112

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 18/07/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 21879112

Country of ref document: EP

Kind code of ref document: A1