WO2017167023A1 - 一种媒体数据播放方法和装置、智能终端 - Google Patents

一种媒体数据播放方法和装置、智能终端 Download PDF

Info

Publication number
WO2017167023A1
WO2017167023A1 PCT/CN2017/076893 CN2017076893W WO2017167023A1 WO 2017167023 A1 WO2017167023 A1 WO 2017167023A1 CN 2017076893 W CN2017076893 W CN 2017076893W WO 2017167023 A1 WO2017167023 A1 WO 2017167023A1
Authority
WO
WIPO (PCT)
Prior art keywords
media
operating system
data
graphic
media data
Prior art date
Application number
PCT/CN2017/076893
Other languages
English (en)
French (fr)
Inventor
刘永卿
李江卫
闵洪波
钟学书
Original Assignee
阿里巴巴集团控股有限公司
刘永卿
李江卫
闵洪波
钟学书
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司, 刘永卿, 李江卫, 闵洪波, 钟学书 filed Critical 阿里巴巴集团控股有限公司
Publication of WO2017167023A1 publication Critical patent/WO2017167023A1/zh
Priority to US16/144,525 priority Critical patent/US11245885B2/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/79Processing of colour television signals in connection with recording
    • H04N9/7921Processing of colour television signals in connection with recording for more than one processing mode
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/541Interprogram communication via adapters, e.g. between incompatible applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/54Interprogram communication
    • G06F9/547Remote procedure calls [RPC]; Web services
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007Time or data compression or expansion
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/36Monitoring, i.e. supervising the progress of recording or reproducing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/443OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/00007Time or data compression or expansion
    • G11B2020/00072Time or data compression or expansion the compressed signal including a video signal

Definitions

  • the present invention relates to the field of terminal technologies, and in particular, to a media data playing method, a media data playing method based on an intelligent terminal, an intelligent terminal and a media data playing device.
  • the main operating system refers to an operating system that can be directly run in the device, such as an operating system that the smart device starts by default; and the guest operating system refers to an operating system that must be supported by the support of other operating systems.
  • the main operating system runs first, and the guest operating system can be started, and the underlying interface support is provided, such as a device driver interface and a memory access interface.
  • the multimedia functions of smart terminals are becoming more and more powerful, and the media data formats that need to support playback are also increasing.
  • the main operating system cannot support all media data formats, such as the main operating system cannot process the media data provided by the third party, the smart terminal based on the main operating system cannot play the media data provided by the third-party application.
  • the intelligent terminal cannot support all media data formats based on the main operating system, and there is a problem that media data playback fails.
  • the technical problem to be solved by the embodiments of the present application is to provide a media data playing method and a media data playing method based on an intelligent terminal, so as to solve the problem that the smart terminal plays media data.
  • the embodiment of the present application further provides an intelligent terminal and a media data playing device. Set to ensure the implementation and application of the above methods.
  • the embodiment of the present application discloses a media data playing method, including: the first operating system sends a media processing request to the second operating system by calling the communication interface; after receiving the media processing request, the second operating system is configured according to the second operating system.
  • the media processing request processes the media data, generates a processing result, and feeds back the processing result to the first operating system; the first operating system receives the processing result, and responds to the media data based on the processing result.
  • the embodiment of the present application further discloses a media data playing method, including: generating a play request based on a user operation, where the play request includes source information of media data; when the media data does not conform to a preset data format, The second operating system sends a media processing request; and responds to the media data based on a processing result of the second operating system for the media processing request feedback.
  • the embodiment of the present application further discloses a media data playing method, including: receiving a media processing request sent by a first operating system; processing the media data according to the media processing request, generating a processing result; and feeding back the processing result to The first operating system.
  • the embodiment of the present application further discloses an intelligent terminal, including: a first operating system and a second operating system; wherein the first operating system is configured to send a media processing request to the second operating system by calling a communication interface. And receiving the processing result fed back by the second operating system, and responding to the media data based on the processing result; the second operating system, after receiving the media processing request, according to the The media processing request processes the media data, generates a processing result, and feeds the processing result back to the first operating system.
  • the embodiment of the present application further discloses an intelligent terminal, including: a memory, a display, a processor, and an input unit; wherein the processor is configured to perform the method described in any implementation of the present application.
  • the embodiment of the present application further discloses a media data playing device, including: a play requesting module, configured to generate a play request based on a user operation, where the play request includes source information of media data; and a processing request module, configured to be in the media When the data does not conform to the preset data format, the media processing request is sent to the second operating system, and the media response module is configured to respond to the media data based on the processing result of the second operating system for the media processing request feedback.
  • the embodiment of the present application further discloses a media data playing device, including: a request receiving module, configured to receive media sent by a first operating system; and a media processing module, configured to process media data according to the media processing request, to generate Processing result; a feedback module, configured to feed back the processing result to the first operating system.
  • the embodiments of the present application include the following advantages:
  • the first system may send a media processing request to the second operating system through the communication interface, that is, the media data is processed by the second operating system to generate a processing result, which may be generated based on the second operating system.
  • the processing result responds to the media data, and solves the problem that the smart terminal installed with two operating systems fails to play the media data based on the first operating system, thereby improving the user experience.
  • FIG. 1 is a structural block diagram of an intelligent terminal according to an embodiment of the present application.
  • FIG. 2 is a flow chart of steps of a method for playing media data based on an intelligent terminal according to an embodiment of the present application
  • FIG. 3 is a structural block diagram of another intelligent terminal according to an embodiment of the present application.
  • FIG. 4 is a timing diagram of a communication process between a first operating system and a second operating system according to an embodiment of the present application
  • FIG. 5 is a structural block diagram of a browser kernel of a first operating system in the embodiment of the present application.
  • FIG. 6 is a structural block diagram of a bridge service module of a first operating system in the embodiment of the present application.
  • FIG. 7 is a structural block diagram of a media application of a second operating system in the implementation of the present application.
  • FIG. 8 is a structural block diagram of a second graphics service module of a second operating system in the embodiment of the present application.
  • FIG. 9 is a flowchart of steps of another method for playing media data based on an intelligent terminal according to an embodiment of the present application.
  • 10 is a media data playing method based on a first operating system in an embodiment of the present application
  • Figure 11 is a block diagram showing the structure of a media data playing apparatus according to this embodiment of the present application.
  • FIG. 13 is a structural block diagram of another media data playing apparatus according to this embodiment of the present application.
  • FIG. 14 is a structural block diagram of still another intelligent terminal according to an embodiment of the present application.
  • Intelligent terminals can implement various functions to meet user needs by installing two operating systems.
  • the operating system is a huge management control program, its function is to manage all the resources (including hardware and software) of the intelligent terminal, and also the core and cornerstone of the intelligent terminal system.
  • the two operating systems installed by the smart terminal can be respectively labeled as the first operating system and the second operating system.
  • the first operating system may be used as a main operating system, and may specifically include a cloud computing operating system (referred to as a cloud system), and the cloud system may be a new one using the internationally pioneered HFP and HDRDP technologies to implement cloud computing effects under the LAN architecture.
  • a generation of general-purpose computer system products; the second operating system can be used as a guest operating system, and specifically can include a traditional operating system, such as an Android system.
  • the first operating system may first run, and may start the second operating system and provide underlying interface support, such as a device driver interface, a memory access interface, and the like.
  • the media data format supported by the first operating system of the smart terminal is limited, and the smart terminal cannot perform media data playback of all media data formats based on the first operating system, and the media data playback fails.
  • One of the core concepts of the embodiments of the present application is to provide a media data playing method and an intelligent terminal based on an intelligent terminal, so as to solve the problem that the existing intelligent terminal fails to play media data based on the first operating system not supporting all media data formats. problem.
  • the first system detects that it cannot Processing the media data, sending a media processing request to the second operating system; processing the media data by the second operating system, and generating a processing result, so that the first operating system can perform the processing result based on the second operating system
  • the media data is played to solve the problem that the intelligent terminal fails to play the media data based on the first operating system because the first operating system does not support the media data format.
  • FIG. 1 a structural block diagram of an intelligent terminal according to an embodiment of the present application is shown, which may specifically include: a first operating system 102 and a second operating system 104.
  • the first operating system 102 can be configured to send a media processing request to the second operating system by calling a communication interface.
  • the first operating system 102 can be automatically started to implement its function.
  • the first operating system 102 can detect the media data that needs to be played, and determine whether the format of the media data corresponding to the media data is supported, that is, whether the media data can be processed.
  • the first operating system 102 of the smart terminal starts the second operating system 104 by calling the communication interface, and is for the media data.
  • the processing generates a media data processing request, and sends a media processing request to the second operating system 104 of the smart terminal through the communication interface, and triggers the second operating system 104 to process the media data.
  • the media processing request is related to media data processing, such as source information including media data, control identifiers of the first operating system, and the like, and an application package name corresponding to the media application.
  • the second operating system 104 is configured to: after receiving the media processing request, process the media data according to the media processing request, generate a processing result, and feed back the processing result to the first operating system.
  • the second operating system 104 may process the media data according to the media processing request to generate a processing result corresponding to the media data.
  • the second operating system may obtain a software development kit (Software Development Kit) corresponding to the media data by calling a corresponding interface of the media application. SDK), the media data is processed by the SDK, so that the processing of the media data can be completed, and the processing result is generated.
  • the second operating system 104 feeds back the generated processing result to the first operating system 102, such as sending the generated graphic data to the first operating system, so that the first operating system 102 can be based on
  • the processing result plays media data, thereby implementing the multimedia function of the smart terminal.
  • the first operating system 102 of the smart terminal is further configured to receive the processing result fed back by the second operating system 102, and respond to the media data based on the processing result.
  • the first operating system 102 can respond to the media data by using the processing result. Specifically, the first operating system 102 may generate, according to the processing result, play data that is displayed on the display screen of the media data, so as to implement playback control of the media data by the smart terminal, such as playing a video on the display screen, suspending video playback, and The video is fast forwarded or rewinded.
  • the smart terminal implemented by the present application refers to a terminal device with multimedia functions, and supports functions in audio, video, data, and the like.
  • the smart terminal in this implementation is installed with two operating systems, including mobile intelligent terminals such as smart phones, tablet computers, and devices such as smart TVs, personal computers, and set top boxes such as network HD set top boxes.
  • the media data in the embodiment of the present application refers to transmission data corresponding to the media, such as video data corresponding to the video, audio data corresponding to the audio, and the like.
  • video data is used to play video
  • audio data is used to play audio, such as playing music.
  • the method for playing media data based on the smart terminal is discussed. As shown in FIG. 2, the method may include the following steps:
  • Step 202 The first operating system sends a media processing request to the second operating system by calling a communication interface.
  • the first operating system needs to process the media data, for example, interpreting the media data according to the media data format corresponding to the media data, and generating play data corresponding to the media data, thereby
  • the playing data plays the media data, that is, realizes the multimedia playing function of the smart terminal.
  • the communication interface may be invoked, such as inter-process communication (Inter-Process).
  • the interface of the Communication, IPC) mechanism connects the second operating system and sends a media processing request to the second operating system.
  • the media processing request is related to the media data processing, and is generated by the first operating system based on the media data that needs to be processed, and may include source information of the media data, a control identifier of the first operating system, and an application package. Name and other information.
  • the source information of the media data may include a Uniform Resource Locator (URL) corresponding to the media data, and may further include other data corresponding to the media data, such as a media label corresponding to the media data, where the media label may be used.
  • URL Uniform Resource Locator
  • the URL may be used to obtain media data;
  • the first operating system control identifier may be used to establish a two-way communication connection;
  • the application package name may be used to determine a media application that processes the media data,
  • the SDK corresponding to the media data can be obtained by the media application.
  • Step 204 After receiving the media processing request, the second operating system processes the media data according to the media processing request, generates a processing result, and feeds the processing result to the first operating system.
  • the second operating system of the smart terminal may start the media application according to the media processing request.
  • the media application is installed with an SDK corresponding to the media data, and the media data can be parsed by the SDK to complete the processing of the media data.
  • the second operating system can start the media application by calling the interface corresponding to the media application, so that the SDK corresponding to the media data can be obtained.
  • the media data is parsed by the SDK to generate a processing result of the media data.
  • the interface of the media service module is invoked by the SDK, a decoding environment is created, the media data is decoded, a decoded data frame is generated, and the graphic data corresponding to the media data is generated by using the data frame. Therefore, the processing result of the media data is generated based on the graphic data, and the processing result is fed back to the operating system through the communication interface, that is, in response to the media processing request sent by the first operating system, so that the first operating system can generate the processing result based on the processing result.
  • the processing result may include second graphic information, playing state data, and the like.
  • the second graphic information is used to generate the playing data corresponding to the media data in the first operating system, and the playing state data may be used to display the playing state corresponding to the media data, such as the current broadcast. Progress, media playback time, etc.
  • Step 206 The first operating system receives the processing result, and plays the media data based on the processing result.
  • the first operating system of the smart terminal may detect the processing result. Extracting the second graphic information from the processing result, and generating the first graphic information based on the other content of the playing page where the media data is located, and synthesizing the second graphic information into the first graphic information by using the first graphic service module to generate the first
  • the graphic display data of the operating system that is, the playing data corresponding to the media data is generated, so that the media data can be played according to the playing data.
  • the graphic display data includes the processing result generated by the second operating system, and is used to display the graphic page on the display interface of the smart terminal, such as displaying the playing page on the display screen corresponding to the smart terminal, and playing the media data.
  • the first operating system of the smart terminal may send a media processing request to the second operating system through the communication interface, requesting the second operating system to the media.
  • the data is processed, that is, the media data is processed by the second operating system, and the processing result is generated, so that the first operating system can play the media data based on the processing result generated by the second operating system, thereby solving the problem.
  • An operating system cannot process the media data, causing the intelligent terminal to fail to play the media data based on the first operating system, so that the media data can be played in the first operating system to implement the media playing function of the smart terminal.
  • the first system cannot obtain the SDK, that is, the corresponding media data of the media application cannot be processed by the SDK provided by the third-party application, that is, The media data format used by the media is not supported.
  • the interface corresponding to the first operating system is not set in the SDK for the first operating system, so that the first system cannot Obtaining the SDK provided by the third party through the interface causes the first operating system to fail to process the video data provided by the first operating system.
  • the interface corresponding to the second operating system is usually set in the SDK, that is, the interface corresponding to the SDK is provided for the second operating system, so that the media application can obtain the SDK, so that The media application developed by it is installed on the second operating system. Therefore, the second operating system can start the media application, call the interface corresponding to the SDK to obtain the SDK, process the media data through the SDK, and generate a processing interface corresponding to the media data, so that the smart terminal can perform the media data based on the processing result. Play, realize media playback.
  • FIG. 3 a structural block diagram of another smart terminal according to an embodiment of the present application is shown.
  • the first operating system 102 of the smart terminal may include: a browser kernel 1022, a bridge service module 1024, and a first graphics service module 1026.
  • the second operating system 104 may include: a media application 1042, a media service module. 1044 and a second graphics service module 1046.
  • the browser kernel 1022 of the first operating system 102 can connect to the first graphics service module 1026 via a remote registration (RegistRemote).
  • a remote registration In the remote connection (OnRegisted), you can play the media data by creating a second graphic, such as a sub-picture (CreateSubSurface).
  • a sub-picture CreateSubSurface
  • the browser kernel 1022 (WebEngine) passes through the bridge service module 1024 (MediaBridgeServer) to the media application 1042 of the second operating system 104 ( The application sends a ready to play message (Prepare message), triggering the media application 1042 to enter the ready to play state.
  • the media application 1042 sends a create graphic message (CreateSurface message) to the media service module 1044 (MediaServer), and the trigger media service module 1044 sends a create media graphic message to the second graphics service module 1046 (SurfaceFlinger). CreateMediaSurface message).
  • the second service module can establish a Wayland Connection (Wayland Connection) with the first operating system 102 according to the Wayland protocol, so that a sub-graphic (CreateSubSurface) can be created under the connected state (OnConnected), and the sub-graphic will be generated.
  • Wayland Connection Wayland Connection
  • SetSubSurface is transmitted to the first graphics service module 1026 (Weston Server), and the generated second graphics are sent to the first graphics service module 1026, so that the first operating system 102 can play the media data based on the second graphics.
  • the second graphics service module 1046 may notify the media service module 1044 by using a sub-graphics creation message (OnSurfaceCreated message), and the triggering media service module 1044 sends an initialization completion message (OnPrepared) to the media application 1042. Message).
  • OnPrepared initialization completion message
  • the media application 1042 The bridge service module 1024 forwards the initialization completed message, so that the browser kernel 1022 obtains the initialization completed message and enters the state of starting to play the media data.
  • the browser kernel 1022 can trigger the media service module 1044 to send a draw graphics message (DrawToSurface message) to the second graphics service module 1046 by sending a start play message (Start message), so that the second graphics service module 1046 draws the child graphics to the first
  • the graphics service module 1026 is equivalent to DrawToSubsurface, so that the media data can be played in the first operating system.
  • the browser kernel 1022 can trigger the media service module 1044 to send a delete graphic message to the second graphics service module 1046 by sending a stop play message (such as a Stop message), which is equivalent to the DestorySurface, so that the second graphics service module 1046 is disconnected.
  • the Wayland connection of the first graphics service module 1026 such as sending a Wayland Disconnect message, causes the connection to be disconnected, that is, the second graphics service module 1046 is disconnected from the first graphics service in the OnDisconnected state, and the media data is stopped.
  • the browser kernel 1022 of the first operating system 102 can be used for a play request generated based on a user operation, the play request includes source information of the media data, and a source for detecting media data according to the play request. information.
  • the browser kernel can monitor the interface corresponding to the user operation, and when the user operation is monitored, the operation request is generated by acquiring the data source information corresponding to the user operation.
  • the browser kernel may determine the operation request as a play request, and may detect the source information of the media data to determine whether the first operating system supports the media data corresponding to the media data. format. When it is detected that the first operating system does not support the media data format corresponding to the media data, it may be determined that the first operating system cannot process the media data in the play request.
  • FIG. 5 a block diagram of a browser kernel of a first operating system in the implementation of the present application is shown.
  • the source information of the media data includes a media tag;
  • the browser kernel 1022 may include the following submodules:
  • the media label extraction sub-module 102201 is configured to extract, by the browser kernel, the media label corresponding to the media data from the source information.
  • a determining sub-module 102203 configured to determine, according to the media label, whether the media data is The preset data format.
  • the determining submodule 102205 is configured to determine that the first operating system cannot process the media data when the media data does not conform to the preset data format.
  • the parameter information sending submodule 102207 is configured to send parameter information corresponding to the media data to the bridge service module.
  • the browser kernel 102 may extract the media label corresponding to the media data from the source information by using the media label extraction submodule 102201; and use the determining submodule 102203 to detect the extracted media label to determine the media.
  • the determining sub-module 102205 can determine that the first operating system 102 cannot process Transmitting, by the parameter information sending submodule 102207, the parameter information corresponding to the media data to the bridge service module 10204, and triggering the bridge service module 1024 to send a media processing request to the second operating system 104, so that the first
  • the operating system 102 can be connected to the second operating system 104, and the media data is processed by the second operating system 104 to obtain the processing result of the second operating system 104 for the media data.
  • the bridge service module 1024 is specifically configured to: after receiving the parameter information, generate a media processing request according to the parameter information, and invoke a communication interface to send a media processing request to the second operating system.
  • the browser kernel 1022 may further include: an identifier acquisition submodule 102209 and a parameter information determination submodule 102211.
  • the identifier acquisition sub-module 102209 can be configured to obtain a control identifier of the first operating system through the system interface.
  • the number information determining submodule 102211 can be used to use the control identifier and source information as the parameter information.
  • the browser kernel may acquire the control identifier of the first operating system by using the identifier acquiring submodule 102209 to call the system interface, and the control identifier is used to establish a relationship between the first operating system and the second operating system.
  • Two-way communication; and submodules are determined by parameter information 102211 uses the control identifier and source information as the parameter information, and invokes the parameter information sending submodule 102207 to send the parameter information to the bridge service module 1024.
  • FIG. 6 a block diagram of a bridge service module of a first operating system in the implementation of the present application is shown.
  • the bridge service module 1024 can include the following sub-modules:
  • the application package name determining submodule 102401 can be configured to extract source information from the parameter information, and determine an application package name based on the source information, where the application package name is used to determine a media application that processes the media data.
  • the processing request generation submodule 102403 may be configured to generate the media processing request by using the parameter information and an application package name.
  • the bridge service module 1024 may extract the source information of the media data from the parameter information by using the application package name determining module 102401, according to the extracted source.
  • the information determines an application package name corresponding to the media application that processes the media data; and the processing request generation sub-module 102403 generates a media processing request, where the media processing request includes parameter information and an application package name.
  • the bridge service module 1024 sends the media processing request to the second operating system 104 through the communication interface, and triggers the second operating system 104 to start the media application 1042 corresponding to the application package name according to the media processing request, and processes the media data.
  • the bridge service module 1024 may further include: a communication establishment submodule 102405 and a processing request sending submodule 102407.
  • the communication establishing submodule 102405 is configured to invoke the communication interface to establish a two-way communication connection with the second operating system based on the control identifier.
  • the processing request sending submodule 102407 is configured to send the media processing request to the second operating system based on the two-way communication connection.
  • the bridge service module 1024 can establish a submodule by communication.
  • the 102405 invokes the communication interface to establish a two-way communication connection with the second operating system using the control identifier.
  • the bridge service module 1024 can also send the media processing request to the second operating system by processing the request sending submodule 102407 based on the two-way communication connection established by the communication establishing submodule 102405.
  • the second operating system 104 may be specifically configured to start the media application 1042 corresponding to the application package name based on the media processing request.
  • the media application 1042 is configured to generate a processing result corresponding to the media data in response to the media processing request.
  • the media application 1042 is installed with an SDK, and the media data corresponding to the media processing request is obtained according to the source information of the media data, such as a Uniform Resource Locator (URL) of the media data, and the media data is parsed through the SDK.
  • URL Uniform Resource Locator
  • To generate a processing result of the media data such as calling a media service interface to create a decoding environment, decoding the media data to generate the processing result.
  • FIG. 7 a structural block diagram of a media application of a second operating system in the implementation of the present application is shown.
  • the media application 1042 can include the following sub-modules:
  • the media data obtaining sub-module 104201 is configured to obtain media data corresponding to the media processing request according to the source information.
  • the decoding environment creation sub-module 104203 is configured to invoke a media service interface to create a decoding environment, decode the media data, and generate the processing result.
  • the media application 1042 may create a decoding environment by using a decoding environment creation sub-module 104203, and decode the media data to generate the processing result.
  • the media interface may be invoked by the decoding environment creation sub-module 104203, and the acquired media data may be sent to the second media service module 1044, and the second media service module 1044 is triggered to decode the media data.
  • the decoding environment creation submodule 104203 may include a media data sending unit 1042031.
  • the media data sending unit 1042031 can be configured to send the acquired media data to the second media service module through the media interface.
  • the second media service module 1044 is configured to: after receiving the media data, decode the media data, generate a data frame, and send the generated data frame to the second graphics service module 1046.
  • the second graphics service module 1046 is configured to synthesize the data frame after receiving the data frame, generate second graphics information, and use the second graphics information as a graphics processing result.
  • the decoding environment creation submodule 104203 of the media application may send a processing request to the second media service module 1044 by calling the media interface.
  • the decoding environment creation sub-module 104203 may send the acquired media data to the second media service module 1044 via the media data sending unit 1042031, triggering the second media service module 1044 to the media.
  • the data is decoded.
  • the second media service module 1044 decodes the received media data, generates a decoded data frame, and transmits the generated data frame to the second graphics service module 1046 for synthesis.
  • the second graphics service module 1046 is configured to synthesize the data frame after receiving the data frame, generate second graphics information, and use the second graphics information as a graphics processing result.
  • the second graphics service module 1046 can listen to the interface corresponding to the control identifier. When the control identifier of the first operating system 102 is monitored, the second graphics service module 1046 can connect the first graphics service module 1026 of the first operating system 102 based on the control identifier of the first operating system 102, and receive the received The data frame synthesizes the second graphic to generate the second graphic information.
  • the second graphic information includes a handle corresponding to the second graphic and the second graphic, and the handle is used to control the display area size and the display position of the second graphic.
  • FIG. 8 a structural block diagram of a second graphics service module of a second operating system in the implementation of the present application is shown.
  • the second graphics service module 1046 may include the following sub-modules:
  • the monitoring sub-module 104601 is configured to monitor the interface corresponding to the control identifier.
  • connection sub-module 104603 is configured to, when listening to the control identifier of the first operating system, connect the first graphics service module of the first operating system based on the control identifier.
  • the second graphic service service module can monitor the interface corresponding to the control identifier in real time through the monitoring submodule 104601.
  • the received data frame may be determined to be a data frame generated by the media processing request sent by the first operating system 102, and the data frame is determined to be in a special encoding mode.
  • the data frame synthesizes a handle corresponding to the second graphic and the second graphic; by calling the connection sub-module 104603, connecting the first graphics service module 1026 of the first operating system 102 based on the control identifier to send the first graphics service module 1026 Generating a second graphic and a handle corresponding to the second graphic, so that the first operating system 102 can generate playback data corresponding to the media data based on the handle corresponding to the second graphic and the second graphic, and thus can be in the first operation.
  • System 102 performs playback control of the media data.
  • the second graphics service module 1046 may further include the following submodules:
  • the encoding decision sub-module 10465 is configured to determine that the data frame belongs to a special encoding mode when the control identifier of the first operating system is monitored.
  • the data frame synthesis sub-module 10467 is configured to synthesize the data frame to generate a second graphic and a handle corresponding to the second graphic.
  • the decoding environment creation submodule 104203 may further include a state information generating unit 1042033.
  • the status information generating unit 1042033 may be configured to parse the media data by using a software development package, generate play status information, and use the generated play status information as a status processing result.
  • the play status information may be used to display a play status corresponding to the media player on the display interface of the smart terminal, such as displaying the current play progress, the media play duration, and the like.
  • the media playing duration refers to the length of time required for the media data to be played. For example, the video playing time is 50 minutes, which means that it takes 50 minutes to play the video.
  • the media application 1042 is further configured to send the status processing result to the bridge service module.
  • the second graphics service module 1046 is further configured to send the graphics processing result to the first graphics service module.
  • the second operation is to feed back the state processing result and the graphics processing result to the first operating system 102 by calling the media application 1042 and the second graphics service module 1046, so that the first operating system 102 can use the media processing result and the graphics processing result to the media.
  • Data into The line plays, thereby solving the problem that the first operating system 102 of the smart terminal does not support the media data format corresponding to the media data, and the smart terminal fails to play the media data based on the first operating system 102.
  • the bridge service module 1024 may further include a processing result forwarding sub-module 102408.
  • the processing result forwarding sub-module 102408 can be configured to forward the received status processing result to the browser kernel 1022.
  • the browser kernel 1022 may be further configured to acquire a handle corresponding to the second graphic received by the first graphic service module 1026 based on the state processing result, determine a target transparent area according to the handle, and generate the transparent area based on the target transparent area.
  • the content of the first graphic is sent to the first graphic service module 1026; the first graphic service module 1026 is configured to generate a first graphic based on the content of the first graphic, the target in the first graphic
  • the transparent area presents a second graphic for playing the media data.
  • the bridge service module 1024 forwards the status processing result to the browser kernel 1022 by calling the processing result forwarding sub-module 102408, so that the browser kernel 1022 can be based on the The status processing result plays the media data.
  • the browser kernel 1022 can detect the status processing result.
  • the media play mode When detecting that the status processing result includes the preparation status data, enter the media play mode, that is, enter the ready state for playing media data; in the media play mode, obtain the first a handle corresponding to the second graphic received by the graphics service module 1026, according to the handle, determining a display position and a display area size of the second graphic on the first graphic, that is, determining a display area of the second graphic in the first graphic layer , the determined display area is set as the target transparent area.
  • the browser kernel 1022 is further configured to extract playing state data from the received state processing result, generate the content of the first graphic by using the playing state data and the target transparent area, and transmit the content of the generated first graphic to the first
  • a graphics service module 1026 triggers the first graphics service module 1026 to generate a first graphic to display a second graphic in a target transparent area of the first graphic to play the media data.
  • the browser kernel 1022 may further include the following sub-modules:
  • the status data extraction sub-module 102213 is configured to extract play status data from the status processing result.
  • the first graphic content generation sub-module 102215 is configured to generate the content of the first graphic by using the playing state data and the target transparent area.
  • the browser kernel 1022 further includes: a region determining submodule 102217, a display region determining submodule 102219, and a target transparent setting submodule 102221.
  • the area determining sub-module 102217 is configured to determine, by using the handle, a display position and a display area size corresponding to the second graphic on the first graphic.
  • the display area determining sub-module 102219 is configured to determine a display area of the second graphic on the first graphic based on the display position and the display area size.
  • the target transparent setting sub-module 102221 is configured to set the display area as a target transparent area.
  • the display area may include: a target player play window.
  • the browser kernel may determine, by using the area determining sub-module 102217, the display position corresponding to the second graphic on the first graphic and the display area size by using the handle corresponding to the second graphic; and calling the display area determining sub-module 102219 to determine the second a display area of the graphic on the first graphic, such as determining a display position of the target player playback window in the webpage page and a size of the playback window; setting the display area as the target transparent area by the target transparent setting sub-module 102221, thereby making the first
  • the graphics service module 1026 can merge the second graphics into the first graphics, and thus can display the second graphics in the target transparent area, that is, play the media data in the target player playback window.
  • the browser kernel 1022 may further include: a play mode entry submodule 102223 and a handle acquisition submodule 102225.
  • the play mode enters the sub-module 102223, and is configured to enter the media play mode based on the readiness state data when detecting that the state process result includes the ready state data.
  • the handle acquisition sub-module 102225 is configured to acquire, in the media play mode, a handle corresponding to the second graphic received by the first graphics service module.
  • the method for playing media data based on the smart terminal is further discussed. As shown in FIG. 9 , the method may include the following steps:
  • Step 902 The browser kernel of the first operating system is based on a play request generated by a user operation, and the play request includes source information of the media data.
  • the user can select the media he wants to play through the smart terminal.
  • a user can select a video that he wants to watch through a browser installed on the first operating system of the smart terminal, such as selecting a video to be played by a click operation, which is equivalent to accessing a Video of the Html5 page.
  • the browser of the first operating system may acquire data source information corresponding to the user operation based on a user operation, such as a click operation submitted by the user, such as obtaining a URL corresponding to the user operation, using the URL as the data source information, and based on the acquired data source information. Generate an operation request.
  • the URL contains information such as a mode (or protocol), a server name (or IP address), a path, and a file name.
  • the data format of the URL may be "protocol: user name: [email protected] domain name : Port number / directory / file name.
  • File suffix? Parameter value #flag”.
  • the browser kernel may determine the operation request as a play request, and use the data source information in the play request as the media data.
  • the source information corresponding to the media data may include media tags such as video tags, video tag information, and transmission protocols.
  • Step 904 The browser kernel detects source information of the media data according to the play request.
  • the browser kernel When the operation request is a play request, the browser kernel needs to detect the source information in the play request in response to the play request. Specifically, the browser kernel needs to parse the media data according to the media data format corresponding to the media data to generate the play data corresponding to the media data, so that the media data can be played and played according to the play data, that is, respond to the user operation. Play request.
  • the browser kernel may extract the media label corresponding to the media data from the source information, determine a media data format corresponding to the media data based on the media label, and determine whether the media data conforms to a preset data format, that is, determine the first operating system. Whether the media data can be processed.
  • the first operating system detects source information of the media data according to the play request, and may include the following sub-steps:
  • Sub-step 9041 the browser kernel extracts the media label corresponding to the media data from the source information. sign.
  • the browser kernel may extract a media label from source information of the media data, and determine, by using the media label, a media data format corresponding to the media data to determine whether the first operating system supports the media data.
  • Media data format For example, the browser kernel extracts the video tag from the URL of the webpage accessed by the user, which is equivalent to extracting the video tag from the source information of the media data, so that the media data corresponding to the media data can be determined based on the data source data-from attribute of the video tag. format.
  • Sub-step 9043 determining, based on the media tag, whether the media data conforms to a preset data format.
  • the first operating system of the smart terminal presets the data format supported by the first terminal, that is, the data format corresponding to the data that can be processed is preset.
  • the main operating system pre-sets the media data format supported by the host OS OS of the host operating system, such as a preset media data format supported by the Host OS player, such as the Flash Video format. Flv format).
  • the browser kernel may determine a media data format corresponding to the media data based on the media tag, so that the media data may be determined to conform to a preset data format. Specifically, when the media data format corresponding to the media data is a preset data format, the media data may be determined to conform to a preset data format.
  • the media data when the media data format corresponding to the media data is a flv format, the media data may be determined. It conforms to the media data format supported by the Host OS player, that is, the media data can be processed by the Host OS player; when the media data format corresponding to the media data is not a preset data format, it can be determined that the media data does not meet the preset data.
  • the data format for example, when the media data format corresponding to the media data is in the qsv format, it can be determined that the media data does not conform to the media data format supported by the Host OS player, that is, the media data cannot be processed by the Host OS player.
  • the qsv format is a video file format developed by a third party, and the video data corresponding to the qsv format can be processed by the guest operating system player Guest OS Player.
  • Sub-step 9045 when the media data does not conform to the preset data format, determining that the first operating system cannot process the media data.
  • the media kernel when the media kernel does not conform to the preset data format, It can be determined that the first operating system cannot process the media data, which is equivalent to the Host OS player not being able to decode the media data, and the Guest OS Player can be called to decode the media data.
  • Step 906 The browser kernel sends the parameter information corresponding to the media data to the bridge service module of the first operating system.
  • the first operating system when the first operating system detects that the media data cannot be processed, the first operating system performs a step of sending a media processing request to the second operating system.
  • the second operating system may be connected to the second operating system by the bridge service module, so that the second operating system is processed to obtain the second operating system.
  • the processing result of the media data Specifically, the browser kernel can obtain the control identifier of the first operating system through the system interface, such as the ClientId of the first operating system, and the source information of the obtained media data and the control identifier of the first operating system are used as parameter information.
  • the media processing request is related to media data processing, and may include information such as source information of the media data, an application package name, and the like.
  • the application package name may be determined according to source information of the media data, and used to determine a media application that processes the media data.
  • the method further includes: acquiring, by using a system interface, a control identifier of the first operating system; and using the control identifier and the source Information is used as the parameter information.
  • the browser kernel WebEngine can obtain the ClientId of the first operating system through the interface provided by Weston, and send the obtained URL of the ClientId and the media data as parameter information to the bridge service module MediaBridgeService.
  • the first operating system and the second operating system may establish a socket connection through the ClientId to perform communication.
  • Step 908 After receiving the parameter information, the bridge service module generates a media processing request according to the parameter information, and invokes the communication interface to send a media processing request to the second operating system.
  • the bridge service module After receiving the parameter information sent by the browser kernel, the bridge service module can be based on the parameters.
  • the number information generates a media processing request, and sends the media processing request to the second operating system, triggering the second operating system to start the media application corresponding to the application package name, so that the media application creates a decoding environment after startup, and decodes the media data.
  • the bridge service module MediaBridgeService may send an IPC message to the second operating system by calling an IPC interface, where the IPC message data includes an application package name Application Package Name, a URL, and a ClientId.
  • the information is equivalent to sending a media processing request to the second operating system.
  • the bridge service module generates a media processing request according to the parameter information, and may include the following sub-steps:
  • Sub-step 9081 extracting source information from the parameter information, determining an application package name based on the source information, the application package name being used to determine a media application that processes the media data.
  • the bridge service module may extract source information corresponding to the source information identifier from the parameter information according to the preset source information identifier, and determine an application package name based on the extracted source information.
  • the application package name can be used to determine the media application that processes the media data. For example, when the media data is video data, the application package name may be specifically used to start the video application of the second operating system.
  • the video application of the second operating system can be used to create a sub-graphics Surface and a third-party-based SDK to create a media player MediaPlayer.
  • Sub-step 9083 generating the media processing request by using the parameter information and the application package name.
  • the bridge service module may generate a media processing request by using the parameter information sent by the browser kernel and the determined application package name, and send the media to the second operating system by calling a communication interface, such as an IPC interface. Processing the request, triggering the second operating system to start the media application corresponding to the application name according to the media processing request.
  • the bridge service module invoking the communication interface to send the media processing request to the second operating system may include the following substeps:
  • Sub-step 9085 invoking the communication interface to establish a two-way communication connection with the second operating system based on the control identifier.
  • the bridge service module may extract the ClientId of the first operating system from the parameter information, and establish a two-way communication connection with the second operating system according to the ClientId of the first operating system by calling the IPC interface, such as the network.
  • the bridge service module can establish a socket connection according to the clientId of the first operating system and the media application Application of the second operating system through the IPC interface, so that communication can be performed based on the socket connection.
  • Sub-step 9087 transmitting the media processing request to the second operating system based on the two-way communication connection.
  • the bridge service module sends a media processing request to the second operating system to trigger the second operating system to process the media data based on the two-way communication connection.
  • the media processing request may be triggered by the second operating system to start the media application Application corresponding to the application package name, so that the media application invokes the preparation interface, such as the Application Prepare interface. , ready to play.
  • Step 910 The second operating system starts the media application corresponding to the application package name based on the media processing request.
  • the second operating system may extract the application package name from the media processing request, such as extracting the package name parameter from the media processing request according to the preset package name parameter identifier.
  • the application package name corresponding to the identifier so that the media application that processes the media data can be determined.
  • the first operating system may respond to the media processing request sent by the first operating system by starting the media application corresponding to the application package name, that is, by the media application responding to the media processing request, generating the The processing result corresponding to the media data.
  • the media application is installed with an SDK
  • the second operating system acquires the SDK by using an interface provided by the SDK by the media application, and parses the media data through the SDK to generate a processing result of the media data, such as calling a media service interface to create Decoding the environment, decoding the media data, and generating the processing result.
  • a processing result of the media data such as calling a media service interface to create Decoding the environment, decoding the media data, and generating the processing result.
  • Step 912 The media application acquires media data corresponding to the media processing request according to the source information.
  • the media preparation state is entered.
  • the video data corresponding to the media processing request may be obtained according to the source information of the video data, such as the URL of the video data, so that the sub-graphic Surface and the based data may be created according to the video data.
  • the third-party SDK creates the media player MediaPlayer and enters the video playback ready state.
  • Step 914 The media application invokes the media service interface to create a decoding environment, and decodes the media data to generate the processing result.
  • the second media service module may be connected to the media service interface, such as the multimedia server MediaServer, and the obtained media data is decoded by the media service module, that is, the decoding is created. Environment, so that decoded data frames can be generated.
  • the second media service module transmits the generated data frame to the second graphics service module of the second operating system, such as the graphics server SurfaceFlinger of the second operating system, and the second graphics service module will decode the data frame.
  • the data frame is synthesized into a graphic, so that the processing result corresponding to the media data can be generated based on the synthesized graphic to display the graphic on the display interface of the smart terminal.
  • the media application invokes the media service interface to create a decoding environment, and the media data is decoded to generate the processing result, which may include the following sub-steps:
  • Sub-step 9141 the media application sends the acquired media data to the second media service module through the media interface.
  • the media application application may connect to the multimedia server MediaServer of the second operating system through a media interface, such as a MediaServer interface, and send the obtained media data to the multimedia server MediaServer, and trigger the multimedia server MediaServer to the media data. Decode.
  • Sub-step 9143 after receiving the media data, the second media service module decodes the media data, generates a data frame, and sends the generated data frame to the second graphics service module.
  • the second media service module may decode the media data, such as decoding the video data or the audio data, to generate a decoded data frame.
  • the second media service module delivers the decoded data frame to the second graphics service module of the second operating system, such as the graphics server SurfaceFlinger of the second operating system, to Perform the synthesis.
  • the multimedia server MediaServer of the second operating system transmits the decoded data frame to the graphics server SurfaceFlinger of the second operating system, and triggers the graphics server SurfaceFlinger of the second operating system to synthesize the data frame. , generating second graphic information.
  • Sub-step 9145 after receiving the data frame, the second graphics service module synthesizes the data frame to generate second graphics information, and uses the second graphics information as a graphics processing result.
  • the second graphics service module may detect, when the graphic label is created, whether the interface corresponding to the control identifier has a control identifier of the first operating system; if not, follow the second operation.
  • the normal creation process of the system generates graphic information of the second operating system to play the media data in the media player of the second operating system; if the control identifier of the first operating system exists, the control identifier of the first operating system
  • the first graphics service module of the first operating system is connected through a system interface (such as a WaylandConnection interface).
  • the decoded data frame is synthesized, that is, the second graphic information is generated, and the second graphic information is used as a graphic processing result, and the graphic processing result is transmitted to the established connection.
  • the first graphics service module After the first graphics service module of the first operating system is connected, the decoded data frame is synthesized, that is, the second graphic information is generated, and the second graphic information is used as a graphic processing result, and the graphic processing result is transmitted to the established connection.
  • the second graphics service module after receiving the data frame, further includes: listening to an interface corresponding to the control identifier; and when monitoring the control identifier of the first operating system, based on The control identifier is coupled to the first graphics service module of the first operating system.
  • the second graphics service module may monitor the interface ClientId() corresponding to the control identifier to detect whether the ClientId() has a value; if the ClientId() is empty, the guest OS is normal. Some creation processes process data frames to play media data in GuestOS; if ClientId() is not empty, the first operation
  • the system's control identifier ClientId is a parameter, and the first operating system's graphics server, WestonServer, is connected through the WaylandConnection interface.
  • the second graphics service module synthesizes the data frame to generate second graphics information, including: determining, when the control identifier of the first operating system is monitored, the data frame It belongs to a special coding mode; the data frame is synthesized to generate a second graphic and a handle corresponding to the second graphic.
  • the second graphics service module when the second graphics service module listens to the control identifier of the first operating system, it may determine that the received data frame is a data frame generated by the media processing request sent by the first operating system, so that It is determined that the data frame belongs to a special coding mode. After determining that the data belongs to the special coding mode, the second graphics service module may synthesize the data frame according to the special coding manner to generate a second graphic and a handle corresponding to the second graphic. The handle corresponding to the second graphic may be used to control the display area size and the display position of the second graphic.
  • the graphics server SurfaceFlinger of the second operating system may determine, according to the view attribute, such as the video view attribute VideoView, that the received data frame belongs to a special coding mode, according to the special coding mode.
  • the data frame is synthesized, and the sub-text SubSurface and the handle texture corresponding to the sub-picture SubSurface are generated.
  • the handle texture is used to control the display area size of the sub-picture SubSurface and the display position.
  • Sub-step 9147 the media application parses the media data through a software development package, generates play status information, and uses the generated status information as a status processing result.
  • the media data can be parsed through the SDK, and the playback status information of the media player, such as the preparation status data and the playback status data, can be generated according to the analysis of the media data.
  • the preparation status data refers to data generated by the media player during the initialization phase, such as a message to start initialization, a message to complete initialization, and the like, which may be used to indicate the current preparation state of the media player.
  • the play status data refers to the status data of the media player during the process of playing media data, such as displaying the progress of the current play, the duration of the media play, and the like.
  • the media application can use the playback status information of the media player as a result of the status processing.
  • Step 916 The second operating system feeds back the graphics processing result and the status processing result to the first operating system.
  • the second operating system may send the status processing result to the bridge service module by using the media application, and send the graphic processing result to the first graphics service module by using the second graphics service module.
  • the media application Application of the second operating system may transmit the state processing result to the bridge service module MediaBridgeService of the first operating system through the IPC interface.
  • the graphics server SurfaceFlinger of the second operating system can send graphics processing results to the graphics server WestonServer of the first operating system through the WaylandConnection interface, which is equivalent to sending a graphic processing result to the first operating system based on the two-way communication connection, such as by wayland
  • the protocol transmits a handle corresponding to the sub-graphic to the first graphics service module of the first operating system.
  • Step 918 The first operating system responds to the media data based on the processing result.
  • the first operating system may receive the state processing result fed back by the second operating system through the bridge service module, and receive the graphic processing result fed back by the second operating system through the graphic service module.
  • the first operating system may detect the status processing result by using the browser kernel.
  • the first operating system enters the media playing mode according to the preparation status data.
  • the first operating system acquires a handle corresponding to the second graphic received by the first graphic service module through the browser kernel, and sets a target transparent area in the first graphic layer by using the handle, and adopts a target transparent area and a webpage.
  • the other content of the page generates the content of the first graphic, that is, generates the first graphic information; generates the first graphic by calling the first graphic service module, and merges the second graphic into the target transparent area of the first graphic to generate The synthesized graphic, so that the second graphic can be presented in the target display area of the first graphic, that is, the media data is played.
  • the first operating system plays the media data based on the processing result, and may include the following sub-steps:
  • Sub-step 9181 the bridge service module forwards the received status processing result to the browser kernel.
  • the bridge service module may forward the received status processing result to the browser kernel, and trigger the browser internal body to process the status processing result. The detection is performed so that the media data can be played in the first operating system.
  • Sub-step 9183 the browser kernel acquires a handle corresponding to the second graphic received by the first graphics service module, determines a target transparent area according to the handle, and generates a content of the first graphic based on the target transparent area. And transmitting the content of the first graphic to the first graphics service module.
  • the browser kernel acquires a handle corresponding to the second graphic received by the first graphics service module based on the state processing result, which may include: preparing the state processing result to include preparation In the state data, the media playback mode is entered based on the preparation state data; in the media playback mode, the handle corresponding to the second graphic received by the first graphics service module is obtained.
  • the browser kernel may detect the received status processing result, and obtain status data generated by the media application for the media data from the status processing result.
  • the extracted state data is the preparation state data, that is, when the state processing result includes the preparation state data
  • the browser kernel acquires the handle received by the first graphics service module by calling the interface corresponding to the first graphics service module in the media play simulation mode.
  • the browser kernel Webengine obtains the handle texture of the sub-graphic SubSurface through the first operating system's graphics server module WestonServer.
  • the browser kernel determines the target transparent area corresponding to the second graphic according to the handle, which may include: determining, by using the handle, the display position and the display area size of the second graphic on the first graphic; Determining a display area of the second graphic on the first graphic based on the display position and the display area size; setting the display area as the target transparent area.
  • the browser kernel may determine, according to the handle, a size of the corresponding display area of the second graphic on the first graphics layer, such as a size of the playback window corresponding to the second graphic; and determining the second graphic.
  • a display position on the first graphic layer such as determining a display position of the play window in the web page, determining a rectangular area according to the determined display area size and display position, and using the rectangular area as the second graphic in the first graphic
  • the upper display area, and the rectangular area is set as the transparent display area as the target transparent area, that is, the display area of the second graphic on the first graphic is set as the target transparent area to woven the second graphic into the target transparent area
  • the second graphic is displayed in the first operating system, that is, the media data is played in the first operating system.
  • the display area may include: a target player play window, a webpage play window, and the like, and the target play player play window refers to a play window corresponding to the currently running player application.
  • the method before the browser kernel generates the content of the first graphic based on the target transparent area, the method further includes: extracting playing state data from the state processing result;
  • the target transparent area generates the content of the first graphic, including: generating the content of the first graphic by using the playing state data and the target transparent area.
  • the browser kernel detects the state processing result, and when the state processing result includes the playing state data corresponding to the media application, the playing state data may also be extracted from the state processing result, based on the extracted playing state.
  • the data, the target transparent area and the like generate information of the first graphic, send the generated content of the first graphic to the first graphic service module, and synthesize the content of the first graphic by the first graphic service module to generate the first Graphics.
  • Sub-step 9185 the first graphics service module generates a first graphic based on the content of the first graphic, and displays the second graphic in the target transparent area of the first graphic to play the media data.
  • the first graphics service module may generate the first graphic according to the content of the first graphic, and merge the second graphic sent by the second graphic service module into the target transparent area of the first graphic. And generating the synthesized graphic so that the second graphic can be presented in the target display area of the first graphic.
  • the first operating system of the smart terminal realizes the media playing function of the smart terminal by displaying the synthesized graphics on the display interface and playing the media data.
  • the first operating system of the smart terminal when detecting that the media data cannot be processed, connects to the second operating system through the bridge service module, thereby triggering the second operating system to start the media application to process the media data. Generating the processing result, so that the media data can be played based on the processing result generated by the second operating system, and the media playing of the smart terminal is realized.
  • this embodiment discusses a media data playing method and apparatus located on the operating system side.
  • FIG. 10 a method for playing media data based on a first operating system in the embodiment of the present application is shown, which may specifically include the following steps:
  • Step 1002 Generate a play request based on a user operation.
  • Step 1004 Send a media processing request to the second operating system when the media data does not conform to the preset data format.
  • Step 1006 Receive a processing result that is sent by the second operating system for the media processing request, and respond to the media data based on the processing result.
  • the media data playing device located in the first operating system may receive a user operation and generate a play request based on a user operation.
  • the play request includes source information of the media data. Specifically, by detecting source information of the media data, it may be determined whether the media data conforms to a preset data format, that is, whether the first operating system can parse the media data.
  • the media data playing device may generate a media processing request for the media data, and send the request to the second operating system, so that the second operating system may receive the feedback for the media processing request.
  • the processing result is based on the processing result to respond to the media data, that is, the media data is parsed by the second operating system, and the media data is parsed, so that the media data can be played and controlled to implement the media playing function.
  • the media data playing method after the generating the play request, further includes the step of determining whether the media data conforms to a preset data format, including: extracting, by the source information a media tag corresponding to the media data; determining, based on the media tag, whether the media data conforms to a preset data format.
  • the play request module can detect the source information of the media data from the source letter. And extracting a media label corresponding to the media data, so that a data format corresponding to the media data is determined based on the media label, and determining whether the data format corresponding to the media data conforms to a preset data format.
  • the media data playing device may generate a media processing request for the media data, and send the media processing request to the second operating system to parse the media data by using the second operating system, thereby completing the processing of the media data.
  • the sending the media request to the second operating system may include the following sub-steps:
  • Sub-step 10041 invoking a communication interface to establish a two-way communication connection with the second operating system based on the control identifier.
  • Sub-step 10043 transmitting the media processing request to the second operating system based on the two-way communication connection.
  • the media data playing device can connect to the second operating system by calling the communication interface.
  • the control identifier of the first operating system is transmitted to the second operating system through the communication interface, so that a two-way communication connection between the first operating system and the second operating system can be established based on the control identifier, and
  • the two-way communication connection sends the media processing request to the second operating system; and the processing result of the second operating system feedback may also be received based on the two-way communication connection.
  • the processing result fed back by the second operating system includes: a status processing result and an image processing result.
  • the responding to the media data based on the processing result may include the following sub-steps:
  • Sub-step 10061 based on the state processing result, acquire a handle corresponding to the second graphic from the image processing result.
  • Sub-step 10063 determining a target transparent area according to the handle, and generating content of the first graphic based on the target transparent area;
  • Sub-step 10065 generating a first graphic based on content of the first graphic
  • Sub-step 10066 displaying a second graphic in the target transparent area of the first graphic, and performing playback control on the media data.
  • the media data playing device may acquire a handle corresponding to the second graphic from the image processing result based on the state processing result, and determine a target transparent area according to the handle, and generate a first graphic based on the target transparent area. And generating a first graphic based on the content of the first graphic, so that the second graphic is displayed in the target transparent area of the first graphic, and the media data is played back.
  • the obtaining, according to the state processing result, the handle corresponding to the second graphic from the image processing result may include: entering the media based on the preparation state data when detecting that the state processing result includes the preparation state data a play mode; in the media play mode, acquiring a handle corresponding to the second graphic from the image processing result.
  • the media data playing device located in the first operating system may detect the status processing result, and when detecting that the status processing result includes the preparation status data, may determine that the second operating system has been Creating a decoding environment and completing initialization, and then entering a media play mode based on the preparation state data, and acquiring a handle corresponding to the second graphic from the image processing result in the media play mode, so that the display corresponding to the media data can be determined according to the handle region.
  • the media data playing device may further extract playing state data from the state processing result, so that the playing state data and the target transparent area may be adopted. Generate the content of the first graphic.
  • the media data playing device may be located in the operating system, and may be located in the first operating system in any of the above embodiments.
  • FIG. 11 is a structural block diagram of a media data playing apparatus according to an embodiment of the present application, which may specifically include the following modules:
  • the play requesting module 1102 is configured to generate a play request based on a user operation, where the play request includes source information of the media data;
  • the processing request module 1104 is configured to send a media processing request to the second operating system when the media data does not conform to the preset data format.
  • the media response module 1106 is configured to respond to the media data based on a processing result of the second operating system for the media processing request feedback.
  • the media data playing device may further include the following modules:
  • the label extraction module 1108 is configured to extract a media label corresponding to the media data from the source information.
  • the media judging module 1110 is configured to determine, according to the media label, whether the media data conforms to a preset data format.
  • the identifier acquisition module 1112 is configured to obtain a control identifier of the first operating system through the system interface.
  • the parameter information determining module 1114 is configured to use the control identifier and source information as parameter information corresponding to the media data.
  • the processing request module 1104 is configured to generate a media processing request according to the parameter information corresponding to the media data, and send a media request to the second operating system.
  • the processing request module 1104 may include the following sub-modules:
  • the communication establishing sub-module 11041 is configured to invoke a communication interface, and establish a two-way communication connection with the second operating system based on the control identifier.
  • the processing request sending submodule 11043 is configured to send the media processing request to the second operating system based on the two-way communication connection.
  • the processing result fed back by the second operating system may include: a status processing result and an image processing result.
  • the media response module 1106 may include the following submodules:
  • the handle acquisition sub-module 11061 is configured to obtain a handle corresponding to the second graphic from the image processing result based on the state processing result.
  • a content generation sub-module 11063 configured to determine a target transparent area according to the handle, and base Generating content of the first graphic in the target transparent area.
  • the graphic generation sub-module 11065 is configured to generate the first graphic based on the content of the first graphic.
  • the response sub-module 11067 is configured to display a second graphic in a target transparent area of the first graphic, and perform playback control on the media data.
  • the handle acquisition sub-module 11061 is configured to: when detecting that the status processing result includes preparation status data, enter a media play mode based on the preparation status data; and, in the media play mode Obtaining a handle corresponding to the second graphic from the image processing result.
  • the media response module 1106 may further include: a state data extraction sub-module 11069, configured to extract play state data from the state processing result.
  • the content generation sub-module 11065 is specifically configured to generate the content of the first graphic by using the play state data and the target transparent area.
  • FIG. 12 a method for playing media data based on a second operating system in the embodiment of the present application is shown, which may specifically include the following steps:
  • Step 1202 Receive a media processing request sent by the first operating system.
  • Step 1204 Process the media data according to the media processing request, and generate a processing result.
  • Step 1206 the processing result is fed back to the first operating system.
  • the first operating system can perform playback control on the media data based on the processing result, satisfy the user's playing requirement, and improve the user's physical examination.
  • processing the media data according to the media processing request to generate a processing result may include the following sub-steps:
  • Sub-step 12031 is configured to start, according to the media processing request, a media application corresponding to the application package name.
  • the application package name is determined according to source information of the media data carried by the media processing request.
  • Sub-step 12033 the processing result corresponding to the media data is generated by the media application in response to the media processing request.
  • the processing, by the media application, in response to the media processing request, the processing result corresponding to the media data may include: acquiring corresponding media data according to the source information carried by the media processing request; The data is decoded to generate a data frame; the data frame is synthesized, second graphic information is generated, and the second graphic information is used as a graphic processing result.
  • the generating the processing result corresponding to the media data further includes: listening to an interface corresponding to the control identifier.
  • the synthesizing the data frame to generate the second graphic information includes: determining, when the control identifier of the first operating system is monitored, the data frame belongs to a special encoding mode; synthesizing the data frame And generating a second graphic and a handle corresponding to the second graphic.
  • the processing result corresponding to the media data is generated by the media application in response to the media processing request, and may further include: the media application parsing the media data by using a software development package. , generating play status information; using the generated play status information as a status processing result.
  • the feeding back the processing result to the first operating system includes: sending the state processing result graphic and the processing result to the first operating system respectively according to the two-way communication connection.
  • FIG. 13 a block diagram of a structure of another media data playing apparatus of this embodiment is shown, which may specifically include the following modules:
  • the receiving module 1302 is configured to receive a media processing request sent by the first operating system
  • the media processing module 1304 is configured to process the media data according to the media processing request, and generate a processing result
  • a feedback module 1306, configured to feed back the processing result to the first operating system
  • the media data playing device in this embodiment may also be an operating system, and may be located on the In the second operating system in any of the embodiments.
  • the media processing module 1304 includes the following submodules:
  • the application launching sub-module 13041 is configured to start, according to the media processing request, a media application corresponding to the application package name.
  • the application package name is determined according to source information of the media data carried by the media processing request.
  • the result generation sub-module 13042 is configured to generate, by the media application, the processing result corresponding to the media data in response to the media processing request.
  • the result generation submodule 13042 may include the following units:
  • the media data acquiring unit is configured to acquire corresponding media data according to the source information carried by the media processing request.
  • a media data decoding unit configured to decode the media data to generate a data frame.
  • a graphic result generating unit configured to synthesize the data frame, generate second graphic information, and use the second graphic information as a graphic processing result.
  • the result generation submodule 13042 may further include the following units:
  • a listener unit that listens on the interface corresponding to the control identifier.
  • the encoding determining unit is configured to determine that the data frame belongs to a special encoding mode when the control identifier of the first operating system is monitored.
  • the data frame synthesizing unit is specifically configured to synthesize the data frame to generate a second graphic and a handle corresponding to the second graphic.
  • a media data parsing unit configured to parse the media data by using a software development package to generate play status information
  • the status result generating unit is configured to use the generated playing status information as a status processing result.
  • the feedback module 1306 is specifically configured to send a status processing result and a graphics processing result to the first operating system based on the two-way communication connection.
  • the embodiment further discloses an intelligent terminal.
  • the smart terminal 1400 includes a memory 1410, a display 1420, a processor 1430, and an input unit 1440.
  • the input unit 1440 can be configured to receive numeric or character information input by the user, and a control signal.
  • the input unit 1440 may include a touch screen 1441, which may collect a touch operation on or near the user (such as an operation of the user using a finger, a stylus, or the like on the touch screen 1441 using any suitable object or accessory. ), and drive the corresponding connection device according to a preset program.
  • the input unit 1440 may also include other input devices such as a physical keyboard, function keys (such as volume control buttons, switch buttons, etc.), a mouse, and the like.
  • the display 1420 includes a display panel.
  • the display panel may be configured in the form of a liquid crystal display (LCD) or an organic light-emitting diode (OLED).
  • the touch screen can cover the display panel to form a touch display screen, and when the touch display screen detects a touch operation on or near it, it is transmitted to the processor 1430 to perform corresponding processing.
  • the processor 1430 by calling a software program stored in the memory 1410, and/or a module, and/or data, the processor 1430 is used by the first operating system to call the second operating system by calling a communication interface. Transmitting a media processing request; after receiving the media processing request, the second operating system processes the media data according to the media processing request, and generates a processing result, The processing result is fed back to the first operating system; the first operating system receives the processing result, and responds to the media data based on the processing result.
  • the processor 1430 is further configured to use, by the browser core of the first operating system, a play request generated based on a user operation, where the play request includes source information of the media data, and the first operating system detects the play request according to the play request.
  • the source information of the media data when the first operating system detects that the media data cannot be processed, performs the step of sending a media processing request to the second operating system.
  • the source information includes a media label
  • the first operating system detects the source information of the media data according to the play request, including: the browser kernel extracts a media label corresponding to the media data from the source information; The media label determines whether the media data conforms to a preset data format; when the media data does not conform to the preset data format, determining that the first operating system cannot process the media data.
  • the first operating system sends a media processing request to the second operating system by using a communication interface, where the browser kernel sends the parameter corresponding to the media data to a bridge service module of the first operating system.
  • the bridge service module After receiving the parameter information, the bridge service module generates a media processing request according to the parameter information, and invokes the communication interface to send a media processing request to the second operating system.
  • the method further includes: acquiring, by using a system interface, a control identifier of the first operating system; and using the control identifier and the source Information is used as the parameter information.
  • the bridge service module generates a media processing request according to the parameter information, including: extracting source information from the parameter information, determining an application package name based on the source information, where the application package name is used to determine a processing location a media application of the media data; generating the media processing request by using the parameter information and an application package name.
  • the bridge service module invokes the communication interface to send the media processing request to the second operating system, including: invoking the communication interface, establishing a two-way communication connection with the second operating system based on the control identifier; The two-way communication connection sends the media processing request to the second operating system.
  • the second operating system processes the media data according to the media processing request, and generates a processing result, including: starting a media application corresponding to the application package name based on the media processing request; and responding by using the media application
  • the media processing request generates a processing result corresponding to the media data.
  • the media application responds to the media processing request to generate a processing result corresponding to the media data, where the media application acquires media data corresponding to the media processing request according to the source information; and the media application invokes the media service interface.
  • a decoding environment is created, the media data is decoded, and the processing result is generated.
  • the media application invokes the media service interface to create a decoding environment, and the media data is decoded to generate the processing result, where the media application sends the acquired media data to the second media service module through the media interface;
  • the second media service module decodes the media data, generates a data frame, and sends the generated data frame to the second graphics service module;
  • the second graphics service module receives the data frame.
  • the data frame is synthesized to generate second graphic information, and the second graphic information is used as a graphic processing result.
  • the second graphics service module further includes: listening to an interface corresponding to the control identifier; and when monitoring the control identifier of the first operating system, connecting according to the control identifier The first graphics service module of an operating system.
  • the second graphics service module synthesizes the data frame to generate the second graphics information, including: when the control identifier of the first operating system is monitored, determining the The data frame belongs to a special coding mode; the data frame is synthesized to generate a second graphic and a handle corresponding to the second graphic.
  • the media application invokes the media service interface to create a decoding environment, and the media data is decoded to generate the processing result.
  • the method further includes: the media application parsing the media data by using a software development package, and generating a play status. Information, the generated playback status information is used as a status processing result.
  • the second operating system feeds back the processing result to the first operating system, including: the media application sends the status processing result to the bridge service module; and the second graphics service module sends the graphic processing result to the The first graphics service module.
  • the first operating system responds to the media data based on the processing result
  • the method includes: the bridge service module forwards the received status processing result to the browser kernel; and the browser kernel obtains the first a handle corresponding to the second graphic received by the graphics service module, determining a target transparent area according to the handle, generating content of the first graphic based on the target transparent area, and transmitting the content of the first graphic to the first graphic a service module: the first graphics service module generates a first graphic based on content of the first graphic, and displays a second graphic in a target transparent area of the first graphic, and performs playback control on the media data.
  • the browser kernel acquires, according to the state processing result, the handle corresponding to the second graphic received by the first graphics service module, including: when detecting that the state processing result includes the preparation state data, based on the The preparation state data enters a media play mode; in the media play mode, a handle corresponding to the second graphic received by the first graphics service module is obtained.
  • the method further includes: extracting playing state data from the state processing result; and then generating the first graphic based on the target transparent area
  • the content includes: generating the content of the first graphic by using the playing state data and the target transparent area.
  • determining, by the browser kernel, the target transparent area corresponding to the second graphic according to the handle comprising: determining, by using the handle, a display position and a display area size corresponding to the second graphic on the first graphic; The display position and the display area size determine a display area of the second graphic on the first graphic; and the display area is set as the target transparent area.
  • the display area includes: a target player play window.
  • the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.
  • embodiments of the embodiments of the present application can be provided as a method, apparatus, or computer program product. Therefore, embodiments of the present application may adopt an entirely hardware embodiment, A fully software embodiment, or a combination of software and hardware aspects. Moreover, embodiments of the present application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) including computer usable program code.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • Embodiments of the present application are described with reference to flowcharts and/or block diagrams of methods, terminal devices (systems), and computer program products according to embodiments of the present application. It will be understood that each flow and/or block of the flowchart illustrations and/or FIG.
  • These computer program instructions can be provided to a processor of a general purpose computer, special purpose computer, embedded processor or other programmable data processing terminal device to produce a machine such that instructions are executed by a processor of a computer or other programmable data processing terminal device
  • Means are provided for implementing the functions specified in one or more of the flow or in one or more blocks of the flow chart.
  • the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing terminal device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
  • the instruction device implements the functions specified in one or more blocks of the flowchart or in a flow or block of the flowchart.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Stored Programmes (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

本申请实施例提供了一种媒体数据播放方法和装置、智能终端,该方法包括:第一操作***通过调用通信接口向第二操作***发送媒体处理请求;第二操作***接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***;第一操作***接收到所述处理结果,基于所述处理结果对所述媒体数据进行响应。本申请实施例的第一***可以通过通信接口向第二操作***发送媒体处理请求,即通过第二操作***对该媒体数据进行处理,生成处理结果,从而可以基于第二操作***所生成的处理结果对所述媒体数据进行响应,解决了安装有两个操作***的智能终端播基于第一操作***播放媒体数据失败的问题。

Description

一种媒体数据播放方法和装置、智能终端 技术领域
本申请涉及终端技术领域,特别是涉及一种媒体数据播放方法、一种基于智能终端的媒体数据播放方法、一种智能终端和一种媒体数据播放装置。
背景技术
在移动互联网业务如火如荼的发展态势影响下,开源智能终端操作***因其开放性和先进性成为未来主流的智能终端软件平台。
基于智能终端操作***的开放性,可以在智能终端上安装两个操作***,分别是主操作***(Host OS)和客操作***(Guest OS)。其中,主操作***指的是设备中能够直接运行的操作***,如智能设备默认启动的操作***;而客操作***指的是必须依赖其它操作***的支持才能运行的操作***。在启动智能终端时,主操作***首先运行,并可启动客操作***,并为其提供底层接口支持,比如设备驱动接口,内存访问接口等。
随着软硬技术的不断发展,智能终端的多媒体功能越来越强大,其所需要支持播放的媒体数据格式也越来越多。但是,由于主操作***不能支持所有媒体数据格式,如主操作***不能处理第三方所提供的媒体数据,导致基于主操作***的智能终端不能播放第三方应用所提供的媒体数据。
显然,智能终端基于主操作***不能支持所有媒体数据格式,存在媒体数据播放失败的问题。
发明内容
本申请实施例所要解决的技术问题是提供一种媒体数据播放方法和基于智能终端的媒体数据播放方法,以解决智能终端播放媒体数据的失败问题。
相应的,本申请实施例还提供一种智能终端以及一种媒体数据播放装 置,用以保证上述方法的实现及应用。
为了解决上述问题,本申请实施例公开了一种媒体数据播放方法,包括:第一操作***通过调用通信接口向第二操作***发送媒体处理请求;第二操作***接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***;第一操作***接收到所述处理结果,基于所述处理结果对所述媒体数据进行响应。
本申请实施例还公开了一种媒体数据播放方法,包括:基于用户操作生成播放请求,所述播放请求包含媒体数据的源信息;在所述媒体数据不符合预置的数据格式时,向第二操作***发送媒体处理请求;基于所述第二操作***针对所述媒体处理请求反馈的处理结果对所述媒体数据进行响应。
本申请实施例还公开了一种媒体数据播放方法,包括:接收第一操作***发送的媒体处理请求;依据所述媒体处理请求对媒体数据进行处理,生成处理结果;将所述处理结果反馈给第一操作***。
本申请实施例还公开了一种智能终端,包括:第一操作***和第二操作***;其中,所述第一操作***,用于通过调用通信接口向所述第二操作***发送媒体处理请求,以及用于接收到所述第二操作***所反馈的处理结果,基于所述处理结果对所述媒体数据进行响应;所述第二操作***,用于接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***。
本申请实施例还公开了一种智能终端,包括:存储器、显示器、处理器和输入单元;其中,所述处理器用于执行本申请任一实施所述的方法。
本申请实施例还公开了一种媒体数据播放装置,包括:播放请求模块,用于基于用户操作生成播放请求,所述播放请求包含媒体数据的源信息;处理请求模块,用于在所述媒体数据不符合预置的数据格式时,向第二操作***发送媒体处理请求;媒体响应模块,用于基于第二操作***针对所述媒体处理请求反馈的处理结果对所述媒体数据进行响应。
本申请实施例还公开了一种媒体数据播放装置,包括:请求接收模块,用于接收第一操作***发送的媒体;媒体处理模块,用于依据所述媒体处理请求对媒体数据进行处理,生成处理结果;反馈模块,用于将所述处理结果反馈给第一操作***。
与现有技术相比,本申请实施例包括以下优点:
在本申请实施例中,第一***可以通过通信接口向第二操作***发送媒体处理请求,即通过第二操作***对该媒体数据进行处理,生成处理结果,从而可以基于第二操作***所生成的处理结果对所述媒体数据进行响应,解决了安装有两个操作***的智能终端播基于第一操作***播放媒体数据失败的问题,提高用户体验。
附图说明
图1是本申请实施例的一种智能终端的结构框图;
图2是本申请实施例的一种基于智能终端的媒体数据播放方法的步骤流程图;
图3是本申请实施例的另一种智能终端的结构框图;
图4是本申请实施例的第一操作***与第二操作***通信过程的时序示意图;
图5是本申请实施例中第一操作***的一种浏览器内核的结构框图;
图6是本申请实施例中第一操作***的一种网桥服务模块的结构框图;
图7是本申请实施中第二操作***的一种媒体应用的结构框图;
图8是本申请实施例中第二操作***的一种第二图形服务模块的结构框图;
图9是本申请实施例的另一种基于智能终端的媒体数据播放方法的步骤流程图;
图10是本申请实施例中基于第一操作***的媒体数据播放方法;
图11是本申请本实施例的一种媒体数据播放装置的结构框图;
图12是本申请实施例中基于第二操作***的媒体数据播放方法;
图13是本申请本实施例的另一种媒体数据播放装置的结构框图;
图14是本申请实施例的又一种智能终端的结构框图。
具体实施方式
为使本申请的上述目的、特征和优点能够更加明显易懂,下面结合附图和具体实施方式对本申请作进一步详细的说明。
智能终端可以通过安装两个操作***,实现其各种各样的功能,以满足用户需求。其中,操作***(Operating System,简称OS)是一个庞大的管理控制程序,其功能是管理智能终端的所有资源(包括硬件和软件),同时也是智能终端***的内核与基石。
智能终端所安装的两个操作***可以分别标注为第一操作***和第二操作***。其中,第一操作***可以作为主操作***,具体可以包括云计算操作***(简称云***),且云***具体可以是采用国际首创的HFP及HDRDP技术在局域网架构下实现云计算使用效果的新一代通用计算机***产品;第二操作***可以作为客操作***,具体可以包括传统操作***,如安卓(Android)***。在智能终端启动时,第一操作***可以首先运行,并可启动第二操作***,并为其提供底层接口支持,比如设备驱动接口,内存访问接口等。
智能终端的第一操作***所支持的媒体数据格式是有限的,导致智能终端基于第一操作***不能实现对所有媒体数据格式的媒体数据进行播放,存在媒体数据播放失败的问题。
本申请实施例的核心构思之一在于,提出一种基于智能终端的媒体数据播放方法及智能终端,以解决现有智能终端基于第一操作***不支持所有媒体数据格式而导致媒体数据播放失败的问题。当第一***检测到无法 处理媒体数据时,向第二操作***发送媒体处理请求;通过第二操作***对该媒体数据进行处理,生成处理结果,从而使得第一操作***可以基于第二操作***所生成的处理结果对所述媒体数据进行播放,解决了由于第一操作***不支持媒体数据格式而造成智能终端基于第一操作***播放媒体数据失败的问题。
实施例一
参照图1,示出了本申请实施例的一种智能终端的结构框图,具体可以包括:第一操作***102和第二操作***104。
其中,第一操作***102,可以用于通过调用通信接口向所述第二操作***发送媒体处理请求。
本实施例的智能终端在启动时,可以自动启动第一操作***102,以实现其功能。当智能终端需要播放媒体数据时,第一操作***102可以对所需要播放的媒体数据进行检测,判断是否支持该媒体数据对应媒体数据的格式,即判断是否可以对该媒体数据处理。智能终端的第一操作***102在检测到不支持该媒体数据对应的媒体数据格式时,即在检测到无法处理该媒体数据时,通过调用通信接口启动第二操作***104,并针对该媒体数据的处理生成媒体数据处理请求,通过通信接口向智能终端的第二操作***104发送媒体处理请求,触发第二操作***104对该媒体数据进行处理。其中,该媒体处理请求与媒体数据处理有关,如包括了媒体数据的源信息、第一操作***的控件标志符等参数信息,以及媒体应用对应的应用包名。
第二操作***104,可以用于接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***。
第二操作***104在接收到第一操作***104所发送的媒体处理请求后,可以依据该媒体处理请求对媒体数据进行处理,生成该媒体数据对应的处理结果。具体的,第二操作***可以通过调用媒体应用对应的接口,获取该媒体数据对应的软件开发工具包(Software Development Kit, SDK),通过该SDK对该媒体数据进行处理,从而可以完成对该媒体数据的处理,生成处理结果。第二操作***104在生成该媒体数据的处理结果后,将所生成的处理结果反馈给第一操作***102,如将生成的图形数据发送给第一操作***,使得第一操作***102可以基于该处理结果对媒体数据进行播放,从而实现智能终端的多媒体功能。
因此,智能终端的第一操作***102还用于接收第二操作***102所反馈的处理结果,基于所述处理结果对所述媒体数据进行响应。
在本实施例中,第一操作***102在接收到第二操作***102针对媒体数据处理所发送的处理结果后,就可以通过该处理结果对该媒体数据进行响应制。具体的,第一操作***102可以基于该处理结果生成该媒体数据在显示屏上显示的播放数据,以实现智能终端对该媒体数据的播放控制,如在显示屏播放视频,暂停视频播放、对视频进行快进或快退播放等。
需要说明的时,本申请实施的智能终端指的是具有多媒体功能的终端设备,支持音频、视频、数据等方面的功能。本实施中的智能终端安装有两个操作***,包括移动智能终端如智能手机、平板电脑、也可以是智能电视、个人计算机、机顶盒如网络高清机顶盒等设备。
本申请实施例的媒体数据指的是媒体所对应的传输数据,如视频对应的视频数据,音频对应的音频数据等。其中,视频数据用于播放视频,音频数据用于播放音频,如播放音乐。
基于上述智能终端,论述基于智能终端的媒体数据播放方法,如图2所示,具体可以包括如下步骤:
步骤202,第一操作***通过调用通信接口向所述第二操作***发送媒体处理请求。
当智能终端需要播放媒体数据时,第一操***需要对媒体数据进行处理,如按照该媒体数据对应的媒体数据格式对该媒体数据进行解释,生成该媒体数据对应的播放数据,从而可以依据该播放数据对该媒体数据进行播放,即实现智能终端的多媒体播放功能。
在本申请实施例中,当第一操***检测到无法处理该媒体数据时,即在第一***不支持该媒体数据对应的格式时,可以通过调用通信接口,如进程间通信(Inter-Process Communication,IPC)机制的接口,连接第二操作***,向第二操***发送媒体处理请求。其中,该媒体处理请求与所述媒体数据处理有关,是第一操作***基于所需要处理的媒体数据所生成的,可以包括媒体数据的源信息、第一操操作***的控件标志符、应用包名等信息。其中,媒体数据的源信息可以包括媒体数据对应的统一资源定位符(Uniform Resource Locator,URL),还可以包括该媒体数据对应的其他数据,如媒体数据对应的媒体标签等,媒体标签可以用于确定媒体数据所采用的媒体数据格式,URL可以用于获取媒体数据;第一操操作***的控件标志符可以用于建立双向通信连接;应用包名可以用于确定处理该媒体数据的媒体应用,通过该媒体应用可以获取该媒体数据对应的SDK。
步骤204,第二操作***接收到媒体处理请求后,依据媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***。
智能终端的第二操作***在接收到第一操作***所发送的媒体处理请求后,可以依据该媒体处理请求启动媒体应用。其中,该媒体应用安装有媒体数据对应的SDK,可以通过该SDK对该媒体数据进行解析,完成对该媒体数据的处理。具体的,第二操作***可以通过调用媒体应用对应的接口,启动媒体应用,从而可以获取到该媒体数据对应的SDK。通过SDK对媒体数据进行解析,生成该媒体数据的处理结果。作为本申请实施例的一个具体示例,通过该SDK调用媒体服务模块的接口,创建解码环境,对该媒体数据进行解码,生成解码后的数据帧,采用数据帧生成该媒体数据对应的图形数据,从而可以基于该图形数据生成该媒体数据的处理结果,通过通信接口将该处理结果反馈给操作***,即响应第一操作***所发送的媒体处理请求,使得第一操作***可以基于该处理结果生成该媒体数据对应的播放数据。其中,该处理结果可以包括第二图形信息、播放状态数据等。第二图形信息用于在第一操作***中生产媒体数据对应的播放数据,播放状态数据可以用于显示媒体数据所对应的播放状态,如当前的播 放进度、媒体数据的播放时长等。
步骤206,第一操作***接收到所述处理结果,基于所述处理结果对所述媒体数据进行播放。
智能终端的第一操作***在接收到第二操作***所发送的处理结果后,可以对处理结果进行检测。如处理结果中提取第二图形信息,并且基于该媒体数据所在的播放页面的其他内容生成第一图形信息,通过第一图形服务模块将第二图形信息合成到第一图形信息中,生成第一操作***的图形显示数据,即生成了该媒体数据对应的播放数据,从而可以依据该播放数据对该媒体数据进行播放。其中,该图形显示数据包含了第二操作***所生成的处理结果,用于在智能终端的显示界面展现图形页面,如在智能终端对应的显示屏上展现播放页面,对媒体数据进行播放。
在本申请实施例中,智能终端的第一操作***在检测到无法处理当前所需要播放的媒体数据时,可以通过通信接口向第二操作***发送媒体处理请求,请求第二操作***对该媒体数据进行处理,即通过第二操作***对该媒体数据进行处理,生成处理结果,使得第一操作***可以基于第二操作***所生成的处理结果对所述媒体数据进行播放,从而解决了由于第一操作***无法处理媒体数据而造成智能终端基于第一操作***播放媒体数据失败的问题,从而可以在第一操作***中播放媒体数据,实现智能终端的媒体播放功能。
实际上,当媒体应用没有为第一操作***提供自身的SDK对应的接口时,则第一***不能获取到该SDK,即不能通过第三方应用所提供的SDK处理该媒体应用对应媒体数据,即不支持该媒体用所采用的媒体数据格式。例如,视频的提供商、视频应用的开发商在设计SDK时,即第三方在开发SDK时,没有针对第一操作***在SDK中设置SDK与第一操作***对应的接口,导致第一***不能通过接口获取第三方所提供的SDK,造成第一操作***不能处理其所提供的视频数据的问题。但是,第三方在开发SDK时,通常在SDK里设置与第二操作***对应的接口,即为第二操作***提供自身的SDK对应的接口,使得媒体应用可以获取到该SDK,从而可以将 其所开发的媒体应用安装在第二操作***上。因此,第二操作***可以通过启动媒体应用,调用SDK对应的接口获取SDK,通过该SDK对媒体数据进行处理,生成该媒体数据对应的处理接口,使得智能终端可以基于该处理结果对媒体数据进行播放,实现媒体播放功能。
参照图3,示出了本申请实施例的另一种智能终端的结构框图。
在本申请实施中,智能终端的第一操作***102可以包括:浏览器内核1022、网桥服务模块1024和第一图形服务模块1026;第二操作***104可以包括:媒体应用1042、媒体服务模块1044和第二图形服务模块1046。
当第一操操作***102无法处理处理媒体数据时,第一操作***102的浏览器内核1022可以通过远程注册(RegistRemote)连接第一图形服务模块1026。在远程连接中(OnRegisted),可以通过创建第二图形,如子图形(CreateSubSurface),实现对媒体数据的播放。作为本申请的一个具体示例,如图4所示,在创建图形过程(OnSurfaceCreated)中,浏览器内核1022(WebEngine)通过网桥服务模块1024(MediaBridgeServer)向第二操作***104的媒体应用1042(Application)发送准备播放消息(Prepare消息),触发媒体应用1042进入准备播放状态。媒体应用1042在接收到准备播放消息后,向媒体服务模块1044(MediaServer)发送创建图形消息(CreateSurface消息),触发媒体服务模块1044向对第二图形服务模块1046(SurfaceFlinger)发送创建媒体图形消息(CreateMediaSurface消息)。第二服务模块在接收到创建媒体图形消息后,可以依据Wayland协议与第一操作***102建立Wayland连接(WaylandConnection),从而可以在连接状态(OnConnected)下创建子图形(CreateSubSurface),将生成子图形(SetSubSurface)传送给第一图形服务模块1026(Weston Server),即将生成的第二图形发送给第一图形服务模块1026,从而使得第一操作***102可以基于第二图形对媒体数据进行播放。第二图形服务模块1046在建立与第一图形服务模块1026的连接后,可以通过子图形创建消息(OnSurfaceCreated消息)通知媒体服务模块1044,触发媒体服务模块1044向媒体应用1042发送初始化完成消息(OnPrepared消息)。媒体应用1042在接收到初始化完成的消息后,向 网桥服务模块1024转发初始化完成的消息,进而使得浏览器内核1022获取到初始化完成的消息,进入开始播放媒体数据的状态。浏览器内核1022可以通过发送开始播放消息(Start消息),触发媒体服务模块1044向第二图形服务模块1046发送绘制图形消息(DrawToSurface消息),使得第二图形服务模块1046绘制子图形传送给第一图形服务模块1026,相当于DrawToSubsurface,从而可以在第一操***中对媒体数据进行播放。同理,浏览器内核1022通过发送停止播放消息(如Stop消息),可以触发媒体服务模块1044向第二图形服务模块1046发送删除图形消息,相当于DestorySurface,使得第二图形服务模块1046断开与第一图形服务模块1026的Wayland连接,如发送WaylandDisconnect消息,使得连接断开即第二图形服务模块1046断开与第一图形服务处于OnDisconnected状态,停止播放媒体数据。
其中,第一操作***102的浏览器内核1022,可以用于基于用户操作生成的播放请求,所述播放请求包含所述媒体数据的源信息;以及用于依据所述播放请求检测媒体数据的源信息。具体的,浏览器内核可以对用户操作对应的接口进行监听,在监听到用户操作时,通过获取该用户操作对应的数据源信息生成操作请求。当数据源信息包含了媒体标签时,浏览器内核可以将该操作请求确定为播放请求,并且可以对该媒体数据的源信息进行检测,以判断第一操***是否支持该媒体数据对应的媒体数据格式。当检测到第一操作体统不支持该媒体数据对应的媒体数据格式,可以判定第一操作***无法处理该播放请求中的媒体数据。
参照图5,示出了本申请实施中第一操作***的一种浏览器内核的结构框图。
在本申请的一种优选实施例中,媒体数据的源信息包括媒体标签;所浏览器内核1022,可以包括如下子模块:
媒体标签提取子模块102201,用于所述浏览器内核从源信息中提取所述媒体数据对应的媒体标签。
判断子模块102203,用于基于所述媒体标签判断所述媒体数据是否符 合预置的数据格式。
确定子模块102205,用于在所媒体数据不符合预置的数据格式时,确定第一操作***无法处理所述媒体数据。
参数信息发送子模块102207,用于向所述网桥服务模块发送所述媒体数据对应的参数信息。
在本申请实施例中,浏览器内核102可以通过媒体标签提取子模块102201从源信息中提取所述媒体数据对应的媒体标签;采用判断子模块102203对所提取到媒体标签进行检测,以判断媒体数据是否符合预置的数据格式,即判断第一操作***102是否可以处理该媒体数据;在该媒体数据不符合预置的数据格式时,通过确定子模块102205可以确定第一操作***102无法处理该媒体数据,并且通过参数信息发送子模块102207向所述网桥服务模块10204发送所述媒体数据对应的参数信息,触发网桥服务模块1024向第二操作***104发送媒体处理请求,使得第一操作***102可以连接第二操作***104,通过第二操作***104对该媒体数据进行处理,获取到第二操作***104针对该媒体数据的处理结果。
网桥服务模块1024,具体可以用于在接收到所述参数信息后,依据所述参数信息生成媒体处理请求,调用通信接口向所述第二操作***发送媒体处理请求。
可选的,浏览器内核1022还可以包括:标志符获取子模块102209和参数信息确定子模块102211。
其中,标志符获取子模块102209,可以用于通过***接口获取第一操作***的控件标志符。
数信息确定子模块102211,可以用于将所述控件标志符和源信息作为所述参数信息。
在本申请实施例中,浏览器内核可以通过标志符获取子模块102209调用***接口,获取第一操作体统的控件标识符,该控件标识符用于建立第一操***与第二操作***之间的双向通信;并通过参数信息确定子模块 102211将所述控件标志符和源信息作为所述参数信息,调用参数信息发送子模块102207向网桥服务模块1024发送参数信息。
参照图6,示出了本申请实施中第一操作***的一种网桥服务模块的结构框图。
在本申请的一种优选实施例中,网桥服务模块1024可以包括如下子模块:
应用包名确定子模块102401,可以用于从所述参数信息中提取源信息,基于所述源信息确定应用包名,所述应用包名用于确定处理所述媒体数据的媒体应用。
处理请求生成子模块102403,可以用于采用所述参数信息以及应用包名,生成所述媒体处理请求。
在本申请实施例中,网桥服务模块1024在接收到浏览器内核所发送的参数信息后,可以通过应用包名确定字模块102401从参数信息中提取媒体数据的源信息,依据所提取的源信息确定处理该媒体数据的媒体应用对应的应用包名;采用处理请求生成子模块102403生成媒体处理请求,该媒体处理请求包含参数信息以及应用包名。网桥服务模块1024通过通信接口将该媒体处理请求发发送给第二操作***104,触发第二操作***104依据该媒体处理请求启动应用包名对应的媒体应用1042,对媒体数据进行处理。
可选的,网桥服务模块1024还可以包括:通信建立子模块102405和处理请求发送子模块102407。
通信建立子模块102405,用于调用所述通信接口,基于所述控件标识符与第二操作***建立双向通信连接。
处理请求发送子模块102407,用于基于所述双向通信连接向第二操作***发送所述媒体处理请求。
在本申请实施例中,网桥服务模块1024可以通过通信建立子模块 102405调用通信接口,采用控件标识符与第二操作***建立双向通信连接。此外,网桥服务模块1024还可以通过处理请求发送子模块102407,基于通信建立子模块102405所建立的双向通信连接,向第二操作***发送所述媒体处理请求。
第二操作***104,可以具体用于基于所述媒体处理请求,启动所述应用包名对应的媒体应用1042。该媒体应用1042,用于响应所述媒体处理请求,生成所述媒体数据对应的处理结果。具体的,媒体应用1042安装有SDK,可以依据媒体数据的源信息如媒体数据的资源统一定位符(Uniform Resource Locator,URL)获取媒体处理请求对应的媒体数据,通过SDK对该媒体数据进行解析,以生成该媒体数据的处理结果,如调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。
参照图7,示出了本申请实施中第二操作***的一种媒体应用的结构框图。
在本申请的一种优选实施例中,媒体应用1042可以包括如下子模块:
媒体数据获取子模块104201,用于依据所述源信息获取媒体处理请求对应的媒体数据。
解码环境创建子模块104203,用于调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。
在本申请实施例中,媒体应用1042可以通过解码环境创建子模块104203,调用媒体接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。作为本申请的一个具体示例,可以通过解码环境创建子模块104203调用媒体接口,向第二媒体服务模块1044发送所获取的媒体数据,触发第二媒体服务模块1044对该媒体数据进行解码。
可选的,解码环境创建子模块104203可以包括媒体数据发送单元1042031。其中,媒体数据发送单元1042031可以用于通过媒体接口向第二媒体服务模块发送所获取的媒体数据。
第二媒体服务模块1044,用于在接收到媒体数据后,对所述媒体数据进行解码,生成数据帧,将所生成的数据帧发送给第二图形服务模块1046。
第二图形服务模块1046,用于在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,将所述第二图形信息作为图形处理结果。
在本申请实施例中,媒体应用的解码环境创建子模块104203可以通过调用媒体接口向第二媒体服务模块1044发送处理请求。当第二媒体服务模块1044该处理请求时,解码环境创建子模块104203可以通过媒体数据发送单元1042031,向第二媒体服务模块1044发送所获取的媒体数据,触发第二媒体服务模块1044对该媒体数据进行解码处理。第二媒体服务模块1044对接收到的媒体数据进行解码,生成解码后的数据帧,并将所生成的数据帧输送到第二图形服务模块1046进行合成。
第二图形服务模块1046,用于在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,将所述第二图形信息作为图形处理结果。
在本申请实施例中的,第二图形服务模块1046可以对控件标志符对应的接口进行监听。当监听到第一操作***102的控件标志符时,第二图形服务模块1046可以基于第一操作***102的控件标志符连接第一操作***102的第一图形服务模块1026,并将所接收到的数据帧合成第二图形,生成第二图形信息。该第二图形信息包括第二图形和第二图形对应的句柄,该句柄用于控制第二图形的显示区域大小以及显示位置。
参照图8,示出了本申请实施中第二操作***的一种第二图形服务模块的结构框图。
在本申请的一种优选实施例中,第二图形服务模块1046可以包括如下子模块:
监听子模块104601,用于对控件标志符对应的接口进行监听。
连接子模块104603,用于在监听到第一操作***的控件标志符时,基于所述控件标志符连接第一操作***的第一图形服务模块。
在本申请实施例中,第二图形服务服务模块可以通过监听子模块104601,实时对控件标志符对应的接口进行监听。当监听到第一操作***102的控件标志符时,可以确定接收到的数据帧为针对第一操作***102所发送的媒体处理请求所生成的数据帧,判定该数据帧属于特殊编码方式,将该数据帧合成第二图形和第二图形对应的句柄;通过调用连接子模块104603,基于控件标志符连接第一操作***102的第一图形服务模块1026,以向第一图形服务模块1026发送所生产的第二图形和该第二图形对应的句柄,从而使得第一操***102可以给基于该第二图形和该第二图形对应的句柄生成媒体数据对应的播放数据,进而可以在第一操作***102对该媒体数据进行播放控制。
可选的,第二图形服务模块1046还可以包括如下子模块:
编码判定子模块10465,用于在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式。
数据帧合成子模块10467,用于对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
在本申请实施例的一种优选实施例中,解码环境创建子模块104203还可以包括状态信息生成单元1042033。其中,状态信息生成单元1042033可以用于通过软件开发包对所述媒体数据进行解析,生成播放状态信息,将所生成的播放状态信息作为状态处理结果。其中,该播放状态信息可以用于在智能终端的显示界面上显示媒体播放器对应的播放状态,如显示当前播放的进度、媒体播放时长等。其中,媒体播放时长是指该媒体数据播放完毕所需要的时间长度,如视频播放时长为50分钟,是指播放完该视频播放需要50分钟。
在本申请实施例中,媒体应用1042还用于将所述状态处理结果发送到网桥服务模块;第二图形服务模块1046,还用于将所述图形处理结果发送到第一图形服务模块。第二操作系通过调用媒体应用1042以及第二图形服务模块1046将状态处理结果和图形处理结果反馈给第一操***102,使得第一操***102可以基于状态处理结果和图形处理结果对该媒体数据进 行播放,从而解决了智能终端的第一操作***102不支持媒体数据对应的媒体数据格式而导致智能终端基于第一操作***102播放媒体数据失败的问题。
在本申请的一种优选实施例中,网桥服务模块1024还可以包括处理结果转发子模块102408。其中,处理结果转发子模块102408可以用于将接收到的状态处理结果转发给浏览器内核1022。所述浏览器内核1022,还可以用于基于状态处理结果,获取第一图形服务模块1026所接收到的第二图形对应的句柄,依据所述句柄确定目标透明区域,基于所述目标透明区域生成第一图形的内容,将所述第一图形的内容发送到第一图形服务模块1026;第一图形服务模块1026,可以用于基于第一图形的内容生成第一图形,在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放。
具体的,网桥服务模块1024在接收到媒体应用1042所发送的状态处理结果后,通过调用处理结果转发子模块102408将该状态处理结果转发给浏览器内核1022,使得浏览器内核1022可以基于该状态处理结果对媒体数据进行播放。例如,浏览器内核1022可以对该状态处理结果进行检测,在检测到该状态处理结果包含准备状态数据时,进入媒体播放模式,即进入播放媒体数据的准备状态;在媒体播放模式下,获取第一图形服务模块1026所接收到的第二图形对应的句柄,依据该句柄确定第二图形在第一图形上对应的显示位置和显示区域大小,即确定第二图形在第一图形层的显示区域,将所确定的显示区域设置为目标透明区域。此外,浏览器内核1022还用于从接收到的状态处理结果中提取播放状态数据,采用该播放状态数据和目标透明区域生成第一图形的内容,将所生产的第一图形的内容传输给第一图形服务模块1026,触发第一图形服务模块1026生成第一图形,以在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放。
在本申请的一种优选实施例中,浏览器内核1022还可以包括如下子模块:
状态数据提取子模块102213,用于从所述状态处理结果中提取播放状态数据。
第一图形内容生成子模块102215,用于采用所述播放状态数据和目标透明区域生成第一图形的内容。
可选的,该浏览器内核1022还包括:区域确定子模块102217、显示区域确定子模块102219和目标透明设置子模块102221。
区域确定子模块102217,用于采用所述句柄确定所述第二图形在第一图形上对应的显示位置和显示区域大小。
显示区域确定子模块102219,用于基于所述显示位置和显示区域大小,确定第二图形在第一图形上的显示区域。
目标透明设置子模块102221,用于将所述显示区域设置为目标透明区域。
显示区域可以包括:目标播放器播放窗口。具体的,浏览器内核可以通过区域确定子模块102217,采用第二图形对应的句柄确定第二图形在第一图形上对应的显示位置和显示区域大小;调用显示区域确定子模块102219,确定第二图形在第一图形上的显示区域,如确定目标播放器播放窗口在网页页面中的显示位置以及播放窗口的大小;通过目标透明设置子模块102221将显示区域设置为目标透明区域,从而使得第一图形服务模块1026可以将第二图形合并到第一图形中,进而可以在目标透明区域展现第二图形,即在目标播放器播放窗口对媒体数据进行播放。
可选的,浏览器内核1022还可以包括:播放模式进入子模块102223和句柄获取子模块102225。其中,播放模式进入子模块102223,用于在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式。句柄获取子模块102225,用于在所述媒体播放模式下,获取第一图形服务模块所接收到的第二图形对应的句柄。
基于上述智能终端,进一步论述基于智能终端的媒体数据播放方法,如图9所示,具体可以包括如下步骤:
步骤902,第一操作***的浏览器内核基于用户操作生成的播放请求,所述播放请求包含所述媒体数据的源信息。
在本申请实施中,用户可以通过智能终端选择其想要播放的媒体。作为本申请的一个具体示例,用户可以通过安装在智能终端的第一操作***上的浏览器,选择其想要观看的视频,如通过点击操作选中其所需要播放的视频,相当于访问一个含有视频的Html5的网页。第一操作***的浏览器可以基于用户操作如用户所提交的点击操作,获取用户操作对应的数据源信息,如获取用户操作对应的URL,将URL作为数据源信息,基于所获取的数据源信息生成操作请求。其中,URL包含模式(或称协议)、服务器名称(或IP地址)、路径和文件名等信息,如URL的数据格式可以是“协议://用户名:密码@子域名.域名.顶级域名:端口号/目录/文件名.文件后缀?参数=值#标志”。当数据源信息包含了媒体标签时,如所获取到的URL包含了媒体对应的文件后缀信息,浏览器内核可以将该操作请求确定为播放请求,将播放请求中的数据源信息作为为媒体数据的源信息。媒体数据对应的源信息可以包含媒体标签如视频标签video tag、文件名信息、传输协议等信息。
步骤904,浏览器内核依据所述播放请求检测媒体数据的源信息。
当操作请求为播放请求时,浏览器内核需要对该播放请求中的源信息进行检测,以响应该播放请求。具体的,浏览器内核需要按照媒体数据对应的媒体数据格式对该媒体数据进行解析,以生成该媒体数据对应的播放数据,从而可以依据播放数据对该媒体数据进行播放控制,即响应用户操作对应的播放请求。浏览器内核可以从源信息中提取所述媒体数据对应的媒体标签,基于该媒体标签确定媒体数据对应的媒体数据格式,从而可以判定媒体数据是否符合预置的数据格式,即判断第一操作***是否可以处理该媒体数据。
在本申请的一个优选实施例中,第一操作***依据所述播放请求检测媒体数据的源信息,可以包括如下子步骤:
子步骤9041,浏览器内核从源信息中提取所述媒体数据对应的媒体标 签。
作为本申请的一个具体示例,浏览器内核可以从媒体数据的源信息中提取媒体标签,采用该媒体标签确定该媒体数据对应的媒体数据格式,以确定第一操***是否支持该媒体数据对应的媒体数据格式。例如,浏览器内核从用户所访问的网页的URL中提取video tag,相当于从媒体数据的源信息中提取video tag,从而可以基于video tag的数据源data-from属性确定媒体数据对应的媒体数据格式。
子步骤9043,基于所述媒体标签判断所述媒体数据是否符合预置的数据格式。
在本申请实施例中,智能终端的第一操作***预置了其所支持的数据格式,即预先设置了其可以处理的数据对应的数据格式。作为本申请的一个具体示例,主操作***预先设置了主操作***的播放器Host OS player所支持的媒体数据格式,如预置了Host OS player所支持的媒体数据格式,如Flash Video格式(简称flv格式)。浏览器内核可以基于媒体标签确定媒体数据对应的媒体数据格式,从而可以判断该媒体数据是否符合预置的数据格式。具体的,当媒体数据对应的媒体数据格式为预置的数据格式时,可以判定该媒体数据符合预置的数据格式,如在媒体数据对应的媒体数据格式为flv格式时,可以判定该媒体数据符合Host OS player所支持的媒体数据格式,即可以采用Host OS player对该媒体数据进行处理;当媒体数据对应的媒体数据格式不是预置的数据格式时,可以判定该媒体数据不符合预置的数据格式,如在媒体数据对应的媒体数据格式为qsv格式时,可以判定该媒体数据不符合Host OS player所支持的媒体数据格式,即不可以采用Host OS player对该媒体数据进行处理。其中,qsv格式为第三方所研发的是所研发的一种视频文件格式,可以采用客操作***的播放器Guest OS Player对qsv格式对应的视频数据进行处理。
子步骤9045,在所述媒体数据不符合预置的数据格式时,确定第一操作***无法处理所述媒体数据。
在本申请实施例中,浏览器内核在媒体数据不符合预置的数据格式时, 即可以确定第一操作***无法处理该媒体数据,相当于Host OS player不能该媒体数据进行解码处理,可以调用Guest OS Player对该媒体数据进行解码。
步骤906,浏览器内核向所述第一操作***的网桥服务模块发送所述媒体数据对应的参数信息。
本实施例中,第一操作***在检测到无法处理所述媒体数据时,执行向第二操作***发送媒体处理请求的步骤。具体的,当浏览器内核确定第一操作***无法处理该媒体数据时,可以通过网桥服务模块连接第二操作***,触发第二操作***对该媒体数据进行处理,从而获取第二操作***针对该媒体数据的处理结果。具体而言,浏览器内核可以通过***接口获取第一操作***的控件标志符,如第一操作***的ClientId,将获取到的媒体数据的源信息和第一操作***的控件标志符作为参数信息,并将参数信息传输给网桥服务模块,触发网桥服务模块向第二操作***发送媒体处理请求。该媒体处理请求与媒体数据处理有关,可以包含了媒体数据的源信息、应用包名等信息。其中,该应用包名可以依据了媒体数据的源信息确定,用于确定处理该媒体数据的媒体应用。
可选的,所述浏览器内核在向网桥服务模块发送所述媒体数据对应的参数信息之前,还包括:通过***接口获取第一操作***的控件标志符;将所述控件标志符和源信息作为所述参数信息。
作为本申请的一个具体示例,浏览器内核WebEngine可以通过Weston所提供的接口获取第一操作***的ClientId,将获取到的ClientId和媒体数据的URL作为参数信息,向网桥服务模块MediaBridgeService发送。其中,第一操作***和第二操作***可以通过该ClientId建立socket连接,以进行通信。
步骤908,网桥服务模块在接收到所述参数信息后,依据所述参数信息生成媒体处理请求,调用通信接口向所述第二操作***发送媒体处理请求。
网桥服务模块在接收到浏览器内核所发送的参数信息后,可以基于参 数信息生成媒体处理请求,向第二操作***发送该媒体处理请求,触发第二操作***启动应用包名对应的媒体应用,使得该媒体应用在启动后创建解码环境,对该媒体数据进行解码,以生成该媒体数据的处理结果。例如,网桥服务模块MediaBridgeService在接收到参数信息后,可以通过调用IPC接口,向第二操作***发送IPC消息,该IPC消息数据包括应用程序包名Application PackageName(简称应用包名)、URL、ClientId等信息,即相当于向第二操***发送媒体处理请求。
在本申请的一种优选实施例中,网桥服务模块依据所述参数信息生成媒体处理请求,可以包括如下子步骤:
子步骤9081,从所述参数信息中提取源信息,基于所述源信息确定应用包名,所述应用包名用于确定处理所述媒体数据的媒体应用。
在本申请实施例中,网桥服务模块可以依据预置的源信息标识符从参数信息中提取源信息标识符对应的源信息,基于所提取的源信息确定应用包名。该应用包名可以用于确定处理该媒体数据的媒体应用。例如,在媒体数据为视频数据时,应用包名可以具体用于启动第二操作***的视频应用。其中,该第二操作***的视频应用可以用于创建子图形Surface和基于第三方的SDK创建媒体播放器MediaPlayer。
子步骤9083,采用所述参数信息以及应用包名,生成所述媒体处理请求。
在本实施例中,网桥服务模块可以通过该浏览器内核所发送的参数信息以及所确定的应用包名生成媒体处理请求,通过调用通信接口,如IPC接口,向第二操作***发送该媒体处理请求,触发第二操作***依据该媒体处理请求启动应用名对应的媒体应用。
可选的,网桥服务模块调用通信接口向所述第二操作***发送媒体处理请求,可以包括如下子步骤:
子步骤9085,调用所述通信接口,基于所述控件标识符与第二操作***建立双向通信连接。
作为本申请的一个具体示例,网桥服务模块可以从参数信息同提取第一操作***的ClientId,以及通过调用IPC接口,依据第一操作***的ClientId与第二操作***建立双向通信连接,如网桥服务模块可以通过IPC接口,依据第一操作***的ClientId与第二操作***的媒体应用Application建立socket连接,从而可以基于该socket连接进行通信。
子步骤9087,基于所述双向通信连接向第二操作***发送所述媒体处理请求。
具体的,网桥服务模块基于双向通信连接,向第二操作***发送媒体处理请求,以触发第二操作***对该媒体数据进行处理。例如,在第二操作***的媒体应用Application还没有启动时,可以通过该媒体处理请求触发第二操作***启动应用包名对应的媒体应用Application,使得该媒体应用Application调用准备接口,如Application Prepare接口,进行播放准备工作。
步骤910,第二操作***基于所述媒体处理请求,启动所述应用包名对应的媒体应用。
第二操作***在接到网桥服务模块所发送的媒体数据请求后,可以从该媒体处理请求中提取应用包名,如按照预置的包名参数标识符从媒体处理请求中提取包名参数标识符对应的应用包名,从而可以确定处理该媒体数据的媒体应用。在本申请实施例中,第一操作***可以通过启动该应用包名对应的媒体应用,响应第一操作***所发送的媒体处理请求,即通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。具体的,媒体应用安装有SDK,第二操作***通过媒体应用调用SDK所提供的接口获取该SDK,通过SDK对该媒体数据进行解析,以生成该媒体数据的处理结果,如调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。下文结合具体的解码环境,对本申请实施例进行详细的论述。
步骤912,媒体应用依据所述源信息获取媒体处理请求对应的媒体数据。
在具体实现中,媒体应用在启动后,进入播放准备状态。作为本申请实施例的具体示例,视频应用在启动后,可以根据视频数据的源信息,如视频数据的URL,获取该媒体处理请求对应的视频数据,从而可以依据视频数据创建子图形Surface和基于第三方的SDK创建媒体播放器MediaPlayer,进入视频播放准备状态。
步骤914,媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。
在本申请实施中,应用媒体在进入播放准备状态后,可以通过调用媒体服务接口连接第二媒体服务模块,如多媒体服务器MediaServer,通过媒体服务模块对所获取到的媒体数据进行解码,即创建解码环境,从而可以生成解码后的数据帧。在生成数据帧后,第二媒体服务模块将所生成的数据帧传输到第二操作***的第二图形服务模块,如第二操作***的图形服务器SurfaceFlinger,通过该第二图形服务模块将解码后的数据帧合成图形,从而可以基于所合成的图形生成该媒体数据对应的处理结果,以在智能终端的显示界面上展现该图形
在本申请的一种优选实施例中,媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果,可以包括如下子步骤:
子步骤9141,媒体应用通过媒体接口向第二媒体服务模块发送所获取的媒体数据。
作为本申请的具体示例,媒体应用Application可以通过媒体接口如MediaServer接口,连接第二操作***的多媒体服务器MediaServer,将获取到的媒体数据发送给该多媒体服务器MediaServer,触发该多媒体服务器MediaServer对该媒体数据进行解码。
子步骤9143,所述第二媒体服务模块在接收到媒体数据后,对所述媒体数据进行解码,生成数据帧,将所生成的数据帧发送给第二图形服务模块。
在本申请实施例中,第二媒体服务模块在接收到媒体应用所发送的媒体数据后,可以对该媒体数据进行解码,如对视频数据或者音频数据进行解码,生成解码后的数据帧。当媒体播放器初始化完成后,即在开始播放媒体数据时,第二媒体服务模块将解码后的数据帧输送到第二操作***的第二图形服务模块如第二操作***的图形服务器SurfaceFlinger,以进行合成。例如,在播放视频数据的过程中,第二操作***的多媒体服务器MediaServer将解码后的数据帧传输到第二操作***的图形服务器SurfaceFlinger,触发第二操作***的图形服务器SurfaceFlinger对该数据帧进行合成,生成第二图形信息。
子步骤9145,第二图形服务模块在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,将所述第二图形信息作为图形处理结果。
具体的,第二图形服务模块在接收到数据帧后,可以在创建图形标签的时候,检测控件标志符对应的接口是否存在第一操***的控件标识符;若不存在,则按照第二操作***正常的创建流程,生成第二操作***的图形信息,以在第二操作***的媒体播放器播放媒体数据;若存在第一操作***的控件标识符,则以第一操作***的控件标识符为参数,通过***接口(如WaylandConnection接口)连接第一操***的第一图形服务模块。在连接第一操***的第一图形服务模块后,对解码后的数据帧进行合成,即生成第二图形信息,将第二图形信息作为图形处理结果,通过建立的连接将图形处理结果传送给第一图形服务模块。
在本申请的一种优选实施例中,第二图形服务模块在接收到数据帧后,还包括:对控件标志符对应的接口进行监听;在监听到第一操作***的控件标志符时,基于所述控件标志符连接第一操作***的第一图形服务模块。
作为本申请实施例的一个具体示例,第二图形服务模块可以对控件标志符对应的接口ClientId()进行监听,以检测ClientId()是否有值;如果ClientId()为空,则按照GuestOS正常原有的创建流程对数据帧进行处理,以在GuestOS播放媒体数据;如果ClientId()不为空,则以第一操作 ***的控件标志符ClientId为参数,通过WaylandConnection接口连接第一操作***的图形服务器WestonServer。
可选的,第二图形服务模块在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,包括:在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
具体的,第二图形服务模块在监听到第一操作***的控件标志符时,可以判定其所接收到的数据帧为针对第一操作***所发送的媒体处理请求所生成的数据帧,从而可以判定所述数据帧属于特殊编码方式。第二图形服务模块在确定数据属于特殊编码方式后,可以按照该特殊编码方式对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。其中,第二图形对应的句柄可以用于控制第二图形的显示区域大小和显示位置。例如,第二操作***的图形服务器SurfaceFlinger在检测到第一操作***的ClientId时,可以根据视图属性如视频视图属性VideoView判断所接收到的数据帧属于特殊编码方式,按照该特殊编码方式对所述数据帧进行合成,生成子图形SubSurface和该子图形SubSurface对应的句柄texture。句柄texture用于控制子图形SubSurface的显示区域大小Size和显示位置。
子步骤9147,媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息,将所生成的状态信息作为状态处理结果。
第二操作***的媒体应用在创建媒体播放器后,还可以通过SDK对媒体数据进行解析,依据媒体数据的解析生产媒体播放器的播放状态信息,如准备状态数据和播放状态数据等。其中,准备状态数据指的是媒体播放器在初始化阶段所生成的数据,如初始化开始的消息、初始化完成的消息等,可以用于表示媒体播放器当前的准备状态。播放状态数据指的是媒体播放器在播放媒体数据过程中的状态数据,如显示当前播放的进度、媒体播放时长等。媒体应用可以将媒体播放器的播放状态信息作为状态处理结果。
步骤916,第二操作***将图形处理结果和状态处理结果反馈给第一操***。
具体的,第二操作***可以通过媒体应用,将所述状态处理结果发送到网桥服务模块;以及通过第二图形服务模块,将所述图形处理结果发送到第一图形服务模块。作为本申请的一个具体示例,第二操作***的媒体应用Application可以通过IPC接口向第一操作***的网桥服务模块MediaBridgeService传送状态处理结果。此外,第二操作***的图形服务器SurfaceFlinger可以通过WaylandConnection接口,向第一操作***的的图形服务器WestonServer发送图形处理结果,相当于基于双向通信连接,向第一操作***发送图形处理结果,如通过wayland协议向第一操作***的第一图形服务模块传送子图形对应的句柄。
步骤918,第一操作***基于所述处理结果对所述媒体数据进行响应。
具体的,第一操作***可以通过网桥服务模块,接收到第二操作***所反馈的状态处理结果;还可以通过图形服务模块,接收第二操作***所反馈的图形处理结果。在接收播放状态出处理结果后,第一操作***可以通过浏览器内核对该状态处理结果进行检测,在检测到该状态处理结果包含准备准备状态数据时,依据该准备状态数据进入媒体播放模式。基于媒体播放模式,第一操作***通过浏览器内核获取第一图形服务模块所接收到的第二图形对应的句柄,通过该句柄在第一图形层成设置目标透明区域,采用目标透明区域以及网页页面其它内容生成第一图形的内容,即生成第一图形信息;通过调用第一图形服务模块将第一图形信息生产第一图形,将第二图形合并到第一图形的目标透明区域中,生成合成后的图形,从而可以在第一图形的目标显示区域展现第二图形,即对该媒体数据进行播放。
在本申请的一种优选实施例中,第一操作***基于所述处理结果对所述媒体数据进行播放,可以包括如下子步骤:
子步骤9181,网桥服务模块将接收到的状态处理结果转发给浏览器内核。
在本申请实施例中,网桥服务模块在接收到第二操作***所反馈的状态处理结果后,可以将接收到的状态处理结果转发给浏览器内核,触发浏览器内体对该状态处理结果进行检测,从而可以在第一操作***中对媒体数据进行播放。
子步骤9183,浏览器内核基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,依据所述句柄确定目标透明区域,基于所述目标透明区域生成第一图形的内容,将所述第一图形的内容发送到第一图形服务模块。
在本申请的一种优选实施例中,浏览器内核基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,具体可以包括:在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;在所述媒体播放模式下,获取第一图形服务模块所接收到的第二图形对应的句柄。
具体的,浏览器内核可以对接收到的状态处理结果进行检测,从状态处理结果中获取媒体应用针对该媒体数据所生成的状态数据。当提取到的状态数据为准备状态数据时,即在检测到状态处理结果包含准备状态数据时,可以确定第二操作***的媒体应用进入播放准备阶段,进而进入媒体播放模式,准备播放媒体数据。浏览器内核在媒体播放模拟式下,通过调用第一图形服务模块对应的接口,获取第一图形服务模块所接收到的句柄。例如,浏览器内核Webengine通过第一操作***的图形服务器模块WestonServer获取到子图形SubSurface的句柄texture。
在本申请实施例中,浏览器内核依据句柄确定第二图形对应的目标透明区域,具体可以包括:采用所述句柄确定所述第二图形在第一图形上对应的显示位置和显示区域大小;基于所述显示位置和显示区域大小,确定第二图形在第一图形上的显示区域;将所述显示区域设置为目标透明区域。
具体的,浏览器内核可以依据句柄确定第二图形在第一图形层上对应的显示区域大小,如第二图形对应的播放窗口的大小;以及确定第二图形 在第一图形层上的显示位置,如确定播放窗口在网页页面中的显示位置,依据所确定的显示区域大小和显示位置,确定一个矩形区域,将该矩形区域作为第二图形在第一图形上的显示区域,并且把该矩形区域设置为透明显示区域作为目标透明区域,即将第二图形在第一图形上的显示区域设置为目标透明区域,以将第二图形纺织到该目标透明区域中,实现在第一操作***中对第二图形进行展现,即在第一操作***中播放媒体数据。其中,显示区域可以包括:目标播放器播放窗口、网页播放窗口等,目标播播放器播放窗口指的是当前运行的播放器应用程序对应的播放窗口。
在本申请的一种优选实施例中,浏览器内核在基于所述目标透明区域生成第一图形的内容之前,还包括:从所述状态处理结果中提取播放状态数据;则所述基于所述目标透明区域生成第一图形的内容,包括:采用所述播放状态数据和目标透明区域生成第一图形的内容。
在本申请实施例中,浏览器内核对状态处理结果进行检测,在状态处理结果中包含媒体应用对应的播放状态数据时,还可以从该状态处理结果中提取播放状态数据,基于所提取播放状态数据、目标透明区域等信息生成第一图形的内容,将所生成的第一图形的内容发送到第一图形服务模块,通过第一图形服务模块对第一图形的内容进行合成,以生成第一图形。
子步骤9185,第一图形服务模块基于第一图形的内容生成第一图形,在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放。
第一图形服务模块在接收到第一图形的内容后,可以依据第一图形的内容生产第一图形,并且将第二图形服务模块所发送的第二图形合并到第一图形的目标透明区域中,生成合成后的图形,从而可以在第一图形的目标显示区域展现第二图形。智能终端的第一操作***通过在显示界面对合成后的图形进行展现,播放媒体数据,实现了智能终端的媒体播放功能。
在本申请实施例中,智能终端的第一操作***在检测到无法处理媒体数据时,通过网桥服务模块连接第二操作***,从而触发第二操作***启动媒体应用对该媒体数据进行处理,生成处理结果,从而可以基于第二操作***所生成的处理结果对媒体数据进行播放,实现智能终端的媒体播放 功能。
实施例二
基于上述实施例,本实施例论述位于操作***侧的媒体数据播放方法和装置。
参照图10,示出了本申请实施例中基于第一操作***的媒体数据播放方法,具体可以包括以下步骤:
步骤1002,基于用户操作生成播放请求。
步骤1004,在所述媒体数据不符合预置的数据格式时,向第二操作***发送媒体处理请求。
步骤1006,接收所述第二操作***针对所述媒体处理请求反馈的处理结果,基于所述处理结果对所述媒体数据进行响应。
本实施例中,位于第一操作***的媒体数据播放装置可以接收到用户操作,以及基于用户操作生成播放请求。其中,在所述播放请求包含媒体数据的源信息。具体的,通过检测该媒体数据的源信息,可以确定该媒体数据是否符合预置的数据格式,即判断第一操作***是否可以对该媒体数据进行解析。当媒体数据不符合预置的数据格式时,该媒体数据播放装置可以针对该媒体数据生成媒体处理请求,并发送给第二操作***,从而可以接收到第二操作***针对所述媒体处理请求反馈的处理结果,基于该处理结果对媒体数据进行响应,即通过第二操作***对该媒体数据进行解析,实现了对媒体数据的解析,从而可以对该媒体数据进行播放控制,实现媒体播放功能。
在本申请的一种优选实施例中,该媒体数据播放方法,在生成播放请求之后还包括判断所述媒体数据是否符合预置的数据格式的步骤,包括:从所述源信息中提取所述媒体数据对应的媒体标签;基于所述媒体标签判断所述媒体数据是否符合预置的数据格式。
具体而言,播放请求模块可以对媒体数据的源信息进行检测,从源信 息中提取所述媒体数据对应的媒体标签,从而可以基于该媒体标签确定该媒体数据对应的数据格式,以及判断该媒体数据对应的数据格式是否符合预置的数据格式。当媒体数据对应的数据格式不符合预置的数据格式时,可以确定该媒体数据不符合预置的数据格式,即确定第一操作***无法对该媒体数据进行解析。因此,媒体数据播放装置可以针对该媒体数据生成媒体处理请求,并发送给第二操作***,通过第二操作***对该媒体数据进行解析,从而完成该媒体数据的处理。
可选的,所述向第二操作***发送媒体请求,具体可以包括以下子步骤:
子步骤10041,调用通信接口,基于所述控件标识符与第二操作***建立双向通信连接。
子步骤10043,基于所述双向通信连接向第二操作***发送所述媒体处理请求。
本实施例中,媒体数据播放装置通过调用通信接口,从而可以连接第二操作***。具体的,通过通信接口将第一操作***的控件标识符传输给第二操作***,从而可以基于所述控件标识符建立第一操作***与第二操作***之间的双向通信连接,以及基于所述双向通信连接向第二操作***发送所述媒体处理请求;并且还可以基于该双向通行连接接收第二操作***反馈的处理结果。
在本申请的一种优选实施例中,第二操作***反馈的处理结果包括:状态处理结果和图像处理结果。其中,所述基于所述处理结果对所述媒体数据进行响应,可以包括如下子步骤:
子步骤10061,基于状态处理结果,从图像处理结果中获取第二图形对应的句柄。
子步骤10063,依据所述句柄确定目标透明区域,并基于所述目标透明区域生成第一图形的内容;
子步骤10065,基于第一图形的内容生成第一图形;
子步骤10066,在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
本实施例中,媒体数据播放装置可以基于状态处理结果,从图像处理结果中获取第二图形对应的句柄,以及依据所述句柄确定目标透明区域,并基于所述目标透明区域生成第一图形的内容;以及基于第一图形的内容生成第一图形,从而可以在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
可选的,所述基于状态处理结果,从图像处理结果中获取第二图形对应的句柄,具体可以包括:在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;在所述媒体播放模式下,从图像处理结果中获取第二图形对应的句柄。具体而言,位于第一操作***中的媒体数据播放装置在接收到状态处理结果后,可以对状态处理结果进行检测,当检测到状态处理结果包含准备状态数据时,可以确定第二操作***已经创建解码环境并完成初始化,进而基于所述准备状态数据进入媒体播放模式,以及在媒体播放模式下,从图像处理结果中获取第二图形对应的句柄,从而可以依据该句柄确定媒体数据对应的显示区域。
可选的,该媒体数据播放装置在基于所述目标透明区域生成第一图形的内容之前,还可以从所述状态处理结果中提取播放状态数据,从而可以采用所述播放状态数据和目标透明区域生成第一图形的内容。在本实施例中,媒体数据播放装置可以位于操作***中,具体可以位于上述任一实施例中的第一操作***中。
参照图11,示出了本申请实施例的一种媒体数据播放装置的结构框图,具体可以包括如下模块:
播放请求模块1102,用于基于用户操作生成播放请求,所述播放请求包含媒体数据的源信息;
处理请求模块1104,用于在所述媒体数据不符合预置的数据格式时,向第二操作***发送媒体处理请求
媒体响应模块1106,用于基于第二操作***针对所述媒体处理请求反馈的处理结果对所述媒体数据进行响应。
在本申请的一种优选实施例中,所述媒体数据播放装置,还可以包括如下模块:
标签提取模块1108,用于从所述源信息中提取所述媒体数据对应的媒体标签。
媒体判断模块1110,用于基于所述媒体标签判断所述媒体数据是否符合预置的数据格式。
标志符获取模块1112,用于通过***接口获取第一操作***的控件标志符。
参数信息确定模块1114,用于将所述控件标志符和源信息作为所述媒体数据对应的参数信息。
其中,处理请求模块1104,用于依据所述媒体数据对应的参数信息生成媒体处理请求,以及向第二操作***发送媒体请求。
在本申请的一种优选实施例中,所述处理请求模块1104,可以包括如下子模块:
通信建立子模块11041,用于调用通信接口,基于所述控件标识符与第二操作***建立双向通信连接。
处理请求发送子模块11043,用于基于所述双向通信连接向第二操作***发送所述媒体处理请求。
本实施例中,第二操作***反馈的处理结果可以包括:状态处理结果和图像处理结果。媒体响应模块1106,可以包括如下子模块:
句柄获取子模块11061,用于基于状态处理结果,从图像处理结果中获取第二图形对应的句柄。
内容生成子模块11063,用于依据所述句柄确定目标透明区域,并基 于所述目标透明区域生成第一图形的内容。
图形生成子模块11065,用于基于第一图形的内容生成第一图形。
响应子模块11067,用于在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
可选的,所述句柄获取子模块11061,具体可以用于在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;以及,在所述媒体播放模式下,从图像处理结果中获取第二图形对应的句柄。
可选的,所述媒体响应模块1106,还可以包括:状态数据提取子模块11069,用于从所述状态处理结果中提取播放状态数据。内容生成子模块11065,具体可以用于采用所述播放状态数据和目标透明区域生成第一图形的内容。
参照图12,示出了本申请实施例中基于第二操作***的媒体数据播放方法,具体可以包括以下步骤:
步骤1202,接收第一操作***发送的媒体处理请求。
步骤1204,依据所述媒体处理请求对媒体数据进行处理,生成处理结果。
步骤1206,将所述处理结果反馈给第一操作***。
从而使得第一操作***可以基于处理结果对媒体数据进行播放控制,满足用户的播放需求,提高用户体检。
在本申请的一种优选实施例中,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,可以包括如下子步骤:
子步骤12031,用于基于所述媒体处理请求,启动应用包名对应的媒体应用。其中,所述应用包名依据媒体处理请求所携带媒体数据的源信息确定。
子步骤12033,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
可选的,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果,具体可以包括:依据所述媒体处理请求携带的源信息获取对应的媒体数据;对所述媒体数据进行解码,生成数据帧;对所述数据帧进行合成,生成第二图形信息,并将所述第二图形信息作为图形处理结果。
在本申请的一种优选实施例中,所述生成所述媒体数据对应的处理结果,还包括:对控件标志符对应的接口进行监听。其中,所述对所述数据帧进行合成,生成第二图形信息,包括:在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
在本申请的一种优选实施例中,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果,还可以包括:媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息;将所生成的播放状态信息作为状态处理结果。
可选的,所述将所述处理结果反馈给第一操作***,包括:基于所述双向通信连接,分别将状态处理结果图形和处理结果发送给第一操作***。
参照图13,示出了本实施例的另一种媒体数据播放装置的结构框图,具体可以包括以下模块:
接收模块1302,用于接收第一操作***发送的媒体处理请求;
媒体处理模块1304,用于依据所述媒体处理请求对媒体数据进行处理,生成处理结果;
反馈模块1306,用于将所述处理结果反馈给第一操作***
在本实施例的媒体数据播放装置也可以位操作***,具体可以位于上 述任一实施例中的第二操作***中。
可选的,所述媒体处理模块1304,包括以下子模块:
应用启动子模块13041,用于基于所述媒体处理请求,启动应用包名对应的媒体应用。其中,所述应用包名依据媒体处理请求所携带媒体数据的源信息确定。
结果生成子模块13042,用于通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
可选的,所述结果生成子模块13042,可以包括以下单元:
媒体数据获取单元,用于依据所述媒体处理请求携带的源信息获取对应的媒体数据。
媒体数据解码单元,用于对所述媒体数据进行解码,生成数据帧。
图形结果生成单元,用于对所述数据帧进行合成,生成第二图形信息,并将所述第二图形信息作为图形处理结果。
在本申请的一种优选实施例中,结果生成子模块13042,还可以包括以下单元:
监听子单元,用于对控件标志符对应的接口进行监听。
编码判定单元,用于在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式。
其中,数据帧合成单元,具体用于对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
媒体数据解析单元,用于媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息;
状态结果生成单元,用于将所生成的播放状态信息作为状态处理结果。
在本申请的一种优选实施例中,所述反馈模块1306,具体用于基于所述双向通信连接,将状态处理结果和图形处理结果发送给第一操作***。
需要说明的是,对于方法实施例,为了简单描述,故将其都表述为一系列的动作组合,但是本领域技术人员应该知悉,本申请实施例并不受所描述的动作顺序的限制,因为依据本申请实施例,某些步骤可以采用其他顺序或者同时进行。其次,本领域技术人员也应该知悉,说明书中所描述的实施例均属于优选实施例,所涉及的动作并不一定是本申请实施例所必须的。
在上述实施例的基础上,本实施例还公开了一种智能终端。
参照图14,示出了本申请实施例的又一种智能终端的结构框图。具体的,该智能终端1400包括:存储器1410、显示器1420、处理器1430和输入单元1440。
其中,该输入单元1440可用于接收用户输入的数字或字符信息,以及控制信号。具体地,本申请实施例中,该输入单元1440可以包括触摸屏1441,可收集用户在其上或附近的触摸操作(比如用户使用手指、触笔等任何适合的物体或附件在触摸屏1441上的操作),并根据预先设定的程式驱动相应的连接装置。当然,除了触摸屏1441,输入单元1440还可以包括其他输入设备,如物理键盘、功能键(比如音量控制按键、开关按键等)、鼠标等。
显示器1420包括显示面板,可选的,可以采用液晶显示器(Liquid Crystal Display,LCD)或有机发光二极管(Organic Light-Emitting Diode,OLED)等形式来配置显示面板。其中,触摸屏可以覆盖显示面板,形成触摸显示屏,当该触摸显示屏检测到在其上或附近的触摸操作后,传送给处理器1430以执行相应的处理。
在本申请实施例中,通过调用存储该存储器1410内的软件程序,和/或,模块,和/或,数据,处理器1430用于第一操作***通过调用通信接口向所述第二操作***发送媒体处理请求;第二操作***接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将 所述处理结果反馈给第一操作***;第一操作***接收到所述处理结果,基于所述处理结果对所述媒体数据进行响应。
可选的,处理器1430还用于第一操作***的浏览器内核基于用户操作生成的播放请求,所述播放请求包含所述媒体数据的源信息;以及第一操作***依据所述播放请求检测媒体数据的源信息,当第一操作***检测到无法处理所述媒体数据时,执行向第二操作***发送媒体处理请求的步骤。
可选的,所述源信息包括媒体标签,第一操作***依据所述播放请求检测媒体数据的源信息,包括:所述浏览器内核从源信息中提取所述媒体数据对应的媒体标签;基于所述媒体标签判断所述媒体数据是否符合预置的数据格式;在所述媒体数据不符合预置的数据格式时,确定第一操作***无法处理所述媒体数据。
可选的,所述第一操作***通过通信接口向所述第二操作***发送媒体处理请求,包括:浏览器内核向所述第一操作***的网桥服务模块发送所述媒体数据对应的参数信息;网桥服务模块在接收到所述参数信息后,依据所述参数信息生成媒体处理请求,调用通信接口向所述第二操作***发送媒体处理请求。
可选的,所述浏览器内核在向网桥服务模块发送所述媒体数据对应的参数信息之前,还包括:通过***接口获取第一操作***的控件标志符;将所述控件标志符和源信息作为所述参数信息。
可选的,网桥服务模块依据所述参数信息生成媒体处理请求,包括:从所述参数信息中提取源信息,基于所述源信息确定应用包名,所述应用包名用于确定处理所述媒体数据的媒体应用;采用所述参数信息以及应用包名,生成所述媒体处理请求。
可选的,网桥服务模块调用通信接口向所述第二操作***发送媒体处理请求,包括:调用所述通信接口,基于所述控件标识符与第二操作***建立双向通信连接;基于所述双向通信连接向第二操作***发送所述媒体处理请求。
可选的,第二操作***依据所述媒体处理请求对媒体数据进行处理,生成处理结果,包括:基于所述媒体处理请求,启动所述应用包名对应的媒体应用;通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
可选的,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果,包括:媒体应用依据所述源信息获取媒体处理请求对应的媒体数据;媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。
可选的,媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果,包括:媒体应用通过媒体接口向第二媒体服务模块发送所获取的媒体数据;所述第二媒体服务模块在接收到媒体数据后,对所述媒体数据进行解码,生成数据帧,将所生成的数据帧发送给第二图形服务模块;第二图形服务模块在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,将所述第二图形信息作为图形处理结果。
可选的,第二图形服务模块在接收到数据帧后,还包括:对控件标志符对应的接口进行监听;在监听到第一操作***的控件标志符时,基于所述控件标志符连接第一操作***的第一图形服务模块。
可选的,所述第二图形服务模块在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,包括:在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
可选的,媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果,还包括:所述媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息,将所生成的播放状态信息作为状态处理结果。
可选的,第二操作***将所述处理结果反馈给第一操作***,包括:媒体应用将所述状态处理结果发送到网桥服务模块;第二图形服务模块将所述图形处理结果发送到第一图形服务模块。
可选的,第一操作***基于所述处理结果对所述媒体数据进行响应,包括:网桥服务模块将接收到的状态处理结果转发给浏览器内核;浏览器内核基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,依据所述句柄确定目标透明区域,基于所述目标透明区域生成第一图形的内容,将所述第一图形的内容发送到第一图形服务模块;第一图形服务模块基于第一图形的内容生成第一图形,在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
可选的,所述浏览器内核基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,包括:在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;在所述媒体播放模式下,获取第一图形服务模块所接收到的第二图形对应的句柄。
可选的,浏览器内核在基于所述目标透明区域生成第一图形的内容之前,还包括:从所述状态处理结果中提取播放状态数据;则所述基于所述目标透明区域生成第一图形的内容,包括:采用所述播放状态数据和目标透明区域生成第一图形的内容。
可选的,浏览器内核依据所述句柄确定第二图形对应的目标透明区域,包括:采用所述句柄确定所述第二图形在第一图形上对应的显示位置和显示区域大小;基于所述显示位置和显示区域大小,确定第二图形在第一图形上的显示区域;将所述显示区域设置为目标透明区域。
可选的,所述显示区域包括:目标播放器播放窗口。
对于装置实施例而言,由于其与方法实施例基本相似,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。
本说明书中的各个实施例均采用递进的方式描述,每个实施例重点说明的都是与其他实施例的不同之处,各个实施例之间相同相似的部分互相参见即可。
本领域内的技术人员应明白,本申请实施例的实施例可提供为方法、装置、或计算机程序产品。因此,本申请实施例可采用完全硬件实施例、 完全软件实施例、或结合软件和硬件方面的实施例的形式。而且,本申请实施例可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。
本申请实施例是参照根据本申请实施例的方法、终端设备(***)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理终端设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理终端设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理终端设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。
这些计算机程序指令也可装载到计算机或其他可编程数据处理终端设备上,使得在计算机或其他可编程终端设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程终端设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。
尽管已描述了本申请实施例的优选实施例,但本领域内的技术人员一旦得知了基本创造性概念,则可对这些实施例做出另外的变更和修改。所以,所附权利要求意欲解释为包括优选实施例以及落入本申请实施例范围的所有变更和修改。
最后,还需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而 且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者终端设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者终端设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括所述要素的过程、方法、物品或者终端设备中还存在另外的相同要素。
以上对本申请所提供的一种媒体数据播放方法和装置、基于智能终端的媒体数据播放方法和一种智能终端,进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。

Claims (65)

  1. 一种基于智能终端的媒体数据播放方法,其特征在于,所述方法包括:
    第一操作***通过调用通信接口向所述第二操作***发送媒体处理请求;
    第二操作***接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***;
    第一操作***接收到所述处理结果,基于所述处理结果对所述媒体数据进行响应。
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:
    所述第一操作***的浏览器内核基于用户操作生成的播放请求,所述播放请求包含所述媒体数据的源信息;
    第一操作***依据所述播放请求检测媒体数据的源信息;
    当第一操作***检测到无法处理所述媒体数据时,执行向第二操作***发送媒体处理请求的步骤。
  3. 根据权利要求2所述的方法,其特征在于,所述源信息包括媒体标签,第一操作***依据所述播放请求检测媒体数据的源信息,包括:
    所述浏览器内核从源信息中提取所述媒体数据对应的媒体标签;
    基于所述媒体标签判断所述媒体数据是否符合预置的数据格式;
    在所述媒体数据不符合预置的数据格式时,确定第一操作***无法处理所述媒体数据。
  4. 根据权利要求3所述的方法,其特征在于,所述第一操作***通过通信接口向所述第二操作***发送媒体处理请求,包括:
    浏览器内核向所述第一操作***的网桥服务模块发送所述媒体数据 对应的参数信息;
    网桥服务模块在接收到所述参数信息后,依据所述参数信息生成媒体处理请求,调用通信接口向所述第二操作***发送媒体处理请求。
  5. 根据权利要求4所述的方法,其特征在于,所述浏览器内核在向网桥服务模块发送所述媒体数据对应的参数信息之前,还包括:
    通过***接口获取第一操作***的控件标志符;
    将所述控件标志符和源信息作为所述参数信息。
  6. 根据权利要求5所述的方法,其特征在于,网桥服务模块依据所述参数信息生成媒体处理请求,包括:
    从所述参数信息中提取源信息,基于所述源信息确定应用包名,所述应用包名用于确定处理所述媒体数据的媒体应用;
    采用所述参数信息以及应用包名,生成所述媒体处理请求。
  7. 根据权利要求5所述的方法,其特征在于,网桥服务模块调用通信接口向所述第二操作***发送媒体处理请求,包括:
    调用所述通信接口,基于所述控件标识符与第二操作***建立双向通信连接;
    基于所述双向通信连接向第二操作***发送所述媒体处理请求。
  8. 根据权利要求7所述的方法,其特征在于,第二操作***依据所述媒体处理请求对媒体数据进行处理,生成处理结果,包括:
    基于所述媒体处理请求,启动所述应用包名对应的媒体应用;
    通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
  9. 根据权利要求8所述的方法,其特征在于,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果,包括:
    媒体应用依据所述源信息获取媒体处理请求对应的媒体数据;
    媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。
  10. 根据权利要求9所述的方法,其特征在于,媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果,包括:
    媒体应用通过媒体接口向第二媒体服务模块发送所获取的媒体数据;
    所述第二媒体服务模块在接收到媒体数据后,对所述媒体数据进行解码,生成数据帧,将所生成的数据帧发送给第二图形服务模块;
    第二图形服务模块在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,将所述第二图形信息作为图形处理结果。
  11. 根据权利要求10所述的方法,其特征在于,第二图形服务模块在接收到数据帧后,还包括:
    对控件标志符对应的接口进行监听;
    在监听到第一操作***的控件标志符时,基于所述控件标志符连接第一操作***的第一图形服务模块。
  12. 根据权利要求11所述的方法,其特征在于,所述第二图形服务模块在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,包括:
    在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;
    对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
  13. 根据权利要求10至12任一所述的方法,其特征在于,媒体应用调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果,还包括:
    所述媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息,将所生成的播放状态信息作为状态处理结果。
  14. 根据权利要求13所述的方法,其特征在于,第二操作***将所述处理结果反馈给第一操作***,包括:
    媒体应用将所述状态处理结果发送到网桥服务模块;
    第二图形服务模块将所述图形处理结果发送到第一图形服务模块。
  15. 根据权利要求14所述的方法,其特征在于,第一操作***基于所述处理结果对所述媒体数据进行响应,包括:
    网桥服务模块将接收到的状态处理结果转发给浏览器内核;
    浏览器内核基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,依据所述句柄确定目标透明区域,基于所述目标透明区域生成第一图形的内容,将所述第一图形的内容发送到第一图形服务模块;
    第一图形服务模块基于第一图形的内容生成第一图形,在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
  16. 根据权利要求15所述的方法,其特征在于,所述浏览器内核基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,包括:
    在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;
    在所述媒体播放模式下,获取第一图形服务模块所接收到的第二图形对应的句柄。
  17. 根据权利要求16所述的方法,其特征在于,浏览器内核在基于所述目标透明区域生成第一图形的内容之前,还包括:
    从所述状态处理结果中提取播放状态数据;
    则所述基于所述目标透明区域生成第一图形的内容,包括:
    采用所述播放状态数据和目标透明区域生成第一图形的内容。
  18. 根据权利要求16所述的方法,其特征在于,浏览器内核依据所述句柄确定第二图形对应的目标透明区域,包括:
    采用所述句柄确定所述第二图形在第一图形上对应的显示位置和显示区域大小;
    基于所述显示位置和显示区域大小,确定第二图形在第一图形上的显示区域;
    将所述显示区域设置为目标透明区域。
  19. 根据权利要求18所述的方法,其特征在于,所述显示区域包括:目标播放器播放窗口。
  20. 一种媒体数据播放方法,其特征在于,包括:
    基于用户操作生成播放请求,所述播放请求包含媒体数据的源信息;
    在所述媒体数据不符合预置的数据格式时,向第二操作***发送媒体处理请求;
    基于所述第二操作***针对所述媒体处理请求反馈的处理结果对所述媒体数据进行响应。
  21. 根据权利要求20所述的方法,其特征在于,在生成播放请求之后还包括判断所述媒体数据是否符合预置的数据格式的步骤,包括:
    从所述源信息中提取所述媒体数据对应的媒体标签;
    基于所述媒体标签判断所述媒体数据是否符合预置的数据格式。
  22. 根据权利要求20所述的方法,其特征在于,在向第二操作***发送媒体处理请求之前,还包括:
    通过***接口获取第一操作***的控件标志符;
    将所述控件标志符和源信息作为所述媒体数据对应的参数信息;
    依据所述媒体数据对应的参数信息生成媒体处理请求。
  23. 根据权利要求22所述的方法,其特征在于,所述向第二操作***发送媒体请求,包括:
    调用通信接口,基于所述控件标识符与第二操作***建立双向通信连接;
    基于所述双向通信连接向第二操作***发送所述媒体处理请求。
  24. 根据权利要求23所述的方法,其特征在于,所述处理结果包括:状态处理结果和图像处理结果;
    其中,所述基于所述处理结果对所述媒体数据进行响应,包括:
    基于状态处理结果,从图像处理结果中获取第二图形对应的句柄;
    依据所述句柄确定目标透明区域,并基于所述目标透明区域生成第一图形的内容;
    基于第一图形的内容生成第一图形;
    在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
  25. 根据权利要求24所述的方法,其特征在于,所述基于状态处理结果,从图像处理结果中获取第二图形对应的句柄,包括:
    在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;
    在所述媒体播放模式下,从图像处理结果中获取第二图形对应的句柄。
  26. 根据权利要求25所述的方法,其特征在于,在基于所述目标透明区域生成第一图形的内容之前,还包括:从所述状态处理结果中提取播 放状态数据;
    其中,所述基于所述目标透明区域生成第一图形的内容,包括:采用所述播放状态数据和目标透明区域生成第一图形的内容。
  27. 一种媒体数据播放方法,其特征在于,包括:
    接收第一操作***发送的媒体处理请求;
    依据所述媒体处理请求对媒体数据进行处理,生成处理结果;
    将所述处理结果反馈给第一操作***。
  28. 根据权利要求27所述的方法,其特征在于,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,包括:
    基于所述媒体处理请求,启动应用包名对应的媒体应用,其中所述应用包名依据媒体处理请求所携带媒体数据的源信息确定;
    通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
  29. 根据权利要求28所述的方法,其特征在于,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果,包括:
    依据所述媒体处理请求携带的源信息获取对应的媒体数据;
    对所述媒体数据进行解码,生成数据帧;
    对所述数据帧进行合成,生成第二图形信息,并将所述第二图形信息作为图形处理结果。
  30. 根据权利要求29所述的方法,其特征在于,所述生成所述媒体数据对应的处理结果,还包括:对控件标志符对应的接口进行监听;
    其中,所述对所述数据帧进行合成,生成第二图形信息,包括:在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
  31. 根据权利要求30所述的方法,其特征在于,通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果,还包括:
    媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息;
    将所生成的播放状态信息作为状态处理结果。
  32. 根据权利要求31所述的方法,其特征在于,所述将所述处理结果反馈给第一操作***,包括:
    基于所述双向通信连接,将状态处理结果和图形处理结果发送给第一操作***。
  33. 一种智能终端,其特征在于,所述智能终端包括:第一操作***和第二操作***;其中,
    所述第一操作***,用于通过调用通信接口向所述第二操作***发送媒体处理请求,以及用于接收到所述第二操作***所反馈的处理结果,基于所述处理结果对所述媒体数据进行响应;
    所述第二操作***,用于接收到媒体处理请求后,依据所述媒体处理请求对媒体数据进行处理,生成处理结果,将所述处理结果反馈给第一操作***。
  34. 根据权利要求33所述的智能终端,其特征在于,所述第一操作***包括浏览器内核;
    其中,所述浏览器内核,用于基于用户操作生成的播放请求,所述播放请求包含所述媒体数据的源信息;以及用于依据所述播放请求检测媒体数据的源信息。
  35. 根据权利要求34所述的智能终端,其特征在于,所述源信息包括媒体标签,所浏览器内核,包括:
    媒体标签提取子模块,用于所述浏览器内核从源信息中提取所述媒体数据对应的媒体标签;
    判断子模块,用于基于所述媒体标签判断所述媒体数据是否符合预置的数据格式;
    确定子模块,用于在所述媒体数据不符合预置的数据格式时,确定第一操作***无法处理所述媒体数据。
  36. 根据权利要求35所述的智能终端,其特征在于,所述第一操作***还包括:网桥服务模块;
    则浏览器内核还包括:参数信息发送子模块,用于向所述网桥服务模块发送所述媒体数据对应的参数信息;
    所述网桥服务模块,用于在接收到所述参数信息后,依据所述参数信息生成媒体处理请求,调用通信接口向所述第二操作***发送媒体处理请求。
  37. 根据权利要求36所述的智能终端,其特征在于,所述浏览器内核,还包括:
    标志符获取子模块,用于通过***接口获取第一操作***的控件标志符;
    参数信息确定子模块,用于将所述控件标志符和源信息作为所述参数信息。
  38. 根据权利要求37所述的智能终端,其特征在于,所述网桥服务模块,包括:
    应用包名确定子模块,用于从所述参数信息中提取源信息,基于所述源信息确定应用包名,所述应用包名用于确定处理所述媒体数据的媒体应用;
    处理请求生成子模块,用于采用所述参数信息以及应用包名,生成所述媒体处理请求。
  39. 根据权利要求39所述的智能终端,其特征在于,所述网桥服务模块,包括:
    通信建立子模块,用于调用所述通信接口,基于所述控件标识符与第二操作***建立双向通信连接;
    处理请求发送子模块,用于基于所述双向通信连接向第二操作***发送所述媒体处理请求。
  40. 根据权利要求39所述的智能终端,其特征在于,第二操作***包括媒体应用,则所述第二操作***具体用于基于所述媒体处理请求,启动所述应用包名对应的媒体应用;
    所述媒体应用,用于响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
  41. 根据权利要求40所述的智能终端,其特征在于,所述媒体应用,包括:
    媒体数据获取子模块,用于依据所述源信息获取媒体处理请求对应的媒体数据;
    解码环境创建子模块,用于调用媒体服务接口创建解码环境,对所述媒体数据进行解码,生成所述处理结果。
  42. 根据权利要求41所述的智能终端,其特征在于,所述第二操作***还包括:第二媒体服务模块和第二图形服务模块;
    所述解码环境创建子模块包括:媒体数据发送单元,用于通过媒体接口向第二媒体服务模块发送所获取的媒体数据;
    所述第二媒体服务模块,用于在接收到媒体数据后,对所述媒体数据进行解码,生成数据帧,将所生成的数据帧发送给第二图形服务模块;
    所述第二图形服务模块,用于在接收到数据帧后,对所述数据帧进行合成,生成第二图形信息,将所述第二图形信息作为图形处理结果。
  43. 根据权利要求42所述的智能终端,其特征在于,第二图形服务模块,包括:
    监听子模块,用于对控件标志符对应的接口进行监听;
    连接子模块,用于在监听到第一操作***的控件标志符时,基于所述控件标志符连接第一操作***的第一图形服务模块。
  44. 根据权利要求43所述的智能终端,其特征在于,所述第二图形服务模块,还包括:
    编码判定子模块,用于在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;
    数据帧合成子模块,用于对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
  45. 根据权利要求42至44任一所述的智能终端,其特征在于,所述解码环境创建子模块,还包括:
    状态信息生成单元,用于通过软件开发包对所述媒体数据进行解析,生成播放状态信息,将所生成的播放状态信息作为状态处理结果。
  46. 根据权利要求45所述的智能终端,其特征在于,所述媒体应用,还用于将所述状态处理结果发送到网桥服务模块;
    所述第二图形服务模块,还用于将所述图形处理结果发送到第一图形服务模块。
  47. 根据权利要求46所述的智能终端,其特征在于,所述网桥服务模块还包括:处理结果转发子模块,用于将接收到的状态处理结果转发给浏览器内核;
    则所述浏览器内核,还用于基于状态处理结果,获取第一图形服务模块所接收到的第二图形对应的句柄,依据所述句柄确定目标透明区域,基于所述目标透明区域生成第一图形的内容,将所述第一图形的内容发送到第一图形服务模块;
    所述第一图形服务模块,用于基于第一图形的内容生成第一图形,在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
  48. 根据权利要求47所述的智能终端,其特征在于,所述浏览器内核,还包括:
    播放模式进入子模块,用于在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;
    句柄获取子模块,用于在所述媒体播放模式下,获取第一图形服务模块所接收到的第二图形对应的句柄。
  49. 根据权利要求48所述的智能终端,其特征在于,浏览器内核还包括:
    状态数据提取子模块,用于从所述状态处理结果中提取播放状态数据;
    第一图形内容生成子模块,用于采用所述播放状态数据和目标透明区域生成第一图形的内容。
  50. 根据权利要求35所述的智能终端,其特征在于,浏览器内核还包括:
    区域确定子模块,用于采用所述句柄确定所述第二图形在第一图形上对应的显示位置和显示区域大小;
    显示区域确定子模块,用于基于所述显示位置和显示区域大小,确定第二图形在第一图形上的显示区域;
    目标透明设置子模块,用于将所述显示区域设置为目标透明区域。
  51. 根据权利要求50所述的智能终端,其特征在于,所述显示区域包括:目标播放器播放窗口。
  52. 一种智能终端,其特征在于,包括:存储器、显示器、处理器和输入单元;
    其中,所述处理器用于执行上述权利要求1-32任一所述的方法。
  53. 一种媒体数据播放装置,其特征在于,包括:
    播放请求模块,用于基于用户操作生成播放请求,所述播放请求包含媒体数据的源信息;
    处理请求模块,用于在所述媒体数据不符合预置的数据格式时,向第二操作***发送媒体处理请求;
    媒体响应模块,用于基于第二操作***针对所述媒体处理请求反馈的处理结果对所述媒体数据进行响应。
  54. 根据权利要求53所述的装置,其特征在于,还包括:
    标签提取模块,用于从所述源信息中提取所述媒体数据对应的媒体标签;
    媒体判断模块,用于基于所述媒体标签判断所述媒体数据是否符合预置的数据格式。
  55. 根据权利要求53所述的装置,其特征在于,还包括:
    标志符获取模块,用于通过***接口获取第一操作***的控件标志符;
    参数信息确定模块,用于将所述控件标志符和源信息作为所述媒体数据对应的参数信息;
    其中,所述处理请求模块,还用于依据所述媒体数据对应的参数信息生成媒体处理请求。
  56. 根据权利要求55所述的装置,其特征在于,所述处理请求模块,包括:
    通信建立子模块,用于调用通信接口,基于所述控件标识符与第二操作***建立双向通信连接;
    处理请求发送子模块,用于基于所述双向通信连接向第二操作***发送所述媒体处理请求。
  57. 根据权利要求56所述的装置,其特征在于,所述处理结果包括: 状态处理结果和图像处理结果;所述媒体响应模块,包括:
    句柄获取子模块,用于基于状态处理结果,从图像处理结果中获取第二图形对应的句柄;
    内容生成子模块,用于依据所述句柄确定目标透明区域,并基于所述目标透明区域生成第一图形的内容;
    图形生成子模块,用于基于第一图形的内容生成第一图形;
    响应子模块,用于在第一图形的目标透明区域展现第二图形,对所述媒体数据进行播放控制。
  58. 根据权利要求57所述的装置,其特征在于,所述句柄获取子模块,具体用于在检测到所述状态处理结果包含准备状态数据时,基于所述准备状态数据进入媒体播放模式;以及,在所述媒体播放模式下,从图像处理结果中获取第二图形对应的句柄。
  59. 根据权利要求58所述的装置,其特征在于,所述媒体响应模块还包括:状态数据提取子模块,用于从所述状态处理结果中提取播放状态数据;
    其中,所述内容生成子模块,具体用于采用所述播放状态数据和目标透明区域生成第一图形的内容。
  60. 一种媒体数据播放装置,其特征在于,包括:
    请求接收模块,用于接收第一操作***发送的媒体;
    媒体处理模块,用于依据所述媒体处理请求对媒体数据进行处理,生成处理结果;
    反馈模块,用于将所述处理结果反馈给第一操作***。
  61. 根据权利要求60所述的装置,其特征在于,所述媒体处理模块,包括:
    应用启动子模块,用于基于所述媒体处理请求,启动应用包名对应的 媒体应用,其中,所述应用包名依据媒体处理请求所携带媒体数据的源信息确定;
    结果生成子模块,用于通过所述媒体应用响应所述媒体处理请求,生成所述媒体数据对应的处理结果。
  62. 根据权利要求61所述的装置,其特征在于,所述结果生成子模块,包括:
    媒体数据获取单元,用于依据所述媒体处理请求携带的源信息获取对应的媒体数据;
    媒体数据解码单元,用于对所述媒体数据进行解码,生成数据帧;
    图形结果生成单元,用于对所述数据帧进行合成,生成第二图形信息,并将所述第二图形信息作为图形处理结果。
  63. 根据权利要求62所述的装置,其特征在于,所述结果生成子模块,还包括:
    监听单元,用于对控件标志符对应的接口进行监听;
    编码判定单元,用于在监听到第一操作***的控件标志符时,判定所述数据帧属于特殊编码方式;
    其中,图形结果生成单元,具体用于对所述数据帧进行合成,生成第二图形和所述第二图形对应的句柄。
  64. 根据权利要求63所述的装置,其特征在于,所述结果生成子模块,还包括:
    媒体数据解析单元,用于媒体应用通过软件开发包对所述媒体数据进行解析,生成播放状态信息;
    状态结果生成单元,用于将所生成的播放状态信息作为状态处理结果。
  65. 根据权利要求64所述的装置,其特征在于,所述反馈模块,具体用于基于所述双向通信连接,将状态处理结果和图形处理结果发送给第一操作***。
PCT/CN2017/076893 2016-03-28 2017-03-16 一种媒体数据播放方法和装置、智能终端 WO2017167023A1 (zh)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/144,525 US11245885B2 (en) 2016-03-28 2018-09-27 Method and system for playing media data

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201610184627.6 2016-03-28
CN201610184627.6A CN107241651B (zh) 2016-03-28 2016-03-28 一种媒体数据播放方法和装置、智能终端

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/144,525 Continuation-In-Part US11245885B2 (en) 2016-03-28 2018-09-27 Method and system for playing media data

Publications (1)

Publication Number Publication Date
WO2017167023A1 true WO2017167023A1 (zh) 2017-10-05

Family

ID=59963460

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/076893 WO2017167023A1 (zh) 2016-03-28 2017-03-16 一种媒体数据播放方法和装置、智能终端

Country Status (3)

Country Link
US (1) US11245885B2 (zh)
CN (1) CN107241651B (zh)
WO (1) WO2017167023A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112399223B (zh) * 2019-08-18 2022-11-29 海信视像科技股份有限公司 一种改善莫尔条纹现象的方法及显示设备
CN111142939B (zh) * 2019-12-11 2023-04-07 北京小米移动软件有限公司 应用程序处理方法及装置
US11403155B2 (en) * 2020-03-17 2022-08-02 Google Llc Integration of vehicle manufacturer user management system with automotive operating system
CN117560544A (zh) * 2023-11-13 2024-02-13 书行科技(北京)有限公司 播放处理方法、***、装置、电子设备及存储介质

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080086728A1 (en) * 2006-08-02 2008-04-10 Lam Monica S Binding User Data Files
CN102981894A (zh) * 2011-09-05 2013-03-20 联想(北京)有限公司 显示方法和电子设备
CN102981887A (zh) * 2011-09-06 2013-03-20 联想(北京)有限公司 数据处理方法及电子设备
CN103488466A (zh) * 2012-06-11 2014-01-01 联想(北京)有限公司 用于执行应用程序的方法和装置
US20140108951A1 (en) * 2012-10-11 2014-04-17 Motorola Mobility Llc Method and Apparatus for Providing Adaptive Wallpaper Display for a Device Having Multiple Operating System Environments
US20150324209A1 (en) * 2014-05-08 2015-11-12 Pegatron Corporation Operating System Switching Method and Dual-Operating System Electronic Device Using the Same

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2173695A1 (en) * 1995-04-14 1996-10-15 Panagiotis Kougiouris Method and system for providing interoperability among processes written to execute on different operating systems
US7774762B2 (en) * 2003-09-15 2010-08-10 Trigence Corp. System including run-time software to enable a software application to execute on an incompatible computer platform
TWI276957B (en) 2004-12-03 2007-03-21 Intervideo Digital Technology Partition area architecture of an operation system common used disk and the method thereof
US8166492B2 (en) * 2007-04-10 2012-04-24 Microsoft Corporation Application compatibility using a hybrid environment
US8473565B2 (en) * 2010-09-10 2013-06-25 International Business Machines Corporation Abstracting special file interfaces to concurrently support multiple operating system levels
KR101260185B1 (ko) * 2011-09-22 2013-05-06 주식회사 엘지씨엔에스 단일 운영체제에 포함된 기본 미디어 플레이어를 이용하여 스마트 서비스와 디지털 텔레비젼 서비스를 제공하는 스마트 셋탑 박스 및 그것의 구동 방법
US9179144B2 (en) * 2012-11-28 2015-11-03 Cisco Technology, Inc. Fast switching hybrid video decoder
US20150094150A1 (en) * 2013-09-30 2015-04-02 Zynga Inc. Operation of a browser-incompatible application within a browser
WO2015139246A1 (zh) * 2014-03-19 2015-09-24 华为终端有限公司 一种应用数据同步的方法及装置
US9804990B2 (en) * 2014-08-27 2017-10-31 Vmware, Inc. Sharing unclaimed USB devices as PCI devices
CN105404547A (zh) * 2014-09-12 2016-03-16 阿里巴巴集团控股有限公司 一种操作***的融合方法及装置

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080086728A1 (en) * 2006-08-02 2008-04-10 Lam Monica S Binding User Data Files
CN102981894A (zh) * 2011-09-05 2013-03-20 联想(北京)有限公司 显示方法和电子设备
CN102981887A (zh) * 2011-09-06 2013-03-20 联想(北京)有限公司 数据处理方法及电子设备
CN103488466A (zh) * 2012-06-11 2014-01-01 联想(北京)有限公司 用于执行应用程序的方法和装置
US20140108951A1 (en) * 2012-10-11 2014-04-17 Motorola Mobility Llc Method and Apparatus for Providing Adaptive Wallpaper Display for a Device Having Multiple Operating System Environments
US20150324209A1 (en) * 2014-05-08 2015-11-12 Pegatron Corporation Operating System Switching Method and Dual-Operating System Electronic Device Using the Same

Also Published As

Publication number Publication date
CN107241651A (zh) 2017-10-10
US20190116348A1 (en) 2019-04-18
CN107241651B (zh) 2021-02-26
US11245885B2 (en) 2022-02-08

Similar Documents

Publication Publication Date Title
US9894402B2 (en) Multimedia device and method for controlling the same
WO2017167023A1 (zh) 一种媒体数据播放方法和装置、智能终端
EP2710463B1 (en) Integrated rendering of streaming media in virtualized desktop environment
TWI444216B (zh) 基於移動終端實現遊戲之方法和裝置
US20120204093A1 (en) Providing web-based content to local device
WO2019037660A1 (zh) 设备控制方法、装置、终端设备和操作***
WO2016197862A1 (zh) 一种数据传输方法、装置和智能电视***
WO2016095705A1 (zh) 流媒体传输的方法、装置及***
CN104918105B (zh) 媒体文件的多屏播放方法、设备及***
WO2022033171A1 (zh) 多媒体数据的播放方法、装置、电子设备及存储介质
WO2018036544A1 (zh) 浏览器在独立窗口中播放视频的方法、装置及存储介质
US20140201619A1 (en) Method And Device For Implementing Local Operation On Web Page
WO2021249318A1 (zh) 一种投屏方法和终端
WO2013013554A1 (zh) 一种程序回调方法及装置
WO2022057677A1 (zh) 振动控制方法、装置、电子设备和计算机可读存储介质
WO2013174080A1 (zh) 适用于多种显示类型的家庭网关的界面显示方法和***
CN113613064A (zh) 视频处理方法、装置、存储介质及终端
WO2017113855A1 (zh) 应用程序交互的方法和终端
US9342386B1 (en) Messaging channel for web pages, extensions, and applications to communicate
JP6445050B2 (ja) クラウドストリーミングサービス提供方法、そのための装置及びシステム、並びにそのためのクラウドストリーミング用スクリプトコードを記録したコンピュータ読み取り可能な記録媒体
CN111641864B (zh) 一种视频信息获取方法、装置及设备
US10523718B2 (en) Video playing method and device
CN111654753B (zh) 一种应用程序启动方法及显示设备
CN116347158A (zh) 视频播放的方法、装置、电子设备及计算机可读存储介质
WO2014161395A1 (zh) 一种移动终端的参数处理方法及移动终端

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17773053

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 17773053

Country of ref document: EP

Kind code of ref document: A1