CN108063971A - Multimedia playing apparatus and method - Google Patents
Multimedia playing apparatus and method Download PDFInfo
- Publication number
- CN108063971A CN108063971A CN201711424967.2A CN201711424967A CN108063971A CN 108063971 A CN108063971 A CN 108063971A CN 201711424967 A CN201711424967 A CN 201711424967A CN 108063971 A CN108063971 A CN 108063971A
- Authority
- CN
- China
- Prior art keywords
- module
- medium data
- media data
- decoder
- type
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 43
- 238000009877 rendering Methods 0.000 claims abstract description 73
- 230000008569 process Effects 0.000 claims description 10
- 238000006243 chemical reaction Methods 0.000 claims description 7
- 230000001360 synchronised effect Effects 0.000 claims 1
- 238000010276 construction Methods 0.000 abstract description 4
- 230000006870 function Effects 0.000 description 21
- 238000012545 processing Methods 0.000 description 13
- 230000000694 effects Effects 0.000 description 10
- 238000011161 development Methods 0.000 description 7
- 238000013442 quality metrics Methods 0.000 description 7
- 239000004065 semiconductor Substances 0.000 description 6
- 230000008859 change Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 241001269238 Data Species 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 235000013399 edible fruits Nutrition 0.000 description 1
- 230000012010 growth Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention discloses a kind of multimedia playing apparatus and method, device includes：Control module, source module, input/output module, demultiplexing module, multiple decoder modules, multiple rendering modules and synchronization module；Source module obtains network address, obtains multi-medium data according to network address, and parses media data type；One decoder module, is decoded the multi-medium data of a media data type；One rendering module, renders multi-medium data；Synchronization module, according to timestamp, synchronism output multi-medium data；Control module obtains network address；It establishes and connects with source module；Decoder module corresponding with media data type establishes connection；It is connected with multiple rendering modules, control decoder module is connected with corresponding rendering module；It is connected with synchronization module, multiple rendering modules is controlled to be connected with synchronization module.By the technical solution, user can replace according to the demand of oneself and extend distinctive module, shorten the construction cycle.
Description
Technical field
The present invention relates to technical field of media play, especially a kind of multimedia playing apparatus and method.
Background technology
With the high speed development of mobile Internet, more and more net cast program request application programs emerge, user
Super clear 4k videos are watched, there has also been fulminant growths for the demand of VR (Virtual Reality, virtual reality) panoramic video.
Super clear 4k videos, VR panoramic videos are very high to the performance requirement of player and equipment, played so in current mobile equipment
Video cardton phenomenon than more serious.The expansible player frame of a depth optimization is just needed this when, by player
Modules closely effectively connect, and to the greatest extent using the hardware of mobile equipment, save power consumption, promote playing body
It tests.
Traditional multimedia frame needs oneself to go the data flow between management disparate modules, adds exploitation
Complexity and cycle, and the efficiency of data processing is often handled than relatively low.
The content of the invention
A technical problem to be solved of the embodiment of the present invention be how in media play process maximum performance system
The characteristic of equipment, with the effect being optimal.
A kind of multimedia playing apparatus of the embodiment of the present invention and method.The technical solution is as follows：
It is according to embodiments of the present invention in a first aspect, provide a kind of multimedia playing apparatus, including：
Control module, source module, input/output module, demultiplexing module, multiple decoder modules, multiple rendering modules and same
Walk module；
For obtaining network address, multi-medium data is obtained according to network address for source module, and from the multi-medium data
In parse media data type, the media data type is fed back into the control module；
Input/output module, for obtaining multi-medium data；
Demultiplexing module, for being demultiplexed to multi-medium data；
One decoder module, is decoded for the multi-medium data to a media data type；
One rendering module, renders for the multi-medium data to video branch or audio branch；
Synchronization module, for the timestamp according to the multi-medium data, multi-medium data described in synchronism output；
The control module, for obtaining network address；It establishes and connects with the source module after network address is obtained；
After obtaining media data type, decoder module corresponding with the media data type establishes connection, by the media data class
Type is sent to corresponding decoder module；It is connected and control the media data type corresponding with the multiple rendering module
Decoder module is connected with corresponding rendering module；The multiple rendering module and institute are connected and controlled with the synchronization module
State synchronization module connection.
In the above-mentioned technical solutions, when carrying out multi-medium data broadcasting, can as needed be connected by control module
To different function modules, and corresponding input/output function module is connected, can be transmitted between different function modules
The multi-medium datas such as the audio and video of corresponding format.In this way, it is orthogonal without coupling, and disparate modules between disparate modules
Transmission data can be flexibly connected, so that user according to the demand of oneself can very easily replace and extend oneself spy
Some modules, the use without influencing other modules improve development efficiency during actual development, shorten the construction cycle,
Achieve the effect that get twice the result with half the effort.
Wherein, multiple decoder modules can include Video decoding module and audio decoder module etc., and Video Rendering module can
To include Video Rendering module and audio rendering module etc..It in this way, can be according to the media data type of multi-medium data not
Together, the connection between corresponding module is established.For example, if multi-medium data is video data, send media data to
Video decoding module, the decoded data of video are sent to Video Rendering module and render, and then export the video data after rendering,
And if multi-medium data is voice data, voice data is sent to audio decoder module, the data after audio decoder pass
It send to audio rendering module and renders, and then export treated voice data.
Optionally, the input/output module includes：Multiple input output module；The demultiplexing module includes：It is multiple
Demultiplexing module；
One input/output module obtains multi-medium data for passing through a port；
One demultiplexing module, demultiplexes for the multi-medium data to a media data type；
The source module, the port information being additionally operable in network address establish company with corresponding input/output module
It connects, and the network address is sent to corresponding input/output module；Receive the multi-medium data of input/output module feedback；Control
It makes input/output module demultiplexing module corresponding with the media data type and establishes connection；
The control module is additionally operable to control the corresponding demultiplexing module of the media data type and the corresponding solution
Code module connection.
Wherein, for each module, its responsible corresponding media data type can be set, upper layer module can lead to
It crosses media data type and establishes connection, the matchmaker that such lower module comes with regard to upper layer module can be handled to be transmitted through with corresponding lower module
Volume data.When media data type changes, upper layer module detects that media data type changes, and need to only reconnect to corresponding
Lower module, need not restart playback equipment can continue normal play.
Optionally, described device further includes：Multiple modular converters；
One modular converter is handled for the video to function type or the multi-medium data of audio；
The control module is additionally operable to establish connection with corresponding modular converter according to default function type and press
According to video branch and audio branch, the corresponding decoder module is controlled to be established with the corresponding modular converter and is connected；And
According to video branch and audio branch, the corresponding modular converter is controlled to be established with corresponding rendering module and is connected.
In the above-mentioned technical solutions, control module can also be established according to default function type with corresponding modular converter
Connection.Because needing to carry out after-treatment to decoded audio or video data under some scenes, for example change and give great volume
It is small, Video Layer superposition or filter are done, a modular converter is thus needed to go processing audio or video data, this module is
Selectable, which is not required similar functions that can not have to realize to realize that audio, video data processing provides an interface.
Optionally, between the demultiplexing module and corresponding decoder module, the decoder module renders mould with corresponding
Between block, between the decoder module and corresponding modular converter, between the modular converter and corresponding rendering module, adopt
It is connected with pin interfaces.
Optionally, the control module is additionally operable to the OS Type according to the multimedia playing apparatus, controls institute
The corresponding demultiplexing module of media data type is stated to connect with the corresponding decoder module for supporting the OS Type.
In the above-mentioned technical solutions, can be selected according to the different operating system type priority of multimedia playing apparatus a kind of
Media handling mode, for example, decoding when prioritizing selection corresponding operating system type hardware decoding process, to decoding carry out
Accelerate.Prioritizing selection is handled video by GLSL (GL Shading Language, shading language) during Video Quality Metric,
Preferentially by the SMID of compilation, (Semiconductor Memory Integrated Device, semiconductor are deposited when audio is converted
Reservoir integrated device) instruction handled, so in playing process can the maximum characteristic for playing device, to be optimal
Effect.Prioritizing selection solves decoder of the mode as video firmly, can also realize following effect：The hard relatively soft solution of solution not only can
The power consumption of equipment is substantially reduced, improves decoding efficiency, reduces system CPU load, is decoded in video, Video Quality Metric, Video Rendering
When mass data is needed to carry out parallel computation, the GPU (Graphic Processing Unit, the figure that are suitble to parallel computation are selected
As processor) it is with the obvious advantage, CPU can be liberated and handle other tasks, and since the video data for solving operation firmly is in GPU
On chip, substantial amounts of yuv data need not be copied on memory directly to be shown in Video Rendering module.
Second aspect according to embodiments of the present invention provides a kind of multi-medium play method, including：
When receiving the network address of multi-medium data, with source module establish connect, with control the source module according to
The network address obtains the multi-medium data, and obtains the media data class for the multi-medium data that source module parses
Type；
According to the media data type of the multi-medium data, the source module with corresponding decoder module is established and is connected
It connects, so that the decoder module is decoded the multi-medium data；
According to the media data type of the multi-medium data, the decoder module with corresponding rendering module is established and is connected
It connects, so that the rendering module renders the decoded multi-medium data of the decoder module；
According to the media data type of the multi-medium data, the rendering module with corresponding synchronization module is established and is connected
Connect so that synchronization module rendering module according to the timestamp synchronism output of the multi-medium data render after more matchmakers
Volume data.
Optionally, the control source module obtains the multi-medium data, and parses the multi-medium data
Media data type, including：
Port information of the source module in the network address is controlled to establish with corresponding input/output module to connect
It connects, and the network address is sent to corresponding input/output module；
Receive the multi-medium data of input/output module feedback；
Media data type is parsed from the multi-medium data received, makes input/output module and the media data class
The corresponding demultiplexing module of type establishes connection, so that the demultiplexing module carries out demultiplexing process to the multi-medium data,
Obtain the multi-medium data of video branch or the multi-medium data of audio branch；
The media data type according to the multi-medium data establishes the source module with corresponding decoder module
Connection, including：
The corresponding demultiplexing module of the media data type is controlled to be connected with the corresponding decoder module.
Optionally, the method further includes：
Connection is established and according to video branch and audio point with corresponding modular converter according to default function type
Road controls the corresponding decoder module to be established with the corresponding modular converter and connects；
According to video branch and audio branch, the corresponding modular converter is controlled to be established with corresponding rendering module and is connected
It connects.
Optionally, between the demultiplexing module and corresponding decoder module, the decoder module renders mould with corresponding
Between block, between the decoder module and corresponding modular converter, between the modular converter and corresponding rendering module, adopt
It is connected with pin interfaces.
Optionally, the corresponding demultiplexing module of the control media data type connects with the corresponding decoder module
It connects, including：
According to the OS Type of the multimedia playing apparatus, the corresponding demultiplexing of the media data type is controlled
Module supports the decoder module of the OS Type is established to connect with corresponding.
Below by drawings and examples, technical scheme is described in further detail.
Description of the drawings
The attached drawing of a part for constitution instruction describes the embodiment of the present invention, and is used to explain together with description
The principle of the present invention.
Referring to the drawings, according to following detailed description, the present invention can be more clearly understood, wherein：
Fig. 1 is the block diagram according to a kind of multimedia playing apparatus shown in an exemplary embodiment.
Fig. 2 is the block diagram according to a kind of multimedia playing apparatus shown in an exemplary embodiment.
Fig. 3 is the flow chart according to a kind of multi-medium play method shown in an exemplary embodiment.
Fig. 4 is the flow chart according to another multi-medium play method shown in an exemplary embodiment.
Fig. 5 is the flow chart according to another multi-medium play method shown in an exemplary embodiment.
Fig. 6 is the particular flow sheet according to another multi-medium play method shown in an exemplary embodiment.
Specific embodiment
Carry out the various exemplary embodiments of detailed description of the present invention now with reference to attached drawing.It should be noted that：Unless in addition have
Body illustrates that the unlimited system of component and the positioned opposite of step, numerical expression and the numerical value otherwise illustrated in these embodiments is originally
The scope of invention.
Simultaneously, it should be appreciated that for ease of description, the size of the various pieces shown in attached drawing is not according to reality
Proportionate relationship draw.
It is illustrative to the description only actually of at least one exemplary embodiment below, is never used as to the present invention
And its application or any restrictions that use.
It may be not discussed in detail for technology, method and apparatus known to person of ordinary skill in the relevant, but suitable
In the case of, the technology, method and apparatus should be considered as part for specification.
It should be noted that：Similar label and letter represents similar terms in following attached drawing, therefore, once a certain Xiang Yi
It is defined, then it need not be further discussed in subsequent attached drawing in a attached drawing.
The embodiment of the present invention can be applied to computer system/server, can be with numerous other universal or special calculating
System environments or configuration operate together.Suitable for be used together with computer system/server well-known computing system, ring
The example of border and/or configuration includes but not limited to：Personal computer system, server computer system, thin client, thick client
Machine, hand-held or laptop devices, the system based on microprocessor, set-top box, programmable consumer electronics, NetPC Network PC,
Little types Ji calculates machine Xi Tong ﹑ large computer systems and the distributed cloud computing technology environment including any of the above described system, etc..
Computer system/server can be in computer system executable instruction (such as journey performed by computer system
Sequence module) general linguistic context under describe.In general, program module can include routine, program, target program, component, logic, number
According to structure etc., they perform specific task or realize specific abstract data type.Computer system/server can be with
Implement in distributed cloud computing environment, in distributed cloud computing environment, task is long-range by what is be linked through a communications network
Manage what equipment performed.In distributed cloud computing environment, program module can be located at the Local or Remote meter for including storage device
On calculation system storage medium.
Fig. 1 is according to a kind of block diagram of multimedia playing apparatus shown in an exemplary embodiment, which can pass through
Software, hardware or both are implemented in combination with as some or all of of playback equipment.As shown in Figure 1, the multimedia
Device includes：
Control module 11, source module 12, input/output module 13, demultiplexing module 14, multiple decoder modules 15, Duo Gexuan
Contaminate module 16 and synchronization module 17；
For obtaining network address, multi-medium data is obtained according to network address for source module 12, and from the multimedia number
Media data type is parsed in, the media data type is fed back into the control module 11；
Input/output module 13, for obtaining multi-medium data；
Demultiplexing module 14, for being demultiplexed to multi-medium data；
One decoder module 15, is decoded for the multi-medium data to a media data type；Different decodings
Module is responsible for being decoded the multi-medium data of different media data types.
One rendering module 16, renders for the multi-medium data to video branch or audio branch；Different wash with watercolours
Dye module is responsible for rendering the multi-medium data of different media data types.
Synchronization module 17, for the timestamp according to the multi-medium data, synchronism output render after multi-medium data；
The control module 11, for obtaining network address；It establishes and connects with the source module 12 after network address is obtained
It connects；After media data type is obtained, decoder module 15 corresponding with the media data type establishes connection, by the media
Data type is sent to corresponding decoder module 15；The media data is connected and controls with the multiple rendering module 16
The corresponding decoder module 15 of type is connected with corresponding rendering module 16；Described in being connected and control with the synchronization module 17
Multiple rendering modules 16 are connected with the synchronization module 17.There is the interface identifier of modules in the control module, in this way, expanding
When exhibition or removing module, the configuration information in change control module, the i.e. interface identifier of increase module or removing module
Interface identifier.
In this embodiment, when carrying out multi-medium data broadcasting, can be as needed connected to not by control module
Same function module, and corresponding input/output function module is connected, it can be transmitted between different function modules corresponding
The multi-medium datas such as the audio and video of form.In this way, be orthogonal without coupling between disparate modules, and disparate modules can be with
Data are transferred in flexible connection, so that user can very easily be replaced according to the demand of oneself and to extend oneself distinctive
Module, the use without influencing other modules improve development efficiency during actual development, shorten the construction cycle, reach
The effect got twice the result with half the effort.
In this embodiment, input/output module can only there are one, source module 12 is fixed with the input/output module 13
Connection.
Demultiplexing module 14 may adapt to media data type, is fixedly connected with the input/output module 13.
Control module 11 can also be fixedly connected with demultiplexing module 14, know the interface identifier of demultiplexing module 14.Separately
On the one hand, the decoder module 15 corresponding with the media data type of control module 11 establishes connection, knows the decoder module 15
Interface identifier.Control module sends the first bind command to decoder module, by first bind command by demultiplexing module
Interface identifier be sent to corresponding decoder module 15；And to demultiplexing module send the second bind command, by this second
The interface identifier of decoder module 15 is sent to demultiplexing module by bind command.Demultiplexing module and decoder module receive respective
After bind command, by the interface identifier of the opposite end of acquisition, connection is established each other.
Wherein, multiple decoder modules 15 can include Video decoding module 151 and audio decoder module 152 etc., render mould
Block 16 can include Video Rendering module 161 and audio rendering module 162 etc..It in this way, can be according to the media of multi-medium data
The difference of data type establishes the connection between corresponding module.For example, if multi-medium data is video data, by matchmaker
Volume data is sent to Video decoding module, and the decoded data of video are sent to Video Rendering module and render, and then exports and render
Video data afterwards, and if multi-medium data is voice data, voice data is sent to audio decoder module, audio solution
Data after code are sent to audio rendering module and render, and then the voice data that exports that treated.
Fig. 2 is the block diagram according to a kind of multimedia playing apparatus shown in an exemplary embodiment.
As shown in Fig. 2, in one embodiment, decoder module and rendering module can be multiple, input/output module
Can also be multiple with demultiplexing module；
One input/output module 13 obtains multi-medium data for passing through a port；Wherein, different input and output
Module obtains multi-medium data by different ports.
One demultiplexing module 14, demultiplexes for the multi-medium data to a media data type；Wherein, no
Same demultiplexing module is responsible for demultiplexing the multi-medium data of different media data types.
The source module 12, the port information being additionally operable in network address establish company with corresponding input/output module
It connects, and the network address is sent to corresponding input/output module；Receive the multi-medium data of input/output module feedback；Control
It makes input/output module demultiplexing module corresponding with the media data type and establishes connection；
The control module 11, be additionally operable to control the corresponding demultiplexing module of the media data type with it is described corresponding
Decoder module connects.
Wherein, for each module, its responsible corresponding media data type can be set, upper layer module can lead to
It crosses media data type and establishes connection, the matchmaker that such lower module comes with regard to upper layer module can be handled to be transmitted through with corresponding lower module
Volume data.When media data type changes, upper layer module detects that media data type changes, and need to only reconnect to corresponding
Lower module, need not restart playback equipment can continue normal play.
In one embodiment, described device further includes：Multiple modular converters 18；
One modular converter 18 is handled for the video to function type or the multi-medium data of audio；Its
In, multiple modular converters 18 can include video conversion module 181 and audio conversion module 182.
The control module 11 is additionally operable to establish connection with corresponding modular converter 18 according to default function type, with
And according to video branch and audio branch, the corresponding decoder module is controlled to be established with the corresponding modular converter and is connected；
And according to video branch and audio branch, the corresponding modular converter is controlled to be established with corresponding rendering module and is connected.
In this embodiment, control module can also be established with corresponding modular converter according to default function type and connected
It connects.Because needing to carry out after-treatment to decoded audio or video data under some scenes, for example change volume,
Video Layer superposition or filter are done, a modular converter is thus needed to go processing audio or video data, this module is can
Selection, which is not required similar functions that can not have to realize to realize that audio, video data processing provides an interface.
In one embodiment, between the demultiplexing module 14 and corresponding decoder module 15, the decoder module 15
Between corresponding rendering module 16, between the decoder module 15 and corresponding modular converter 18, the modular converter and 18
Between corresponding rendering module 16, connected using pin interfaces.
In one embodiment, the control module 11, is additionally operable to the operating system according to the multimedia playing apparatus
Type controls the corresponding demultiplexing module of the media data type and the corresponding decoding mould for supporting the OS Type
Block connects.
In this embodiment it is possible to a kind of media are selected according to the different operating system type priority of multimedia playing apparatus
Processing mode, for example, decoding when prioritizing selection corresponding operating system type hardware decoding process, come to decoding add
Speed.Prioritizing selection is handled video, sound by GLSL (GL Shading Language, shading language) during Video Quality Metric
Frequency preferentially passes through SMID (Semiconductor Memory Integrated Device, the semiconductor storage of compilation when converting
Device integrated device) instruction handled, so in playing process can the maximum characteristic for playing device, with what is be optimal
Effect.Prioritizing selection solves decoder of the mode as video firmly, can also realize following effect：The relatively soft solution of hard solution not only can be big
The big power consumption for reducing equipment, improves decoding efficiency, reduces system CPU load, is decoded in video, Video Quality Metric, Video Rendering etc.
When needing mass data progress parallel computation, the GPU (Graphic Processing Unit, the image that are suitble to parallel computation are selected
Processor) it is with the obvious advantage, CPU can be liberated and handle other tasks, and since the video data for solving operation firmly is in GPU cores
On piece, substantial amounts of yuv data need not be copied on memory directly to be shown in Video Rendering module.
Fig. 3 is the flow chart according to a kind of multi-medium play method shown in an exemplary embodiment.It as shown in figure 3, should
Multi-medium play method includes step S301-S304：
Step S301 when receiving the network address of multi-medium data, is established with source module and connected, to control source module
Multi-medium data is obtained according to network address, and obtains the media data type for the multi-medium data that source module parses；
Step S302 according to the media data type of multi-medium data, source module with corresponding decoder module is established and is connected
It connects, so that decoder module is decoded multi-medium data；
According to the media data type of multi-medium data, decoder module is established with corresponding rendering module by step S303
Connection, so that rendering module renders the decoded multi-medium data of decoder module；
According to the media data type of multi-medium data, rendering module is established with corresponding synchronization module by step S304
Connection so that synchronization module rendered according to the timestamp synchronism output rendering module of multi-medium data after multi-medium data.
In this embodiment, when carrying out multi-medium data broadcasting, different function modules can be connected to as needed,
And corresponding input/output function module is connected, audio and video of corresponding format etc. can be transmitted between different function modules
Multi-medium data.In this way, be orthogonal without coupling between disparate modules, and disparate modules can flexibly connect transmission
Data, so that user according to the demand of oneself can very easily replace and extend oneself distinctive module, without influencing
The use of other modules improves development efficiency during actual development, shortens the construction cycle, reaches the effect got twice the result with half the effort
Fruit.
Fig. 4 is the flow chart according to another multi-medium play method shown in an exemplary embodiment.
As shown in figure 4, in one embodiment, above-mentioned steps S301 includes step S401-S403：
Step S401, port information of the control source module in network address is established with corresponding input/output module to be connected
It connects, and network address is sent to corresponding input/output module；
Step S402 receives the multi-medium data of input/output module feedback；
Step S403 parses media data type from the multi-medium data received, makes input/output module and media
The corresponding demultiplexing module of data type establishes connection, so that demultiplexing module carries out demultiplexing process to multi-medium data, obtains
To the multi-medium data of video branch or the multi-medium data of audio branch；
Step S302 includes step S404：
Step S404, the corresponding demultiplexing module of control media data type are connected with corresponding decoder module.
Wherein, for each module, its corresponding media data type can be set, upper layer module can pass through media
Data type sets interface to inform its media data type of lower module, and such lower module is transmitted through coming with regard to that can handle upper layer module
Media data.When media data changes, upper layer module detects that media data type changes, and only need to re-call a matchmaker
Body type sets interface, and need not restart playback equipment can continue normal play.
Fig. 5 is the flow chart according to another multi-medium play method shown in an exemplary embodiment.
As shown in figure 5, in one embodiment, above-mentioned steps S303 further includes step S501-S502：
Step S501 establishes connection and according to video branch according to default function type with corresponding modular converter
With audio branch, corresponding decoder module is controlled to be established with corresponding modular converter and is connected；
Step S502 according to video branch and audio branch, controls corresponding modular converter to be built with corresponding rendering module
Vertical connection.
In this embodiment, it can also be established and connected with corresponding modular converter according to default function type.Because have
Scene under need to carry out after-treatment to decoded audio or video data, for example change volume, do video figure
Stacking adds or filter, and a modular converter is thus needed to go processing audio or video data, this module is selectable, is somebody's turn to do
Module is not required similar functions that can not have to realize to realize that audio, video data processing provides an interface.
In one embodiment, between demultiplexing module and corresponding decoder module, decoder module renders mould with corresponding
Between block, between decoder module and corresponding modular converter, between modular converter and corresponding rendering module, connect using pin
Mouth connection.
In one embodiment, the corresponding demultiplexing module of media data type is controlled to be connected with corresponding decoder module,
Including：
According to the OS Type of multimedia playing apparatus, the corresponding demultiplexing module of control media data type with it is right
The decoder module for the support OS Type answered establishes connection.
In this embodiment it is possible to a kind of media are selected according to the different operating system type priority of multimedia playing apparatus
Processing mode, for example, decoding when prioritizing selection corresponding operating system type hardware decoding process, come to decoding add
Speed.Prioritizing selection is handled video, sound by GLSL (GL Shading Language, shading language) during Video Quality Metric
Frequency preferentially passes through SMID (Semiconductor Memory Integrated Device, the semiconductor storage of compilation when converting
Device integrated device) instruction handled, so in playing process can the maximum characteristic for playing device, with what is be optimal
Effect.Prioritizing selection solves decoder of the mode as video firmly, can also realize following effect：The relatively soft solution of hard solution not only can be big
The big power consumption for reducing equipment, improves decoding efficiency, reduces system CPU load, is decoded in video, Video Quality Metric, Video Rendering etc.
When needing mass data progress parallel computation, the GPU (Graphic Processing Unit, the image that are suitble to parallel computation are selected
Processor) it is with the obvious advantage, CPU can be liberated and handle other tasks, and since the video data for solving operation firmly is in GPU cores
On piece, substantial amounts of yuv data need not be copied on memory directly to be shown in Video Rendering module.
The technical solution of the application is described in detail with a specific embodiment below.
Fig. 6 is the particular flow sheet according to another multi-medium play method shown in an exemplary embodiment.
As shown in fig. 6, the idiographic flow of multi-medium play method includes：
Step 601：Control module receives the broadcasting network address of multi-medium data.
Step 602：Control module creates source module, and network address is transmitted to source module processing.
Step 603：Source module creates corresponding input/output module to ask multimedia number according to the prefix of network address
According to.
Step 604：Determine whether input/output module is successfully opened.
Step 605：After definite input/output module is successfully opened, source module analyzes media data according to media head
Type creates corresponding demultiplexing module demultiplexing multi-medium data.
Step 606：Determine whether demultiplexing module opens success.
Step 607：After definite demultiplexing module is opened successfully, demultiplexing module reads file.
Step 608：Judge whether to read the end-of-file of multi-medium data bag.
Step 609：It is video data packet or packets of audio data to judge multi-medium data bag.
Step 610：When it is video data packet to judge, then video data packet is transmitted to Video decoding module and be decoded.
Step 611：The decoded data of Video decoding module send video conversion module to, are converted.
Step 612：Video Rendering module is transmitted to after Video Quality Metric and carries out Video Rendering.
Step 613：When it is packets of audio data to judge, then packets of audio data is transmitted to audio decoder module and be decoded.
Step 614：The decoded data of audio decoder module send audio conversion module to, are converted.
Step 615：Audio rendering module progress audio is transmitted to after audio conversion to render.
Step 616：Audio rendering module or Video Rendering module, according to timestamp synchronization and show.
A kind of computer program product for multimedia, the computer program product include：
Computer usable medium, wherein including the available program code of computer, the computer usable program code bag
It includes：
The available program code of computer, is configured as：
When receiving the network address of multi-medium data, with source module establish connect, with control the source module according to
The network address obtains the multi-medium data, and obtains the media data class for the multi-medium data that source module parses
Type；
According to the media data type of the multi-medium data, the source module with corresponding decoder module is established and is connected
It connects, so that the decoder module is decoded the multi-medium data；
According to the media data type of the multi-medium data, the decoder module with corresponding rendering module is established and is connected
It connects, so that the rendering module renders the decoded multi-medium data of the decoder module；
According to the media data type of the multi-medium data, the rendering module with corresponding synchronization module is established and is connected
Connect so that synchronization module rendering module according to the timestamp synchronism output of the multi-medium data render after more matchmakers
Volume data.
Each embodiment is described by the way of progressive in this specification, the highlights of each of the examples are with its
The difference of its embodiment, the same or similar part cross-reference between each embodiment.For system embodiment
For, since it is substantially corresponding to embodiment of the method, so description is fairly simple, referring to the portion of embodiment of the method in place of correlation
It defends oneself bright.
The method and system of the present invention may be achieved in many ways.For example, can by software, hardware, firmware or
Software, hardware, firmware any combinations come realize the present invention method and system.The said sequence of the step of for the method
Merely to illustrate, the step of method of the invention, is not limited to order described in detail above, special unless otherwise
It does not mentionlet alone bright.In addition, in some embodiments, the present invention can be also embodied as recording program in the recording medium, these programs
Machine readable instructions including being used to implement the method according to the invention.Thus, the present invention also covering stores to perform basis
The recording medium of the program of the method for the present invention.
Description of the invention provides for the sake of example and description, and is not exhaustively or by the present invention
It is limited to disclosed form.Many modifications and variations are obvious for the ordinary skill in the art.It selects and retouches
It states embodiment and is to more preferably illustrate the principle of the present invention and practical application, and those of ordinary skill in the art is enable to manage
The present invention is solved so as to design the various embodiments with various modifications suitable for special-purpose.
Claims (10)
1. a kind of multimedia playing apparatus, which is characterized in that including：
Control module, source module, input/output module, demultiplexing module, multiple decoder modules, multiple rendering modules and synchronous mould
Block；
For obtaining network address, multi-medium data is obtained according to network address for the source module, and from the multi-medium data
In parse media data type, the media data type is fed back into the control module；
Input/output module, for obtaining multi-medium data；
Demultiplexing module, for being demultiplexed to multi-medium data；
One decoder module, is decoded for the multi-medium data to a media data type；
One rendering module, renders for the multi-medium data to video branch or audio branch；
The synchronization module, for the timestamp according to the multi-medium data, synchronism output render after multi-medium data；
The control module, for obtaining network address；It establishes and connects with the source module after network address is obtained；It is obtaining
After media data type, decoder module corresponding with the media data type establishes connection, and the media data type is sent out
Give corresponding decoder module；The corresponding decoding of the media data type is connected and controlled with the multiple rendering module
Module is connected with corresponding rendering module；Be connected and control with the synchronization module the multiple rendering module with it is described same
Walk module connection.
2. the apparatus according to claim 1, which is characterized in that the input/output module includes：Multiple input exports mould
Block；The demultiplexing module includes：Multiple demultiplexing modules；
One input/output module obtains multi-medium data for passing through a port；
One demultiplexing module, demultiplexes for the multi-medium data to a media data type；
The source module, the port information being additionally operable in network address establish connection with corresponding input/output module, and
The network address is sent to corresponding input/output module；Receive the multi-medium data of input/output module feedback；Control institute
It states input/output module demultiplexing module corresponding with the media data type and establishes connection；
The control module is additionally operable to control the corresponding demultiplexing module of the media data type and the corresponding decoding mould
Block connects.
3. the apparatus according to claim 1, which is characterized in that described device further includes：Multiple modular converters；
One modular converter is handled for the video to function type or the multi-medium data of audio；
The control module, be additionally operable to according to default function type and corresponding modular converter establish connection and according to regarding
Frequency division road and audio branch control the corresponding decoder module to be established with the corresponding modular converter and connect；And according to
Video branch and audio branch control the corresponding modular converter to be established with corresponding rendering module and connect.
4. the apparatus of claim 2, which is characterized in that between the demultiplexing module and corresponding decoder module,
Between the decoder module and corresponding rendering module, between the decoder module and corresponding modular converter, the modulus of conversion
Between block and corresponding rendering module, connected using pin interfaces.
5. the apparatus of claim 2, which is characterized in that
The control module is additionally operable to the OS Type according to the multimedia playing apparatus, controls the media data
The corresponding demultiplexing module of type is connected with the corresponding decoder module for supporting the OS Type.
6. a kind of multi-medium play method, which is characterized in that including：
When receiving the network address of multi-medium data, establish and connect with source module, to control the source module according to
Network address obtains the multi-medium data, and obtains the media data class for the multi-medium data that the source module parses
Type；
According to the media data type of the multi-medium data, the source module with corresponding decoder module is established and is connected, with
The decoder module is made to be decoded the multi-medium data；
According to the media data type of the multi-medium data, the decoder module with corresponding rendering module is established and is connected,
So that the rendering module renders the decoded multi-medium data of the decoder module；
According to the media data type of the multi-medium data, the rendering module with corresponding synchronization module is established and is connected,
So that synchronization module rendering module according to the timestamp synchronism output of the multi-medium data render after multimedia
Data.
7. according to the method described in claim 6, it is characterized in that, the control source module obtains the multimedia number
According to, and the media data type of the multi-medium data is parsed, including：
Port information of the source module in the network address is controlled to establish with corresponding input/output module to connect, and
The network address is sent to corresponding input/output module；
Receive the multi-medium data of input/output module feedback；
Media data type is parsed from the multi-medium data received, makes input/output module and the media data type pair
The demultiplexing module answered establishes connection, so that the demultiplexing module carries out demultiplexing process to the multi-medium data, obtains
The multi-medium data of video branch or the multi-medium data of audio branch；
The source module with corresponding decoder module is established and connected by the media data type according to the multi-medium data
It connects, including：
The corresponding demultiplexing module of the media data type is controlled to be connected with the corresponding decoder module.
8. the method according to the description of claim 7 is characterized in that the method further includes：
Connection is established and according to video branch and audio branch, control with corresponding modular converter according to default function type
It makes the corresponding decoder module and establishes connection with the corresponding modular converter；
According to video branch and audio branch, the corresponding modular converter is controlled to be established with corresponding rendering module and is connected.
9. according to the method described in claim 8, it is characterized in that, between the demultiplexing module and corresponding decoder module,
Between the decoder module and corresponding rendering module, between the decoder module and corresponding modular converter, the modulus of conversion
Between block and corresponding rendering module, connected using pin interfaces.
10. it is demultiplexed the method according to the description of claim 7 is characterized in that the control media data type is corresponding
It is connected with module with the corresponding decoder module, including：
According to the OS Type of the multimedia playing apparatus, the corresponding demultiplexing module of the media data type is controlled
Support the decoder module of the OS Type is established to connect with corresponding.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711424967.2A CN108063971A (en) | 2017-12-25 | 2017-12-25 | Multimedia playing apparatus and method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711424967.2A CN108063971A (en) | 2017-12-25 | 2017-12-25 | Multimedia playing apparatus and method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108063971A true CN108063971A (en) | 2018-05-22 |
Family
ID=62140173
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711424967.2A Pending CN108063971A (en) | 2017-12-25 | 2017-12-25 | Multimedia playing apparatus and method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108063971A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109379627A (en) * | 2018-11-27 | 2019-02-22 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and storage medium |
| CN110620954A (en) * | 2018-06-20 | 2019-12-27 | 北京优酷科技有限公司 | Video processing method and device for hard solution |
| WO2022135133A1 (en) * | 2020-12-24 | 2022-06-30 | 中兴通讯股份有限公司 | Vr playback synchronization method and apparatus, storage medium, and electronic device |
| CN114827741A (en) * | 2021-01-18 | 2022-07-29 | 武汉斗鱼鱼乐网络科技有限公司 | Live broadcast stream management method and device, electronic equipment and storage medium |
-
2017
- 2017-12-25 CN CN201711424967.2A patent/CN108063971A/en active Pending
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110620954A (en) * | 2018-06-20 | 2019-12-27 | 北京优酷科技有限公司 | Video processing method and device for hard solution |
| CN109379627A (en) * | 2018-11-27 | 2019-02-22 | Oppo广东移动通信有限公司 | Method for processing video frequency, device, electronic equipment and storage medium |
| CN109379627B (en) * | 2018-11-27 | 2020-12-04 | Oppo广东移动通信有限公司 | Video processing method, video processing device, electronic equipment and storage medium |
| WO2022135133A1 (en) * | 2020-12-24 | 2022-06-30 | 中兴通讯股份有限公司 | Vr playback synchronization method and apparatus, storage medium, and electronic device |
| CN114827741A (en) * | 2021-01-18 | 2022-07-29 | 武汉斗鱼鱼乐网络科技有限公司 | Live broadcast stream management method and device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108063971A (en) | Multimedia playing apparatus and method | |
| CN102868908B (en) | High-efficiency streaming media playing method and device | |
| CN109088887A (en) | A kind of decoded method and device of Streaming Media | |
| CN110393921A (en) | Processing method, device, terminal, server and the storage medium of cloud game | |
| CN107027046B (en) | Audio and video processing method and device for assisting live broadcast | |
| CN110347979A (en) | Information sharing method, device and touch control terminal, storage medium of the split screen across application | |
| CN101861577A (en) | System and method for inter-processor communication | |
| CN103995567B (en) | A kind of dual system intelligent interaction all-in-one and its dual system switching method | |
| CN103974111B (en) | By the method, apparatus of the data transfer on intelligent terminal to television terminal | |
| WO2017092561A1 (en) | Method and apparatus for realizing playing of audio and video contents | |
| CN104067627B (en) | Method, device, system and computer-readable medium that a kind of video is redirected | |
| CN103828381B (en) | adaptive PID controller for audio/video clock recovery | |
| JP2006339855A (en) | Network control apparatus, coding system conversion apparatus, and content data reproduction system | |
| CN107438051A (en) | streaming media quick start method, device and system | |
| CN108124158A (en) | Multimedia terminal and the data processing method of multimedia terminal | |
| KR20090033562A (en) | System controlling synchronization of media and multi-device for smmd media service and the method thereof | |
| CN109845280A (en) | Audio and video playing method and device based on Streaming Media | |
| CN110113298A (en) | Data transmission method, device, signal server and computer-readable medium | |
| CN102883213B (en) | Subtitle extraction method and device | |
| CN110448892A (en) | Game implementation method and system based on augmented reality | |
| CN110519331A (en) | A kind of view networked resources processing method and processing device | |
| CN115393490A (en) | Image rendering method and device, storage medium and electronic equipment | |
| WO2016107174A1 (en) | Method and system for processing multimedia file data, player and client | |
| CA2438418A1 (en) | Demultiplexer application programming interface | |
| KR20100029010A (en) | Multiprocessor systems for processing multimedia data and methods thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination |