CN110740383B - Multimedia file management method, terminal device, service device and file management system - Google Patents
Multimedia file management method, terminal device, service device and file management system Download PDFInfo
- Publication number
- CN110740383B CN110740383B CN201810801349.3A CN201810801349A CN110740383B CN 110740383 B CN110740383 B CN 110740383B CN 201810801349 A CN201810801349 A CN 201810801349A CN 110740383 B CN110740383 B CN 110740383B
- Authority
- CN
- China
- Prior art keywords
- multimedia file
- time information
- resolution
- file
- terminal device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000007726 management method Methods 0.000 title claims abstract description 29
- 238000006243 chemical reaction Methods 0.000 claims description 15
- 238000009877 rendering Methods 0.000 claims 6
- 238000012360 testing method Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4621—Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440263—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440281—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the temporal resolution, e.g. by frame skipping
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
The invention provides a multimedia file management method, which is used for a terminal device, and comprises the following steps: receiving a multimedia file; evaluating decoding time information of the multimedia file according to the file format of the multimedia file; recoding the multimedia file according to the decoding time information and the picture refreshing time information of the multimedia file; and playing the re-encoded multimedia file. Therefore, the multimedia playing quality of the terminal device can be improved.
Description
Technical Field
The present invention relates to a file management mechanism, and more particularly, to a multimedia file management method, a terminal device, a service device and a file management system.
Background
With the popularization of cloud technology and internet of things technology, multimedia files such as films played by terminal devices such as electronic digital signage and the like can be pushed by a film server in the background in a unified manner. However, terminal devices set at different locations and/or different points in time may have different device specifications. Therefore, how to improve the playing performance of the multimedia files from the movie server for the terminal devices with different software/hardware specifications is one of the subjects of the research by those skilled in the art.
Disclosure of Invention
The invention provides a multimedia file management method, a terminal device, a service device and a file management system, which can dynamically adjust the file format and/or resolution of a multimedia file to be played by the terminal device so as to improve the multimedia playing quality of the terminal device.
An embodiment of the present invention provides a multimedia file management method for a terminal device, including: receiving a multimedia file; evaluating decoding time information of the multimedia file according to the file format of the multimedia file; recoding the multimedia file according to the decoding time information and the picture refreshing time information of the multimedia file; and playing the re-encoded multimedia file.
Another embodiment of the present invention provides a terminal device, which includes a connection interface, a storage circuit, a display, and a processor. The processor is coupled with the connection interface, the storage circuit and the display. The processor is used for evaluating the decoding time information of the multimedia file according to the file format of the multimedia file. The processor is further configured to re-encode the multimedia file according to the decoding time information and the picture refresh time information of the multimedia file. Further, the processor is also to play the re-encoded multimedia file via the display.
Another embodiment of the present invention provides a service device, which includes a connection interface, a storage circuit, and a processor. The storage circuit is used for storing multimedia files. The processor is coupled to the connection interface and the storage circuit. The processor is used for evaluating the decoding time information of the terminal device for the multimedia file according to the device information of the terminal device and the file format of the multimedia file. The processor is further configured to re-encode the multimedia file according to the decoding time information and the picture refresh time information of the multimedia file. Furthermore, the processor is further configured to transmit the re-encoded multimedia file to the terminal device via the connection interface.
Another embodiment of the present invention provides a file management system, which includes at least one terminal device and a service device. The service device is used for storing multimedia files. The service device is further used for evaluating the decoding time information of the first terminal device for the multimedia file according to the file format of the multimedia file and the device information of the first terminal device in the at least one terminal device. The service device is further used for recoding the multimedia file according to the decoding time information and the picture refreshing time information of the multimedia file. The serving device is also configured to transfer the re-encoded multimedia file to the first terminal device. Furthermore, the first terminal device is used to play the multimedia file that is re-encoded.
Based on the above, the present invention proposes to evaluate the decoding time information of the terminal device for the multimedia file according to the file format of the multimedia file, and re-encode the multimedia file according to the obtained decoding time information and the picture refreshing time information of the multimedia file. Therefore, the terminal device can smoothly play the recoded multimedia file, and the problem of the reduction of the multimedia playing quality of the specific terminal device caused by the inconsistency of the software/hardware specifications of the terminal device is solved.
Drawings
FIG. 1 is a diagram illustrating a file management system according to an embodiment of the invention.
Fig. 2 is a schematic diagram of a terminal device according to an embodiment of the invention.
Fig. 3 is a flowchart illustrating a multimedia file management method according to an embodiment of the invention.
Fig. 4 is a flowchart illustrating a multimedia file management method according to another embodiment of the invention.
Description of reference numerals:
10: a file management system;
11: a service device;
12(1) - (12 (n): a terminal device;
13: a network;
21: a connection interface;
22: a storage circuit;
23: a display;
24: a processor;
s301 to S304, S401 to S405: and (5) carrying out the following steps.
Detailed Description
In order to make the aforementioned and other features and advantages of the invention more comprehensible, embodiments accompanied with figures are described in detail below.
FIG. 1 is a diagram illustrating a file management system according to an embodiment of the invention. Referring to fig. 1, a file management system 10 includes a server 11 and terminal devices 12(1) to 12 (n). The number of n may be any positive integer. In addition, the number of the service devices 11 may be one or more, and the invention is not limited thereto.
The service device 11 and the terminal devices 12(1) to 12(n) may be various electronic devices having data transmission, data storage and data processing functions, such as a desktop computer, an industrial computer, a notebook computer, a smart phone or a tablet computer. In addition, the terminal devices 12(1) to 12(n) may further have a function of playing a multimedia file. In one embodiment, at least one of the terminal devices 12(1) - (12 (n) may also be an electronic billboard, display, or kiosk (kiosk) device.
The service device 11 can communicate with the terminal devices 12(1) to 12(n) via the network 13. In one embodiment, network 13 generally refers to any type of wired connection, such as Ethernet (Ethernet) or the like. In one embodiment, the network 13 generally refers to any type of wireless network, such as a Long Term Evolution (LTE) network or a Wifi network. The invention is not limited to the type of network 13.
The service device 11 may be regarded as a master control device, a management device, or a multimedia data center of the terminal devices 12(1) to 12 (n). For example, the service device 11 may store one or more multimedia files. A multimedia file may be an image file, a sound file, or a composite audio/video file. The service device 11 can provide the same multimedia file to the terminal devices 12(1) to 12(n) in a unified manner for playing, or provide specific multimedia files to the terminal devices 12(1) to 12(n) for playing, respectively.
It should be noted that if one of the terminal devices 12(1) - (12 (n) has poor playing capability (e.g., decoding capability) for a specific type of multimedia file, when the terminal device plays the multimedia file from the service device 11, a delay of video and/or audio in playing the multimedia file may be caused, thereby affecting the experience of the viewer. Therefore, in one embodiment, the terminal devices 12(1) -12 (n) can dynamically adjust the file format and/or the video resolution of the multimedia file from the service device 11 according to their own software/hardware performance, which may cause video and/or audio delay (e.g., re-encode the multimedia file), in an attempt to improve the playing quality (e.g., smoothness) when the multimedia file is subsequently played. Alternatively, in an embodiment, the service device 11 may also dynamically adjust the file format and/or resolution of the multimedia file to be provided to the terminal device according to the software/hardware performance of a specific terminal device, so as to improve the playing quality of the multimedia file played by the terminal device.
Fig. 2 is a schematic diagram of a terminal device according to an embodiment of the invention. The basic circuit configuration of the terminal device 12(1) is described as an example, and the basic circuit configuration of the terminal device 12(1) may be the same as or similar to the basic circuit configuration of the service device 11 and/or any other terminal device.
Referring to fig. 1 and fig. 2, the terminal device 12(1) includes a connection interface 21, a storage circuit 22, a display 23, and a processor 24. The connection interface 21 may include wired and/or wireless connection interface circuitry. The connection interface 21 may connect the terminal apparatus 12(1) to the network 13 and communicate with the service apparatus 11 (and/or other terminal apparatuses 12(2) to 12(n)) via the network 13. For example, the connection interface 21 may include a Network Interface Card (NIC) and/or a wireless network interface card.
The storage circuit 22 may include volatile storage media and non-volatile storage media. For example, the volatile storage medium may be a Random Access Memory (RAM), and the non-volatile storage medium may be a Read Only Memory (ROM), a Solid State Disk (SSD), or a conventional hard disk (HDD), etc. The display 23 is used for displaying images. For example, the Display 23 may be a Liquid Crystal Display (LCD), a Light-Emitting Diode (LED) Display, an Organic Light Emitting Display (OLED), an electrophoretic Display (EPD), or other types of displays.
The processor 24 is coupled to the connection interface 21, the storage circuit 22 and the display 23 and is used for controlling the connection interface 21, the storage circuit 22 and the display 23. In one embodiment, processor 24 may also be responsible for overall operation of terminal device 12 (1). For example, the Processor 24 may be a Central Processing Unit (CPU), or other Programmable general purpose or special purpose microprocessor, Digital Signal Processor (DSP), Programmable controller, Application Specific Integrated Circuit (ASIC), Programmable Logic Device (PLD), or the like or any combination thereof. In addition, the terminal device 12(1) may further include other types of input/output (I/O) interfaces, power supply circuits, and the like, which are not limited in the present invention.
Fig. 3 is a flowchart illustrating a multimedia file management method according to an embodiment of the invention. The following describes a multimedia file management method according to an embodiment of the present invention with reference to the file management system 10 in fig. 1 and the terminal device 12(1) in fig. 2 and the flowchart in fig. 3.
Referring to fig. 1 to fig. 3, in step S301, the terminal device 12(1) receives a multimedia file (hereinafter also referred to as a first multimedia file). For example, the processor 24 of the terminal apparatus 12(1) can receive the first multimedia file from the network 13 via the connection interface 21 and store the received first multimedia file in the storage circuit 22. Further, the first multimedia file may be provided by the service apparatus 11 or provided by any one of the terminal apparatuses 12(2) to 12 (n).
After receiving the first multimedia file, in step S302, the terminal device 12(1) evaluates the decoding time information ds of the first multimedia file according to the file format of the first multimedia file. In an embodiment, the processor 24 of the terminal device 12(1) may calculate, in advance, preset decoding time information of the terminal device 12(1) for decoding an image frame in the multimedia file for each of a plurality of preset file formats, and record the calculated preset decoding time information in a table. This table may be stored in the memory circuit 22.
Taking the following table 1 as an example, the processor 24 can perform decoding tests on multimedia files with three predetermined file formats, i.e., h.264, MPEG, and VP8, and record (average) decoding times ds1 ds3 of one video frame.
TABLE 1
| File format | (average) decoding time of video pictures |
| H.264 | ds1 |
| MPEG | ds2 |
| VP8 | ds3 |
For example, the decoding time ds1 recorded in table 1 can be the (average) decoding time for the processor 24 to decode one video frame of a multimedia file with h.264 file format; the decoding time ds2 recorded in table 1 can be the (average) decoding time of the processor 24 for decoding one video frame of the multimedia file with the MPEG file format; and the decoding time ds3 recorded in table 1 can be the (average) decoding time of the processor 24 for decoding one picture of the multimedia file having the file format of VP 8. In another embodiment, table 1 may record all (or at least part) of the preset decoding time information corresponding to the file format supported by the processor 24 for playing, which is not repeated herein.
In step S302, the processor 24 can read one of the recorded preset decoding time information ds 1-ds 3 from Table 1 as the decoding time information ds of the first multimedia file according to the file format of the first multimedia file. For example, assuming that the file format of the first multimedia file is h.264, the processor 24 may use the information ds1 listed in table 1 as the decoding time information ds of the first multimedia file.
In step S303, the terminal device 12(1) re-encodes the first multimedia file according to the decoding time information ds of the first multimedia file and the picture refreshing time information F _ refresh of the first multimedia file. For example, the frame refresh time information F _ refresh of the first multimedia file may be an inverse number of a refresh rate (FPS) (also referred to as a frame rate) F of the first multimedia file (i.e., F _ refresh ═ 1/F).
For example, in step S303, the processor 24 of the terminal apparatus 12(1) can determine whether the decoding time information ds of the first multimedia file is less than the picture refreshing time information F _ refresh of the first multimedia file. If the decoding time information ds is not less than the frame refreshing time information F _ refresh (i.e. ds is greater than or equal to F _ refresh), it indicates that the terminal apparatus 12(1) may delay the video and/or audio by directly playing the first multimedia file with the original file format. Therefore, if the decoding time information ds is not less than the picture refresh time information F _ refresh, the processor 24 can perform a file format conversion operation on the first multimedia file to re-encode the first multimedia file.
In the file format conversion operation, the file format of the first multimedia file is converted from an original file format (also referred to as a first file format) to a new file format (also referred to as a second file format), and the first file format is different from the second file format. For example, the processor 24 may reselect a file format corresponding to a minimum (or less than the current decoding time ds) decoding time from table 1 above as the new file format (i.e., the second file format) of the first multimedia file. For example, assuming that the original file format (i.e., the first file format) of the first multimedia file is h.264 and ds3< ds2< ds1, the processor 24 may select the file format VP8 corresponding to the decoding time ds3 as the second file format and re-encode the first multimedia file according to the file format VP 8. On the contrary, if the decoding time information ds is less than the frame refreshing time information F _ refresh, the processor 24 may not perform the file format conversion operation.
In step S304, the terminal device 12(1) plays the re-encoded first multimedia file. For example, if the file format of the first multimedia file is converted into a new file format (i.e. the second file format) in step S303, the processor 24 can smoothly play the first multimedia file with the second file format through the display 23.
Fig. 4 is a flowchart illustrating a multimedia file management method according to another embodiment of the invention. The following describes a multimedia file management method according to another embodiment of the present invention with reference to the file management system 10 in fig. 1 and the terminal device 12(1) in fig. 2 and the flowchart in fig. 4. It should be noted that steps S401, S402, and S405 of fig. 4 are the same as or similar to steps S301, S302, and S304 of fig. 3, respectively, and therefore are not repeated herein.
In step S403, the terminal device 12(1) evaluates the frame drawing time information rs of the first multimedia file according to the resolution information P of the first multimedia file. The resolution information P of the first multimedia file reflects the image resolution (e.g. expressed in pixel (pixel) number) of the first multimedia file, and the frame drawing time information rs of the first multimedia file reflects the time required for drawing one (or once) image frame in the first multimedia file. If the image resolution (P value) of the first multimedia file is higher, the time required for drawing one (or one) image frame is often longer. On the contrary, if the image resolution of the first multimedia file is low (the value of P is small), the time required for drawing one (or one) image frame is also small. From another perspective, it can be considered that the resolution information P of the first multimedia file positively correlates to the picture drawing time information rs of the first multimedia file. The processor 24 of the terminal device 12(1) can bring the resolution information P of the first multimedia file into a specific algorithm or a table lookup to obtain the frame drawing time information rs of the first multimedia file.
In step S404, the terminal device 12(1) re-encodes the first multimedia file according to the decoding time information ds of the first multimedia file, the picture drawing time information rs of the first multimedia file, and the picture refreshing time information F _ refresh of the first multimedia file. For example, in step S404, the processor 24 of the terminal apparatus 12(1) may perform the operation of step S303 of fig. 3.
In addition, in step S404, the processor 24 may further determine whether a sum of the decoding time information ds of the first multimedia file and the picture drawing time information rs of the first multimedia file is less than the picture refreshing time information F _ refresh of the first multimedia file. If the sum of the decoding time information ds of the first multimedia file and the drawing time information rs of the first multimedia file is not less than the frame refreshing time information F _ refresh of the first multimedia file (i.e. ds + rs is greater than or equal to F _ refresh), it indicates that the terminal device 12(1) may delay the video and/or audio by directly playing the first multimedia file with the original video resolution. Accordingly, processor 24 may perform a resolution adjustment operation on the first multimedia file to re-encode the first multimedia file.
In the resolution adjustment operation, the processor 24 adjusts the resolution of the first multimedia file from the original resolution (also referred to as the first resolution) to a new resolution (also referred to as the second resolution), and the first resolution is different from the second resolution. For example, the second resolution may be less than the first resolution.
In one embodiment, processor 24 may simply reduce the resolution of the first multimedia file. In an embodiment, the processor 24 may further calculate the resolution adjustment parameter F _ scale of the first multimedia file according to the following equation (1):
assuming that the original resolution information of the first multimedia file is represented as original resolution information in a width direction (W1) multiplied by resolution information in a height direction (H1), the processor 24 may set new resolution information in the width direction of the first multimedia file to (W1xF _ scale) and set new resolution information in the height direction of the first multimedia file to (H1xF _ scale), thereby reducing the resolution of the first multimedia file. Accordingly, the first multimedia file with the second resolution can be played smoothly subsequently. On the contrary, if the sum of the decoding time information ds of the first multimedia file and the drawing time information rs of the first multimedia file is less than the picture refreshing time information F _ refresh of the first multimedia file (i.e. ds + rs is less than F _ refresh), the processor 24 may not perform the resolution adjustment operation.
In summary, in the foregoing embodiment, the processor 24 of the terminal apparatus 12(1) can dynamically determine whether to re-encode the first multimedia file. In particular, in embodiments where it is determined that the first multimedia file is to be re-encoded, the processor 24 may dynamically determine that only the file format conversion operation needs to be performed, only the resolution adjustment operation needs to be performed, or both the file format conversion operation and the resolution adjustment operation need to be performed. In addition, in the embodiment where the file format conversion operation and the resolution adjustment operation are both required to be performed, the file format conversion operation and the resolution adjustment operation may be performed simultaneously or sequentially, and the invention is not limited thereto.
It should be noted that although the foregoing embodiments all use the operation of the terminal device 12(1) as an example, the operation flows of fig. 3 and/or fig. 4 can also be applied to the remaining terminal devices 12(2) -12 (n) in fig. 1. For example, the re-encoded first multimedia files in the terminal devices 12(1) -12 (n) may have different file formats and/or resolutions corresponding to the same first multimedia file (e.g., from the serving device 11) according to the respective software/hardware specifications of the terminal devices 12(1) -12 (n). In addition, more types of file adjustment mechanisms can be adopted in the operation of re-encoding the first multimedia file, and the invention is not limited to only adjusting the file format and resolution of the first multimedia file, as long as the playing quality (e.g., playing fluency) of the terminal device for the first multimedia file can be improved.
In one embodiment, the operation of re-encoding the multimedia file can also be performed in the service device 11. Accordingly, even if the terminal devices 12(1) to 12(n) do not execute the operation flow shown in fig. 3 or 4, the service device 11 can re-encode the multimedia files to be provided to the terminal devices 12(1) to 12(n) according to the device information of the terminal devices 12(1) to 12(n), so as to improve the playing quality (e.g., playing fluency) of the multimedia files by the terminal devices 12(1) to 12 (n).
For example, it is assumed that table 2 below is stored in the storage circuit of the service device 11, and table 2 describes the preset decoding time information for each of the terminal devices 12(1) to 12(3) in a plurality of preset file formats. In other words, the following table 2 describes the device information of the terminal devices 12(1) to 12 (3).
TABLE 2
| File format | Terminal equipment 12(1) | Terminal equipment 12(2) | Terminal apparatus 12(3) |
| H.264 | ds1 | ds4 | ds7 |
| MPEG | ds2 | ds5 | ds8 |
| VP8 | ds3 | ds6 | ds9 |
In table 2, the decoding times ds1, ds4, and ds7 are (average) decoding times for the terminal apparatuses 12(1) to 12(3) to decode one video picture of a multimedia file having a file format of h.264, respectively; the decoding times ds2, ds5, and ds8 are (average) decoding times for the terminal apparatuses 12(1) to 12(3) to decode one video picture of a multimedia file having an MPEG file format, respectively; the decoding times ds3, ds6, and ds8 are (average) decoding times for the terminal apparatuses 12(1) to 12(3) to decode one video picture of the multimedia file having the file format VP 8.
In an embodiment, the decoding times ds 1-ds 3 in table 2 can be obtained by the terminal device 12(1) performing decoding tests on the multimedia files with the three predetermined file formats of h.264, MPEG and VP8, respectively. The decoding times ds 4-ds 6 can be obtained by the terminal device 12(2) performing decoding tests on the multimedia files with the three preset file formats of h.264, MPEG and VP 8. The decoding times ds 7-ds 9 can be obtained by the terminal 12(3) performing decoding tests on the multimedia files with the three preset file formats of h.264, MPEG and VP 8. Alternatively, in an embodiment, the decoding times ds 1-ds 3, ds 4-ds 6, and ds 7-ds 9 in table 2 can be obtained by the processor of the service device 11 performing the analog decoding test according to the specification information (e.g., software/hardware specification) of the terminal devices 12(1) - (12), (3).
In one embodiment, before transmitting a specific multimedia file (e.g., a first multimedia file) to the terminal devices 12(1) to 12(3), the processor of the service device 11 evaluates the decoding time information of the terminal devices 12(1) to 12(3) for the first multimedia file according to the device information of the terminal devices 12(1) to 12(3) and the file format of the first multimedia file. For example, assuming that the original file format of the first multimedia file is h.264, the processor of the service device 11 can obtain the decoding time information of the terminal devices 12(1) -12 (3) for the first multimedia file as ds1, ds4 and ds7, respectively, through the lookup table 2.
After obtaining the decoding time information ds1 of the terminal device 12(1) for the first multimedia file, the processor of the service device 11 can determine whether the first multimedia file to be transmitted to the terminal device 12(1) needs to be re-encoded according to the decoding time information ds1 and the frame refreshing time information F _ refresh of the first multimedia file. After obtaining the decoding time information ds4 of the terminal device 12(2) for the first multimedia file, the processor of the service device 11 can determine whether the first multimedia file to be transmitted to the terminal device 12(2) needs to be re-encoded according to the decoding time information ds4 and the frame refreshing time information F _ refresh of the first multimedia file. After obtaining the decoding time information ds7 of the terminal device 12(3) for the first multimedia file, the processor of the service device 11 can determine whether the first multimedia file to be transmitted to the terminal device 12(3) needs to be re-encoded according to the decoding time information ds7 and the frame refreshing time information F _ refresh of the first multimedia file. Here, the operation details of determining whether the operation of re-encoding the first multimedia file and the operation of re-encoding the first multimedia file (e.g., performing the file format conversion operation) are required according to the decoding time information and the picture refreshing time information of the first multimedia file may refer to step S303 of fig. 3, which is not repeated herein.
In an embodiment, the processor of the service device 11 may further evaluate the frame drawing time information rs of the first multimedia file according to the resolution information P of the first multimedia file. According to the decoding time information ds1, the frame drawing time information rs of the first multimedia file, and the frame refreshing time information F _ refresh of the first multimedia file, the processor of the service device 11 can determine whether the first multimedia file to be transmitted to the terminal device 12(1) needs to be re-encoded. According to the decoding time information ds4, the frame drawing time information rs of the first multimedia file, and the frame refreshing time information F _ refresh of the first multimedia file, the processor of the service device 11 can determine whether the first multimedia file to be transmitted to the terminal device 12(2) needs to be re-encoded. According to the decoding time information ds7, the frame drawing time information rs of the first multimedia file, and the frame refreshing time information F _ refresh of the first multimedia file, the processor of the service device 11 can determine whether the first multimedia file to be transmitted to the terminal device 12(3) needs to be re-encoded. Here, the operation details of the operation of evaluating the frame drawing time information of the first multimedia file, the operation of determining whether the first multimedia file needs to be re-encoded, and the operation of re-encoding the first multimedia file (e.g., performing the resolution adjustment operation) may refer to step S404 of fig. 4, which is not repeated herein.
After re-encoding the first multimedia file to be transmitted to at least one of the terminal devices 12(1) - (12) (3), the connection interface of the service device 11 can transmit the first multimedia file (re-encoded or not re-encoded) to the terminal devices 12(1) - (12) (3) via the network 13 for storage and playing. For example, assuming that the first multimedia file to be transmitted to the terminal devices 12(1) and 12(2) is re-encoded in the service device 11, and the first multimedia file to be transmitted to the terminal devices 12(3) is not re-encoded in the service device 11, the first multimedia file received and played by the terminal devices 12(1) and 12(2) may have a new file format and/or a new resolution, respectively, and the first multimedia file received and played by the terminal devices 12(3) has an original file format and an original resolution. Accordingly, even if the software/hardware performance of the terminal devices 12(1), (12) and (2) is poor, the terminal devices 12(1) to 12(3) can smoothly play the first multimedia file with the same content.
In summary, the present invention provides a method for evaluating decoding time information of a multimedia file by a terminal device according to a file format of the multimedia file, and re-encoding the multimedia file according to the obtained decoding time information and picture refreshing time information of the multimedia file. Therefore, the terminal device can smoothly play the recoded multimedia file, and the problem of the reduction of the multimedia playing quality of the specific terminal device caused by the inconsistency of the software/hardware specifications of the terminal device is solved.
Although the present invention has been described with reference to the above embodiments, it should be understood that various changes and modifications can be made therein by those skilled in the art without departing from the spirit and scope of the invention.
Claims (10)
1. A multimedia file management method is used for a terminal device, and comprises the following steps:
receiving a multimedia file;
evaluating decoding time information of the multimedia file according to a file format of the multimedia file;
evaluating a picture drawing time information of the multimedia file according to a resolution information of the multimedia file;
when the sum of the decoding time information and the picture drawing time information is greater than or equal to picture refreshing time information of the multimedia file, the picture refreshing time information is the reciprocal of the frame rate of the multimedia file, the multimedia file is recoded according to the decoding time information, the picture refreshing time information and the picture drawing time information, and coding format conversion operation and resolution adjustment operation are carried out on the multimedia file during recoding; and
playing the re-encoded multimedia file.
2. The multimedia file management method of claim 1, further comprising:
respectively calculating preset decoding time information of the terminal device for decoding an image frame aiming at a plurality of preset file formats; and
recording the calculated preset decoding time information in a table;
wherein the step of evaluating the decoding time information of the multimedia file according to the file format of the multimedia file comprises:
reading one of the recorded preset decoding time information from the table as the decoding time information of the multimedia file according to the file format of the multimedia file.
3. The multimedia file management method of claim 1, wherein the encoding format conversion operation comprises converting the encoding format of the multimedia file from a first encoding format to a second encoding format, wherein the first encoding format is different from the second encoding format;
the resolution adjustment operation includes adjusting a resolution of the multimedia file from a first resolution to a second resolution, wherein the first resolution is different from the second resolution.
4. A terminal apparatus, comprising:
a connection interface for receiving a multimedia file;
a memory circuit for storing the multimedia file;
a display; and
a processor coupled to the connection interface, the storage circuit and the display;
wherein the processor is configured to evaluate a decoding time information of the multimedia file according to a file format of the multimedia file;
the processor is further configured to evaluate picture rendering time information of the multimedia file according to resolution information of the multimedia file, when the sum of the decoding time information and the picture rendering time information is greater than or equal to picture refreshing time information of the multimedia file, the picture refreshing time information is a reciprocal of a frame rate of the multimedia file, re-encode the multimedia file according to the decoding time information, the picture refreshing time information, and the picture rendering time information, and perform encoding format conversion operation and resolution adjustment operation on the multimedia file during re-encoding;
wherein the processor is also to play the re-encoded multimedia file via the display.
5. The terminal device of claim 4, wherein the processor is further configured to calculate a predetermined decoding time information for the terminal device to decode a video frame for each of a plurality of predetermined file formats;
wherein the processor is further configured to record the calculated preset decoding time information in a table and store the table in the storage circuit;
wherein the processor is further configured to read one of the recorded preset decoding time information from the table as the decoding time information of the multimedia file according to the file format of the multimedia file.
6. The terminal apparatus of claim 4, wherein the encoding format conversion operation comprises converting the encoding format of the multimedia file from a first encoding format to a second encoding format, wherein the first encoding format is different from the second encoding format;
the resolution adjustment operation includes adjusting a resolution of the multimedia file from a first resolution to a second resolution, wherein the first resolution is different from the second resolution.
7. A service device, comprising:
a connection interface;
a memory circuit for storing a multimedia file; and
a processor coupled to the connection interface and the storage circuit;
wherein the processor is configured to evaluate decoding time information of a terminal device for the multimedia file according to device information of the terminal device and a file format of the multimedia file;
the processor is further configured to evaluate picture rendering time information of the multimedia file according to resolution information of the multimedia file, when the sum of the decoding time information and the picture rendering time information is greater than or equal to picture refreshing time information of the multimedia file, the picture refreshing time information is a reciprocal of a frame rate of the multimedia file, re-encode the multimedia file according to the decoding time information, the picture refreshing time information, and the picture rendering time information, and perform encoding format conversion operation and resolution adjustment operation on the multimedia file during re-encoding;
wherein the processor is further configured to transmit the re-encoded multimedia file to the terminal device via the connection interface.
8. The service apparatus of claim 7, wherein the apparatus information includes a predetermined decoding time information for the terminal apparatus to decode a video picture respectively for a plurality of predetermined file formats;
wherein the processor is further configured to store the device information in the memory circuit;
wherein the processor is further configured to read one of the recorded preset decoding time information from the storage circuit according to the file format of the multimedia file as the decoding time information of the multimedia file.
9. The service apparatus of claim 7, wherein the encoding format conversion operation comprises converting the encoding format of the multimedia file from a first encoding format to a second encoding format, wherein the first encoding format is different from the second encoding format;
the resolution adjustment operation includes adjusting a resolution of the multimedia file from a first resolution to a second resolution, wherein the first resolution is different from the second resolution.
10. A file management system, comprising:
at least one terminal device; and
a service device for storing a multimedia file;
wherein the service device is further configured to evaluate a decoding time information of a first terminal device of the at least one terminal device for the multimedia file according to a file format of the multimedia file and device information of the first terminal device;
the service device is further used for evaluating picture drawing time information of the multimedia file according to resolution information of the multimedia file, when the sum of the decoding time information and the picture drawing time information is greater than or equal to picture refreshing time information of the multimedia file, the picture refreshing time information is the reciprocal of the frame rate of the multimedia file, the multimedia file is recoded according to the decoding time information, the picture refreshing time information and the picture drawing time information, and coding format conversion operation and resolution adjustment operation are carried out on the multimedia file during recoding;
wherein the serving device is also to communicate the re-encoded multimedia file to the first terminal device;
wherein the first terminal device is used to play the re-encoded multimedia file.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810801349.3A CN110740383B (en) | 2018-07-20 | 2018-07-20 | Multimedia file management method, terminal device, service device and file management system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810801349.3A CN110740383B (en) | 2018-07-20 | 2018-07-20 | Multimedia file management method, terminal device, service device and file management system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110740383A CN110740383A (en) | 2020-01-31 |
| CN110740383B true CN110740383B (en) | 2021-10-08 |
Family
ID=69235147
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810801349.3A Active CN110740383B (en) | 2018-07-20 | 2018-07-20 | Multimedia file management method, terminal device, service device and file management system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110740383B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6469744B1 (en) * | 1999-07-06 | 2002-10-22 | Hitachi America, Ltd. | Methods and apparatus for encoding, decoding and displaying images in a manner that produces smooth motion |
| CN102263942A (en) * | 2010-05-31 | 2011-11-30 | 苏州闻道网络科技有限公司 | Scalable video transcoding device and method |
| CN102292957A (en) * | 2009-01-29 | 2011-12-21 | 高通股份有限公司 | Multimedia management system for seamless multimedia content mobility |
| CN103310820A (en) * | 2012-03-14 | 2013-09-18 | 三星电子（中国）研发中心 | Method for optimizing multimedia player |
| EP2911406A1 (en) * | 2014-02-25 | 2015-08-26 | Alcatel Lucent | Method and device for encoding a video |
| CN106961629A (en) * | 2016-01-08 | 2017-07-18 | 广州市动景计算机科技有限公司 | A kind of video encoding/decoding method and device |
| CN107249144A (en) * | 2017-05-12 | 2017-10-13 | 北京小鸟看看科技有限公司 | Method, multimedia player and the playback equipment of multimedia file decoding |
| CN107277592A (en) * | 2017-07-26 | 2017-10-20 | 青岛海信电器股份有限公司 | Multimedia data playing method, device and storage medium based on embedded platform |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9942622B2 (en) * | 2014-01-24 | 2018-04-10 | Hiperwall, Inc. | Methods and systems for synchronizing media stream presentations |
-
2018
- 2018-07-20 CN CN201810801349.3A patent/CN110740383B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6469744B1 (en) * | 1999-07-06 | 2002-10-22 | Hitachi America, Ltd. | Methods and apparatus for encoding, decoding and displaying images in a manner that produces smooth motion |
| CN102292957A (en) * | 2009-01-29 | 2011-12-21 | 高通股份有限公司 | Multimedia management system for seamless multimedia content mobility |
| CN102263942A (en) * | 2010-05-31 | 2011-11-30 | 苏州闻道网络科技有限公司 | Scalable video transcoding device and method |
| CN103310820A (en) * | 2012-03-14 | 2013-09-18 | 三星电子（中国）研发中心 | Method for optimizing multimedia player |
| EP2911406A1 (en) * | 2014-02-25 | 2015-08-26 | Alcatel Lucent | Method and device for encoding a video |
| CN106961629A (en) * | 2016-01-08 | 2017-07-18 | 广州市动景计算机科技有限公司 | A kind of video encoding/decoding method and device |
| CN107249144A (en) * | 2017-05-12 | 2017-10-13 | 北京小鸟看看科技有限公司 | Method, multimedia player and the playback equipment of multimedia file decoding |
| CN107277592A (en) * | 2017-07-26 | 2017-10-20 | 青岛海信电器股份有限公司 | Multimedia data playing method, device and storage medium based on embedded platform |
Non-Patent Citations (1)
| Title |
|---|
| 4K 数字电影剪辑技术研究及应用;李稳;《中国优秀硕士学位论文全文数据库-哲学与人文科学辑》;20170315;F087-506 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110740383A (en) | 2020-01-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7205485B2 (en) | Method and streaming server for image processing that optimizes image resolution for VR video and optimizes video streaming bandwidth | |
| US9615112B2 (en) | Method, system, player and mobile terminal for online video playback | |
| US20150156557A1 (en) | Display apparatus, method of displaying image thereof, and computer-readable recording medium | |
| US9369506B2 (en) | Insertion of supplementary content into a segmented content stream | |
| US20080101455A1 (en) | Apparatus and method for multiple format encoding | |
| US20100199151A1 (en) | System and method for producing importance rate-based rich media, and server applied to the same | |
| US11356739B2 (en) | Video playback method, terminal apparatus, and storage medium | |
| US20170134736A1 (en) | Information processing device and method | |
| WO2017080175A1 (en) | Multi-camera used video player, playing system and playing method | |
| CN101692710B (en) | Pseudo random number generator management method device and film grain simulation method device | |
| US11943487B2 (en) | Delivery and playback of content | |
| US8881213B2 (en) | Alignment of video frames | |
| US20240073427A1 (en) | Methods, systems, and apparatuses for enhanced adaptive bitrate segmentation | |
| CN110740383B (en) | Multimedia file management method, terminal device, service device and file management system | |
| US20170264685A1 (en) | Distribution method, distribution request method, and information processing device | |
| TWI688268B (en) | Multimedia file management method, terminal device, server device and file management system | |
| KR20140117889A (en) | Client apparatus, server apparatus, multimedia redirection system and the method thereof | |
| KR20160131827A (en) | System for cloud streaming service, method of image cloud streaming service using alpha level of color bit and apparatus for the same | |
| US20060110067A1 (en) | Digital video media duplication or transmission quality measurement | |
| JP6483850B2 (en) | Data processing method and apparatus | |
| US20210092494A1 (en) | Collaborative media quality determination | |
| CN109302574A (en) | A kind of method and apparatus handling video flowing | |
| US20180199031A1 (en) | Video encoding apparatus and video data amount encoding method | |
| CN113225620B (en) | Video processing method and video processing device | |
| TW201946431A (en) | Video conference system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |