TWI587696B - Method for synchronization of data display - Google Patents
Method for synchronization of data display Download PDFInfo
- Publication number
- TWI587696B TWI587696B TW103131520A TW103131520A TWI587696B TW I587696 B TWI587696 B TW I587696B TW 103131520 A TW103131520 A TW 103131520A TW 103131520 A TW103131520 A TW 103131520A TW I587696 B TWI587696 B TW I587696B
- Authority
- TW
- Taiwan
- Prior art keywords
- media segment
- external device
- time difference
- plays
- local
- Prior art date
Links
Landscapes
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Description
本發明是有關於一種資料分享方法,且特別是有關於一種資料同步播放的方法。 The present invention relates to a data sharing method, and in particular to a method for synchronous playback of data.
隨著行動裝置的普及,無線網路傳輸或雲端服務等應用已與大多數人的日常生活密不可分。為了提升行動裝置與其他裝置之間的互動連結,無線區域網路聯盟(Wi-Fi Alliance)提出以無線方式進行影音分享的技術Miracast或Wi-Fi Display。 With the popularity of mobile devices, applications such as wireless network transmission or cloud services have become inseparable from the daily lives of most people. In order to enhance the interaction between mobile devices and other devices, the Wi-Fi Alliance proposes Miracast or Wi-Fi Display, a technology for wireless video sharing.
在Miracast規格中,將影音播放裝置分為兩類,一類稱為傳送端(source),另一類稱為接收端(sink)。接收端又分為主接收端(primary sink)及次接收端(secondary sink),差別在於主接收端能支援影像或聲音的資料輸出,次接收端只支援聲音的資料輸出。當兩端的裝置建立好無線連線後,會進行設備功能與網路條件的協調,以選擇適合的影音傳輸格式,並建立影音串流的連線協議(session),以控制一連串的影音串流的播放與終止。 In the Miracast specification, video and audio playback devices are divided into two categories, one is called a source and the other is called a sink. The receiving end is further divided into a primary sink and a secondary sink. The difference is that the main receiver can support image or audio output, and the secondary receiver only supports sound data output. When the devices at both ends establish a wireless connection, the device functions and network conditions are coordinated to select a suitable audio and video transmission format, and a video stream connection protocol is established to control a series of video streams. Play and terminate.
因此,兩端的裝置可透過上述的影音分享技術播放 相同的影音資料,但是影音資料經過一連串的壓縮、加密、解密及解壓縮等資料處理後會有傳輸延遲(propagation delay),以致於影音資料無法同步播放。 Therefore, the devices at both ends can be played through the above-mentioned audio-visual sharing technology. The same audio and video data, but the audio and video data after a series of compression, encryption, decryption and decompression and other data processing will have a propagation delay (propagation delay), so that audio and video data can not be played simultaneously.
本發明係有關於一種資料同步播放的方法,可藉由計算時間差並根據時間差修正播放的時程,以達到兩端的裝置同步播放資料。 The invention relates to a method for synchronously playing data, which can correct the playing time according to the time difference by calculating the time difference, so as to achieve synchronized playing data of the devices at both ends.
根據本發明之一方面,提出一種資料同步播放的方法,包括下列步驟。本部裝置播放第一媒體片段,並傳輸第一媒體片段至外部裝置。當外部裝置播放第一媒體片段時,本部裝置開啟收音單元或影像擷取單元,以接收外部裝置播放的第一媒體片段。本部裝置計算外部裝置播放第一媒體片段與本部裝置播放第一媒體片段時的時間差,本部裝置可選擇性的傳輸包含時間差的資訊至外部裝置。本部裝置傳輸第二媒體片段至外部裝置。本部裝置與外部裝置依據計算的時間差同步播放第二媒體片段。 According to an aspect of the present invention, a method for synchronous playback of data is provided, comprising the following steps. The local device plays the first media segment and transmits the first media segment to the external device. When the external device plays the first media segment, the local device turns on the radio unit or the image capturing unit to receive the first media segment played by the external device. The device of the present unit calculates a time difference between when the external device plays the first media segment and when the first device plays the first media segment, and the device of the present device can selectively transmit the information including the time difference to the external device. The local device transmits the second media segment to the external device. The local device and the external device synchronously play the second media segment according to the calculated time difference.
根據本發明之一方面,提出一種資料同步播放的方法,包括下列步驟。本部裝置播放第一媒體片段,並傳輸第一媒體片段至外部裝置。當本部裝置播放第一媒體片段時,外部裝置開啟收音單元,以接收本部裝置播放的第一媒體片段。外部裝置計算外部裝置播放第一媒體片段與本部裝置播放第一媒體片段時的一時間差。外部裝置傳輸包含時間差的資訊至本部裝置。本部裝置傳輸第二媒體片段至外部裝置。本部裝置與外部裝置根據 時間差同步播放第二媒體片段。 According to an aspect of the present invention, a method for synchronous playback of data is provided, comprising the following steps. The local device plays the first media segment and transmits the first media segment to the external device. When the first device plays the first media segment, the external device turns on the radio unit to receive the first media segment played by the local device. The external device calculates a time difference between when the external device plays the first media segment and when the local device plays the first media segment. The external device transmits information including the time difference to the local device. The local device transmits the second media segment to the external device. The unit and the external unit are based on The time difference is synchronized to play the second media segment.
為了對本發明之上述及其他方面有更佳的瞭解,下文特舉較佳實施例,並配合所附圖式,作詳細說明如下: In order to better understand the above and other aspects of the present invention, the preferred embodiments are described below, and in conjunction with the drawings, the detailed description is as follows:
100‧‧‧本部裝置 100‧‧‧Main unit
102‧‧‧外部裝置 102‧‧‧External devices
C1~C6‧‧‧媒體片段 C1~C6‧‧‧Media clip
Tc1~Tc7‧‧‧時點 Tc1~Tc7‧‧‧
第1圖繪示依照本發明一實施例之資料同步播放的方法的流程圖。 FIG. 1 is a flow chart of a method for synchronous playback of data according to an embodiment of the invention.
第2A~2D圖繪示資料同步播放的設備示意圖。 Figure 2A~2D shows a schematic diagram of a device for synchronous playback of data.
第3圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 3 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
第4圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 4 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
第5圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 5 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
第6圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 6 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
第7圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 7 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
第8圖繪示依照本發明另一實施例之資料同步播放的方法的流程圖。 FIG. 8 is a flow chart showing a method for synchronously playing data according to another embodiment of the present invention.
第9圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 9 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
第10圖繪示依照本發明一實施例之資料同步播放的時序圖。 FIG. 10 is a timing diagram of synchronous playback of data according to an embodiment of the invention.
在本實施例之一範例中,提出一種資料同步播放的方法,可應用於電視、機上盒、投影機、智慧型手機、平板裝置及筆記型電腦等電子產品之間的資料傳輸及同步播放。其中,任一裝置可做為傳輸資料的傳送端,在本案中稱之為本部裝置;而 任一裝置可做為接收資料的接收端,在本案中稱之為外部裝置。 在一實施例中,本部裝置可為智慧型手機或平板裝置,而外部裝置可為電視或投影機。此外,本部裝置可為智慧型手機,而外部裝置可為平板裝置等等,本發明對此不加以限制。本方法可透過無線區域網路傳輸資料,亦可以有線網路(纜線)傳輸資料。透過無線分享技術可讓使用者免除連接線材與轉換器規格不一的煩惱,互通性較高,可將圖片、文字、聲音與影像等多媒體資料在不同裝置間共享。目前已知的無線分享技術有air play,WiDi,WiGig,WHDI,MirrorLink及Miracast等。 In an example of the embodiment, a method for synchronous data playback is provided, which can be applied to data transmission and synchronous playback between electronic products such as televisions, set-top boxes, projectors, smart phones, tablet devices, and notebook computers. . Wherein, any device can be used as a transmitting end of the transmission data, which is referred to as a local device in the present case; Any device can be used as a receiving end for receiving data, which is referred to as an external device in this case. In an embodiment, the device can be a smart phone or a tablet device, and the external device can be a television or a projector. In addition, the device of the present invention may be a smart phone, and the external device may be a tablet device or the like, which is not limited by the present invention. The method can transmit data through a wireless local area network, and can also transmit data through a wired network (cable). Through wireless sharing technology, users can avoid the troubles of connecting wires and converters with different specifications. The interoperability is high, and multimedia materials such as pictures, texts, sounds and images can be shared among different devices. Currently known wireless sharing technologies are air play, WiDi, WiGig, WHDI, MirrorLink and Miracast.
以下係提出實施例進行詳細說明,實施例僅用以作為範例說明,並非用以限縮本發明欲保護之範圍。 The embodiments are described in detail below, and the embodiments are only intended to be illustrative and not intended to limit the scope of the invention.
請同時參照第1及2A~2D圖,其中第1圖繪示依照本發明一實施例之資料同步播放的方法的流程圖,第2A~2D圖繪示資料同步播放的設備示意圖。在步驟S110中,本部裝置100播放一第一媒體片段,並傳輸第一媒體片段至一外部裝置102。如第2A圖,當本部裝置100播放一媒體片段“A”時,外部裝置102因為傳輸延遲而無法即時播放媒體片段“A”。 Please refer to FIG. 1 and FIG. 2A to FIG. 2D. FIG. 1 is a flow chart showing a method for synchronously playing data according to an embodiment of the present invention, and FIG. 2A to FIG. 2D are diagrams showing a device for synchronous playback of data. In step S110, the local device 100 plays a first media segment and transmits the first media segment to an external device 102. As shown in FIG. 2A, when the own device 100 plays a media segment "A", the external device 102 cannot play the media segment "A" instantaneously due to the transmission delay.
在步驟S120中,當外部裝置102播放第一媒體片段時,本部裝置100開啟收音單元或影像擷取單元,以接收外部裝置102播放的第一媒體片段。如第2B圖,當外部裝置102播放媒體片段“A”時,本部裝置100可透過麥克風(未繪示)或攝影 機(未繪示)接收外部裝置102播放的媒體片段,此時,本部裝置100正在播放另一媒體片段“B”,因此本部裝置100與外部裝置102尚未同步播放資料。 In step S120, when the external device 102 plays the first media segment, the local device 100 turns on the radio unit or the image capturing unit to receive the first media segment played by the external device 102. As shown in FIG. 2B, when the external device 102 plays the media segment "A", the device 100 can be transmitted through a microphone (not shown) or photographed. The device (not shown) receives the media segment played by the external device 102. At this time, the local device 100 is playing another media segment "B", so the local device 100 and the external device 102 have not synchronized playing the data.
在步驟S130中,本部裝置100依據外部裝置102播放第一媒體片段與本部裝置100播放第一媒體片段時計算一時間差。有關時間差的計算,請參照第3圖至第7圖,稍後再舉例說明。 In step S130, the local device 100 calculates a time difference according to the playing of the first media segment by the external device 102 and the playback of the first media segment by the local device 100. For the calculation of the time difference, please refer to Figures 3 to 7, which will be illustrated later.
在步驟S140中,本部裝置100傳輸一第二媒體片段至外部裝置102。在步驟S150中,本部裝置100與外部裝置102依據時間差同步播放第二媒體片段。如第2C圖,當本部裝置100與外部裝置102因為傳輸延遲而產生的時間差被計算出來後,本部裝置100根據時間差修正播放的時程,例如本部裝置100重複播放媒體片段“B”至少一次,直到外部裝置102播放媒體片段“B”為止。或是,如第2D圖,外部裝置102根據時間差修正播放的時程,例如外部裝置102跳過播放媒體片段“B”,直接播放本部裝置100正在播放的媒體片段“C”。 In step S140, the local device 100 transmits a second media segment to the external device 102. In step S150, the home device 100 and the external device 102 synchronously play the second media segment according to the time difference. As shown in FIG. 2C, after the time difference generated by the local device 100 and the external device 102 due to the transmission delay is calculated, the local device 100 corrects the time course of the playback according to the time difference, for example, the local device 100 repeatedly plays the media segment "B" at least once. Until the external device 102 plays the media segment "B". Alternatively, as shown in FIG. 2D, the external device 102 corrects the time course of the playback based on the time difference. For example, the external device 102 skips playing the media segment "B" and directly plays the media segment "C" being played by the local device 100.
請參照第3圖,其座標的橫軸表示各媒體片段C1~C4播放的時點,而縱軸表示各媒體片段C1~C4在不同裝置上播放的順序。任一媒體片段C1~C4可做為本部裝置100計算時間差的第一媒體片段,例如計算外部裝置102播放媒體片段C1與本部裝置100播放媒體片段C1時的時點,以計算時間差(Tshift=Tc3-Tc1)。 Referring to FIG. 3, the horizontal axis of the coordinates indicates the time at which each of the media segments C1 to C4 is played, and the vertical axis indicates the order in which the media segments C1 to C4 are played on different devices. Any of the media segments C1 C C4 can be used as the first media segment for calculating the time difference for the device 100 , for example, calculating the time when the external device 102 plays the media segment C1 and the local device 100 plays the media segment C1 to calculate the time difference (Tshift=Tc3- Tc1).
接著,請參照第4圖,當時間差(Tshift=Tc3-Tc1)被計算出來後,本部裝置100依據時間差在下一個時點Tc4上重新播放位於時點Tc2上的媒體片段C2,依此類推,本部裝置100可依據時間差修正為在下一個時點上播放排列於較早時點上的媒體片段,以使本部裝置100與外部裝置102同步播放資料。 Next, referring to FIG. 4, after the time difference (Tshift=Tc3-Tc1) is calculated, the local device 100 replays the media segment C2 located at the time point Tc2 at the next time point Tc4 according to the time difference, and so on, the local device 100 The media segment arranged at an earlier time point can be played back at the next time point according to the time difference, so that the home device 100 plays the data synchronously with the external device 102.
接著,請參照第5圖,當時間差(Tshift=Tc3-Tc1)被計算出來後,本部裝置100依據時間差在下一個時點Tc4上重新播放位於時點Tc3上的媒體片段C3至少一次,以減少本部裝置100與外部裝置102播放的時間差,並可減少緩衝用的資料量。也就是說,當外部裝置102播放第一媒體片段(例如媒體片段C1),且本部裝置100正在播放一緩衝媒體片段(例如媒體片段C3)時,本部裝置100根據時間差重複播放緩衝媒體片段至少一次,以減少本部裝置100與外部裝置102播放的時間差。 Next, referring to FIG. 5, after the time difference (Tshift=Tc3-Tc1) is calculated, the local device 100 replays the media segment C3 located at the time point Tc3 at least once according to the time difference at the next time point Tc4 to reduce the local device 100. The time difference from the playback of the external device 102 can reduce the amount of data for buffering. That is, when the external device 102 plays the first media segment (for example, the media segment C1), and the local device 100 is playing a buffered media segment (for example, the media segment C3), the local device 100 repeatedly plays the buffered media segment at least once according to the time difference. In order to reduce the time difference between the playback of the home device 100 and the external device 102.
此外,在第5圖中,當本部裝置100根據時間差(Tshift=Tc3-Tc1)重複播放緩衝媒體片段一次之後,若本部裝置100與外部裝置102之間仍存有時間差時,本部裝置100亦可重新計算外部裝置102播放另一緩衝媒體片段(例如媒體片段C4)與本部裝置100播放該另一緩衝媒體片段(例如媒體片段C4)時的一緩衝時間差(Tshift=Tc6-Tc5)。此時,本部裝置100依據緩衝時間差在下個時點Tc7上重新播放位於時點Tc6上的緩衝媒體片段(例如媒體片段C5)至少一次,以減少本部裝置100與外部裝置102播放的時間差。若本部裝置100與外部裝置102之間仍 存有時間差時,重複上述的步驟,直到本部裝置100與外部裝置102同步播放資料為止。 In addition, in FIG. 5, after the home device 100 repeatedly plays the buffer media segment once according to the time difference (Tshift=Tc3-Tc1), if there is still a time difference between the device 100 and the external device 102, the device 100 can also be used. A buffer time difference (Tshift = Tc6 - Tc5) when the external device 102 plays another buffered media segment (e.g., media segment C4) and the host device 100 plays the other buffered media segment (e.g., media segment C4) is recalculated. At this time, the own device 100 replays the buffer media segment (for example, the media segment C5) located at the time point Tc6 at least once at the next time point Tc7 according to the buffer time difference, so as to reduce the time difference between the playback of the host device 100 and the external device 102. If the front device 100 and the external device 102 are still When there is a time difference, the above steps are repeated until the home device 100 plays the data in synchronization with the external device 102.
在一實施例中,上述的媒體片段C1~C5可分別包含一聲音資訊或一聲音/影像資訊。本部裝置100可透過收音單元來擷取任一媒體片段C1~C5的聲音資訊,以供比對。因此,本部裝置100可經由比對本部裝置100播放第一媒體片段的聲音資訊與外部裝置102播放第一媒體片段的聲音資訊的時點,計算時間差。 In an embodiment, the media segments C1 C C5 may respectively include a sound information or a sound/image information. The device 100 of the present unit can capture the sound information of any of the media segments C1 C C5 through the radio unit for comparison. Therefore, the home device 100 can calculate the time difference by comparing the sound information of the first media segment to the sound information of the first media segment and the external device 102 playing the sound information of the first media segment.
在另一實施例中,上述的媒體片段C1~C5可分別包含一影像資訊或一聲音/影像資訊。本部裝置100可透過影像擷取單元來擷取任一媒體片段C1~C5的影像資訊,以供比對。因此,本部裝置100可經由比對本部裝置100播放第一媒體片段的影像資訊與外部裝置102播放第一媒體片段的影像資訊的時點,計算時間差。 In another embodiment, the media segments C1 C C5 may respectively include an image information or a sound/image information. The device 100 of the device can capture the image information of any of the media segments C1 C C5 through the image capturing unit for comparison. Therefore, the home device 100 can calculate the time difference by comparing the video information of the first media segment with the video information of the first device segment and the video information of the first media segment by the external device 102.
在又一實施例中,上述的媒體片段C1~C5可分別包含一時序資訊。當本部裝置100傳輸任一媒體片段C1~C5至外部裝置102時,本部裝置100可透過加密單元將時序資訊加密到各媒體片段C1~C5中。此外,當本部裝置100接收外部裝置102播放的任一媒體片段C1~C5時,本部裝置100可透過解密單元從任一媒體片段C1~C5中解密時序資訊,以得知媒體片段C1~C5播放的時序,以供比對。因此,本部裝置100可根據時序資訊計算時間差。 In still another embodiment, the media segments C1 C C5 may include a timing information. When the local device 100 transmits any of the media segments C1 C C5 to the external device 102, the local device 100 can encrypt the time series information into the media segments C1 C C5 through the encryption unit. In addition, when the local device 100 receives any of the media segments C1 C C5 played by the external device 102, the local device 100 can decrypt the timing information from any of the media segments C1 C C5 through the decryption unit to learn that the media segments C1 C C5 are played. Timing for comparison. Therefore, the device 100 of the present embodiment can calculate the time difference based on the time series information.
上述的時序資訊加密技術可在一聲音資訊或一聲音/影像資訊中加入一編碼資訊,並隨同聲音資訊或聲音/影像資訊傳輸至外部裝置102。當外部裝置102播放聲音資訊或聲音/影像資訊時,此編碼資訊將以人耳無法辨識的高頻訊號發出,以供本部裝置100準確地辨識時序資訊。如此,當外部裝置102在播放媒體片段的聲音資訊或聲音/影像資訊時,人耳不會接收到此高頻訊號,但本部裝置100的收音單元仍可接收此高頻訊號,以計算時間差。同時,可避免聲音資訊與時序資訊在傳送時發生訊號間的干擾。 The above-described sequential information encryption technology can add an encoded information to a sound information or a sound/image information, and transmit the sound information or sound/image information to the external device 102 along with the sound information. When the external device 102 plays the sound information or the sound/image information, the encoded information will be sent out by the high frequency signal that is not recognizable by the human ear, so that the device 100 can accurately recognize the time series information. Thus, when the external device 102 plays the sound information or the sound/video information of the media segment, the human ear does not receive the high frequency signal, but the radio unit of the device 100 of the present device can still receive the high frequency signal to calculate the time difference. At the same time, it can avoid the interference between the sound information and the timing information when the signal is transmitted.
請參照第6圖,當時間差(Tshift=Tc3-Tc1)被計算出來後,本部裝置100更可傳輸包含時間差的資訊至外部裝置102。外部裝置102根據時間差修正播放的時程,例如外部裝置102原本在下一個時點Tc4上要播放媒體片段C2,但根據時間差得知本部裝置100在下一個時點Tc4上要播放媒體片段C4,因此外部裝置102跳過播放媒體片段C2及C3,直接播放本部裝置100正要播放的媒體片段C4(即第二媒體片段)。因此,本部裝置100與外部裝置102可同步播放資料。 Referring to FIG. 6, when the time difference (Tshift=Tc3-Tc1) is calculated, the local device 100 can transmit information including the time difference to the external device 102. The external device 102 corrects the time course of the playback according to the time difference. For example, the external device 102 originally plays the media segment C2 at the next time point Tc4, but according to the time difference, it is known that the local device 100 is to play the media segment C4 at the next time point Tc4, so the external device 102 Skip playing media clips C2 and C3 and directly play the media clip C4 (ie, the second media clip) that the host device 100 is about to play. Therefore, the front device 100 and the external device 102 can play back the data in synchronization.
接著,請參照第7圖,當時間差(Tshift=Tc3-Tc1)被計算出來後,本部裝置100傳輸包含時間差的資訊至外部裝置102。此時,外部裝置102依據時間差跳過播放媒體片段C2,直接在下一個時點Tc4上播放一緩衝媒體片段C3,以減少本部裝置100與外部裝置102播放的時間差,並可減少緩衝用的資料量。 若本部裝置100與外部裝置102之間仍存有時間差時,本部裝置100亦可重新計算外部裝置102播放緩衝媒體片段(例如媒體片段C4)與本部裝置100播放該緩衝媒體片段(例如媒體片段C4)時的一緩衝時間差(Tshift=Tc5-Tc4)。接著,本部裝置100傳輸包含緩衝時間差的資訊至外部裝置102。此時,外部裝置102依據緩衝時間差跳過播放媒體片段C5,直接播放本部裝置100正要播放的另一媒體片段C6。若本部裝置100與外部裝置102之間仍存有時間差時,重複上述的步驟,直到本部裝置100與外部裝置102同步播放資料為止。 Next, referring to FIG. 7, when the time difference (Tshift=Tc3-Tc1) is calculated, the own device 100 transmits information including the time difference to the external device 102. At this time, the external device 102 skips playing the media segment C2 according to the time difference, and directly plays a buffered media segment C3 at the next time point Tc4, so as to reduce the time difference between the playback of the host device 100 and the external device 102, and reduce the amount of data for buffering. If there is still a time difference between the device 100 and the external device 102, the device 100 can recalculate the external device 102 to play the buffered media segment (eg, the media segment C4) and the host device 100 to play the buffered media segment (eg, the media segment C4). A buffer time difference (Tshift = Tc5 - Tc4). Next, the own device 100 transmits information including the buffer time difference to the external device 102. At this time, the external device 102 skips playing the media segment C5 according to the buffer time difference, and directly plays another media segment C6 that the own device 100 is about to play. If there is still a time difference between the own device 100 and the external device 102, the above steps are repeated until the home device 100 plays the data in synchronization with the external device 102.
請參照第8圖,其繪示依照本發明另一實施例之資料同步播放的方法的流程圖。步驟S210、S240、S250與第一實施例的步驟S110、S140、S150相同,本實施例與第一實施例不同之處在於,在步驟S220中,當該本部裝置100播放該第一媒體片段時,外部裝置102開啟一收音單元,以接收本部裝置100播放的第一媒體片段,例如外部裝置102可透過麥克風(未繪示)接收本部裝置100播放的第一媒體片段。在步驟S230中,該外部裝置102計算該外部裝置102播放該第一媒體片段與該本部裝置100播放該第一媒體片段時的一時間差,並傳輸包含該時間差的資訊至該本部裝置100。 Please refer to FIG. 8 , which is a flowchart of a method for synchronous playback of data according to another embodiment of the present invention. Steps S210, S240, and S250 are the same as steps S110, S140, and S150 of the first embodiment. The difference between this embodiment and the first embodiment is that, in step S220, when the first device 100 plays the first media segment. The external device 102 turns on a radio unit to receive the first media segment played by the local device 100. For example, the external device 102 can receive the first media segment played by the local device 100 through a microphone (not shown). In step S230, the external device 102 calculates a time difference between the playback of the first media segment by the external device 102 and the playback of the first media segment by the local device 100, and transmits information including the time difference to the local device 100.
有關時間差的計算,請參照第9和10圖,稍受再詳細說明。在一實施例中,媒體片段C1~C5可分別包含一聲音資 訊或一聲音/影像資訊。外部裝置102可透過收音單元來擷取任一媒體片段C1~C5的聲音資訊,以供比對。因此,外部裝置102可經由比對本部裝置100播放第一媒體片段的聲音資訊與外部裝置102播放第一媒體片段的聲音資訊的時點,計算時間差。 For the calculation of the time difference, please refer to Figures 9 and 10, which will be described in detail. In an embodiment, the media segments C1 C C5 may respectively include a voice resource. News or a sound/image information. The external device 102 can capture the sound information of any of the media segments C1 C C5 through the radio unit for comparison. Therefore, the external device 102 can calculate the time difference by comparing the sound information of the first media segment to the sound information of the first media segment and the external device 102 playing the sound information of the first media segment.
在另一實施例中,上述的媒體片段C1~C5可分別包含一影像資訊或一聲音/影像資訊。外部裝置102可透過影像擷取單元來擷取任一媒體片段C1~C5的影像資訊,以供比對。因此,外部裝置102可經由比對本部裝置100播放第一媒體片段的影像資訊與外部裝置102播放第一媒體片段的影像資訊的時點,計算時間差。 In another embodiment, the media segments C1 C C5 may respectively include an image information or a sound/image information. The external device 102 can capture the image information of any of the media segments C1 C C5 through the image capturing unit for comparison. Therefore, the external device 102 can calculate the time difference by comparing the video information of the first media segment with the video information of the first media segment and the video information of the first media segment by the external device 102.
在又一實施例中,上述的媒體片段C1~C5可分別包含一時序資訊。當本部裝置100傳輸任一媒體片段C1~C5至外部裝置102時,本部裝置100可透過加密單元將時序資訊加密到各媒體片段C1~C5中。此外,當外部裝置102接收本部裝置100播放的任一媒體片段C1~C5時,外部裝置102可透過解密單元從任一媒體片段C1~C5中解密時序資訊,以得知媒體片段C1~C5播放的時序,以供比對。因此,外部裝置102可根據時序資訊計算時間差。 In still another embodiment, the media segments C1 C C5 may include a timing information. When the local device 100 transmits any of the media segments C1 C C5 to the external device 102, the local device 100 can encrypt the time series information into the media segments C1 C C5 through the encryption unit. In addition, when the external device 102 receives any of the media segments C1 C C5 played by the device 100, the external device 102 can decrypt the timing information from any of the media segments C1 C C5 through the decryption unit to learn that the media segments C1 C C5 play. Timing for comparison. Therefore, the external device 102 can calculate the time difference based on the time series information.
上述的時序資訊加密技術可在一聲音資訊或一聲音/影像資訊中加入一編碼資訊,並隨同聲音資訊或聲音/影像資訊傳輸至外部裝置102。當本部裝置100播放聲音資訊或聲音/影像資訊時,此編碼資訊將以人耳無法辨識的高頻訊號發出,以供外 部裝置102準確地辨識時序資訊。如此,當本部裝置100在播放媒體片段的聲音資訊或聲音/影像資訊時,人耳不會接收到此高頻訊號,但外部裝置102的收音單元仍可接收此高頻訊號,以計算時間差。同時,可避免聲音資訊與時序資訊在傳送時發生訊號間的干擾。 The above-described sequential information encryption technology can add an encoded information to a sound information or a sound/image information, and transmit the sound information or sound/image information to the external device 102 along with the sound information. When the device 100 of the headquarters plays sound information or sound/image information, the coded information will be sent out with high frequency signals that are not recognizable by the human ear for external use. The device 102 accurately recognizes the timing information. Thus, when the local device 100 plays the sound information or the audio/video information of the media segment, the human ear does not receive the high frequency signal, but the radio unit of the external device 102 can still receive the high frequency signal to calculate the time difference. At the same time, it can avoid the interference between the sound information and the timing information when the signal is transmitted.
請參照第9圖,當時間差(Tshift=Tc3-Tc1)被計算出來後,外部裝置102傳輸包含時間差的資訊至本部裝置100。本部裝置100根據時間差修正播放的時程,例如本部裝置100原本在下一個時點Tc4上要播放媒體片段C4,但根據時間差得知外部裝置102在下一個時點Tc4上要播放媒體片段C2。因此,本部裝置100依據時間差在下一個時點Tc4上重新播放位於時點Tc2上的媒體片段C2,以使本部裝置100與外部裝置102同步播放資料。 Referring to FIG. 9, when the time difference (Tshift=Tc3-Tc1) is calculated, the external device 102 transmits information including the time difference to the home device 100. The own device 100 corrects the time course of the playback according to the time difference. For example, the local device 100 originally plays the media segment C4 at the next time point Tc4, but according to the time difference, the external device 102 is required to play the media segment C2 at the next time point Tc4. Therefore, the device 100 of the present embodiment replays the media segment C2 located at the time point Tc2 at the next time point Tc4 in accordance with the time difference, so that the own device 100 and the external device 102 play the material in synchronization.
接著,請參照第10圖,當時間差(Tshift=Tc3-Tc1)被計算出來後,外部裝置102傳輸包含時間差的資訊至本部裝置100。此時,本部裝置100依據時間差在下一個時點Tc4上重新播放位於時點Tc3上的一緩衝媒體片段C3至少一次,以減少本部裝置100與外部裝置102播放的時間差,並可減少緩衝用的資料量。也就是說,當外部裝置102播放第一媒體片段(例如媒體片段C1),且本部裝置100正在播放一緩衝媒體片段(例如媒體片段C3)時,本部裝置100根據時間差重複播放緩衝媒體片段至少一次,以減少本部裝置100與外部裝置102播放的時間差。 Next, referring to FIG. 10, when the time difference (Tshift=Tc3-Tc1) is calculated, the external device 102 transmits information including the time difference to the own device 100. At this time, the own device 100 replays a buffered media segment C3 located at the time point Tc3 at least once at the next time point Tc4 according to the time difference, so as to reduce the time difference between the playback of the host device 100 and the external device 102, and reduce the amount of data for buffering. That is, when the external device 102 plays the first media segment (for example, the media segment C1), and the local device 100 is playing a buffered media segment (for example, the media segment C3), the local device 100 repeatedly plays the buffered media segment at least once according to the time difference. In order to reduce the time difference between the playback of the home device 100 and the external device 102.
此外,在第10圖中,若本部裝置100與外部裝置102之間仍存有時間差時,外部裝置102亦可重新計算外部裝置102播放緩衝媒體片段(例如媒體片段C4)與本部裝置100播放該緩衝媒體片段(例如媒體片段C4)時的一緩衝時間差(Tshift=Tc6-Tc5)。接著,外部裝置102傳輸包含緩衝時間差的資訊至本部裝置100。此時,本部裝置100依據緩衝時間在下個時點Tc7上重新播放位於時點Tc6上的緩衝媒體片段(例如媒體片段C5)至少一次,以減少本部裝置100與外部裝置102播放的時間差。若本部裝置100與外部裝置102之間仍存有時間差時,重複上述的步驟,直到本部裝置100與外部裝置102同步播放資料為止。 In addition, in FIG. 10, if there is still a time difference between the local device 100 and the external device 102, the external device 102 may recalculate the external device 102 to play the buffered media segment (eg, the media segment C4) and the local device 100 to play the A buffer time difference (Tshift = Tc6 - Tc5) when buffering a media segment (e.g., media segment C4). Next, the external device 102 transmits information including the buffer time difference to the home device 100. At this time, the own device 100 replays the buffer media segment (for example, the media segment C5) located at the time point Tc6 at least once according to the buffer time at the next time point Tc7 to reduce the time difference between the playback of the host device 100 and the external device 102. If there is still a time difference between the own device 100 and the external device 102, the above steps are repeated until the home device 100 plays the data in synchronization with the external device 102.
本實施例中,若外部裝置102的緩衝空間夠大的話,可提早接收更多的媒體片段並儲存時,亦可採用如第6、7圖的方式實施,其差異僅在於本實施例中以外部裝置102來計算時間差,而不是由本部裝置100計算時間差之後再傳輸給外部裝置102。因此,外部裝置102可根據該時間差直接播放第二媒體片段,以使本部裝置100與外部裝置102同時播放資料。此外,外部裝置102亦可根據時間差播放至少一緩衝媒體片段(例如媒體片段C3、C4),以減少時間差。接著,外部裝置102重新計算該外部裝置102播放緩衝媒體片段(例如媒體片段C4)與該本部裝置100播放該緩衝媒體片段(例如媒體片段C4)時的一緩衝時間差。此時,外部裝置102依據緩衝時間差跳過播放媒體片段C5,直接播放本 部裝置100正要播放的另一媒體片段C6。若本部裝置100與外部裝置102之間仍存有時間差時,重複上述的步驟,直到本部裝置100與外部裝置102同步播放資料為止。 In this embodiment, if the buffer space of the external device 102 is large enough, more media segments can be received early and stored, and the method can be implemented as shown in FIGS. 6 and 7. The difference is only in this embodiment. The external device 102 calculates the time difference instead of transmitting the time difference by the own device 100 before transmitting it to the external device 102. Therefore, the external device 102 can directly play the second media segment according to the time difference, so that the local device 100 and the external device 102 simultaneously play the data. In addition, the external device 102 can also play at least one buffered media segment (eg, media segments C3, C4) according to the time difference to reduce the time difference. Next, the external device 102 recalculates a buffer time difference between the playback of the buffered media segment (eg, media segment C4) by the external device 102 and the playback of the buffered media segment (eg, media segment C4) by the native device 100. At this time, the external device 102 skips playing the media segment C5 according to the buffer time difference, and directly plays the video. Another media segment C6 that the device 100 is about to play. If there is still a time difference between the own device 100 and the external device 102, the above steps are repeated until the home device 100 plays the data in synchronization with the external device 102.
本發明上述實施例所揭露之資料同步播放的方法,係藉由計算時間差並根據時間差修正播放的時程,以達到本部裝置及外部裝置同步播放資料,不需增加額外複雜的計算流程或傳輸協定,適用於任何現有影音分享的播放裝置上,使用上更方便。 The method for synchronously playing data disclosed in the above embodiments of the present invention is to calculate the time difference and correct the time course of the playback according to the time difference, so as to achieve synchronous playback of the data by the local device and the external device without adding an extra complicated calculation process or transmission protocol. It is suitable for any existing audio-visual sharing device and is more convenient to use.
綜上所述,雖然本發明已以較佳實施例揭露如上,然其並非用以限定本發明。本發明所屬技術領域中具有通常知識者,在不脫離本發明之精神和範圍內,當可作各種之更動與潤飾。因此,本發明之保護範圍當視後附之申請專利範圍所界定者為準。 In conclusion, the present invention has been disclosed in the above preferred embodiments, and is not intended to limit the present invention. A person skilled in the art can make various changes and modifications without departing from the spirit and scope of the invention. Therefore, the scope of the invention is defined by the scope of the appended claims.
S110、S120、S130、S140、S150‧‧‧各個步驟 S110, S120, S130, S140, S150‧‧‧ steps
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW103131520A TWI587696B (en) | 2014-09-12 | 2014-09-12 | Method for synchronization of data display |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW103131520A TWI587696B (en) | 2014-09-12 | 2014-09-12 | Method for synchronization of data display |
Publications (2)
Publication Number | Publication Date |
---|---|
TW201611595A TW201611595A (en) | 2016-03-16 |
TWI587696B true TWI587696B (en) | 2017-06-11 |
Family
ID=56085329
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
TW103131520A TWI587696B (en) | 2014-09-12 | 2014-09-12 | Method for synchronization of data display |
Country Status (1)
Country | Link |
---|---|
TW (1) | TWI587696B (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060161835A1 (en) * | 2005-01-20 | 2006-07-20 | Microsoft Corporation | Audio and video buffer synchronization based on actual output feedback |
TW201043027A (en) * | 2009-05-22 | 2010-12-01 | Acer Inc | Video sharing system and a method thereof |
US20130117413A1 (en) * | 2010-07-20 | 2013-05-09 | Sharp Kabushiki Kaisha | Content distribution device, content playback device, content distribution system, method for controlling a content distribution device, control program, and recording medium |
-
2014
- 2014-09-12 TW TW103131520A patent/TWI587696B/en not_active IP Right Cessation
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060161835A1 (en) * | 2005-01-20 | 2006-07-20 | Microsoft Corporation | Audio and video buffer synchronization based on actual output feedback |
TW201043027A (en) * | 2009-05-22 | 2010-12-01 | Acer Inc | Video sharing system and a method thereof |
US20130117413A1 (en) * | 2010-07-20 | 2013-05-09 | Sharp Kabushiki Kaisha | Content distribution device, content playback device, content distribution system, method for controlling a content distribution device, control program, and recording medium |
Also Published As
Publication number | Publication date |
---|---|
TW201611595A (en) | 2016-03-16 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6702455B2 (en) | Display device, display control method, and computer program | |
KR102305302B1 (en) | Direct streaming for wireless display | |
KR102284721B1 (en) | Method and apparatus for displaying application data in wireless communication system | |
US11606596B2 (en) | Methods, systems, and media for synchronizing audio and video content on multiple media devices | |
US8607284B2 (en) | Method of outputting video content from a digital media server to a digital media renderer and related media sharing system | |
KR20140091021A (en) | Control method and device using same | |
JP5841715B2 (en) | VIDEO / AUDIO OUTPUT DEVICE, VIDEO / AUDIO OUTPUT SYSTEM, AND MASTER DEVICE | |
JP2018514129A (en) | Multi-layer timing synchronization framework | |
US20140365685A1 (en) | Method, System, Capturing Device and Synchronization Server for Enabling Synchronization of Rendering of Multiple Content Parts, Using a Reference Rendering Timeline | |
CN103314599A (en) | Mechanism for clock recovery for streaming content being communicated over a packetized communication network | |
US20210195256A1 (en) | Decoder equipment with two audio links | |
JP2017147594A (en) | Audio apparatus | |
JP5739015B2 (en) | COMMUNICATION DEVICE, COMMUNICATION METHOD, AND PROGRAM | |
CN104243850B (en) | The method that data is played simultaneously | |
JP4986229B2 (en) | Receiving system, receiving apparatus and program for receiving and simultaneously reproducing different types of synchronized streaming data | |
TWI587696B (en) | Method for synchronization of data display | |
JP2014131142A (en) | Receiver, reception method and program, imaging apparatus, imaging method and program, transmitter, transmission method and program | |
US20190028522A1 (en) | Transmission of subtitle data for wireless display | |
KR101480653B1 (en) | Method for controlling output of sound in mirrorlink | |
US20170374243A1 (en) | Method of reducing latency in a screen mirroring application and a circuit of the same | |
US10264241B2 (en) | Complimentary video content | |
JP2017225164A (en) | Receiving device, receiving method, transmitting device, transmitting method, and program | |
US20150088994A1 (en) | Image display apparatus, server, method for operating the image display apparatus, and method for operating the server | |
JP2024503063A (en) | Dongle to convert format to ATSC3.0 low power radio | |
CN116456138A (en) | Mirror image screen projection system and method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
MM4A | Annulment or lapse of patent due to non-payment of fees |