WO2022242461A1 - Procédé et appareil de traitement d'un flux audio/vidéo en direct, client et serveur - Google Patents

Procédé et appareil de traitement d'un flux audio/vidéo en direct, client et serveur Download PDF

Info

Publication number
WO2022242461A1
WO2022242461A1 PCT/CN2022/090942 CN2022090942W WO2022242461A1 WO 2022242461 A1 WO2022242461 A1 WO 2022242461A1 CN 2022090942 W CN2022090942 W CN 2022090942W WO 2022242461 A1 WO2022242461 A1 WO 2022242461A1
Authority
WO
WIPO (PCT)
Prior art keywords
audio
video
target
client
live
Prior art date
Application number
PCT/CN2022/090942
Other languages
English (en)
Chinese (zh)
Inventor
陈迪川
Original Assignee
北京字节跳动网络技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京字节跳动网络技术有限公司 filed Critical 北京字节跳动网络技术有限公司
Publication of WO2022242461A1 publication Critical patent/WO2022242461A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/2187—Live feed
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/239—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests
    • H04N21/2393—Interfacing the upstream path of the transmission network, e.g. prioritizing client content requests involving handling client requests
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60—Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63—Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/643—Communication protocols
    • H04N21/6437—Real-time Transport Protocol [RTP]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments

Definitions

  • the present disclosure relates to the field of live broadcast technology, and in particular to a live audio and video processing method, device, client and server.
  • Webcasting has become a popular trend in providing interactive channels to users.
  • the anchor can live broadcast content such as commodity shopping, game experience, music playback and other content in the virtual live broadcast room, so that the audience can watch the live broadcast content in time in the virtual live broadcast room, enriching the entertainment life of users.
  • anchors or viewers have a need to download live content.
  • the host can attract more viewers through the live broadcast highlights (that is, the highlights of the live broadcast) in the live broadcast content, which is beneficial to increase the attention of the host.
  • viewers can help the anchor attract more viewers by live broadcasting highlight clips, so that viewers can complete sharing tasks.
  • the present disclosure provides a live audio and video processing method, device, client and server.
  • the present disclosure provides a method for processing live audio and video, including:
  • the client sends a first request to the server, and the first request is used to request the live audio and video of the target period;
  • the client receives the first message from the server, the first message is used to indicate the download address of the target audio and video slice within the target time period, the download address of the target audio and video slice is obtained by the server from the audio and video file, and the audio and video file stores The download address of each audio and video slice;
  • the client downloads the target audio and video slice based on the download address of the target audio and video slice;
  • the client splices the target audio and video slices sequentially according to the live broadcast sequence of the target audio and video slices to obtain the live audio and video of the target period.
  • the client splices the target audio and video slices sequentially according to the live broadcast sequence of the target audio and video slices to obtain the live audio and video of the target period, including:
  • the client splices the target audio and video slices sequentially according to the order of the live broadcast time of the target audio and video slices from small to large, and obtains the live audio and video of the target time period;
  • the target audio and video slices are sequentially spliced according to the order in which the target audio and video slices are downloaded first to last, to obtain Live audio and video of the target time period.
  • the method further includes: the client deletes the target audio and video slice.
  • the live broadcast duration of the target period is the initial time when the first request is sent, and a preset duration before the initial time.
  • the client sends the first request to the server, including: the client receives the first operation performed by the user on the first control of the client; the client sends the first request to the server in response to the first operation .
  • the present disclosure provides a method for processing live audio and video, including:
  • the server receives a first request from the client, and the first request is used to request the live audio and video of the target period;
  • the server obtains the download address of the target audio and video slice in the target period from the audio and video file, and the download address of each audio and video slice is stored in the audio and video file;
  • the server sends a first message to the client.
  • the first message is used to indicate the download address of the target audio and video slice, so that the client can download the target audio and video slice based on the download address of the target audio and video slice, and follow the live broadcast of the target audio and video slice.
  • the target audio and video slices are spliced sequentially to obtain the live audio and video of the target time period.
  • the server obtains the download address of the target audio and video slice in the target period from the audio and video file, including: the server obtains the audio and video file from the server corresponding to the content distribution network; the server parses the audio and video file , to obtain the download address of the target audio and video slice.
  • the present disclosure provides a live audio and video processing device, including:
  • the first sending module is used to send a first request to the server, and the first request is used to request the live audio and video of the target time period;
  • the first receiving module is configured to receive a first message from the server, the first message is used to indicate the download address of the target audio and video slice within the target time period, the download address of the target audio and video slice is obtained by the server from the audio and video file, and the audio and video The download address of each audio and video slice is stored in the video file;
  • the download module is used to download the target audio and video slice based on the download address of the target audio and video slice;
  • the splicing module is configured to sequentially splice the target audio and video slices according to the live broadcast sequence of the target audio and video slices, so as to obtain the live audio and video of the target period.
  • the splicing module is specifically configured to splice the target audio and video slices sequentially according to the order of the live broadcast time of the target audio and video slices from small to large, to obtain the live audio and video of the target time period.
  • the splicing module is specifically used to download the target audio and video slices according to the sequence of downloading the target audio and video slices from small to large In order, the target audio and video slices are spliced sequentially to obtain the live audio and video of the target time period.
  • the device also includes:
  • the deletion module is used to delete the target audio and video slice after the splicing module obtains the live audio and video of the target period.
  • the live broadcast duration of the target period is the initial time when the first request is sent, and a preset duration before the initial time.
  • the first sending module is specifically configured to receive a first operation performed by the user on the first control of the client; and send the first request to the server in response to the first operation.
  • the device also includes:
  • the playing module is configured to receive a second operation performed by the user on the second control of the client; in response to the second operation, play the live audio and video of the target period in the client.
  • the present disclosure provides a live audio and video processing device, including:
  • the second receiving module is used to receive the first request from the client, and the first request is used to request the live audio and video of the target period;
  • the obtaining module is used to obtain the download address of the target audio and video slice in the target period from the audio and video file, and the download address of each audio and video slice is stored in the audio and video file;
  • the second sending module is configured to send a first message to the client, the first message is used to indicate the download address of the target audio and video slice, so that the client downloads the target audio and video slice based on the download address of the target audio and video slice, and according to The live broadcast sequence of the target audio and video slices, the target audio and video slices are spliced sequentially to obtain the live audio and video of the target time period.
  • the obtaining module is specifically configured to obtain audio and video files from a server corresponding to the content distribution network; analyze the audio and video files to obtain a download address of a target audio and video slice.
  • the live broadcast duration of the target period is the initial time when the first request is sent, and a preset duration before the initial time.
  • the present disclosure provides a client, including: a memory and a processor; the memory is used to store program instructions; the processor is used to call the program instructions in the memory so that the client executes any one of the first aspect and the first aspect. Live audio and video processing methods in possible designs.
  • the present disclosure provides a server, including: a memory and a processor; the memory is used to store program instructions; and the processor is used to call the program instructions in the memory so that the server executes any one of the second aspect and the second aspect.
  • the live audio and video processing method in the design including: a processor; the memory is used to store program instructions; and the processor is used to call the program instructions in the memory so that the server executes any one of the second aspect and the second aspect.
  • the present disclosure provides a computer storage medium, including computer instructions.
  • the computer instructions When the computer instructions are run on the electronic device, the electronic device executes the live audio and video in any possible design of the first aspect and the first aspect.
  • the present disclosure provides a computer program product that, when the computer program product is run on a computer, causes the computer to execute the live audio and video processing method in any possible design of the first aspect and the first aspect, or, Make the computer execute the second aspect and the method for processing live audio and video in any possible design of the second aspect.
  • the present disclosure provides a chip system, which includes: a processor; when the processor executes the computer instructions stored in the memory, the electronic device executes any of the possible designs of the first aspect and the first aspect A live audio and video processing method, or the electronic device executes the live audio and video processing method in the second aspect and any possible design of the second aspect.
  • FIG. 1 is a schematic diagram of a communication system provided by an embodiment of the present disclosure
  • FIG. 2 is a schematic flowchart of a live audio and video processing method provided by an embodiment of the present disclosure
  • FIG. 3 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure
  • FIG. 4 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure
  • FIG. 5 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure
  • FIG. 6 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure.
  • live broadcast highlight clips cannot be predicted in advance, and are often generated through data such as the number of online viewers in the virtual live broadcast room, the number of gifts given to the anchor by the viewers, and the number of comments made by the viewers. Therefore, the server needs to perform audio and video recording on the live highlight segment, and generate a recorded audio and video file (such as an MP4 file), so that the client can download the recorded audio and video file from the server to obtain the live highlight segment.
  • a recorded audio and video file such as an MP4 file
  • the present disclosure provides a live audio and video processing method, device, client and server.
  • FIG. 1 is a schematic diagram of a communication system provided by an embodiment of the present disclosure.
  • the communication system provided by the present disclosure may include: a server and a client, and the server and the client may communicate with each other.
  • the client may be a client corresponding to the host, or may be a client corresponding to the viewer.
  • the host mentioned in this disclosure can be understood as a user who opens a virtual live broadcast room, and the audience mentioned in this disclosure can be understood as a user who watches live content in a virtual live broadcast room.
  • the client can implement the live audio and video processing method of the present disclosure through an application program (application, APP), official account, web page, etc. in the terminal device.
  • Terminal devices can be mobile phones (such as folding screen mobile phones, smart phones, etc.), personal digital assistants (personal digital assistant, PDA), tablet computers, notebook computers, ultra-mobile personal computers (ultra-mobile personal computer, UMPC), netbooks and other devices , the present disclosure does not impose any limitation on the specific type of the terminal device.
  • the present disclosure does not limit the type of the operating system of the terminal device.
  • Android system Linux system
  • Windows system or iOS system etc.
  • the present disclosure will take the client and server in FIG. 1 as an example in an embodiment, and describe the live audio and video processing method provided by the present disclosure in detail in combination with the accompanying drawings and application scenarios.
  • FIG. 2 is a schematic flowchart of a method for processing live audio and video provided by an embodiment of the present disclosure.
  • the live audio and video processing method provided by the present disclosure may include:
  • the client sends a first request to the server, where the first request is used to request live audio and video in a target time period.
  • the client corresponding to the anchor may send a first request to the server.
  • the client corresponding to the viewer may send the first request to the server.
  • the present disclosure does not limit the specific implementation manner of the first request.
  • the first request may represent the live audio and video of the target time period in the form of an identifier, a binary, or a field.
  • the live audio and video of the target time period is a piece of audio and video in the live content that has been live broadcast in the virtual live broadcast room.
  • the present disclosure does not limit the specific time period of the target time period.
  • the live broadcast duration of the target period is the initial moment when the first request is sent, and a preset duration before the initial moment.
  • the server obtains the download address of the target audio and video slice within the target period from the audio and video file, and the download address of each audio and video slice is stored in the audio and video file.
  • the server After receiving the first request, the server can learn that the client needs to download the live audio and video of the target period. Because the download address of each audio and video slice that has been broadcast live is stored in the audio and video file. Therefore, the server can obtain the download address of the target audio and video slice within the target time period from the audio and video file.
  • the present disclosure sets the live content and live time of a piece of audio and video in the live content that has been live broadcast in the virtual live room as an audio and video slice.
  • the live broadcast duration of each audio and video slice may be the same or different, which is not limited in this disclosure.
  • the audio and video slices may be expressed in a way such as transport stream (transport stream, TS) slices.
  • the target audio and video slices within the target time period can be understood as all audio and video slices whose live broadcast time is within the target time period.
  • the live broadcast time of the audio and video slice refers to the playback time corresponding to the live audio and video corresponding to the audio and video slice, such as the initial time, the middle time, or the end time.
  • the target audio and video slice can be one audio and video slice or multiple audio and video slices played sequentially, which is specifically determined based on the live broadcast duration of the target period and the live broadcast duration of the audio and video slices.
  • the download address of the target audio and video slice is the download address of the audio and video slice.
  • the download address of the target audio and video slice is the download address of each audio and video slice.
  • audio and video files may be represented by m3u8 files.
  • m3u8 refers to the m3u file in UTF-8 encoding format.
  • the m3u file records an index plain text file.
  • the playback software When opening the m3u file, the playback software does not play the m3u file, but finds the corresponding audio and video according to the index of the m3u file.
  • the present disclosure does not limit the specific implementation manner of the download address of the audio and video slices.
  • the download address may be represented by a uniform resource locator (uniform resource locator, URL) or a file transfer protocol (file transfer protocol, FTP) address.
  • URL uniform resource locator
  • FTP file transfer protocol
  • the server sends a first message to the client, where the first message is used to indicate the download address of the target audio and video slice.
  • the server may send a first message for indicating the download address of the target audio and video slice to the client.
  • the present disclosure does not limit the specific implementation manner of the first message.
  • the first message may represent the download address of the target audio and video slice by means of identification, binary, or fields.
  • the server may pack the download address of each audio and video slice in the target audio and video slice into a value, and transmit it to the client in the form of a message.
  • the client downloads the target audio and video slice based on the download address of the target audio and video slice.
  • the client can download the target audio and video slice based on the download address of the target audio and video slice.
  • the present disclosure does not limit the manner in which the client downloads the target audio and video slice.
  • the client may traverse the download addresses of the target audio and video slices, and download the target audio and video serially.
  • the client can download the audio and video slice based on the download address of the audio and video slice.
  • the client can download each audio and video slice separately based on the download address of each audio and video slice.
  • the client sequentially stitches the target audio and video slices according to the live broadcast sequence of the target audio and video slices, to obtain the live audio and video of the target period.
  • the client After downloading the target audio and video slices, the client splices the target audio and video slices sequentially according to the live broadcast sequence of the target audio and video slices to obtain the live audio and video of the target period.
  • the live broadcast sequence of an audio and video slice can be understood as the playing sequence of the live audio and video corresponding to the audio and video slice during the live broadcast.
  • the live audio and video 1 corresponding to the audio and video slice 1 is played before the live audio and video 2 corresponding to the audio and video slice 2 .
  • the live broadcast sequence of the audio and video slice 1 is prior to the live broadcast sequence of the audio and video slice 2.
  • the client requests the server to obtain the live audio and video of the target time period through the first request.
  • the server obtains the download address of the target audio and video slice in the target period from the audio and video file.
  • the server sends the download address of the target audio and video slice to the client through the first message, so that the client downloads the target audio and video based on the download address of the target audio and video slice.
  • the client splices the target audio and video slices sequentially according to the playing sequence of the target audio and video slices, and obtains the live audio and video of the target period. Therefore, the client initiates a request for the live highlight segment to the server and downloads the live highlight segment with the help of the download address sent by the server.
  • the server does not need to store the live highlight segment in the live content in advance.
  • the download address of the live highlight segment is sent to the client, so that the client downloads the live highlight segment based on the download address, which meets the needs of the anchor and the audience to download the live highlight segment, reduces the additional resource consumption of the server, and reduces the Server input costs.
  • the client can use various methods to represent the live sequence of the target audio and video slices.
  • the client may determine the live broadcast sequence of the audio and video slices based on the live broadcast time of the target audio and video slices.
  • the client can sequentially stitch the target audio and video slices according to the order of the live broadcast time of the target audio and video slices from small to large, and obtain the live audio and video of the target time period.
  • the target audio and video slice includes: audio and video slice 1 and audio and video slice 2, and assume that the start time of audio and video slice 1 is earlier than the start time of audio and video slice 2. Then, the client splices audio and video slice 1 before audio and video slice 2.
  • the client may download the target audio and video according to the live broadcast time of the audio and video slices.
  • the client can determine the live broadcast sequence of the audio and video slices based on the download sequence of the target audio and video slices.
  • the client when the client downloads the target audio and video slices according to the order of the live broadcast time of the target audio and video slices from small to large, it can download the target audio and video slices in the order of first to last. Sequential splicing to obtain the live audio and video of the target time period.
  • the target audio and video slice includes: audio and video slice 1 and audio and video slice 2, and assume that the start time of audio and video slice 1 is earlier than the start time of audio and video slice 2. Then, the client can first download the audio and video slice 1, and then download the audio and video slice 2. And the client splices audio and video slice 1 before audio and video slice 2.
  • the client after obtaining the live audio and video of the target period, the client can delete the target audio and video slice.
  • the resource waste of the client is reduced.
  • a first control can be set in the client, and the first control is used to request live audio and video in a target time period. Therefore, after receiving the first operation performed by the user on the first control, the client can send the first request to the server. In this way, it is convenient for the anchor or the audience to obtain the live broadcast highlights.
  • the present disclosure does not limit parameters such as shape, size, color, and position of the first control.
  • the first operation is an operation such as click, double-click, long-press, slide, etc. that acts on the first control.
  • a second control can be set in the client, and the second control is used to provide an entry for audio and video playback. Therefore, after receiving the second operation performed by the user on the second control, the client can publish the live audio and video of the target period on the client, so that the client can play the live audio and video of the target period on the client.
  • providing users with a channel for sharing audio and video is beneficial to attracting more users' attention in the client terminal and increasing the user viscosity of the client terminal.
  • the second operation is an operation such as click, double-click, long-press, slide, etc. that acts on the second control.
  • the second operation performed on the second control may include: an operation of the user inputting a target time period and determining the target time period, or an operation of the user selecting a target time period and determining the target time period.
  • the client can store the audio and video files in the server corresponding to the content delivery network (CDN) by using, for example, real time messaging protocol (RTMP).
  • RTMP real time messaging protocol
  • the server corresponding to the CDN is different from the server involved in the foregoing embodiments.
  • the server can obtain audio and video files from the server corresponding to the CDN.
  • the server can analyze the audio and video file to obtain the download address of the target audio and video slice.
  • the phenomenon of occupying excessive resources of the server is reduced.
  • the present disclosure provides a device for processing live audio and video.
  • FIG. 3 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure.
  • the apparatus for processing live audio and video of the present disclosure can be set in a terminal device, and can realize the operation corresponding to the operation of the client in the method for processing live audio and video in the embodiments of FIGS. 1-2 above.
  • the live audio and video processing device 100 may include: a first sending module 101 , a first receiving module 102 , a downloading module 103 and a splicing module 104 .
  • the first sending module 101 is used to send a first request to the server, and the first request is used to request the live audio and video of the target time period;
  • the first receiving module 102 is configured to receive a first message from the server, the first message is used to indicate the download address of the target audio and video slice within the target time period, the download address of the target audio and video slice is obtained by the server from the audio and video file, The download address of each audio and video slice is stored in the audio and video file;
  • Download module 103 for downloading the target audio and video slice based on the download address of the target audio and video slice;
  • the splicing module 104 is configured to sequentially splice the target audio and video slices according to the live broadcast sequence of the target audio and video slices, so as to obtain the live audio and video of the target time period.
  • the splicing module 104 is specifically configured to sequentially splice the target audio and video slices according to the order of the live broadcast time of the target audio and video slices from small to large, to obtain the live audio and video of the target time period.
  • the splicing module 104 is specifically configured to download the target audio and video slices according to the sequence of downloading the target audio and video slices from small to large , sequentially splicing the target audio and video slices to obtain the live audio and video of the target time period.
  • FIG. 4 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure. As shown in FIG. 4 , on the basis of the device structure shown in FIG. 3 , the live audio and video processing device 100 provided by the present disclosure may further include: a deletion module 105 .
  • the deletion module 105 is configured to delete the target audio and video slice after the splicing module 104 obtains the live audio and video of the target period.
  • the live broadcast duration of the target period is the initial moment when the first request is sent, and a preset duration before the initial moment.
  • the first sending module 101 is specifically configured to receive a first operation performed by the user on the first control of the client; and send a first request to the server in response to the first operation.
  • FIG. 5 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure. As shown in FIG. 5 , on the basis of the device structure shown in FIG. 3 or FIG. 4 (taking FIG. 3 as an example), the live audio and video processing device 100 provided by the present disclosure may further include: a playback module 106 .
  • the playing module 106 is configured to receive a second operation performed by the user on the second control of the client; in response to the second operation, play the live audio and video of the target period in the client.
  • the live audio and video processing device provided in the present disclosure can execute the above-mentioned method embodiments.
  • the present disclosure provides a device for processing live audio and video.
  • FIG. 6 is a schematic structural diagram of a live audio and video processing device provided by an embodiment of the present disclosure.
  • the device for processing live audio and video of the present disclosure can be set in a server, and can realize the operation of the server corresponding to the method for processing live audio and video in the embodiments of FIGS. 1-2 above.
  • the live audio and video processing apparatus 200 may include: a second receiving module 201 , an acquiring module 202 and a second sending module 203 .
  • the second receiving module 201 is configured to receive a first request from a client, and the first request is used to request live audio and video of a target time period;
  • Obtaining module 202 for obtaining the download address of the target audio-video slice in the target period from the audio-video file, the download address of each audio-video slice is stored in the audio-video file;
  • the second sending module 203 is configured to send a first message to the client, the first message is used to indicate the download address of the target audio and video slice, so that the client downloads the target audio and video slice based on the download address of the target audio and video slice, and According to the live broadcast sequence of the target audio and video slices, the target audio and video slices are spliced sequentially to obtain the live audio and video of the target period.
  • the obtaining module 203 is specifically configured to obtain audio and video files from a server corresponding to the content distribution network; analyze the audio and video files to obtain the download address of the target audio and video slice.
  • the live broadcast duration of the target period is the initial moment when the first request is sent, and a preset duration before the initial moment.
  • the live audio and video processing device provided in the present disclosure can execute the above-mentioned method embodiments.
  • the present disclosure provides a client, comprising: one or more processors; memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; one or more processors When one or more computer programs are executed, the client is enabled to implement the live audio and video processing method of the foregoing embodiments.
  • the present disclosure provides a server, comprising: one or more processors; memory; and one or more computer programs; wherein the one or more computer programs are stored in the memory; When one or more computer programs are executed, the server is made to implement the method for processing live audio and video in the foregoing embodiments.
  • the present disclosure provides a chip system, which is applied to an electronic device including a memory and a sensor; the chip system includes: a processor; when the processor executes the live audio and video processing method of the foregoing embodiments.
  • the present disclosure provides a computer-readable storage medium, on which a computer program is stored, and the computer program is executed by a processor so that an electronic device implements the method for processing live audio and video in the foregoing embodiments.
  • the present disclosure provides a computer program product, which, when running on a computer, causes the computer to execute the method for processing live audio and video in the foregoing embodiments.
  • all or part of the functions may be implemented by software, hardware, or a combination of software and hardware.
  • software When implemented using software, it may be implemented in whole or in part in the form of a computer program product.
  • a computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on the computer, the processes or functions according to the embodiments of the present disclosure are produced in whole or in part.
  • a computer can be a general purpose computer, special purpose computer, a computer network, or other programmable apparatus.
  • Computer instructions may be stored on a computer readable storage medium.
  • the computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server, a data center, etc. integrated with one or more available media.
  • the usable medium may be a magnetic medium (for example, a floppy disk, a hard disk, or a magnetic tape), an optical medium (for example, DVD), or a semiconductor medium (for example, a solid state disk (solid state disk, SSD)) and the like.
  • a magnetic medium for example, a floppy disk, a hard disk, or a magnetic tape
  • an optical medium for example, DVD
  • a semiconductor medium for example, a solid state disk (solid state disk, SSD)

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

La présente divulgation concerne un procédé et un appareil de traitement d'un flux audio/vidéo en direct, un client et un serveur. Le procédé comprend les étapes suivantes : un client envoie, à un serveur, une première demande pour demander un flux audio/vidéo en direct à partir d'une période de temps cible (S101) ; le client reçoit, du serveur, un premier message pour indiquer les adresses de téléchargement de tranches audio/vidéo cibles dans la période de temps cible (S103), les adresses de téléchargement des tranches audio/vidéo cibles étant obtenues d'un fichier audio/vidéo par le serveur et le fichier audio/vidéo stockant l'adresse de téléchargement de chaque tranche audio/vidéo (S102) ; le client télécharge les tranches audio/vidéo cibles sur la base des adresses de téléchargement des tranches audio/vidéo cibles (S104) ; et le client, selon la séquence de flux en direct des tranches audio/vidéo cibles, réalise un collage séquentiel sur les tranches audio/vidéo cibles et obtient le flux audio/vidéo en direct à partir de la période de temps cible (S105).
PCT/CN2022/090942 2021-05-21 2022-05-05 Procédé et appareil de traitement d'un flux audio/vidéo en direct, client et serveur WO2022242461A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202110556761.5 2021-05-21
CN202110556761.5A CN113301374A (zh) 2021-05-21 2021-05-21 直播音视频处理方法、装置、客户端和服务器

Publications (1)

Publication Number Publication Date
WO2022242461A1 true WO2022242461A1 (fr) 2022-11-24

Family

ID=77323623

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/090942 WO2022242461A1 (fr) 2021-05-21 2022-05-05 Procédé et appareil de traitement d'un flux audio/vidéo en direct, client et serveur

Country Status (2)

Country Link
CN (1) CN113301374A (fr)
WO (1) WO2022242461A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113301374A (zh) * 2021-05-21 2021-08-24 北京字节跳动网络技术有限公司 直播音视频处理方法、装置、客户端和服务器

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140189761A1 (en) * 2012-12-28 2014-07-03 Microsoft Corporation Archiving a live media presentation
CN104202616A (zh) * 2014-09-11 2014-12-10 北京阅联信息技术有限公司 一种基于裸流直播方法、回看方法及其***
CN105872858A (zh) * 2016-04-27 2016-08-17 亦非云互联网技术（上海）有限公司 一种视频分享方法和***、视频处理***、及客户端
WO2018232795A1 (fr) * 2017-06-19 2018-12-27 网宿科技股份有限公司 Client de lecteur vidéo, système et procédé de synchronisation vidéo de diffusion en direct
CN109842804A (zh) * 2017-11-24 2019-06-04 腾讯科技（深圳）有限公司 音视频数据的处理方法及服务器、计算机存储介质
CN111147878A (zh) * 2019-12-30 2020-05-12 广州酷狗计算机科技有限公司 直播中的推流方法、装置及计算机存储介质
CN111954005A (zh) * 2019-05-17 2020-11-17 腾讯科技（深圳）有限公司 多媒体资源的传输方法及装置
CN113301374A (zh) * 2021-05-21 2021-08-24 北京字节跳动网络技术有限公司 直播音视频处理方法、装置、客户端和服务器

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8667164B2 (en) * 2010-04-26 2014-03-04 Samsung Electronics Co., Ltd. Method and apparatus for playing live content
CN102790911B (zh) * 2011-05-16 2016-02-03 腾讯科技（深圳）有限公司 直播回放方法和***
CN108632675A (zh) * 2018-04-09 2018-10-09 北京潘达互娱科技有限公司 一种直播回放方法、装置及设备
CN111107386A (zh) * 2019-12-27 2020-05-05 北京达佳互联信息技术有限公司 直播视频的回看方法、装置、电子设备、***及存储介质
CN112468839B (zh) * 2020-11-26 2022-11-25 上海哔哩哔哩科技有限公司 直播内容的回放方法、***、设备、及可读存储介质

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140189761A1 (en) * 2012-12-28 2014-07-03 Microsoft Corporation Archiving a live media presentation
CN104202616A (zh) * 2014-09-11 2014-12-10 北京阅联信息技术有限公司 一种基于裸流直播方法、回看方法及其***
CN105872858A (zh) * 2016-04-27 2016-08-17 亦非云互联网技术（上海）有限公司 一种视频分享方法和***、视频处理***、及客户端
WO2018232795A1 (fr) * 2017-06-19 2018-12-27 网宿科技股份有限公司 Client de lecteur vidéo, système et procédé de synchronisation vidéo de diffusion en direct
CN109842804A (zh) * 2017-11-24 2019-06-04 腾讯科技（深圳）有限公司 音视频数据的处理方法及服务器、计算机存储介质
CN111954005A (zh) * 2019-05-17 2020-11-17 腾讯科技（深圳）有限公司 多媒体资源的传输方法及装置
CN111147878A (zh) * 2019-12-30 2020-05-12 广州酷狗计算机科技有限公司 直播中的推流方法、装置及计算机存储介质
CN113301374A (zh) * 2021-05-21 2021-08-24 北京字节跳动网络技术有限公司 直播音视频处理方法、装置、客户端和服务器

Also Published As

Publication number Publication date
CN113301374A (zh) 2021-08-24

Similar Documents

Publication Publication Date Title
US11620972B2 (en) System and method for association of a song, music, or other media content with a user's video content
US8843616B2 (en) Personal cloud computing with session migration
US11882180B2 (en) Dynamic content and cloud based content within collaborative electronic content creation and management tools
CN102884529B (zh) 用于社交摘要的可适配布局
RU2406133C2 (ru) Устройство и способы предоставления и представления настроенной информации о канале
US20220174346A1 (en) Video playing method and apparatus
US20150288993A1 (en) Service method and system for providing multi-track video contents
CN102255951A (zh) 资产可解析书签
Müller et al. A test-bed for the dynamic adaptive streaming over HTTP featuring session mobility
US20120151012A1 (en) Internet delivery of scheduled multimedia content
EP3343484A1 (fr) Système et procédé d'association d'une chanson, du musique ou d'un autre contenu multimédia avec le contenu d'un video utilisateur.
WO2018157743A1 (fr) Procédé de traitement de données multimédias, dispositif, système, et support de stockage
WO2015070796A1 (fr) Procédé et dispositif pour pousser des ressources vers un terminal de communication mobile par télévision intelligente
CN111930973A (zh) 多媒体数据的播放方法、装置、电子设备及存储介质
US10178431B2 (en) Hybrid stream delivery
JP2015062288A (ja) 権利および機能包括のコンテンツ選択および配信
WO2022242461A1 (fr) Procédé et appareil de traitement d'un flux audio/vidéo en direct, client et serveur
CN105812845A (zh) 一种媒体资源推送方法、***和基于Android***的媒体播放器
CN112565877B (zh) 投屏方法、***、电子设备及存储介质
US9762703B2 (en) Method and apparatus for assembling data, and resource propagation system
CN112637626A (zh) 推流方法、***、装置、电子设备及存储介质
WO2016184288A1 (fr) Procédé, dispositif et système de placement de publicité
WO2016197867A1 (fr) Procédé et dispositif de traitement de données pouvant s'appliquer à un dispositif informatique
US10387537B1 (en) Presentation of introductory content
JP6664587B1 (ja) 情報処理装置、情報処理方法および情報処理プログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22803785

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE