CN114827650A

CN114827650A - Streaming media content transmission, live broadcast and pull method

Info

Publication number: CN114827650A
Application number: CN202210430785.0A
Authority: CN
Inventors: 姜栋; 廖大达; 朱翔
Original assignee: Shanghai Bilibili Technology Co Ltd
Current assignee: Shanghai Bilibili Technology Co Ltd
Priority date: 2022-04-22
Filing date: 2022-04-22
Publication date: 2022-07-29

Abstract

The present disclosure provides a method for streaming media content transmission, live broadcast and pull, which relates to the technical field of computers, in particular to the technical field of streaming media transmission. The implementation scheme is as follows: receiving a pull instruction of a first user and receiving a public network service opening instruction of a live user, wherein the pull instruction indicates the first user to pull the streaming media content of the live user, and the public network service opening instruction indicates the live user to allow the first user to access based on a public network service address of the live user; responding to the public network service opening instruction and the pull instruction, and acquiring a public network service address; and issuing at least one pull address to the first user so that the first user can access the streaming media content based on one item of the at least one pull address to obtain the streaming media content, wherein the at least one pull address comprises a public network service address.

Description

Streaming media content transmission, live broadcast and pull method

Technical Field

The present disclosure relates to the field of computer technologies, and in particular, to a method and an apparatus for streaming media content transmission, live broadcast, and pull, an electronic device, a computer-readable storage medium, and a computer program product.

Background

In the live broadcast process of the streaming media, a live broadcast user takes audio and video data in the live broadcast process as a stable and continuous stream and pushes the stream to a server side so as to realize stream pushing; and the user watching the live broadcast pulls the stream containing the audio and video data from the server side to play so as to realize stream pulling.

In the process of stream pulling, when a server receives a stream pulling instruction of a user watching live broadcast, a stream pulling address is distributed to the user, so that the user can pull audio and video data from an edge server.

The approaches described in this section are not necessarily approaches that have been previously conceived or pursued. Unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section. Similarly, unless otherwise indicated, the problems mentioned in this section should not be considered as having been acknowledged in any prior art.

Disclosure of Invention

The disclosure provides streaming media content transmission, live broadcast and pull methods, devices, electronic equipment, computer readable storage medium and computer program products.

According to an aspect of the present disclosure, there is provided a streaming media content transmission method, including: receiving a pull instruction of a first user and receiving a public network service opening instruction of a live user, wherein the pull instruction indicates the first user to pull the streaming media content of the live user, and the public network service opening instruction indicates the live user to allow the first user to access based on a public network service address of the live user; responding to a public network service starting instruction of a live broadcast user and a pull instruction received from a first user, and responding to the public network service starting instruction and the pull instruction, and obtaining a public network service address of the live broadcast user; and issuing at least one pull address to the first user so that the first user accesses the streaming media content based on one item of the at least one pull address to obtain the streaming media content, wherein the at least one pull address comprises the public network service address.

According to another aspect of the present disclosure, there is also provided a streaming media content live broadcasting method, including: sending a public network service opening instruction to enable the server to respond to the public network service opening instruction to obtain a public network service address and issue at least one pull address to a first user pulling streaming media content, wherein the at least one pull address comprises the public network service address, and the public network service opening instruction indicates that the first user is allowed to access based on the public network service address.

According to another aspect of the present disclosure, there is also provided a streaming media content pulling method, including: sending a pulling instruction to a server to pull the streaming media content of the live broadcast user; responding to at least one pull flow address sent by the server, and acquiring a first pull flow address from the at least one pull flow address, wherein the at least one pull flow address comprises a public network service address of the live broadcast user, and the live broadcast user can be accessed based on the public network service address; and accessing based on the first pull stream address to obtain the stream media content.

According to another aspect of the present disclosure, there is also provided a streaming media content pushing apparatus, including: the receiving unit is configured to receive a pull instruction of a first user and receive a public network service opening instruction of a live user, wherein the pull instruction indicates that the first user pulls the streaming media content of the live user, and the public network service opening instruction indicates that the live user allows the first user to access based on a public network service address of the live user; the obtaining unit is configured to respond to the public network service starting instruction and the pulling instruction to obtain the public network service address; and a distribution unit configured to issue at least one pull address to the first user, so that the first user accesses based on one item of the at least one pull address to obtain the streaming media content, wherein the at least one pull address includes the public network service address.

According to another aspect of the present disclosure, there is also provided a streaming media content live broadcasting device, including: the starting unit is configured to send a public network service starting instruction, so that the server obtains a public network service address in response to the public network service starting instruction and issues at least one pull address to a first user pulling streaming media content, wherein the at least one pull address comprises the public network service address, and the public network service starting instruction indicates that the first user is allowed to access based on the public network service address.

According to another aspect of the present disclosure, there is also provided a streaming media content pull apparatus, including: the instruction sending unit is configured to send a pull instruction to the server so as to pull the streaming media content of the live user; the address acquisition unit is configured to respond to the receiving of at least one pull flow address sent by the server, and acquire a first pull flow address from the at least one pull flow address, wherein the at least one pull flow address comprises a public network service address of the live broadcast user, and the live broadcast user can be accessed based on the public network service address; and the access unit is configured to access based on the first pull stream address to obtain the streaming media content.

According to another aspect of the present disclosure, there is also provided an electronic device including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores a computer program which, when executed by the at least one processor, implements a method according to the above.

According to another aspect of the present disclosure, there is also provided a non-transitory computer readable storage medium storing a computer program, wherein the computer program, when executed by a processor, implements the method according to the above.

According to another aspect of the present disclosure, there is also provided a computer program product comprising a computer program, wherein the computer program realizes the method according to the above when executed by a processor.

According to one or more embodiments of the present disclosure, a public network service address of a live user is included in at least one pull address and is issued to a user pulling a streaming media content of the live user, so that the user can access the live user based on the public network service address and pull the streaming media content of the live user, a CDN bandwidth can be reduced, and a live cost can be reduced. Meanwhile, as the streaming media content is directly transmitted from the live user to the user pulling the streaming media content, compared with the streaming media content transmitted from the live user to the server and then transmitted from the edge server to the user pulling the streaming media content, the method shortens the link of the streaming media content transmission, can reduce the delay, and can reduce the problem of live jitter caused by network jitter.

It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate exemplary embodiments of the embodiments and, together with the description, serve to explain the exemplary implementations of the embodiments. The illustrated embodiments are for purposes of illustration only and do not limit the scope of the claims. Throughout the drawings, identical reference numbers designate similar, but not necessarily identical, elements.

Fig. 1 shows a flow chart of a streaming media content transmission method according to an embodiment of the present disclosure;

fig. 2 is a flowchart illustrating a process of obtaining a public network service address of the live user in a streaming media content transmission method according to an embodiment of the disclosure;

fig. 3 is a flowchart illustrating a process of issuing at least one pull address to a first user in a streaming media content transmission method according to an embodiment of the present disclosure;

fig. 4 shows a flowchart of a procedure for obtaining a first detection result in a streaming media content transmission method according to an embodiment of the present disclosure;

fig. 5 is a flowchart illustrating a process of obtaining a first detection result based on distance in a streaming media content transmission method according to an embodiment of the present disclosure;

FIG. 6 shows a flow diagram of a method of live streaming of media content, in accordance with an embodiment of the present disclosure;

FIG. 7 shows a flow diagram of a method of live streaming of media content, in accordance with an embodiment of the present disclosure;

FIG. 8 shows a flow diagram of a method of live streaming of media content in accordance with an embodiment of the disclosure;

fig. 9 shows a flow chart of a streaming media content pull method according to an embodiment of the present disclosure;

fig. 10 is a schematic diagram illustrating a data interaction process between a server, a live user and a user pulling streaming media in a streaming media content transmission, live broadcast and pulling method according to an embodiment of the disclosure;

FIG. 11 shows a schematic block diagram of a streaming media content transmission apparatus according to an embodiment of the present disclosure;

FIG. 12 shows a schematic block diagram of a streaming media content live device according to an embodiment of the present disclosure;

fig. 13 shows a schematic block diagram of a streaming media content pull apparatus according to an embodiment of the present disclosure; and

FIG. 14 illustrates a block diagram of an exemplary electronic device that can be used to implement embodiments of the present disclosure.

Detailed Description

Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

In the present disclosure, unless otherwise specified, the use of the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, the timing relationship, or the importance relationship of the elements, and such terms are used only to distinguish one element from another. In some examples, a first element and a second element may refer to the same instance of the element, and in some cases, based on the context, they may also refer to different instances.

The terminology used in the description of the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the elements may be one or more. Furthermore, the term "and/or" as used in this disclosure is intended to encompass any and all possible combinations of the listed items.

In the related art, a live user pushes streaming media content in a live process to a server, and when the live user pulls the streaming media content of the live user, the server issues a CDN (content delivery network) address of an edge server having the streaming media content to the user, so that the user accesses the edge server based on the CDN address to pull the streaming media content. Because the streaming media content is pulled from the same edge server of a plurality of users, the bandwidth pressure of the CDN is higher, and the live broadcast cost is increased. Meanwhile, in the process that the streaming media content is pushed to the server by the live broadcast user and pulled by the user from the edge server corresponding to the CDN address delivered by the server, the flow is complex and cumbersome, and the data transmission link is long, so that the possibility of delay occurring in the data transmission process and live broadcast jitter occurring due to network jitter is increased. And increasing the CND bandwidth will increase the live broadcast cost.

Therefore, the present disclosure provides a streaming media content transmission method and apparatus, a streaming media content live broadcast method and apparatus, and a streaming media content pull method and apparatus.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

Referring to fig. 1, a streaming media content transmission method according to an embodiment of the present invention is schematically illustrated. As shown in fig. 1, the streaming media content transmission method 100 includes:

step S110: receiving a pull instruction of a first user and receiving a public network service opening instruction of a live user, wherein the pull instruction indicates the first user to pull the streaming media content of the live user, and the public network service opening instruction indicates the live user to allow the first user to access based on a public network service address of the live user;

step S120: responding to the public network service opening instruction and the pull instruction, and acquiring the public network service address;

step S130: and issuing at least one pull address to the first user so that the first user accesses the streaming media content based on one item of the at least one pull address to obtain the streaming media content, wherein the at least one pull address comprises the public network service address.

The public network service address of the live broadcast user is contained in at least one pull address and is issued to the user pulling the streaming media content of the live broadcast user, so that the user can access the live broadcast user based on the public network service address, the streaming media content of the live broadcast user is pulled, the bandwidth of the CDN can be reduced, and the live broadcast cost is reduced. Meanwhile, as the streaming media content is directly transmitted from the live user to the user pulling the streaming media content, compared with the streaming media content transmitted from the live user to the server and then transmitted from the edge server to the user pulling the streaming media content, the method shortens the link of the streaming media content transmission, can reduce the delay, and can reduce the problem of live jitter caused by network jitter.

According to the embodiment of the disclosure, a live user who starts a public network service can be scheduled as a special edge server (different from an edge server based on a CDN address) to allow a user who pulls a streaming media content of the live user to pull the streaming media content from the special edge server, so that bandwidth pressure of the edge server based on the CDN address is shared, and thus, a CND bandwidth can be reduced, and live cost can be reduced.

In some embodiments, the streaming media content transmission method according to the present disclosure is applied to a server.

In some embodiments, the live user is a client that pushes a live stream, and the client may be a live device such as a mobile phone and a tablet computer. In some embodiments, the live stream may include, for example and without limitation, streaming media content of at least one of a video stream and an audio stream.

In some embodiments, in response to receiving an instruction to open public network services from a live user, it is determined that the live user opens public network services. In one example, the instruction for opening the public network service is automatically sent by the live broadcast user when the public network service is opened.

In some embodiments, in response to determining that the live user registers the registration information for starting the public network service in the registry, the registration information is used as the public network service starting instruction of the live user, so as to determine that the live user starts the public network service.

In some embodiments, the first user is any user that watches the live of the live user.

In some embodiments, the pull instruction is sent when the first user accesses based on a live address of a live user.

It should be noted that, in terms of "open public network service instruction", "pull instruction", and the like according to the present disclosure, the instruction may be any form of data, and is not limited herein.

In some embodiments, obtaining the public network service address of the live user comprises: and obtaining a public network service address from the live broadcast user, wherein the public network service address is obtained by the live broadcast user through port mapping based on the public network address and the port of the live broadcast user.

For example, a live user in a local area network can access a port of the live user in the local area network by mapping the port of the live user in the local area network to a port of a public network address of the live user, so that a user accessed by the port based on the public network address can access the port of the live user in the local area network.

In some embodiments, as shown in fig. 2, obtaining the public network service address includes:

step S210: obtaining a first address of the first user corresponding to the pull instruction, wherein the first address is a public network address and a port indicating the first user;

step S220: sending a first instruction containing the first address to the live user to cause the live user to send first data in response to receiving the first instruction and to access the first user based on the first address;

step S230: responding to the live broadcast user to access the first user, and acquiring a second address corresponding to the first data of the live broadcast user, wherein the second address indicates a public network address and a port of the live broadcast user; and

step S240: and determining the second address as the public network service address.

According to some embodiments of the present disclosure, a live broadcast user does not have a public network service address obtained by performing port mapping based on a public network address and a port of the live broadcast user, and a server obtains a second address of data exchanged by the live broadcast user to the outside in a 'hole punching' manner, and determines the second address as the public network service address of the live broadcast user, thereby obtaining the public network service address.

It should be understood that the embodiments to obtain the public network service address include "obtaining based on port mapping of the public network address and the port of the live user" or obtaining by "punching", which is merely exemplary, and those skilled in the art should understand that the public network service address of the live user may be obtained in any way as long as the live user can be accessed based on the public network service address.

In some embodiments, as shown in fig. 3, issuing at least one pull address to the first user includes:

step S310: obtaining a first detection result, wherein the first detection result indicates whether to issue the public network service address to the first user; and

step S320: and responding to the first detection result to indicate that the public network service address is issued to the first user, and issuing the at least one pull flow address to the first user.

Before at least one pull address is issued to a first user for pulling the streaming media content of a live user, whether the public network service address of the live user is issued to the first user is determined, the public network service address is prevented from being issued to users who do not meet conditions, the users are enabled to pull the streaming media content based on the public network service address, the pull process of the users is affected, meanwhile, the users who do not meet the conditions are prevented from pulling the streaming media content from the live user based on the public network service address, pressure is caused to the live user, and the push process of the live user is affected.

In some embodiments, as shown in fig. 4, obtaining the first detection result comprises:

step S410: obtaining the positions of the live user and the first user;

step S420: obtaining a distance between the live user and the first user based on the position of the live user and the position of the first user; and

step S430: and obtaining the first detection result based on the distance.

When the user pulling the streaming media content is far away from the live user (for example, the distance between the user pulling the streaming media content and the live broadcast of the user is greater than the distance between the user pulling the streaming media content and the edge server based on the CDN address), if the user pulls the streaming media content from the live user based on the public network service address, the streaming media content needs more transmission links in the transmission process, which may increase delay and may cause a problem of live broadcast jitter due to network jitter.

In an embodiment according to the present disclosure, a distance between a live user and a first user is obtained based on a position of the live user and a position of the first user, and a first detection result is obtained based on the distance. The method avoids issuing the public network service address to the user far away from the live broadcast user, and reduces the probability of delay and live broadcast jitter in the data transmission process.

In some embodiments, obtaining the first detection result based on the distance comprises: and responding to the distance larger than a distance threshold value, and obtaining the first detection result, wherein the first detection result indicates that the public network service address is not issued to the first user.

For example, for a live broadcast user located in Nanjing, when the user pulling the streaming media content is also located in Nanjing and the distance between the two is not more than 2km, a first detection result is obtained, where the first detection result indicates that the public network service address of the live broadcast user can be issued to the user pulling the streaming media content.

In some embodiments, as shown in fig. 5, obtaining the first detection result based on the distance includes:

step S510: obtaining a current user set of the live users, wherein each user in the current user set obtains the streaming media content by accessing the live user based on the public network service address; and

step S520: in response to determining that the user data in the current user set is not greater than a quantity threshold and the distance is not greater than the distance threshold, obtaining the first detection result, the first detection result indicating that the public network service address is issued to the first user.

When a user pulling the streaming media content accesses a live broadcast user based on a public network service address, the live broadcast user transmits the streaming media content to the user by using the downlink bandwidth of the live broadcast user, and processes data in the transmission process by using the equipment processing capacity of the live broadcast user. Because the equipment processing and bandwidth capacity of the live broadcast user is limited, when the number of users accessing the live broadcast user based on the public network service address is too many, the pressure is caused to the equipment processing capacity and the downlink bandwidth of the live broadcast user, when the equipment processing capacity of the live broadcast user reaches the limit, the stream pushing process of the live broadcast user is influenced, and when the downlink bandwidth of the live broadcast user reaches the limit, the stream pulling process of the user accessing the live broadcast user based on the public network service address is influenced.

According to the embodiment of the disclosure, when the first detection result is obtained based on the distance, the first detection result is obtained based on the number of users who have accessed based on the public network service address; the method and the device avoid the problems that too many users pull the streaming media content from the live broadcast user based on the public network service address, the pressure is caused to the live broadcast user, the push flow process of the live broadcast user is influenced, and the pull flow process of the user who accesses to pull the streaming media content based on the public network address is avoided.

In some embodiments, the current set of users is determined by obtaining information sent by each user in the current set of users during the process of pulling streaming media content.

For example, after a user who pulls the streaming media content accesses a live user based on a public network service address, in the process of pulling the streaming media content from the live user, the user sends an instruction to the server every preset time period, so that the server determines that the user pulls the streaming media content from the live user based on the instruction, and thus determines that the user is one of the current user set.

In some embodiments, the streaming media content transmission method according to the present disclosure further includes: in response to determining that the first user obtained the streaming media content by accessing the live user based on the public network service address, adding the first user to the current set of users.

After the first user is determined to obtain the streaming media content by accessing the live user based on the public network service address, the first user is added to the current user set, so that the current user set can be updated, and in the subsequent process of issuing at least one pull address to a second user who pulls the streaming media content, whether the public network service address is issued to the second user is determined based on the current user set, so that the situation that the push flow process of the live user and the pull flow process of the user who pulls the streaming media content based on the public network service address are influenced due to the fact that too many users pull the streaming media content from the live user based on the public network service address cause pressure on the live user and the pull flow process of the user who accesses the live user based on the public network address to pull the streaming media content are further avoided.

In some embodiments, the at least one pull address further includes a content distribution network address, based on which the first user can access an edge server having the streaming media content to obtain the streaming media content.

In the process of issuing at least one stream pulling address, a content distribution network address is issued in addition to a public network service address, so that in the process of pulling stream media content, when a first user does not pull stream media content based on the public network service address, the first user automatically switches to obtain the stream media content based on the content distribution network address, and the stream pulling process of the first user is ensured to be smoothly and stably carried out.

In some embodiments, the streaming media content transmission method further comprises:

receiving a public network service forbidding instruction of the live broadcast user; wherein the public network service disabling instruction indicates that the live user does not allow the second user to access based on the public network service address;

in response to the public network service forbidding instruction, issuing a content distribution network address to a second user pulling the streaming media content, so that the second user can access an edge server with the streaming media content based on the content distribution network address to obtain the streaming media content; wherein disabling public network service indicates that the live user does not allow the second user access based on the public network service address.

When a public network service forbidding instruction of a live user is obtained, the live user is determined not to allow the user pulling the stream media content to access the public network service address, and at the moment, the content distribution network address of the edge server is issued to the user pulling the stream media content, so that the smooth and stable operation of the stream pulling process of the user is ensured.

According to another aspect of the disclosure, a method for live broadcasting of streaming media content is also provided.

Referring to fig. 6, a method for live broadcasting of streaming media content according to an embodiment of the present invention is schematically illustrated. As shown in fig. 6, a method 600 for live broadcasting of streaming media content includes:

step S610: sending a public network service opening instruction to enable the server to respond to the public network service opening instruction to obtain a public network service address and issue at least one pull address to a first user pulling streaming media content, wherein the at least one pull address comprises the public network service address, and the public network service opening instruction indicates that the first user is allowed to access based on the public network service address.

By sending the public network service starting instruction, the server side obtains the public network service address and includes the public network service address in at least one pull address to be issued to the user pulling the streaming media content, so that the user can access the public network service address and pull the streaming media content of the live broadcast user, the bandwidth of the CDN can be reduced, and the live broadcast cost can be further reduced. Meanwhile, as the streaming media content is directly transmitted to the user pulling the streaming media content, compared with the method that the streaming media content is transmitted to the server firstly and then transmitted to the user pulling the streaming media content from the edge server, the method shortens the link of the transmission of the streaming media content, can reduce the delay and can reduce the problem of live broadcast jitter caused by network jitter.

According to some embodiments of the present disclosure, a method of streaming media content according to the present disclosure is performed at a client.

In some embodiments, the server may be any server that performs the streaming media content transmission method according to the present disclosure.

In some embodiments, the client is any device that pushes a live stream, and may be a live device such as a mobile phone and a tablet computer. In some embodiments, the live stream may include, for example and without limitation, streaming media content of at least one of a video stream and an audio stream.

In some embodiments, the registration information for opening the public network service is registered in the registration center of the server to send a public network service opening instruction, where the registration information is the public network service opening instruction.

In some embodiments, the public network service is opened by sending an instruction to the server, wherein the server performs obtaining the public network service address in response to receiving the instruction.

In some embodiments, the public network service is opened by sending a command for opening the public network service, and the server side obtains the public network service address included in the command.

In some embodiments, the public network service address is generated by a live user, and as shown in fig. 7, the method for streaming media content according to the present disclosure further includes:

step S710: carrying out port mapping based on a public network address and a port to obtain the public network service address; and

step S720: and sending the public network service address to the server.

In other embodiments, the public network service address is obtained by the server through interaction with the server and the first user, for example, the method for streaming media content according to the present disclosure further includes:

in response to receiving a first instruction from the server, sending first data to the server, and accessing the first user based on a first address corresponding to the first instruction, where the first instruction corresponds to a pull instruction of the first user, and the first user pulls the streaming media content by sending the pull instruction to the server, and the first data indicates the public network service address.

According to some embodiments of the present disclosure, when there is no public network service address obtained by performing port mapping according to a public network address and a port, through interaction between the first user and the server, in an interaction process, the server obtains an address included in the interaction data in a "hole punching" manner, and uses the address as a public network service address, so that the first user pulls streaming media content, thereby enabling the server to obtain the public network service address.

In some embodiments, the first user is a client that pulls the streaming media content and plays the streaming media content, and the client may be a live device such as a mobile phone, a tablet computer, and the like.

In some embodiments, as shown in fig. 8, the method of streaming media content according to the present disclosure further includes:

step S810: acquiring the number of users in a current user set, wherein each user in the current user set accesses to acquire the streaming media content based on the public network address; and

step S820: and in response to the user number not less than a number threshold, sending a public network service forbidding instruction to enable the server to respond to the public network service forbidding instruction and issue a content distribution network address to a second user pulling the streaming media content, so that the second user can access an edge server with the streaming media content and obtain the streaming media content based on the content distribution network address, wherein the public network service forbidding instruction indicates that the second user is prohibited from accessing based on the public network service address.

When a user accesses to pull the streaming media content based on the public network service address, the live broadcast user transmits the streaming media content to the user by using the downlink bandwidth of the live broadcast user, and processes data in the transmission process by using the equipment processing capacity of the live broadcast user. Because the equipment processing and bandwidth capacity of the live broadcast user is limited, when the number of users accessing the live broadcast user based on the public network service address is too many, the pressure is caused to the equipment processing capacity and the downlink bandwidth of the live broadcast user, when the equipment processing capacity of the live broadcast user reaches the limit, the stream pushing process of the live broadcast user is influenced, and when the downlink bandwidth of the live broadcast user reaches the limit, the stream pulling process of the user accessing the live broadcast user based on the public network service address is influenced.

According to the embodiment of the disclosure, users who access based on the public network service address to pull the streaming media content are counted, when the number of the users exceeds a number threshold, a public network service forbidding instruction is sent, so that the service end is based on the public network service forbidding instruction, and a content distribution network address is issued to the users who pull the streaming media content later, so that the users who pull the streaming media content later can access an edge server with the streaming media content based on the content distribution network address and obtain the streaming media content, the streaming media content is guaranteed to be pulled smoothly by the users who pull the streaming media content later, and the phenomenon that the streaming process is influenced by too many users who pull the streaming media content from a live user based on the public network service address and the streaming process of the users who access based on the public network address to pull the streaming media content is avoided.

In some embodiments, the second user is any client that pulls the streaming media content behind the first user.

According to another aspect of the present disclosure, a method for pulling streaming media content is also provided.

Referring to fig. 9, a method of streaming media content pull according to an embodiment of the present disclosure is schematically illustrated. As shown in fig. 9, the streaming media content pulling method 900 includes:

step S910: sending a pulling instruction to a server to pull the streaming media content of the live broadcast user;

step S920: responding to at least one pull flow address sent by the server, and acquiring a first pull flow address from the at least one pull flow address, wherein the at least one pull flow address comprises a public network service address of the live broadcast user, and the live broadcast user can be accessed based on the public network service address; and

step S930: and accessing based on the first pull stream address to obtain the streaming media content.

In some embodiments, the client is any device for pulling the streaming media content, for example, a streaming device such as a mobile phone or a tablet computer. In some embodiments, the streaming media content may include, for example and without limitation, at least one of a video stream and an audio stream.

In some embodiments, the pull instruction is instruction data sent to the server to indicate that the streaming media content is to be acquired, and may include, for example, an address to which the server is allowed to push a pull address.

In some embodiments, obtaining the first pull address from the at least one pull address comprises: and in response to the public network service address being included in the at least one pull address, determining the public network service address as a first pull address.

When at least one stream pulling address comprises a public network service address, access is carried out based on the public network service address to pull stream media content, CDN bandwidth can be reduced, and then live broadcast cost is reduced. Meanwhile, as the streaming media content is directly pulled from the live user, compared with the method that the streaming media content is transmitted from the live user to the server and then transmitted from the edge server to the pull, the method shortens the link of the streaming media content transmission, can reduce the delay, and can reduce the problem of live jitter caused by network jitter.

In some embodiments, the at least one pull address further comprises a content distribution network address, the method further comprising:

in response to determining that the number of segments of the streaming media content obtained within a preset time is less than a segment number threshold; and

and accessing an edge server with the streaming media content to obtain the streaming media content based on the content distribution network address.

When accessing to pull the streaming media content based on the public network service address, the number of the segments of the streaming media content obtained within the preset time is smaller than the threshold value of the number of the segments, which indicates that the process of pulling the streaming media content based on the public network service address is not smooth, at the moment, the method switches to the content distribution network address, accesses the edge server based on the content distribution network address to obtain the streaming media content, ensures the smooth pulling process and ensures the playing quality of the streaming media content.

In some embodiments, a streaming media content pulling method according to the present disclosure further includes: and responding to the obtained streaming media content, and sending a reporting instruction to the server, wherein the reporting instruction indicates that the streaming media content is obtained by accessing the live user based on the public network service address.

By sending a reporting instruction to the server, the server determines that the client is obtained by accessing the live user based on the public network service address because the reporting instruction indicates that the streaming media content is obtained by accessing the live user based on the public network service address, so that the number of the clients accessing the live user based on the public network service address can be counted, and the stream pushing process and the stream pulling process of the client accessing to pull the streaming media content based on the public network address are influenced by too many users pulling the streaming media content from the live user based on the public network service address.

Referring to fig. 10, a streaming media content transmission method, a streaming media content live broadcasting method, and a streaming media content pull method according to the present disclosure are exemplarily described. The server 1010 realizes the streaming media content transmission method according to the present disclosure through data interaction between the live user 1020 and the user 1030 pulling the streaming media content; the live broadcast user 1010 realizes the live broadcast method of the streaming media content according to the present disclosure through data interaction between the live broadcast user 1010 and the user 1030 pulling the streaming media content; and the user 1030 pulling the streaming media content realizes the method for pulling the streaming media content according to the present disclosure through data interaction with the server 1010 and the live user 1020, respectively, and wherein the arrows indicate the data interaction step and the direction of data transmission in the data interaction step.

As shown in fig. 10, when the live user 1020 starts the live broadcast, the streaming media content is pushed a to the server 1010, and meanwhile, the user 1030 pulling the streaming media content sends a B pull instruction to the server 1010 to pull the streaming media content. When receiving a pull instruction of the user 1030, the server 1010 issues a C pull address to the user 1030, where after determining that the live broadcast user 1020 starts the public network service, the server 1010 issues the pull address to the user 1030 including the public network service address of the live broadcast user 1020. After receiving the pull address issued by the server 1010, the user 1030 responds to the pull address including the public network service address, and accesses D to the live user 1020 based on the public network service address, so that the live user 1020 pushes E the streaming media content to the user 1030.

According to another aspect of the present disclosure, there is also provided a streaming media content transmission apparatus, as shown in fig. 11, the apparatus 1100 includes:

a receiving unit 1110, configured to receive a pull instruction of a first user, and receive a public network service opening instruction of a live user, where the pull instruction indicates that the first user pulls streaming media content of the live user, and the public network service opening instruction indicates that the live user allows the first user to access based on a public network service address of the live user;

an obtaining unit 1120, configured to obtain the public network service address in response to the public network service opening instruction and the pull instruction; and

a distributing unit 1130 configured to issue at least one pull address to the first user, so that the first user accesses based on one of the at least one pull address to obtain the streaming media content, where the at least one pull address includes the public network service address.

According to another aspect of the present disclosure, there is also provided a streaming media content live broadcasting device, as shown in fig. 12, the device 1200 includes:

a starting unit 1210, configured to send a public network service opening instruction, so that the server obtains a public network service address in response to the public network service opening instruction and issues at least one pull address to a first user pulling streaming media content, where the at least one pull address includes the public network service address, and the public network service opening instruction indicates that the first user is allowed to access based on the public network service address.

According to another aspect of the present disclosure, there is also provided a streaming media content pull apparatus, as shown in fig. 13, an apparatus 1300 includes:

an instruction sending unit 1310 configured to send a pull instruction to a server to pull the streaming media content of the live user;

an address obtaining unit 1320, configured to, in response to receiving at least one pull address sent by the server, obtain a first pull address from the at least one pull address, where the at least one pull address includes a public network service address of the live user, and the live user can be accessed based on the public network service address; and

an accessing unit 1330 configured to access based on the first pull address to obtain the streaming media content.

Referring to fig. 14, a block diagram of a structure of an electronic device 1400, which may be a server or a client of the present disclosure, which is an example of a hardware device that may be applied to aspects of the present disclosure, will now be described. The electronic devices may be different types of computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.

As shown in fig. 14, the electronic device 1400 may include at least one processor 1410, a working memory 1420, an input unit 1440, a display unit 1450, a speaker 1460, a storage unit 1470, a communication unit 1480, and other output units 1490 that can communicate with each other through a system bus 1430.

Processor 1410 may be a single processing unit or multiple processing units, all of which may include single or multiple computing units or multiple cores. Processor 1410 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuitry, and/or any devices that manipulate signals based on operational instructions. The processor 1410 may be configured to fetch and execute computer readable instructions stored in the working memory 1420, storage unit 1470, or other computer readable medium, such as program code for the operating system 1420a, program code for the application programs 1420b, and so forth.

Working memory 1420 and storage unit 1470 are examples of computer-readable storage media for storing instructions that are executed by processor 1410 to implement various functions described above. The working memory 1420 may include both volatile and non-volatile memory (e.g., RAM, ROM, etc.). Further, storage unit 1470 may include a hard disk drive, solid state drive, removable media, including external and removable drives, memory cards, flash memory, floppy disks, optical disks (e.g., CDs, DVDs), storage arrays, network attached storage, storage area networks, and so forth. Both working memory 1420 and storage unit 1470 may be referred to herein collectively as memory or computer-readable storage medium and may be a non-transitory medium capable of storing computer-readable, processor-executable program instructions as computer program code, which may be executed by processor 1410 as a particular machine configured to implement the operations and functions described in the examples herein.

The input unit 1440 may be any type of device capable of inputting information to the electronic device 1400, and the input unit 1440 may receive input numeric or character information and generate key signal inputs related to user settings and/or function controls of the electronic device, and may include, but is not limited to, a mouse, a keyboard, a touch screen, a track pad, a track ball, a joystick, a microphone, and/or a remote control. The output units may be any type of device capable of presenting information and may include, but are not limited to, a display unit 1450, speakers 1460, and other output units 1490, which other output units 1490 may include, but are not limited to, video/audio output terminals, vibrators, and/or printers. The communication unit 1480 allows the electronic device 1400 to exchange information/data with other devices via a computer network such as the internet and/or various telecommunications networks and may include, but is not limited to, a modem, a network card, an infrared communication device, a wireless communication transceiver, and/or a chipset, such as a bluetooth (TM) device, an 802.11 device, a WiFi device, a WiMax device, a cellular communication device, and/or the like.

The application 1420b in the working register 1420 may be loaded to perform the various methods and processes described above, such as steps S110-S120 in fig. 1. For example, in some embodiments, a streaming media content transmission, live broadcast, or pull method may be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 1470. In some embodiments, some or all of the computer programs can be loaded and/or installed onto the electronic device 1400 via the storage unit 1470 and/or the communication unit 1480. When loaded and executed by processor 1410, may perform one or more steps of the streaming media content transmission, live broadcast or pull methods described above. Alternatively, in other embodiments, processor 1410 may be configured by any other suitable means (e.g., by way of firmware) to perform a method of building a live peer-to-peer network.

Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.

Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.

In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.

The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), and the Internet.

The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other.

It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be performed in parallel, sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.

Although embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it is to be understood that the above-described methods, systems and apparatus are merely exemplary embodiments or examples and that the scope of the present invention is not limited by these embodiments or examples, but only by the claims as issued and their equivalents. Various elements in the embodiments or examples may be omitted or may be replaced with equivalents thereof. Further, the steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples may be combined in various ways. It is important that as technology evolves, many of the elements described herein may be replaced with equivalent elements that appear after the present disclosure.

Claims

1. A streaming media content transmission method, comprising:

receiving a pull instruction of a first user and receiving a public network service opening instruction of a live user, wherein the pull instruction indicates the first user to pull the streaming media content of the live user, and the public network service opening instruction indicates the live user to allow the first user to access based on a public network service address of the live user;

responding to the public network service opening instruction and the pull instruction, and acquiring the public network service address; and

and issuing at least one pull address to the first user so that the first user accesses the streaming media content based on one item of the at least one pull address to obtain the streaming media content, wherein the at least one pull address comprises the public network service address.

2. The method of claim 1, wherein said issuing at least one pull address to the first user comprises:

obtaining a first detection result, wherein the first detection result indicates whether to issue the public network service address to the first user; and

and responding to the first detection result to indicate that the public network service address is issued to the first user, and issuing the at least one pull flow address to the first user.

3. The method of claim 2, wherein the obtaining a first detection result comprises:

obtaining the positions of the live user and the first user;

obtaining a distance between the live user and the first user based on the position of the live user and the position of the first user; and

and obtaining the first detection result based on the distance.

4. The method of claim 3, wherein the obtaining a first detection result based on the distance comprises:

obtaining a current user set of the live users, wherein each user in the current user set obtains the streaming media content by accessing the live user based on the public network service address; and

in response to determining that the user data in the current user set is not greater than a quantity threshold and the distance is not greater than the distance threshold, obtaining the first detection result, the first detection result indicating that the public network service address is issued to the first user.

5. The method of claim 4, further comprising:

in response to determining that the first user obtained the streaming media content by accessing the live user based on the public network service address, adding the first user to the current set of users.

6. The method of any of claims 1-5, wherein the public network service address is obtained based on port mapping of a public network address and a port of the live user.

7. The method of any one of claims 1-6, wherein the obtaining the address comprises:

obtaining a first address of the first user corresponding to the pull instruction, wherein the first address indicates a public network address and a port of the first user;

sending a first instruction containing the first address to the live user to cause the live user to send first data in response to receiving the first instruction and to access the first user based on the first address;

responding to the live broadcast user to access the first user, and acquiring a second address corresponding to the first data of the live broadcast user, wherein the second address indicates a public network address and a port of the live broadcast user; and

determining the second address as the public network service address.

8. The method of any of claims 1-7, wherein the at least one pull address further comprises a content distribution network address, based on which the first user can access an edge server having the streaming media content to obtain the streaming media content.

9. The method of any one of claims 1-8, further comprising:

receiving a public network service forbidding instruction of the live user, wherein the public network service forbidding instruction indicates that the live user does not allow the second user to access based on the public network service address; and

and responding to the public network service forbidding instruction, issuing a content distribution network address to a second user pulling the streaming media content, so that the second user can access an edge server with the streaming media content based on the content distribution network address to obtain the streaming media content.

10. A live streaming media content broadcasting method comprises the following steps:

sending a public network service opening instruction to enable the server to respond to the public network service opening instruction to obtain a public network service address and issue at least one pull address to a first user pulling streaming media content, wherein the at least one pull address comprises the public network service address, and the public network service opening instruction indicates that the first user is allowed to access based on the public network service address.

11. The method of claim 10, further comprising:

carrying out port mapping based on a public network address and a port to obtain the public network service address; and

and sending the public network service address to the server.

12. The method of claim 10 or 11, further comprising:

13. The method of any of claims 10-12, further comprising:

acquiring the number of users in a current user set, wherein each user in the current user set accesses to acquire the streaming media content based on the public network address; and

and in response to the user number not less than a number threshold, sending a public network service forbidding instruction to enable the server to respond to the public network service forbidding instruction and issue a content distribution network address to a second user pulling the streaming media content, so that the second user can access an edge server with the streaming media content and obtain the streaming media content based on the content distribution network address, wherein the public network service forbidding instruction indicates that the second user is prohibited from accessing based on the public network service address.

14. A method for pulling streaming media content, comprising:

sending a pulling instruction to a server to pull the streaming media content of the live broadcast user;

responding to at least one pull flow address sent by the server, and acquiring a first pull flow address from the at least one pull flow address, wherein the at least one pull flow address comprises a public network service address of the live broadcast user, and the live broadcast user can be accessed based on the public network service address; and

and accessing based on the first pull address to obtain the streaming media content.

15. The method of claim 14, wherein obtaining a first pull address from the at least one pull address comprises:

in response to the public network service address being included in the at least one pull address, determining the public network service address as the first pull address.

16. The method of claim 15, wherein the at least one pull address further comprises a content distribution network address, the method further comprising:

17. The method of any of claims 14-16, further comprising:

and responding to the acquisition of the streaming media content, and sending a reporting instruction to the server, wherein the reporting instruction indicates that the streaming media content is acquired by accessing the live user based on the public network service address.

18. A streaming media content transmission apparatus, comprising:

the receiving unit is configured to receive a pull instruction of a first user and receive a public network service opening instruction of a live user, wherein the pull instruction indicates that the first user pulls the streaming media content of the live user, and the public network service opening instruction indicates that the live user allows the first user to access based on a public network service address of the live user;

the obtaining unit is configured to respond to the public network service starting instruction and the pulling instruction to obtain the public network service address; and

a distributing unit, configured to issue at least one pull address to the first user, so that the first user accesses based on one item of the at least one pull address to obtain the streaming media content, where the at least one pull address includes the public network service address.

19. A streaming media content live device, comprising:

the starting unit is configured to send a public network service starting instruction, so that the server obtains a public network service address in response to the public network service starting instruction and issues at least one pull address to a first user pulling streaming media content, wherein the at least one pull address comprises the public network service address, and the public network service starting instruction indicates that the first user is allowed to access based on the public network service address.

20. A streaming media content pull apparatus, comprising:

the instruction sending unit is configured to send a pull instruction to the server so as to pull the streaming media content of the live user;

the address selecting unit is configured to respond to at least one received pull address sent by the server and acquire a first pull address from the at least one pull address, wherein the at least one pull address comprises a public network service address of the live user, and the live user can be accessed based on the public network service address; and

an accessing unit configured to access based on the first pull address to obtain the streaming media content.

21. An electronic device, comprising:

at least one processor; and

a memory communicatively coupled to the at least one processor; wherein

The memory stores a computer program that, when executed by the at least one processor, implements the method of any one of claims 1-17.

22. A non-transitory computer readable storage medium storing a computer program, wherein the computer program when executed by a processor implements the method of any one of claims 1-17.

23. A computer program product comprising a computer program, wherein the computer program realizes the method according to any of claims 1-17 when executed by a processor.