WO2009030137A1

WO2009030137A1 - Method, device and system for mixing appointed media stream in conference

Info

Publication number: WO2009030137A1
Application number: PCT/CN2008/072022
Authority: WO
Inventors: Jiangping Feng; Tingfang Tang
Original assignee: Huawei Technologies Co., Ltd.
Priority date: 2007-08-27
Filing date: 2008-08-18
Publication date: 2009-03-12
Also published as: CN101378430B; CN101378430A

Abstract

A method for mixing appointed media stream in conference is provided, the method includes that: Multimedia Processor MP receives an identifier of the media source, which is set for the media stream participating in the mix by the Multimedia Controller MC, and sets the said identifier of the media source for the media stream which participates in the mix; MP receives an identifier of the output media stream, which will be set for the endpoint appointed to output the said media stream participating in the mix by the MC, and sets the identifier of the output media stream for the said endpoint, the said identifier of the media stream is at least one identifier of the media source, which is chosen from the media source identifiers of the said media stream participating in mix by MC; MP mixes the corresponding media stream to the output media stream of the endpoint, according to the identifier of the output media stream corresponding to the said endpoint. Another method, system, as well as multimedia controller and multimedia processor for mixing appointed media stream in conference are also provided. Using the embodiments of the invention, the appointed media stream can be mixed according to the original volume, and the operation for mixing the appointed media stream can be simplified.

Description

会议中混合指定媒体流的方法、装置和*** 技术领域 Method, device and system for mixing specified media streams in a conference

本发明涉及多媒体会议技术，特别涉及多媒体会议中混合指定媒体流的方法、 ***以及多媒体控制器、多媒体处理器。 The present invention relates to a multimedia conference technology, and in particular, to a method and system for mixing a specified media stream in a multimedia conference, and a multimedia controller and a multimedia processor.

背景技术 Background technique

目前，在多媒体会议中通常使用 H.248/媒体网关控制（ Media Gateway Control, MEGACO )协议，上述协议提供***体的建立、修改和释放机制，并将媒体服务器从功能上划分为多媒体控制器 ( Multimedia Controller, MC ) 和多媒体处理器（Multimedia Processor, MP ) , 形成载和控制分离的媒体服务器架构。 Currently, the H.248/Media Gateway Control (MEGACO) protocol is usually used in multimedia conferences. The above protocol provides a mechanism for controlling the establishment, modification and release of media, and functionally divides the media server into a multimedia controller ( Multimedia Controller (MC) and Multimedia Processor (MP) form a separate media server architecture for loading and control.

MP 上的各种资源可以抽象表示为端点，不同的端点代表不同的会议参与方，能够发送和接收一种或多种媒体流，其类型主要有半永久性端点和临时性端点。端点之间的联系可以抽象表示为上下文，上下文描述端点之间的拓补关系及媒体混合和 /或交换的参数，一个端点只能属于一个上下文。用于描述端点特性的参数称为描述符，可以划分为属性、信号、事件和统计等类别。 H.248/MEGACO 协议的一条消息包含一个或多个事务处理，每个事务处理包含一个或多个上下文，每个上下文又包括一个或多个命令，每个命令包含一个或多个描述符。这些命令包括用于建立端点的增加（Add ) 命令、用于修改端点属性的修改（Modify ) 命令、用于通知的通知（Notify )命令等，各种命令通过其携带的参数实现不同的业务。 The various resources on the MP can be abstractly represented as endpoints, and different endpoints represent different conference participants, capable of sending and receiving one or more media streams, the types of which are mainly semi-permanent endpoints and temporary endpoints. The association between endpoints can be abstracted as a context, the context describes the topological relationship between endpoints, and the parameters of media mixing and/or exchange. An endpoint can only belong to one context. The parameters used to describe the characteristics of the endpoint are called descriptors and can be divided into categories such as attributes, signals, events, and statistics. A message of the H.248/MEGACO protocol contains one or more transaction processing, each transaction containing one or more contexts, each context including one or more commands, each command containing one or more descriptors. These commands include an Add command for establishing an endpoint, a Modify command for modifying an endpoint attribute, a Notify command for notification, etc. Various commands implement different services through the parameters they carry.

为了屏蔽端点多样性的问题， H.248/MEGACO 协议中引入了包的概念，将具有业务相关性的参数在逻辑上组合成包，不同的包基于其内部包括的不同参数，可以对代表参与方的端点设置混音策略。以 H.248协议中的多点会议控制协议 H.248.19为例，该协议中针对音频会议定义了混音音量控制包（ Mixing Volume Level Control Package ) , 该包对代表参与方的端点设置混音策略，为混音指定媒体源，并指定各媒体源被混音时的音量。该包中的参数包括：混合参与方编号和混音输入音量，其中混合参与方编号用于为参与混音的端点上的媒体流进行编号，可以表示为 Mixpartnum, 编号后形成媒体源列表，而混音输入音量用于描述媒体源列表中不同端点上的媒体流的被混音的音量，可以表示为 Vollevip。 In order to shield the problem of endpoint diversity, the concept of the packet is introduced in the H.248/MEGACO protocol, and the parameters with business relevance are logically combined into packets. Different packets can participate in the representative based on different parameters included in the internal package. The endpoint of the party sets the mix strategy. Take the multipoint conference control protocol H.248.19 in the H.248 protocol as an example. In this protocol, a Mixing Volume Level Control Package is defined for audio conferences. This package sets the mix for the endpoints representing the participants. Policy, assigns a media source to the mix, and specifies the volume at which each media source is mixed. The parameters in the package include: mixed participant number and mix input volume, where the mixed participant number is used to number the media streams on the endpoints participating in the mix, which can be expressed as Mixpartnum, after numbering to form a list of media sources, and The mix input volume is used to describe the volume of the mixed media stream on different endpoints in the media source list, which can be expressed as Vollevip.

在实际应用中可能存在这样的需求，某些参与方希望收听固定的某些媒体流，即代表参与方的端点可以输出指定混音媒体流，包括不同的端点输出不同的指定混音媒体流，或所有端点输出指定的相同混音媒体流等。 H.248.19协议中的混音音量控制包可以实现上述需求。现有技术中为使用上述混音音量控制包提供的功能，针对 MC和 MP给出了输出指定混音媒体流的具体实施步骤。 In practical applications, there may be such a requirement that some participants want to listen to certain fixed media streams, that is, the endpoints representing the participants can output the specified mixed media stream, including different endpoints outputting different specified mixed media streams. Or all endpoints output the same mix of media streams as specified. The mixing volume control package in the H.248.19 protocol can fulfill the above requirements. In the prior art, the functions provided by the above-mentioned mixing volume control package are given, and specific implementation steps for outputting the specified mixed media stream are given for the MC and MP.

殳设应用场景为： MP上包括四个端点 TA、 TB、 TC和 TD, 其中 TD 要求指定输出来自 TA和 TB的混音媒体流，输出指定混音媒体流具体操作包括： The application scenario is as follows: The MP includes four endpoints TA, TB, TC and TD, wherein the TD requires to specify the output of the mixed media stream from the TA and the TB, and the specific operations of outputting the specified mixed media stream include:

MC为需要参与混音的端点上的媒体流设置编号 Mixpartnum, 为输出指定混音媒体流的端点设置指定混音媒体流的音量 Vollevip, 指示 MP设置所述端点的 Mixpartnum和 Vollevip; The MC sets the number Mixpartnum for the media stream on the endpoint that needs to participate in the mixing, and sets the volume of the specified mixed media stream to the endpoint of the output mixed media stream. Vollevip, indicating that the MP sets the Mixpartnum and Vollevip of the endpoint;

MP接收媒体流，以指定音量在向相关端点的输出媒体流中混合指定混音媒体流。 The MP receives the media stream and mixes the designated mix media stream with the specified volume in the output media stream to the associated endpoint.

上述步骤实施之前， MC 可以通过多种方式获知参与混音的端点和各端点指定输出的媒体流，例如可以通过会议***指定并通知 MC。 Before the above steps are implemented, the MC can know the media stream participating in the mixing and the output of the specified output by each endpoint in various ways. For example, the MC can be specified and notified by the conference chairperson.

结合 H没应用场景， MC为 TA、 TB和 TD上的媒体流分别设置编号为 1、 2和 3 , MC指示 MP为 TA、 TB和 TD上的媒体流设置编号 1 , 2 , 3。在本步骤中，对于没有编号的端点上的媒体流，不参与混音。 In combination with the H no application scenario, the MC sets the number of media streams on the TA, TB, and TD to 1, 2, and 3, respectively, and the MC indicates that the MP sets the numbers 1 , 2, and 3 for the media streams on the TA, TB, and TD. In this step, the media stream on the unnumbered endpoint does not participate in the mix.

MC为 TD设置指定混音媒体源的混音音量，并指示 MP为 TD设置指定的混音音量。 MP在端点 TD上依次设置混音音量为 25分贝、 15分贝和 0分贝，该记录顺序与 Mixpartnum对应的编号顺序相同，由于 TC未进行媒体源编号，则上述设置的混音音量分别对应 TA、 TB和 TD, 其中 TD的音量被设置为 0分贝，因此 TD输出的混音媒体流只包括来自 TA和 TB的媒体流，即实现了 TD输出指定媒体流。图 1示出了经过上述设置后各端点的属性。 The MC sets the mix volume of the specified mix media source for the TD and instructs the MP to set the specified mix volume for the TD. The MP sequentially sets the mixing volume to 25 decibels, 15 decibels, and 0 decibels on the endpoint TD. The order of the records is the same as that of the Mixpartnum, since the TC is not performed. The media source number, the above-mentioned set mixing volume corresponds to TA, TB and TD, respectively, wherein the volume of the TD is set to 0 decibels, so the mixed media stream output by the TD only includes the media streams from the TA and the TB, that is, the implementation The TD outputs a specified media stream. Figure 1 shows the properties of each endpoint after the above settings.

现有技术会议中混合指定媒体流的方案，无论不同端点指定输出不同的混合媒体流，还是所有端点都指定输出相同的混合媒体流，都需要先对可能参与混音的端点上的媒体流进行编号，然后对指定媒体流设置音量，因此混合指定媒体流时都必须按照为其指定的音量进行混合，当需要以原始音量混合指定媒体流时，现有技术的方案无法做到；并且，当所有端点都指定输出相同的混合媒体流时，需要先对指定输出的媒体流编号，然后逐个设置所有端点上该指定媒体流的混音音量，没有提出一种简化操作的方案。 In the prior art conference, a scheme for mixing specified media streams, whether different endpoints specify different mixed media streams, or all endpoints specify to output the same mixed media stream, needs to first perform media streams on endpoints that may participate in the mixing. Number, and then set the volume for the specified media stream, so the mixed media stream must be mixed according to the volume specified for it. When it is necessary to mix the specified media stream with the original volume, the prior art solution cannot do it; and, when When all endpoints specify to output the same mixed media stream, it is necessary to first number the media stream of the specified output, and then set the mixing volume of the specified media stream on all the endpoints one by one, without suggesting a simplified operation.

发明内容 Summary of the invention

本发明实施例提供一种会议中混合指定媒体流的方法、 MP、 MC、系统，能够实现按照原始音量混合指定媒体流。 Embodiments of the present invention provide a method, a MP, an MC, and a system for mixing specified media streams in a conference, which can implement mixing of specified media streams according to original volume.

本发明实施例提供一种会议中混合指定媒体流的方法，该方法包括：多媒体处理器 MP接收多媒体控制器 MC为参与混合的媒体流设置的媒体源标识，为参与混合的媒体流设置所述媒体源标识； An embodiment of the present invention provides a method for mixing a specified media stream in a conference, where the method includes: the multimedia processor MP receives a media source identifier set by the multimedia controller MC for participating in the mixed media stream, and setting the medium for participating in the mixed media stream. Media source identifier;

MP接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为所述端点设置所述输出媒体流标识，所述媒体流标识是 MC 从所述参与混合的媒体流的媒体源标识中，选择的至少一个媒体源标识； The MP receiving MC is configured to output an output media stream identifier that is set by the endpoint of the media stream that participates in the mixing, and set the output media stream identifier for the endpoint, where the media stream identifier is the MC from the media stream that participates in the mixing. In the media source identifier, at least one selected media source identifier;

MP 根据所述端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 The MP mixes the corresponding media stream into the output media stream of the endpoint according to the output media stream identifier corresponding to the endpoint.

本发明实施例提供一种 MC, 该 MC包括： An embodiment of the present invention provides an MC, where the MC includes:

标识设置模块，用于为参与混合的媒体流设置媒体源标识；从所述参与混合的媒体流对应的媒体源标识中，选择至少一个媒体源标识，作为指定输出所述参与混合的媒体流的端点对应的输出媒体流标识；指示模块，用于将所述媒体源标识和输出媒体流标识向 MP发送，指示 MP设置所述媒体源标识和输出媒体流标识。 An identifier setting module, configured to set a media source identifier for the media stream participating in the hybrid; and selecting at least one media source identifier from the media source identifier corresponding to the media stream participating in the hybrid, as the finger Outputting an output media stream identifier corresponding to the endpoint of the media stream participating in the hybrid; the indicating module, configured to send the media source identifier and the output media stream identifier to the MP, and instruct the MP to set the media source identifier and the output media stream Logo.

本发明实施例提供一种 MP, 该 MP包括： An embodiment of the present invention provides an MP, where the MP includes:

处理模块，用于接收 MC为参与混合的媒体流设置的媒体源标识，为所述参与混合的媒体流设置所述媒体源标识；接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，所述媒体流标识是从所述参与混合的媒体流的媒体源标识中，选择的至少一个媒体源标识； a processing module, configured to receive a media source identifier set by the MC for participating in the mixed media stream, and set the media source identifier for the media stream participating in the hybrid; and the receiving MC is configured to output the endpoint of the media stream participating in the hybrid And outputting a media stream identifier, where the media stream identifier is at least one selected media source identifier from the media source identifier of the media stream participating in the hybrid;

混合执行模块，用于根据指定输出所述参与混合的媒体流的端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 And a hybrid execution module, configured to output, according to the specified output media stream identifier corresponding to the endpoint of the media stream participating in the hybrid, to mix the corresponding media stream into the output media stream of the endpoint.

本发明实施例提供一种会议中混合指定媒体流的***，该***包括： MP和 MC; An embodiment of the present invention provides a system for mixing specified media streams in a conference, where the system includes: MP and MC;

所述 MC, 用于为参与混合的媒体流设置媒体源标识；从所述参与混合的媒体流对应的媒体源标识中，选择至少一个媒体源标识，作为指定输出所述参与混合的媒体流的端点对应的输出媒体流标识；将所述媒体源标识和输出媒体流标识向 MP发送，指示 MP设置所述媒体源标识和输出媒体流标识； The MC is configured to set a media source identifier for the media stream that participates in the mixing; and select at least one media source identifier from the media source identifier corresponding to the media stream that participates in the hybrid, as the specified output of the media stream that participates in the mixing An output media stream identifier corresponding to the endpoint; sending the media source identifier and the output media stream identifier to the MP, instructing the MP to set the media source identifier and the output media stream identifier;

所述 MP, 用于接收 MC为参与混合的媒体流设置的媒体源标识，为所述参与混合的媒体流设置所述媒体源标识；接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为所述端点设置所述输出媒体流标识；根据指定输出所述参与混合的媒体流的端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 The MP is configured to receive, by the MC, a media source identifier set for the media stream that participates in the hybrid, and set the media source identifier for the media stream that participates in the hybrid; and the receiving MC is configured to output the endpoint settings of the media stream that participates in the hybridization. The output media stream identifier is set for the endpoint, and the output media stream identifier corresponding to the endpoint of the media stream participating in the mixed output is output, and the corresponding media stream is mixed to the output media stream of the endpoint. in.

可见，本发明实施例提供的会议中混合指定媒体流的方法、装置和系统，可以为参与混合的媒体流设置媒体源标识，还可以为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，所述输出媒体流标识为在参与混合的媒体流对应的媒体源标识中，选择的至少一个媒体源标识，将输出媒体流标识对应的媒体流混合到各个端点的输出媒体流中，而无需通过指定音量确定各端点指定输出的媒体流，从而可以按照原始音量混合指定媒体流。 It can be seen that the method, device, and system for mixing a specified media stream in a conference provided by the embodiment of the present invention may set a media source identifier for the media stream participating in the hybrid, and may also output an output that is specified to output the endpoint of the media stream participating in the hybrid. a media stream identifier, where the output media stream identifier is selected from at least one media source identifier corresponding to the media source identifier corresponding to the mixed media stream, The media stream corresponding to the output media stream identifier is mixed into the output media stream of each endpoint without determining the media stream specified by each endpoint by specifying the volume, so that the specified media stream can be mixed according to the original volume.

另一方面，本发明实施例提供另一种会议中混合指定媒体流的方法、 On the other hand, an embodiment of the present invention provides another method for mixing a specified media stream in a conference.

MC、 MP、 ***，能够针对所有端点都指定输出相同混合媒体流的情况，简化操作。 MC, MP, system, can specify the output of the same mixed media stream for all endpoints, simplifying operations.

本发明实施例提供另一种会议中混合指定媒体流的方法，该方法包括： An embodiment of the present invention provides another method for mixing a specified media stream in a conference, where the method includes:

MP接收 MC为指定端点上的媒体流设置的始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识； The MP receiving MC sets the always-involved hybrid identifier set for the media stream on the specified endpoint, and sets the always-involved hybrid identifier for the media stream on the specified endpoint;

MP 根据所述始终参与混合标识，将对应指定端点上的媒体流，混合到各端点的输出媒体流中。 The MP mixes the media streams corresponding to the specified endpoints into the output media stream of each endpoint according to the always participating in the hybrid identifier.

本发明实施例提供另一种 MC, 该 MC包括： An embodiment of the present invention provides another MC, where the MC includes:

标识设置模块，用于为指定端点上的媒体流设置始终参与混合标识；指示模块，用于将所述标识设置模块设置的始终参与混合标识向 MP 发送，指示 MP为指定端点设置所述始终参与混合标识。 An identifier setting module, configured to always participate in the hybrid identifier for the media stream on the specified endpoint; the indication module, configured to send the always-involved hybrid identifier set by the identifier setting module to the MP, indicating that the MP is always participating in the specified endpoint setting Mixed logo.

本发明实施例提供另一种 MP, 该 MP包括： An embodiment of the present invention provides another MP, where the MP includes:

处理模块，用于接收 MC为指定端点上的媒体流设置的始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识； a processing module, configured to receive an always-on hybrid identifier set by the MC for the media stream on the specified endpoint, and set the always-involved hybrid identifier for the media stream on the specified endpoint;

混合执行模块，用于将所述始终参与混合标识对应的指定端点上的媒体流混合到各端点的输出媒体流中。 The hybrid execution module is configured to mix the media streams on the specified endpoints that are always involved in the hybrid identifier into the output media stream of each endpoint.

本发明实施例提供另一种会议中混合指定媒体流的***，该***包括： MC和 MP; An embodiment of the present invention provides another system for mixing specified media streams in a conference, where the system includes: MC and MP;

所述 MC, 用于为指定端点上的媒体流设置始终参与混合标识；将所述始终参与混合标识向 MP发送，指示 MP为指定端点设置所述始终参与混合标识；所述 MP, 用于接收 MC为指定端点上的媒体流设置的始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识；将所述始终参与混合标识对应的指定端点上的媒体流混合到各端点的输出媒体流中。 The MC is configured to always participate in the hybrid identifier for the media stream on the specified endpoint; send the always-involved hybrid identifier to the MP, and instruct the MP to set the always-involved hybrid identifier for the specified endpoint; The MP is configured to receive an always-involved hybrid identifier set by the MC for the media stream on the specified endpoint, and set the always-involved hybrid identifier for the media stream on the specified endpoint; The media stream is mixed into the output media stream of each endpoint.

可见，本发明实施例提供的会议中混合指定媒体流的方法、装置和系统，针对所有端点都指定输出相同的混合媒体流的情况，还可以为指定端点设置始终参与混合标识， MP 混音时将始终参与混合标识对应的指定端点上的媒体流混合到所有端点的输出媒体流中，即只需针对指定端点设置一个标识，就可实现混合指定媒体流，简化了这种情况下的操作。 It can be seen that the method, device, and system for mixing specified media streams in a conference provided by the embodiment of the present invention specify that the same mixed media stream is output for all endpoints, and can also always participate in the hybrid identifier for the specified endpoint, when MP is mixed. The media stream on the specified endpoint corresponding to the hybrid ID is always mixed into the output media stream of all endpoints, that is, only one identifier is set for the specified endpoint, and the specified media stream can be mixed, which simplifies the operation in this case.

附图说明 DRAWINGS

图 1 为现有技术中使用音量控制包混合指定媒体流的方法中， MP中各端点属性示意图； FIG. 1 is a schematic diagram of attributes of each endpoint in an MP in a method for mixing a specified media stream using a volume control packet in the prior art;

图 2为本发明实施例会议中混合指定媒体流的第一种方法流程图；图 3为本发明实施例会议中混合指定媒体流的第一种方法较佳实施方式流程图； 2 is a flowchart of a first method for mixing specified media streams in a conference according to an embodiment of the present invention; FIG. 3 is a flowchart of a preferred method for mixing a specified media stream in a conference according to an embodiment of the present invention;

图 4为图 3所示流程中 MP中各端点属性示意图； 4 is a schematic diagram of attributes of each endpoint in the MP in the process shown in FIG. 3;

图 5为本发明实施例会议中混合指定媒体流的第二种方法流程图；图 6为本发明实施例会议中混合指定媒体流的第二种方法较佳实施方式流程图； FIG. 5 is a flowchart of a second method for mixing a specified media stream in a conference according to an embodiment of the present invention; FIG. 6 is a flowchart of a second preferred method for mixing a specified media stream in a conference according to an embodiment of the present invention;

图 7为图 6所示流程中 MP中各端点属性示意图； 7 is a schematic diagram of attributes of each endpoint in the MP in the process shown in FIG. 6;

图 8为本发明实施例提供的第一种 MC的结构示意图； FIG. 8 is a schematic structural diagram of a first MC according to an embodiment of the present disclosure;

图 9为本发明实施例提供的第二种 MC的结构示意图； FIG. 9 is a schematic structural diagram of a second type of MC according to an embodiment of the present disclosure;

图 10为本发明实施例提供的第一种 MP的结构示意图。 FIG. 10 is a schematic structural diagram of a first type of MP according to an embodiment of the present invention.

具体实施方式 detailed description

为使本发明实施例的目的和优点更加清楚，下面结合附图对本发明实施例作进一步的详细说明。 The embodiments of the present invention will be further described in detail below with reference to the accompanying drawings.

首先，对本发明实施例提供的会议中混合指定媒体流的方法进行详细描述。 First, the method for mixing a specified media stream in a conference provided by an embodiment of the present invention is detailed. Description.

在介绍该方法的详细流程之前，先介绍以下两种该方法中要用到的标识： Before describing the detailed process of this method, the following two types of identifiers to be used in this method are introduced:

第一、媒体源标识。 First, the media source identifier.

媒体源标识为 MC为参与混合的媒体流设置，用来在混合中标识这些媒体流。 The media source identifier is set by the MC for participating in the mixed media stream to identify these media streams in the mix.

第二、输出媒体流标识。 Second, the output media stream identifier.

输出媒体流标识为 MC为指定输出参与混合的媒体流的端点设置，该输出媒体流标识为从所述参与混合的媒体流对应的媒体源标识中，选择的至少一个媒体源标识。 The output media stream identifier is an endpoint setting of the media stream that the specified output participates in the hybrid, and the output media stream identifier is the selected at least one media source identifier from the media source identifier corresponding to the media stream participating in the hybrid.

图 2为本发明实施例提供的会议中混合指定媒体流的第一种方法流程图，该流程包括： FIG. 2 is a flowchart of a first method for mixing a specified media stream in a conference according to an embodiment of the present disclosure, where the process includes:

步骤 201 : MP接收 MC为参与混合的媒体流设置的媒体源标识，为参与混合的媒体流设置所述媒体源标识。 Step 201: The MP receives the media source identifier set by the MC for participating in the mixed media stream, and sets the media source identifier for the mixed media stream.

本步骤中，所述媒体源标识根据实际应用场景，可以设置为不同的形式，例如媒体源编号。 MP接收媒体源标识可以通过接收 H.248协议中的消息实现，在 MC发送给 MP的消息中携带媒体源标识，所述消息可以为修改请求（ MOD. request ) 消息。 In this step, the media source identifier may be set to a different form, such as a media source number, according to an actual application scenario. The MP receiving media source identifier may be implemented by receiving a message in the H.248 protocol, and the message sent by the MC to the MP carries the media source identifier, and the message may be a modify request (MOD. request) message.

步骤 202: MP接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为所述端点设置输出媒体流标识。所述输出媒体流标识是从所述参与混合的媒体流的媒体源标识中，选择的至少一个媒体源标识。 Step 202: The MP receiving MC is configured to output an output media stream identifier set by the endpoint of the media stream participating in the mixing, and set an output media stream identifier for the endpoint. The output media stream identifier is at least one media source identifier selected from the media source identifiers of the media streams participating in the hybrid.

步骤 203 : MP根据所述端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 Step 203: The MP mixes the corresponding media stream into the output media stream of the endpoint according to the output media stream identifier corresponding to the endpoint.

经过上述步骤 201〜步骤 203 , 本发明实施例提供的会议中混合指定媒体流的第一种方法流程结束，该流程针对一个端点，描述了实现输出指定混音媒体流的过程，具体应用中只需将上述流程应用到相关端点即可。在上述步骤 201和步骤 202中， MP接收媒体源标识，可以通过 H.248 协议中具体的消息实现，例如修改请求消息或增加请求消息等。在这种情况下， MP还可以向 MC发送修改响应消息或增加响应消息，返回执行结果。 After the foregoing steps 201 to 203, the first method of mixing the specified media stream in the conference provided by the embodiment of the present invention ends, and the process describes the implementation output specification for an endpoint. The process of mixing media streams, in the specific application, only need to apply the above process to the relevant endpoints. In the foregoing step 201 and step 202, the MP receives the media source identifier, which may be implemented by using a specific message in the H.248 protocol, such as a modification request message or an add request message. In this case, the MP can also send a modification response message or an increase response message to the MC to return the execution result.

本发明实施例提供的会议中混合指定媒体流的第一种方法， MC 为参与混合的端点上的媒体流设置媒体源标识发送给 MP, 并将为指定输出所述混合媒体流的端点设置的输出媒体流标识也发送给 MP, MP可以将输出媒体流标识对应的媒体流混合到该端点的输出媒体流中，避免为参与混合的媒体流设置指定音量，从而实现按照原始音量混合指定媒体流。 The first method for mixing a specified media stream in a conference provided by the embodiment of the present invention, the MC sets a media source identifier to the MP for the media stream participating in the hybrid endpoint, and sends the identifier to the endpoint for specifying the output of the mixed media stream. The output media stream identifier is also sent to the MP, and the MP can mix the media stream corresponding to the output media stream identifier into the output media stream of the endpoint to avoid setting a specified volume for the media stream participating in the hybrid, thereby implementing the specified media stream according to the original volume. .

本发明实施例提供的会议中混合指定媒体流的第一种方法中，所述媒体源标识和输出媒体流标识，可以按照 H.248协议的规定组成包，称为指定媒体源混音包，该包用于为端点指定按照原始音量混合的媒体流。 In the first method of mixing a specified media stream in a conference provided by the embodiment of the present invention, the media source identifier and the output media stream identifier may be formed into a packet according to the provisions of the H.248 protocol, and is referred to as a specified media source mixing packet. This package is used to specify the media stream that is mixed at the original volume for the endpoint.

在本发明实施例提供的会议中混合指定媒体流的第一种方法中，可以包括两种应用场景，第一种为针对各个端点混合不同的指定媒体流，第二种为针对所有端点混合相同的指定媒体流。下面以第一种应用场景为例，介绍本发明实施例提供的会议中混合指定媒体流的第一种方法，应用在音频会议中的较佳实施方式。 The first method for mixing a specified media stream in the conference provided by the embodiment of the present invention may include two application scenarios, the first one is to mix different specified media streams for each endpoint, and the second is to mix the same for all endpoints. The specified media stream. The first application scenario in the conference provided by the embodiment of the present invention is described in the following, and the first method for mixing the specified media stream in the conference is applied to the preferred embodiment in the audio conference.

图 3为本发明实施例提供的会议中混合指定媒体流的第一种方法的较佳实施方式流程图，假设该流程的应用场景为： MC使用 H.248协议中的修改请求（ MOD.request ) 消息向 MP发出指示， MP在完成 MC所指示的操作后向 MC发送修改响应（MOD.reply ) 消息，返回执行结果；参与混音的端点分别为 TA、 TB、 TC和 TD, 其中 TA指定输出 TC上的媒体流， TC指定输出 TA和 TB上的媒体流， TD指定输出 TB上的媒体流；媒体源标识为媒体源编号（ Mix Participant Number ) ，输出媒体流标识为输出媒体流编号（ Output Participant Number ) , 并将所述媒体源编号作为指定输出所述参与混合的媒体流的端点对应的输出媒体流编号；使用 Mixpartnum 代表媒体源编号属性，使用 outpn代表输出媒体流编号属性。 3 is a flowchart of a preferred implementation manner of a first method for mixing specified media streams in a conference according to an embodiment of the present invention. It is assumed that the application scenario of the process is: MC uses a modification request in the H.248 protocol (MOD.request) The message sends an indication to the MP, and the MP sends a modify response (MOD.reply) message to the MC after completing the operation indicated by the MC, and returns the execution result; the endpoints participating in the mix are TA, TB, TC, and TD, respectively, where the TA designates The media stream on the TC is output, the TC specifies the media stream on the output TA and the TB, and the TD specifies the media stream on the output TB; the media source identifier is the Mix Participant Number, and the output media stream identifier is the output media stream number ( Output Participant Number ) , and the media source number is specified as the input The output media stream number corresponding to the endpoint of the media stream participating in the hybrid; the Mixpartnum is used to represent the media source number attribute, and the outpn is used to represent the output media stream number attribute.

图 3所示流程包括： The process shown in Figure 3 includes:

步骤 301〜步骤 302 : MC 设置 TA 上媒体流的媒体源编号为 Mixpartnum = 1 , 向 MP发送 MOD.request消息，指示 MP对 TA上媒体流进行媒体源编号，并接收 MP发送的 MOD .reply消息 , 即 MP返回的执行结果。 Step 301 to Step 302: The MC sets the media source number of the media stream on the TA to Mixpartnum = 1, and sends a MOD.request message to the MP, instructing the MP to perform the media source number on the media stream on the TA, and receiving the MOD.reply message sent by the MP. , that is, the execution result returned by the MP.

步骤 303〜步骤 304 : MC 设置 TB 上媒体流的媒体源编号为 Mixpartnum=2,向 MP发送 MOD.request消息，指示 MP对 TB上媒体流进行媒体源编号 , 并接收 MP发送的 MOD .reply消息 , 即 MP返回的执行结果。 Step 303 to step 304: The MC sets the media source number of the media stream on the TB to Mixpartnum=2, and sends a MOD.request message to the MP, instructing the MP to perform the media source number on the media stream on the TB, and receiving the MOD.reply message sent by the MP. , that is, the execution result returned by the MP.

步骤 305〜步骤 306 : MC 设置 TC 上媒体流的媒体源编号为 Mixpartnum=3 , 根据应用场景假设， TC指定输出 TA和 TB上的媒体流，而在前述步骤 301〜步骤 302中， TA和 TB的媒体源编号已经设定，因此可以在本步骤中设置 TC媒体源编号的同时，设置 TC的输出媒体流编号为 outpn=l , 2。 MC向 MP发送 MOD.request消息，指示 MP对 TC上媒体流进行媒体源编号、以及对 TC 进行输出媒体流编号，并接收 MP 发送的 MOD. reply消息 , 即 MP返回的执行结果。 Step 305 to step 306: The MC sets the media source number of the media stream on the TC to Mixpartnum=3. According to the application scenario, the TC specifies the media streams on the output TA and the TB, and in the foregoing steps 301 to 302, TA and TB. The media source number has been set, so you can set the TC media source number and set the output media stream number of the TC to outpn=l, 2 while setting the TC media source number in this step. The MC sends a MOD.request message to the MP, instructing the MP to perform the media source number on the media stream on the TC, and output the media stream number to the TC, and receive the MOD. reply message sent by the MP, that is, the execution result returned by the MP.

步骤 307 ~步骤 308: 根据应用场景假设， TD指定输出 TB上的媒体流，而在前续步骤中， TB的媒体源编号已经设置为 2, 因此 MC可以在本步骤中设置 TD的输出媒体流编号为 outpn=2, MC向 MP发送 MOD.request 消息，指示 MP 对 TC 上媒体流进行媒体源编号，并接收 MP 发送的 MOD. reply消息，即 MP返回的执行结果。由于根据假设应用场景，其他端点未指定输出 TD上的媒体流，则本步骤中可以不对 TD进行媒体源编号。 Step 307 ~ Step 308: According to the application scenario assumption, the TD specifies the media stream on the output TB, and in the previous step, the media source number of the TB has been set to 2, so the MC can set the output media stream of the TD in this step. The number is outpn=2, and the MC sends a MOD.request message to the MP, instructing the MP to perform the media source number for the media stream on the TC, and receives the MOD. reply message sent by the MP, that is, the execution result returned by the MP. Since the other endpoints do not specify the media stream on the output TD according to the hypothetical application scenario, the media source number may not be used for the TD in this step.

步骤 309〜步骤 310: 根据应用场景假设， TA指定输出 TC的媒体流，在前续步骤中， TC的媒体源编号已经设置为 3 , MC设置 TA的输出媒体流编号为 outpn=3，并向 MP发送 MOD.request消息，指示 MP对 TC上媒体流进行媒体源编号，并接收 MP发送的 MOD.reply消息 , 即 MP返回的执行结果。 Step 309 to step 310: According to the application scenario, the TA specifies the media stream of the output TC. In the previous step, the media source number of the TC has been set to 3, and the output media stream number of the MC setting TA is outpn=3, and a MOD.request message is sent to the MP, indicating that the MP performs the media source number on the media stream on the TC. And receive the MOD.reply message sent by the MP, that is, the execution result returned by the MP.

经过上述步骤 301〜步骤 310, 已经完成为参与混音的端点设置媒体源编号，并为指定输出参与混音的媒体流的端点设置输出媒体流编号，完成了指定媒体流的操作。 After the above steps 301 to 310, the media source number is set for the endpoint participating in the mixing, and the output media stream number is set for the endpoint of the media stream that is designated to output the mixing, and the operation of specifying the media stream is completed.

步骤 311： MP根据指定输出所述参与混音的媒体流的端点对应的输出媒体流标识 , 将对应的媒体流混合到该端点的输出媒体流中。关于 MP如何进行混音，为本领域技术人员的公知常识，也并非本发明实施例讨论的重点，这里不再赘述。 Step 311: The MP outputs the corresponding media stream to the output media stream of the endpoint according to the specified output media stream identifier corresponding to the endpoint of the media stream participating in the mixing. Regarding how the MP is mixed, it is common knowledge of those skilled in the art, and is not the focus of the discussion of the embodiments of the present invention, and details are not described herein again.

经过上述步骤， T A的输出媒体流中以原始音量混合来自 TC的媒体流， TC的输出媒体流中以原始音量混合来自 TA和 TB的媒体流，而 TD的输出媒体流中以原始音量混合来自 TB的媒体流。 After the above steps, the media stream from the TC is mixed in the output media stream of the TA at the original volume, and the media streams from the TA and the TB are mixed in the output media stream of the TC at the original volume, and the output volume stream of the TD is mixed with the original volume. TB media stream.

从上述图 3所示流程可以看出，当端点指定输出的参与混音的媒体流已经完成媒体源编号时，就可以针对该端点设置输出媒体流编号，例如步骤 305 ~步骤 306示出的为 TC设置输出媒体流编号的情况；当端点指定输出的参与混音的媒体流还未完成媒体源编号时，可以在所述指定的媒体流完成媒体源编号之后，再设置该端点的输出媒体流编号，例如步骤 301 ~ 步骤 302中， TA指定接收的 TC上的媒体流还未进行媒体源编号，则在步骤 301〜步骤 302中仅为 TA设置了媒体源编号，而在步骤 309〜步骤 310 中，在 TC上的媒体流已经完成媒体源编号后，再为 TA设置输出媒体流编号。当然，步骤 309〜步骤 310可以在 TC上的媒体流完成媒体源编号后的任意步骤进行，例如可以在步骤 307 ~步骤 308之前进行。 It can be seen from the above-mentioned process shown in FIG. 3 that when the media stream of the audio input participating in the output specified by the endpoint has completed the media source number, the output media stream number can be set for the endpoint, for example, steps 305 to 306 are shown. The TC sets the output media stream number; when the endpoint specifies that the output media stream participating in the mixing has not completed the media source number, the output media stream of the endpoint may be set after the specified media stream completes the media source number. For example, in step 301 to step 302, the TA specifies that the media stream on the received TC has not been subjected to the media source number. In step 301 to step 302, the media source number is set only for the TA, and in steps 309 to 310. After the media stream on the TC has completed the media source number, set the output media stream number for the TA. Of course, step 309 to step 310 can be performed at any step after the media stream on the TC completes the media source number, for example, before step 307 to step 308.

上述针对不同端点的设置步骤也可以交换执行顺序，例如步骤 305 ~ 步骤 306可以和步骤 307 ~步骤 308交换执行顺序。图 4示出了经过上述步骤 301 ~步骤 311之后 MP中各端点的属性。以上以本发明实施例提供的会议中混合指定媒体流的第一种方法中的第一种应用场景为例，详细描述了第一种方法应用在音频会议中的流程。针对第二种应用场景，即所有端点指定输出相同的媒体流，步骤流程与上述图 3所示相同，区别在于首先需要为该所有端点都指定输出的媒体流设置媒体源编号，再逐一将该指定输出的媒体流对应的媒体源编号设置为其他端点的输出媒体流编号。 The above-mentioned setting steps for different endpoints may also exchange the execution order. For example, steps 305 to 306 may exchange the execution order with steps 307 to 308. FIG. 4 shows the attributes of each end point in the MP after the above steps 301 to 311. The first application scenario in the first method of mixing the specified media stream in the conference provided by the embodiment of the present invention is taken as an example, and the flow of the first method applied in the audio conference is described in detail. For the second application scenario, that is, all the endpoints specify the output of the same media stream, and the process flow is the same as that shown in FIG. 3 above, except that the media source number of the output media specified by all the endpoints needs to be set first, and then the media source number is set one by one. Specifies the media source number corresponding to the output media stream to be the output media stream number of the other endpoint.

图 5为本发明实施例提供的会议中混合指定媒体流的第二种方法流程图，该流程包括： FIG. 5 is a flowchart of a second method for mixing a specified media stream in a conference according to an embodiment of the present disclosure, where the process includes:

步骤 501： MP接收 MC为指定端点上的媒体流设置始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识。 Step 501: The MP receiving MC sets the always participating in the hybrid identifier for the media stream on the specified endpoint, and sets the always-involved hybrid identifier for the media stream on the specified endpoint.

本步骤中，所述始终参与混合标识，用于指示该端点的媒体流是否始终被混合到其他端点的输出媒体流中 , 该标识的取值可以为 ON或 OFF, 其中 ON表示该端点的媒体流始终被混合到其他端点的输出媒体流中。 In this step, the indicator is always involved in the mixed identifier, and is used to indicate whether the media stream of the endpoint is always mixed into the output media stream of the other endpoint. The value of the identifier may be ON or OFF, where ON indicates the media of the endpoint. Streams are always mixed into the output media stream of other endpoints.

步骤 502: MP根据所述始终参与混合标识，将对应媒体流混合到各端点的输出媒体流中。 Step 502: The MP mixes the corresponding media stream into the output media stream of each end point according to the always participating in the hybrid identifier.

本发明实施例提供的会议中混合指定媒体流的第二种方法， MC 为指定端点上的媒体流设置始终参与混合标识，并指示 MP为指定端点设置所述始终参与混合标识， MP 接收媒体流后，可以将上述指定端点上的媒体流混合到各端点的输出媒体流中，并且 MC无需为指定端点上的媒体流设置媒体源编号，再针对其他端点逐一设置输出媒体流编号，从而简化了这种应用场景下的操作。 A second method for mixing a specified media stream in a conference provided by the embodiment of the present invention, the MC sets the always participating in the hybrid identifier for the media stream on the specified endpoint, and instructs the MP to set the always-involved hybrid identifier for the specified endpoint, and the MP receives the media stream. After that, the media stream on the specified endpoint can be mixed into the output media stream of each endpoint, and the MC does not need to set the media source number for the media stream on the specified endpoint, and then sets the output media stream number one by one for other endpoints, thereby simplifying the process. The operation in this application scenario.

在上述步骤 501 中， MC设置始终参与混合标识后，还可以为指定端点上的媒体流进一步设置混合音量，用于描述该端点的媒体流作为媒体源混合时的音量电平值，该参数只有在始终参与混合标识的取值为 ON的情况下才有效，如果步骤 501中不设置该参数，则表示按照原始音量对该端点的媒体流进行混合。在设置了混合音量后，可以在所有端点的输出媒体流中按照指定音量混合该指定端点上的媒体流。 In the above step 501, after the MC setting is always involved in the hybrid identification, the mixing volume may be further set for the media stream on the specified endpoint, and used to describe the media stream of the endpoint as the volume level value when the media source is mixed. It is valid only when the value of the mixed identifier is always ON. If the parameter is not set in step 501, it means that the end is the original volume. The media stream of points is mixed. After the blending volume is set, the media stream on the specified endpoint can be mixed at the specified volume in the output media stream of all endpoints.

同样地， MC向 MP发送始终参与混合标识和 /或混合音量时，也可以釆用 H.248协议中的修改请求消息， MP也可以向 MC发送修改响应消息，返回执行结果。 Similarly, when the MC sends the MP to always participate in the mixed identifier and/or the mixed volume, the modification request message in the H.248 protocol can also be used, and the MP can also send a modification response message to the MC to return the execution result.

将上述始终参与混合标识和混合音量按照 H.248协议的规定组成包，可以称为指定媒体源始终被混音包（ Specific Sound Mixed Package ) ，作为对 H.248协议的补充，而始终参与混合标识和混合音量可以作为该指定媒体源始终被混音包中的参数。如果始终参与混合标识参数取值为 ON而没有携带混合音量参数，则在所有端点的输出媒体流中按照原始音量混合指定的媒体流；如果参与混合标识参数取值为 ON并且携带混合音量参数，则在所有端点的输出媒体流中按照混合音量参数指示的音量混合指定的媒体流。 The above-mentioned always participating in the mixed logo and the mixed volume according to the provisions of the H.248 protocol may be referred to as a designated media source, a specific sound mixed package, as a supplement to the H.248 protocol, and always participate in the mixing. The logo and mix volume can be used as parameters in the mix pack for the specified media source. If the mixed-indicator parameter is always ON and does not carry the mixed-volume parameter, the specified media stream is mixed according to the original volume in the output media stream of all the endpoints; if the participating hybrid identifier parameter is ON and carries the mixed volume parameter, The specified media stream is then mixed in the output media stream of all endpoints according to the volume indicated by the mixed volume parameter.

图 6为本发明实施例提供的会议中混合指定媒体流的第二种方法，应用在音频会议中的较佳实施方式流程图，则始终参与混合标识可以称为始终参与混音标识，而混合音量可以称为混音音量。假设该流程的应用场景为： MC使用 H.248协议中的修改请求（ MOD.request ) 消息向 MP发出指示， MP在完成 MC所指示的操作后向 MC返回修改响应（ MOD.reply )消息；参与混音的端点分别为 TA、 TB、 TC、 TD和 TE, 其中 TD以原始音量始终被混音到除自身外的其他端点的输出媒体流中，而 TE以 25分贝的音量始终被混音输出到除自身外的其他端点的输出媒体流中；使用 AlwysInMix表示始终参与混音标识，使用 VlmLvlMixed标识混音音量。 FIG. 6 is a flowchart of a preferred embodiment of a method for mixing a specified media stream in a conference according to an embodiment of the present invention, and the method for always participating in a hybrid identifier may be referred to as always participating in a mix logo, and mixing The volume can be called the mix volume. Assume that the application scenario of the process is as follows: The MC sends an indication to the MP by using a modify request (MOD.request) message in the H.248 protocol, and the MP returns a modify response (MOD.reply) message to the MC after completing the operation indicated by the MC; The endpoints participating in the mix are TA, TB, TC, TD, and TE, respectively, where the TD is always mixed in the original volume to the output media stream of the endpoints other than itself, and the TE is always mixed at 25 dB. Output to the output media stream of other endpoints other than itself; use AlwysInMix to always participate in the mix logo, use VlmLvlMixed to identify the mix volume.

图 6所示流程包括： The process shown in Figure 6 includes:

步骤 601〜步骤 602 : MC 为 TD 上的媒体流设置始终混音标识 AlwysInMix=ON, 向 MP发送 MOD.request消息，指示 MP为 TD设置该始终参与混音标识，接收 MP发送的 MOD.reply消息，即 MP返回的执行结果。 Step 601 to step 602: The MC sets the always-mixing identifier AlwysInMix=ON for the media stream on the TD, and sends a MOD.request message to the MP, instructing the MP to set the MOD.reply message for the TD to always participate in the mixing identifier, and receive the MP. , that is, the execution of the MP return The result.

步骤 603〜步骤 604: MC 为 TE上的媒体流设置始终参与混音标识 AlwysInMix=ON,以及混音音量 VlmLvlMixed=25 ,向 MP发送 MOD.request 消息，指示 MP为 TE设置该始终混音标识和混音音量，接收 MP发送的 MOD. reply消息 , 即 MP返回的执行结果。 Steps 603 to 604: The MC sets the media stream on the TE to always participate in the mixing indicator AlwysInMix=ON, and the mixing volume VlmLvlMixed=25, and sends a MOD.request message to the MP, instructing the MP to set the always-mixing identifier for the TE and The mixing volume, receiving the MOD. reply message sent by the MP, that is, the execution result returned by the MP.

经过上述步骤 601 ~步骤 604 , 已经完成指定 TD以原始音量始终被混音到除自身外的其他端点的输出媒体流中，而 TE以 25分贝的音量始终被混音到除自身外的其他端点的输出媒体流中。 After the above steps 601 to 604, the specified TD has been completed, and the original volume is always mixed into the output media stream of other endpoints except itself, and the TE is always mixed to other endpoints except itself at a volume of 25 decibels. The output is in the media stream.

步骤 605: MP将所述始终参与混音标识对应的媒体流混音到各端点的输出媒体流中。同样地，关于 MP如何进行混音，为本领域技术人员的公知常识，也并非本发明实施例讨论的重点，这里不再赘述。 Step 605: The MP mixes the media stream corresponding to the always participating in the mixing identifier into the output media stream of each endpoint. Similarly, how to mix the MPs is a common knowledge of those skilled in the art, and is not the focus of the embodiments of the present invention, and details are not described herein again.

经过上述步骤， TA、 TB、 TC的输出媒体流中以原始音量混合来自 TD 的媒体流，并以 25分贝的音量混合来自 TE的媒体流； TD的输出媒体流中以 25分贝的音量混合来自 TE的媒体流； TE的输出媒体流中以原始音量混合来自 TD的媒体流。 After the above steps, the media streams of the TD are mixed in the output media stream of TA, TB, and TC, and the media stream from the TE is mixed at a volume of 25 decibels; the output media stream of the TD is mixed at a volume of 25 decibels. TE's media stream; the TE's output media stream mixes the media stream from the TD at the original volume.

从图 6所示流程可以看出，针对指定端点上的媒体流被混音到其他端点的输出媒体流中的情况，只需为所述指定端点上的媒体流设置始终混音标识，即可实现将该指定端点上的媒体流始终混音输出到其他端点，是一种简化了操作步骤的优化方法。 As can be seen from the flow shown in FIG. 6, for the case where the media stream on the specified endpoint is mixed into the output media stream of the other endpoint, it is only necessary to set the always-mixed identifier for the media stream on the specified endpoint. Implementing the always-mixing of the media stream on the specified endpoint to other endpoints is an optimized way to simplify the steps.

图 7示出了经过上述步骤 601 ~步骤 604之后各端点的属性。 Fig. 7 shows the attributes of the respective endpoints after the above steps 601 to 604.

本领域普通技术人员可以理解实现上述实施例方法中的全部或部分步骤，是可以通过程序指令相关硬件完成的。实施例对应的软件可以存储在一个计算机可存储读取的介质中，如 R0M/RAM、磁碟、光盘等。 One of ordinary skill in the art will appreciate that all or part of the steps in implementing the above-described embodiments can be accomplished by program-related hardware. The software corresponding to the embodiment can be stored in a computer readable storage medium such as ROM/RAM, disk, optical disk, and the like.

其次，详细介绍本发明实施例提供的会议中混合指定媒体源的装置，包括 MC和 MP。 Next, the device for mixing the specified media source in the conference provided by the embodiment of the present invention, including the MC and the MP, is described in detail.

图 8为本发明实施例提供的第一种多媒体控制器 MC的结构示意图，该 MC包括：标识设置模块 81和指示模块 82。 FIG. 8 is a schematic structural diagram of a first multimedia controller MC according to an embodiment of the present invention, where The MC includes: an identification setting module 81 and an indication module 82.

标识设置模块 81 , 用于为参与混合的媒体流设置媒体源标识；从所述参与混合的媒体流对应的媒体源标识中，选择至少一个媒体源标识，作为指定输出所述参与混合的媒体流的端点对应的输出媒体流标识； The identifier setting module 81 is configured to set a media source identifier for the media stream that participates in the mixing; and select at least one media source identifier from the media source identifier corresponding to the media stream that participates in the hybrid, as the specified output the media stream that participates in the mixing The output media stream identifier corresponding to the endpoint;

指示模块 82 ,用于将所述媒体源标识和输出媒体流标识向多媒体处理器 MP发送，指示 MP设置所述媒体源标识和输出媒体流标识。 The indication module 82 is configured to send the media source identifier and the output media stream identifier to the multimedia processor MP, and instruct the MP to set the media source identifier and the output media stream identifier.

本发明实施例提供第一种 MC, 将为参与混合的媒体流设置的媒体源标识，和为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识发送给 MP, 使 MP可以将所述输出媒体流标识对应的媒体流混合到端点对应的输出媒体流中，从而实现按照原始音量混合指定媒体流。 The embodiment of the present invention provides a first type of MC, which is to set a media source identifier for a media stream that participates in the hybrid, and an output media stream identifier that is set to output an endpoint of the media stream that participates in the hybrid media, so that the MP can The media stream corresponding to the output media stream is mixed into the output media stream corresponding to the endpoint, so that the specified media stream is mixed according to the original volume.

上述指示模块还可以包括：消息收发模块 822和标识获取模块 821。标识获取模块 821 , 用于从所述标识设置模块中获取为参与混合的媒体流设置的媒体源标识，和指定输出所述参与混合的媒体流的端点对应的输出媒体流标识。 The above indication module may further include: a messaging module 822 and an identifier acquisition module 821. The identifier obtaining module 821 is configured to obtain, from the identifier setting module, a media source identifier set for participating in the mixed media stream, and specify an output media stream identifier corresponding to the endpoint of the media stream participating in the hybrid.

消息收发模块 822, 用于将所述标识获取模块获取的媒体源标识和输出媒体流标识携带在请求消息中向 MP发送，指示 MP设置所述媒体源标识和输出媒体流标识；接收 MP返回的响应消息。 The message sending and receiving module 822 is configured to carry the media source identifier and the output media stream identifier acquired by the identifier obtaining module in the request message to the MP, and instruct the MP to set the media source identifier and the output media stream identifier; Response message.

在将指示模块 82划分为消息收发模块 822和标识获取模块 821后，本发明实施例提供的第一种 MC, 可以使用请求消息携带所述媒体源标识和输出媒体流标识，还可以接收 MP执行 MC指示的操作之后返回的执行结果。 After the instruction module 82 is divided into the message sending and receiving module 822 and the identifier obtaining module 821, the first type of MC provided by the embodiment of the present invention may use the request message to carry the media source identifier and the output media stream identifier, and may also receive the MP execution. The execution result returned after the operation indicated by the MC.

本发明实施例提供的第一种 MC, 可以按照本发明实施例提供的会议中混合指定媒体流的第一种方法工作。 The first type of MC provided by the embodiment of the present invention may work according to the first method of mixing specified media streams in a conference provided by an embodiment of the present invention.

图 9为本发明实施例提供的第二种多媒体控制器 MC的结构示意图，该 MC包括：标识设置模块 81和指示模块 82。 FIG. 9 is a schematic structural diagram of a second multimedia controller MC according to an embodiment of the present invention. The MC includes: an identifier setting module 81 and an indication module 82.

标识设置模块 81 , 用于为指定端点上的媒体流设置始终参与混合标识。 An identifier setting module 81, configured to always participate in the hybrid label for the media stream on the specified endpoint Knowledge.

指示模块 82 , 用于将所述标识设置模块设置的始终参与混合标识向 The indicating module 82 is configured to always participate in the mixed identification of the identifier setting module

MP发送，指示 MP为指定端点设置所述始终参与混合标识。 The MP sends, indicating that the MP is always participating in the hybrid identity for the specified endpoint setting.

本发明实施例提供的第二种 MC, 为指定端点上的媒体流设置始终参与混合标识，并指示 MP为指定端点设置所述始终参与混合标识，使 MP 接收媒体流后，可以将上述指定端点上的媒体流混合到其他端点的输出媒体流中，而无需按照指定的音量混合媒体流，并且 MC无需为指定端点上的媒体流设置媒体源编号，再针对其他接收该媒体流的端点逐一设置输出媒体流编号，从而简化了这种应用场景下的操作。 The second type of the MC provided by the embodiment of the present invention is configured to always participate in the hybrid identifier for the media stream on the specified endpoint, and instruct the MP to set the always-involved hybrid identifier for the specified endpoint, so that the MP can receive the specified endpoint after receiving the media stream. The media stream on the other stream is mixed into the output media stream of other endpoints without mixing the media stream at the specified volume, and the MC does not need to set the media source number for the media stream on the specified endpoint, and then sets one by one for the other endpoints that receive the media stream. The media stream number is output, which simplifies the operation in this application scenario.

本发明实施例提供的第二种 MC 中还可以进一步包括音量设置模块 83 , 用于为指定端点上的媒体流设置混合音量。 The second type of MC provided by the embodiment of the present invention may further include a volume setting module 83 for setting a mixing volume for the media stream on the specified endpoint.

并且上述指示模块还可以包括：信息获取模块 823 和消息收发模块 And the foregoing indication module may further include: an information acquiring module 823 and a messaging module

822。 822.

信息获取模块 823 , 用于获取所述标识设置模块为指定端点上的媒体流设置的始终参与混合标识，获取所述音量设置模块为指定端点上的媒体流设置的混合音量。 The information obtaining module 823 is configured to obtain an always-involved hybrid identifier set by the identifier setting module for the media stream on the specified endpoint, and obtain a mixed volume set by the volume setting module for the media stream on the specified endpoint.

消息收发模块 822, 用于将所述信息获取模块获取的始终参与混合标识和混合音量携带在请求消息中向 MP发送，指示 MP为指定端点设置所述始终参与混合标识和混合音量；接收 MP返回的响应消息。 The message sending and receiving module 822 is configured to carry the always-involved hybrid identifier and the mixed volume acquired by the information acquiring module in the request message to the MP, and instruct the MP to set the always-involved hybrid identifier and the mixed volume for the specified endpoint; Response message.

在将指示模块划分为消息收发模块和信息获取模块后，本发明实施例提供的第二种 MC可以使用请求消息携带设置的始终参与混合标识和混合音量，指示 MP为指定端点设置所述始终参与混合标识和混合音量，还可以接收 MP执行 MC指示的操作之后返回的执行结果。 After the indication module is divided into the message transceiving module and the information acquisition module, the second MC provided by the embodiment of the present invention can use the request message to carry the always-involved hybrid identifier and the mixed volume, and instruct the MP to always participate in the specified endpoint setting. The mixed identification and the mixed volume may also receive an execution result returned by the MP after performing the operation indicated by the MC.

本发明实施例提供的第二种 MC, 可以按照本发明实施例提供的会议中混合指定媒体流的第二种方法工作。 The second type of the MC provided by the embodiment of the present invention may work in the second method of mixing the specified media stream in the conference provided by the embodiment of the present invention.

图 10为本发明实施例提供的第一种多媒体处理器 MP的结构示意图，该 MP包括：处理模块 91和混合执行模块 92。 FIG. 10 is a schematic structural diagram of a first multimedia processor MP according to an embodiment of the present disclosure. The MP includes: a processing module 91 and a hybrid execution module 92.

处理模块 91 , 用于接收 MC为参与混合的媒体流设置的媒体源标识，为所述参与混合的媒体流设置媒体源标识；接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为所述端点设置输出媒体流标识，所述媒体流标识是从所述参与混合的媒体流的媒体源标识中，选择的至少一个媒体源标识。 The processing module 91 is configured to receive, by the MC, a media source identifier set for the media stream that participates in the hybrid, and set a media source identifier for the media stream that participates in the hybrid; and receive, by the receiving MC, an output that is configured to output the endpoint of the media stream that participates in the hybrid The media stream identifier is configured to set an output media stream identifier, where the media stream identifier is the at least one media source identifier selected from the media source identifiers of the media streams participating in the hybrid.

混合执行模块 92，用于根据指定输出所述参与混合的媒体流的端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 The hybrid execution module 92 is configured to output the corresponding media stream identifier corresponding to the endpoint of the media stream participating in the hybrid according to the specified output, and mix the corresponding media stream into the output media stream of the endpoint.

本发明实施例提供的第一种多媒体处理器，接收 MC为参与混合的媒体流设置的媒体源标识，以及为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为所述端点设置输出媒体流标识，使 MP通过 MC 的指示，无需通过设置各混音媒体流的音量混合指定媒体流，从而实现了按照原始音量混合媒体流。 The first multimedia processor provided by the embodiment of the present invention receives the media source identifier set by the MC for participating in the mixed media stream, and the output media stream identifier set for specifying the output of the endpoint of the media stream participating in the hybrid, The endpoint sets the output media stream identifier so that the MP passes the indication of the MC, and does not need to set the media stream by setting the volume mixing of each mixed media stream, thereby realizing the mixed media stream according to the original volume.

上述处理模块 91还可以包括：消息收发模块 911和设置存储模块 912。消息收发模块 911 , 用于接收 MC发送的请求消息，获取请求消息中携带的参与混合的媒体流对应的媒体源标识；接收 MC将所述媒体源标识作为指定输出所述参与混合的媒体流的端点对应的输出媒体流标识；根据所述设置存储模块的执行结果，向 MC发送响应消息。 The foregoing processing module 91 may further include: a messaging module 911 and a setting storage module 912. The message sending and receiving module 911 is configured to receive the request message sent by the MC, and obtain the media source identifier corresponding to the media stream participating in the hybrid message carried in the request message. The receiving MC uses the media source identifier as the designated output to output the mixed media stream. An output media stream identifier corresponding to the endpoint; sending a response message to the MC according to the execution result of the setting storage module.

设置存储模块 912, 用于根据消息收发模块获取的参与混音的媒体流设置对应的媒体源标识，为参与混合的媒体流设置所述媒体源标识并存储；根据消息收发模块获取的指定输出所述参与混合的媒体流的端点对应的输出媒体流标识，为指定输出所述参与混合的媒体流的端点设置输出媒体流标识并存储。 The setting storage module 912 is configured to set a corresponding media source identifier according to the media stream participating in the mixing acquired by the message transceiving module, set the media source identifier for the media stream participating in the mixing, and store the specified media output identifier according to the message receiving and receiving module. An output media stream identifier corresponding to an endpoint of the media stream participating in the mixing, and an output media stream identifier is set and stored for specifying an endpoint of the media stream participating in the mixing.

在对上述处理模块划分后，本发明实施例提供的第一种 MP, 可以通过请求消息接收 MC设置的所述媒体源标识和输出媒体流标识，并可以向 MC发送响应消息，返回执行结果。本发明实施例提供的第一种 MP, 可以按照本发明实施例提供的会议中混合指定媒体流的第一种方法工作。 After the foregoing processing module is divided, the first MP provided by the embodiment of the present invention may receive the media source identifier and the output media stream identifier set by the MC by using the request message, and may send a response message to the MC, and return an execution result. The first type of MP provided by the embodiment of the present invention may work according to the first method of mixing specified media streams in a conference provided by an embodiment of the present invention.

本发明实施例提供的第二种多媒体处理器 MP的结构，与图 10所示的本发明实施例提供的第一种 MP的结构相同，但 MP中各模块完成的功能不相同。本发明实施例提供的第二种 MP包括：处理模块 91和混合执行模块 92。 The structure of the second type of multimedia processor MP provided by the embodiment of the present invention is the same as that of the first type of MP provided by the embodiment of the present invention shown in FIG. 10, but the functions performed by the modules in the MP are different. The second MP provided by the embodiment of the present invention includes: a processing module 91 and a hybrid execution module 92.

处理模块 91 ,用于接收 MC为指定端点上的媒体流设置的始终参与混很标识，为指定端点上的媒体流设置所述始终参与混合标识。 The processing module 91 is configured to receive, by the MC, an always-involved identifier set for the media stream on the specified endpoint, and set the always-involved hybrid identifier for the media stream on the specified endpoint.

混合执行模块 92 ,用于将所述始终参与混合标识对应的指定端点上的媒体流混合到各端点的输出媒体流中。 The hybrid execution module 92 is configured to mix the media streams on the specified endpoints that are always involved in the hybrid identifier into the output media stream of each endpoint.

本发明实施例提供的第二种 MP, 接收 MC为指定端点上的媒体流设置的始终参与混合标识，为端点上的媒体流设置所述始终参与混合标识，无需通过设置各混音媒体流的指定音量混合指定媒体流，从而实现了按照原始音量混合指定媒体流；并且，本发明实施例提供的第二种 MP, 无需先对指定端点设置媒体源标识，再对输出指定媒体流的端点设置输出媒体流标识，简化了指定端点上的媒体流被指定混合到所有端点的操作。 The second MP provided by the embodiment of the present invention receives the always-involved hybrid identifier set by the MC for the media stream on the specified endpoint, and sets the always-involved hybrid identifier for the media stream on the endpoint, without setting the respective mixed media streams. The specified volume is mixed to specify the media stream, so that the specified media stream is mixed according to the original volume; and the second MP provided by the embodiment of the present invention does not need to first set the media source identifier for the specified endpoint, and then sets the endpoint setting of the specified media stream. Output media stream identification, which simplifies the operation of specifying the media stream on the specified endpoint to be mixed to all endpoints.

上述处理模块 91还可以包括：消息收发模块 911和设置存储模块 912。消息收发模块 911 , 用于接收 MC发送的请求消息，获取请求消息中携带的为指定端点上的媒体流设置的始终参与混合标识和混合音量；根据设置存储模块的执行结果，向 MC发送响应消息。 The foregoing processing module 91 may further include: a messaging module 911 and a setting storage module 912. The message sending and receiving module 911 is configured to receive the request message sent by the MC, and obtain the always-involved mixed identifier and the mixed volume set for the media stream on the specified endpoint that is carried in the request message; send a response message to the MC according to the execution result of the setting storage module. .

设置存储模块 912, 用于根据所述消息收发模块获取的始终参与混合标识和混合音量，为指定端点上的媒体流设置所述始终参与混合标识和混合音量并存储。 The storage module 912 is configured to set the always-involved mixed identifier and the mixed volume for the media stream on the specified endpoint according to the always participating mixed identifier and the mixed volume obtained by the messaging module.

在对上述处理模块划分后，本发明实施例提供的第二种 MP, 可以通过请求消息接收 MC设置的始终参与混合标识和混合音量，并可以向 MC 发送响应消息，返回执行结果。本发明实施例提供的第二种 MP, 可以按照本发明实施例提供的会议中输出指定混音媒体流的第二种方法工作。 After the foregoing processing module is divided, the second MP provided by the embodiment of the present invention can receive the mixed identifier and the mixed volume that are set by the MC through the request message, and can send a response message to the MC to return the execution result. The second MP provided by the embodiment of the present invention may work in the second method of outputting the specified mixed media stream in the conference provided by the embodiment of the present invention.

上述本发明实施例提供的第一种 MC和第一种 MP, 可以组成本发明实施例提供的第一种会议中混合指定媒体流的***；而本发明实施例提供的第二种 MC和第二种 MP, 可以组成本发明实施例提供的第二种会议中混合指定媒体流的***。 The first type of MC and the first type of MP provided by the embodiment of the present invention may constitute a system for mixing a specified media stream in the first type of conference provided by the embodiment of the present invention; The two types of MPs can be combined into a system for mixing specified media streams in the second conference provided by the embodiment of the present invention.

本发明实施例提供的会议中混合指定媒体流的方法、装置及***，可以为参与混合的端点上的媒体流设置的媒体源标识，还可以为指定输出所述参与混合的媒体流的端点设置输出媒体流标识，所述输出媒体流标识为在参与混合的媒体流对应的媒体源标识中，选择的至少一个媒体源标识， MP可以根据 MC的指示设置所述媒体源标识和输出媒体流标识，而无需通过指定音量确定混合的指定媒体流，从而可以按照原始音量混合媒体流；针对指定端点被指定混合到所有端点的情况，还可以为指定端点设置始终参与混合标识， MP 混合媒体流时将始终参与混合标识对应的指定端点上的媒体流混合到各端点的输出媒体流中，即只需针对指定端点设置一个标识，就可实现混合指定媒体流，简化了这种情况下的操作。 The method, device, and system for mixing a specified media stream in a conference provided by the embodiment of the present invention may be a media source identifier set for a media stream participating in a mixed endpoint, and may also be configured to output an endpoint setting of the media stream participating in the hybrid And outputting the media stream identifier, where the output media stream identifier is at least one selected media source identifier in the media source identifier corresponding to the mixed media stream, and the MP may set the media source identifier and the output media stream identifier according to the indication of the MC. Instead of specifying the mixed specified media stream by specifying the volume, you can mix the media streams at the original volume; for a given endpoint to be specified to blend to all endpoints, you can also set the endpoint to always participate in the hybrid ID, MP mixed media stream The media stream on the specified endpoint corresponding to the hybrid identifier is always mixed into the output media stream of each endpoint, that is, only one identifier is set for the specified endpoint, and the specified media stream can be mixed, which simplifies the operation in this case.

综上所述，以上仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。 In conclusion, the above is only a preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and scope of the present invention are intended to be included within the scope of the present invention.

Claims

权利要求书 Claim

1、一种会议中混合指定媒体流的方法，其特征在于，该方法包括：多媒体处理器 MP根据从多媒体控制器 MC接收的为参与混合的媒体流设置的媒体源标识，为参与混合的媒体流设置媒体源标识； A method for mixing a specified media stream in a conference, the method comprising: the multimedia processor MP, according to a media source identifier set by the multimedia controller MC for participating in the mixed media stream, for participating in the mixed media Set the media source identifier for the stream;

MP根据从 MC接收的为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为指定输出所述参与混合的媒体流的端点设置输出媒体流标识，所述输出媒体流标识是 MC从所述参与混合的媒体流的媒体源标识中，选择的至少一个媒体源标识； The MP sets an output media stream identifier according to an output media stream identifier that is received from the MC and is configured to output the endpoint of the media stream that participates in the hybrid, and the output media stream identifier is configured to specify an output end of the media stream that participates in the hybrid media stream. The at least one media source identifier selected by the MC from the media source identifier of the media stream participating in the hybrid;

MP根据所述参与混合的媒体流的端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 The MP mixes the corresponding media stream into the output media stream of the endpoint according to the output media stream identifier corresponding to the endpoint of the media stream participating in the hybrid.

2、如权利要求 1所述的会议中混合指定媒体流的方法，其特征在于，所述 MC为参与混合的媒体流设置的媒体源标识，携带在 MC向 MP发送的请求消息中。 2. The method of mixing a specified media stream in a conference according to claim 1, wherein the MC is a media source identifier set in a media stream that participates in the hybrid, and is carried in a request message sent by the MC to the MP.

3、如权利要求 1所述的会议中混合指定媒体流的方法，其特征在于，所述 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，携带在 MC向 MP发送的请求消息中。 The method of mixing a specified media stream in a conference according to claim 1, wherein the MC is an output media stream identifier that is specified to output an endpoint of the media stream participating in the hybrid, and is carried in the MC to the MP. In the request message.

4、一种会议中混合指定媒体流的方法，其特征在于，该方法包括： A method for mixing specified media streams in a conference, the method comprising:

MP根据从 MC接收的为指定端点上的媒体流设置的始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识； The MP sets the always-involved hybrid identifier for the media stream on the specified endpoint according to the always-involved hybrid identifier set from the MC for the media stream on the specified endpoint;

MP将所述始终参与混合标识对应的指定端点上的媒体流，混合到会议中各端点的输出媒体流中。 The MP mixes the media streams on the specified endpoints that are always involved in the hybrid identifier into the output media stream of each endpoint in the conference.

5、如权利要求 4所述的会议中混合指定媒体流的方法，其特征在于，所述 MP接收所述始终参与混合标识后，进一步包括： MP接收 MC为所述指定端点上的媒体流设置的混合音量； The method for mixing a specified media stream in the conference according to claim 4, wherein, after the MP receives the always participating in the hybrid identifier, the method further includes: the MP receiving MC setting the media stream on the specified endpoint Mixing volume

所述 MP为所述指定端点上的媒体流设置始终参与混合标识之后 ,进一步包括： MP为所述指定端点上的媒体流设置所述混合音量。 After the MP sets the media stream on the specified endpoint to always participate in the hybrid identifier, further Include: The MP sets the blended volume for the media stream on the specified endpoint.

6、如权利要求 4所述的会议中混合指定媒体流的方法，其特征在于，所述为指定端点上的媒体流设置的所述始终参与混合标识，携带在 MC发送给 MP 的请求消息中。 The method for mixing a specified media stream in a conference according to claim 4, wherein the always-involved hybrid identifier set for the media stream on the specified endpoint is carried in the request message sent by the MC to the MP. .

7、一种多媒体控制器 MC, 其特征在于，该 MC包括： 7. A multimedia controller MC, wherein the MC comprises:

标识设置模块（81 ), 用于为参与混合的媒体流设置媒体源标识；从所述参与混合的媒体流对应的媒体源标识中，选择至少一个媒体源标识，作为指定输出所述参与混合的媒体流的端点对应的输出媒体流标识； An identifier setting module (81), configured to set a media source identifier for the media stream participating in the mixing; and selecting at least one media source identifier from the media source identifier corresponding to the media stream participating in the hybrid, as the specified outputting the participating hybrid An output media stream identifier corresponding to an endpoint of the media stream;

指示模块（82 ), 用于将所述媒体源标识和输出媒体流标识向 MP发送，指示 MP设置所述媒体源标识和输出媒体流标识。 The indication module (82) is configured to send the media source identifier and the output media stream identifier to the MP, and the MP indicates the media source identifier and the output media stream identifier.

8、如权利要求 7所述的 MC, 其特征在于，所述指示模块（82 ) 包括：消息收发模块 ( 822 )和标识获取模块 ( 821 ); The MC of claim 7, wherein the indication module (82) comprises: a message transceiving module (822) and an identity acquisition module (821);

所述标识获取模块（821 ),用于从所述标识设置模块中获取为参与混合的媒体流设置的媒体源标识，和指定输出所述参与混合的媒体流的端点对应的输出媒体流标识； The identifier obtaining module (821) is configured to obtain, from the identifier setting module, a media source identifier set for participating in the mixed media stream, and specify an output media stream identifier corresponding to the endpoint of the media stream participating in the hybrid output;

所述消息收发模块（ 822 ),用于将所述标识获取模块获取的媒体源标识和输出媒体流标识携带在 MC向 MP发送的请求消息中，指示 MP设置所述媒体源标识和输出媒体流标识。 The message sending and receiving module (822) is configured to carry the media source identifier and the output media stream identifier obtained by the identifier obtaining module in a request message sent by the MC to the MP, and instruct the MP to set the media source identifier and the output media stream. Logo.

9、一种多媒体控制器 MC, 其特征在于，该 MC包括： 9. A multimedia controller MC, wherein the MC comprises:

标识设置模块（81 ), 用于为指定端点上的媒体流设置始终参与混合标识；指示模块（ 82 ), 用于向 MP发送所述标识设置模块设置的始终参与混合标识，指示 MP为指定端点设置所述始终参与混合标识。 An identifier setting module (81), configured to always participate in the hybrid identifier for the media stream on the specified endpoint; the indication module (82), configured to send, to the MP, the always-involved hybrid identifier set by the identifier setting module, indicating that the MP is the designated endpoint Set the said to always participate in the hybrid logo.

10、如权利要求 9所述的 MC, 其特征在于，该 MC中进一步包括音量设置模块（83 ), 用于为指定端点上的媒体流设置混合音量； The MC of claim 9, further comprising a volume setting module (83) for setting a mixed volume for the media stream on the specified endpoint;

所述指示模块（82 ) 包括：信息获取模块（ 823 )和消息收发模块（822 ); 所述信息获取模块（ 823 ) , 用于获取所述标识设置模块（ 81 )为指定端点上的媒体流设置的始终参与混合标识，获取所述音量设置模块（83 ) 为指定端点上的媒体流设置的混合音量； The indication module (82) includes: an information acquisition module (823) and a message transceiving module (822); the information acquisition module (823) is configured to acquire the identifier setting module (81) as a specified endpoint The media stream is set to always participate in the hybrid identification, and the volume setting module (83) obtains the mixed volume set for the media stream on the specified endpoint;

所述消息收发模块（822 ), 用于将所述信息获取模块（ 823 )获取的始终参与混合标识和混合音量携带在 MC向 MP发送的请求消息，指示 MP为指定端点设置所述始终参与混合标识和混合音量。 The message sending and receiving module (822) is configured to carry the request message that is sent by the information acquiring module (823) to the mixed identifier and the mixed volume that is sent by the MC to the MP, and instruct the MP to set the always-involved hybrid for the specified endpoint. Identify and mix the volume.

11、一种多媒体处理器 MP, 其特征在于，该 MP包括： 11. A multimedia processor MP, wherein the MP comprises:

处理模块（91 ), 用于接收 MC为参与混合的媒体流设置的媒体源标识，为所述参与混合的媒体流设置所述媒体源标识；接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识，为所述端点设置所述输出媒体流标识，所述媒体流标识是 MC从所述参与混合的媒体流的媒体源标识中，选择的至少一个媒体源标识； a processing module (91), configured to receive, by the MC, a media source identifier set for the media stream that participates in the hybrid, and set the media source identifier for the media stream that participates in the hybrid; and receive the MC to specify the output of the media stream that participates in the hybrid An output media stream identifier set by the endpoint, where the output media stream identifier is set for the endpoint, where the media stream identifier is at least one media source identifier selected by the MC from the media source identifier of the media stream participating in the hybrid;

混合执行模块（92 ), 用于根据指定输出所述参与混合的媒体流的端点对应的输出媒体流标识，将对应的媒体流混合到该端点的输出媒体流中。 The hybrid execution module (92) is configured to output the corresponding media stream to the output media stream of the endpoint according to the specified output media stream identifier corresponding to the endpoint of the media stream participating in the hybrid output.

12、如权利要求 11所述的 MP, 其特征在于，所述处理模块（91 ) 包括：消息收发模块（911 )和设置存储模块（912 ); The MP according to claim 11, wherein the processing module (91) comprises: a messaging module (911) and a setting storage module (912);

所述消息收发模块（911 ), 用于接收 MC发送的请求消息，获取所述请求消息中携带的参与混合的媒体流对应的媒体源标识；接收 MC为指定输出所述参与混合的媒体流的端点设置的输出媒体流标识； The message sending and receiving module (911) is configured to receive a request message sent by the MC, and obtain a media source identifier corresponding to the media stream participating in the hybrid message carried in the request message, where the receiving MC is configured to output the media stream that participates in the mixing. The output media stream identifier set by the endpoint;

所述设置存储模块（ 912 ),用于根据消息收发模块获取的参与混合的媒体流对应的媒体源标识，为参与混合的媒体流设置所述媒体源标识并存储；根据消息收发模块获取的指定输出所述参与混合的媒体流的端点对应的输出媒体流标识，为指定输出所述参与混合的媒体流的端点设置输出媒体流标识并存储。 The setting storage module (912) is configured to set the media source identifier and store the media source identifier corresponding to the mixed media stream according to the media source identifier corresponding to the mixed media stream acquired by the message sending and receiving module; Outputting an output media stream identifier corresponding to an endpoint of the media stream participating in the hybrid, and setting an output media stream identifier for storing an endpoint of the media stream participating in the hybrid output and storing.

13、一种多媒体处理器 MP, 其特征在于，该 MP包括： 13. A multimedia processor MP, wherein the MP comprises:

处理模块（91 ), 用于接收 MC为指定端点上的媒体流设置的始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识； a processing module (91), configured to receive an always-on hybrid identifier set by the MC for the media stream on the specified endpoint, and set the always-involved hybrid identifier for the media stream on the specified endpoint;

混合执行模块（ 92 ), 用于将所述始终参与混合标识对应的指定端点上的媒体流混合到会议中各端点的输出媒体流中。 a hybrid execution module (92), configured to use the medium on the specified endpoint corresponding to the hybrid identifier The body stream is mixed into the output media stream of each endpoint in the conference.

14、如权利要求 13所述的 MP, 其特征在于，所述处理模块（91 ) 包括：消息收发模块（911 )和设置存储模块（912 ); The MP according to claim 13, wherein the processing module (91) comprises: a messaging module (911) and a setting storage module (912);

所述消息收发模块（911 ), 用于接收 MC发送的请求消息，获取所述请求消息中携带的为指定端点上的媒体流设置的始终参与混合标识和混合音量；所述设置存储模块（ 912 ),用于根据所述消息收发模块获取的始终参与混合标识和混合音量，为指定端点设置所述始终参与混合标识和混合音量并存储。 The message sending and receiving module (911) is configured to receive a request message sent by the MC, and obtain an always-involved hybrid identifier and a mixed volume that are set in the request message for the media stream on the specified endpoint; the setting storage module (912) And is configured to always participate in the hybrid identification and the mixed volume according to the always-acquired mixed identifier and the mixed volume obtained by the messaging module, and set the always-involved mixed identifier and the mixed volume for the specified endpoint and store.

15、一种会议中混合指定媒体流的***，其特征在于，该***包括： MP和 15. A system for mixing specified media streams in a conference, the system comprising: MP and

MC; MC;

所述 MC, 用于为参与混合的媒体流设置媒体源标识；从所述参与混合的媒体流对应的媒体源标识中，选择至少一个媒体源标识，作为指定输出所述参与混合的媒体流的端点对应的输出媒体流标识；向 MP发送所述媒体源标识和输出媒体流标识，指示 MP设置所述媒体源标识和输出媒体流标识； The MC is configured to set a media source identifier for the media stream that participates in the mixing; and select at least one media source identifier from the media source identifier corresponding to the media stream that participates in the hybrid, as the specified output of the media stream that participates in the mixing An output media stream identifier corresponding to the endpoint; sending the media source identifier and the output media stream identifier to the MP, instructing the MP to set the media source identifier and the output media stream identifier;

16、一种会议中混合指定媒体流的***，其特征在于，该***包括： MC和 16. A system for mixing specified media streams in a conference, the system comprising: MC and

MP; MP;

所述 MC, 用于为指定端点上的媒体流设置始终参与混合标识；向 MP发送所述始终参与混合标识，指示 MP为指定端点设置所述始终参与混合标识；所述 MP, 用于接收 MC为指定端点上的媒体流设置的始终参与混合标识，为指定端点上的媒体流设置所述始终参与混合标识；将所述始终参与混合标识对应的指定端点上的媒体流混合到会议中各端点的输出媒体流中。 The MC is configured to always participate in the hybrid identifier for the media stream on the specified endpoint; send the always-involved hybrid identifier to the MP, and instruct the MP to set the always-involved hybrid identifier for the specified endpoint; the MP, for receiving the MC The always-involved hybrid identifier is set for the media stream on the specified endpoint, and the always-involved hybrid identifier is set for the media stream on the specified endpoint; the media stream on the specified endpoint corresponding to the always-involved hybrid identifier is mixed into each endpoint in the conference The output is in the media stream.