WO2010020193A1

WO2010020193A1 - Multimedia system for providing real-time scene and implementing method thereof

Info

Publication number: WO2010020193A1
Application number: PCT/CN2009/073407
Authority: WO
Inventors: 刘海军; 黄波; 王坚
Original assignee: 中兴通讯股份有限公司
Priority date: 2008-08-22
Filing date: 2009-08-21
Publication date: 2010-02-25
Also published as: CN101360114A

Abstract

A multimedia method and system for providing real-time scene is disclosed in the invention. A mobile terminal calls a multimedia information server and establishes session contact with the multimedia information server. The mobile terminal collects multimedia information in the scene and sends the multimedia information to the multimedia information server in real time. The multimedia information server receives the multimedia information and distributes the multimedia information according to predetermined configuration policy. A communication terminal receives the multimedia information from the multimedia information server in real time and plays it. Using the invention, the technology of implementing transmitting real-time scene multimedia information by a mobile terminal is realized. Other users can have the effect of watching the content of the multimedia information in real time by the means of customizing real-time multimedia information service in advance or watching the multimedia information, through the multimedia information server distributing multimedia information to communication terminals of the users.

Description

一种提供实时场景的多媒体***及其实现方法 Multimedia system for providing real-time scene and implementation method thereof

技术领域 Technical field

本发明涉及提供实时场景的多媒体技术，尤其是指一种提供实时场景的多媒体***及其实现方法。 The present invention relates to a multimedia technology for providing a real-time scene, and more particularly to a multimedia system for providing a real-time scene and an implementation method thereof.

背景技术 Background technique

随着无线通信领域的第三代码分多址（CDMA2000 ) 、宽带码分多址 ( WCDMA ) 、时分同步码分多址（TD-SCDMA ) 、第三代移动通信长期演进（3G LTE ) 、无线保真（Wi-Fi, Wireless Fidelity ) 、微波存取全球互通 ( WiMAX )等网络的技术商用化进程的加快，在移动宽带化和宽带移动化技术的研究过程中涌现出了大量的研究成果，其中很多提高网络传输性能和提高通信终端处理能力的研究成果已经转化到实用中，从而使得通过移动通信网传送音频、视频等多媒体信息成为现实，而作为无线通信接入网侧的用户节点即移动终端则 7 担着多媒体信息的信息源或信息宿的角色。当前已有很多不同制式的实现发送或接收多媒体信息的移动终端，均能将用户通过移动终端所拍摄或录制的图片、音频、视频等多媒体信息传送给其他移动终端用户共享，或将所述多媒体信息上传到互联网上供其他用户浏览、下载。但这种使用移动终端进行多媒体信息发送的过程并不能通过实时传输的方式来完成。此外，现有能够传输实时场景的多媒体***中，釆集和制作音频、视频等内容的工作需要通过专用的设备和网络才能完成，这种实现现场实时多媒体信息传输的方式的成本太高，且该专用设备还需专业技术人员进行操作和维护，因此，不具备向个人用户普及的条件。 With the third code division multiple access (CDMA2000), wideband code division multiple access (WCDMA), time division synchronous code division multiple access (TD-SCDMA), third generation mobile communication long term evolution (3G LTE), wireless The commercialization of technologies such as Wi-Fi (Wireless Fidelity) and Microwave Access Worldwide Interoperability (WiMAX) has accelerated. In the research process of mobile broadband and broadband mobility technologies, a large number of research results have emerged. Many of the research results of improving network transmission performance and improving the processing capability of communication terminals have been transformed into practical applications, so that the transmission of multimedia information such as audio and video through the mobile communication network becomes a reality, and the user node as the wireless communication access network side moves. The terminal 7 is responsible for the information source or information sink of the multimedia information. At present, there are many different types of mobile terminals that implement transmitting or receiving multimedia information, and can transmit multimedia information such as pictures, audio, video, etc. captured or recorded by the user through the mobile terminal to other mobile terminal users for sharing, or the multimedia. Information is uploaded to the Internet for other users to browse and download. However, the process of transmitting multimedia information using a mobile terminal cannot be completed by means of real-time transmission. In addition, in the existing multimedia systems capable of transmitting real-time scenes, the work of collecting and producing audio, video, and the like needs to be completed through dedicated equipment and networks, and the cost of realizing the real-time multimedia information transmission on site is too high, and This special equipment also requires professional technicians to operate and maintain, and therefore does not have the conditions for popularization to individual users.

目前，随着 IP多媒体子***（ IMS, IP Multi-media Subsystem ) 网络建设和 3G LTE技术等的不断发展，无线核心网和无线接入网均已具备实时高速传送多媒体信息的处理能力。而在现实生活中，许多高端用户和年轻用户等移动业务消费群体也有这种连线通信网络进行实时报道和发送现场多媒体信息的业务需要。这里，所述 IMS,是基于会话发起协议（SIP, Session Initiation Protocol ) 的通用平台，可以同时支持固定终端和移动终端的多种接入方式，实现固定网与移动网的融合。 At present, with the continuous development of IP Multimedia Subsystem (IMS, IP Multi-media Subsystem) network construction and 3G LTE technology, both the wireless core network and the wireless access network have the processing capability of transmitting multimedia information in real time at high speed. In real life, many mobile consumer groups such as high-end users and young users also have the need for such a wired communication network to report and send live multimedia information in real time. Here, the IMS is a universal platform based on Session Initiation Protocol (SIP), and can support multiple access modes of fixed terminals and mobile terminals at the same time. Realize the integration of fixed network and mobile network.

因此，提供一种能够传送实时场景的多媒体***是非常有必要的。 Therefore, it is very necessary to provide a multimedia system capable of transmitting real-time scenes.

发明内容 Summary of the invention

有鉴于此，本发明的主要目的在于提供一种提供实时场景的多媒体*** 及其实现方法，使移动终端能够实时釆集并发送现场的多媒体信息，同时，使无线网络用户以及互联网用户能够实时收看所述移动终端录制的多媒体信息内容。 In view of this, the main object of the present invention is to provide a multimedia system for providing real-time scenes and an implementation method thereof, so that a mobile terminal can collect and transmit multimedia information in the field in real time, and at the same time enable wireless network users and Internet users to watch in real time. The multimedia information content recorded by the mobile terminal.

为达到上述目的，本发明的技术方案是这样实现的： In order to achieve the above object, the technical solution of the present invention is achieved as follows:

一种提供实时场景的多媒体***，该***处在无线通信网络环境下，该 ***包括：移动终端、多媒体信息服务器以及通信终端；其中， A multimedia system for providing a real-time scenario, the system is in a wireless communication network environment, the system includes: a mobile terminal, a multimedia information server, and a communication terminal;

移动终端，设置成釆集实时的多媒体信息，并将所述多媒体信息通过无线通信网络发送给多媒体信息服务器； The mobile terminal is configured to collect real-time multimedia information, and send the multimedia information to the multimedia information server through the wireless communication network;

多媒体信息服务器，设置成通过无线通信网络接收所述移动终端釆集的实时的多媒体信息，并将所述多媒体信息分发给通信终端； a multimedia information server, configured to receive real-time multimedia information collected by the mobile terminal through a wireless communication network, and distribute the multimedia information to the communication terminal;

通信终端，设置成从所述多媒体信息服务器接收并播放所述实时的多媒体信息。 The communication terminal is arranged to receive and play the real-time multimedia information from the multimedia information server.

其中，所述移动终端，内部包含 IP多媒体子*** IMS客户端软件模块，设置成通过无线通信网络承载 IP, 实现 IMS会话的业务流程，包括支持会话发起协议 SIP、实时传输协议 RTP以及编码解码功能。 The mobile terminal includes an IP multimedia subsystem IMS client software module, and is configured to carry an IP through a wireless communication network to implement a service flow of the IMS session, including a session initiation protocol SIP, a real-time transmission protocol RTP, and a codec function. .

所述多媒体信息服务器将所述多媒体信息转发到电视广播服务中心，利用多媒体广播 /组播技术发送到定制了实时的多媒体信息服务的通信终端；或者多媒体信息服务器经 IMS核心网直接通过呼叫发送到定制了服务的通信终端；或者多媒体信息服务器将所接收到的现场多媒体信息分发到互联网，互联网用户收看所述多媒体信息。 The multimedia information server forwards the multimedia information to a television broadcast service center, and uses a multimedia broadcast/multicast technology to transmit to a communication terminal customized with a real-time multimedia information service; or the multimedia information server is directly sent by a call to the IMS core network The communication terminal of the service is customized; or the multimedia information server distributes the received live multimedia information to the Internet, and the Internet user views the multimedia information.

所述通信终端定制实时的多媒体信息服务后，通过网络广播 /组播方式或者通过流媒体的方式接收并播放所述多媒体信息；互联网用户能够通过个人计算机、笔记本计算机、个人数字助理（PDA, Personal Digital Assistant )等智能通信终端收看所述正在播放的现场的多媒体信息。 After the communication terminal customizes the real-time multimedia information service, the multimedia information is received and played through a network broadcast/multicast mode or through streaming media; the Internet user can pass through a personal computer, a notebook computer, a personal digital assistant (PDA, Personal) Digital Assistant) The intelligent communication terminal views the multimedia information of the scene being played.

所述多媒体***进一步包括： The multimedia system further includes:

内容编审工作站，设置成通过多媒体信息服务器进行分发前对实时的多媒体信息进行编辑和审查，并为所述实时的多媒体信息附加字幕、添加滚动新闻消息的功能。 The content editing workstation is configured to edit and review real-time multimedia information before distributing through the multimedia information server, and add subtitles and add rolling news messages to the real-time multimedia information.

本发明还公开了一种多媒体信息服务器，其支持实现提供实时场景的多媒体***，所述多媒体信息服务器设置成： The present invention also discloses a multimedia information server that supports implementing a multimedia system that provides a real-time scenario, the multimedia information server being configured to:

通过无线通信网络接收由移动终端釆集的实时的多媒体信息，并将所述多媒体信息分发给通信终端，以使所述通信终端接收并播放所述多媒体信息。 Receiving real-time multimedia information collected by the mobile terminal through a wireless communication network, and distributing the multimedia information to the communication terminal, so that the communication terminal receives and plays the multimedia information.

较佳地，所述多媒体信息服务器进一步设置成在进行分发前通过内容编审工作站对所述多媒体信息进行编辑和审查，并为所述多媒体信息附加字幕、添力。滚动新闻消息。一种提供实时场景的多媒体***实现方法，该方法包括： Preferably, the multimedia information server is further configured to edit and review the multimedia information through a content editing workstation before distributing, and add subtitles and add power to the multimedia information. Scroll news messages. A multimedia system implementation method for providing real-time scenarios, the method comprising:

A、移动终端拨叫多媒体信息服务器，建立与所述多媒体信息服务器间的会话联系； A. The mobile terminal dials a multimedia information server to establish a session connection with the multimedia information server;

B、所述移动终端釆集现场的多媒体信息，实时地发送到所述多媒体信息服务器； B. The mobile terminal collects multimedia information of the scene and sends the multimedia information to the multimedia information server in real time;

C、所述多媒体信息服务器接收到所述多媒体信息，根据预先的配置策略分发所述多媒体信息； C. The multimedia information server receives the multimedia information, and distributes the multimedia information according to a preset configuration policy;

D、通信终端从所述多媒体信息服务器实时接收并播放所述多媒体信息。其中，步骤 A所述移动终端建立与所述多媒体信息服务器的会话联系 , 具体为：所述移动终端拨打多媒体信息服务器的接入号，并发送 SIP 消息 INVITE,以 SIP信令协议发起 SIP会话，所述移动终端根据 SIP协议通过 IMS 核心网与所述多媒体信息服务器以 SIP消息交互的方式建立会话，并确认所要传输的参数。 D. The communication terminal receives and plays the multimedia information in real time from the multimedia information server. The mobile terminal establishes a session connection with the multimedia information server, where the mobile terminal dials an access number of the multimedia information server, sends a SIP message INVITE, and initiates a SIP session by using a SIP signaling protocol. The mobile terminal establishes a session by means of a SIP message through the IMS core network and the multimedia information server interacts with the SIP message, and confirms parameters to be transmitted.

步骤 B所述移动终端釆集现场的多媒体信息实时地发送到所述多媒体信息服务器，具体为：所述移动终端使用实时传输协议 /实时传输控制协议 RTP/RTCP,将所述多媒体信息的音频部分转换为音频媒体报文进行传送；将所述多媒体信息的视频部分转换为视频媒体报文进行传送。 Step B: The mobile terminal collects the multimedia information of the live site to the multimedia information server in real time, specifically: the mobile terminal uses the real-time transmission protocol/real-time transmission control protocol RTP/RTCP to convert the audio portion of the multimedia information. Convert to audio media message for transmission; The video portion of the multimedia information is converted into a video media message for transmission.

按照 G.711、 G723或按照自适应多速率 ARM的编码方式将所述多媒体信息的音频部分转换为音频媒体报文进行传送；按照 H.263协议、运动图像专家组 MPEG4标准的编码方式将所述多媒体信息的视频部分转换为视频媒体报文进行传送。 Converting the audio portion of the multimedia information into an audio media message according to G.711, G723 or an adaptive multi-rate ARM encoding method for transmission; according to the H.263 protocol, the Moving Picture Experts Group MPEG4 standard encoding method The video portion of the multimedia information is converted into a video media message for transmission.

其中，步骤 C所述多媒体信息服务器按照预先的配置策略分发所述多媒体信息，具体为：将所述多媒体信息转发到电视广播服务中心，利用多媒体广播 /组播技术发送到定制了实时的多媒体信息服务的通信终端；或者由多媒体信息服务器经 IMS核心网直接通过呼叫发送到定制了服务的通信终端；或者将所接收到的现场多媒体信息分发到互联网，互联网用户收看所述多媒体信息。 The multimedia information server of the step C distributes the multimedia information according to a pre-configuration policy, specifically: forwarding the multimedia information to a television broadcast service center, and transmitting the customized real-time multimedia information by using a multimedia broadcast/multicast technology. The communication terminal of the service; or the multimedia information server directly sends the call to the communication terminal customized by the service through the IMS core network; or distributes the received live multimedia information to the Internet, and the Internet user views the multimedia information.

通信终端从所述多媒体信息服务器实时接收并播放所述多媒体信息，具体为：定制实时的多媒体信息服务的通信终端，通过网络广播 /组播方式或者通过流媒体的方式接收并播放所述多媒体信息；互联网用户能够通过个人计算机、笔记本计算机、 PDA等智能通信终端收看所述正在播放的现场的多媒体信息。 The communication terminal receives and plays the multimedia information in real time from the multimedia information server, specifically: a communication terminal that customizes a real-time multimedia information service, and receives and plays the multimedia information through a network broadcast/multicast mode or through streaming media. The Internet user can view the multimedia information of the scene being played through an intelligent communication terminal such as a personal computer, a notebook computer, or a PDA.

本发明所提供的提供实时场景的多媒体***及其实现方法，具有以下优点： The multimedia system for providing real-time scenes and the implementation method thereof provided by the invention have the following advantages:

本发明通过对移动终端内置 IMS客户端软件模块以及在网络中增设多媒体信息服务器的方式，实现了一种通过移动终端完成实时的现场多媒体信息传输的技术，使其他用户能够通过预先定制实时的多媒体信息服务或收看多媒体信息的方式，由所述多媒体信息服务器向所述用户的通信终端分发多媒体信息、达到实时观看所述多媒体信息的内容的效果。本发明无须对核心网、无线接入网络进行改造，只需使用一部能够摄录音频、视频的移动终端即可将所需发布的现场多媒体信息播报到各个定制此服务的用户眼前。使用本发明，不仅丰富了无线通信的增值业务，吸引用户使用，而且扩充了各种多媒体信息的发布渠道，由于操作简单，人人皆可体验这种像记者一样连线报道的信息发布方式，方便地让他人及时了解各种现场事件。附图概述 The invention realizes a real-time live multimedia information transmission technology through a mobile terminal by means of a built-in IMS client software module of the mobile terminal and a multimedia information server in the network, so that other users can pre-customize real-time multimedia through pre-customization. The information service or the manner of viewing the multimedia information, the multimedia information server distributing the multimedia information to the communication terminal of the user, and achieving the effect of viewing the content of the multimedia information in real time. The invention does not need to modify the core network and the wireless access network, and only needs to use a mobile terminal capable of recording audio and video to broadcast the required on-site multimedia information to the users who customize the service. By using the invention, not only enriching the value-added service of wireless communication, attracting users, but also expanding the distribution channels of various multimedia information, since the operation is simple, everyone can experience such a way of publishing information like a reporter. Conveniently let others know about various live events in a timely manner. BRIEF abstract

图 1为本发明的多媒体***的网络结构示意图； 1 is a schematic diagram of a network structure of a multimedia system according to the present invention;

图 2为本发明的移动终端釆集和发送实时的多媒体信息的逻辑处理过程示意图。本发明的较佳实施方式 2 is a schematic diagram of a logical processing procedure for collecting and transmitting real-time multimedia information by a mobile terminal according to the present invention. Preferred embodiment of the invention

下面结合附图及本发明的实施例对本发明的方法作进一步详细的说明。图 1为本发明的多媒体***的网络结构示意图，如图 1所示，该多媒体 ***处在无线通信网络中并且接入国际互联网（ Internet ) , 所述多媒体***，包括设置成釆集和发送多媒体信息的移动终端 101、多媒体信息服务器 102、内容编审工作站 103以及多部设置成接收多媒体信息的通信终端 104等。这里，所述无线通信网络，包括无线接入网、 IMS核心网；所述 IMS核心网包括包交换（PS, Packet Switch )域。所述通信终端，包括接入互联网的固网和无线网的微型计算机、笔记本计算机、个人数字助理（PDA ) 、可视电话以及移动终端等。其中， The method of the present invention will be further described in detail below with reference to the accompanying drawings and embodiments of the invention. 1 is a schematic diagram of a network structure of a multimedia system according to the present invention. As shown in FIG. 1, the multimedia system is in a wireless communication network and is connected to the Internet. The multimedia system includes setting and collecting multimedia. The information mobile terminal 101, the multimedia information server 102, the content editing workstation 103, and a plurality of communication terminals 104 arranged to receive multimedia information, and the like. Here, the wireless communication network includes a radio access network and an IMS core network; and the IMS core network includes a packet switching (PS, Packet Switch) domain. The communication terminal includes a microcomputer, a notebook computer, a personal digital assistant (PDA), a videophone, a mobile terminal, and the like of a fixed network and a wireless network connected to the Internet. among them,

移动终端 101 , 设置成釆集现场的多媒体信息，并将所釆集的多媒体信息通过无线接入网、 IMS核心网转发给多媒体信息服务器 102。 The mobile terminal 101 is configured to collect multimedia information of the scene, and forward the collected multimedia information to the multimedia information server 102 through the radio access network and the IMS core network.

这里，所述移动终端 101 , 包括有麦克风、摄像头等部件，并且内部包含 IMS客户端软件模块。使用所述 IMS客户端软件模块通过无线通信网络承载的互联网协议（IP ) , 实现 IMS会话的业务流程，包括支持会话发起协议 ( SIP ) 、实时传输协议（RTP ) 、媒体编码解码等功能。所述移动终端使用的麦克风、摄像头随着移动终端的档次和发展阶段的不同，麦克风的拾音效果、灵敏度、所釆集音频的位率等均可不同，摄像头的像素、釆集视频信息的帧频以及精确度等也可不同。为了提高所摄录的画面的质量，该移动终端还可以外接高分辨率的摄像头。 Here, the mobile terminal 101 includes components such as a microphone, a camera, and the like, and internally includes an IMS client software module. The IMS client software module (IP) is implemented by using the Internet Protocol (IP) carried by the IMS client software module, and supports the functions of Session Initiation Protocol (SIP), Real-Time Transport Protocol (RTP), media coding and decoding, and the like. The microphone and the camera used by the mobile terminal may have different sound pickup effects, sensitivity, and bit rate of the collected audio, depending on the grade and development stage of the mobile terminal, and the pixels of the camera and the video information collected by the camera. The frame rate and accuracy can also be different. In order to improve the quality of the recorded picture, the mobile terminal can also externally connect to a high resolution camera.

另外，所述移动终端 101若需要较长时间工作在无线信号收发、釆集音频视频、编码解码等状态下的话，还可以通过接驳外接电源或高容量电池的方式来保证所述移动终端的长时间用电的需要。多媒体信息服务器 102, 设置成通过 IMS核心网接收移动终端 101所釆集的实时的多媒体信息，同时将所述实时的多媒体信息分发给互联网用户和其他预先定制了实时多媒体信息服务的通信终端。 In addition, if the mobile terminal 101 needs to work for a long period of time in the state of wireless signal transmission and reception, collecting audio and video, encoding and decoding, etc., the mobile terminal can also ensure the mobile terminal by connecting an external power source or a high-capacity battery. The need to use electricity for a long time. The multimedia information server 102 is configured to receive real-time multimedia information collected by the mobile terminal 101 through the IMS core network, and simultaneously distribute the real-time multimedia information to the Internet user and other communication terminals pre-customized with the real-time multimedia information service.

这里，所述多媒体信息服务器 102通过 IMS核心网、无线接入网与移动终端 101连接；所述无线接入网用于承载和传输 IP报文；所述 IMS核心网为所述多媒体信息服务器 102分配一个接入码或协议地址，当所述移动终端 101 拨打该接入码或协议地址向所述多媒体信息服务器 102发起会话请求时，所述 IMS核心网将会话消息转发给所述多媒体信息服务器 102, 当通信建立后，移动终端 101所釆集的实时的多媒体信息通过无线接入网、 IMS核心网传送到所述多媒体信息服务器 102。 Here, the multimedia information server 102 is connected to the mobile terminal 101 through an IMS core network and a radio access network; the radio access network is configured to carry and transmit IP packets; and the IMS core network is the multimedia information server 102. Assigning an access code or protocol address, when the mobile terminal 101 dials the access code or protocol address to initiate a session request to the multimedia information server 102, the IMS core network forwards the session message to the multimedia information server. 102. After the communication is established, the real-time multimedia information collected by the mobile terminal 101 is transmitted to the multimedia information server 102 through the radio access network and the IMS core network.

所述多媒体信息服务器 102 , 还可以设置成根据定制实时的多媒体信息服务的通信终端的不同，将所述多媒体信息格式转化为所述通信终端所支持的格式。 The multimedia information server 102 may be further configured to convert the multimedia information format into a format supported by the communication terminal according to a different communication terminal of the customized real-time multimedia information service.

内容编审工作站 103 , 设置成通过多媒体信息服务器 102进行分发前对实时的多媒体信息进行编辑和审查，并可以为所述实时的多媒体信息附加字幕、添加滚动新闻消息等内容。 The content reviewing workstation 103 is configured to edit and review the real-time multimedia information before being distributed by the multimedia information server 102, and may add a character, a scrolling news message, and the like to the real-time multimedia information.

通信终端 104, 设置成向所述多媒体信息服务器 102定制实时多媒体信息服务，以及接收和播放所述多媒体信息供用户收看。 The communication terminal 104 is arranged to customize the real-time multimedia information service to the multimedia information server 102, and to receive and play the multimedia information for viewing by the user.

图 2 为本发明的移动终端釆集和发送实时的多媒体信息的逻辑处理过程示意图，如图 2所示，该过程包括： 2 is a schematic diagram of a logic processing process for collecting and transmitting real-time multimedia information by a mobile terminal according to the present invention. As shown in FIG. 2, the process includes:

步骤 201 : 移动终端选中现场后，拨叫多媒体信息服务器，建立会话联系。 Step 201: After the mobile terminal selects the site, dial the multimedia information server to establish a session connection.

这里，所述移动终端拨叫多媒体信息服务器建立会话联系，具体为：移动终端拨打多媒体信息服务器的接入号，发送 SIP消息 INVITE, 以 SIP信令协议发起一个 SIP会话，根据 SIP协议，移动终端通过 IMS核心网与所述多媒体信息服务器以 SIP消息交互的方式建立会话，并确认所要传输的多媒体格式等参数。 Here, the mobile terminal dials the multimedia information server to establish a session connection, specifically: the mobile terminal dials the access number of the multimedia information server, sends the SIP message INVITE, initiates a SIP session by using the SIP signaling protocol, and according to the SIP protocol, the mobile terminal The session is established by the IMS core network interacting with the multimedia information server by means of SIP messages, and the parameters such as the multimedia format to be transmitted are confirmed.

所述移动终端拨打的接入号，是由 IMS核心网为所述多媒体信息服务器分配的，拨号建立会话的过程，也是寻址、建立与多媒体信息服务器连接关系的过程。建立会话所用到的信令，是通过现有的 SIP协议、会话描述协议 ( SDP )等实现的。 The access number dialed by the mobile terminal is used by the IMS core network as the multimedia information server. The process of assigning, dialing, and establishing a session is also a process of addressing and establishing a connection relationship with a multimedia information server. The signaling used to establish a session is implemented through an existing SIP protocol, a Session Description Protocol (SDP), and the like.

步骤 202: 会话建立后，所述移动终端上的麦克风和摄像头开始釆集现场的声音和视频信息即多媒体信息，实时地发送到多媒体信息服务器。 Step 202: After the session is established, the microphone and the camera on the mobile terminal start to collect the sound and video information of the field, that is, the multimedia information, and send it to the multimedia information server in real time.

这里，所述移动终端实时地发送多媒体信息到所述多媒体信息服务器的过程中，使用实时传输协议 /实时传输控制等协议（RTP/RTCP ) , 所述音频的编码可以按照 G.711、 G.723协议以脉冲编码调制（PCM )的方式进行，也可以按照自适应多速率（AMR )的音频编码或其它方式进行，并传送所选定格式的音频媒体^艮文；所述视频可以以 H.263协议、运动图像专家组（ MPEG4, Moving Picture Experts Group )等视频编码的方式进行，并传送视频媒体才艮文。 Here, in the process of transmitting the multimedia information to the multimedia information server in real time, the mobile terminal uses a real-time transmission protocol/real-time transmission control protocol (RTP/RTCP), and the audio coding may be in accordance with G.711, G. The 723 protocol is performed in a pulse code modulation (PCM) manner, or may be performed in an adaptive multi-rate (AMR) audio encoding or other manner, and transmits an audio medium of a selected format; the video may be in the H The .263 protocol, the Moving Picture Experts Group (MPEG4, Moving Picture Experts Group) and other video coding methods are carried out, and the video media is transmitted.

步骤 203: 所述多媒体信息服务器接收到所述多媒体信息，根据预先的配置策略分发所述多媒体信息。 Step 203: The multimedia information server receives the multimedia information, and distributes the multimedia information according to a preset configuration policy.

这里，多媒体信息服务器根据预先配置的策略，包括但不限于以下方式：将所述多媒体信息以 IP报文或其它的形式转发到电视广播服务中心，利用多媒体广播 /组播技术（MBMS )发送到定制了实时的多媒体信息服务的通信终端；或者由多媒体信息服务器经 IMS核心网直接通过呼叫发送到定制了服务的通信终端；还可把所接收到的现场多媒体信息通过 IP网络分发到互联网，互联网用户可以收看所述多媒体信息。 Here, the multimedia information server is configured according to a pre-configured policy, including but not limited to the following manner: forwarding the multimedia information to a television broadcast service center in an IP message or other form, and transmitting to the television broadcast service center by using a multimedia broadcast/multicast technology (MBMS) A communication terminal that customizes the real-time multimedia information service; or the multimedia information server directly transmits the call to the customized communication terminal via the IMS core network; and the received live multimedia information can be distributed to the Internet through the IP network, the Internet The user can view the multimedia information.

在进行分发之前，可根据需要，将接收到的现场多媒体信息通过 IP网络发送到内容编审工作站，通过内容编审工作站对多媒体信息进行在线编辑、审核，并且，还可以选择对所述的多媒体信息进行保存。这里，所述编辑，只是简单地对所述经过多媒体信息服务器的多媒体信息进行处理，以辅助增强多媒体信息内容的可读性、观赏性，比如，增加字幕、插播点评等；所述审核，是对所述多媒体信息的内容进行在线审核，以便于发现不适合播出的内容时及时切断或删除相关内容。在所述内容编审工作站中对多媒体信息进行在线编辑、审核时，允许对拟播放的多媒体信息进行延时处理，以利于编辑、审核人员的操作，但延时播放的时间不宜过长，此操作还可以利用镜头回放的时间进行。总之，要保证播放的内容流畅，使收视此多媒体信息的观众不感到播放过程有明显中断为宜。 Before the distribution, the received on-site multimedia information may be sent to the content editing workstation through the IP network as needed, and the multimedia information may be edited and reviewed online by the content editing workstation, and the multimedia information may also be selected. save. Here, the editing simply processes the multimedia information passing through the multimedia information server to assist in enhancing the readability and viewing of the multimedia information content, for example, adding subtitles, interstitial comments, etc.; The content of the multimedia information is reviewed online, so as to cut off or delete the related content in time when the content that is not suitable for the broadcast is found. When the multimedia information is online edited and audited in the content editing workstation, the multimedia information to be played is allowed to be delayed, so as to facilitate the editing and auditing operations, but the time of the delayed playback should not be too long. It can also be done with the time of the lens playback. In short, to ensure that the content played is smooth, so that the view of viewing this multimedia information The public does not feel that the playback process has a significant interruption.

步骤 204: 定制了实时的多媒体信息业务的通信终端，接收并播放所述多媒体信息服务器发送的多媒体信息内容。 Step 204: Customize a communication terminal of the real-time multimedia information service, and receive and play the multimedia information content sent by the multimedia information server.

这里，接收并播放的方式包括但不限于以下几种：所述定制了实时的多媒体信息服务的通信终端，可以网络广播 /组播方式或者流媒体的方式接收并播放所述多媒体信息；互联网用户能够通过个人计算机、笔记本计算机、 PDA 等智能通信终端收看所述正在播放的现场的多媒体信息。 Here, the manner of receiving and playing includes, but is not limited to, the following: The communication terminal that customizes the real-time multimedia information service can receive and play the multimedia information in a network broadcast/multicast mode or a streaming media manner; the Internet user The multimedia information of the live scene can be viewed through an intelligent communication terminal such as a personal computer, a notebook computer, or a PDA.

步骤 205: 现场移动终端结束与所述多媒体信息服务器的会话，所述实时的多媒体信息传送结束，相应地，所述通信终端也结束了接收所述多媒体信息的过程。 Step 205: The live mobile terminal ends the session with the multimedia information server, and the real-time multimedia information transmission ends. Accordingly, the communication terminal also ends the process of receiving the multimedia information.

这里，现场移动终端完成了现场釆集后，发送结束会话的 SIP消息（BYE ) 到多媒体信息服务器，结束本次会话，移动终端与多媒体信息服务器之间遵从 SIP协议流程。 Here, after the on-site mobile terminal completes the on-site collection, the SIP message (BYE) of the end session is sent to the multimedia information server, and the session is terminated, and the SIP protocol process is followed between the mobile terminal and the multimedia information server.

所述多媒体信息服务器通过无线网络，使用 MBMS信道通知接收端即通信终端结束该过程。 The multimedia information server uses the MBMS channel to notify the receiving end, i.e., the communication terminal, of the process through the wireless network.

所述实施例中，核心网适用于第三代移动通信伙伴计划（3GPP ) IMS域， 3GPP2 多媒体域（MMD ) 以及***移动通信***（4G )等更先进的高速无线通信网络；无线通信网络适用于 CDMA2000、 WCDMA、 LTE、 Wi-Fi、 WiMAX, TD-SCDMA等网络以及其他能够支持传输多媒体信息所需带宽的不同制式的网络；所用的移动终端可以是支持上述一种或多种制式的单模或多模移动终端。 In the embodiment, the core network is applicable to a third generation mobile communication partner project (3GPP) IMS domain, a 3GPP2 multimedia domain (MMD), and a fourth generation mobile communication system (4G) and other advanced high-speed wireless communication networks; The network is applicable to networks such as CDMA2000, WCDMA, LTE, Wi-Fi, WiMAX, TD-SCDMA, and other networks capable of supporting the bandwidth required for transmitting multimedia information; the mobile terminal used may support one or more of the above-mentioned standards. Single mode or multimode mobile terminal.

以上所述，仅为本发明的较佳实施例而已，并非用于限定本发明的保护范围。本领域技术人员根据本发明所作的任何修饰和变更，均在本发明的保护范围内。 The above is only the preferred embodiment of the present invention and is not intended to limit the scope of the present invention. Any modifications and variations made by those skilled in the art in light of the present invention are within the scope of the invention.

工业实用性 Industrial applicability

本发明通过对移动终端内置 IMS客户端软件模块以及在网络中增设多媒体信息服务器的方式，实现了一种通过移动终端完成实时的现场多媒体信息传输的技术，使其他用户能够通过预先定制实时的多媒体信息服务或收看多媒体信息的方式，由所述多媒体信息服务器向所述用户的通信终端分发多媒体信息、达到实时观看所述多媒体信息的内容的效果。本发明无须对核心网、无线接入网络进行改造，只需使用一部能够摄录音频、视频的移动终端即可将所需发布的现场多媒体信息播报到各个定制此服务的用户眼前。使用本发明，不仅丰富了无线通信的增值业务，吸引用户使用，而且扩充了各种多媒体信息的发布渠道，由于操作简单，人人皆可体验这种像记者一样连线报道的信息发布方式，方便地让他人及时了解各种现场事件。因此具有很强的工业实用性。 The invention realizes real-time on-site multimedia information through a mobile terminal by means of a built-in IMS client software module of the mobile terminal and a multimedia information server added in the network. The transmission technology enables other users to distribute multimedia information to the communication terminal of the user by means of pre-customizing the real-time multimedia information service or viewing the multimedia information, and realizing the content of the multimedia information in real time. effect. The invention does not need to modify the core network and the wireless access network, and only needs to use a mobile terminal capable of recording audio and video to broadcast the required on-site multimedia information to the users who customize the service. By using the invention, not only enriching the value-added service of wireless communication, attracting users, but also expanding the distribution channels of various multimedia information, since the operation is simple, everyone can experience such a way of publishing information like a reporter. Conveniently let others know about various live events in a timely manner. Therefore, it has strong industrial applicability.

Claims

权利要求书 Claim

1、一种提供实时场景的多媒体***，该***处在无线通信网络环境下，该***包括：移动终端、多媒体信息服务器以及通信终端；其中， A multimedia system for providing a real-time scenario, the system being in a wireless communication network environment, the system comprising: a mobile terminal, a multimedia information server, and a communication terminal;

所述移动终端设置成釆集实时的多媒体信息，并将所述多媒体信息通过无线通信网络发送给所述多媒体信息服务器； The mobile terminal is configured to collect real-time multimedia information, and send the multimedia information to the multimedia information server through a wireless communication network;

所述多媒体信息服务器设置成通过无线通信网络接收所述移动终端釆集的所述多媒体信息，并将所述多媒体信息分发给所述通信终端； The multimedia information server is configured to receive the multimedia information collected by the mobile terminal through a wireless communication network, and distribute the multimedia information to the communication terminal;

所述通信终端设置成从所述多媒体信息服务器接收并播放所述多媒体信息。 The communication terminal is arranged to receive and play the multimedia information from the multimedia information server.

2、根据权利要求 1所述的多媒体***，其中，所述移动终端内部包含 IP 多媒体子*** IMS客户端软件模块，所述 IMS客户端软件模块设置成通过无线通信网络承载 IP, 实现 IMS会话的业务流程， IMS会话的业务流程包括支持会话发起协议 SIP、实时传输协议 RTP以及编码解码功能。 The multimedia system according to claim 1, wherein the mobile terminal internally comprises an IP Multimedia Subsystem IMS client software module, and the IMS client software module is configured to carry an IP over a wireless communication network to implement an IMS session. The business process of the IMS session includes the support of the session initiation protocol SIP, the real-time transport protocol RTP, and the codec function.

3、根据权利要求 1所述的多媒体***，其中，所述多媒体信息服务器还设置成将所述多媒体信息转发到电视广播服务中心，利用多媒体广播 /组播技术将所述多媒体信息发送到定制了实时的多媒体信息服务的所述通信终端；或者 3. The multimedia system according to claim 1, wherein the multimedia information server is further configured to forward the multimedia information to a television broadcast service center, and send the multimedia information to a customized service by using a multimedia broadcast/multicast technology. The communication terminal of the real-time multimedia information service; or

所述多媒体信息服务器还设置成经 IMS核心网直接将所述多媒体信息通过呼叫发送到定制了服务的所述通信终端；或者 The multimedia information server is further configured to directly send the multimedia information via a call to the communication terminal customized for the service via the IMS core network; or

所述多媒体信息服务器还设置成将所述多媒体信息直接分发到互联网。 The multimedia information server is further arranged to distribute the multimedia information directly to the Internet.

4、根据权利要求 3所述的多媒体***，其中，所述通信终端设置成定制所述多媒体信息服务后，通过网络广播 /组播方式或者通过流媒体的方式接收并播放所述多媒体信息，以便互联网用户能够通过所述通信终端收看所述正在播放的所述多媒体信息； The multimedia system according to claim 3, wherein the communication terminal is configured to receive and play the multimedia information through a network broadcast/multicast mode or by streaming media after the multimedia information service is customized, so that The Internet user can view the multimedia information being played through the communication terminal;

所述通信终端为个人计算机、笔记本计算机或个人数字助理 PDA。 The communication terminal is a personal computer, a notebook computer or a personal digital assistant PDA.

5、根据权利要求 1或 3所述的多媒体***，其中，所述多媒体***进一步包括：内容编审工作站，其设置成通过所述多媒体信息服务器在进行分发前对所述多媒体信息进行编辑和审查，并为所述多媒体信息附加字幕、添加滚动新闻消息。 The multimedia system according to claim 1 or 3, wherein the multimedia system further comprises: a content editing workstation configured to edit and review the multimedia information before being distributed by the multimedia information server, and add a subtitle to the multimedia information, and add a rolling news message.

6、一种提供实时场景的多媒体***实现方法，该方法包括： 6. A multimedia system implementation method for providing a real-time scenario, the method comprising:

B、所述移动终端釆集现场的多媒体信息，实时地将所述多媒体信息发送到所述多媒体信息服务器； B. The mobile terminal collects multimedia information of the site, and sends the multimedia information to the multimedia information server in real time;

C、所述多媒体信息服务器接收到所述多媒体信息，根据预先的配置策略将所述多媒体信息分发给通信终端； C. The multimedia information server receives the multimedia information, and distributes the multimedia information to the communication terminal according to a preset configuration policy;

D、所述通信终端从所述多媒体信息服务器实时接收并播放所述多媒体信息。 D. The communication terminal receives and plays the multimedia information in real time from the multimedia information server.

7、根据权利要求 6所述的方法，其中，所述步骤 A包括：所述移动终端拨打所述多媒体信息服务器的接入号，并发送 SIP消息 INVITE, 以 SIP信令协议发起 SIP会话，所述移动终端根据 SIP协议通过 IMS核心网与所述多媒体信息服务器以 SIP消息交互的方式建立会话，并确认所要传输的参数。 The method according to claim 6, wherein the step A comprises: the mobile terminal dialing an access number of the multimedia information server, and sending a SIP message INVITE to initiate a SIP session by using a SIP signaling protocol. The mobile terminal establishes a session by means of a SIP protocol interacting with the multimedia information server by means of a SIP message according to the SIP protocol, and confirms parameters to be transmitted.

8、根据权利要求 6所述的方法，其中，所述步骤 B包括：所述移动终端使用 RTP/实时传输控制协议 RTCP, 将所述多媒体信息的音频部分转换为音频媒体报文传送给所述多媒体信息服务器；将所述多媒体信息的视频部分转换为视频媒体报文传送给所述多媒体信息服务器。 The method according to claim 6, wherein the step B comprises: the mobile terminal converting the audio portion of the multimedia information into an audio media message and transmitting the audio information to the mobile terminal using an RTP/Real Time Transmission Control Protocol (RTCP) a multimedia information server; converting the video portion of the multimedia information into a video media message and transmitting the message to the multimedia information server.

9、根据权利要求 8所述的方法，其中，所述移动终端是按照 G.711、 G723 或按照自适应多速率 ARM的编码方式将所述多媒体信息的音频部分转换为音频媒体报文的； The method according to claim 8, wherein the mobile terminal converts the audio portion of the multimedia information into an audio media message according to G.711, G723 or an adaptive multi-rate ARM encoding manner;

所述移动终端是按照 H.263协议或按照运动图像专家组 MPEG4标准的编码方式将所述多媒体信息的视频部分转换为视频媒体报文的。 The mobile terminal converts the video portion of the multimedia information into a video media message according to the H.263 protocol or the encoding method according to the Moving Picture Experts Group MPEG4 standard.

10、根据权利要求 6所述的方法，其中，步骤 C中所述多媒体信息服务器按照预先的配置策略将所述多媒体信息分发给所述通信终端的所述步骤包括：所述多媒体信息服务器将所述多媒体信息转发到电视广播服务中心，利用多媒体广播 /组播技术将所述多媒体信息发送到定制了实时的多媒体信息服务的所述通信终端；或者 The method according to claim 6, wherein the step of the multimedia information server distributing the multimedia information to the communication terminal according to a pre-configuration policy in step C comprises: Transmitting, by the multimedia information server, the multimedia information to a television broadcast service center, and transmitting the multimedia information to the communication terminal customized with a real-time multimedia information service by using a multimedia broadcast/multicast technology; or

所述多媒体信息服务器经 IMS核心网直接通过呼叫将所述多媒体信息发送到定制了实时的多媒体信息服务的所述通信终端；或者 The multimedia information server sends the multimedia information directly to the communication terminal customized with the real-time multimedia information service via a call through the IMS core network; or

所述多媒体信息服务器将所述多媒体信息直接分发到互联网。 The multimedia information server directly distributes the multimedia information to the Internet.

11、根据权利要求 10所述的方法，其中，所述步骤 D包括：定制实时的多媒体信息服务的所述通信终端，通过网络广播 /组播方式或者通过流媒体的方式接收并播放所述多媒体信息； The method according to claim 10, wherein the step D comprises: customizing the communication terminal of the real-time multimedia information service, receiving and playing the multimedia through a network broadcast/multicast mode or by streaming media. Information

所述通信终端为个人计算机、笔记本计算机或 PDA。 The communication terminal is a personal computer, a notebook computer or a PDA.

12、一种多媒体信息服务器，其支持实现提供实时场景的多媒体***，所述多媒体信息服务器设置成：通过无线通信网络接收由移动终端釆集的实时的多媒体信息，并将所述多媒体信息分发给通信终端，以使所述通信终端接收并播放所述多媒体信息。 12. A multimedia information server, which supports implementing a multimedia system for providing a real-time scene, the multimedia information server being configured to: receive real-time multimedia information collected by the mobile terminal through a wireless communication network, and distribute the multimedia information to a communication terminal to enable the communication terminal to receive and play the multimedia information.

13、根据权利要求 12所述的多媒体信息服务器，其中，所述多媒体信息服务器进一步设置成在进行分发前通过内容编审工作站对所述多媒体信息进行编辑和审查，并为所述多媒体信息附加字幕、添加滚动新闻消息。 13. The multimedia information server according to claim 12, wherein the multimedia information server is further configured to edit and review the multimedia information through a content reviewing workstation before performing the distribution, and attach a subtitle to the multimedia information, Add a rolling news message.