WO2009045051A2

WO2009045051A2 - Method for providing initial behavior of multimedia application format content and system therefor

Info

Publication number: WO2009045051A2
Application number: PCT/KR2008/005788
Authority: WO
Inventors: Jeong Yeon Lim; Young Ho Joo; Won Jun Lee; Ki Mun Kim; Min Seok Kim
Original assignee: Sk Telecom Co., Ltd.
Priority date: 2007-10-04
Filing date: 2008-10-01
Publication date: 2009-04-09
Also published as: KR20090034500A; KR101034758B1; WO2009045051A3

Abstract

The present invention relates to a method of initially executing an integrated multimedia file in which pieces of single-type multimedia content, such as video, audio, images, and text, are provided in the format of a single file, and an integrated multimedia service system for implementing the method. The multimedia service system includes an integrated multimedia content provision server (100) for determining an initial execution method for integrated multimedia content according to a multimedia content authoring method, and authoring, creating and providing content by including the initial execution method in a structure of an integrated multimedia file format of the content; and a user terminal (200) for requesting and receiving specific integrated multimedia content from the integrated multimedia content provision server, decrypting an initial execution method for the specific integrated multimedia content, and then executing the content.

Description

METHOD FOR PROVIDING INITIAL BEHAVIOR OF MULTIMEDIA APPLICATION FORMAT CONTENT AND

SYSTEM THEREFOR

Technical Field

[1] The present invention relates, in general, to a method of initially executing an integrated multimedia file, and, more particularly, to a method of initially executing an integrated multimedia file and a system for implementing the method, in which methods of initially executing content are provided through an integrated multimedia file in which single-type multimedia content, such as video, audio, images or text, is provided as a single file, and the content can be played by analyzing the initial execution methods.

[2]

Background Art

[3] Generally, pieces of single-type multimedia content (for example, video, audio, an image, text, script, metadata, etc.) are separately played, or are converted into two different types of multimedia content and are then provided. For example, multimedia content is played as each piece of single-type content, such as audio, text, video or an image, or, alternatively, is converted into a single video file and is then provided in order to combine multimedia content in the form of video and text, or an image and text.

[4] Recently, in order to provide integrated multimedia content, an integrated file format for providing integrated multimedia content as a single file has been proposed. One or more pieces of single-type multimedia content are stored in an integrated multimedia file format in accordance with the structure of an integrated multimedia file format, so that the pieces of single-type multimedia content can be provided as content having a single integrated form.

[5] This is described in detail below. Multimedia application file format technology, which is one of the fields of standardization currently under administration by a Moving Picture Experts Group (MPEG) standardization group, is technology for an object-oriented standard configured to overcome the limitations of existing universal standards and aimed at a specific application service. Such a multimedia application file format is called an MPEG-A multimedia application format (International Organization for Standardization [ISO]/ International Electrotechnical Commission [IEC] 23000), and is abbreviated as MAF. Standards for a multimedia application file format provide a framework for defining a file format, in which standards of non-MPEG elements are included, as a single integrated file application format by deviating from the definition of application tool sets having the concept of profile using only technology for the standards of existing MPEG elements, so that various characteristics of the standards of respective elements can be provided to application services in various forms. That is, MAF is intended to provide rich media by allowing metadata, which enables time synchronization with existing multimedia content, such as video, audio, an image or text, or which does not require the time synchronization, to be included in a single file format, which enables the exchange, management, editing, and representation of media content, and by enabling the file format to be used in various types of application services in compliance with the standards.

[6] However, in the prior art, the application of a file structure, based on a scheme for determining which new application service is to be derived by combining pieces of additional single-type multimedia content with each other on the basis of main single- type multimedia content and by providing the combined multimedia content in the form of a single file, has been handled through the structure of an integrated multimedia file. Further, when a service method is varied according to an application environment, and then methods of executing single-type content must be variously implemented, a description of a method of executing pieces of single-type multimedia content belonging to a single integrated multimedia file structure is not considered.

[7] For example, in a conventional method, integrated multimedia content is created in such a way as to synchronize additional single-type multimedia content with main single-type multimedia content, and the additional single-type multimedia content starts to be played in synchronization with the start of the playing of the main single- type multimedia content.

[8] Meanwhile, there is a need to establish methods of initial execution of various types of multimedia content in advance for the case where there are one or more pieces of main single-type multimedia content, or the execution of content is restricted through license/protection information or the like, and thus the execution sequence of content must be determined by an application method, the case where advertisement content is included together in main video content and is then differently played according to the billing information of a user, the case where the sequence of advertisement content and main video content must be automatically determined, and the case where menu items are primarily shown to a user to allow the user to view a list of pieces of main content and to manually determine desired content. However, there is a problem in that a method of initializing and initially executing content in current file formats is not considered in current integrated multimedia file structures.

[9] Disclosure of Invention

Technical Problem

[10] Accordingly, the present invention has been made keeping in mind the above problems occurring in the prior art, and an object of the present invention is to provide a method of initially executing an integrated multimedia file and a system for implementing the method, which can provide initial execution methods of describing play methods corresponding to application services for a plurality of pieces of single-type multimedia content in the structure of an integrated multimedia file containing one or more pieces of single-type multimedia content.

[11] Another object of the present invention is to create and provide integrated multimedia content on the basis of initial execution methods together with the structure of an integrated multimedia file, thus enabling the integrated multimedia content to be played.

[12] A further object of the present invention is to provide an integrated multimedia content file format in which the representation of initial execution methods is included in an existing integrated multimedia file format by using a method of describing initial execution methods in the structure of an integrated multimedia file, or a method of describing initial execution methods using representation technology, such as script or metadata, or by using the two methods together.

[13]

Technical Solution

[14] In accordance with an aspect of the present invention to accomplish the above objects, there is provided an integrated multimedia service system, comprising an integrated multimedia content provision server for determining an initial execution method for integrated multimedia content according to a multimedia content authoring method, and authoring, creating and providing content by including the initial execution method in a structure of an integrated multimedia file format of the content; and a user terminal for requesting and receiving specific integrated multimedia content from the integrated multimedia content provision server, decrypting an initial execution method for the specific integrated multimedia content, and then executing the content.

[15] Preferably, the initial execution method is implemented using any one of script, metadata, an integrated multimedia content file format, and combinations thereof.

[16] Preferably, the script required to control the initial execution is implemented using any one standard of Moving Picture Experts Group (MPEG)-4 Binary Format for Scene (BIFS), MPEG-4 Lightweight Application Scene Representation (LASeR), Synchronized Multimedia Integration Language (SMIL), Scalable Vector Graphic (SVC), SVC Tiny, and Extensible Markup Language (XML).

[17] Preferably, the metadata required to describe the initial execution is described using any one standard of MPEG-21, MPEG-7, T V- Anytime, and content protection and rights technology.

[18] Preferably, the content protection and rights technology required to control the initial execution represents content information using any one of MPEG-21 Intellectual Property Management and Protection (IPMP), Rights Expression Language (REL), Rights Data Dictionary (RDD) and Event Reporting (ER).

[19] Preferably, the integrated multimedia content file format is configured using any one of Apple's QuickTime file format, an MPEG-4 file format, an Adobe file format, a Skeletal Model (SKM) format, and an International Organization for Standardization (ISO) file format.

[20] Preferably, the integrated multimedia content comprises at least one of video, audio, an image, text, metadata, content rights/protection information, and script.

[21] In accordance with another aspect of the present invention, there is provided an integrated multimedia content provision server, comprising an integrated multimedia content authoring information input unit for receiving information required to author integrated multimedia content; an initial execution information generation unit for generating initial execution information according to input from a creator; a rights/ protection management unit for generating a user's rights and content protection management information for integrated multimedia content; an integrated multimedia content creation unit for creating a single integrated multimedia content file from the initial execution information, the rights/protection management information and single-type multimedia content on a basis of an integrated multimedia content file format; a single-type multimedia content database for storing and managing single- type multimedia content; and an integrated multimedia content database for storing and managing integrated multimedia content created by the integrated multimedia content creation unit.

[22] Preferably, integrated multimedia content provision server further comprises an integrated multimedia content transmission unit for searching the integrated multimedia content database for relevant integrated multimedia content and extracting and providing the relevant integrated multimedia content when a request for the integrated multimedia content is generated.

[23] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of track boxes (trak boxes) which are respectively connected to the plurality of pieces of single-type multimedia content stored in the mdat box, are respectively assigned to the plurality of pieces of single-type multimedia content, and are configured to include storage locations, time synchronization information and encoding information of respective pieces of single-type multimedia content, and sample table boxes (stbl boxes) which are located in respective trak boxes and are configured to record time synchronization information with other pieces of single-type multimedia content.

[24] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a Binary Format for Scene (BIFS) and Object Description (OD) which are at a higher level and are configured to control an initial execution form of a plurality of track boxes (trak boxes), and the plurality of trak boxes which are respectively allocated to the plurality of pieces of single-type multimedia content.

[25] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of trak boxes which are respectively assigned to the plurality of pieces of single-type multimedia content, and a metabox which is included in a highest track box so as to control an initial execution form of the plurality of trak boxes.

[26] Preferably, the metabox comprises script information, such as MPEG-4, Lightweight

Application Scene Representation (LASeR), Scalable Vector Graphic (SVG), Java Midlet, Java Script, or HyperText Markup Language (HTML).

[27] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of trak boxes and a metabox, the metabox including an XML box containing script information.

[28] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, a media data box (mdat box) including actual multimedia content, and a metabox; and the moov box includes a plurality of trak boxes and the metabox includes an XML box containing script information. [29] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a metabox, and a media data box (mdat box) including actual multimedia content; and the metabox contains script information.

[30] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of trak boxes and a metabox, the metabox including an XML box containing metadata.

[31] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, a media data box (mdat box) including actual multimedia content, and a metabox; and the metabox includes an XML box containing metadata.

[32] Preferably, the integrated multimedia content file format includes a file type box

(ftyp box), a metabox, and a media data box (mdat box) including actual multimedia content; and the metabox includes metadata.

[33] In accordance with a further aspect of the present invention, there is provided a user terminal connected to an integrated multimedia content provision server for creating integrated multimedia content from single-type multimedia content and configured to execute the integrated multimedia content, comprising a storage unit for storing and managing integrated multimedia content; an integrated multimedia content request/ reception unit for requesting and receiving relevant integrated multimedia content from the integrated multimedia content provision server, and storing the integrated multimedia content; a file format analysis unit for parsing and analyzing a file format of the integrated multimedia file received by the integrated multimedia content request/reception unit; an initial execution information decryption unit for decrypting initial execution information on a basis of a structure of the integrated multimedia content file format analyzed by the file format analysis unit, and then transmitting an initial execution command; a rights/protection decryption unit for checking a user's rights and content protection information in compliance with the initial execution command output from the initial execution information decryption unit; a content decoding unit for decoding relevant integrated multimedia content in compliance with the initial execution command output from the initial execution information decryption unit; and an integrated multimedia content rendering unit for rendering the decoded content to a screen of the user terminal in compliance with the initial execution command output from the initial execution information decryption unit.

[34] In accordance with yet another aspect of the present invention, there is provided an integrated multimedia service method, the method creating integrated multimedia content in an integrated multimedia content provision server, comprising the steps of a) the integrated multimedia content provision server receiving authoring information input by a creator; b) generating initial execution information of the authoring information, received at step a), using any one of metadata, script, a file format, content protection and rights technology, and combinations thereof; c) storing a user's rights and content protection information input by the creator; d) searching pre- stored single- type multimedia content for relevant single-type multimedia content selected by the creator and extracting found relevant single-type multimedia content; and e) creating integrated multimedia content by combining the initial execution information, the user's rights/content protection information, and the found single-type multimedia content with each other and by storing combined information in a form of a single file, and then storing the integrated multimedia content.

[35] In accordance with still another aspect of the present invention, there is provided an integrated multimedia service method, the method executing integrated multimedia content in a user terminal connected to an integrated multimedia content provision server for creating integrated multimedia content using single-type multimedia content, comprising the steps of a) the user terminal requesting and receiving specific integrated multimedia content from the integrated multimedia content provision server; b) parsing and analyzing a file format of the integrated multimedia content, received at step a); c) decrypting initial execution information of the integrated multimedia content, analyzed at step b), and then outputting an initial execution command; d) decrypting a user's rights to the integrated multimedia content and protection information of the integrated multimedia content in compliance with the initial execution command, and assigning rights to the initial execution command; e) decoding content depending on the initial execution command, and the content rights and protection information; and f) rendering the content, decoded at step e), to the user terminal in compliance with the initial execution command.

[36]

Advantageous Effects

[37] As described above, the method of initially executing an integrated multimedia file and a system for implementing the method according to the present invention are advantageous in that, unlike multimedia content provided as single-type content, or integrated multimedia content played by synchronizing additional information with a single piece of main multimedia content depending on the structure of a file format, initial execution methods are included in an existing integrated multimedia file format. Accordingly, the present invention is advantageous in that it can efficiently provide various execution methods on the basis of an initial playing method based on a billing method, on the basis of such rights as content rights for respective terminals or users (for example, content resolution, content quality, etc.), the right to restrict initial playing based on profile information such as each user's age/gender, the right to initial execution which allows included content to be automatically played, the right to initial execution and playing in which the intentions of the content's creator are reflected as in the case of an interactive method of allowing content included in a menu or content list to be played arbitrarily by a user according to input from the user, the right to initial execution and automatic playing which allows various types of content to be automatically executed depending on the intentions of the content's provider, the right to initial execution and playing in which the intentions of the content's owner are reflected by means of an advertisement, a specific phrase, an image, video, and audio, the right to initial execution and playing in which the intentions of the content's distributor are reflected by means of an advertisement, a specific phrase, an image, video, and audio, and on the basis of service provision methods using content's own information, such as the content's title, the content's genre, the content's author, the content's length, and the content's compression method.

[38] Further, the present invention is advantageous in that, since integrated multimedia content, including initial execution methods, is provided, various application methods for content can be provided.

[39] In addition, the present invention is advantageous in that, since the intentions of content's user, the content's author, the content's provider, the content's creator, the content's owner, and the content's distributor are applied to initial execution methods for content when the content is played, content consumption methods/service methods for users can be provided, and thus the users' various desires to consume content can be satisfied.

[40]

Brief Description of the Drawings

[41] FIG. 1 is a diagram showing the relationship between an integrated multimedia service system and a communication network according to the present invention;

[42] FIG. 2 is a diagram showing in detail the construction of an integrated multimedia content provision server according to the present invention;

[43] FIG. 3 is a diagram showing in detail the construction of a user terminal according to the present invention;

[44] FIGS. 4 to 12 are diagrams showing examples of the structure of an integrated multimedia content file format according to the present invention;

[45] FIG. 13 is a flowchart showing an example of an integrated multimedia service method according to the present invention; and

[46] FIG. 14 is a flowchart showing another example of an integrated multimedia service method according to the present invention.

[47] <Description of reference numerals of principal elements in the drawings>

[48] 100: integrated multimedia content provision server

[49] 110: integrated multimedia content authoring information input unit

[50] 120: initial execution information generation unit 130: rights/protection management unit

[51] 140: integrated multimedia content creation unit

[52] 150: integrated multimedia content transmission unit

[53] 160: single-type multimedia content DB

[54] 170: integrated multimedia content DB

[55] 200: user terminal

[56] 210: integrated multimedia content request/reception unit

[57] 220: file format analysis unit 230: initial execution information decryption unit

[58] 240: rights/protection decryption unit 250: content decoding unit

[59] 260: integrated multimedia content rendering unit 270: storage unit

[60]

Best Mode for Carrying Out the Invention

[61] Hereinafter, embodiments of the present invention will be described in detail with reference to the attached drawings.

[62] First, FIG. 1 is a diagram showing the relationship between an integrated multimedia service system and a communication network according to the present invention.

[63] As shown in the drawing, the integrated multimedia service system includes an integrated multimedia content provision server 100 for determining initial execution methods for integrated multimedia content according to a multimedia content authoring method, and authoring, creating and providing content by including the initial execution method in the structure of an integrated multimedia file format of the content, and a user terminal 200 for requesting and receiving specific integrated multimedia content from the integrated multimedia content provision server 100, decrypting an initial execution method for relevant content, and executing the content.

[64] The integrated multimedia content includes one or more pieces of single-type multimedia content, and has a form in which initial execution methods for respective pieces of single-type multimedia content are determined by the integrated multimedia content provision server 100 and are included in the structure of the integrated m ultimedia file format.

[65] The initial execution methods are implemented using any one of script, metadata, an integrated multimedia content file format, and combinations thereof.

[66] In this case, script required to control initial execution is configured using any one standard of MPEG-4 Binary Format for Scene (BIFS), MPEG-4 Lightweight Application Scene Representation (LASeR), Synchronized Multimedia Integration Language (SMIL), Scalable Vector Graphic (SVG), SVC Tiny, and Extensible Markup Language (XML).

[67] Further, metadata required to describe initial execution is described using any one standard of MPEG-21, MPEG-7, TV- Anytime, content protection and rights technology.

[68] Metadata technology for multimedia content protection and rights, required to control initial execution, is implemented using MPEG-21 Intellectual Property Management and Protection (IPMP), and thus content information is represented.

[69] The integrated multimedia content file format is configured using any one of Apple's

QuickTime file format, an MPEG-4 file format, an Adobe file format, a Skeletal Model (SKM) format, and an International Organization for Standardization (ISO) file format.

[70] Further, the integrated multimedia content includes at least one of video, audio, images, text, metadata, content rights/protection information, and script.

[71] FIG. 2 is a diagram showing in detail the construction of an integrated multimedia content provision server according to the present invention.

[72] As shown in the drawing, the integrated multimedia content provision server 100 includes an integrated multimedia content authoring information input unit 110, an initial execution information generation unit 120, a rights/protection management unit 130, an integrated multimedia content creation unit 140, an integrated multimedia content transmission unit 150, a single-type multimedia content Database (DB) 160, and an integrated multimedia content DB 170.

[73] In more detail, the integrated multimedia content authoring information input unit

110 receives information required to author integrated multimedia content.

[74] The initial execution information generation unit 120 generates initial execution information in response to an input from a creator.

[75] The rights/protection management unit 130 generates a user's rights and content protection management information for respective pieces of integrated multimedia content.

[76] The integrated multimedia content creation unit 140 creates a single integrated multimedia content file from the initial execution information, the rights/protection management information, and the single-type multimedia content, on the basis of an integrated multimedia content file format.

[77] The integrated multimedia content transmission unit 150 searches the integrated multimedia content DB 170 for relevant integrated multimedia content, extracts the relevant integrated multimedia content from the DB 170 and provides the extracted integrated multimedia content when a request for integrated multimedia content is generated.

[78] The single-type multimedia content DB 160 stores and manages single-type multimedia content.

[79] The integrated multimedia content DB 170 stores and manages integrated multimedia content created by the integrated multimedia content creation unit 140.

[80] FIG. 3 is a diagram showing in detail the construction of a user terminal according to the present invention.

[81] As shown in the drawing, the user terminal 200 includes an integrated multimedia content request/reception unit 210, a file format analysis unit 220, an initial execution information decryption unit 230, a rights/protection decryption unit 240, a content decoding unit 250, an integrated multimedia content rendering unit 260, and a storage unit 270.

[82] In detail, the integrated multimedia content request/reception unit 210 requests and receives integrated multimedia content from the integrated multimedia content provision server 100, and stores the received integrated multimedia content in the storage unit 270.

[83] The file format analysis unit 220 parses and analyzes the file format of the integrated multimedia content received by the integrated multimedia content request/reception unit 210.

[84] The initial execution information decryption unit 230 decrypts initial execution information and transmits an execution command depending on the structure of the file format of the integrated multimedia content analyzed by the file format analysis unit 220.

[85] The rights/protection decryption unit 240 checks the user's rights, content protection information, and content right information in compliance with the initial execution command output from the initial execution information decryption unit 230.

[86] The content decoding unit 250 decodes relevant integrated multimedia content in compliance with the initial execution command output from the initial execution information decryption unit 230.

[87] The integrated multimedia content rendering unit 260 renders the decoded content to the screen of the user terminal 200 in compliance with the initial execution command output from the initial execution information decryption unit 230.

[88] The storage unit 270 stores and manages the integrated multimedia content received by the integrated multimedia content request/reception unit 210.

[89] The storage unit 270 may also be implemented as a separate storage medium connected to a communication network, in addition to a storage medium included in the user terminal 200. When information is stored in a separate storage medium, the user terminal 200 accesses the relevant storage medium over the communication network, and then requests and receives information from the storage medium.

[90] With reference to FIGS. 4 to 12, which will be described later, the structure of the integrated multimedia content file format generated by the integrated multimedia content creation unit 140 of FIG. 2 is described below.

[91] FIG. 4 is a diagram showing an example of the structure of an integrated multimedia content file format according to the present invention.

[92] Referring to FIG. 4, the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including the locations and running times of a plurality of pieces of single-type multimedia content and typical information related to the content, and a media data box (mdat box) including actual multimedia content.

[93] The moov box includes a plurality of track boxes (trak boxes) respectively connected to the plurality of pieces of single-type multimedia content stored in the mdat box and configured to include the storage locations, time synchronization information and encoding information of respective pieces of single-type multimedia content, and sample table boxes (stbl boxes) located in respective trak boxes and configured to record time synchronization information with other pieces of single-type multimedia content.

[94] The execution sequence of the plurality of pieces of single-type multimedia content is adjusted on the basis of the information stored in the sample table boxes of the plurality of trak boxes stored in the file format, and thus initial execution methods are controlled.

[95] Further, the trak boxes are respectively assigned to one or more pieces of single-type multimedia content stored in the media data box, and include both basic information about relevant multimedia content and information about playing methods thereof.

[96] For example, audio track data includes the encoding information of audio and information about the time required to play the audio.

[97] FIG. 5 is a diagram showing another example of the structure of an integrated multimedia content file format according to the present invention.

[98] Referring to FIG. 5, the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including the locations and running times of a plurality of pieces of single-type multimedia content and typical information related to the content, and a media data box (mdat box) including actual multimedia content.

[99] The moov box includes a Binary Format for Scene (BIFS) and Object Description

(OD), which are at a higher level and are configured to control the initial execution form of a plurality of trak boxes, and the plurality of trak boxes. The moov box controls the initial execution of the plurality of pieces of single-type multimedia content using both the information of the BIFS and the command information of the OD (OD command).

[100] In the BIFS and the OD, information designated to allow the plurality of pieces of multimedia content to be executed according to the sequence input by the user or to be executed according to time or priority is stored.

[101] FIG. 6 is a diagram showing a further example of the structure of an integrated multimedia content file format according to the present invention.

[102] Referring to FIG. 6, the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including the locations and running times of a plurality of pieces of single-type multimedia content and typical information related to the content, and a media data box (mdat box) including actual multimedia content.

[103] The moov box includes a plurality of track boxes (trak boxes) and a metabox included in the highest trak box in order to control the initial execution form of the plurality of trak boxes.

[104] The metabox includes script information, such as MPEG-4 LASeR, SVG, Java

Midlet, Java Script, and (HyperText Markup Language) HTML, and controls initial execution methods by controlling pieces of multimedia content corresponding to other trak boxes. Further, in the metabox, the time information of the file format is set so that the highest trak box including the script information is checked first, thus enabling the script to be always read first.

[105] Further, the script information is used together with the standards of a file format, or metadata, and thus the initial execution methods are controlled.

[106] The metabox of FIG. 6 may be located within the moov box (refer to FIG. 7), at a level equivalent to that of the moov box (refer to FIG. 8), or after the file type box (ftyp box) without using the moov box (refer to FIG. 9), in addition to within the trak box. Accordingly, the location of the metabox, including script information, may also be changed, as shown in FIGS. 7 to 9, which will be described later.

[107] Here, the moov box of FIG. 8 includes information for time synchronization between respective pieces of multimedia content.

[108] In more detail, the integrated multimedia content file format of FIG. 7 includes a file type box (ftyp box), a movie box (moov box) including the locations and running times of a plurality of pieces of single-type multimedia content and typical information related to the content, and a media data box (mdat box) including actual multimedia content. The moov box includes a plurality of trak boxes and a metabox, the metabox including an XML box containing script information.

[109] The integrated multimedia content file format of FIG. 8 includes a file type box (ftyp box), a movie box (moov box) including the locations and running times of a plurality of pieces of single-type multimedia content and typical information related to the content, a media data box (mdat box) including actual multimedia content, and a metabox.

[110] Here, the moov box includes a plurality of track boxes (trak boxes), and the metabox includes an XML box containing script information.

[I l l] The integrated multimedia content file format of FIG. 9 includes a file type box (ftyp box), a metabox, and a media data box (mdat box) including actual multimedia content.

[112] Here, the metabox includes script information.

[113] FIGS. 10 to 12, which will be described later, are diagrams showing examples of the case where initial execution methods are controlled using metadata, such as MPEG-21 data and TV- Anytime data. Here, it is possible to control initial execution methods by independently using the metadata information, or by applying the metadata information together with copyright information, such as MPEG-21 Intellectual Property Management and Protection (IPMP), Rights Expression Language (REL), Rights Data Dictionary (RDD), and Event Reporting (ER), rights control, internal standards of a file format, and script.

[114] In detail, the integrated multimedia content file format of FIG. 10 includes a file type box (ftyp box), a movie box (moov box) including the locations and running times of a plurality of pieces of single-type multimedia content and typical information related to the content, and a media data box (mdat box) including actual multimedia content. The moov box includes a plurality of trak boxes and a metabox, the metabox including an XML box containing metadata.

[115] The integrated multimedia content file format of FIG. 11 includes a file type box (ftyp box), a moov box including the locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, a media data box (mdat box) including actual multimedia content, and a metabox. The metabox includes an XML box containing metadata.

[116] Here, the metadata may include time information. When the metadata does not include time information, multimedia content is executed on the basis of time information contained in trak boxes.

[117] The integrated multimedia content file format of FIG. 12 includes a file type box (ftyp box), a metabox, and a media data box (mdat box) including actual multimedia content. The metabox includes metadata.

[118] In this case, it is possible to perform setting such that information contained in the XML box of FIG. 12 is read first.

[119] FIG. 13 is a flowchart showing an example of an integrated multimedia service method according to the present invention, and a description will be made regarding the case where the integrated multimedia content provision server of FIG. 2 generates integrated multimedia content by way of example.

[120] First, the integrated multimedia content authoring information input unit 110 of the integrated multimedia content provision server 100 receives authoring information input by a creator at step SlOl.

[121] For example, the term 'authoring information' means a playing method based on a billing scheme, a playing restriction method based on content rights and profile information such as a user's age/gender, a method of allowing included content to be automatically played, a play method in which the intentions of the content's creator are reflected as in the case of an interactive method of playing respective pieces of included content by adjusting the content according to input from the user, a play method in which the intentions of the content's provider are reflected, a play method in which the intentions of the content's owner are reflected, a play method in which the intentions of the content's distributor are reflected, and content's own information, such as the content's title, the content's genre, the content's author, the content's length, and the content's compression method.

[122] Next, the initial execution information generation unit 120 generates the initial execution information of the authoring information, received at step SlOl, using any one of metadata, script, a file format, content protection and rights technology, and combinations thereof at step S 103.

[123] The rights/protection management unit 130 stores the user's rights and content protection information input by the creator at step S 105.

[124] The integrated multimedia content creation unit 140 searches the single-type multimedia content DB 160 for relevant single-type multimedia content selected by the creator and extracts the found single-type multimedia content at step S 107.

[125] The integrated multimedia content creation unit 140 creates integrated multimedia content by combining the initial execution information generated at step S 103, the rights/protection information stored at step S 105, and the single-type multimedia content found at step S 107 with each other and by storing the combined results in the form of a single file, and then stores the integrated multimedia content in the integrated multimedia content DB 170 at step S 109.

[126] Thereafter, the integrated multimedia content transmission unit 150 extracts relevant integrated multimedia content from the integrated multimedia content DB 170 and provides the extracted integrated multimedia content in response to a request received from the user terminal 200 at step Si l l.

[127] FIG. 14 is a flowchart showing another example of an integrated multimedia service method according to the present invention, and a description will be made regarding the case where the user terminal of FIG. 3 executes integrated multimedia content by way of example. [128] First, the integrated multimedia content request/reception unit 210 of the user terminal 200 requests and receives specific integrated multimedia content from the integrated multimedia content provision server 100, and stores the integrated multimedia content in the storage unit 270 at step S201.

[129] The file format analysis unit 220 parses and analyzes the file format of the integrated multimedia content, received at step s201, at step S203.

[130] Next, the initial execution information decryption unit 230 decrypts the initial execution information of the integrated multimedia content, analyzed at step S203, and then outputs an initial execution command at step S205.

[131] For example, the initial execution information decryption unit 230 outputs the initial execution command on the basis of the initial execution information included in the moov box or metabox, which includes the initial execution information of each piece of single-type multimedia content, in the integrated multimedia content file format of FIGS. 4 to 12.

[132] The rights/protection decryption unit 240 decrypts the user's rights to relevant integrated multimedia content and protection information of the content in compliance with the initial execution command, output at step S205, and then assigns the rights to the initial execution command at step S207.

[133] For example, the term 'initial execution command' means a command for assigning the rights on the basis of an initial play method based on a billing scheme, content rights for respective terminals or users (for example, content resolution, content quality, etc.), the right to restrict initial playing based on profile information such as each user's age/gender, the right to initial execution which allows included content to be automatically played, the right to initial execution and playing in which the intentions of the content's creator are reflected as in the case of an interactive method of allowing content included in a menu or content list to be played arbitrarily by a user according to input from the user, the right to initial execution and automatic playing which allows various types of content to be automatically executed depending on the intentions of the content's provider, the right to initial execution and playing in which the intentions of the content's owner are reflected by means of an advertisement, a specific phrase, an image, video, and audio, the right to initial execution and playing in which the intentions of the content's distributor are reflected by means of an advertisement, a specific phrase, an image, video, and audio, and other types of content's own information, such as the content's title, the content's genre, the content's author, the content length, and the content's compression method.

[134] The content decoding unit 250 decodes content depending on the initial execution command and the content rights and protection information at step S209.

[135] For example, the content decoding unit 250 decodes content in compliance with the initial execution command and a rights/protection command, decrypted by the rights/ protection decryption unit 240, on the basis of the content rights and protection information, that is, an initial play method based on a billing scheme, content rights for respective terminals or users (for example, content resolution, content quality, etc.), the right to restrict initial playing based on profile information such as each user's age/ gender, the right to initial execution which allows included content to be automatically played, the right to initial execution and playing in which the intentions of the content's creator are reflected as in the case of an interactive method of allowing content included in a menu or content list to be played arbitrarily by a user according to input from the user, the right to initial execution and automatic playing which allows various types of content to be automatically executed depending on the intentions of the content's provider, the right to initial execution and playing in which the intentions of the content's owner are reflected by means of an advertisement, a specific phrase, an image, video, and audio, the right to initial execution and playing in which the intentions of the content's distributor are reflected by means of an advertisement, a specific phrase, an image, video, and audio, and other types of content's own information, such as the content's title, the content's genre, the content's author, the content's length, and the content's compression method.

[136] Thereafter, the integrated multimedia content rendering unit 260 renders the content decoded at step S209 to the user terminal 200 in compliance with the initial execution command at step S211.

[137] As described above those skilled in the art will appreciate that the present invention can be implemented in other detailed forms without changing the technical spirit or essential features thereof. Therefore, the above-described embodiments should be understood as not being restrictive, and they are only exemplary from all aspects. The scope of the present invention will be defined by the accompanying claims rather than the detailed description, and all changes and modifications derived from the meaning and scope of the claims and equivalent thereof should be interpreted as being included in the scope of the present invention.

[138]

Industrial Applicability

[139] As described above, an integrated multimedia service system and method according to the present invention are configured such that initial execution methods are included in the structure of an existing integrated multimedia file format, unlike multimedia content that is provided in a single type, or integrated multimedia content that is played by synchronizing additional information with a single piece of main multimedia content depending on the structure of a file format, and thus the present invention can be suitably applied to fields in which various application-based execution methods must be effectively provided.

Claims

[1] An integrated multimedia service system, comprising: an integrated multimedia content provision server for determining an initial execution method for integrated multimedia content according to a multimedia content authoring method, and authoring, creating and providing content by including the initial execution method in a structure of an integrated multimedia file format of the content; and a user terminal for requesting and receiving specific integrated multimedia content from the integrated multimedia content provision server, decrypting an initial execution method for the specific integrated multimedia content, and then executing the content.

[2] The integrated multimedia service system according to claim 1, wherein the initial execution method is implemented using any one of script, metadata, an integrated multimedia content file format, and combinations thereof.

[3] The integrated multimedia service system according to claim 2, wherein the script required to control the initial execution is implemented using any one standard of Moving Picture Experts Group (MPEG)-4 Binary Format for Scene (BIFS), MPEG-4 Lightweight Application Scene Representation (LASeR), Synchronized Multimedia Integration Language (SMIL), Scalable Vector Graphic (SVC), SVC Tiny, and Extensible Markup Language (XML).

[4] The integrated multimedia service system according to claim 2, wherein the metadata required to describe the initial execution is described using any one standard of MPEG-21, MPEG-7, TV- Anytime, and content protection and rights technology.

[5] The integrated multimedia service system according to claim 4, wherein the content protection and rights technology required to control the initial execution represents content information using any one of MPEG-21 Intellectual Property Management and Protection (IPMP), Rights Expression Language (REL), Rights Data Dictionary (RDD) and Event Reporting (ER).

[6] The integrated multimedia service system according to claim 2, wherein the integrated multimedia content file format is configured using any one of Apple's QuickTime file format, an MPEG-4 file format, an Adobe file format, a Skeletal Model (SKM) format, and an International Organization for Standardization (ISO) file format.

[7] The integrated multimedia service system according to claim 1, wherein the integrated multimedia content comprises at least one of video, audio, an image, text, metadata, content rights/protection information, and script.

[8] An integrated multimedia content provision server, comprising: an integrated multimedia content authoring information input unit for receiving information required to author integrated multimedia content; an initial execution information generation unit for generating initial execution information according to input from a creator; a rights/protection management unit for generating a user's rights and content protection management information for integrated multimedia content; an integrated multimedia content creation unit for creating a single integrated multimedia content file from the initial execution information, the rights/ protection management information and single-type multimedia content on a basis of an integrated multimedia content file format; a single-type multimedia content database for storing and managing single-type multimedia content; and an integrated multimedia content database for storing and managing integrated multimedia content created by the integrated multimedia content creation unit.

[9] The integrated multimedia content provision server according to claim 8, further comprising an integrated multimedia content transmission unit for searching the integrated multimedia content database for relevant integrated multimedia content and extracting and providing the relevant integrated multimedia content when a request for the integrated multimedia content is generated.

[10] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of track boxes (trak boxes) which are respectively connected to the plurality of pieces of single-type multimedia content stored in the mdat box, are respectively assigned to the plurality of pieces of single-type multimedia content, and are configured to include storage locations, time synchronization information and encoding information of respective pieces of single-type multimedia content, and sample table boxes (stbl boxes) which are located in respective trak boxes and are configured to record time synchronization information with other pieces of single-type multimedia content.

[11] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a Binary Format for Scene (BIFS) and Object Description (OD) which are at a higher level and are configured to control an initial execution form of a plurality of track boxes (trak boxes), and the plurality of trak boxes which are respectively allocated to the plurality of pieces of single-type multimedia content.

[12] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of trak boxes which are respectively assigned to the plurality of pieces of single-type multimedia content, and a metabox which is included in a highest track box so as to control an initial execution form of the plurality of trak boxes.

[13] The integrated multimedia content provision server according to claim 12, wherein the metabox comprises script information, such as MPEG-4, Lightweight Application Scene Representation (LASeR), Scalable Vector Graphic (SVG), Java Midlet, Java Script, or HyperText Markup Language (HTML).

[14] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of trak boxes and a metabox, the metabox including an XML box containing script information.

[15] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, a media data box (mdat box) including actual multimedia content, and a metabox; and the moov box includes a plurality of trak boxes and the metabox includes an XML box containing script information.

[16] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a metabox, and a media data box (mdat box) including actual multimedia content; and the metabox contains script information.

[17] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, and a media data box (mdat box) including actual multimedia content; and the moov box includes a plurality of trak boxes and a metabox, the metabox including an XML box containing metadata.

[18] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a movie box (moov box) including locations and running times of a plurality of pieces of single-type multimedia content and typical information about the content, a media data box (mdat box) including actual multimedia content, and a metabox; and the metabox includes an XML box containing metadata.

[19] The integrated multimedia content provision server according to claim 8 or 9, wherein: the integrated multimedia content file format includes a file type box (ftyp box), a metabox, and a media data box (mdat box) including actual multimedia content; and the metabox includes metadata.

[20] A user terminal connected to an integrated multimedia content provision server for creating integrated multimedia content from single-type multimedia content and configured to execute the integrated multimedia content, comprising: a storage unit for storing and managing integrated multimedia content; an integrated multimedia content request/reception unit for requesting and receiving relevant integrated multimedia content from the integrated multimedia content provision server, and storing the integrated multimedia content; a file format analysis unit for parsing and analyzing a file format of the integrated multimedia file received by the integrated multimedia content request/ reception unit; an initial execution information decryption unit for decrypting initial execution information on a basis of a structure of the integrated multimedia content file format analyzed by the file format analysis unit, and then transmitting an initial execution command; a rights/protection decryption unit for checking a user's rights and content protection information in compliance with the initial execution command output from the initial execution information decryption unit; a content decoding unit for decoding relevant integrated multimedia content in compliance with the initial execution command output from the initial execution information decryption unit; and an integrated multimedia content rendering unit for rendering the decoded content to a screen of the user terminal in compliance with the initial execution command output from the initial execution information decryption unit.

[21] An integrated multimedia service method, the method creating integrated multimedia content in an integrated multimedia content provision server, comprising the steps of: a) the integrated multimedia content provision server receiving authoring information input by a creator; b) generating initial execution information of the authoring information, received at step a), using any one of metadata, script, a file format, content protection and rights technology, and combinations thereof; c) storing a user's rights and content protection information input by the creator; d) searching pre-stored single-type multimedia content for relevant single-type multimedia content selected by the creator and extracting found relevant single- type multimedia content; and e) creating integrated multimedia content by combining the initial execution information, the user's rights/content protection information, and the found single- type multimedia content with each other and by storing combined information in a form of a single file, and then storing the integrated multimedia content.

[22] An integrated multimedia service method, the method executing integrated multimedia content in a user terminal connected to an integrated multimedia content provision server for creating integrated multimedia content using single- type multimedia content, comprising the steps of: a) the user terminal requesting and receiving specific integrated multimedia content from the integrated multimedia content provision server; b) parsing and analyzing a file format of the integrated multimedia content, received at step a); c) decrypting initial execution information of the integrated multimedia content, analyzed at step b), and then outputting an initial execution command; d) decrypting a user's rights to the integrated multimedia content and protection information of the integrated multimedia content in compliance with the initial execution command, and assigning rights to the initial execution command; e) decoding content depending on the initial execution command, and the content rights and protection information; and f) rendering the content, decoded at step e), to the user terminal in compliance with the initial execution command.