MXPA00003573A - System for formatting and processing multimedia program data and program guide information - Google Patents

Abstract

A program specific information data structure facilitates communication of program content and program guide data with attached multimedia objects including audio, video, animation, still image, Internet, Email, text and other types of data. The data structure supports uni-directional communication applications, e.g. passive viewing, and bi-directional communication applications, e. g. interactive type functions. A decoder (100) processes packetized program data and program specific information containing ancillary description information including multimedia object type, location and other descriptive indicators. These indicators are used in acquiring (22, 60), and decoding (30, 37, 60) multimedia objects derived from different sources for presentation (45, 50) in composite video images representing video program content or program guides, for example. Additional ancillary location and acquisition description information enables acquisition of supplementary program specific information elements and program content data.

Description

SYSTEM FOR FORMATTING AND PROCESSING MULTIMEDIA PROGRAM DATA AND PROGRAM GUIDE INFORMATION Field of the Invention This invention relates to the field of digital signal processing, and more particularly to the acquisition, training and processing of multimedia program guides and program content information.

BACKGROUND OF THE INVENTION Home entertainment systems that combine functions of the Personal Computer and television (PC / TV systems), are becoming increasingly generic, interactive user, multiple sources and multiple destinations. It is required that these multimedia systems communicate in different data formats between multiple locations, for a variety of applications, in response to the requests of the User. For example, a PC / TV system can receive data from satellite or terrestrial sources that include High Definition Television (HDTV) broadcasts, Multi-Point Microwave Distribution System (MMDS) broadcasts, and Digital Video Broadcasts (DVB). . A PC / TV system can also receive and transmit data via the telephone (for example, the Internet) and coaxial lines (for example, cable TV), and from both remote and local sources, such as Digital Video Disc (DVD) ), CDROM, VHS type and VHS Digital (DVHS1 ^) players, PCs, and many other types of sources. The formation and processing of program guide data containing the content of programs from numerous sources for multimedia applications presents many problems for that generic PC / TV entertainment system. For example, that system might be required to process multimedia content, including audio clips, video clips, animation, still images, text and other types of data encoded in different data formats. Specifically, difficulties arise when structuring program content and program guide data to facilitate the acquisition and decoding of multimedia content of different data formats and from different sources. These problems and related problems are addressed by a system in accordance with the present invention.

Compendium of the Invention A program-specific information data structure facilitates the communication of program content and program guide information, with accompanying multimedia data including audio, video, animation, still images, Internet, email, text and other types of data. The data structure supports unidirectional communication applications, for example, passive and bidirectional communication applications, for example, interactive type functions. A decoder processes the data of packaged programs that contain subordinate description information that includes the multimedia object type, the location and other descriptive indicators. These indicators are used to acquire, and decode multimedia objects derived from different sources, for presentation in composite video images that represent the content of video programs or program guides, for example. The description information of location and additional subordinate acquisition allows the acquisition of specific information elements of complementary programs and data of the content of programs. In the drawings: Figure 1 shows an exemplary hierarchical program guide data structure for transporting multimedia object data, in accordance with the invention. Figure 2 shows a visual display of exemplary program guide, containing multimedia objects, in accordance with the invention. Figures 3-6 show, respectively, a Master Guide Table (MGT), an Additional Guide Data Table (AGDT), a Channel Information Table (CIT) and a Multimedia Object Descriptor Table (MOD). that are used in the hierarchical data structure of Figure 1, in accordance with the invention. Figure 7 describes the elements of the Multimedia Object Descriptor Table (MOD) of Figure 6, in accordance with the invention. Figures 8 and 9 respectively, list and describe other descriptors that can be incorporated into the specific information of the program, to facilitate the acquisition and decoding of multimedia data, in accordance with the invention. Figures 10, 11 and 12 list the acquisition descriptors for use in acquiring multimedia objects from exemplary locations including Internet locations, digital storage media data flow locations and MPEG PSI stream locations respectively, in accordance with with the invention Figure 13 shows an acquisition descriptor for acquiring program-specific information and multimedia objects from different sources, including MPEG PSI streams and Internet locations, for example, in accordance with the invention. Figure 14 shows an exemplary list of the types of tables that can be used by the acquisition descriptor of Figure 13, in accordance with the invention. Figures 15 and 16 respectively show the location descriptors for use in identifying multimedia content data from different sources, including an MPEG compatible source and a Digital Satellite System (DSS) source, in accordance with the invention. Figure 17 shows a flow chart of a method for forming program-specific information for transporting multimedia objects, in accordance with the invention. Figure 18 shows a home entertainment decoder system for forming and decoding multimedia program data and program guide information, in accordance with the invention.

Detailed Description of the Drawings The program-specific information (PSI) includes program guide data and information to be used to identify and assemble individual data packets, to retrieve the content of selected program channels. The specific information of the program and the content of the associated program is conveniently structured to support the communication of multimedia objects including audio clips, video clips, animation, still images, Internet data, email messages, text and other types of data. Multimedia objects are data entities that can be viewed as independent units, and are associated with images within individual programs, or with program guide components. Multimedia objects are embedded in composite video images that represent a program guide or a video program, for example. The data structure supports unidirectional communication applications, for example, passive and bidirectional communication applications, for example, interactive type functions, and also supports storage applications. Program-specific information and associated program content may be sent through different service providers, through the Internet, or via terrestrial, satellite, or cable transmission on a subscription or other basis. pay per event. The data structure facilitates the acquisition and decoding of multimedia objects encoded in different data formats, and communicated in different communication protocols from both local and remote sources. An exemplary decoder receives the content of the program from satellite, cable and terrestrial sources, including by means of the telephone line from Internet sources, for example. Subsequently, the data referred to as being compatible with MPEG conform to the MPEG2 image coding standard (Groups of Experts in Moving Images), called the "MPEG standard". This standard comprises a system coding section (ISO / IEC 13818-1, June 10, 1994) and a video coding section (ISO / IEC 13818-2, January 20, 1995). The data structure elements according to the principles of the invention can be transported in MPEG compatible format (by section 2.4.4 of the MPEG systems standard), or they can be transported in a format compatible with the Program and System Information Protocol for Terrestrial Broadcast and Cable, published by the Committee on Advanced Television Systems (ATSC), November 10, 1997, which will be referred to hereinafter as the PSIP standard or other ATSC standards. In addition, data structure elements can be formed in accordance with the requirements of the owner or the customer of a particular system. The principles of the invention can be applied to terrestrial, cable, satellite, Internet or computer network broadcasting systems, in which the type of coding or modulation format can be varied. These systems may include, for example, non-MPEG compatible systems, which involve other types of encoded data streams and other methods for conveying program-specific information. In addition, although the system described is described as processing broadcast programs, this is only exemplary. The term "program" is used to represent any form of packaged data such as audio data, telephone messages, computer programs, Internet data or other communications, for example. Figure 1 shows a general view of a data structure of specific information of exemplary hierarchical programs, for transporting data of multimedia objects, in accordance with the invention. The structure comprises multiple tables and multimedia objects that are hierarchically configured and interleaved (Object 1 and Object 2). Tables consist of data and parameter settings that are used to list and describe collections or sequences of TV channels, TV programs, channel parameters, program parameters, associated multimedia objects and object parameters, and so on. The configuration of the exemplary hierarchical table in Figure 1 includes a Master Guide Table (MGT) 205, an Additional Guide Data Table (AGDT) 210, Channel Information Tables (CIT-1, CIT-2, CIT- 3), Event Information Tables (EIT-1, EIT-2), Network Information Table NIT 20, and optional tables such as Extended Channel Information Tables (ECIT-1, ECIT-2, ECIT-3), and Extended Event Information Tables (EEIT-1, EEIT-2). The MGT contains information to be used to acquire program-specific information conveyed in other tables, and specifically, in this exemplary modality, it provides information to be used to acquire the AGDT. The AGDT contains information to determine the structure and division of the table of program-specific information. The CIT contains information for tuning and navigation to receive a program channel selected by the User, the EIT contains descriptive lists of programs (events) that can be received in the channels listed in the CIT. You can use either a CIT, an EIT or another table to transport information, enabling a user to select and tune to a particular program. A CIT is typically used to transport parameters to acquire content data from audiovisual programs that remain constant through many events (TV programs). An EIT is typically used to convey content data parameters of audiovisual programs that remain constant for an event (Individual TV program). The NIT contains lists of parameters for the entire broadcasting network (terrestrial, satellite, cable, etc.). The ECIT and the EEIT are extension tables that accommodate additional information from the CIT and the EIT. Additional program-specific information and complementary items within the hierarchical tables are conveyed inside of the descriptive information elements.

This data structure conveniently enables multimedia objects and table information located in a plurality of different remote or local sources, which is to be acquired in a decoder, and assembled to produce an individual program and program guide for visual display to a user . The data structure incorporates address and protocol information to identify and acquire tables and objects from a variety of sources. The data structure allows objects to be positioned anywhere in a program guide, and to be associated with specific information table elements of individual programs. A decoder uses the address and protocol information and other parameters in the data structure to acquire and format a composite program guide, and programs of tables and derived objects from a plurality of distributed sources. As such, the data structure offers advantages of flexibility and adaptability, and provides a comprehensive mechanism for transporting a multiplicity of distributed multimedia objects, in a manner that facilitates the efficient decoding and reproduction of composite video images and audio segments. Other methods can be used to divide the specific information of the program, to transport the objects of multimedia and can obtain advantages of similar flexibility, adaptability and efficiency, by means of the use of the structuring of the table, and information of definition and acquisition of objects of multimedia, in accordance with the principles of the invention. It is considered that the elements of the data structure presented in Figures 1-16 are optional, and can be used or omitted based on the requirements of a particular system. Figure 2 shows a visual display of exemplary program guides, which can be produced by means of a decoder from the specific information structure of the program, in accordance with the invention. The program guide contains multimedia objects and provides a user interface, which supports email, telephone, fax, Internet browsing, storage, home purchases, home banking (420-433) and other functions. Multimedia objects such as video clips, Internet Web page data or still images can be displayed visually in area 435, in response to the user's selection of a preview icon (for example 447, 449), or a Web page icon (for example, 443). Data and text such as email messages, sports results or stock quotes, etc., are visually displayed in area 439, in response to the user's selection of a result icon (for example, 445), or in response to the user selection of functions 420-433. Similarly, advertisements and animation can be displayed visually in area 437. Figures 3-6 show, respectively, a Master Guide Table (MGT), an Additional Guidance Data Table (AGDT), an Information Table of Channels (CIT) and a Table of Descriptors of Multimedia Objects (MOD) that are used in the hierarchical data structure of Figure 1, in accordance with the invention. Figure 3 shows an MGT that provides pointer information specifically for use to acquire the AGDT. Figures 4 and 5 comprise an exemplary AGDT for transporting information to acquire and assemble the other tables and components of the program-specific information, the AGDT describes the structure and locations of the data divisions used to transport the specific information of the program. Program. A decoder uses the control information in the AGDT to assemble the program-specific information, and to create a program guide for visual display. Although the AGDT is shown as separate Figures for clarity (Figures 4 and 5), the AGDT actually comprises a single table in which the syntax of Figure 5 occupies the element_map_guide_program 415 of Figure 4. The AGDT syntax of the Figure 4 indicates a first level of division of program-specific information and provides: • A global description for the entire guide (eg, descriptor 405). • A definition of network parameter division (for cable, terrestrial, digital broadcast satellite, Internet, for example). One or more pointer descriptors can be inserted on line 405 of Figure 4, to indicate the location of all the program-specific information and / or its table components. Similarly, if the network-based division is used, the location of the network information tables can be indicated by inserting appropriate pointer descriptors on line 410. The table pointer descriptors comprise acquisition descriptors. , as exemplified by means of the syntax structure of Figure 13, which is described later. In addition, multimedia object descriptors (MODs) can be inserted into an AGDT on line 405, to associate external multimedia objects with program-specific information, with program-specific information (or program guide) as a whole , or can be inserted in line 410, to associate external objects with particular network parameter settings. An external multimedia object is an object that is provided by means of a remote or local source, and is not carried within the specific information of the program itself. For example, you can link an ad sponsoring a program guide transported within program-specific information to the guide for visual display, using one or more MODs on line 405. In order to support that function, a MOD conveniently incorporates indications of: «the type of object being described (eg, MIME format of e-mail, Internet HTML, fixed-image JPEG format, video clip MPEG2 format, etc.) • object location (PSI bitstream , FTP site, WWW site, DSM-CC stream, etc.). Figure 6 shows an exemplary MOD syntax structure incorporating a pointer of object type indicators and address location, and is described in more detail later. The AGDT syntax of Figure 5 indicates a second level of division of program-specific information, which can be used to divide the program-specific information by time segments and channel characteristic or group. The divisions by time segments of the program-specific information are defined by a cycle of syntax elements, starting at line 510. The pointer descriptors (location) to locate tables or objects, can be inserted on line 515. In addition , one or more additional pointer descriptors can be inserted in line 505 of Figure 5, to indicate the location of multimedia objects and tables that are valid for all divisions by time segments. The divisions by channel characteristic of the program-specific information are defined by means of a cycle of syntax elements starting at line 520, and on line 525, pointer descriptors (location) can be inserted to locate tables or objects for groups of particular channels. In addition, multimedia object descriptors (MODs) can also be inserted into sections of the AGDT descriptor of Figure 5, to associate external multimedia objects with program-specific information with particular time segments or groups of channels. As stated previously, the AGDT elements can be viewed as optional to make the structure of the data for particular system requirements. For example, in a particular application the syntax described above that enables the division of the program-specific information into different channel groups can be omitted. Figure 6 shows an exemplary multimedia object descriptor (MOD), to be used to define multimedia objects to be incorporated into the content of the visually displayed program, or into a visually displayed program guide, for example. The MOD syntax shown in Figure 6 can be incorporated in a plurality of locations along the structure of the program-specific information, for the purpose of associating multimedia objects with image components or individual data from a guide of programs or program content. The MOD identifies objects associated with components of the program-specific information, using the object type field (line 605), and identifies the location of the object to allow its acquisition using the address descriptor field (line 610). The key elements of the MOD shown in Figure 6 can be conveniently used to convey acquisition information of multimedia objects in a wide variety of data transport structures that can be used to send information about the content of the program or guide. of programs . These transport structures, for example, may include MPEG-PSI, TCP / IP (Internet Transport Protocol / Internet Protocol), DSS (Digital Satellite System), ATM (Asynchronous Transfer Mode), and so on. Figure 7 describes the elements of the Multimedia Object Descriptor (MOD) of Figure 6. Figure 8 (items 805-850) and Figure 9, respectively, list and describe other types of descriptors that can be incorporated into the information program guide, to facilitate acquisition and decoding of multimedia objects, in accordance with the invention. Figures 10, 11 and 12 list the address descriptors for use in acquiring multimedia objects from exemplary locations, including Internet locations, location of digital storage media data streams, and MPEG PSI stream locations, respectively. Any of these address descriptors (or alternately defined address descriptors) may be included within the MOD on line 610 of Figure 6. The descriptor in Figure 10 identifies web-based locations from which the multimedia objects are acquired., using a URL 905 of the Internet. The descriptor of Figure 11 identifies objects in a DSM-CC flow (Digital Storage Medium-Command and Control) from which the multimedia objects are acquired, using a DSM-CC_association_label 910 as a link to a particular object in a carousel DSM-CC. The descriptor in Figure 12 identifies locations of objects in an MPEG-2 PSI stream. Within the descriptor of Figure 12, article 915 identifies a particular network (eg, satellite, cable, or terrestrial), article 920 identifies a particular network transport stream (transport flow id), the article 925 identifies packets within a particular flow, which uses a Package Identifier (PID), and article 930 identifies particular table associations of packets with table identifiers (table_id and table extension_id). Similar descriptors can be derived for other means, in accordance with the principles of the invention, exemplified in Figures 10-12. Figure 13 shows an acquisition descriptor for defining table locations for acquiring program-specific information and multimedia objects from different sources, including MPEG PSI streams and Internet locations, for example. This descriptor can be used throughout the structure of the program-specific information to identify table locations. The acquisition descriptor of Figure 13 can be used on line 405 of the AGDT of Figure 4, to identify tables that are not associated with particular parameters of the program-specific information. Alternatively, the acquisition descriptor of Figure 13 can be used on line 410 of the AGDT of Figure 4 to identify tables associated with particular networks. In addition, the acquisition descriptor of Figure 13 can be used in other portions of the AGDT, such as in time-based divisions of particular channel groups. As an example, the descriptor in Figure 13 incorporates elements to acquire tables of program-specific information from two separate sources. Specifically, (1) articles 960 and 965 enable data acquisition from MPEG-2 PSI streams, and (2) article 970 enables data acquisition from an Internet address, such as from a source compatible with FTP or HTTP . The structure of the descriptor in Figure 13 is flexible and quickly accommodates different additional addressing methods, through the addition of "or if" extra declarations to the descriptor. By adapting or expanding the data structure of Figure 13, to encompass additional addressing elements, article 955 is used to identify the particular table that is defined in the execution cycle of Figure 13, and article 950 determines the number of tables for which the acquisition locations are defined. Figure 14 shows an exemplary list of the types of tables that can be used by the acquisition descriptor of Figure 13, and that can be incorporated into the structure of the program-specific information, in accordance with the principles of the invention. By using the acquisition descriptor of Figure 13 to acquire the tables listed in Figure 14, the values of the item identifier of the desired table listed in Figure 14 are inserted in the item identifier field, on line 955 of the acquisition descriptor of Figure 13. Other tables can also be acquired, divided and incorporated into the structure of the program-specific information, as desired, using the data structuring principles described.

Figures 15 and 16 show examples of a location descriptor to be used when acquiring multimedia audiovisual content data from different sources, using different communication protocols and data formats (as distinct from the descriptor in Figure 14 that is used to acquire information. specific to the program from different sources). The location descriptor exemplified in Figures 15 and 16 can be incorporated into the program-specific information tables, such as within a Channel Information Table (CIT), or within an Event Information Table (EIT), and it is used to identify the audiovisual content data within the input data streams. Specifically, Figure 15 shows an example of a location descriptor to be used to acquire audiovisual data from an MPEG-compatible source, and Figure 16 shows an example of the location descriptor data structure, to be used to acquire audiovisual data from a source of Digital Satellite System (DSS). A plurality of location descriptors can be included in the specific information of the program, in order to acquire audiovisual content data from, (a) multiple sources and types of different media (for example, MPEG, Internet, cable sources), and (b) from different addresses associated with a particular source or media type (for example, from different Internet addresses or channels) of cable TV). In the example of the location descriptor of Figure 15, the audiovisual data compatible with MPEG are identified by means of the PID value. The location descriptor of Figure 15 includes two methods of data acquisition based on the PID value. The two methods are referred to as an implicit method and an explicit method, respectively. The selection between the two methods is determined by means of an implicit 985 flag flag. In the explicit method, the PIDs, for example, the PID 990, are individually listed within a cycle that begins at line 987. In the implicit method, a base PID is defined 993, and other PIDs are derived from the PID base, in accordance with a previously determined definition of the PID, for example, as a function of the channel number of the program and type of flow. This implicit method is known and described, for example, in an ATSC standard. The type of flow associated with a particular PID is defined by means of the element SType [i] in Figures 15 and 16. In the example of location descriptor of the audiovisual data of Figure 16 from a source of Digital Satellite System ( DSS) is identified by means of the SCID value (Service Component Identifier). The location descriptor of Figure 16 includes two methods of data acquisition (an implicit and explicit method) based on the SCID value, in a similar way to the MPEG example in Figure 15. The selection between the two methods is determined by of an implicit 353 flag flag input. In the explicit method, the SCIDs, for example the SCID 355 or 357, are individually listed within a "para" cycle following line 353. In the implicit method a base SCID 360 or 363 is defined, and other SCIDs are derived from the base SCID, in accordance with a SCID definition. previously determined, as mentioned above. In the DSS case, however, the SCID values may have two different sizes. Accordingly, within the structure of the DSS location descriptor an input selection parameter (Z_bit) is used to select among the SCID values. Specifically, in Figure 16 the selection parameter (Z_bit) is used to select between the SCIDs 355 and 357 in the explicit case, and to select between the SCIDs 360 and 363 in the implicit case. The label of descriptor 980 of Figure 15 and the label of descriptor 350 of Figure 16 are used inside of a decoder to identify a type of descriptor, and to automatically differentiate between descriptors. In a decoder, it is determined whether a particular desired channel (and associated program) is transmitted from a particular source (e.g., satellite, terrestrial, cable, or Internet source), and after that the location descriptor is selected satellite, terrestrial, cable, or corresponding Internet to be used. A variety of other location descriptors can be defined in a manner similar to those exemplified in Figures 15 and 16. These other descriptors can be used to acquire digital audiovisual services from sources that include, for example, audio and video in flow through of the Internet, ATM networks, etc. Figure 17 shows a flow diagram of a method for forming program-specific information for transporting multimedia objects, in accordance with the invention. The method in Figure 17 generates program-specific information that includes MGT, AGDT, CIT, ECIT, EIT, EEIT, NIT and ETT data and descriptors that contain the convenient features described above. The method may be employed in an encoder to broadcast video data, or the method may be employed within a decoding unit. After the start in step 250 of Figure 17, in step 253, a method based on the data structuring principles described above is selected to divide program-specific information. The specific information of the program is divided according to the types of networks, time segments, groups of channels, groupings of transport flow channels, and the programs (events) that are being transmitted in particular channels. In step 255, the locations of the table divisions, and the tables and subtables (extended tables) required to accommodate the specific information of the divided program are identified, and the descriptors are formed to identify and acquire the associated multimedia tables and objects. . In step 257 an AGDT (or other type of control table) is generated to include those acquisition descriptors and multimedia objects generated in step 257, which apply to the AGDT level of the structure of the program-specific information. In addition, in step 257 an MGT is generated that contains information to be used to acquire program-specific information conveyed in other tables, and specifically to be used to acquire an AGDT. In step 260, individual tables are formed CIT, ECIT, EIT, EEIT, NIT and ETT that conform to the divided structure. The individual tables incorporate acquisition descriptors, multimedia object descriptors (MODs) and location descriptors derived in accordance with the principles of the invention described previously. A CIT is formed that contains subchannel information and program identification that allows the acquisition of available programs and broadcast channels, which contain packet identifiers to identify individual packaged data flows, which constitute individual programs that will be transmitted on particular channels . The generated CIT also incorporates articles linked to the listed program channels, which include a program number, a PCR identifier (Program Clock Reference), a language code indicator, and a flow type identifier, for example. . In addition, in step 260, an EIT is generated containing program guide information that includes descriptive lists of the programs (events) that can be received in the channels listed in the CIT. In addition, in step 260, an NIT is created and an ETT is generated containing text messages describing programs, for example. Also, extension tables are formed, as necessary to accommodate specific information of the additional divided program. In step 263, the tables formed in step 260 are formatted, together with the associated multimedia objects, to be compatible with a desired data format and protocol. These data formats and protocols include, for example, MPEG2 Compatible Program Specific Information, MPEG2 DSM-CC, DSS, and an Internet-compatible file transfer format. In step 265, the resulting formatted tables and multimedia objects are incorporated into a data stream at their designated locations for terrestrial transmission. The AGDT is incorporated into the data stream in step 267. In step 270, the program-specific information produced in step 267, together with the representative components of the audio and video program (and other data) for multiple channels, it is multiplexed and formatted within a transport flow for output. In step 270, the outgoing transport stream is further processed to be suitable for terrestrial transmission to another device such as a receiver, video server, or storage device for recording in a storage medium, for example. The processes performed in step 270 include known coding functions such as data compression, Reed-Solomon coding, interpolation, demodulation, lattice encoding, and carrier modulation. The process is completed and terminated in step 275. In the process of Figure 17, multiple CITs, EITs, ETTs, and associated extension tables can be formed, and can be incorporated into the specific information of the program, in order to accommodate expanded numbers of channels. In addition, in other modalities tables can be processed in a similar way for satellite, cable or Internet transmission, for example. Figure 18 is a block diagram of a digital video reception system for demodulating and decoding broadcast signals (terrestrial, satellite, cable, or Internet). In terrestrial mode, a modulated carrier with signals carrying audio, video and associated data compatible with MPEG, representative of the program, received by antenna 10, are converted to digital form and processed by means of the input processor 13. The processor 13 includes a radio frequency (RF) tuner and an intermediate frequency (IF) mixer and amplification stages for downwardly converting the input signal to a lower frequency band, suitable for further processing. In this exemplary system, the terrestrial input signal received by antenna 10 contains 33 Physical Transmission Channels (PTCs 0-32). Each Physical Transmission Channel (PTC) is assigned to a bandwidth of 6 MHz, and contains, for example, up to 6 subchannels. It is assumed, for exemplary purposes, that a user of the video receiver selects a sub-channel (SC) to view using the remote control unit 70. The processor 60 uses the selection information that is provided from the remote control unit 70 by means of of the interface 65, to appropriately configure the elements of the decoder 100 to receive the PTC corresponding to the selected SC subchannel. After the downconversion, the output signal from unit 13 for the selected PCT has a bandwidth of 6 MHz, and a center frequency in the range of 119-405 MHz. In the following description, an RF channel or Channel Physical Transmission (PTC) refers to an assigned diffuser transmission channel band, which encompasses one or more subchannels (also called virtual or logical channels). The processor 60 configures the radio frequency (RF) tuner and the intermediate frequency (IF) mixer and the amplification stages of the unit 13, to receive the selected PTC using bidirectional control and the C-signal bus. The unit 15 demodulates the frequency output converted down to the selected PTC. The primary functions of the demodulator 15 are the recovery and the path of the carrier frequency, the recovery of the clock frequency of the transmitted data, and the recovery of the same video data. The unit 15 also retrieves the sampling and synchronization clocks corresponding to the transmitter clocks, and is used to time the operation of the processor 13, the demodulator 15 and the decoder 17. The recovered output of the unit 15 is provided to the decoder 17 The output of the scrambler 15 is mapped into data segments of byte length, deinterleaved and corrected for the Reed-Solomon error, in accordance with the known principles, by means of the unit 17. In addition, the unit 17 provides A validity of Anticipated Error Correction (FEC) or closing indication to processor 60. Reed-Solomon error correction is a known type of Early Error Correction. The FEC closing indication indicates that the Reed-Solomon error correction is synchronized with the data being corrected, and is provided as a valid output. It will be noted that the demodulator and decoder functions implemented by the units 13, 15 and 17 are known individually and are generally described, for example, in the reference text Digi tal Communication, Lee and Messerschmidt (Kluwer Academic Press, Boston, MA, USA, 1988). In the other satellite, cable and Internet modes, the data is received on the input lines 11, 14 and 18, and processed by the interface access modules 74, 78 and 72, respectively. The interface modules 74, 78 and 72 incorporate interface functions for format data by satellite, cable and Internet, respectively. Those functions are known and detailed in the applicable standards and other documents. These interface functions correspond to those performed by units 13, 15 and 17 in terrestrial mode. In addition, in a manner similar to terrestrial mode, the processor 60 configures the units 74, 78, 72 and the decoder 100, to receive data by satellite, cable, or over the Internet, using bidirectional control and the C signal bus. The decoder 100 processes the conditioned data by means of the units 74, 78 or 72 in these other modes, using functions similar to those described for the terrestrial mode. The output data corrected from the unit 17 is processed by means of the transport demultiplexer processor 22 compatible with MPEG. The individual packages that comprise either the content of the particular program channel, or program-specific information, are identified by means of their Package Identifiers.

(PIDs). The processor 22 separates the conformance data with the type based on an analysis of the packet identifiers.

(PIDs) contained within the header information of the packet, and provides synchronization and error indication information that is used in the subsequent decompression of video, audio and data. The corrected output data that is provided to processor 22 is in the form of a transport data stream, containing program channel content, and program-specific information, for many programs distributed across many sub-channels. The program-specific information in this exemplary description describes subchannels present in a transport stream of a particular PTC. However, in another modality, the specific information of the program can also describe subchannels located in other PTCs, and transported in different transport flows. The groups of these subchannels can be associated in the sense that their source is a particular diffuser, or they occupy the transmission bandwidth previously assigned to a broadcast channel compatible with analog NTSC.

In addition, individual packets comprising a selected program channel in the transport stream are identified and assembled by the processor 60, operating in conjunction with the processor 22, using the PIDs contained in the program-specific information. The processor 60 acquires and assembles the program-specific information, operating in conjunction with the unit 22, from the input of the data stream from the unit 17. The processor 60 determines by the closing indication FEC provided by unit 17, which is They are providing valid data to the transport processor 22. After the above, the MGT and AGDT tables of the program specific information are identified, and assembled using previously determined PID values, stored inside the internal memory of the processor 60. Using the Control signal C, the processor 60 configures the transport processor 22 to select the data packets comprising the remaining information specific to the program, including CIT, EIT, ETT and NIT data. The program-specific information tables can be acquired from a plurality of sources, using the information of the acquisition descriptor described previously in connection with Figures 13 and 14. The tables can be acquired by means of the processor 60, initiating communication with different sources (e.g., satellite, cable, or Internet sources), in different data formats and transmission protocols by means of different transmission media, such as by means of satellite feed 11, cable line 14, or telephone line 18. The information of the acquisition descriptor, either alone or as supplemented by other program-specific information, allows the processor 60 to establish communication in different data formats and transmission protocols. This is achieved by using the interface units 72, 74 and 78, to establish either unidirectional communication (eg, for satellite communication), or bidirectional communication (eg, for Internet communication). Processor 22 compares PIDs (or other data identifiers, e.g., TCP / IP identifiers, SCIDs, etc.) of incoming packets provided by unit 17 (or units 72, 74 and 78 for data sources over the Internet, cable or satellite), with the PID values previously loaded in control recorders inside the unit 22, by means of the processor 60. In addition, the processor 60 accesses, analyzes and assembles the program-specific information packets, captured by the processor 22, and stores the specific information of the program inside its internal memory. Further, in response to a SC channel selection command from the remote unit 70, via the interface 65, the processor 60 derives tuning parameters including the carrier frequency of the PTC, demodulation characteristics, and sub-channel PIDs, of the specific information of the acquired program that includes descriptors of location, acquisition and MOD. The processor 60 uses this information to configure the units 13, 15, 17 and the elements of the decoder 100 to acquire the program content of the selected sub-channel (SC). The input of the decoded transport stream packaged to the decoder 100 from the unit 17 (or the units 72, 74 or 78) contains video, audio and data that represent TV programs, for example, and also contains sub-image data. The sub-image data contains picture elements associated with programs and channels that a user can select to view even, multimedia objects, program guides, visual display commands, subtitles, selectable menu options or other items, for example . As such, the sub-image data includes multimedia objects acquired using MODs and an EIT that contains descriptive lists of programs (events) that can be received in the sub-channels listed in a CIT, and also contains an ETT that contains text messages that describe programs and sub-channels of programs. The processor acquires the video, audio, data and sub-image data that is transmitted on the terrestrial SC sub-channel, together with associated data from satellite, cable or Internet sources from units 74, 78 and 72, respectively. which operates in conjunction with unit 22. This is continued using the specific information of the collated program that includes location descriptors and MOD. The processor 60 identifies the video, audio, data and sub-image data using the respective PIDs (or other identifiers) determined from the CIT and the descriptors. The processor 60 also initiates communication with other data sources (e.g., cable, satellite or Internet sources), in order to acquire the video, audio, data and sub-image data from these sources. Processor 60 and unit 22 initiate communication, and identify and capture video, audio, data and sub-image data from other sources, using location descriptor information of the type previously described, in connection with Figures 15 and 16. Similarly, processor 60 and unit 22 initiate communication and identify and capture multimedia objects from other sources, using MOD information of the type previously described, in connection with Figures 6-12. The location descriptor and the MOD information, either alone or as supplemented by other program-specific information, allow the processor 60 to establish communication in different data formats and transmission protocols. As previously explained, this is achieved by using the interface units 72, 74 and 78 to establish either unidirectional communication (eg, in satellite communication mode), or bidirectional communication (eg, in communication mode). cable or Internet). The processor 22 compares the PIDs (or other identifiers) of incoming packets provided by the decoder 17 and the interface units 72, 74 and 78 with the values of the video, audio, and sub-image data that is transmitted on the SC sub-channel. , and which are also introduced via communication lines 11, 14 and 18. In this way, the processor 22 captures packets that constitute the program transmitted on the SC sub-channel and associated data and multimedia objects (for example, advertisements, data from Web pages, interactive icons, etc.). The processor 22 forms these packets in video, audio, and sub-image streams compatible with MPEG, for output to the video decoder 25, the audio decoder 35 and the sub-image processor 30, respectively. The video and audio streams contain compressed video and audio data, which represent the content of the selected SC subchannel program. The sub-image data contains multimedia objects and EIT and ETT information, associated with the SC sub-channel program content and program guide information. The decoder 25 decodes and decompresses the MPEG-compatible packaged video data of the unit 22, and provides pixel data (picture elements) representative of the program uncompressed to the NTSC 45 encoder, by means of the multiplexer 40. Similarly, the processor audio 35 decodes the packaged audio data of the unit 22, and provides decoded and amplified audio data, synchronized with the associated decompressed video data, to the device 55 for audio playback. The processor 30 decodes and decompresses the sub-image data including the multimedia objects received from the unit 22, to provide data of multimedia objects, text, subtitle and graphics representative of the image. When decoding multimedia objects, the processor 30 applies a certain decoding function using the associated MOD information elements, exemplified in Figures 6 and 7. The processor 30 (Figure 18) assembles and formats the data of multimedia objects, text, subtitle and decoded graphics and decompressed, for output to the Visual Display Deployment (OSD) generator and graphics 37. When formatting the decoded multimedia objects, the processor 30 (in conjunction with the unit 37), under the address of the unit 60, determines how, in where, and when the individual objects of the MOD information (or equivalent elements) are to be displayed visually, such as format_object, mode_timeout, time_start object, time_object, object_mark_ size, as shown in Figures 6 and 7, for example . It is also possible to link an individual object to another program or program guide images, by means of the processor 30, using link descriptors and attributes, for example (items 825 and 840 of Figures 8 and 9). Alternatively, other descriptors and descriptor elements that perform a similar link function may be employed. A multimedia object can also be linked to subchannels, program images, scenes or program guide pages or particular Web pages, for example, by incorporating information from the MOD descriptor into an EIT or CIT or another table. In this method, an object is directly linked to an image of the program (or sub-channel, scene, or program guide or Web page image), by associating it with the descriptive elements of the program inside the EIT or CIT. The unit 37 of Figure 18 interprets and formats the multimedia objects and other data of the unit 30, using the link, and formatting the information (as described in connection with the above processor 30) of Figures 6 and 8, as it is complemented by CIT and EIT information, and generates text and graphics mapped with formatted pixels, for presentation in unit 50 (Figure 18). Text data and graphics mapped from formatted pixels may represent multimedia objects or a program guide or other type of menu or user interface for subsequent visual display in unit 50. Unit 37 also processes information EIT, ETT and other information. information to generate visual displays of representation menu, subtitling, control and information of mapped data of pixels, which include menu options that can be selected, and other articles, for presentation in unit 50. The visual displays of control and information allow the selection of functions and the input of operative parameters of the device for the operation of the user of the decoder 100. The text and the graphics produced by means of the OSD generator 37 are generated in the form of superimposed pixel map data, under the direction of the processor 60. The superimposed pixel map data of unit 37 are combined and synchronized with the decompressed pixel representative data of the MPEG decoder 25 in the encoder 45, by means of the multiplexer 40, under the direction of the processor 60. By means of the same multimedia objects such as advertisements, web page data, icons can be included interactive, etc., in the content of the program or the program guides for visual display. The NTSC 45 encoder encodes the combined pixel map data representing a video program, and the associated multimedia objects, together with the associated sub-image text message data, and the device 50 is output for visual display. In a storage mode of the system of Figure 18, the output data corrected from the unit 17 is processed by the decoder 100 to provide a data stream compatible with MPEG for storage. In this mode, a user selects a program for storage by means of the remote unit 70 and the interface 65. The processor 22, in conjunction with the processor 60 forms specific information of the condensed program which includes MGT, AGDT, CIT, EIT and ETT data, and location, acquisition and multimedia objects descriptors, which contain the convenient features previously described. The condensed program specific information supports the decoding of the selected program for storage, but excludes unrelated information. The processor 60, in conjunction with the processor 22 forms a data stream compatible with composite MPEG, which contains packaged content data of the selected program, and information specific to the associated condensed program. The composite data stream is taken to the storage interface 95. The storage interface 95 enters the data stream in the buffer zone to reduce intermediate spaces and the variation of the bit rate in the data. The data entered in the resulting buffer zone is processed by means of the storage device 90, so that it is suitable for storage in the medium 105. The storage device 90 encodes the data stream introduced in the buffer zone from the interface 95. , using known error coding techniques, such as channel coding, interpolation and Reed-Solomon coding, to produce a coded data stream, suitable for storage. The unit 90 stores the resulting coded data stream, incorporating the program-specific information condensed in the medium 105. The architecture of Figure 18 is not exclusive. Other architectures may be derived in accordance with the principles of the invention, to achieve the same objectives. In addition, the functions of the decoder elements 100 of Figure 18, and the process steps of Figure 17 can be implemented in whole or in part within the programmed instructions of a microprocessor. In addition, the principles of the invention apply to any form of electronic program guide compatible with MPEG or non-MPEG. A data stream formed in accordance with the principles of the invention can be used in a variety of applications, including video server or PC type communication via telephone lines, for example. A stream of program data may be recorded with one or more video, audio and data components formed to incorporate program-specific information, in accordance with the principles of the invention, into a storage medium, and may be transmitted or re-transmitted. spread to other servers, PCs or recipients.

Claims (48)

1. An apparatus for decoding packaged program information from a first source, for providing the data content of a program, comprising: an element for identifying (22, 60) subordinate information in the packaged program information, the subordinate information including information that discloses a multimedia object associated with an image in the packaged program information, the multimedia object description information comprising: (a) a location indicator (610) that identifies a location of a multimedia object to be used to acquire the multimedia object. multimedia object, and (b) a type indicator (605) that identifies a type of multimedia object to be used to decode the multimedia object; and an element for acquiring and decoding (22, 30, 60) the multimedia object, using the description information of the multimedia object; and an element for formatting (30, 37, 60) the multimedia object for visual display. The apparatus, according to claim 1, wherein the location indicator identifies a location of said multimedia object in one of (a) the program information packaged from the first source, and (b) the information derived from a second source different from the first source. The apparatus, according to claim 2, wherein the location indicator identifies a location of the multimedia object derived from the first source, using one of (a) a packet identifier (PID) compatible with MPEG, (b) a Media code of Digital storage compatible with MPEG. The apparatus, according to claim 2, wherein the location indicator identifies a location of the multimedia object derived from the second source, using one of (a) an Internet URL, (b) an IP address Internet, (c) an email address, (d) a telephone / fax / videophone number. 5. The device, in accordance with the claim 4, wherein the element for acquiring the multimedia object includes the establishment of bidirectional communication, with the second source using the location indicator, and the bidirectional communication path is different from the communication path between the decoder apparatus and the first source . The apparatus, according to claim 1, wherein the multimedia object type comprises at least one of, (a) a video segment or still image, (b) an audio segment, (c) text, (d) an Internet Web page or Internet data, (e) an advertisement, (f) an icon for the selection of the user of a service, (g) an animation segment, (h) an email message, (i) a user command indication indicator, and (j) a broadcast channel identification icon. The apparatus, according to claim 1, wherein the multimedia object description information also includes at least one of, (a) an object start time, (b) a duration of the object, (c) a visual display mode of the object, (d) a version number of the object, (e) an object format, to be used in decoding. The apparatus, according to claim 1, wherein the formatting element includes an element for associating the multimedia object with one of (a) a video image, and (b) audio data, and the formatting element forms a composite image for visual display, combining the multimedia object and at least one of, (a) an electronic program guide, (b) a video program, and (c) an Internet Web page image. The apparatus, according to claim 1, wherein the subordinate information comprises program-specific information for transporting an electronic program guide from the first source, and wherein the multimedia object is associated with the electronic program guide. 10. A storage medium containing digital data representing video information comprising: packaged program information representing a video program; and subordinate information (205, 210, 215, 22) which includes information describing a multimedia object associated with an image in the packaged program information, description information of the multimedia object comprising: (a) a location indicator ( 610) identifying a location of said multimedia object to be used to acquire the multimedia object, and (b) a type indicator (605) that identifies a type of multimedia object to be used to decode the multimedia object; and information (215; 825; 840) for associating the multimedia object with an image in the packaged program information. 11. A storage medium, according to claim 10, wherein the subordinate information comprises information specific to that contained in an electronic program guide, and wherein the multimedia object is associated with the electronic program guide. 1

2. A method for forming program guide information into a first suitable source for decoding packaged program information, to provide the data content of a program, comprising the steps of: forming the information describing a multimedia object associated with an image in the packaged program information, the multimedia object description information comprising: (a) a location indicator that identifies a location of a multimedia object to be used to acquire the multimedia object, and (b) an indicator of type that identifies a type of multimedia object to be used to decode the multimedia object; and forming link information that associates the multimedia object with an image in the packaged program information; and incorporating the multimedia object description information and the link information into packaged data for output to a transmission channel. 1

3. One method, in accordance with the claim 12, wherein the location indicator identifies a location of the multimedia object in one of (a) the program information packaged from the first source, and (b) the information derived from a second source different from the first source. 1

4. One method, in accordance with the claim 13, wherein said location indicator identifies a location of the multimedia object of the first source, using one of (a) an MPEG-compatible packet identifier (PID), (b) a code of Digital Storage Media compatible with MPEG. . 1

5. A method, according to claim 13, wherein the location indicator identifies a location of the multimedia object derived from the second source, using one of (a) an Internet URL, (b) an IP address Internet, (c) an email address, (d) a telephone / fax / videophone number. 1

6. A method, according to claim 15, wherein the multimedia object type comprises at least one of, (a) a video segment or still image, (b) an audio segment, (c) text, (d) an Internet Web page or Internet data, (e) an advertisement, (f) an icon for the selection of the user of a service, (g) an animation segment, (h) an email message, (i) a user command indication indicator, and (j) a broadcast channel identification icon. 1

7. A method, according to claim 12, wherein the multimedia object description information also includes at least one of, (a) an object start time, (b) a duration of the object, (c) a visual display mode of the object, (d) a version number of the object, (e) an object format, to be used in decoding. 1

8. A method, according to claim 12, wherein the link information associates the multimedia object with at least one of, (a) an electronic program guide, (b) a video program, (c) a audio program and (d) an Internet Web page image. 1

9. A method for encoding packaged program information to provide the data content of a program, comprising the steps of: identifying the subordinate information in the packaged program information, the subordinate information including information describing an associated multimedia object with an image in the packaged program information, the description information of the multimedia object comprising: (a) a location indicator that identifies a location of a multimedia object to be used to acquire the multimedia object, and (b) a type indicator that identifies a type of multimedia object to be used to decode the multimedia object; and acquiring and decoding said multimedia object using the description information of the multimedia object; and format the multimedia object for visual display. 20. A method, according to claim 19, including the step of associating the multimedia object with one of (a) a video image, and (b) audio data. 21. A method, according to claim 19, which includes the step of forming a composite image for visual display, combining the multimedia object and at least one of, (a) an electronic program guide, (b) a program of video, and (c) an Internet Web page image. 22. An apparatus for decoding the program information packaged from a first source to provide the data content of a program, comprising: an element for identifying the subordinate information in the packaged program information, the subordinate information including the description of a method associated with a multimedia object in the packaged program information, the description information of the method comprising: (a) information that allows the identification of a method and (b) information to initiate the activation of the method after a previously determined event; and in element for acquiring and decoding the method, using the description information of the method; and an element to initiate the activation of the method after the previously determined event, which uses the description information of the method. 23. The apparatus, in accordance with the claim 22, wherein the method comprises software to perform at least one of the following functions, (a) altering the visual display controls of the user interface, (b) generating an image window within a comprehensive image, (c) generate an HTML or SGML document, (d) generate a menu of articles that can be selected, (e) generate an icon that represents an item that the user can select for visual display, (f) generate an image window to initiate access to the Internet, (g) generate an image window that supports an electronic business transaction, and (h) dial a telephone number. 24. The apparatus, in accordance with the claim 23, wherein the alteration of the visual display controls of the user interface comprises modifying at least one of (a) response characteristics of keyboard / mouse buttons, (d) characteristics of the visual display video, and (c) audio features. The apparatus, according to claim 22, wherein the method comprises software for at least one of, (a) providing descriptive text for said image object; and (b) providing at least one control article that the user can select, associated with the image object. The apparatus, according to claim 22, wherein the information for initiating the activation of the method after a previously determined event comprises information for at least one of, (a) activating the method in response to the user's selection of a command or article of the menu displayed visually, (b) activate the method in response to a planned event, (c) activate the method in sequence after the completion of a particular function, and (d) activate the method substantially immediately after that the method is processed, and is ready for activation. 27. The apparatus, according to claim 26, wherein the information to initiate the activation of the method, after a planned event comprises a start time indication. The apparatus, according to claim 27, wherein the indication of the start time is associated with a specific video program, and is derived from the electronic program guide information. 29. The apparatus, according to claim 27, wherein the information to initiate the activation of the method also includes a duration. 30. The apparatus, according to claim 22, wherein the subordinate information includes electronic program guide information of the first source. 31. The apparatus, in accordance with the claim 27, wherein the subordinate information also includes information for acquiring the method from the first source, comprising, a data identifier for identifying a location of the method conveyed within the program information packaged from the first source. The apparatus, according to claim 22, wherein the subordinate information also includes the acquisition information to be used to acquire the method from a second source, different from the first source, and the acquisition information includes one of (a) ) a Internet URL, (b) an Internet IP address, (c) an email address, and (d) a telephone / fax / videophone number. The apparatus, according to claim 32, wherein the item for acquiring the method includes establishing bidirectional communication with the second source, using the acquisition information, and the bidirectional communication path is different from the communication path between the decoder apparatus and the first source. 34. The apparatus, in accordance with the claim 22, which includes a formatting element to form a composite image for visual display, combining an image produced using the method and at least one of, (a) an electronic program guide, (b) a video program, and (c) an Internet Web page image. 35. A storage medium containing digital data representing video information, comprising: packaged program information representing a video program; and subordinate information including information describing a method associated with a multimedia object in the packaged program information, method description information comprising, (a) information that allows the identification of a method, and (b) information to initiate the activation of the method after a previously determined event; and information to associate the method with a multimedia object in the packaged program information. 36. A storage medium, according to claim 35, wherein the subordinate information includes electronic program guide information, and wherein the method is associated with the electronic program guide. 37. A method for forming program guide information in a first source, suitable for decoding packaged program information, to provide the data content of a program, comprising the steps of: forming the information describing a method associated with one or more images in the packaged program information, method description information comprising, (a) information that allows the identification of a method and (b) information to initiate the activation of the method after a previously determined event; and forming link information that associates the method with an image in the packaged program information; and incorporating the method description information and the link information into packaged data for output to a transmission channel. 38. One method, in accordance with the claim 37, wherein the identification information of the method identifies a location of the method in the program information packaged from the first source. 39. A method, in accordance with the claim 37, wherein the method description information includes data to acquire the method from a second source different from the first source, using one of (a) an Internet URL, (b) an Internet IP address, (c) a email address, (d) a telephone / fax / videophone number. 40. A method, according to claim 37, wherein the link information associates the method with at least one of, (a) an electronic program guide, (b) a video program, (c) a program of audio and (d) an Internet Web page image. 41. A method for processing packaged program information to provide the data content of a program, comprising the steps of: identifying the subordinate information in the packaged program information, said subordinate information including information describing a method associated with a or more images in the packaged program information, method description information comprising: (a) information that allows the identification of a method and (b) information to initiate the activation of the method after a previously determined event; and acquiring and decoding the method, using the description information of the method; and initiate the activation of the method after the previously determined event, which uses the description information of the method. 42. A method, according to claim 41, wherein the acquisition step comprises acquiring the method from a second source different from the first source, using one of (a) an Internet URL, (b) an IP address of Internet, (c) an email address, and (d) a telephone / fax / videophone number. 43. A method, according to claim 41, wherein the activation initiation step comprises initiating the activation of the method by means of at least one of (a) activating the method in response to user selection of a command or menu item displayed visually, (b) activate the method in response to a planned event, (c) activate the method in sequence after completion of a particular function, and (d) activate the method substantially immediately after it is process the method, and it is ready for activation. 44. A method for processing packaged program information, from a first source, to provide the data content of a program, comprising the steps of: identifying the subordinate information in the packaged program information, said subordinate information including, (a ) a first identifier for identifying a location of data representing a multimedia object, and (b) a second identifier for identifying a location of data representing program guide information, and (c) a third identifier for identifying a location of information. data representing a video program in the packaged program information, and acquiring and decoding the multimedia object, the program guide information and the video program data using the subordinate information; and format the acquired data for visual display. 45. A method, according to claim 44, wherein the subordinate information also includes (d) a fourth identifier to identify a location of data representing a method. 46. A method, according to claim 44, wherein the first, second, and third identifiers identify a location of the multimedia object in either one of (a) said package information of the first source, and (b) ) the information derived from a second source different from the first source. 47. A method, according to claim 46, where the information is derived from the second source different from the first source, using one of (a) an Internet URL, (b) an Internet IP address, (c) an email address, and ( d) a telephone / fax / videophone number. 48. A method, according to claim 44, wherein the step of formatting includes the steps of associating the multimedia object with one of (a) a video image, and (b) audio data, and forming an image composed for visual display, combining the multimedia object and at least one of, (a) an electronic program guide, (b) a video program, and (c) an Internet Web page image.