CA2481000A1 - Method and apparatus for displaying graphics on an auxiliary display device using low level graphics drivers - Google Patents
Method and apparatus for displaying graphics on an auxiliary display device using low level graphics drivers Download PDFInfo
- Publication number
- CA2481000A1 CA2481000A1 CA002481000A CA2481000A CA2481000A1 CA 2481000 A1 CA2481000 A1 CA 2481000A1 CA 002481000 A CA002481000 A CA 002481000A CA 2481000 A CA2481000 A CA 2481000A CA 2481000 A1 CA2481000 A1 CA 2481000A1
- Authority
- CA
- Canada
- Prior art keywords
- display device
- auxiliary display
- graphics
- stb
- driver calls
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title claims abstract description 19
- 230000004044 response Effects 0.000 claims abstract description 6
- 230000005540 biological transmission Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 7
- 239000008186 active pharmaceutical agent Substances 0.000 description 6
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000006870 function Effects 0.000 description 2
- 238000004519 manufacturing process Methods 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000000153 supplemental effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/10—Adaptations for transmission by electrical cable
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
- H04N21/41265—The peripheral being portable, e.g. PDAs or mobile phones having a remote control device for bidirectional communication between the remote control device and client device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4431—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB characterized by the use of Application Program Interface [API] libraries
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/8146—Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/16—Analogue secrecy systems; Analogue subscription systems
- H04N7/162—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing
- H04N7/163—Authorising the user terminal, e.g. by paying; Registering the use of a subscription channel, e.g. billing by receiver means only
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Security & Cryptography (AREA)
- Library & Information Science (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Controls And Circuits For Display Device (AREA)
- User Interface Of Digital Computer (AREA)
- Details Of Television Systems (AREA)
- Selective Calling Equipment (AREA)
Abstract
A method and system for processing and displaying graphics in a communications system (e.g., CATV system) (200). The system (200) includes an auxiliary display device (210) and a set-top box (STB) (205). The STB (205) transmits graphical data to the auxiliary display device (210) over a wireless communications medium (245). The graphical data includes abstracted graphic driver calls. The driver calls are processed in the auxiliary display device (210) using graphic drivers residing in the auxiliary display device (210).
Graphics are displayed on a display (235) in the auxiliary display device (210), based on the processed driver calls. User inputs are transmitted from the auxiliary display device (210) to the STB (205) over the wireless communications medium (245). The user inputs are responses to selections presented by the graphics on the display (235) of the auxiliary display device (210).
Graphics are displayed on a display (235) in the auxiliary display device (210), based on the processed driver calls. User inputs are transmitted from the auxiliary display device (210) to the STB (205) over the wireless communications medium (245). The user inputs are responses to selections presented by the graphics on the display (235) of the auxiliary display device (210).
Description
TITLE OF THE INVENTION
METHOD AND APPARATUS FOR DISPLAYING GRAPHICS ON AN AUXILIARY
DISPLAY DEVICE USING LOW LEVEL GRAPHICS DRIVERS
BACKGROUND OF THE INVENTION
FIELD OF THE INVENTION
[0001] The present invention generally relates to the transmission of interactive graphics for viewing and interacting with applications running on a processor of a remote device.
BACKGROUND INFORMATION
METHOD AND APPARATUS FOR DISPLAYING GRAPHICS ON AN AUXILIARY
DISPLAY DEVICE USING LOW LEVEL GRAPHICS DRIVERS
BACKGROUND OF THE INVENTION
FIELD OF THE INVENTION
[0001] The present invention generally relates to the transmission of interactive graphics for viewing and interacting with applications running on a processor of a remote device.
BACKGROUND INFORMATION
[0002] A new era in TV viewing experience is emerging in which video complementary data services are available to the TV viewer using a second display screen on an auxiliary display device. One example of an auxiliary display device is a webpad, which is a relatively small remote wireless device.
[0003] FIG. 1 shows a conventional two-screen digital cable TV system 100. The system 100 includes an auxiliary display device 105 which communicates with a digital set-top box (STB) 110 (also referred to as a "local device") using a wireless connection.
The wireless connection utilizes an external port 115 on the STB 110, such as a Universal serial bus (IISB), Ethernet, or IEEE 1394 port equipped with an access point 120 that communicates with the auxiliary display device 105 over a wireless radio frequency (RF) link 125.
The access point 120 in this scenario is a device designed for a specific interface (e.g., USB) and is used to support wireless connectivity. The auxiliary display device 105 may also be connected directly to a high-speed cable modem, digital subscriber (DSL) modem or any other high-speed Internet connection device to access the Internet 135. TV video programming 140 is accessible via STB
110. Typical wireless connection protocols that may be used by TV system 100 include, but are not limited to, HomeRF~ and IEEE 802.11. A more traditional wired connection simply includes a cable or wire between the STB 110 and the auxiliary display device 105, again using a USB, Ethernet, or IEEE 1394 port. The STB 110 is also connected to a television 130.
The wireless connection utilizes an external port 115 on the STB 110, such as a Universal serial bus (IISB), Ethernet, or IEEE 1394 port equipped with an access point 120 that communicates with the auxiliary display device 105 over a wireless radio frequency (RF) link 125.
The access point 120 in this scenario is a device designed for a specific interface (e.g., USB) and is used to support wireless connectivity. The auxiliary display device 105 may also be connected directly to a high-speed cable modem, digital subscriber (DSL) modem or any other high-speed Internet connection device to access the Internet 135. TV video programming 140 is accessible via STB
110. Typical wireless connection protocols that may be used by TV system 100 include, but are not limited to, HomeRF~ and IEEE 802.11. A more traditional wired connection simply includes a cable or wire between the STB 110 and the auxiliary display device 105, again using a USB, Ethernet, or IEEE 1394 port. The STB 110 is also connected to a television 130.
[0004] The two-screen digital cable TV system 100 allows for many enhanced capabilities over a one-screen system. For example, a user can view Internet data on the screen of the auxiliary display device 105, while watching video uninterrupted on the television 130. In another example, STB applications that are normally viewed on the television screen, are viewed on the screen of the auxiliary display device 105, leaving the television 130 available for video program viewing.
[0005] In a CATV system, an electronic program guide (EPG) is a specific example of an application that can be interacted with through an application running on a second screen device, such as auxiliary display device 105. An EPG is used by a viewer to determine what programs are available for viewing on a television, at what time the programs will be broadcast, and on which channels. More sophisticated EPGs display supplemental information used by the viewer to determine whether the program is suitable for young children, what actors are in the program, how long the program is, and what the program is about. Normally in an EPG, an individual windowed portion is allocated for each program displayed. Viewers of CATV
1 S programs use a GUI to navigate an EPG and select program windows in the EPG that are of particular interest.
1 S programs use a GUI to navigate an EPG and select program windows in the EPG that are of particular interest.
[0006] It is desirable to define a distributed process for a CATV STB
application to send abstracted graphic driver calls to a low cost auxiliary display device, upon which the graphics is rendered, and to facilitate remote control feedback from the auxiliary display device to the STB.
Unlike processes incorporated into more complex personal computers, the transmission of the abstracted graphic driver calls relieves the STB of the burden of supporting application data traffic, and minimizes the processing and memory requirements of the auxiliary display device.
SUMMARY OF THE INVENTION
application to send abstracted graphic driver calls to a low cost auxiliary display device, upon which the graphics is rendered, and to facilitate remote control feedback from the auxiliary display device to the STB.
Unlike processes incorporated into more complex personal computers, the transmission of the abstracted graphic driver calls relieves the STB of the burden of supporting application data traffic, and minimizes the processing and memory requirements of the auxiliary display device.
SUMMARY OF THE INVENTION
[0007] The present invention enables graphics information to be sent to an auxiliary display device for display in a communications system including an auxiliary display device and a set-top box (STB).
[0008] The STB transmits graphical data to the auxiliary display. The graphical data includes abstracted graphics driver calls. The driver calls are processed in the auxiliary display device using graphic drivers residing in the auxiliary display device.
Graphics are displayed on a display in the auxiliary display device, based on the processed driver calls.
_2_
Graphics are displayed on a display in the auxiliary display device, based on the processed driver calls.
_2_
[0009] User inputs may be transmitted from the auxiliary display device to the STB. The user inputs are responses to selections presented by the graphics on the display of the auxiliary display device. A wireless local area network (WLAN) protocol andlor infrared transmission may be used to transmit the user inputs. The abstracted graphics driver calls may be packaged S in a wireless local area network (WLAN) protocol. The abstracted graphics driver calls may be low level graphics driver calls. The displayed graphics may include a television program grid of an electronic program guide (EPG). The communications system may be a cable television (CATV) system.
[0010] The STB may include a local graphics application running at least one application program interface (API) layer, at least one driver layer, and at least one hardware layer including a processor.
[0011] The auxiliary display device may include a remote graphics application running at least one application program interface (API) layer, at least one driver layer, and at least one hardware layer including a processor.
BRIEF DESCRIPTION OF THE DRAWINGS
BRIEF DESCRIPTION OF THE DRAWINGS
[0012] The following detailed description of preferred embodiments of the present invention would be better understood when read in conjunction with the appended drawings.
For the purpose of illustrating the present invention, there are shown in the drawings embodiments which are presently preferred. However, the present invention is not limited to the precise arrangements and instrumentalities shown. In the drawings:
For the purpose of illustrating the present invention, there are shown in the drawings embodiments which are presently preferred. However, the present invention is not limited to the precise arrangements and instrumentalities shown. In the drawings:
[0013] FIG. 1 shows a conventional two-screen digital cable TV system;
. [0014] FIG. 2 shows a communications system operating in accordance with the present invention;
[0015] FIG. 3 shows a simplified representation of two-screen API architecture used in accordance with the present invention;
[0016] FIG. 4 shows a simplified representation of a remote control API
architecture used in accordance with the present invention; and (0017] FIG. 5 is a high-level functional flowchart including steps implemented in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0018] Graphics information is transmitted from an STB to an auxiliary display device.
The graphics information does not include pixel representations, which would require high bandwidth and fast processing. Nor does the graphics information include high level application program interface (API) calls.
[0019] In accordance with the present invention, the graphics information includes abstracted graphics call drivers, such as drivers that instruct a display to construct an image (e.g., draw a square, color red, large size at X, Y, Z coordinates). The abstracted graphics driver calls are low level graphics drivers and are packaged in a wireless local area network (WLAN) protocol, such as 802.1 lb. Unlike the high level API, the low level API gives a user complete access to the screen and to input events. Although, this access requires everything that is shown on the screen to be programmed, the memory and processing requirements for the auxiliary display device are drastically reduced.
[0020] In a one-screen environment, an STB typically hosts applications that are capable of rendering graphics to the display device. Applications axe typically provided this ability through an abstraction layer. This abstraction layer, commonly referred to as an Application Program Interface (API) layer, serves to allow the STB ultimate control over what is displayed while also providing applications the ability to communicate with low level drivers, and ultimately with the hardware itself. The single screen API architecture includes an application having an API layer, a driver layer and a hardware layer. The application would typically request control over the graphics drivers and hardware by calling a set of APIs. The application first negotiates control with a control function of the STB and then communicates with a graphics processor and associated components through drivers.
[0021] FIG. 2 shows a communications system (e.g., CATV system) 200 including an STB
205 and an auxiliary display device 210. The STB 205 (i.e., local device) includes a local graphics application 215 that runs on a first processor 220. The local graphics application 215 includes at least one API layer, at least one driver layer, and at least one hardware layer. The auxiliary display device 210 (i.e., remote wireless device, second screen device) includes a remote graphics application 225 that runs on a second processor 230 that communicates with a display 235. The remote graphics application 225 also includes at least one API layer, at least one driver layer, and at least one hardware layer. The STB 205 communicates with a television 240 (i.e., first screen device).
[0022] In a two-screen scenario in accordance with the present invention, the local graphics application 215 communicates with the remote graphics application 225. The STB
communicates abstracted graphics driver calls to the auxiliary display device 210 via wireless communications medium 245, and processes remote control commands received from the auxiliary display device 210. The abstracted graphics driver calls can be low level graphics driver calls.
[0023] FIG. 3 shows a two-screen API architecture supporting the transmission of graphics calls. The STB 205 transmits graphical data including abstracted graphics driver calls over the wireless communications medium 245 to the auxiliary display device 210. The driver calls are passed on to an API layer in the remote graphics application 225 of the auxiliary display device 210. Graphics are displayed on display 235 of the auxiliary display device 210 in accordance with the driver calls received from STB 205. The graphics displayed on display 235 can include a television program grid of an electronic program guide (EPG).
[0024] FIG. 4 shows a two-screen API architecture supporting the transmission of remote control commands. The auxiliary display device 210 transmits remote control commands based on user inputs to the STB 205 over the wireless communications medium 245. The remote control commands are passed to an API layer in the local graphics application 215 of the STB
205. When displayed on the display 235 of the auxiliary display device 210, the remote graphics application 225 can accept user inputs (e.g., via a touch screen or keyboard) in response to the graphics presented. The remote graphics application 225 communicates the user inputs to the local graphics application 215 via the wireless communications medium 245, . and the user inputs are processed by the STB 205. A wireless local area network (WLAN) protocol and/or infrared transmission can be used to transmit the user inputs to the STB 205.
[0025] The abstracted graphics driver calls can be based on proprietary or open standard-based graphics APIs. The graphics APIs are encapsulated in a remote communications message such that the auxiliary display device 210 can process commands with its own specific hardware suite and drivers.
[0026] The abstracted graphics driver calls are suitable for implementing on-screen and interactive display applications, such as an electronic or interactive program guide, web-browsing, email, or the like. Several "open standard" graphics APIs are currently in use throughout the computing industry. Some examples include:
[0027] (1) OpenGL, for example:
[0028] glVertex3f( O.Of, l.Of, O.Of); /l Draws the top of a triangle, [0029] glVertex3f(-l.Of,-l.Of, O.Of); // Draws the bottom left of a triangle, and [0030] glVertex3f( l.Of,-l.Of, O.Ofj; // Draws the bottom right of a triangle;
[0031] (2) Java Abstract Windows Toolbox Graphics APIs, for example:
[0032] drawRect(int x, int y, int width, int height) /l Draws a rectangle;
[0033] (3) DirectX; and [0034] (4) GDI.
[0035] These, or any other open or proprietary graphics APIs, can be used to implement the present invention.
[0036] Instead of being processed in the auxiliary display device 210, the abstracted graphics driver calls are packaged by the STB 205 in at least one communications package, such as one using a WLAN
protocol, which is sent to the auxiliary display device 210. The auxiliary display device 210, in turn, receives and "unwraps" the communications package, and then processes the abstracted graphics driver calls with its own hardware and drivers.
[0037] FIG. 5 shows the steps implemented by a method operating in accordance with the present invention. In step SOS, the STB 205 transmits graphical data to the auxiliary display device 210 over a wireless communications medium 245. The graphical data includes abstracted graphics calls. In step 510, the driver calls are processed in the auxiliary display device 210 using graphic drivers residing in the remote graphics application 225. In step 515, graphics are displayed on display 235 in the auxiliary display device 210, based on the process driver calls. In step 520, user inputs are transmitted from the auxiliary display device 210 to the STB 205 over the wireless communications medium 245. The user inputs are responses to selections presented by the graphics on the display 235 of the auxiliary display device 210.
[0038] The present invention may be implemented with any combination of hardware and software. If implemented as a computer-implemented apparatus, the present invention is implemented using means for performing all of the steps and functions described above.
[0039] The present invention can be included in an article of manufacture (e.g., one or more computer program products) having, for instance, computer useable media. The media has embodied therein, for instance, computer readable program code means for providing and facilitating the mechanisms of the present invention. The article of manufacture can be included as part of a computer system or sold separately.
[0040] It will be appreciated by those skilled in the art that changes could be made to the embodiments described above without departing from the broad inventive concept thereof. It is understood, therefore, that this invention is not limited to the particular embodiments disclosed, but it is intended to cover modifications within the spirit and scope of the present invention as defined by the appended claims.
. [0014] FIG. 2 shows a communications system operating in accordance with the present invention;
[0015] FIG. 3 shows a simplified representation of two-screen API architecture used in accordance with the present invention;
[0016] FIG. 4 shows a simplified representation of a remote control API
architecture used in accordance with the present invention; and (0017] FIG. 5 is a high-level functional flowchart including steps implemented in accordance with the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0018] Graphics information is transmitted from an STB to an auxiliary display device.
The graphics information does not include pixel representations, which would require high bandwidth and fast processing. Nor does the graphics information include high level application program interface (API) calls.
[0019] In accordance with the present invention, the graphics information includes abstracted graphics call drivers, such as drivers that instruct a display to construct an image (e.g., draw a square, color red, large size at X, Y, Z coordinates). The abstracted graphics driver calls are low level graphics drivers and are packaged in a wireless local area network (WLAN) protocol, such as 802.1 lb. Unlike the high level API, the low level API gives a user complete access to the screen and to input events. Although, this access requires everything that is shown on the screen to be programmed, the memory and processing requirements for the auxiliary display device are drastically reduced.
[0020] In a one-screen environment, an STB typically hosts applications that are capable of rendering graphics to the display device. Applications axe typically provided this ability through an abstraction layer. This abstraction layer, commonly referred to as an Application Program Interface (API) layer, serves to allow the STB ultimate control over what is displayed while also providing applications the ability to communicate with low level drivers, and ultimately with the hardware itself. The single screen API architecture includes an application having an API layer, a driver layer and a hardware layer. The application would typically request control over the graphics drivers and hardware by calling a set of APIs. The application first negotiates control with a control function of the STB and then communicates with a graphics processor and associated components through drivers.
[0021] FIG. 2 shows a communications system (e.g., CATV system) 200 including an STB
205 and an auxiliary display device 210. The STB 205 (i.e., local device) includes a local graphics application 215 that runs on a first processor 220. The local graphics application 215 includes at least one API layer, at least one driver layer, and at least one hardware layer. The auxiliary display device 210 (i.e., remote wireless device, second screen device) includes a remote graphics application 225 that runs on a second processor 230 that communicates with a display 235. The remote graphics application 225 also includes at least one API layer, at least one driver layer, and at least one hardware layer. The STB 205 communicates with a television 240 (i.e., first screen device).
[0022] In a two-screen scenario in accordance with the present invention, the local graphics application 215 communicates with the remote graphics application 225. The STB
communicates abstracted graphics driver calls to the auxiliary display device 210 via wireless communications medium 245, and processes remote control commands received from the auxiliary display device 210. The abstracted graphics driver calls can be low level graphics driver calls.
[0023] FIG. 3 shows a two-screen API architecture supporting the transmission of graphics calls. The STB 205 transmits graphical data including abstracted graphics driver calls over the wireless communications medium 245 to the auxiliary display device 210. The driver calls are passed on to an API layer in the remote graphics application 225 of the auxiliary display device 210. Graphics are displayed on display 235 of the auxiliary display device 210 in accordance with the driver calls received from STB 205. The graphics displayed on display 235 can include a television program grid of an electronic program guide (EPG).
[0024] FIG. 4 shows a two-screen API architecture supporting the transmission of remote control commands. The auxiliary display device 210 transmits remote control commands based on user inputs to the STB 205 over the wireless communications medium 245. The remote control commands are passed to an API layer in the local graphics application 215 of the STB
205. When displayed on the display 235 of the auxiliary display device 210, the remote graphics application 225 can accept user inputs (e.g., via a touch screen or keyboard) in response to the graphics presented. The remote graphics application 225 communicates the user inputs to the local graphics application 215 via the wireless communications medium 245, . and the user inputs are processed by the STB 205. A wireless local area network (WLAN) protocol and/or infrared transmission can be used to transmit the user inputs to the STB 205.
[0025] The abstracted graphics driver calls can be based on proprietary or open standard-based graphics APIs. The graphics APIs are encapsulated in a remote communications message such that the auxiliary display device 210 can process commands with its own specific hardware suite and drivers.
[0026] The abstracted graphics driver calls are suitable for implementing on-screen and interactive display applications, such as an electronic or interactive program guide, web-browsing, email, or the like. Several "open standard" graphics APIs are currently in use throughout the computing industry. Some examples include:
[0027] (1) OpenGL, for example:
[0028] glVertex3f( O.Of, l.Of, O.Of); /l Draws the top of a triangle, [0029] glVertex3f(-l.Of,-l.Of, O.Of); // Draws the bottom left of a triangle, and [0030] glVertex3f( l.Of,-l.Of, O.Ofj; // Draws the bottom right of a triangle;
[0031] (2) Java Abstract Windows Toolbox Graphics APIs, for example:
[0032] drawRect(int x, int y, int width, int height) /l Draws a rectangle;
[0033] (3) DirectX; and [0034] (4) GDI.
[0035] These, or any other open or proprietary graphics APIs, can be used to implement the present invention.
[0036] Instead of being processed in the auxiliary display device 210, the abstracted graphics driver calls are packaged by the STB 205 in at least one communications package, such as one using a WLAN
protocol, which is sent to the auxiliary display device 210. The auxiliary display device 210, in turn, receives and "unwraps" the communications package, and then processes the abstracted graphics driver calls with its own hardware and drivers.
[0037] FIG. 5 shows the steps implemented by a method operating in accordance with the present invention. In step SOS, the STB 205 transmits graphical data to the auxiliary display device 210 over a wireless communications medium 245. The graphical data includes abstracted graphics calls. In step 510, the driver calls are processed in the auxiliary display device 210 using graphic drivers residing in the remote graphics application 225. In step 515, graphics are displayed on display 235 in the auxiliary display device 210, based on the process driver calls. In step 520, user inputs are transmitted from the auxiliary display device 210 to the STB 205 over the wireless communications medium 245. The user inputs are responses to selections presented by the graphics on the display 235 of the auxiliary display device 210.
[0038] The present invention may be implemented with any combination of hardware and software. If implemented as a computer-implemented apparatus, the present invention is implemented using means for performing all of the steps and functions described above.
[0039] The present invention can be included in an article of manufacture (e.g., one or more computer program products) having, for instance, computer useable media. The media has embodied therein, for instance, computer readable program code means for providing and facilitating the mechanisms of the present invention. The article of manufacture can be included as part of a computer system or sold separately.
[0040] It will be appreciated by those skilled in the art that changes could be made to the embodiments described above without departing from the broad inventive concept thereof. It is understood, therefore, that this invention is not limited to the particular embodiments disclosed, but it is intended to cover modifications within the spirit and scope of the present invention as defined by the appended claims.
Claims (17)
1. A method of processing and displaying graphics in a communications system, the system including an auxiliary display device and a set-top box (STB), the method comprising:
(a) the STB transmitting graphical data to the auxiliary display device, the graphical data including abstracted graphics driver calls;
(b) processing the driver calls in the auxiliary display device using graphic drivers residing in the auxiliary display device; and (c) displaying graphics on a display in the auxiliary display device, based on the processed driver calls.
(a) the STB transmitting graphical data to the auxiliary display device, the graphical data including abstracted graphics driver calls;
(b) processing the driver calls in the auxiliary display device using graphic drivers residing in the auxiliary display device; and (c) displaying graphics on a display in the auxiliary display device, based on the processed driver calls.
2. The method of claim 1 further comprising:
(d) transmitting user inputs from the auxiliary display device to the STB, wherein the user inputs are responses to selections presented by the graphics on the display of the auxiliary display device.
(d) transmitting user inputs from the auxiliary display device to the STB, wherein the user inputs are responses to selections presented by the graphics on the display of the auxiliary display device.
3. The method of claim 2 wherein the auxiliary display device uses a wireless local area network (WLAN) protocol to transmit the user inputs.
4. The method of claim 2 wherein the auxiliary display device uses infrared transmission to transmit the user inputs.
5. The method of claim 1 wherein step (a) further comprises using a wireless local area network (WLAN) protocol to package the abstracted graphics driver calls.
6. The method of claim 1 wherein the abstracted graphics driver calls are low level graphics driver calls.
7. The method of claim 1 wherein step (c) further comprises displaying a television program grid of an electronic program guide (EPG).
8. A communications system for processing and displaying graphics, comprising:
(a) a set-top box (STB); and (b) an auxiliary display device having a display, wherein:
(i) the STB transmits graphical data to the auxiliary display device, the graphical data including abstracted graphics driver calls;
(ii) the auxiliary display device processes the driver calls using graphic drivers residing in the auxiliary display device; and (iii) graphics are displayed on the display of the auxiliary display device, based on the processed driver calls.
(a) a set-top box (STB); and (b) an auxiliary display device having a display, wherein:
(i) the STB transmits graphical data to the auxiliary display device, the graphical data including abstracted graphics driver calls;
(ii) the auxiliary display device processes the driver calls using graphic drivers residing in the auxiliary display device; and (iii) graphics are displayed on the display of the auxiliary display device, based on the processed driver calls.
9. The system of claim 8 wherein the auxiliary display device transmits user inputs to the STB, the user inputs being responses to selections presented by the graphics on the display of the auxiliary display device.
10. The system of claim 9 wherein the auxiliary display device uses a wireless local area network (WLAN) protocol to transmit the user inputs.
11. The system of claim 9 wherein the auxiliary display device uses infrared transmission to transmit the user inputs.
12. The system of claim 8 wherein the abstracted graphics driver calls are packaged using a wireless local area network (WLAN) protocol.
13. The system of claim 8 wherein the abstracted graphics driver calls are low level graphics driver calls.
14. The system of claim 8 wherein the displayed graphics include a television program grid of an electronic program guide (EPG).
15. The system of claim 8 wherein the communications system is a cable television (CATV) system.
16. The system of claim 8 wherein the STB includes a local graphics application which runs on top of:
(i) at least one application program interface (API) layer;
(ii) at least one driver layer; and (iii) at least one hardware layer including a processor.
(i) at least one application program interface (API) layer;
(ii) at least one driver layer; and (iii) at least one hardware layer including a processor.
17. The system of claim 8 wherein the auxiliary display device includes a remote graphics application which runs on top of:
(i) at least one application program interface (API) layer;
(ii) at least one driver layer; and (iii) at least one hardware layer including a processor.
(i) at least one application program interface (API) layer;
(ii) at least one driver layer; and (iii) at least one hardware layer including a processor.
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11563302A | 2002-04-04 | 2002-04-04 | |
US10/115,633 | 2002-04-04 | ||
PCT/US2003/008124 WO2003085960A1 (en) | 2002-04-04 | 2003-03-14 | Method and apparatus for displaying graphics on an auxiliary display device using low level graphics drivers |
Publications (1)
Publication Number | Publication Date |
---|---|
CA2481000A1 true CA2481000A1 (en) | 2003-10-16 |
Family
ID=28789827
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CA002481000A Abandoned CA2481000A1 (en) | 2002-04-04 | 2003-03-14 | Method and apparatus for displaying graphics on an auxiliary display device using low level graphics drivers |
Country Status (8)
Country | Link |
---|---|
EP (1) | EP1491036A1 (en) |
JP (1) | JP2005522151A (en) |
KR (1) | KR20040111483A (en) |
CN (1) | CN1647500A (en) |
AU (1) | AU2003218214A1 (en) |
CA (1) | CA2481000A1 (en) |
MX (1) | MXPA04009699A (en) |
WO (1) | WO2003085960A1 (en) |
Families Citing this family (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040235520A1 (en) | 2003-05-20 | 2004-11-25 | Cadiz Jonathan Jay | Enhanced telephony computer user interface allowing user interaction and control of a telephone using a personal computer |
US7549154B2 (en) * | 2004-11-23 | 2009-06-16 | Microsoft Corporation | Extensible architecture for auxiliary displays |
US7634780B2 (en) * | 2004-11-23 | 2009-12-15 | Microsoft Corporation | Method and system for exchanging data between computer systems and auxiliary displays |
US8659505B2 (en) * | 2005-08-31 | 2014-02-25 | Mircosoft Corporation | Auxiliary display device driver interface |
CN101802755A (en) * | 2007-09-18 | 2010-08-11 | 汤姆森许可贸易公司 | User interface for set top box |
US20090217170A1 (en) * | 2008-02-27 | 2009-08-27 | Audividi Inc. | System and method for sharing display information |
US9258402B2 (en) | 2009-04-14 | 2016-02-09 | Qualcomm Incorporated | System and method for controlling mobile devices |
EP2661900B1 (en) * | 2011-01-05 | 2020-03-18 | Thomson Licensing | Multi-screen interactions |
GB2491634A (en) * | 2011-06-10 | 2012-12-12 | Ant Software Ltd | Displaying Interactive Content from a Received Video Stream on a Second Screen |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6209132B1 (en) * | 1995-06-15 | 2001-03-27 | Intel Corporation | Host apparatus for simulating two way connectivity for one way data streams |
US6141002A (en) * | 1996-11-12 | 2000-10-31 | Opentv, Inc. | System and method for downloading and rendering glyphs in a set top box |
US6577849B1 (en) * | 1999-02-03 | 2003-06-10 | Motorola, Inc. | Method and apparatus for providing additional information about a broadcast |
GB9906378D0 (en) * | 1999-03-18 | 1999-05-12 | Pace Micro Tech Plc | Infra red modem |
BR0015498A (en) * | 1999-11-12 | 2002-07-23 | Zenith Electronics Corp | Data recovery system to recover data from a digital broadcast signal |
WO2001058151A2 (en) * | 2000-02-04 | 2001-08-09 | Intel Corporation | Displaying enhanced content information on a remote control unit |
-
2003
- 2003-03-14 EP EP03714207A patent/EP1491036A1/en not_active Withdrawn
- 2003-03-14 MX MXPA04009699A patent/MXPA04009699A/en not_active Application Discontinuation
- 2003-03-14 CN CNA038078376A patent/CN1647500A/en active Pending
- 2003-03-14 JP JP2003583017A patent/JP2005522151A/en active Pending
- 2003-03-14 AU AU2003218214A patent/AU2003218214A1/en not_active Abandoned
- 2003-03-14 WO PCT/US2003/008124 patent/WO2003085960A1/en active Application Filing
- 2003-03-14 KR KR10-2004-7015819A patent/KR20040111483A/en not_active Application Discontinuation
- 2003-03-14 CA CA002481000A patent/CA2481000A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
EP1491036A1 (en) | 2004-12-29 |
CN1647500A (en) | 2005-07-27 |
WO2003085960A1 (en) | 2003-10-16 |
KR20040111483A (en) | 2004-12-31 |
AU2003218214A1 (en) | 2003-10-20 |
JP2005522151A (en) | 2005-07-21 |
MXPA04009699A (en) | 2004-12-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP4541476B2 (en) | Multi-image display system and multi-image display method | |
TWI411297B (en) | On screen displays associated with remote video source devices | |
US6020863A (en) | Multi-media processing system with wireless communication to a remote display and method using same | |
US6202211B1 (en) | Method and apparatus for providing television signals to multiple viewing systems on a network | |
US6762798B1 (en) | Methods and apparatus for providing video control for television applications | |
US6259443B1 (en) | Method and apparatus for enabling multiple users to concurrently access a remote server using set-top boxes | |
US6108042A (en) | Method and system for configuring a display | |
US6097441A (en) | System for dual-display interaction with integrated television and internet content | |
JP4672856B2 (en) | Multi-screen display device and multi-screen display method | |
JP4315239B2 (en) | Variable transparency display | |
US6195797B1 (en) | Apparatus and method for providing computer display data from a computer system to a remote display device | |
US6252590B1 (en) | Method and apparatus for image processing and display system | |
US20050149967A1 (en) | System and method for managing software alert messages on televisions | |
EP0783818A4 (en) | Content programmer control of video and data display using associated data | |
WO2021109354A1 (en) | Media stream data playback method and device | |
WO2021189712A1 (en) | Method for switching webpage video from full-screen playing to small-window playing, and display device | |
CN111899175A (en) | Image conversion method and display device | |
WO2021189708A1 (en) | Method for turning on screen protection for display device, and display device | |
US11662971B2 (en) | Display apparatus and cast method | |
CA2481000A1 (en) | Method and apparatus for displaying graphics on an auxiliary display device using low level graphics drivers | |
JP4849756B2 (en) | Method and apparatus for generating a video window with parameters for determining position and scaling factor | |
JP2002033974A (en) | Method and system for using single osd pixmap in multiple video raster sizes by using multiple headers | |
US7661122B2 (en) | Method and device for initializing cable card and channel list using reset menu on OSD screen | |
CN112040309B (en) | Channel switching method and display device | |
CN111954043B (en) | Information bar display method and display equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
EEER | Examination request | ||
FZDE | Discontinued |