US20220206737A1 - Method and apparatus for displaying multiple devices on shared screen - Google Patents
Method and apparatus for displaying multiple devices on shared screen Download PDFInfo
- Publication number
- US20220206737A1 US20220206737A1 US17/209,209 US202117209209A US2022206737A1 US 20220206737 A1 US20220206737 A1 US 20220206737A1 US 202117209209 A US202117209209 A US 202117209209A US 2022206737 A1 US2022206737 A1 US 2022206737A1
- Authority
- US
- United States
- Prior art keywords
- frame
- casting device
- original content
- received
- casting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000000034 method Methods 0.000 title claims abstract description 17
- 238000005266 casting Methods 0.000 claims abstract description 146
- 238000004891 communication Methods 0.000 claims description 30
- 239000000872 buffer Substances 0.000 claims description 20
- 238000012545 processing Methods 0.000 description 10
- 238000013459 approach Methods 0.000 description 3
- 238000004590 computer program Methods 0.000 description 3
- 230000000644 propagated effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000007774 longterm Effects 0.000 description 1
- 230000000873 masking effect Effects 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
- H04N21/43637—Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1438—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using more than one graphics controller
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G3/00—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes
- G09G3/20—Control arrangements or circuits, of interest only in connection with visual indicators other than cathode-ray tubes for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/393—Arrangements for updating the contents of the bit-mapped memory
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4126—The peripheral being portable, e.g. PDAs or mobile phones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/43615—Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44004—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video buffer management, e.g. video decoder buffer or video display buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/485—End-user interface for client configuration
- H04N21/4858—End-user interface for client configuration for modifying screen layout parameters, e.g. fonts, size of the windows
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2352/00—Parallel handling of streams of display data
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2360/00—Aspects of the architecture of display systems
- G09G2360/12—Frame memory handling
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/06—Consumer Electronics Control, i.e. control of another device by a display or vice versa
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/16—Use of wireless transmission of display information
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/20—Details of the management of multiple sources of image data
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/39—Control of the bit-mapped memory
- G09G5/391—Resolution modifying circuits, e.g. variable screen formats
Definitions
- the subject matter disclosed herein relates to displaying content on a display. More particularly, the subject matter disclosed here relates to a system and method for displaying content on a display being used by multiple devices.
- Wireless screen sharing involves the content of a portable computer, tablet, or phone being cast to a screen buffer of the television and displayed with a limited delay of 1-2 frames.
- this approach allows a content that would be viewed on a portable device (having a 6′′-15′′ screen) to have a better viewing experience on a larger display (e.g., a 60′′-100′′ screen).
- An example embodiment provides a receiver device that may include two or more screen-cast receivers and a controller.
- the two or more screen-cast receivers may each receive from a corresponding casting device at least a portion of a frame of original content generated by the corresponding casting device.
- the controller may synchronize each received portion of the frame of original content generated by the corresponding casting device to form a video output signal that includes a combination of each received portion.
- the video output signal may be output to a display.
- at least one casting device may be one of a smartphone, a tablet, and a computing device.
- at least one screen-cast receiver receives the portion of the frame from the corresponding casting device over a local wireless communication link.
- the receiver device may further include a frame buffer that receives from a corresponding screen-cast receiver each received portion of the frame of original content of the corresponding casting device, and the controller may be configured to combine each respective portion of the frame of original content in the frame buffer to form the video output signal.
- the receiver device may include a communication interface device that is configured to receive at least a portion of a frame of original content, and the receiver device may be configured to generate at least a portion of a frame of original content.
- the frame buffer may be configured to receive a portion of the frame of original content from one of a casting device, the communication interface and the receiver device, and the controller may be configured to synchronize each respective portion of the frame received in the frame buffer to form the video output signal.
- each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal to be a sequence of complete frames.
- each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal comprising each respective complete frame received from a casting device, and adjust a layout of received portions of frames of original content in the video output signal based on one of one or more portions of frames not being received by a corresponding screen-cast receiver and a user configuration.
- An example embodiment provides a casting device that may include an image-generating unit and an output device.
- the image-generating unit may generate at least a portion of a frame of original content of the casting device, and the output device may output the portion of the frame of original content of the casting device to a receiver device over a communication network.
- the casting device may be one of a smartphone, a tablet, and a computing device.
- a receiving device may include two or more screen-casting receivers and a controller.
- the two or more screen-cast receivers that each receive from a corresponding casting device a portion of a frame of original content generated by the corresponding casting device, and the controller may synchronize each received portion of the frame of original content of the corresponding casting device to form a video output signal that comprises a combination of each received portion.
- the video output signal may be output to a display, and the communication network may include a local wireless communication network.
- the receiving device may further include a frame buffer that receives from a corresponding screen-cast receiver each received portion of the frame of original content from the corresponding casting device.
- the controller may be configured to combine each respective portion of the frame of original content in the frame buffer to form the video output signal.
- Each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal to be a sequence of complete frames.
- each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal comprising each respective complete frame received from a casting device.
- An example embodiment provides A method that may include: receiving over a local wireless communication link by each of two or more screen-cast receivers from a corresponding casting device at least a portion of a frame of original content generated by the corresponding casting device; and synchronizing each respective portion of the frame of original content to form a video output signal.
- the video output signal may be output to a display, and at least one casting device may be one of a smartphone, a tablet, and a computing device.
- each respective portion of a frame received from a casting device may include a complete frame of original content
- synchronizing each respective portion of the frame of original content may include selecting each respective complete frame of original content to form a video output signal comprising a sequence of complete frames.
- each respective portion of a frame received from a casting device may include a complete frame of original content
- synchronizing each respective portion of the frame of original content may include synchronizing respective complete frames received from a casting device to form the video output signal comprising each respective complete frame received from a casting device.
- the method may further include adjusting a layout of received portions of frames of original content in the video output signal based on one or more portions of frames not being received by a corresponding screen-cast receiver.
- FIG. 1 depicts a first example embodiment of system that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein;
- FIG. 2 depicts a second example embodiment of system that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein;
- FIG. 3 depicts an example system that includes a receiving device and four example casting devices according to the subject matter disclosed herein;
- FIG. 4 depicts an example system that includes a receiving device and two example casting devices according to the subject matter disclosed herein;
- FIG. 5 is a flowchart of an example method for multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein;
- FIG. 6 depicts an electronic device that includes a receiving device that receives original content from multiple casting devices and operates to combine the different original contents to populate a large display screen according to the subject matter disclosed herein.
- a singular term may include the corresponding plural forms and a plural term may include the corresponding singular form.
- a hyphenated term e.g., “two-dimensional,” “pre-determined,” “pixel-specific,” etc.
- a corresponding non-hyphenated version e.g., “two dimensional,” “predetermined,” “pixel specific,” etc.
- a capitalized entry e.g., “Counter Clock,” “Row Select,” “PIXOUT,” etc.
- a non-capitalized version e.g., “counter clock,” “row select,” “pixout,” etc.
- first,” “second,” etc., as used herein, are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.) unless explicitly defined as such.
- same reference numerals may be used across two or more figures to refer to parts, components, blocks, circuits, units, or modules having the same or similar functionality. Such usage is, however, for simplicity of illustration and ease of discussion only; it does not imply that the construction or architectural details of such components or units are the same across all embodiments or such commonly-referenced parts/modules are the only way to implement some of the example embodiments disclosed herein.
- first,” “second,” etc., as used herein, are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.) unless explicitly defined as such.
- same reference numerals may be used across two or more figures to refer to parts, components, blocks, circuits, units, or modules having the same or similar functionality. Such usage is, however, for simplicity of illustration and ease of discussion only; it does not imply that the construction or architectural details of such components or units are the same across all embodiments or such commonly-referenced parts/modules are the only way to implement some of the example embodiments disclosed herein.
- module refers to any combination of software, firmware and/or hardware configured to provide the functionality described herein in connection with a module.
- software may be embodied as a software package, code and/or instruction set or instructions
- the term “hardware,” as used in any implementation described herein, may include, for example, singly or in any combination, an assembly, hardwired circuitry, programmable circuitry, state machine circuitry, and/or firmware that stores instructions executed by programmable circuitry.
- the modules may, collectively or individually, be embodied as circuitry that forms part of a larger system, for example, but not limited to, an integrated circuit (IC), system on-a-chip (SoC), an assembly, and so forth.
- IC integrated circuit
- SoC system on-a-chip
- a “large” display screen means a display that is larger or otherwise has one or more aspects that make it desirable to view rather than a portable device.
- Example aspects that may make a large display screen more desirable to view may include, but are not limited to, a higher resolution, a more vibrant color, a better view angle, and a larger physical size.
- the content generated by each casting device may be original content of the casting device that is related to, but different from, content that is generated by another casting device.
- the original content of a casting device may be a point-of-view (POV) of the casting device of a video game.
- Each casting device involved with the video game generates original content that reflects the POV of the casting device, but is different from the POVs of the other casting devices.
- the different generated original contents may be combined at a receiver device and used to populate a large screen.
- Another example of original content that is related to, but different from, original content of other casting device may be different sporting events, such as, but not limited to, different football games, different baseball games, different basketball games. etc.
- the original content generated by each respective casting device may be independent from original content generated by another casting device.
- the different independent original contents may be combined at a receiver device and used to populate a large screen.
- Configurations may vary based on system/device features, but the underlying purpose is the same for each system: to increase the compute power available for generating a display by coordinating multiple casting devices to work together to draw a single screen.
- a system for performing the functionality disclosed herein may be divided, or distributed, between a receiver associated with a display screen and transceivers associated with corresponding casting devices.
- An advantage provided by the subject matter disclosed herein may include using multiple external computing devices to simulcast either rendered or video-based content on a display screen, thereby reducing a framerate requirement associated with each external computing device to provide an overall image quality in which multiple devices are contributing to the overall displayed content.
- the display receives multiple distinct wireless streams simultaneously.
- this may include a television (or monitor) having screencast capabilities that may accept multiple streaming feeds from casting devices simultaneously.
- Each casting device e.g., a smartphone or similar
- Each casting device may include a transmitter that may cast video content to, for example, a television by a user selecting the TV screen name and using, for example, an extra number, tag, or label that indicates a particular destination portion of the screen for the content transmitted by the casting device.
- hardware and/or software may be used to both receive and manage video streams onto the appropriate section of a display screen at the appropriate times.
- software may be used to mix audio content of the multiple incoming streams.
- One example embodiment provides multiple casting devices that render various overlays of the same game, in which case given a distinct blend ordering, game/video content overlays may be displayed using multiple devices, e.g., live football games with overlaid graphic content, or video games using multiple phones to draw three-dimensional (3D) vs two-dimensional (2D) overlay content onto a screen. Still another example embodiment provides that a three-dimensional stereoscopic system may use casting devices that are configured to generate left- and right-eye content.
- FIG. 1 depicts a first example embodiment of system 100 that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein.
- the system 100 may include a receiving device 101 that may include two or more screen-cast receivers 102 a - 102 n, an intermediate frequency controller (control IF) 103 , an intermediate frequency frame synchronizer (frame synch IF) 104 , a graphic (GFX) processor 105 , a display controller 106 , and an audio mixer 107 .
- the receiving device 101 may include a WiFi receiver 108 .
- the WiFi receiver 108 may be separate from the receiving device 101 .
- the WiFi receiver 108 may be embodied as part of a transceiver.
- the receiving device 101 may include an optional television (TV) tuner (or communication interface device) 109 coupled to an antenna 110 and/or a CATV source (not shown).
- the television tuner 109 may also be coupled to the control IF 103 , the frame synch IF 104 , and the audio mixer 107 .
- the various components and/or functional parts of the system 100 may be embodied as modules that may be any combination of software, firmware, and/or hardware configured to provide the various functionalities described herein.
- the system 100 may be configured as a USB stick-type device.
- the WiFi receiver 108 may receive wireless communication signals over a local wireless network (or personal area network (PAN)) from two or more casting device transmitters (not shown) in a client-server type of arrangement.
- the WiFi receiver 108 may downconvert the wireless communication signals to an intermediate frequency, which may then be input to the screen-cast receivers 102 a - 102 n.
- the screen-cast receivers 102 a - 102 n may each further demodulate/decode the received wireless communication signals from the client devices into corresponding baseband signals.
- the control IF 103 may receive control signals from the WiFi receiver 108 and generate additional control signals that may be used for synchronizing signals passing through the receiving device 101 .
- the WiFi receiver 108 may demodulate/decode the received wireless communications signals and output a baseband signal, in which case the screen-cast receivers may provide further processing, such as error correction, to the baseband signals.
- the WiFi receiver 108 may be omitted and the screen-cast receivers 102 a - 102 n may directly receive wireless communication signals from the client transceivers and demodulate/decode the signals to form baseband signals.
- the respective video or image-content outputs of the screen-cast receivers 102 a - 102 n may be input to the frame sync IF 104 .
- Frame sync IF 104 may synchronize multiple 2 D frame buffers by using a vertical sync (VSYNC) signal or pixel counting mechanism.
- VSYNC vertical sync
- a prior frame may be repeated after a synchronization timer elapses (e.g., 60 Hz time window).
- Audio content may be input to the audio mixer 107 .
- the GFX processor 105 may provide graphical processing functionality such as, but not limited to, translational functionality, rotational functionality, and/or scaling functionality, to the content in the frame sync IF 104 to generate a sequence of frames that are output to the display controller 106 .
- the display controller 106 may output a video signal over a wired or a wireless link to a television or monitor 111 .
- the audio mixer 107 may output an audio signal to, for example, a speaker 112 .
- Audio may either be mixed equally or unequally among all screencast streams. Mixing of the audio streams may be based on passive heuristics (e.g., volume), or alternatively active heuristics may take, for example, gameplay into account. Alternatively, volume may be provided from the display itself, or from the portable devices.
- FIG. 2 depicts a second example embodiment of system 200 that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein.
- the system 200 may include a receiving device 201 that may include two or more screen-cast receivers 202 a - 202 n, a master frame sync controller 203 , a frame buffer 204 , an audio mixer 207 and a WiFi receiver 208 .
- the WiFi receiver 208 may be separate from the receiving device 201 .
- the WiFi receiver 208 may be embodied as part of a transceiver.
- the receiving device 201 may include an optional television tuner (or communication interface device) 209 coupled to an antenna 210 and/or a CATV source (not shown).
- the television tuner 209 may also be coupled to the master frame sync controller 203 and the audio mixer 207 .
- the various components and/or functional parts of the system 200 may be embodied as modules that may be any combination of software, firmware, and/or hardware configured to provide the various functionalities described herein.
- the system 200 may be configured as a USB or HDMI stick or dongle-type device.
- the WiFi receiver 208 may receive wireless communication signals over a local wireless network (or PAN) from two or more casting devices 211 a - 211 n directly (i.e., direct peer-to-peer) and/or through a WiFi router 212 in a client-server type of arrangement.
- a casting device 211 may include a casting transmitter (Xmitter) 213 and an image generating device 214 .
- the image generating device 214 may be embodied as a graphics processing unit (GPU), a video processor, a display compositor, a camera interface and/or a pixel generating engine that generates at least a portion of a frame of original content.
- a casting device 211 may be, for example, a smartphone, a tablet, and/or a computing device, like but not limited to a laptop.
- a casting device 211 may duplicate an internal screen buffer and audio stream, and may send the contents of the screen buffer and audio stream wirelessly to the receiving device 201 .
- the WiFi receiver 208 may downconvert the wireless communication signals to an intermediate frequency and may be input to the screen-cast receivers 202 a - 202 n.
- the screen-cast receivers 202 may each further demodulate/decode the received wireless communication signals from the client devices to form corresponding baseband signals.
- the master frame sync controller 203 may receive control signals from the WiFi receiver 208 and generate control signals that may be used for synchronizing signals passing through the receiving device 201 . Additionally, the master frame sync controller 203 may be configured to combine content received from the different casting devices 211 based on a user selection.
- the respective video or image content outputs of the screen-cast receivers 202 a - 202 n and/or tuner 209 may be input to the frame buffer 204 based on how the master frame sync controller 203 has been configured to combine the content received from the different casting devices 211 . Additionally, the receiver 201 may generate original content that is received by the frame buffer 204 . In one embodiment, the master frame sync controller 203 may be configured in a mode that arranges the received content in a half-screen, a quadrant, or a region-type arrangement depending on the number of casting devices 211 .
- the master frame sync controller 203 may arrange the received content so that each received content is displayed in a corresponding portion, or region, of a display 215 . In one embodiment, if there are fewer casting devices 211 than the number of screen portions for which the master frame sync controller 203 has been configured, the master frame sync controller 203 may automatically adjust a layout of the content on the display screen 215 or, alternatively, leave the portion, or region, of the display screen 215 blank that has allocated for the missing content.
- Audio content may be input to the audio mixer 207 .
- the master frame sync controller 203 may control output of the frame buffer 204 , which is sent (wired or wireles sly) to a display 209 that is external to the receiving device 201 .
- the display 215 may be part of the receiving device 201 .
- the audio mixer 207 may output an audio signal to, for example, a speaker 216 .
- FIG. 3 depicts an example system 300 that includes a receiving device 301 and four example casting devices 302 a - 302 d.
- the receiving device 301 may be embodied as a television receiver that includes the receiving device, such as receiving device 101 or 201 , respectively depicted in FIGS. 1 and 2 .
- the receiving device may be separate from a television receiver.
- the receiving device 301 has been, for example, configured to display the original content of each of the casting devices 302 in separate quadrants of a display screen of the receiving device 301 . That is, the original content of the casting device 302 a is displayed in an upper left quadrant 303 a of the display screen.
- the original content of the casting device 302 b is displayed in a lower left quadrant 303 b of the display screen.
- the original content of the casting device 302 c is displayed in an upper right quadrant 303 c of the display screen
- the original content of casting device 302 d is displayed in a lower right quadrant 303 d.
- Each casting device may generate its original content in a resolution of the casting device, which is communicated to the receiving device 301 .
- each casting device may generate its original content in a resolution based, for example, on a resolution of the display screen of the receiving device 301 .
- four example casting devices are shown in FIG. 3 , it should be understood that the receiving device 301 may be configured to receive content from two or more casting devices 302 and be configured to display the received content on the screen of the receiving device 301 .
- the original content that is displayed on the display of the receiving device 301 provides multiple perspectives, which may be used for displaying a multi-user game.
- fewer than or more than four casting devices 302 may be used in which case the layout of the display of the receiving device 301 may be automatically adjusted to display the original content of each of the casting devices 302 in separate portions or regions of the display.
- Synchronization may be provided either by using the receiving device 301 as a timekeeper or allowing the casting devices 302 to selectively originate a timekeeper for synchronizing among all casting devices 302 .
- Audio may be mixed together, or muted at the receiving device 301 with the intention of each casting device using its own audio for a specific viewer with or without headphones.
- Game context may be maintained either by a single casting device or an external server.
- a client-side prediction may be used for games in which the game may artificially assume the whereabouts of players until sync time and then update player positions. If two or more players are within a threshold vicinity, updates may be performed at relatively shorter intervals, which may improve pure client-server synchronization latency.
- a client-side prediction approach may provide that synchronization may be delayed by an application until player interaction has exceeded a threshold.
- FIG. 4 depicts an example system 400 that includes a receiving device 401 and two example casting devices 402 a and 402 b.
- the receiving device 401 may be embodied as a television receiver that includes the receiving device, such as receiving device 101 or 201 .
- the receiving device 401 has been, for example, configured to display the original content of each casting device 402 in separate horizontal portions, or regions, of a split-screen display. Alternatively, separate vertical portions may be used for a split-screen display. Although simple rectangular regions are shown for screen splitting, other (non-rectangular) geometries can be readily contemplated in which one device is partially overlayed over or around another device's space, via masking concepts. Additionally, although two example casting devices are shown in FIG. 4 , it should be understood that the receiving device 401 may be configured to receive content from two or more casting devices 402 and be configured to display the received content on the screen of the receiving device 401 .
- Another alternative system mode may include two or more casting devices that each cast completely different content in a resolution in a half or quadrant of a large display, for example, four separate live football games, or four different video game matches.
- This system mode may allow a “party mode” for a television or large screen by allowing more than one casting device to cast content independently onto a display screen with no synchronization involved.
- the volume of all four channels might be audio mixed or filtered to allow audio channels at a time depending on a desired output.
- a special mode may be provided that allows one of the received streams to take over the display screen for a limited time (e.g., a winner screen or a common transition movie that is relevant to all users).
- another embodiment may include an internal video stream monitor/TV sourced data to be downscaled and streamed into a portion of the screen in the stead of an external screen-casted stream.
- FIG. 5 is a flowchart of an example method 500 for multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein.
- At 501 at least one screen-cast receiver of a receiving device may receive at least a portion of a frame of original content from a corresponding casting device over a local wireless communication link in which the original content is generated in a resolution of a corresponding casting device.
- multiple screen-cast receivers would be receiving a corresponding portion of a frame of original content from a corresponding casting device, however, if, for some reason, all but one communication link from a casting device end, the display screen coupled to the receiving device will logically fallback to using the single remaining casting device.
- each respective portion of the frame of original content is synchronized to form a video output signal.
- FIG. 6 depicts an electronic device 600 that includes a receiving device that receives original content from multiple casting devices and operates to combine the different original contents to populate a large display screen according to the subject matter disclosed herein.
- a “large” display screen means a display that is larger or otherwise has one or more aspects that make it desirable to view rather than a portable device.
- Example aspects that may make a large display screen more desirable to view may include, but is not limited to, a higher resolution, a more vibrant color, a better view angle, and a larger physical size.
- the electronic device 600 may be embodied as a television receiver that may be configured as a receiving device, such as receiving device 101 or 201 , respectively depicted in FIGS. 1 and 2 .
- the electronic device 600 may include a controller 610 , an input/output device 620 such as, but not limited to, a keypad, a keyboard, a display, a touch-screen display, a camera, and/or an image sensor, a memory 630 , an interface 640 , a GPU 650 , and an imaging-processing unit 660 that are coupled to each other through a bus 670 .
- the controller 610 may include, for example, at least one microprocessor, at least one digital signal processor, at least one microcontroller, or the like.
- the memory 630 may be configured to store a command code to be used by the controller 610 or a user data.
- the interface 640 may be configured to include a wireless interface that is configured to transmit data to or receive data from a wireless communication network using a RF signal.
- the wireless interface 640 may include, for example, an antenna.
- the electronic system 600 also may be used in a communication interface protocol of a communication system, such as, but not limited to, Code Division Multiple Access (CDMA), Global System for Mobile Communications (GSM), North American Digital Communications (NADC), Extended Time Division Multiple Access (E-TDMA), Wideband CDMA (WCDMA), CDMA 2000 , Wi-Fi, Municipal Wi-Fi (Muni Wi-Fi), Bluetooth, Digital Enhanced Cordless Telecommunications (DECT), Wireless Universal Serial Bus (Wireless USB), Fast low-latency access with seamless handoff Orthogonal Frequency Division Multiplexing (Flash-OFDM), IEEE 802 .
- CDMA Code Division Multiple Access
- GSM Global System for Mobile Communications
- NADC North American Digital Communications
- E-TDMA Extended Time Division Multiple Access
- WCDMA Wideband CDMA
- CDMA 2000 Code Division Multiple Access
- Wi-Fi Wireless Fidelity
- Wi-Fi Wireless Universal Serial Bus
- Flash-OFDM Flash-OFDM
- GPRS General Packet Radio Service
- iBurst Wireless Broadband
- WiBro Wireless Broadband
- WiMAX WiMAX-Advanced
- HSPA High Speed Packet Access
- EVDO Evolution Data Optimized
- LTE-Advanced Long Term Evolution-Advanced
- MMDS Multichannel Multipoint Distribution Service
- 5G Fifth-Generation Wireless
- 6G Sixth-Generation Wireless
- Embodiments of the subject matter and the operations described in this specification may be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them.
- Embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer-program instructions, encoded on computer-storage medium for execution by, or to control the operation of data-processing apparatus.
- the program instructions can be encoded on an artificially-generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus.
- a computer-storage medium can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial-access memory array or device, or a combination thereof. Moreover, while a computer-storage medium is not a propagated signal, a computer-storage medium may be a source or destination of computer-program instructions encoded in an artificially-generated propagated signal. The computer-storage medium can also be, or be included in, one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices). Additionally, the operations described in this specification may be implemented as operations performed by a data-processing apparatus on data stored on one or more computer-readable storage devices or received from other sources.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Computer Graphics (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Controls And Circuits For Display Device (AREA)
Abstract
A system and method is disclosed that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein. The system includes a receiving device that includes two or more screen-cast receivers and a controller. Each screen-cast receiver receives from a corresponding casting device at least a portion of a frame of original content of the corresponding casting device generated in a native resolution of the corresponding casting device. The controller synchronizes each received portion of the frame of the original content of the corresponding casting device to form a video output signal that comprises a combination of each received portion, in addition to any internally generated content derived by the receiving display. A casting device may be a smartphone, a tablet, or a computing device, such as a laptop computer.
Description
- This application claims the priority benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application No. 63/133,215, filed on Dec. 31, 2020, the disclosure of which is incorporated herein by reference in its entirety.
- The subject matter disclosed herein relates to displaying content on a display. More particularly, the subject matter disclosed here relates to a system and method for displaying content on a display being used by multiple devices.
- The sizes and resolutions of screen displays are continuing to become larger every year. Resolutions of 4K and 8K use a content throughput that may be particularly difficult to generate without using image scaling or reducing frame-rate. With respect to video games in which features are rendered in real-time, native 4K-8K video resolution may use top of the line compute and graphics hardware; and even with such hardware, features may be scaled back to obtain agreeable framerates of at least 30-60 frames per second (FPS).
- One popular approach for displaying content on large LCD or LED panels (e.g., televisions) is to use a method of wireless screen sharing. Wireless screen sharing involves the content of a portable computer, tablet, or phone being cast to a screen buffer of the television and displayed with a limited delay of 1-2 frames. For shared videos and video games, this approach allows a content that would be viewed on a portable device (having a 6″-15″ screen) to have a better viewing experience on a larger display (e.g., a 60″-100″ screen).
- An example embodiment provides a receiver device that may include two or more screen-cast receivers and a controller. The two or more screen-cast receivers may each receive from a corresponding casting device at least a portion of a frame of original content generated by the corresponding casting device. The controller may synchronize each received portion of the frame of original content generated by the corresponding casting device to form a video output signal that includes a combination of each received portion. The video output signal may be output to a display. In one embodiment, at least one casting device may be one of a smartphone, a tablet, and a computing device. In another embodiment, at least one screen-cast receiver receives the portion of the frame from the corresponding casting device over a local wireless communication link. The receiver device may further include a frame buffer that receives from a corresponding screen-cast receiver each received portion of the frame of original content of the corresponding casting device, and the controller may be configured to combine each respective portion of the frame of original content in the frame buffer to form the video output signal. In one embodiment, the receiver device may include a communication interface device that is configured to receive at least a portion of a frame of original content, and the receiver device may be configured to generate at least a portion of a frame of original content. The frame buffer may be configured to receive a portion of the frame of original content from one of a casting device, the communication interface and the receiver device, and the controller may be configured to synchronize each respective portion of the frame received in the frame buffer to form the video output signal. In one embodiment, each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal to be a sequence of complete frames. In still another embodiment, each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal comprising each respective complete frame received from a casting device, and adjust a layout of received portions of frames of original content in the video output signal based on one of one or more portions of frames not being received by a corresponding screen-cast receiver and a user configuration.
- An example embodiment provides a casting device that may include an image-generating unit and an output device. The image-generating unit may generate at least a portion of a frame of original content of the casting device, and the output device may output the portion of the frame of original content of the casting device to a receiver device over a communication network. The casting device may be one of a smartphone, a tablet, and a computing device. In one embodiment, a receiving device may include two or more screen-casting receivers and a controller. The two or more screen-cast receivers that each receive from a corresponding casting device a portion of a frame of original content generated by the corresponding casting device, and the controller may synchronize each received portion of the frame of original content of the corresponding casting device to form a video output signal that comprises a combination of each received portion. The video output signal may be output to a display, and the communication network may include a local wireless communication network. In one embodiment, the receiving device may further include a frame buffer that receives from a corresponding screen-cast receiver each received portion of the frame of original content from the corresponding casting device. The controller may be configured to combine each respective portion of the frame of original content in the frame buffer to form the video output signal. Each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal to be a sequence of complete frames. In one embodiment, each respective portion of a frame received from a casting device may include a complete frame of original content, and the controller may be configured to synchronize each respective complete frame received from a casting device to form the video output signal comprising each respective complete frame received from a casting device.
- An example embodiment provides A method that may include: receiving over a local wireless communication link by each of two or more screen-cast receivers from a corresponding casting device at least a portion of a frame of original content generated by the corresponding casting device; and synchronizing each respective portion of the frame of original content to form a video output signal. The video output signal may be output to a display, and at least one casting device may be one of a smartphone, a tablet, and a computing device. In one embodiment, each respective portion of a frame received from a casting device may include a complete frame of original content, and synchronizing each respective portion of the frame of original content may include selecting each respective complete frame of original content to form a video output signal comprising a sequence of complete frames. In another embodiment, each respective portion of a frame received from a casting device may include a complete frame of original content, and synchronizing each respective portion of the frame of original content may include synchronizing respective complete frames received from a casting device to form the video output signal comprising each respective complete frame received from a casting device. In one embodiment, the method may further include adjusting a layout of received portions of frames of original content in the video output signal based on one or more portions of frames not being received by a corresponding screen-cast receiver.
- In the following section, the aspects of the subject matter disclosed herein will be described with reference to exemplary embodiments illustrated in the figure, in which:
-
FIG. 1 depicts a first example embodiment of system that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein; -
FIG. 2 depicts a second example embodiment of system that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein; -
FIG. 3 depicts an example system that includes a receiving device and four example casting devices according to the subject matter disclosed herein; -
FIG. 4 depicts an example system that includes a receiving device and two example casting devices according to the subject matter disclosed herein; -
FIG. 5 is a flowchart of an example method for multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein; and -
FIG. 6 depicts an electronic device that includes a receiving device that receives original content from multiple casting devices and operates to combine the different original contents to populate a large display screen according to the subject matter disclosed herein. - In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the disclosure. It will be understood, however, by those skilled in the art that the disclosed aspects may be practiced without these specific details. In other instances, well-known methods, procedures, components and circuits have not been described in detail to not obscure the subject matter disclosed herein.
- Reference throughout this specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment disclosed herein. Thus, the appearances of the phrases “in one embodiment” or “in an embodiment” or “according to one embodiment” (or other phrases having similar import) in various places throughout this specification may not necessarily all be referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner in one or more embodiments. In this regard, as used herein, the word “exemplary” means “serving as an example, instance, or illustration.” Any embodiment described herein as “exemplary” is not to be construed as necessarily preferred or advantageous over other embodiments. Additionally, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. Also, depending on the context of discussion herein, a singular term may include the corresponding plural forms and a plural term may include the corresponding singular form. Similarly, a hyphenated term (e.g., “two-dimensional,” “pre-determined,” “pixel-specific,” etc.) may be occasionally interchangeably used with a corresponding non-hyphenated version (e.g., “two dimensional,” “predetermined,” “pixel specific,” etc.), and a capitalized entry (e.g., “Counter Clock,” “Row Select,” “PIXOUT,” etc.) may be interchangeably used with a corresponding non-capitalized version (e.g., “counter clock,” “row select,” “pixout,” etc.). Such occasional interchangeable uses shall not be considered inconsistent with each other.
- Also, depending on the context of discussion herein, a singular term may include the corresponding plural forms and a plural term may include the corresponding singular form. It is further noted that various figures (including component diagrams) shown and discussed herein are for illustrative purpose only, and are not drawn to scale. For example, the dimensions of some of the elements may be exaggerated relative to other elements for clarity. Further, if considered appropriate, reference numerals have been repeated among the figures to indicate corresponding and/or analogous elements.
- The terminology used herein is for the purpose of describing some example embodiments only and is not intended to be limiting of the claimed subject matter. As used herein, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. The terms “first,” “second,” etc., as used herein, are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.) unless explicitly defined as such. Furthermore, the same reference numerals may be used across two or more figures to refer to parts, components, blocks, circuits, units, or modules having the same or similar functionality. Such usage is, however, for simplicity of illustration and ease of discussion only; it does not imply that the construction or architectural details of such components or units are the same across all embodiments or such commonly-referenced parts/modules are the only way to implement some of the example embodiments disclosed herein.
- It will be understood that when an element or layer is referred to as being on, “connected to” or “coupled to” another element or layer, it can be directly on, connected or coupled to the other element or layer or intervening elements or layers may be present. In contrast, when an element is referred to as being “directly on,” “directly connected to” or “directly coupled to” another element or layer, there are no intervening elements or layers present. Like numerals refer to like elements throughout. As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
- The terms “first,” “second,” etc., as used herein, are used as labels for nouns that they precede, and do not imply any type of ordering (e.g., spatial, temporal, logical, etc.) unless explicitly defined as such. Furthermore, the same reference numerals may be used across two or more figures to refer to parts, components, blocks, circuits, units, or modules having the same or similar functionality. Such usage is, however, for simplicity of illustration and ease of discussion only; it does not imply that the construction or architectural details of such components or units are the same across all embodiments or such commonly-referenced parts/modules are the only way to implement some of the example embodiments disclosed herein.
- Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this subject matter belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
- As used herein, the term “module” refers to any combination of software, firmware and/or hardware configured to provide the functionality described herein in connection with a module. For example, software may be embodied as a software package, code and/or instruction set or instructions, and the term “hardware,” as used in any implementation described herein, may include, for example, singly or in any combination, an assembly, hardwired circuitry, programmable circuitry, state machine circuitry, and/or firmware that stores instructions executed by programmable circuitry. The modules may, collectively or individually, be embodied as circuitry that forms part of a larger system, for example, but not limited to, an integrated circuit (IC), system on-a-chip (SoC), an assembly, and so forth.
- The subject matter disclosed herein relates to a system and a method that allows multiple casting devices, such as, but not limited to smartphones, tablets, laptop computers, and other similar portable computing devices, to work together to generate content to populate a “large” display screen. As used herein, a “large” display screen means a display that is larger or otherwise has one or more aspects that make it desirable to view rather than a portable device. Example aspects that may make a large display screen more desirable to view may include, but are not limited to, a higher resolution, a more vibrant color, a better view angle, and a larger physical size. In one embodiment, the content generated by each casting device may be original content of the casting device that is related to, but different from, content that is generated by another casting device. For example, the original content of a casting device may be a point-of-view (POV) of the casting device of a video game. Each casting device involved with the video game generates original content that reflects the POV of the casting device, but is different from the POVs of the other casting devices. The different generated original contents may be combined at a receiver device and used to populate a large screen. Another example of original content that is related to, but different from, original content of other casting device may be different sporting events, such as, but not limited to, different football games, different baseball games, different basketball games. etc. In another embodiment, the original content generated by each respective casting device may be independent from original content generated by another casting device. The different independent original contents may be combined at a receiver device and used to populate a large screen.
- Configurations may vary based on system/device features, but the underlying purpose is the same for each system: to increase the compute power available for generating a display by coordinating multiple casting devices to work together to draw a single screen. A system for performing the functionality disclosed herein may be divided, or distributed, between a receiver associated with a display screen and transceivers associated with corresponding casting devices. An advantage provided by the subject matter disclosed herein may include using multiple external computing devices to simulcast either rendered or video-based content on a display screen, thereby reducing a framerate requirement associated with each external computing device to provide an overall image quality in which multiple devices are contributing to the overall displayed content.
- The subject matter disclosed herein provides that the display receives multiple distinct wireless streams simultaneously. In one embodiment, this may include a television (or monitor) having screencast capabilities that may accept multiple streaming feeds from casting devices simultaneously. Each casting device (e.g., a smartphone or similar) may include a transmitter that may cast video content to, for example, a television by a user selecting the TV screen name and using, for example, an extra number, tag, or label that indicates a particular destination portion of the screen for the content transmitted by the casting device. In one embodiment, hardware and/or software may be used to both receive and manage video streams onto the appropriate section of a display screen at the appropriate times. In another embodiment, software may be used to mix audio content of the multiple incoming streams.
- One example embodiment provides multiple casting devices that render various overlays of the same game, in which case given a distinct blend ordering, game/video content overlays may be displayed using multiple devices, e.g., live football games with overlaid graphic content, or video games using multiple phones to draw three-dimensional (3D) vs two-dimensional (2D) overlay content onto a screen. Still another example embodiment provides that a three-dimensional stereoscopic system may use casting devices that are configured to generate left- and right-eye content.
-
FIG. 1 depicts a first example embodiment ofsystem 100 that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein. Thesystem 100 may include a receivingdevice 101 that may include two or more screen-cast receivers 102 a-102 n, an intermediate frequency controller (control IF) 103, an intermediate frequency frame synchronizer (frame synch IF) 104, a graphic (GFX)processor 105, adisplay controller 106, and anaudio mixer 107. In one embodiment, the receivingdevice 101 may include aWiFi receiver 108. Alternatively, theWiFi receiver 108 may be separate from the receivingdevice 101. In one embodiment, theWiFi receiver 108 may be embodied as part of a transceiver. In another embodiment, the receivingdevice 101 may include an optional television (TV) tuner (or communication interface device) 109 coupled to anantenna 110 and/or a CATV source (not shown). Thetelevision tuner 109 may also be coupled to the control IF 103, the frame synch IF 104, and theaudio mixer 107. The various components and/or functional parts of thesystem 100 may be embodied as modules that may be any combination of software, firmware, and/or hardware configured to provide the various functionalities described herein. In one example embodiment, thesystem 100 may be configured as a USB stick-type device. - The
WiFi receiver 108 may receive wireless communication signals over a local wireless network (or personal area network (PAN)) from two or more casting device transmitters (not shown) in a client-server type of arrangement. In one embodiment, theWiFi receiver 108 may downconvert the wireless communication signals to an intermediate frequency, which may then be input to the screen-cast receivers 102 a-102 n. The screen-cast receivers 102 a-102 n may each further demodulate/decode the received wireless communication signals from the client devices into corresponding baseband signals. The control IF 103 may receive control signals from theWiFi receiver 108 and generate additional control signals that may be used for synchronizing signals passing through the receivingdevice 101. In an alternative embodiment, theWiFi receiver 108 may demodulate/decode the received wireless communications signals and output a baseband signal, in which case the screen-cast receivers may provide further processing, such as error correction, to the baseband signals. In still another embodiment, theWiFi receiver 108 may be omitted and the screen-cast receivers 102 a-102 n may directly receive wireless communication signals from the client transceivers and demodulate/decode the signals to form baseband signals. - The respective video or image-content outputs of the screen-
cast receivers 102 a-102 n may be input to the frame sync IF 104. Frame sync IF 104 may synchronize multiple 2D frame buffers by using a vertical sync (VSYNC) signal or pixel counting mechanism. In the case of a missing VSYNC (or insufficient data for stream) on one or more incoming streams, a prior frame may be repeated after a synchronization timer elapses (e.g., 60 Hz time window). Audio content may be input to theaudio mixer 107. TheGFX processor 105 may provide graphical processing functionality such as, but not limited to, translational functionality, rotational functionality, and/or scaling functionality, to the content in the frame sync IF 104 to generate a sequence of frames that are output to thedisplay controller 106. Thedisplay controller 106 may output a video signal over a wired or a wireless link to a television or monitor 111. - The
audio mixer 107 may output an audio signal to, for example, aspeaker 112. Audio may either be mixed equally or unequally among all screencast streams. Mixing of the audio streams may be based on passive heuristics (e.g., volume), or alternatively active heuristics may take, for example, gameplay into account. Alternatively, volume may be provided from the display itself, or from the portable devices. -
FIG. 2 depicts a second example embodiment ofsystem 200 that allows multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein. Thesystem 200 may include a receivingdevice 201 that may include two or more screen-cast receivers 202 a-202 n, a masterframe sync controller 203, aframe buffer 204, anaudio mixer 207 and aWiFi receiver 208. In one embodiment, theWiFi receiver 208 may be separate from the receivingdevice 201. In another embodiment, theWiFi receiver 208 may be embodied as part of a transceiver. In another embodiment, the receivingdevice 201 may include an optional television tuner (or communication interface device) 209 coupled to anantenna 210 and/or a CATV source (not shown). Thetelevision tuner 209 may also be coupled to the masterframe sync controller 203 and theaudio mixer 207. The various components and/or functional parts of thesystem 200 may be embodied as modules that may be any combination of software, firmware, and/or hardware configured to provide the various functionalities described herein. In one example embodiment, thesystem 200 may be configured as a USB or HDMI stick or dongle-type device. - The
WiFi receiver 208 may receive wireless communication signals over a local wireless network (or PAN) from two ormore casting devices 211 a-211 n directly (i.e., direct peer-to-peer) and/or through aWiFi router 212 in a client-server type of arrangement. Acasting device 211 may include a casting transmitter (Xmitter) 213 and an image generating device 214. The image generating device 214 may be embodied as a graphics processing unit (GPU), a video processor, a display compositor, a camera interface and/or a pixel generating engine that generates at least a portion of a frame of original content. Acasting device 211 may be, for example, a smartphone, a tablet, and/or a computing device, like but not limited to a laptop. Acasting device 211 may duplicate an internal screen buffer and audio stream, and may send the contents of the screen buffer and audio stream wirelessly to the receivingdevice 201. - The
WiFi receiver 208 may downconvert the wireless communication signals to an intermediate frequency and may be input to the screen-cast receivers 202 a-202 n. The screen-cast receivers 202 may each further demodulate/decode the received wireless communication signals from the client devices to form corresponding baseband signals. The masterframe sync controller 203 may receive control signals from theWiFi receiver 208 and generate control signals that may be used for synchronizing signals passing through the receivingdevice 201. Additionally, the masterframe sync controller 203 may be configured to combine content received from thedifferent casting devices 211 based on a user selection. - The respective video or image content outputs of the screen-
cast receivers 202 a-202 n and/ortuner 209 may be input to theframe buffer 204 based on how the masterframe sync controller 203 has been configured to combine the content received from thedifferent casting devices 211. Additionally, thereceiver 201 may generate original content that is received by theframe buffer 204. In one embodiment, the masterframe sync controller 203 may be configured in a mode that arranges the received content in a half-screen, a quadrant, or a region-type arrangement depending on the number ofcasting devices 211. If there are more than fourcasting devices 211 and thereceiver device 201 includes a corresponding number of screen-cast receivers 202, the masterframe sync controller 203 may arrange the received content so that each received content is displayed in a corresponding portion, or region, of adisplay 215. In one embodiment, if there arefewer casting devices 211 than the number of screen portions for which the masterframe sync controller 203 has been configured, the masterframe sync controller 203 may automatically adjust a layout of the content on thedisplay screen 215 or, alternatively, leave the portion, or region, of thedisplay screen 215 blank that has allocated for the missing content. - Audio content may be input to the
audio mixer 207. The masterframe sync controller 203 may control output of theframe buffer 204, which is sent (wired or wireles sly) to adisplay 209 that is external to the receivingdevice 201. Alternatively, thedisplay 215 may be part of the receivingdevice 201. Theaudio mixer 207 may output an audio signal to, for example, aspeaker 216. -
FIG. 3 depicts anexample system 300 that includes a receivingdevice 301 and four example casting devices 302 a-302 d. The receivingdevice 301 may be embodied as a television receiver that includes the receiving device, such as receivingdevice FIGS. 1 and 2 . Alternatively, the receiving device may be separate from a television receiver. The receivingdevice 301 has been, for example, configured to display the original content of each of the casting devices 302 in separate quadrants of a display screen of the receivingdevice 301. That is, the original content of thecasting device 302 a is displayed in an upper left quadrant 303 a of the display screen. The original content of thecasting device 302 b is displayed in a lower left quadrant 303 b of the display screen. Similarly, the original content of thecasting device 302 c is displayed in an upper right quadrant 303 c of the display screen, and the original content ofcasting device 302 d is displayed in a lower right quadrant 303 d. Each casting device may generate its original content in a resolution of the casting device, which is communicated to the receivingdevice 301. Alternatively, each casting device may generate its original content in a resolution based, for example, on a resolution of the display screen of the receivingdevice 301. Although four example casting devices are shown inFIG. 3 , it should be understood that the receivingdevice 301 may be configured to receive content from two or more casting devices 302 and be configured to display the received content on the screen of the receivingdevice 301. - As depicted in
FIG. 3 , the original content that is displayed on the display of the receivingdevice 301 provides multiple perspectives, which may be used for displaying a multi-user game. In another embodiment, fewer than or more than four casting devices 302 may be used in which case the layout of the display of the receivingdevice 301 may be automatically adjusted to display the original content of each of the casting devices 302 in separate portions or regions of the display. Synchronization may be provided either by using thereceiving device 301 as a timekeeper or allowing the casting devices 302 to selectively originate a timekeeper for synchronizing among all casting devices 302. Audio may be mixed together, or muted at the receivingdevice 301 with the intention of each casting device using its own audio for a specific viewer with or without headphones. - Game context may be maintained either by a single casting device or an external server. A client-side prediction may be used for games in which the game may artificially assume the whereabouts of players until sync time and then update player positions. If two or more players are within a threshold vicinity, updates may be performed at relatively shorter intervals, which may improve pure client-server synchronization latency. A client-side prediction approach may provide that synchronization may be delayed by an application until player interaction has exceeded a threshold.
-
FIG. 4 depicts anexample system 400 that includes a receivingdevice 401 and twoexample casting devices device 401 may be embodied as a television receiver that includes the receiving device, such as receivingdevice device 401 has been, for example, configured to display the original content of each casting device 402 in separate horizontal portions, or regions, of a split-screen display. Alternatively, separate vertical portions may be used for a split-screen display. Although simple rectangular regions are shown for screen splitting, other (non-rectangular) geometries can be readily contemplated in which one device is partially overlayed over or around another device's space, via masking concepts. Additionally, although two example casting devices are shown inFIG. 4 , it should be understood that the receivingdevice 401 may be configured to receive content from two or more casting devices 402 and be configured to display the received content on the screen of the receivingdevice 401. - Another alternative system mode may include two or more casting devices that each cast completely different content in a resolution in a half or quadrant of a large display, for example, four separate live football games, or four different video game matches. This system mode may allow a “party mode” for a television or large screen by allowing more than one casting device to cast content independently onto a display screen with no synchronization involved. For this mode, the volume of all four channels might be audio mixed or filtered to allow audio channels at a time depending on a desired output. A special mode may be provided that allows one of the received streams to take over the display screen for a limited time (e.g., a winner screen or a common transition movie that is relevant to all users). Also another embodiment may include an internal video stream monitor/TV sourced data to be downscaled and streamed into a portion of the screen in the stead of an external screen-casted stream.
- To avoid screen-tearing (e.g., when some frames of devices are complete while others are still being generated), there may be per quadrant (or display area) updates if the screen allows, or a reduced framerate to allow for all quadrants to complete in a given interval. In situations in which any of the many casting devices may be interrupted, there an application-level response provides that the application pauses the game/video for all, removes the interrupted party, or has an artificial intelligence (AI) feature take over for the interruption.
-
FIG. 5 is a flowchart of anexample method 500 for multiple casting devices to work together to populate a large display screen according to the subject matter disclosed herein. - At 501, at least one screen-cast receiver of a receiving device may receive at least a portion of a frame of original content from a corresponding casting device over a local wireless communication link in which the original content is generated in a resolution of a corresponding casting device. Normally, multiple screen-cast receivers would be receiving a corresponding portion of a frame of original content from a corresponding casting device, however, if, for some reason, all but one communication link from a casting device end, the display screen coupled to the receiving device will logically fallback to using the single remaining casting device. At 502, each respective portion of the frame of original content is synchronized to form a video output signal.
-
FIG. 6 depicts anelectronic device 600 that includes a receiving device that receives original content from multiple casting devices and operates to combine the different original contents to populate a large display screen according to the subject matter disclosed herein. As used herein, a “large” display screen means a display that is larger or otherwise has one or more aspects that make it desirable to view rather than a portable device. Example aspects that may make a large display screen more desirable to view may include, but is not limited to, a higher resolution, a more vibrant color, a better view angle, and a larger physical size. In one embodiment, theelectronic device 600 may be embodied as a television receiver that may be configured as a receiving device, such as receivingdevice FIGS. 1 and 2 . - The
electronic device 600 may include acontroller 610, an input/output device 620 such as, but not limited to, a keypad, a keyboard, a display, a touch-screen display, a camera, and/or an image sensor, amemory 630, aninterface 640, aGPU 650, and an imaging-processing unit 660 that are coupled to each other through abus 670. Thecontroller 610 may include, for example, at least one microprocessor, at least one digital signal processor, at least one microcontroller, or the like. Thememory 630 may be configured to store a command code to be used by thecontroller 610 or a user data. -
Electronic device 600 and the various system components ofelectronic device 600 may include theimage processing unit 660. Theinterface 640 may be configured to include a wireless interface that is configured to transmit data to or receive data from a wireless communication network using a RF signal. Thewireless interface 640 may include, for example, an antenna. Theelectronic system 600 also may be used in a communication interface protocol of a communication system, such as, but not limited to, Code Division Multiple Access (CDMA), Global System for Mobile Communications (GSM), North American Digital Communications (NADC), Extended Time Division Multiple Access (E-TDMA), Wideband CDMA (WCDMA), CDMA2000, Wi-Fi, Municipal Wi-Fi (Muni Wi-Fi), Bluetooth, Digital Enhanced Cordless Telecommunications (DECT), Wireless Universal Serial Bus (Wireless USB), Fast low-latency access with seamless handoff Orthogonal Frequency Division Multiplexing (Flash-OFDM), IEEE 802.20, General Packet Radio Service (GPRS), iBurst, Wireless Broadband (WiBro), WiMAX, WiMAX-Advanced, Universal Mobile Telecommunication Service-Time Division Duplex (UMTS-TDD), High Speed Packet Access (HSPA), Evolution Data Optimized (EVDO), Long Term Evolution-Advanced (LTE-Advanced), Multichannel Multipoint Distribution Service (MMDS), Fifth-Generation Wireless (5G), Sixth-Generation Wireless (6G), and so forth. - Embodiments of the subject matter and the operations described in this specification may be implemented in digital electronic circuitry, or in computer software, firmware, or hardware, including the structures disclosed in this specification and their structural equivalents, or in combinations of one or more of them. Embodiments of the subject matter described in this specification may be implemented as one or more computer programs, i.e., one or more modules of computer-program instructions, encoded on computer-storage medium for execution by, or to control the operation of data-processing apparatus. Alternatively or additionally, the program instructions can be encoded on an artificially-generated propagated signal, e.g., a machine-generated electrical, optical, or electromagnetic signal, that is generated to encode information for transmission to suitable receiver apparatus for execution by a data processing apparatus. A computer-storage medium can be, or be included in, a computer-readable storage device, a computer-readable storage substrate, a random or serial-access memory array or device, or a combination thereof. Moreover, while a computer-storage medium is not a propagated signal, a computer-storage medium may be a source or destination of computer-program instructions encoded in an artificially-generated propagated signal. The computer-storage medium can also be, or be included in, one or more separate physical components or media (e.g., multiple CDs, disks, or other storage devices). Additionally, the operations described in this specification may be implemented as operations performed by a data-processing apparatus on data stored on one or more computer-readable storage devices or received from other sources.
- While this specification may contain many specific implementation details, the implementation details should not be construed as limitations on the scope of any claimed subject matter, but rather be construed as descriptions of features specific to particular embodiments. Certain features that are described in this specification in the context of separate embodiments may also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment may also be implemented in multiple embodiments separately or in any suitable subcombination. Moreover, although features may be described above as acting in certain combinations and even initially claimed as such, one or more features from a claimed combination may in some cases be excised from the combination, and the claimed combination may be directed to a subcombination or variation of a subcombination.
- Similarly, while operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be advantageous. Moreover, the separation of various system components in the embodiments described above should not be understood as requiring such separation in all embodiments, and it should be understood that the described program components and systems can generally be integrated together in a single software product or packaged into multiple software products.
- Thus, particular embodiments of the subject matter have been described herein. Other embodiments are within the scope of the following claims. In some cases, the actions set forth in the claims may be performed in a different order and still achieve desirable results. Additionally, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In certain implementations, multitasking and parallel processing may be advantageous.
- As will be recognized by those skilled in the art, the innovative concepts described herein may be modified and varied over a wide range of applications. Accordingly, the scope of claimed subject matter should not be limited to any of the specific exemplary teachings discussed above, but is instead defined by the following claims.
Claims (20)
1. A receiver device, comprising:
two or more screen-cast receivers that each receive from a corresponding separate casting device at least a portion of a frame of original content generated by the corresponding separate casting device; and
a controller that synchronizes each received portion of the frame of original content generated by separate casting devices to form a video output signal that comprises a combination of each received portion.
2. The receiver device of claim 1 , wherein the video output signal is output to a display.
3. The receiver device of claim 1 , wherein at least one screen-cast receiver receives a corresponding portion of the frame from the corresponding separate casting device over a local wireless communication link.
4. The receiver device of claim 1 , further comprising a frame buffer that receives from a corresponding screen-cast receiver each received portion of the frame of original content of the corresponding separate casting device,
wherein the controller is configured to combine each respective portion of the frame of original content in the frame buffer to form the video output signal.
5. The receiver device of claim 4 , further comprising a communication interface device that is configured to receive at least a portion of a frame of original content,
wherein the receiver device is configured to generate at least a portion of a frame of original content,
wherein the frame buffer is configured to receive a portion of the frame of original content from one of a casting device, the communication interface device and the receiver device, and
wherein the controller is configured to synchronize each respective portion of the frame received in the frame buffer to form the video output signal.
6. The receiver device of claim 1 , wherein at least one casting device comprises one of a smartphone, a tablet, orand a computing device.
7. The receiver device of claim 1 , wherein each respective portion of a frame received from a casting device comprises a complete frame of original content, and
wherein the controller is configured to synchronize each respective complete frame received from a casting device to form the video output signal to be a sequence of complete frames.
8. The receiver device of claim 1 , wherein each respective portion of a frame received from a casting device comprises a complete frame of original content, and
wherein the controller is configured to:
synchronize each respective complete frame received from a casting device to form the video output signal comprising each respective complete frame received from a casting device, and
adjust a layout of received portions of frames of original content in the video output signal based on one of one or more portions of frames not being received by a corresponding screen-cast receiver and a user configuration.
9. A casting device, comprising:
an image-generating unit that generates a portion of a frame of original content of the casting device, the portion of the frame of being less than an entirety of the frame and to be combined with other portions of the frame generated by at least one other casting device to form a video signal that comprises a combination of each received portion; and
an output device that outputs the portion of the frame of original content of the casting device to a receiver device over a communication network, the receiver device including two or more screen-cast receivers.
10. The casting device of claim 9 , wherein the casting device comprises a smartphone, a tablet, or a computing device.
11. The casting device of claim 9 , further comprising the receiving device, the receiving device comprising:
the two or more screen-cast receivers, each screen-casting device receiving from a corresponding separate casting device a portion of a frame of original content generated by the corresponding separate casting device; and
a controller that synchronizes each received portion of the frame of original content generated by separate casting devices to form a video output signal that comprises the combination of each received portion.
12. The casting device of claim 11 , wherein the video output signal is output to a display, and
wherein the communication network comprises a local wireless communication network.
13. The casting device of claim 11 , wherein the receiving device further comprises a frame buffer that receives from each screen-cast receiver a corresponding portion of the frame of original content from the casting device,
wherein the controller is configured to combine each respective portion of the frame of original content in the frame buffer to form the video output signal.
14. The casting device of claim 11 , wherein each respective portion of a frame received from a casting device comprises a complete frame of original content, and
wherein the controller is configured to synchronize each respective complete frame received from a casting device to form the video output signal to be a sequence of complete frames.
15. The casting device of claim 11 , wherein each respective portion of a frame received from a casting device comprises a complete frame of original content, and wherein the controller is configured to synchronize each respective complete frame received from a casting device to form the video output signal.
16. A method, comprising:
receiving over a local wireless communication link by each of two or more screen-cast receivers, each screen-cast receiver receiving from a corresponding separate casting device at least a portion of a frame of original content generated by the corresponding separate casting device; and
synchronizing each respective portion of the frame of original content to form a video output signal.
17. The method of claim 16 , wherein the video output signal is output to a display, and
wherein at least one casting device comprises a smartphone, a tablet, or a computing device.
18. The method of claim 16 , wherein each respective portion of a frame received from a casting device comprises a complete frame of original content, and wherein synchronizing each respective portion of the frame of original content comprises forming the video output signal to comprise a sequence of complete frames.
19. The method of claim 16 , wherein each respective portion of a frame received from a casting device comprises a complete frame of original content, and
wherein synchronizing each respective portion of the frame of original content comprises forming the video output signal to comprise each respective complete frame received from a casting device.
20. The method of claim 16 , further comprising adjusting a layout of received portions of frames of original content in the video output signal based on one or more portions of frames not being received by a corresponding screen-cast receiver.
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US17/209,209 US11360732B1 (en) | 2020-12-31 | 2021-03-22 | Method and apparatus for displaying multiple devices on shared screen |
TW110143444A TW202231060A (en) | 2020-12-31 | 2021-11-23 | Receiver device, casting device and method for displaying content on shared screen |
KR1020210181009A KR20220097247A (en) | 2020-12-31 | 2021-12-16 | Method and apparatus for displaying multiple devices on shared screen |
CN202111646277.8A CN114697734A (en) | 2020-12-31 | 2021-12-30 | Method and apparatus for displaying multiple devices on a shared screen |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US202063133215P | 2020-12-31 | 2020-12-31 | |
US17/209,209 US11360732B1 (en) | 2020-12-31 | 2021-03-22 | Method and apparatus for displaying multiple devices on shared screen |
Publications (2)
Publication Number | Publication Date |
---|---|
US11360732B1 US11360732B1 (en) | 2022-06-14 |
US20220206737A1 true US20220206737A1 (en) | 2022-06-30 |
Family
ID=81944209
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/209,209 Active US11360732B1 (en) | 2020-12-31 | 2021-03-22 | Method and apparatus for displaying multiple devices on shared screen |
Country Status (4)
Country | Link |
---|---|
US (1) | US11360732B1 (en) |
KR (1) | KR20220097247A (en) |
CN (1) | CN114697734A (en) |
TW (1) | TW202231060A (en) |
Families Citing this family (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI792407B (en) * | 2021-07-12 | 2023-02-11 | 瑞昱半導體股份有限公司 | Image processing method and display device |
CN116434791B (en) * | 2023-06-12 | 2023-08-11 | 深圳福德源数码科技有限公司 | Configuration method and system for audio player |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150084837A1 (en) * | 2013-09-19 | 2015-03-26 | Broadcom Corporation | Coordination of multiple mobile device displays |
US9298362B2 (en) * | 2011-02-11 | 2016-03-29 | Nokia Technologies Oy | Method and apparatus for sharing media in a multi-device environment |
US20170344330A1 (en) * | 2016-05-31 | 2017-11-30 | Panasonic Intellectual Property Management Co., Ltd. | Multi-display device |
US9961295B2 (en) * | 2012-06-22 | 2018-05-01 | Nec Display Solutions, Ltd. | Display device |
US20190051268A1 (en) * | 2017-08-14 | 2019-02-14 | Thomas Frederick Utsch | Method and System for the Distribution of Synchronized Video to an Array of Randomly Positioned Display Devices Acting as One Aggregated Display Device |
US10459625B2 (en) * | 2011-02-10 | 2019-10-29 | Samsung Electronics Co., Ltd. | Portable device comprising a touch-screen display, and method for controlling same |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20150295783A1 (en) | 2014-04-10 | 2015-10-15 | Screenovate Technologies Ltd. | Method for real-time multimedia interface management sensor data |
US9471955B2 (en) | 2014-06-19 | 2016-10-18 | Apple Inc. | Multiple display pipelines driving a divided display |
WO2016160744A1 (en) | 2015-03-27 | 2016-10-06 | Twitter, Inc. | Live video streaming services |
-
2021
- 2021-03-22 US US17/209,209 patent/US11360732B1/en active Active
- 2021-11-23 TW TW110143444A patent/TW202231060A/en unknown
- 2021-12-16 KR KR1020210181009A patent/KR20220097247A/en unknown
- 2021-12-30 CN CN202111646277.8A patent/CN114697734A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10459625B2 (en) * | 2011-02-10 | 2019-10-29 | Samsung Electronics Co., Ltd. | Portable device comprising a touch-screen display, and method for controlling same |
US9298362B2 (en) * | 2011-02-11 | 2016-03-29 | Nokia Technologies Oy | Method and apparatus for sharing media in a multi-device environment |
US9961295B2 (en) * | 2012-06-22 | 2018-05-01 | Nec Display Solutions, Ltd. | Display device |
US20150084837A1 (en) * | 2013-09-19 | 2015-03-26 | Broadcom Corporation | Coordination of multiple mobile device displays |
US20170344330A1 (en) * | 2016-05-31 | 2017-11-30 | Panasonic Intellectual Property Management Co., Ltd. | Multi-display device |
US20190051268A1 (en) * | 2017-08-14 | 2019-02-14 | Thomas Frederick Utsch | Method and System for the Distribution of Synchronized Video to an Array of Randomly Positioned Display Devices Acting as One Aggregated Display Device |
US10607571B2 (en) * | 2017-08-14 | 2020-03-31 | Thomas Frederick Utsch | Method and system for the distribution of synchronized video to an array of randomly positioned display devices acting as one aggregated display device |
Also Published As
Publication number | Publication date |
---|---|
TW202231060A (en) | 2022-08-01 |
US11360732B1 (en) | 2022-06-14 |
CN114697734A (en) | 2022-07-01 |
KR20220097247A (en) | 2022-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20220279237A1 (en) | Streaming and Rendering of Multidimensional Video Using a Plurality of Data Streams | |
JP5898235B2 (en) | Communication method and communication apparatus | |
US10114522B2 (en) | Method of controlling display of display device by mobile terminal and mobile terminal for the same | |
KR101719583B1 (en) | Multi-view display system | |
CN102088638B (en) | Image display device and method for operating the same | |
US11360732B1 (en) | Method and apparatus for displaying multiple devices on shared screen | |
US9210361B2 (en) | Video display system | |
US9319619B1 (en) | System and method for presenting multiple pictures on a television | |
US20130050573A1 (en) | Transmission of video content | |
US9232169B2 (en) | Display apparatus and display method | |
US20110229106A1 (en) | System for playback of ultra high resolution video using multiple displays | |
CN102223555B (en) | Image display apparatus and method for controlling the same | |
WO2021093575A1 (en) | Video stream display method and apparatus, video stream sending method and apparatus, terminal, server and medium | |
WO2012119346A1 (en) | Method and device for processing channels of mobile phone television | |
KR20140111736A (en) | Display apparatus and control method thereof | |
US20140146147A1 (en) | Apparatus and method for performing multi-view display | |
US20230179815A1 (en) | Electronic apparatus, server and method of controlling the same | |
CN115273748A (en) | Display module, display system, display driver, display method and electronic equipment | |
US20120314087A1 (en) | Visual source management system | |
US20130047186A1 (en) | Method to Enable Proper Representation of Scaled 3D Video | |
US10264241B2 (en) | Complimentary video content | |
RU2583755C2 (en) | Method of capturing and displaying entertaining activities and user interface for realising said method | |
KR20130020310A (en) | Image display apparatus, and method for operating the same | |
KR20140083544A (en) | Image display apparatus, image transmitting apparatus, and method for operating the same | |
EP3089457A1 (en) | Enhanced content consumption by deep immersion |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
AS | Assignment |
Owner name: SAMSUNG ELECTRONICS CO., LTD., KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:DAGANI, GABRIEL T.;TANNENBAUM, DAVID C.;FRASCATI, CHRISTOPHER P.;AND OTHERS;REEL/FRAME:064230/0522 Effective date: 20210319 |