US20130162502A1 - Dynamically controlling display mode of external device coupled to user equipment - Google Patents
Dynamically controlling display mode of external device coupled to user equipment Download PDFInfo
- Publication number
- US20130162502A1 US20130162502A1 US13/726,404 US201213726404A US2013162502A1 US 20130162502 A1 US20130162502 A1 US 20130162502A1 US 201213726404 A US201213726404 A US 201213726404A US 2013162502 A1 US2013162502 A1 US 2013162502A1
- Authority
- US
- United States
- Prior art keywords
- external device
- display
- multiscreen
- user equipment
- image data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 claims abstract description 49
- 238000001514 detection method Methods 0.000 claims abstract description 26
- 230000004913 activation Effects 0.000 claims description 17
- 230000009977 dual effect Effects 0.000 claims description 13
- 230000003213 activating effect Effects 0.000 claims description 12
- 238000010586 diagram Methods 0.000 description 41
- 239000003795 chemical substances by application Substances 0.000 description 18
- 238000012545 processing Methods 0.000 description 18
- 239000000470 constituent Substances 0.000 description 17
- 230000004044 response Effects 0.000 description 17
- 238000004891 communication Methods 0.000 description 16
- 230000008878 coupling Effects 0.000 description 11
- 238000010168 coupling process Methods 0.000 description 11
- 238000005859 coupling reaction Methods 0.000 description 11
- 230000008569 process Effects 0.000 description 8
- 238000003032 molecular docking Methods 0.000 description 7
- 238000013461 design Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 4
- 230000005236 sound signal Effects 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 229920001621 AMOLED Polymers 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 239000007822 coupling agent Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000009429 electrical wiring Methods 0.000 description 1
- 230000005670 electromagnetic radiation Effects 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000005580 one pot reaction Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
- G06F13/14—Handling requests for interconnection or transfer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
- H04N21/4312—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
- H04N21/4316—Generation of visual interfaces for content selection or interaction; Content or additional data rendering involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video stream to a specific local network, e.g. a Bluetooth® network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/44227—Monitoring of local network, e.g. connection or bandwidth variations; Detecting new devices in the local network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/442—Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
- H04N21/4424—Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/14—Display of multiple viewports
Definitions
- the present invention relates to user equipment and, in particular, to dynamically controlling a display mode of an external device coupled to user equipment.
- User equipment has advanced so as to perform multiple functions such as communicating voice and data with others; exchanging text messages or multimedia messages; sending e-mails; capturing a still or moving image; playing back a music or a video file, playing a game, and a receiving a broadcast signal. Lately, such multi-functional user equipment has received greater attention for new applications. Instead of using multiple independent devices, a user prefers to use single multifunction-enabled user equipment. Portability and/or mobility should be considered in design of user equipment, but such user equipment has limitations in size. Accordingly, there also are limitations in display screen size, screen resolution, and speaker performance.
- an external device having a large display size, better speaker performance, and connectable to a mobile terminal has been introduced.
- Such external device connected to the mobile terminal can provide data, music files, and other content stored in the mobile terminal in better performance.
- user equipment is coupled to an external device having a larger display area and displays a mirrored screen that is exactly same as a screen displayed on user equipment. Due to a comparatively small display area of the user equipment, the user equipment may be designed to display only one application window of currently running application. Such a display mode may be referred to as a single display mode. Since the display unit of the coupled external device is typically controlled as the single display mode, the benefit of using the larger display area of the coupled external device may be not maximized.
- Embodiments of the present invention overcome the above disadvantages and other disadvantages not described above. Also, the present invention is not required to overcome the disadvantages described above, and an embodiment of the present invention may not overcome any of the problems described above.
- a display mode of an external device may be controlled dynamically according to a display size of the external device when the external device is coupled to user equipment.
- user equipment may control an external device to display image data in a multiscreen display mode when user equipment is coupled to the external device.
- a method of a user equipment may be provided for dynamically controlling a display mode of an external device coupled to user equipment.
- the method may include determining whether to detect connection to an external device and upon the detection of the connection, controlling the coupled external device to display image data produced in the user equipment on a display unit of the coupled external device in a display mode different from a display mode of the user equipment.
- the display mode of the coupled external device may be a multiscreen display mode and the display mode of the user equipment may be a single screen display mode.
- the controlling may include creating image data in a multiscreen mode display setting associated with applications running in a multitasking mode of the user equipment and information on the coupled external device, transmitting the created image data to the coupled external device, and controlling the external device to display the transmitted image data in a multiscreen display mode based on the associated multiscreen mode display setting.
- the controlling may include determining whether a display size of the coupled external device is greater than a reference display size upon the detection of the connection. When the display size of the coupled external device is determined as being greater than a reference display size, the controlling may include controlling the coupled external device to display the image data produced by the user equipment on the display unit of the coupled external device in a multiscreen display mode.
- the controlling may include determining whether a display size of the coupled external device is greater than a reference display size upon the detection of the connection, determining a number of applications running in a multitasking mode of the user equipment when the display size of the coupled external device is determined as being greater than a reference display size, obtaining a multiscreen mode display setting of the coupled external device based on the determined number of applications running in a multitasking mode of the user equipment and information on the coupled external device, and controlling the coupled external device to display the produced image data on the display unit of the coupled external device in a multiscreen display mode based on the obtained multiscreen mode display setting.
- the method may further include establishing a host-device connection between the user equipment and the coupled external device and setting a host-device connection display setting based on information on a display unit of the coupled external device upon the detection of the connection, creating image data as a result of running an application in the user equipment based on the host-device connection display setting, transmitting the created image data to the coupled external device and controlling the coupled external device to display the transmitted image data in a single screen mode, determining whether a user input is received for activating one of applications installed in the user equipment, upon the receipt of the user input for activating, creating image data of the currently activated application, creating multiscreen image data by combining the created image data of the currently activated application and the created image data of the running application based on an associated multiscreen mode display setting, and transmitting the created multiscreen image data to the external device.
- the controlling may include controlling the coupled external device to display the transmitted multiscreen image data in a dual screen display mode based on the associated multiscreen mode display setting.
- the method may further include establishing a host-device connection between the user equipment and the coupled external device upon the detection of the connection, determining whether a display size of the coupled external device is greater than a reference display size upon the detection of the connection, determining a number of applications running in a multitasking mode of the user equipment when the display size of the coupled external device is greater than a reference display size, and obtaining a multiscreen mode display setting based on the determined number of applications running in a multitasking mode of the user equipment and information on the coupled external device.
- the controlling may includes creating multiscreen image data by combining image data produced by each application running in the multitasking mode of the user equipment based on the obtained multiscreen mode display setting, transmitting the created multiscreen image data to the coupled external device, and controlling the coupled external device to display the transmitted multiscreen mode image data in a multiscreen display mode based on the obtained multiscreen mode display setting.
- the method may further include obtaining a multiscreen mode display setting based on a number of applications running in the user equipment and information on the coupled external device.
- the multiscreen mode display setting may include at least one of information on a number of application windows in the multiscreen display mode, a maximum number of allowed application windows, a display size of each application window, a position and a display orientation of each application window, arrangement of each application window, control menus and icons for controlling an overall graphic user interface of the multiscreen display mode and each application window, arrangement and sizes of the control menus and icons.
- the obtaining may include retrieving, from a memory of the user equipment, the multiscreen mode display setting associated with the number of multitasking applications running in the user equipment and the information on the coupled external device.
- information on the multiscreen mode display setting may be stored in a form of a lookup table in the memory of the user equipment.
- the obtaining may include determining the multiscreen mode display setting based on the number of multitasking application running in the user equipment and the information on the coupled external device.
- the method may further include determining whether an user input is received for activating a new application after controlling the coupled external device to display image data produced in the user equipment in the multiscreen display mode, upon the receipt of the user input for activating a new application, interrupting creating image data of one of running applications associated with the multiscreen display mode, creating image data of the newly activated application and continuously creating image data of remaining applications associated with the multiscreen display mode, creating multiscreen image data by combining the created image data of the newly activated application and the continuously created image data of the remaining applications based on an associated multiscreen mode display setting, and transmitting the created multiscreen image data to the coupled external device.
- the controlling may include controlling the coupled external device to display the transmitted multiscreen image data in the associated multiscreen display mode based on the associated multiscreen mode display setting.
- the application interrupted to create image data may be running in a background mode.
- the determining may include, upon the receipt of the user input for activating a new application, determining whether a number of application windows in a current multiscreen display mode reaches a maximum number of application windows allowed within the current multiscreen display mode.
- the determining may include obtaining a multiscreen mode display setting by increasing a number of associated multitasking applications by one, creating multiscreen image data based on the newly obtained multiscreen mode display setting by additionally including image data produced by the newly activated application, and transmitting the created multiscreen image data to the coupled external device and controlling the external device to display the transmitted multiscreen image data based on the newly obtained multiscreen mode display setting.
- the method may further include determining whether a user input is received for closing one of application windows in the multiscreen display mode after controlling the coupled external device to display image data produced in the user equipment in the multiscreen display mode.
- the method may further include interrupting creating image data of the application associated with the user input, resuming one of applications running in a background mode to create image data and continuously creating image data of applications not associated with the user input, creating multiscreen image data by combining the created image data of the resumed application and the continuously created image data of the applications not associated with the user input based on an associated multiscreen mode display setting, and transmitting the created multiscreen image data to the coupled external device.
- the controlling may include controlling the coupled external device to display the transmitted multiscreen image data in the associated multiscreen display mode based on the associated multiscreen mode display setting.
- a user equipment may be provided for dynamically controlling a display mode of an external device coupled thereto.
- the user equipment may be configured to determine whether to detect connection to an external device. Upon the detection of the connection, the user equipment may be configured to control the coupled external device to display image data produced in the user equipment on a display unit of the coupled external device in a display mode different from a display mode of the user equipment.
- FIG. 1 shows various external devices connected to user equipment in accordance with at least one embodiment of the present invention
- FIG. 2 shows a typical method of user equipment for controlling an external device to display image data when the user equipment is coupled to the external device;
- FIG. 3 shows user equipment and an external device in accordance with at least one embodiment of the present invention
- FIG. 4 is a block diagram illustrating user equipment in accordance with at least one embodiment of the present invention.
- FIG. 5 is a block diagram illustrating an external device in accordance with at least one embodiment of the present invention.
- FIG. 6 shows an external device controlled to display image data in a multiscreen display mode in accordance with at least one embodiment of the present invention
- FIG. 7A to FIG. 7C show a method for dynamically controlling a display mode of an external device coupled to user equipment in accordance with at least one embodiment of the present invention.
- FIG. 8 shows a method for establishing host-device connection at least one embodiment of the present invention.
- user equipment may control an external device to display image data in a display mode different from that of the user equipment when user equipment is coupled to the external device.
- Such user equipment may be coupled to various types of external devices.
- the external devices will be described with reference to FIG. 1 .
- user equipment will be described as a mobile terminal such as a mobile phone or a smart phone throughout the accompanying drawings. The present invention, however, is not limited thereto.
- FIG. 1 shows various external devices connected to user equipment in accordance with at least one embodiment of the present invention.
- user equipment 100 is an image data source device that may be coupled to various types of external devices.
- user equipment 100 may be coupled to pad type device 200 - 1 as shown in a diagram (A) and coupled to laptop type device 200 - 2 as shown in a diagram (B).
- user equipment 100 may be coupled to monitor 200 - 3 as shown in a diagram (C) and coupled to large sized screen 200 - 4 as shown in a diagram (D).
- other types of devices may be coupled to user equipment 100 as an external device for displaying image data produced by user equipment 100 .
- User equipment 100 may be coupled to an external device in various manners.
- user equipment 100 and the external device may include input/output ports 170 and 250 ( FIG. 3 and FIG. 4 ).
- user equipment 100 may be docked at a docking bay of an external device.
- pad type device 200 - 1 and laptop computer 200 - 2 may include a docking bay specially designed to receive user equipment 100 .
- user equipment 100 may be coupled to an external device through a physical cable.
- user equipment 100 may be coupled to monitor 200 - 3 through a physical cable such as a video and/or audio input/output cable.
- user equipment 100 may be coupled to an external device through a wireless manner such as WiFi, WiFi direct, and wireless high definition multimedia interface (HDMI).
- a wireless manner such as WiFi, WiFi direct, and wireless high definition multimedia interface (HDMI).
- user equipment 100 may be coupled to large sized screen 200 - 4 through signal receiving device 900 for receiving an image data signal from user equipment 100 through a wireless link.
- HDMI wireless high definition multimedia interface
- FIG. 2 shows a typical method of user equipment for controlling an external device to display image data when the user equipment is coupled to the external device.
- user equipment 100 is coupled to external device 200 having a larger display size.
- user equipment 100 may exchange data with external device 200 through predetermined coupling interfaces such as port units 170 and 250 ( FIG. 3 ), but the present invention is not limited thereto.
- User equipment 100 may communicate with external device 200 through various manners such as wireless communication.
- user equipment 100 operates as an image data source device and transfers image data produced in user equipment 100 to external device 200 .
- External device 200 receives and displays the image data from user equipment 100 in response to the control of user equipment 100 .
- external device 200 displays mirrored image data that is exactly same as image data displayed on user equipment 100 . Since user equipment 100 displays the image data in a single screen display mode, external device 200 displays the mirrored image data in the single screen display mode. For example, as shown in diagrams (A) and (B), user equipment 100 and external device 200 display the same screen in the single screen display mode.
- the diagram (A) of FIG. 2 shows a default home screen of user equipment 100 .
- the default home screen may be a graphic user interface (GUI) produced by an operation system of user equipment 100 .
- GUI graphic user interface
- external device 200 When external device 200 is coupled to user equipment 100 , external device 200 displays the same default home screen in the single screen mode because external device 200 is controlled to display the same image data produced in user equipment 100 and user equipment 100 displays the produced image data in the single display mode.
- external device 200 displays image data produced by the activated application in the single screen display mode as shown in a diagram (B) of FIG. 2 . External device 200 is controlled to display the same image data produced in user equipment 100 in the single display mode.
- the display mode of external device 200 may be dynamically controlled according to a display size of external device 200 in accordance with at least one embodiment of the present invention.
- user equipment 100 may control external device 200 to display image data in a multiscreen display mode when user equipment 100 is coupled to external device 200 .
- the multiscreen display mode may be a display mode for simultaneously display at least two application windows produced as a result of performing multiple applications at the same time. That is, user equipment 100 may control external device 200 to display image data in a display mode different from that of user equipment 100 in accordance with at least one embodiment of the present invention. Such operation will be described in detail with reference to FIG. 6 to FIG. 8 .
- user equipment 100 and external device 200 will be described with reference to FIG. 3 to FIG. 5 .
- user equipment will be representatively described as a mobile phone or a smart phone through the specification and an external device will be representatively described as a pad-type device or a tablet PC, but the present invention is not limited thereof.
- FIG. 3 shows user equipment and an external device in accordance with at least one embodiment of the present invention.
- user equipment 100 may include display unit 160 and at least one port unit 170 .
- Such port unit 170 may be referred to as an interface unit.
- Display unit 160 may display data according to display setting of user equipment 100 .
- Display unit 160 may typically have about 4.5 inch display area which may be smaller than that of an external device, but the present invention is not limited thereto. For example, a display area of an external device may be smaller than that of user equipment 100 .
- At least one port unit 170 may be coupled to an external device and exchange data with the external device.
- User equipment 100 may be capable of processing data and transferring the processed data to an external device through port unit 170 .
- a port unit 170 may include a high definition multimedia interface (HDMI) port and/or a universal serial bus (USB) port, but the present invention is not limited thereto.
- User equipment 100 may have a certain design or standardized interface connectable to an external device. For example, user equipment 100 may be attachable to and/or detachable from an external device. User equipment 100 may dock to an external device.
- User equipment 100 may be any electronic device that can perform the above and further operations described herein.
- user equipment 100 may include, but is not limited to, a mobile terminal, a mobile device, a mobile phone, a portable terminal, a portable device, a handheld device, a cellular phone, a smart phone, a personal digital assistant (PDA), wireless local loop (WLL) station, a portable multimedia player (PMP), and a navigation device.
- PDA personal digital assistant
- WLL wireless local loop
- PMP portable multimedia player
- a navigation device may include, but is not limited to, a mobile terminal, a mobile device, a mobile phone, a portable terminal, a portable device, a handheld device, a cellular phone, a smart phone, a personal digital assistant (PDA), wireless local loop (WLL) station, a portable multimedia player (PMP), and a navigation device.
- PDA personal digital assistant
- WLL wireless local loop
- PMP portable multimedia player
- external device 200 may include display unit 260 , key buttons 230 , at least one pot unit 250 , and speaker 265 .
- Display unit 260 may display image data.
- Display unit 260 may have a display area larger than that of user equipment 100 .
- display unit 260 may have about 10.1 inch of display area. The present invention, however, is not limited thereto.
- External device 200 may have a display area smaller than that of user equipment 100 .
- display unit 260 may display image data from user equipment 100 in a display mode different from that of user equipment 100 .
- display unit 260 may display image data in a multiscreen display mode.
- At least one port unit 250 may be coupled to corresponding port unit 170 of exchanging data with user equipment 100 .
- at least one port unit 270 may include a HDMI port and/or a USB port corresponding to port unit 170 of user equipment 100 .
- External device 200 may be capable of receiving data from user equipment 100 through at least one port unit 250 and displaying the received data on display unit 260 .
- External device 200 may have a certain design connectable to user equipment 100 through at least one port unit 250 .
- external device 200 may be attachable to and/or detachable from user equipment 100 as described above with respect to diagrams (D) and (E) of FIG. 3 .
- External device 200 may have structure 251 for receiving and holding user equipment 100 (diagram (C) of FIG. 3 ).
- External device 200 may be any electronic device that can perform the above operation.
- external device 200 may include a notebook computer, a laptop computer, a tablet PC, a pad having a touch screen, and a pad having a display unit and a keyboard, but the present invention is not limited thereto.
- external device 200 may be activated when user equipment 100 is connected to external device 200 and controlled by user equipment 100 . Accordingly, external device 200 may have at least constituent elements for necessary operation performed under the control of user equipment 100 .
- user equipment 100 may be coupled to external device in a docking manner.
- user equipment 100 may be inserted in coupling bay 251 of external device 200 in a top-to-bottom direction and user equipment 100 may be completely inserted into coupling bay 251 of external device 200 until at least one port unit 170 of user equipment 100 is interlocked to at least one port unit 250 of external device 200 .
- FIG. 3 shows that user equipment 100 is coupled with external device 200 in a docking manner, the present invention is not limited thereto.
- User equipment 100 may be coupled to external device 200 in other manners such as wireless connection through a radio link.
- user equipment 100 may be coupled to external device 100 and control coupled external device 200 to display image data in a multiscreen display mode which is different from that of user equipment 100 in accordance with at least one embodiment of the present invention.
- FIG. 4 is a block diagram illustrating user equipment in accordance with at least one embodiment of the present invention.
- user equipment 100 may include wireless communication unit 110 , audio/video (A/V) capturing unit 120 , input unit 130 , sensing unit 135 , video processing unit 140 , internal memory 150 , external memory 155 , display unit 160 , audio output unit 165 , a port unit 170 , a controller 180 , and a power supply 190 .
- Controller 180 may include an agent 182 and application framework 184 .
- Port unit 170 may include video input/output port 172 , audio input/output port 174 , and data input/output port 176 .
- Power supply unit 190 may include a battery for electric charging.
- User equipment 100 may be described as including the above constituent elements, but the present invention is not limited thereto.
- Wireless communication unit 110 may include at least one module for communicating with other party through a wireless communication system.
- wireless communication unit 110 may include any or all of a broadcasting signal receiving module, a mobile communication module, a wireless Internet module, a short-distance communication module, and a location information module.
- wireless communication unit 110 may be not an essential unit for user equipment 100 because user equipment 100 may be not required to communicate with another party. Accordingly, wireless communication unit 110 may be omitted in accordance with another embodiment of the present invention.
- A/V capturing unit 120 may capture an audio signal and/or a video signal.
- the A/V capturing unit 120 may include a camera and a microphone.
- the camera may process image frames of a still image or a moving image, which are captured by an image sensor in a video call mode or a photographing mode.
- the microphone may receive an audio signal provided externally in an on-call mode, a recording mode, or a voice recognition mode.
- Input unit 130 may be a user interface for receiving input from a user. Such an input unit 130 may be realized in various types. For example, input unit 130 may include any of a keypad, a dome switch, a touch pad, a jog wheel, and a jog switch, but is not limited thereto.
- user equipment 100 may be a full touch type smart phone.
- input unit 130 may include several hardware key buttons and a touch screen.
- the hardware key buttons may include a hold key and a volume control button.
- user equipment 100 may include a touch screen panel (not shown) as another input unit for receiving touch inputs in accordance with at least one embodiment of the present invention.
- the touch screen panel (not shown) may be disposed on an upper surface of display unit 160 , but the present invention is not limited thereto.
- input unit 130 may be configured to receive various user inputs from a user, for example, user inputs for activating one of applications installed in user equipment 100 and for closing one of application windows within a multiscreen display mode.
- Sensing unit 135 may detect a current status of user equipment 100 . For example, sensing unit 135 may sense an opening or closing of a cover of user equipment 100 , a location and a bearing of user equipment 100 , acceleration and deceleration of user equipment 100 , or physical contact with or proximity to a user. Based on the detected status of user equipment 100 , sensing unit 135 may generate a sensing signal to control the operation of user equipment 100 . For example, in the case of a mobile phone having a sliding type cover, sensing unit 135 may sense whether a cover is opened or closed. Sensing unit 135 may sense whether or not power supply 190 supplies power. Furthermore, sensing unit 135 may sense whether or not port unit 170 is coupled to external device 200 .
- sensing unit 135 may receive a detection signal from port unit 170 when user equipment 100 is connected to external device 200 in accordance with an embodiment of the present invention.
- sensing unit 135 may receive a detection signal from a hot plug detect (HPD) pin when port unit 170 includes a HDMI port.
- controller 160 may determine that external device 200 is connected to user equipment 100 .
- user equipment 100 may establish a host-device connection in accordance with at least one embodiment of the present invention. Such operation will be described in detail with reference to FIG. 8 in later.
- Video processing unit 140 may process an image signal and/or image data under the control of controller 160 . Particularly, video processing unit 140 may process image data according to a display setting determined based on display unit information of display unit 160 .
- the display setting may include a screen size, a screen resolution, a display direction, and a dot per inch (DPI) value.
- the display setting may be determined by controller 180 based on display unit information of display unit 160 .
- the display unit information may include a manufacturer, a model number, a device identifier (ID), a DPI value, a screen size, the number of pixels, supporting screen resolutions, supporting aspect ratios, refresh rates, and a response time.
- Video processing unit 140 may transmit the processed image data to display unit 160 of user equipment 100 in response to controller 160 .
- video processing unit 140 may process image data to be transmitted to external device 200 when user equipment 100 is connected to external device 200 .
- video processing unit 140 may, reconfigure image data based on a display setting of external device 200 and generate a signal based on the reconfigured image data in response to controller 180 .
- the present invention is not limited thereto. Such an operation may be performed by controller 160 .
- the image data may be data for displaying a graphic user interface produced by any software programs installed in user equipment 100 , such as an operating system and applications installed in user equipment 100 .
- Internal memory 150 and external memory 155 may be used as a data storage device of user equipment 100 .
- internal memory 150 and external memory 155 may store information necessary for operating user equipment 100 and performing certain operations requested by a user. Such information may include any software programs and related data.
- internal memory 150 and external memory 155 may store an operation system data, applications, and related data, received from an external device through a physical cable and downloaded from a related server from through a communication link.
- internal memory 150 and/or external memory 155 may store information on display setting determined for display unit 160 or display unit 260 of external device 200 .
- internal memory 150 and external memory 155 may store device unit information for candidate external devices connectable to user equipment 100 .
- internal memory 150 and/or external memory 150 may store a DPI table 800 as shown in FIG. 8 .
- Internal memory 150 may be a flash memory, hard disk, multimedia card micro memory, SD or XD memory, Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), magnetic memory, magnetic disk, or optical disk, but is not limited thereto.
- External memory 155 may be a SD card or a USB memory, but the present invention is not limited thereto.
- external device 200 may function as external memory 155 when external device 200 is coupled to user equipment 100 in accordance with an embodiment of the present invention.
- At least one of internal memory 150 and external memory 155 may store external device information received from the connected external device, for example, external device 200 .
- the external device information may include device type information and universal serial bus (USB) device information.
- the device type information includes information on a device type of the connected external device and the USB device information may include information on vender identification (VID) and product identification (PID) of the external device.
- VIP vender identification
- PID product identification
- internal memory 150 and external memory 155 may store a device table and application information.
- the device table may include device type information mapped to USB device information.
- the device table may be used to obtain the external device information.
- the application information may include information on whether an application is required for optimally controlling and driving constituent elements of the external device, an application type, and an address of a server for obtaining the required application.
- the application information may be used to determine an application required for controlling constituent element of the connected external device such as external device 200 .
- internal memory 150 may store information on a coupled external device and information on multiscreen mode display settings.
- Such multiscreen mode display settings may be stored in a form or a mapping table or a lookup table.
- the multiscreen mode display setting may include at least one of information on a number of application windows in the multiscreen display mode, a maximum number of allowed application windows, a display size of each application window, a position and a display orientation of each application window, arrangement of each application window, control menus and icons for controlling an overall graphic user interface of the multiscreen display mode and each application window, arrangement and sizes of the control menus and icons.
- Display unit 160 may be an output device for visually displaying information.
- display unit 160 may display image data produced or processed by video processing unit 140 and/or controller 180 .
- Display unit 160 may receive the image data from at least one of video processing unit 140 and controller 180 and display the received image data.
- the image data may be produced as a result of certain operations performed by any software programs installed in user equipment 100 .
- the image data may be data processed for displaying a graphic user interface produced by an operation system and applications, performed in user equipment 100 .
- the applications may be referred to as App.
- the image data may further include still images and moving images, produced or processed by video processing unit 140 and controller 180 .
- display unit 160 may be a liquid crystal display (LCD) panel or an active-matrix organic light-emitting diode (AMOLED) panel, but the present invention is not limited thereto.
- LCD liquid crystal display
- AMOLED active-matrix organic light-emitting diode
- display unit 160 may be interrupted to display the image data when user equipment 100 is connected to external device 200 .
- display unit 160 may be turned off or transit to a sleep mode in response to controller 180 when user equipment 100 is connected to external device 200 .
- Display unit 160 may be turned on again or transit back to an operation mode in response to controller 180 when user equipment 100 is disconnected from external device 200 . That is, display unit 160 may be turned off in the pointing device operation mode in accordance with embodiments of the present invention.
- controller 180 may transmit image data to external device 200 for displaying on the image data on display unit 260 of external device 200 .
- Audio output unit 165 may provide an output audio signal that may be produced or processed by controller 180 as a result of operations performed by an operating system and/or applications installed in user equipment 100 .
- Audio output unit 165 may include a speaker, a receiver, and a buzzer.
- Port unit 170 may include at least one port for exchanging signals and/or data with external device 200 .
- port unit 170 may transfer image data and audio data from user equipment 100 to external device 200 .
- Port unit 170 may exchange control data with external device 200 .
- Port unit 170 may be coupled to corresponding port unit 250 of external device 200 in various coupling manners.
- port unit 170 may be coupled to corresponding port unit 250 of external device 200 through a physical cable.
- port unit 170 may be directly interlocked with corresponding port unit 250 of external device 200 .
- the present invention is not limited thereto.
- Port unit 170 may be coupled to corresponding port unit 250 of external device 200 through a radio link formed between user equipment 100 and external device 200 .
- port unit 170 and port unit 250 may include a signal transmitter and receiver (not shown) for communicating with each other using a communication protocol.
- Such communication protocol may be Bluetooth, but the present invention is not limited thereto.
- port unit 170 may include video input/output port 172 , audio input/output port 174 , and data input/output port 176 , but the present invention is not limited thereto. Such port unit 170 may be embodied in various types. For example, port unit 170 may not include audio input/output interface 174 . Further, port unit 170 may include a power port (not shown). In this case, the power port may transfer power from external device 200 to user equipment 100 when external device 200 is coupled to user equipment 100 .
- user equipment 100 may be coupled to external device 200 through port unit 170 .
- user equipment 100 may control external device 200 by exchanging data with external device 200 through port unit 170 .
- user equipment 100 may receive inputs from a user through external device 170 and transmit control data to external device 170 through port unit 170 .
- user equipment 100 may transmit image data through port unit 170 to external device 200 and control external device 200 to display the image data such a graphic user interface instead of display unit 160 of user equipment 100 .
- Controller 180 may control overall operation of the constituent elements of user equipment 100 . Particularly, controller 180 may perform operations necessary for driving the constituent elements of user equipment 100 in response to inputs received from a related user. In accordance with an embodiment of the present invention, controller 180 may control overall operation of constituent elements of external device 200 when user equipment 100 is connected to external device 200 . For example, controller 180 may receive inputs through external device 200 , perform an operation in response to the received inputs, and provide the user with the result thereof through external device 200 . Particularly, controller 180 may display image data, as a result of operation related to the user inputs, on a display unit of external device 200 when user equipment 100 is connected to external device 200 .
- controller 180 may include agent 182 .
- Agent 182 may control operations related to connection to external device 200 and controlling external device 200 .
- agent 182 may be referred to as a coupling agent or a docking agent, but the present invention is not limited thereto.
- Agent 182 may be implemented in software.
- agent 182 may be realized on an application layer in an operating system (OS) structure of user equipment 100 .
- OS operating system
- such an OS structure may be an OS structure of an Android operating system, but present invention is not limited thereto.
- Agent 182 may also determine an application required for optimally controlling and driving constituent elements of external device 200 .
- agent 182 may obtain external device information from external device 200 . Based on the obtained external device information, agent 182 may determine whether any application required for optimally controlling the constituent elements of external device 200 and determine whether the required application is installed in user equipment 100 . Agent 182 may download the required application from an associated server when the required application is not installed in user equipment 100 . Such operations of agent 182 will be described in detail with reference to FIG. 7 to FIG. 9 in later.
- controller 180 may include application framework 184 .
- Application framework 184 may be an application framework layer of the OS structure and implemented in software.
- application framework 184 may perform operations for controlling a display setting in response to associated applications producing image data when user equipment 100 is connected to external device 200 .
- Application framework 184 may cooperate with agent 182 for controlling constituent elements of external device 200 .
- controller 180 may control overall operation for dynamically controlling an external device to display image data in a display mode different from that of the user equipment when the user equipment is connected to the external device. For example, controller 180 may determine whether to detect connection to an external device based on the detection signal generated by port unit 170 . Upon the detection of the connection, controller 180 may control the coupled external device to display image data produced in user equipment 100 on a display unit of the coupled external device in a display mode different from a display mode of the user equipment. Particularly, controller 180 , in cooperation with video processing unit 140 , may create image data in a multiscreen mode display setting associated with applications running in a multitasking mode and information on the coupled external device.
- Controller 180 may transmit the created image data to the coupled external device and control the external device to display the transmitted image data in a multiscreen display mode based on the associated multiscreen mode display setting. Such operation of controller 180 will be described in detail with reference to FIG. 6 to FIG. 8 .
- external device 200 may be coupled to user equipment 100 and may be controlled to display image data in a multiscreen display mode which is different than that of user equipment 100 in accordance with at least one embodiment of the present invention.
- external device 200 will be described in detail with reference to FIG. 5 .
- FIG. 5 is a block diagram illustrating an external device in accordance with at least one embodiment of the present invention.
- external device 200 may include display unit 260 , audio output unit 220 , keypad input unit 230 , signal processing unit 240 , port unit 250 , memory unit 210 , manager 270 , and power supply 280 .
- Display unit 260 , audio output unit 220 , keypad input unit 230 , memory 210 , and power supply unit 280 may be analogous to, and perform similar functions to, display unit 160 , audio output unit 165 , input unit 130 , internal memory unit 150 , and power supply unit 190 of user equipment 100 . Accordingly, the detailed description thereof will be omitted herein. For convenience and ease of understanding, only constituent elements performing distinct operations are described.
- Port unit 250 may be connected to port unit 170 of user equipment 100 . That is, port unit 250 may be a connecting port for forming connectivity between user equipment 100 and external device 200 . Accordingly, port unit 250 may be a pair relation with port unit 170 of user equipment 100 . Port unit 250 may have the same interface configuration of that of port unit 170 of user equipment 100 . For example, port unit 250 may have a HDMI port, a USB port, and an audio port.
- Port unit 250 may include video input/output port 252 , audio input/output port 254 , and data input/output port 256 .
- Video input/output port 252 may receive image data from user equipment 100 .
- Audio input/output port 254 may receive audio signals.
- Data input/output port 256 may exchange data with user equipment 100 .
- port unit 250 may include a power port (not shown) for transferring power to user equipment 100 and a sensing port (not shown) for sensing connection formed between user equipment 100 and external device 200 .
- the present invention is not limited thereto.
- port unit 250 may be connected to user equipment 100 through a radio link formed between user equipment 100 and external device 200 .
- port unit 250 may include a signal transmitter and receiver (not shown) for communicating with each other using a communication protocol.
- Such communication protocol may be Bluetooth® or WiFi, for example, but the present invention is not limited thereto.
- external device 200 may include coupling bay 251 in accordance with an embodiment of the present invention.
- Port unit 250 may be disposed on one side of coupling bay 251 .
- Coupling bay 251 may be formed at a part of a rear side of external device 200 .
- Coupling bay 215 may have a space for housing user equipment 100 .
- User equipment 100 may be inserted into coupling bay 215 .
- port unit 170 of user equipment 100 may be connected with port unit 250 of user equipment 200 when user equipment 100 is completely inserted into coupling bay 251 .
- Manager 270 may control overall operation for controlling constituent elements of external device 200 in response to user equipment 100 when external device 200 is coupled to user equipment 100 .
- manager 270 may receive control data from user equipment 100 through port unit 250 and perform operation in response to the control data.
- manager 270 may receive inputs from a related user and transmit the received input to user equipment 100 through port unit 250 .
- manager 270 may provide external device information to user equipment 100 when external device 200 is connected to user equipment 100 .
- the external device information may include at least one of device type information and USB device information.
- User equipment 100 may identify a device type of external device 200 based on the external device information and run an application determined based on the device type of external device 200 . Such application may produce operation results optimized for constituent elements of external device 200 .
- Manager 270 may receive such operation results from user equipment 100 and control constituent elements of external device 200 based on the received operation results in accordance with embodiments of the present invention. Furthermore, manager 270 may control related constituent elements to output the received operation results in accordance with embodiments of the present invention.
- Manager 270 may include connection setup unit 272 , display control module 274 , and input event processor 276 in accordance with an embodiment of the present invention.
- Connection setup unit 272 may activate the constituent elements of external device 200 when external device 200 initially senses that external device 200 is connected to user equipment 100 .
- connection setup unit 272 may supply power to the constituent elements of external device 200 . That is, connection setup unit 272 may transit a waiting state of external device 200 to a wakeup state of external device 200 . Accordingly, connection setup unit 272 may establish a host-device connection between user equipment 100 and external device 200 .
- External device 200 may provide a graphic user interface substantially identical to that displayed on user equipment 100 when external device 200 is connected to user equipment 100 .
- image data displayed on display unit 160 of user equipment 100 may be transferred to and displayed on display unit 260 of external device 200 .
- manager 270 may include display control module 274 .
- Display control module 274 may turn on display unit 260 under control of manager 270 when external device 200 is connected to user equipment 100 . Then, manager 274 may receive the image data displayed on display unit 160 of user equipment 100 from user equipment 100 and display the received image data on display unit 260 of external device 200 .
- input event processing unit 276 may generate an event signal corresponding to the input events and transfer the generated event signal to user equipment 100 .
- the generated event signal may be a signal for controlling operation of user equipment 100 corresponding to the received input events.
- external device 200 may not operate in a disconnected mode.
- the disconnected mode may denote that user equipment 100 is not connected to external device 200 .
- external device 200 may be a dummy device.
- external device 200 may include minimum elements for performing essential functions such as display control and touch input control.
- the present invention is not limited thereto.
- External device 200 may be embodied as an independent device installed with an operating system (OS) that allows external device 200 operating in a standalone device.
- OS operating system
- external device 200 may operate as a moving image player or a MP3 player when external device 200 is not coupled to user equipment 100 .
- external device 200 may perform certain operations of user equipment 100 in response to the control of user equipment 100 in accordance with embodiments of the present invention.
- user equipment 100 may control external device 200 to display image data in a multiscreen display mode which is different from that of user equipment 100 in accordance with at least one embodiment of the present invention. Such operation will be described with reference to FIG. 6 to FIG. 9 .
- FIG. 6 shows an external device controlled to display image data in a multiscreen display mode in accordance with at least one embodiment of the present invention.
- FIG. 7A to FIG. 7C show a method for dynamically controlling a display mode of an external device coupled to user equipment in accordance with at least one embodiment of the present invention.
- user equipment may operate as a standalone mode at step S 7010 .
- user equipment 100 may perform operations in response to user inputs in a standalone mode when user equipment 100 is not coupled to external device 200 .
- user equipment 100 may produce image data as a result of running applications (including an associated operating system) selected by a user in response to user inputs.
- User equipment 100 may display such produced image data on display unit 160 of user equipment 100 as a single screen display mode as shown in a diagram (A) of FIG. 2 .
- the single screen display mode may be a display mode that displays only one application window at a time although multiple applications are in operation as a background mode.
- typical user equipment may display only one application window associated with one that a user most recently activates among applications in operation.
- step S 7020 determination may be made as to whether to detect connection to an external device.
- port unit 170 of user equipment 100 may be coupled to corresponding port unit 250 of external device 200 .
- user equipment 100 may detect such physical connection to external device 200 based on a detection signal generated at port unit 170 of user equipment 100 .
- the present invention is not limited thereto.
- User equipment 100 may detect connection to external device 200 based on communications with external device 200 through a wireless link. For example, user equipment 100 may detect connection to external device 200 by exchanging a request message and a response message through a wireless link.
- the docking device may detect such connection to the external device in the same manner described above. After detection, such a hub device may inform of the detected connection to user equipment 100 .
- user equipment 100 may continuously operate as the standalone mode and display image data at the single screen display mode at step S 7010 .
- host-device connection may be established at step S 7030 .
- controller 180 of user equipment 100 may establish the host-device connection between user equipment 100 and external device 200 .
- an operation environment similar or about identical to that of user equipment 100 may be provided to a user through external device 200 .
- User equipment 100 may be described as a host device in accordance with an embodiment of the present invention. The present invention, however, is not limited thereto.
- External device 200 connected to user equipment 100 may be a host device in accordance with another embodiment of the present invention.
- Such establishing the host-device connection will be described in more detail with reference to FIG. 8 .
- a host-device connection display setting may be set based on information on a display unit of the coupled external device. Such operation will be described in more detail with reference to FIG. 8 .
- user equipment may create image data produced as a result of running applications based on the host-device connection display setting and transmit the created image data to the coupled external device.
- user equipment 100 may create image data as a result of activated applications based on the host-device connection display setting.
- a host-device connection display setting may be set during establishing the host-device connection between user equipment 100 and external device 200 .
- user equipment 100 may create image data according to at least one of a screen size, a resolution, a DPI, and a display orientation of display unit 260 of external device 200 .
- user equipment 100 may create image data with a display orientation for display unit 260 of external device, which is different than that of display unit 160 of user equipment 100 , as shown in a diagram (A) of FIG. 2 .
- user equipment 100 may create image data of a certain application differently than that created for display unit 160 of user equipment 100 .
- user equipment 100 may create the graphic user interface with more menus and icons than that created for display unit 160 of user equipment 100 .
- user equipment 100 may create mini App tray 640 and scroll direction icons 604 within the graphic user interface, which are different than a graphic user interface displayed on r user equipment 100 .
- the coupled external device may be controlled to display the transferred image data on a display unit thereof in a single screen display mode.
- user equipment 100 may control external device 200 to display the transferred image data on display unit 260 in the single screen display mode, as shown in diagram (A) of FIG. 6 .
- external device 200 is described as simply displaying image data received from user equipment 100 , the present invention is not limited thereto.
- external device 200 may modify the image data from user equipment 100 according to own display properties and conditions and display the modified image data on display unit 260 of external device 200 .
- step S 7060 determination may be made as to whether a user input is an activation input for activating a new application when the user input is received from a user. For example, when user equipment 100 receives the user input from the user, user equipment 100 may determine whether the received user input is an activation input for activating one of applications installed in user equipment 100 .
- user equipment 100 may perform operations associated with the user input. Then, user equipment 100 may create and transmit image data, as a result of performing the operation, based on host-device connection display setting at step S 7040 and continuously control external device 200 to display the created image data in the single screen display mode at step S 7050 .
- the multitasking operation mode may be an operating state of simultaneously running at least two applications.
- an operating system of user equipment 100 may be executed and produce image data for a default home screen and display the default home screen on display unit 260 of external device 200 , as shown in a diagram (A) of FIG. 6 .
- the default home screen may be a graphic user interface (GUI) displayed on a display unit when user equipment 100 is initially turned on or when user equipment 100 is in an idle state after turned on.
- GUI graphic user interface
- Such default home screen may be created by an operating system of user equipment 100 .
- Such operating system might be considered as an application.
- a user input may be received for activating application 601 .
- Such user input may initiate a multitasking operation mode.
- step S 7070 determination may be made as to whether a display area size of the coupled external device is greater than a reference size of a display unit when the user input is determined as the activation input (Yes—S 7060 ). For example, user equipment 100 may determine whether the display size of external device 200 is greater than a reference display size upon the receipt of the activation input. That is, when the multitasking operation mode is initiated, user equipment 100 may determine whether the display size of external device 200 is greater than the reference display size. Such determination may be made based on information on external device 200 which is obtained while establishing the host-device connection at the step S 7030 .
- step S 7070 is the method determines whether external device 200 coupled to user equipment 100 has a display size suitable for displaying at least two application windows simultaneously.
- Each application window may be a graphic user interface produced as a result of performing an associated application. That is, it is determined whether external device 200 has a display size suitable for a multiscreen display mode in accordance with at least one embodiment of the present invention.
- external device 200 may have a display size large enough for simultaneously displaying at least two application windows each of which might has a display size of user equipment 100 . For example, when user equipment 100 has a display size of four inches, external device 200 may have a display size of about eight inches for suitably displaying two application windows at once. If the display size of external device 200 is not greater than about eight inches, user equipment 100 may control external device 200 to display image data in a single screen display mode.
- Such a reference display size may be decided in consideration of various factors including a display size of user equipment 100 , a size of one application window, and a typical display size of each type of external devices.
- the reference display size may be set by a manufacturer of user equipment 100 . In this case, such reference display size may be decided in a designing process of user equipment 100 and stored in user equipment 100 .
- the reference display size may be dynamically set by each user of user equipment 100 .
- a user interface may be provided to user to input a reference display size.
- a related user may input a predetermined display size such as about ten inches as the reference display size.
- a tablet PC may a display size of about ten inches.
- a user interface may be provided to a user to select at least one of an external device type such as a desktop personal computer (PC), a tablet PC, a laptop PC, or a TV.
- PC desktop personal computer
- a related user may input a predetermined external device type and a typical display size of the selected external device type may be set as the reference display size.
- Such user interface for setting the reference display size may be provided after user equipment 100 is coupled to external device 200 . That is, a related user may change the reference display size after user equipment 100 is coupled to external device 200 .
- step S 7070 may be omitted in another embodiment of the present invention.
- user equipment 100 may control external device 200 to display at least two application windows in the multiscreen display mode without considering the display size of external device 200 .
- user equipment 100 may provide another user interface for enabling a user to select one of a single screen display mode and a multiscreen display mode after a new application is activated while displaying an application window in a single display mode. As described above, switching between a single screen display mode and a multiscreen display mode may be performed through various methods in accordance with at least one embodiment of the present invention.
- user equipment 100 may create image data of the newly activated application based on the host-device connection display setting, transmit the created image data to external device 200 at step S 7040 , and control external device 200 to display the image data in the single screen mode a step S 7050 .
- user equipment 100 may control external device 200 to display the same screen that user equipment 100 displays on display unit 160 of user equipment 100 (i.e., mirrored screen) but based on the host-device connection display setting.
- the number of applications for the multitasking operation mode may be determined when the display size of external device 200 is greater than the reference display size (Yes—S 7060 ).
- user equipment 100 may determine the number of applications to be performed as the multitasking statue. According to the determined number of applications, user equipment 100 may decide the number of application windows to be displayed in the multiscreen display mode in accordance with at least one embodiment of the present invention.
- multiscreen mode display setting associated with the determined number may be obtained.
- user equipment 100 may obtain information on multiscreen mode display setting associated with the determined number of applications to be performed in the multitasking statue. That is, user equipment 100 may retrieve such a multiscreen mode display setting from memory 150 of user equipment 100 .
- the multiscreen mode display setting may denote display properties for displaying at least two application windows in the multiscreen display mode.
- the multiscreen mode display setting may include various display properties such as the number of application windows in a multiscreen display mode, a display size of each application window, a position and a display orientation of each application window, arrangement of each application window, control menus and icons for controlling an overall graphic user interface of the multiscreen display mode and each application window, and arrangement and sizes of the control menus and icons, but the present invention is not limited thereto.
- a diagram (C) of FIG. 6 may show two application windows displayed in a dual screen display mode. As shown, two application windows 610 - 2 and 630 are displayed each in two divided display areas of display unit 260 of external device 200 . Furthermore, closing icon 603 and mini app tray 640 are displayed with two application windows 610 - 2 and 630 .
- Such arrangement, sizes, and display orientations of two application windows 610 - 2 and 630 and the control menus and icons may be determined based on the retrieved multiscreen mode display setting in accordance with at least one embodiment of the present invention.
- Such multiscreen mode display setting may be stored in memory 150 in a form of a mapping table. Based on the determined number of applications in the multitasking status, related multiscreen display setting may be retrieved. For example, when two applications are running in the multitasking statue, multiscreen display setting associated with a dual screen display mode may be retrieved from memory 150 .
- the multiscreen mode display setting may be determined based on various parameters of user equipment 100 and external device 200 coupled to user equipment 100 .
- the multiscreen mode display setting may be determined based on a processing power and a memory size of user equipment 100 and a display size of external device 200 . That is, the processing power and the memory size of user equipment 100 may be used to determine the maximum display size of external device 200 because the maximum display area of external device 200 may differ according to the processing power and the memory of user equipment 100 .
- the display size of external device 200 may be considered to determine the maximum number of application windows in the multiscreen display mode. For example, when the display size of external device 200 is larger than about 20 inches, at least four application windows may be displayed in the multiscreen mode.
- the multiscreen mode display setting may be determined and stored in user equipment 100 by a related manufacturer, but the present invention is not limited thereto.
- the multiscreen mode display setting may be determined and stored in user equipment 100 by a related user.
- user equipment 100 may provide a user interface or an application for setting such multiscreen mode display setting.
- the information of the multiscreen mode display setting may be stored in memory 150 in a form of a lookup table, but the present invention is not limited thereto.
- user equipment 100 may obtain such multiscreen mode display setting from other entity through a communication network in associated with an external device coupled to user equipment 100 .
- user equipment 100 may obtain information on the coupled external device upon the connection to the external device and request an associated multiscreen mode display setting to a related web server through a communication network. In response to the request, user equipment 100 may obtain the associated multiscreen mode display setting from the related web server.
- image data of each application may be generated based on the obtained multiscreen mode display setting.
- user equipment 100 may create image data as a result of running each application in response to user inputs associated with each application.
- user equipment 100 may refer related information in the obtained multiscreen mode display setting for creating each application window, such as a display size and a display orientation of each application window.
- user equipment 100 may create image data for application window 620 - 1 and create image data for application window 610 - 1 .
- the image data for application window 610 - 1 may be produced as a result of activating application icon 601 .
- image data of a multiscreen display mode may be created based on the obtained multiscreen mode display setting at step S 7110 .
- user equipment 100 may combine the created image data of each application window and create control menu and icons based on the obtained multiscreen mode display setting in accordance with at least one embodiment of the present invention. That is, user equipment 100 may create multiscreen image data by combining the created image data for application window 610 - 1 and the created image data for application window 620 - 1 based on the obtained multiscreen mode display setting as shown in a diagram (B) of FIG. 6 .
- the created multiscreen image data may be transferred to the coupled external device.
- user equipment 100 may transmit the created multiscreen image data to external device 200 .
- the coupled external device may be controlled to display the multiscreen image data.
- user equipment 100 may control external device 200 to display the multiscreen image data as shown in the diagram (B) of FIG. 6 . That is, user equipment 100 may control external device 200 to simultaneously display application window 610 - 1 and another application window 620 - 1 in a dual screen display mode as shown in the diagram (B) of FIG. 6 .
- user equipment 100 may determine a type of a user input upon the receipt of the user input.
- user equipment 100 may continuously display application windows in the multiscreen mode at step S 7100 to S 7130 .
- user equipment 100 may determine whether the number of application windows associated with the current multiscreen display mode reaches the maximum number of application windows allowed within the current multiscreen display mode at step S 7150 .
- the maximum number may also denote the maximum number of application windows allowed to be displayed at once within the current multiscreen display mode.
- Such information may be included in the multiscreen mode display setting, but the present invention is not limited thereto. For example, when a related user activates application icon 602 in application window 620 - 1 while displaying the multiscreen image data as shown in the diagram (B) of FIG. 6 , user equipment 100 may determine whether the number of multitasking application windows reaches the maximum number based on the associated multiscreen mode display setting.
- the step S 7090 may be performed. For example, the previous number of application windows in the multiscreen display mode may be increased by one and a multiscreen mode display setting may be newly obtained based on the updated number of application windows. Then, image data may be created based on the obtained multiscreen mode display setting at step S 7100 to S 7130 .
- user equipment 100 may interrupt creating image data of one of previously activated applications at step S 7160 .
- external device 200 may have two as the maximum number of application windows allowed to be displayed in a multiscreen display mode because of a display size of external device 200 .
- Such information may be included in the associated multiscreen mode display setting.
- application icon 602 is activated while application window 610 - 1 and application window 620 - 1 are displayed in a dual screen mode, the number of application windows reaches the maximum number because the number of application windows in the current multiscreen display mode and the maximum number is two.
- user equipment 100 may interrupt one of applications to create image data thereof.
- Such interrupted application may be selected by various conditions.
- an operating system may be the first one to be interrupted.
- the oldest one of the activated applications, except the operating system may be selected and interrupted to create image data, but the present invention is not limited thereto.
- the operating system is interrupted to create image data thereof.
- the selected application is interrupted to create image data, operation of the selected application is not interrupted.
- the selected application may be still running in a background mode.
- image data of the newly activated application may be generated.
- user equipment 100 may produce image data of the newly activated application associated with the activated application icon 602 of the diagram (B) of FIG. 6 . That is, image data for application window 630 (diagram (C) of FIG. 6 ) is produced.
- user equipment 100 may create image data of the multiscreen display mode and control external device 200 to display the created image data in the multiscreen display mode at step S 7110 to S 7130 .
- application window 610 - 2 and application window 630 may be displayed in the dual screen display mode as shown in the diagram (C) of FIG. 6 .
- control menus 640 and icons 603 and 604 may be further displayed with application windows 610 - 2 and 630 based on the associated multiscreen mode display setting as shown in the diagram (C) of FIG. 6 .
- user equipment 100 may determine whether the user input is a closing input for closing one of application windows displayed in the multiscreen mode at step S 7180 when the received user input is not the activation input (Other—S 7140 ).
- the closing input may be initiated by clicking closing icon 603 shown in the diagram (C) of FIG. 6 .
- user equipment 100 may interrupt creating image data of the application window associated with the closing input at step S 7190 .
- closing icon 603 of application window 610 - 2 is activated (diagram (C) of FIG. 6 )
- user equipment 100 may interrupt creating image data of the application associated with application window 610 - 2 .
- the application may be running in a background mode.
- user equipment 100 may determine whether the associated multiscreen display mode is a dual screen display mode.
- the associated multiscreen display mode is the dual screen display mode as shown in the diagram (C) of FIG. 6 (Yes—S 7200 )
- user equipment 100 may determine whether any application is running in the background mode at step S 7210 .
- user equipment 100 may resume one of the applications running in the background mode to create image data at step S 7220 .
- one lastly interrupted may be selected to be resumed, but the present invention is not limited thereto.
- the operating system of user equipment 100 may be selected as an application to be resumed as shown in a diagram (D) of FIG. 6 .
- the created image data may be combined and displayed as the dual screen display mode at the steps S 7110 to S 7130 .
- application window 6230 - 2 of the operating system may be resumed and displayed with application window 603 of the lastly activated application in the dual screen mode.
- user equipment 100 may create and transmit image data of remaining application based on the host-device connection display setting at step S 7040 and control external device 200 to display the created image data in the single screen display mode at step S 7050 .
- user equipment 100 may decrease the number of applications in the multitasking operation mode by one at step S 7230 . Using the decreased application number, user equipment 100 may obtain an associated multiscreen mode display setting at step S 7090 and control external device 200 to display remaining application windows in the multiscreen mode at steps S 7100 to S 7130 .
- user equipment 100 may perform operation related to the user input at step S 7240 and create image data of an associated application window based on a result of the performed operation at step S 7250 . Then, user equipment 100 may continuously control external device 200 to display the application windows in the multiscreen mode at steps S 7100 to S 7130 .
- the multiscreen display mode is described as being initiated without consideration of a type of application in accordance with at least one embodiment of the present invention.
- the present invention is not limited thereto.
- a type of an activated application may be considered to initiate the multiscreen display mode in accordance with another embodiment of the present invention.
- a multiscreen display mode may be initiated only when a user activates a designated application such as an Internet browser, an image viewer, a moving image player, and a documenter editor.
- a multiscreen display mode may be initiated only when a user activates two related applications such as an Internet browser with a document editor and an image viewer with an email writer.
- the initiation of the multiscreen display mode may be set in various methods.
- external device 200 is described as being controlled to display an overall graphic user interface (GUI) of a multiscreen display mode in a landscape orientation and each application window of the overall GUI in a portrait orientation, but the present invention is not limited thereto.
- GUI graphic user interface
- Such orientation may be controlled differently in accordance with another embodiment of the present invention.
- one of application windows may be displayed in a portrait orientation and the other may be displayed in a landscape orientation while the overall GUI of the multiscreen display mode in a portrait orientation.
- Such display orientations of the overall GUI of the multiscreen display mode and each application window may be set in the multiscreen mode display setting.
- external device 200 is described as being controlled to display the overall GUI of a multiscreen display mode in a landscape orientation and a display area of external device 200 is described as being divided into a left display area and a right display area.
- the present invention is not limited thereto.
- external device 200 may be controlled to display a multiscreen display mode in a portrait orientation and the display area of external device 200 may be divided into a top display area and a bottom display area in accordance with another embodiment of the present invention.
- the display area of external device 200 is described as being divided evenly, but the present invention is not limited thereto.
- the display area of external device 200 may be divided unevenly according to a type of each application running in a multitasking mode.
- the host-device connection may be established as described in step S 7030 of FIG. 7A . Such operation will be described in more detail with reference to FIG. 8 .
- FIG. 8 shows a method for establishing host-device connection at least one embodiment of the present invention.
- an operation mode may be changed to a connected mode at step S 8010 .
- controller 180 may change the operation mode to the connected mode when controller 180 senses the connection to external device 200 .
- the connected mode may be opposite to a standalone mode or a disconnected mode.
- the connected mode may denote an operation mode of user equipment 100 when user equipment 100 is coupled to external device 200 .
- display device information of external device may be obtained.
- the display device information of external device 200 may include information on a screen size, a resolution, a display orientation, and a dot per inch (DPI) of display unit 260 of external device 200 .
- DPI dot per inch
- Such display device information may be obtained through a request.
- user equipment 100 may request display unit information to external device 200 and obtain the display unit information from external device 200 .
- user equipment 100 may identify a display unit type of external device 200 and retrieve related display unit information from internal memory 150 .
- agent 182 may request and receive display unit information from external device 200 . Based on the display unit information, agent 182 may identify hardware specification of display unit 260 of external device 200 .
- agent 182 may receive extended display identification data (EDID) from external device 200 .
- the EDID may be information on hardware specification of display unit 260 of external device 200 .
- the EDID may include information on a manufacturer, a model number, an EDID version, an appropriate DPI value, a screen size, supporting screen resolutions, luminance, and the number of pixels.
- the present invention is not limited thereto.
- user equipment 100 may store, in internal memory 150 , display unit information of candidate external devices that might be connected to user equipment 100 .
- the stored display unit information may be mapped to a device ID of each candidate external device.
- Such mapping information may be managed by agent 182 of user equipment 100 .
- user equipment 100 may receive or recognize a device ID of external device 200 . Based on the device ID, user equipment 100 may obtain the display unit information of display unit 260 of external device 200 from the stored display unit information.
- step S 8030 determination may be made as to whether it is necessary to reconfigure initial display settings based on the obtained display device information. For example, controller 180 may determine whether it is necessary to reconfigure an initial display setting based on the obtained information.
- the initial display setting may be reconfigured based on the obtained display device information as a host-device connection display setting at step S 8040 .
- controller 180 may reconfigure the initial display setting based on the obtained display device information of external device 200 .
- the host-device connection display setting is stored in memory 150 of user equipment 100 .
- the initial display setting may be used as the host-device connection display setting without modification at step S 8050 .
- controller 180 may store the initial display setting as the host-device connection display setting in memory 150 of user equipment 100 .
- the host-device connection display setting stored in memory 150 may be retrieved and used for displaying the image data on the coupled external device at step S 7110 ( FIG. 7 ) in accordance with at least one embodiment of the present invention.
- user equipment 100 When user equipment 100 operates in a standalone mode, user equipment 100 may display image data based on the initial display setting of display unit 160 of user equipment 100 . After user equipment 100 is connected to external device 200 , user equipment 100 may display the image data on display unit 260 of external device 200 based on the host-connection display setting. User equipment 100 may be required to reconfigure the initial display setting based on a resolution of display unit 260 of external device 200 . When a resolution of display unit 260 of external device 200 is identical to or compatible to that for display unit 160 of user equipment 100 , reconfiguration of image data may not be necessary.
- displaying setting may be reconfigured based on other parameters included in the obtained display device information, for example, a screen size, a display orientation, and a DPI.
- display unit 160 of user equipment 100 may have a screen size different from display unit 260 of external device 200 .
- such display setting may be reconfigured based on the screen size for display unit 260 of external device 200 .
- video processing unit 140 may process the image data based on the display setting, including a screen size, a display orientation, and a DPI, suitable for display unit 260 of external device 200 and transmit the processed image data to external device 200 .
- controller 180 may transmit image data created for display unit 160 of user equipment 100 to external device 200 without reconfiguration and external device 200 may reconfigure the received image data based on a DPI for display unit 260 of external device 200 . Such operation may be performed through signal processing unit 240 of external device 200 .
- display unit 260 of external device 200 may optimally display images through reconfiguring image data based on a resolution and a DPI of display unit 260 of external device 200 .
- a display orientation may be considered to create or to reconfigure image data in accordance with embodiments of the present invention.
- user equipment 100 such as a smart phone may have a portrait display orientation as a default display orientation.
- External devices 200 such as laptop notebook or tablet PC, known as a smart pad, may have a landscape display orientation as a default display orientation.
- agent 182 may i) obtain information on a default display orientation of display unit 260 of external device 200 based on the obtained display unit information including a resolution, a screen size, and product identification and ii) determine whether the default display orientation of external device 200 is identical to or different from that of user equipment 100 based on the obtained display device information.
- controller 180 may reconfigure image data based on the default display orientation of external device 200 in addition to the resolution and the DPI of external device 200 .
- exemplary is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the word exemplary is intended to present concepts in a concrete fashion.
- the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise, or clear from context, “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, if X employs A; X employs B; or X employs both A and B, then “X employs A or B” is satisfied under any of the foregoing instances.
- the articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or clear from context to be directed to a singular form.
- a component may be, but is not limited to being, a process running on a controlling unit, a controlling unit, an object, an executable, a thread of execution, a program, and/or a computer.
- a component may be, but is not limited to being, a process running on a controlling unit, a controlling unit, an object, an executable, a thread of execution, a program, and/or a computer.
- an application running on a controller and the controller can be a component.
- One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers.
- the present invention can be embodied in the form of methods and apparatuses for practicing those methods.
- the present invention can also be embodied in the form of program code embodied in tangible media, such as magnetic recording media, optical recording media, solid state memory, floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
- the present invention can also be embodied in the form of program code, for example, whether stored in a storage medium, loaded into and/or executed by a machine, or transmitted over some transmission medium or carrier, such as over electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention.
- program code segments When implemented on a general-purpose controlling unit, the program code segments combine with the controlling unit to provide a unique device that operates analogously to specific logic circuits.
- the present invention can also be embodied in the form of a bitstream or other sequence of signal values electrically or optically transmitted through a medium, stored magnetic-field variations in a magnetic recording medium, etc., generated using a method and/or an apparatus of the present invention.
- the term “compatible” means that the element communicates with other elements in a manner wholly or partially specified by the standard, and would be recognized by other elements as sufficiently capable of communicating with the other elements in the manner specified by the standard.
- the compatible element does not need to operate internally in a manner specified by the standard.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Controls And Circuits For Display Device (AREA)
- Digital Computer Display Output (AREA)
- User Interface Of Digital Computer (AREA)
- Telephone Function (AREA)
Abstract
Description
- The present application claims priority under 35 U.S.C. §119 to Korean Patent Application No. 10-2011-0141016 (filed on Dec. 23, 2011), which is hereby incorporated by reference in its entirety.
- The subject matter of this application is related to U.S. patent application Ser. No. 13/540,112 filed Jul. 2, 2012, as Attorney Docket No.: (801.0050), U.S. patent application Ser. No. 13/539,929 filed Jul. 2, 2012, as Attorney Docket No.: (801.0051), U.S. patent application Ser. No. 13/460,091 filed Apr. 30, 2012, as Attorney Docket No.: (801.0061), U.S. patent application Ser. No. 13/598,741 filed Aug. 30, 2012, as Attorney Docket No.: (801.0081), U.S. patent application Ser. No. 13/726,361 filed Dec. 24, 2012, as Attorney Docket No.: (801.0083), U.S. patent application Ser. No. ______ filed ______, as Attorney Docket No.: (801.0085), U.S. patent application Ser. No. ______ filed ______, as Attorney Docket No.: (801.0086), U.S. patent application Ser. No. 13/726,384 filed Dec. 24, 2012, as Attorney Docket No.: (801.0087), and U.S. patent application Ser. No. ______ filed ______, as Attorney Docket No.: (801.0089), the teachings of which are incorporated herein their entirety by reference.
- The present invention relates to user equipment and, in particular, to dynamically controlling a display mode of an external device coupled to user equipment.
- User equipment has advanced so as to perform multiple functions such as communicating voice and data with others; exchanging text messages or multimedia messages; sending e-mails; capturing a still or moving image; playing back a music or a video file, playing a game, and a receiving a broadcast signal. Lately, such multi-functional user equipment has received greater attention for new applications. Instead of using multiple independent devices, a user prefers to use single multifunction-enabled user equipment. Portability and/or mobility should be considered in design of user equipment, but such user equipment has limitations in size. Accordingly, there also are limitations in display screen size, screen resolution, and speaker performance.
- In order to overcome such limitations, an external device having a large display size, better speaker performance, and connectable to a mobile terminal has been introduced. Such external device connected to the mobile terminal can provide data, music files, and other content stored in the mobile terminal in better performance.
- For example, user equipment is coupled to an external device having a larger display area and displays a mirrored screen that is exactly same as a screen displayed on user equipment. Due to a comparatively small display area of the user equipment, the user equipment may be designed to display only one application window of currently running application. Such a display mode may be referred to as a single display mode. Since the display unit of the coupled external device is typically controlled as the single display mode, the benefit of using the larger display area of the coupled external device may be not maximized.
- This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.
- Embodiments of the present invention overcome the above disadvantages and other disadvantages not described above. Also, the present invention is not required to overcome the disadvantages described above, and an embodiment of the present invention may not overcome any of the problems described above.
- In accordance with an aspect of the present invention, a display mode of an external device may be controlled dynamically according to a display size of the external device when the external device is coupled to user equipment.
- In accordance with another aspect of the present invention, user equipment may control an external device to display image data in a multiscreen display mode when user equipment is coupled to the external device.
- In accordance with at least one embodiment of the present invention, a method of a user equipment may be provided for dynamically controlling a display mode of an external device coupled to user equipment. The method may include determining whether to detect connection to an external device and upon the detection of the connection, controlling the coupled external device to display image data produced in the user equipment on a display unit of the coupled external device in a display mode different from a display mode of the user equipment.
- The display mode of the coupled external device may be a multiscreen display mode and the display mode of the user equipment may be a single screen display mode.
- The controlling may include creating image data in a multiscreen mode display setting associated with applications running in a multitasking mode of the user equipment and information on the coupled external device, transmitting the created image data to the coupled external device, and controlling the external device to display the transmitted image data in a multiscreen display mode based on the associated multiscreen mode display setting.
- The controlling may include determining whether a display size of the coupled external device is greater than a reference display size upon the detection of the connection. When the display size of the coupled external device is determined as being greater than a reference display size, the controlling may include controlling the coupled external device to display the image data produced by the user equipment on the display unit of the coupled external device in a multiscreen display mode.
- The controlling may include determining whether a display size of the coupled external device is greater than a reference display size upon the detection of the connection, determining a number of applications running in a multitasking mode of the user equipment when the display size of the coupled external device is determined as being greater than a reference display size, obtaining a multiscreen mode display setting of the coupled external device based on the determined number of applications running in a multitasking mode of the user equipment and information on the coupled external device, and controlling the coupled external device to display the produced image data on the display unit of the coupled external device in a multiscreen display mode based on the obtained multiscreen mode display setting.
- The method may further include establishing a host-device connection between the user equipment and the coupled external device and setting a host-device connection display setting based on information on a display unit of the coupled external device upon the detection of the connection, creating image data as a result of running an application in the user equipment based on the host-device connection display setting, transmitting the created image data to the coupled external device and controlling the coupled external device to display the transmitted image data in a single screen mode, determining whether a user input is received for activating one of applications installed in the user equipment, upon the receipt of the user input for activating, creating image data of the currently activated application, creating multiscreen image data by combining the created image data of the currently activated application and the created image data of the running application based on an associated multiscreen mode display setting, and transmitting the created multiscreen image data to the external device. In this case, the controlling may include controlling the coupled external device to display the transmitted multiscreen image data in a dual screen display mode based on the associated multiscreen mode display setting.
- The method may further include establishing a host-device connection between the user equipment and the coupled external device upon the detection of the connection, determining whether a display size of the coupled external device is greater than a reference display size upon the detection of the connection, determining a number of applications running in a multitasking mode of the user equipment when the display size of the coupled external device is greater than a reference display size, and obtaining a multiscreen mode display setting based on the determined number of applications running in a multitasking mode of the user equipment and information on the coupled external device. In this case, the controlling may includes creating multiscreen image data by combining image data produced by each application running in the multitasking mode of the user equipment based on the obtained multiscreen mode display setting, transmitting the created multiscreen image data to the coupled external device, and controlling the coupled external device to display the transmitted multiscreen mode image data in a multiscreen display mode based on the obtained multiscreen mode display setting.
- The method may further include obtaining a multiscreen mode display setting based on a number of applications running in the user equipment and information on the coupled external device. The multiscreen mode display setting may include at least one of information on a number of application windows in the multiscreen display mode, a maximum number of allowed application windows, a display size of each application window, a position and a display orientation of each application window, arrangement of each application window, control menus and icons for controlling an overall graphic user interface of the multiscreen display mode and each application window, arrangement and sizes of the control menus and icons.
- The obtaining may include retrieving, from a memory of the user equipment, the multiscreen mode display setting associated with the number of multitasking applications running in the user equipment and the information on the coupled external device. In this case, information on the multiscreen mode display setting may be stored in a form of a lookup table in the memory of the user equipment.
- The obtaining may include determining the multiscreen mode display setting based on the number of multitasking application running in the user equipment and the information on the coupled external device.
- The method may further include determining whether an user input is received for activating a new application after controlling the coupled external device to display image data produced in the user equipment in the multiscreen display mode, upon the receipt of the user input for activating a new application, interrupting creating image data of one of running applications associated with the multiscreen display mode, creating image data of the newly activated application and continuously creating image data of remaining applications associated with the multiscreen display mode, creating multiscreen image data by combining the created image data of the newly activated application and the continuously created image data of the remaining applications based on an associated multiscreen mode display setting, and transmitting the created multiscreen image data to the coupled external device. In this case, the controlling may include controlling the coupled external device to display the transmitted multiscreen image data in the associated multiscreen display mode based on the associated multiscreen mode display setting.
- The application interrupted to create image data may be running in a background mode.
- The determining may include, upon the receipt of the user input for activating a new application, determining whether a number of application windows in a current multiscreen display mode reaches a maximum number of application windows allowed within the current multiscreen display mode. When the number of application windows in the current multiscreen display mode is smaller than the maximum number, the determining may include obtaining a multiscreen mode display setting by increasing a number of associated multitasking applications by one, creating multiscreen image data based on the newly obtained multiscreen mode display setting by additionally including image data produced by the newly activated application, and transmitting the created multiscreen image data to the coupled external device and controlling the external device to display the transmitted multiscreen image data based on the newly obtained multiscreen mode display setting.
- The method may further include determining whether a user input is received for closing one of application windows in the multiscreen display mode after controlling the coupled external device to display image data produced in the user equipment in the multiscreen display mode. In this case, upon the receipt of the user input for closing one of application windows, the method may further include interrupting creating image data of the application associated with the user input, resuming one of applications running in a background mode to create image data and continuously creating image data of applications not associated with the user input, creating multiscreen image data by combining the created image data of the resumed application and the continuously created image data of the applications not associated with the user input based on an associated multiscreen mode display setting, and transmitting the created multiscreen image data to the coupled external device. In this case, the controlling may include controlling the coupled external device to display the transmitted multiscreen image data in the associated multiscreen display mode based on the associated multiscreen mode display setting.
- In accordance with at least one embodiment of the present invention, a user equipment may be provided for dynamically controlling a display mode of an external device coupled thereto. The user equipment may be configured to determine whether to detect connection to an external device. Upon the detection of the connection, the user equipment may be configured to control the coupled external device to display image data produced in the user equipment on a display unit of the coupled external device in a display mode different from a display mode of the user equipment.
- The above and/or other aspects of the present invention will become apparent and more readily appreciated from the following description of embodiments, taken in conjunction with the accompanying drawings, of which:
-
FIG. 1 shows various external devices connected to user equipment in accordance with at least one embodiment of the present invention; -
FIG. 2 shows a typical method of user equipment for controlling an external device to display image data when the user equipment is coupled to the external device; -
FIG. 3 shows user equipment and an external device in accordance with at least one embodiment of the present invention; -
FIG. 4 is a block diagram illustrating user equipment in accordance with at least one embodiment of the present invention; -
FIG. 5 is a block diagram illustrating an external device in accordance with at least one embodiment of the present invention; -
FIG. 6 shows an external device controlled to display image data in a multiscreen display mode in accordance with at least one embodiment of the present invention; -
FIG. 7A toFIG. 7C show a method for dynamically controlling a display mode of an external device coupled to user equipment in accordance with at least one embodiment of the present invention; and -
FIG. 8 shows a method for establishing host-device connection at least one embodiment of the present invention. - Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like reference numerals refer to like elements throughout. The embodiments are described below, in order to explain the present invention by referring to the figures.
- In accordance with at least one embodiment of the present invention, user equipment may control an external device to display image data in a display mode different from that of the user equipment when user equipment is coupled to the external device. Such user equipment may be coupled to various types of external devices. The external devices will be described with reference to
FIG. 1 . For convenience and ease of understanding, user equipment will be described as a mobile terminal such as a mobile phone or a smart phone throughout the accompanying drawings. The present invention, however, is not limited thereto. -
FIG. 1 shows various external devices connected to user equipment in accordance with at least one embodiment of the present invention. - Referring to
FIG. 1 ,user equipment 100 is an image data source device that may be coupled to various types of external devices. For example,user equipment 100 may be coupled to pad type device 200-1 as shown in a diagram (A) and coupled to laptop type device 200-2 as shown in a diagram (B). Furthermore,user equipment 100 may be coupled to monitor 200-3 as shown in a diagram (C) and coupled to large sized screen 200-4 as shown in a diagram (D). Although not illustrated inFIG. 1 , other types of devices may be coupled touser equipment 100 as an external device for displaying image data produced byuser equipment 100. -
User equipment 100 may be coupled to an external device in various manners. For such connection,user equipment 100 and the external device may include input/output ports 170 and 250 (FIG. 3 andFIG. 4 ). For example,user equipment 100 may be docked at a docking bay of an external device. As shown in the diagrams (A) and (B), pad type device 200-1 and laptop computer 200-2 may include a docking bay specially designed to receiveuser equipment 100. Furthermore,user equipment 100 may be coupled to an external device through a physical cable. As shown in the diagram (C),user equipment 100 may be coupled to monitor 200-3 through a physical cable such as a video and/or audio input/output cable. In addition,user equipment 100 may be coupled to an external device through a wireless manner such as WiFi, WiFi direct, and wireless high definition multimedia interface (HDMI). As shown in the diagram (D),user equipment 100 may be coupled to large sized screen 200-4 through signal receiving device 900 for receiving an image data signal fromuser equipment 100 through a wireless link. -
FIG. 2 shows a typical method of user equipment for controlling an external device to display image data when the user equipment is coupled to the external device. - As shown in
FIG. 2 ,user equipment 100 is coupled toexternal device 200 having a larger display size. After the connection,user equipment 100 may exchange data withexternal device 200 through predetermined coupling interfaces such asport units 170 and 250 (FIG. 3 ), but the present invention is not limited thereto.User equipment 100 may communicate withexternal device 200 through various manners such as wireless communication. Particularly,user equipment 100 operates as an image data source device and transfers image data produced inuser equipment 100 toexternal device 200.External device 200 receives and displays the image data fromuser equipment 100 in response to the control ofuser equipment 100. - Typically,
external device 200 displays mirrored image data that is exactly same as image data displayed onuser equipment 100. Sinceuser equipment 100 displays the image data in a single screen display mode,external device 200 displays the mirrored image data in the single screen display mode. For example, as shown in diagrams (A) and (B),user equipment 100 andexternal device 200 display the same screen in the single screen display mode. The diagram (A) ofFIG. 2 shows a default home screen ofuser equipment 100. The default home screen may be a graphic user interface (GUI) produced by an operation system ofuser equipment 100. Whenuser equipment 100 is initially turned on or whenuser equipment 100 is in an idle state,user equipment 100 displays the default home screen as shown in the diagram (A) ofFIG. 2 . Whenexternal device 200 is coupled touser equipment 100,external device 200 displays the same default home screen in the single screen mode becauseexternal device 200 is controlled to display the same image data produced inuser equipment 100 anduser equipment 100 displays the produced image data in the single display mode. When a related user activate one of applications installed inuser equipment 100 for playing a moving image whileexternal device 200 is coupled touser equipment 100,external device 200 displays image data produced by the activated application in the single screen display mode as shown in a diagram (B) ofFIG. 2 .External device 200 is controlled to display the same image data produced inuser equipment 100 in the single display mode. - Due to such a typical way of controlling a display mode of
external device 200, the benefit of using a larger display area ofexternal device 200 is not maximized. In order to overcome such disadvantage of the typical way of controlling the display mode ofexternal device 200, the display mode ofexternal device 200 may be dynamically controlled according to a display size ofexternal device 200 in accordance with at least one embodiment of the present invention. For example,user equipment 100 may controlexternal device 200 to display image data in a multiscreen display mode whenuser equipment 100 is coupled toexternal device 200. The multiscreen display mode may be a display mode for simultaneously display at least two application windows produced as a result of performing multiple applications at the same time. That is,user equipment 100 may controlexternal device 200 to display image data in a display mode different from that ofuser equipment 100 in accordance with at least one embodiment of the present invention. Such operation will be described in detail with reference toFIG. 6 toFIG. 8 . - Before describing the operation,
user equipment 100 andexternal device 200 will be described with reference toFIG. 3 toFIG. 5 . For convenience and ease of understanding, user equipment will be representatively described as a mobile phone or a smart phone through the specification and an external device will be representatively described as a pad-type device or a tablet PC, but the present invention is not limited thereof. -
FIG. 3 shows user equipment and an external device in accordance with at least one embodiment of the present invention. - Referring to a diagram (A) of
FIG. 3 ,user equipment 100 may includedisplay unit 160 and at least oneport unit 170.Such port unit 170 may be referred to as an interface unit.Display unit 160 may display data according to display setting ofuser equipment 100.Display unit 160 may typically have about 4.5 inch display area which may be smaller than that of an external device, but the present invention is not limited thereto. For example, a display area of an external device may be smaller than that ofuser equipment 100. - At least one
port unit 170 may be coupled to an external device and exchange data with the external device.User equipment 100 may be capable of processing data and transferring the processed data to an external device throughport unit 170. Such aport unit 170 may include a high definition multimedia interface (HDMI) port and/or a universal serial bus (USB) port, but the present invention is not limited thereto.User equipment 100 may have a certain design or standardized interface connectable to an external device. For example,user equipment 100 may be attachable to and/or detachable from an external device.User equipment 100 may dock to an external device.User equipment 100 may be any electronic device that can perform the above and further operations described herein. For example,user equipment 100 may include, but is not limited to, a mobile terminal, a mobile device, a mobile phone, a portable terminal, a portable device, a handheld device, a cellular phone, a smart phone, a personal digital assistant (PDA), wireless local loop (WLL) station, a portable multimedia player (PMP), and a navigation device. The present invention, however, is not limited thereto, and other types of user equipment, such as mini-laptop PCs and other computing devices may incorporate embodiments of the present invention.User equipment 100 will be described in more detail with reference toFIG. 4 . - Referring to diagrams (B) and (C) of
FIG. 3 ,external device 200 may includedisplay unit 260,key buttons 230, at least one pot unit 250, and speaker 265.Display unit 260 may display image data.Display unit 260 may have a display area larger than that ofuser equipment 100. For example,display unit 260 may have about 10.1 inch of display area. The present invention, however, is not limited thereto.External device 200 may have a display area smaller than that ofuser equipment 100. In accordance with at least one embodiment of the present invention,display unit 260 may display image data fromuser equipment 100 in a display mode different from that ofuser equipment 100. For example,display unit 260 may display image data in a multiscreen display mode. - At least one port unit 250 may be coupled to corresponding
port unit 170 of exchanging data withuser equipment 100. Accordingly, at least oneport unit 270 may include a HDMI port and/or a USB port corresponding toport unit 170 ofuser equipment 100.External device 200 may be capable of receiving data fromuser equipment 100 through at least one port unit 250 and displaying the received data ondisplay unit 260.External device 200 may have a certain design connectable touser equipment 100 through at least one port unit 250. For example,external device 200 may be attachable to and/or detachable fromuser equipment 100 as described above with respect to diagrams (D) and (E) ofFIG. 3 .External device 200 may havestructure 251 for receiving and holding user equipment 100 (diagram (C) ofFIG. 3 ). Such structure may be referred to ascoupling bay 251.External device 200 may be any electronic device that can perform the above operation. For example,external device 200 may include a notebook computer, a laptop computer, a tablet PC, a pad having a touch screen, and a pad having a display unit and a keyboard, but the present invention is not limited thereto. In accordance with at least one embodiment of the present invention,external device 200 may be activated whenuser equipment 100 is connected toexternal device 200 and controlled byuser equipment 100. Accordingly,external device 200 may have at least constituent elements for necessary operation performed under the control ofuser equipment 100. - Referring to diagrams (D) and (E) of
FIG. 3 ,user equipment 100 may be coupled to external device in a docking manner. For example,user equipment 100 may be inserted incoupling bay 251 ofexternal device 200 in a top-to-bottom direction anduser equipment 100 may be completely inserted intocoupling bay 251 ofexternal device 200 until at least oneport unit 170 ofuser equipment 100 is interlocked to at least one port unit 250 ofexternal device 200. AlthoughFIG. 3 shows thatuser equipment 100 is coupled withexternal device 200 in a docking manner, the present invention is not limited thereto.User equipment 100 may be coupled toexternal device 200 in other manners such as wireless connection through a radio link. - Hereinafter,
user equipment 100 will be described in more detail with reference toFIG. 4 . As described above,user equipment 100 may be coupled toexternal device 100 and control coupledexternal device 200 to display image data in a multiscreen display mode which is different from that ofuser equipment 100 in accordance with at least one embodiment of the present invention. -
FIG. 4 is a block diagram illustrating user equipment in accordance with at least one embodiment of the present invention. - Referring to
FIG. 4 ,user equipment 100 may includewireless communication unit 110, audio/video (A/V)capturing unit 120,input unit 130, sensingunit 135,video processing unit 140,internal memory 150,external memory 155,display unit 160,audio output unit 165, aport unit 170, acontroller 180, and apower supply 190.Controller 180 may include anagent 182 andapplication framework 184.Port unit 170 may include video input/output port 172, audio input/output port 174, and data input/output port 176.Power supply unit 190 may include a battery for electric charging.User equipment 100 may be described as including the above constituent elements, but the present invention is not limited thereto. -
Wireless communication unit 110 may include at least one module for communicating with other party through a wireless communication system. For example,wireless communication unit 110 may include any or all of a broadcasting signal receiving module, a mobile communication module, a wireless Internet module, a short-distance communication module, and a location information module. In accordance with an embodiment of the present invention,wireless communication unit 110 may be not an essential unit foruser equipment 100 becauseuser equipment 100 may be not required to communicate with another party. Accordingly,wireless communication unit 110 may be omitted in accordance with another embodiment of the present invention. - A/
V capturing unit 120 may capture an audio signal and/or a video signal. For example, the A/V capturing unit 120 may include a camera and a microphone. The camera may process image frames of a still image or a moving image, which are captured by an image sensor in a video call mode or a photographing mode. The microphone may receive an audio signal provided externally in an on-call mode, a recording mode, or a voice recognition mode. -
Input unit 130 may be a user interface for receiving input from a user. Such aninput unit 130 may be realized in various types. For example,input unit 130 may include any of a keypad, a dome switch, a touch pad, a jog wheel, and a jog switch, but is not limited thereto. - In accordance with at least one embodiment of the present invention,
user equipment 100 may be a full touch type smart phone. In this case,input unit 130 may include several hardware key buttons and a touch screen. The hardware key buttons may include a hold key and a volume control button. Furthermore,user equipment 100 may include a touch screen panel (not shown) as another input unit for receiving touch inputs in accordance with at least one embodiment of the present invention. The touch screen panel (not shown) may be disposed on an upper surface ofdisplay unit 160, but the present invention is not limited thereto. In accordance with at least one embodiment of the present invention,input unit 130 may be configured to receive various user inputs from a user, for example, user inputs for activating one of applications installed inuser equipment 100 and for closing one of application windows within a multiscreen display mode. -
Sensing unit 135 may detect a current status ofuser equipment 100. For example, sensingunit 135 may sense an opening or closing of a cover ofuser equipment 100, a location and a bearing ofuser equipment 100, acceleration and deceleration ofuser equipment 100, or physical contact with or proximity to a user. Based on the detected status ofuser equipment 100, sensingunit 135 may generate a sensing signal to control the operation ofuser equipment 100. For example, in the case of a mobile phone having a sliding type cover, sensingunit 135 may sense whether a cover is opened or closed.Sensing unit 135 may sense whether or notpower supply 190 supplies power. Furthermore, sensingunit 135 may sense whether or notport unit 170 is coupled toexternal device 200. In this case, sensingunit 135 may receive a detection signal fromport unit 170 whenuser equipment 100 is connected toexternal device 200 in accordance with an embodiment of the present invention. For example, sensingunit 135 may receive a detection signal from a hot plug detect (HPD) pin whenport unit 170 includes a HDMI port. Based on the detection signal,controller 160 may determine thatexternal device 200 is connected touser equipment 100. Upon the receipt of the detection signal,user equipment 100 may establish a host-device connection in accordance with at least one embodiment of the present invention. Such operation will be described in detail with reference toFIG. 8 in later. -
Video processing unit 140 may process an image signal and/or image data under the control ofcontroller 160. Particularly,video processing unit 140 may process image data according to a display setting determined based on display unit information ofdisplay unit 160. The display setting may include a screen size, a screen resolution, a display direction, and a dot per inch (DPI) value. The display setting may be determined bycontroller 180 based on display unit information ofdisplay unit 160. The display unit information may include a manufacturer, a model number, a device identifier (ID), a DPI value, a screen size, the number of pixels, supporting screen resolutions, supporting aspect ratios, refresh rates, and a response time.Video processing unit 140 may transmit the processed image data to displayunit 160 ofuser equipment 100 in response tocontroller 160. Furthermore,video processing unit 140 may process image data to be transmitted toexternal device 200 whenuser equipment 100 is connected toexternal device 200. For example,video processing unit 140 may, reconfigure image data based on a display setting ofexternal device 200 and generate a signal based on the reconfigured image data in response tocontroller 180. The present invention, however, is not limited thereto. Such an operation may be performed bycontroller 160. The image data may be data for displaying a graphic user interface produced by any software programs installed inuser equipment 100, such as an operating system and applications installed inuser equipment 100. -
Internal memory 150 andexternal memory 155 may be used as a data storage device ofuser equipment 100. For example,internal memory 150 andexternal memory 155 may store information necessary for operatinguser equipment 100 and performing certain operations requested by a user. Such information may include any software programs and related data. For example,internal memory 150 andexternal memory 155 may store an operation system data, applications, and related data, received from an external device through a physical cable and downloaded from a related server from through a communication link. In accordance with an embodiment of the present invention,internal memory 150 and/orexternal memory 155 may store information on display setting determined fordisplay unit 160 ordisplay unit 260 ofexternal device 200. Furthermore,internal memory 150 andexternal memory 155 may store device unit information for candidate external devices connectable touser equipment 100. In addition,internal memory 150 and/orexternal memory 150 may store a DPI table 800 as shown inFIG. 8 .Internal memory 150 may be a flash memory, hard disk, multimedia card micro memory, SD or XD memory, Random Access Memory (RAM), Static Random Access Memory (SRAM), Read-Only Memory (ROM), Programmable Read-Only Memory (PROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), magnetic memory, magnetic disk, or optical disk, but is not limited thereto.External memory 155 may be a SD card or a USB memory, but the present invention is not limited thereto. For example,external device 200 may function asexternal memory 155 whenexternal device 200 is coupled touser equipment 100 in accordance with an embodiment of the present invention. - In accordance with embodiment of the present invention, at least one of
internal memory 150 andexternal memory 155 may store external device information received from the connected external device, for example,external device 200. The external device information may include device type information and universal serial bus (USB) device information. The device type information includes information on a device type of the connected external device and the USB device information may include information on vender identification (VID) and product identification (PID) of the external device. - Furthermore,
internal memory 150 andexternal memory 155 may store a device table and application information. The device table may include device type information mapped to USB device information. The device table may be used to obtain the external device information. The application information may include information on whether an application is required for optimally controlling and driving constituent elements of the external device, an application type, and an address of a server for obtaining the required application. The application information may be used to determine an application required for controlling constituent element of the connected external device such asexternal device 200. - In accordance with at least one embodiment of the present invention,
internal memory 150 may store information on a coupled external device and information on multiscreen mode display settings. Such multiscreen mode display settings may be stored in a form or a mapping table or a lookup table. The multiscreen mode display setting may include at least one of information on a number of application windows in the multiscreen display mode, a maximum number of allowed application windows, a display size of each application window, a position and a display orientation of each application window, arrangement of each application window, control menus and icons for controlling an overall graphic user interface of the multiscreen display mode and each application window, arrangement and sizes of the control menus and icons. -
Display unit 160 may be an output device for visually displaying information. For example,display unit 160 may display image data produced or processed byvideo processing unit 140 and/orcontroller 180.Display unit 160 may receive the image data from at least one ofvideo processing unit 140 andcontroller 180 and display the received image data. The image data may be produced as a result of certain operations performed by any software programs installed inuser equipment 100. For example, the image data may be data processed for displaying a graphic user interface produced by an operation system and applications, performed inuser equipment 100. The applications may be referred to as App. Also, the image data may further include still images and moving images, produced or processed byvideo processing unit 140 andcontroller 180. For example,display unit 160 may be a liquid crystal display (LCD) panel or an active-matrix organic light-emitting diode (AMOLED) panel, but the present invention is not limited thereto. - In accordance with at least one embodiment of the present invention,
display unit 160 may be interrupted to display the image data whenuser equipment 100 is connected toexternal device 200. For example,display unit 160 may be turned off or transit to a sleep mode in response tocontroller 180 whenuser equipment 100 is connected toexternal device 200.Display unit 160 may be turned on again or transit back to an operation mode in response tocontroller 180 whenuser equipment 100 is disconnected fromexternal device 200. That is,display unit 160 may be turned off in the pointing device operation mode in accordance with embodiments of the present invention. After turning offdisplay unit 160,controller 180 may transmit image data toexternal device 200 for displaying on the image data ondisplay unit 260 ofexternal device 200. -
Audio output unit 165 may provide an output audio signal that may be produced or processed bycontroller 180 as a result of operations performed by an operating system and/or applications installed inuser equipment 100.Audio output unit 165 may include a speaker, a receiver, and a buzzer. -
Port unit 170 may include at least one port for exchanging signals and/or data withexternal device 200. In accordance with at least one embodiment of the present invention,port unit 170 may transfer image data and audio data fromuser equipment 100 toexternal device 200.Port unit 170 may exchange control data withexternal device 200.Port unit 170 may be coupled to corresponding port unit 250 ofexternal device 200 in various coupling manners. For example,port unit 170 may be coupled to corresponding port unit 250 ofexternal device 200 through a physical cable. Furthermore,port unit 170 may be directly interlocked with corresponding port unit 250 ofexternal device 200. The present invention, however, is not limited thereto.Port unit 170 may be coupled to corresponding port unit 250 ofexternal device 200 through a radio link formed betweenuser equipment 100 andexternal device 200. In this case,port unit 170 and port unit 250 may include a signal transmitter and receiver (not shown) for communicating with each other using a communication protocol. Such communication protocol may be Bluetooth, but the present invention is not limited thereto. - As shown in
FIG. 4 ,port unit 170 may include video input/output port 172, audio input/output port 174, and data input/output port 176, but the present invention is not limited thereto.Such port unit 170 may be embodied in various types. For example,port unit 170 may not include audio input/output interface 174. Further,port unit 170 may include a power port (not shown). In this case, the power port may transfer power fromexternal device 200 touser equipment 100 whenexternal device 200 is coupled touser equipment 100. - In accordance with an embodiment of the present invention,
user equipment 100 may be coupled toexternal device 200 throughport unit 170. Afteruser equipment 100 coupled toexternal device 200,user equipment 100 may controlexternal device 200 by exchanging data withexternal device 200 throughport unit 170. For example,user equipment 100 may receive inputs from a user throughexternal device 170 and transmit control data toexternal device 170 throughport unit 170. Particularly,user equipment 100 may transmit image data throughport unit 170 toexternal device 200 and controlexternal device 200 to display the image data such a graphic user interface instead ofdisplay unit 160 ofuser equipment 100. -
Controller 180 may control overall operation of the constituent elements ofuser equipment 100. Particularly,controller 180 may perform operations necessary for driving the constituent elements ofuser equipment 100 in response to inputs received from a related user. In accordance with an embodiment of the present invention,controller 180 may control overall operation of constituent elements ofexternal device 200 whenuser equipment 100 is connected toexternal device 200. For example,controller 180 may receive inputs throughexternal device 200, perform an operation in response to the received inputs, and provide the user with the result thereof throughexternal device 200. Particularly,controller 180 may display image data, as a result of operation related to the user inputs, on a display unit ofexternal device 200 whenuser equipment 100 is connected toexternal device 200. - In order to control
external device 200 whenuser equipment 100 is connected toexternal device 200,controller 180 may includeagent 182.Agent 182 may control operations related to connection toexternal device 200 and controllingexternal device 200.Such agent 182 may be referred to as a coupling agent or a docking agent, but the present invention is not limited thereto.Agent 182 may be implemented in software. For example,agent 182 may be realized on an application layer in an operating system (OS) structure ofuser equipment 100. For example, such an OS structure may be an OS structure of an Android operating system, but present invention is not limited thereto. -
Agent 182 may also determine an application required for optimally controlling and driving constituent elements ofexternal device 200. In order to determine,agent 182 may obtain external device information fromexternal device 200. Based on the obtained external device information,agent 182 may determine whether any application required for optimally controlling the constituent elements ofexternal device 200 and determine whether the required application is installed inuser equipment 100.Agent 182 may download the required application from an associated server when the required application is not installed inuser equipment 100. Such operations ofagent 182 will be described in detail with reference toFIG. 7 toFIG. 9 in later. - Furthermore,
controller 180 may includeapplication framework 184.Application framework 184 may be an application framework layer of the OS structure and implemented in software. In accordance with an embodiment of the present invention,application framework 184 may perform operations for controlling a display setting in response to associated applications producing image data whenuser equipment 100 is connected toexternal device 200.Application framework 184 may cooperate withagent 182 for controlling constituent elements ofexternal device 200. - In accordance with embodiments of the present invention,
controller 180 may control overall operation for dynamically controlling an external device to display image data in a display mode different from that of the user equipment when the user equipment is connected to the external device. For example,controller 180 may determine whether to detect connection to an external device based on the detection signal generated byport unit 170. Upon the detection of the connection,controller 180 may control the coupled external device to display image data produced inuser equipment 100 on a display unit of the coupled external device in a display mode different from a display mode of the user equipment. Particularly,controller 180, in cooperation withvideo processing unit 140, may create image data in a multiscreen mode display setting associated with applications running in a multitasking mode and information on the coupled external device.Controller 180 may transmit the created image data to the coupled external device and control the external device to display the transmitted image data in a multiscreen display mode based on the associated multiscreen mode display setting. Such operation ofcontroller 180 will be described in detail with reference toFIG. 6 toFIG. 8 . - As described,
external device 200 may be coupled touser equipment 100 and may be controlled to display image data in a multiscreen display mode which is different than that ofuser equipment 100 in accordance with at least one embodiment of the present invention. Hereinafter,external device 200 will be described in detail with reference toFIG. 5 . -
FIG. 5 is a block diagram illustrating an external device in accordance with at least one embodiment of the present invention. - Referring to
FIG. 5 ,external device 200 may includedisplay unit 260, audio output unit 220,keypad input unit 230,signal processing unit 240, port unit 250, memory unit 210,manager 270, and power supply 280.Display unit 260, audio output unit 220,keypad input unit 230, memory 210, and power supply unit 280 may be analogous to, and perform similar functions to,display unit 160,audio output unit 165,input unit 130,internal memory unit 150, andpower supply unit 190 ofuser equipment 100. Accordingly, the detailed description thereof will be omitted herein. For convenience and ease of understanding, only constituent elements performing distinct operations are described. - Port unit 250 may be connected to
port unit 170 ofuser equipment 100. That is, port unit 250 may be a connecting port for forming connectivity betweenuser equipment 100 andexternal device 200. Accordingly, port unit 250 may be a pair relation withport unit 170 ofuser equipment 100. Port unit 250 may have the same interface configuration of that ofport unit 170 ofuser equipment 100. For example, port unit 250 may have a HDMI port, a USB port, and an audio port. - Port unit 250 may include video input/
output port 252, audio input/output port 254, and data input/output port 256. Video input/output port 252 may receive image data fromuser equipment 100. Audio input/output port 254 may receive audio signals. Data input/output port 256 may exchange data withuser equipment 100. Furthermore, port unit 250 may include a power port (not shown) for transferring power touser equipment 100 and a sensing port (not shown) for sensing connection formed betweenuser equipment 100 andexternal device 200. The present invention, however, is not limited thereto. For example, port unit 250 may be connected touser equipment 100 through a radio link formed betweenuser equipment 100 andexternal device 200. In this case, port unit 250 may include a signal transmitter and receiver (not shown) for communicating with each other using a communication protocol. Such communication protocol may be Bluetooth® or WiFi, for example, but the present invention is not limited thereto. - Referring back to
FIG. 2 ,external device 200 may includecoupling bay 251 in accordance with an embodiment of the present invention. Port unit 250 may be disposed on one side ofcoupling bay 251. Couplingbay 251 may be formed at a part of a rear side ofexternal device 200. Coupling bay 215 may have a space forhousing user equipment 100.User equipment 100 may be inserted into coupling bay 215. In accordance with an embodiment of the present invention,port unit 170 ofuser equipment 100 may be connected with port unit 250 ofuser equipment 200 whenuser equipment 100 is completely inserted intocoupling bay 251. -
Manager 270 may control overall operation for controlling constituent elements ofexternal device 200 in response touser equipment 100 whenexternal device 200 is coupled touser equipment 100. In accordance with an embodiment of the present invention,manager 270 may receive control data fromuser equipment 100 through port unit 250 and perform operation in response to the control data. Furthermore,manager 270 may receive inputs from a related user and transmit the received input touser equipment 100 through port unit 250. - Furthermore
manager 270 may provide external device information touser equipment 100 whenexternal device 200 is connected touser equipment 100. The external device information may include at least one of device type information and USB device information.User equipment 100 may identify a device type ofexternal device 200 based on the external device information and run an application determined based on the device type ofexternal device 200. Such application may produce operation results optimized for constituent elements ofexternal device 200.Manager 270 may receive such operation results fromuser equipment 100 and control constituent elements ofexternal device 200 based on the received operation results in accordance with embodiments of the present invention. Furthermore,manager 270 may control related constituent elements to output the received operation results in accordance with embodiments of the present invention. -
Manager 270 may includeconnection setup unit 272, display control module 274, and input event processor 276 in accordance with an embodiment of the present invention.Connection setup unit 272 may activate the constituent elements ofexternal device 200 whenexternal device 200 initially senses thatexternal device 200 is connected touser equipment 100. For example,connection setup unit 272 may supply power to the constituent elements ofexternal device 200. That is,connection setup unit 272 may transit a waiting state ofexternal device 200 to a wakeup state ofexternal device 200. Accordingly,connection setup unit 272 may establish a host-device connection betweenuser equipment 100 andexternal device 200. -
External device 200 may provide a graphic user interface substantially identical to that displayed onuser equipment 100 whenexternal device 200 is connected touser equipment 100. In such a connected state, image data displayed ondisplay unit 160 ofuser equipment 100 may be transferred to and displayed ondisplay unit 260 ofexternal device 200. In order to display the transferred image data ondisplay unit 260,manager 270 may include display control module 274. Display control module 274 may turn ondisplay unit 260 under control ofmanager 270 whenexternal device 200 is connected touser equipment 100. Then, manager 274 may receive the image data displayed ondisplay unit 160 ofuser equipment 100 fromuser equipment 100 and display the received image data ondisplay unit 260 ofexternal device 200. - When
touch input unit 230 and keypad input unit 235 ofexternal device 200 receive input events such as a touch input in a connected state, input event processing unit 276 may generate an event signal corresponding to the input events and transfer the generated event signal touser equipment 100. The generated event signal may be a signal for controlling operation ofuser equipment 100 corresponding to the received input events. - In accordance with an embodiment of the present invention,
external device 200 may not operate in a disconnected mode. The disconnected mode may denote thatuser equipment 100 is not connected toexternal device 200. Accordingly,external device 200 may be a dummy device. In this case,external device 200 may include minimum elements for performing essential functions such as display control and touch input control. The present invention, however, is not limited thereto.External device 200 may be embodied as an independent device installed with an operating system (OS) that allowsexternal device 200 operating in a standalone device. For example,external device 200 may operate as a moving image player or a MP3 player whenexternal device 200 is not coupled touser equipment 100. Whenexternal device 200 is coupled touser equipment 100,external device 200 may perform certain operations ofuser equipment 100 in response to the control ofuser equipment 100 in accordance with embodiments of the present invention. - As described above,
user equipment 100 may controlexternal device 200 to display image data in a multiscreen display mode which is different from that ofuser equipment 100 in accordance with at least one embodiment of the present invention. Such operation will be described with reference toFIG. 6 toFIG. 9 . -
FIG. 6 shows an external device controlled to display image data in a multiscreen display mode in accordance with at least one embodiment of the present invention.FIG. 7A toFIG. 7C show a method for dynamically controlling a display mode of an external device coupled to user equipment in accordance with at least one embodiment of the present invention. - Referring to
FIG. 7A , user equipment may operate as a standalone mode at step S7010. For example,user equipment 100 may perform operations in response to user inputs in a standalone mode whenuser equipment 100 is not coupled toexternal device 200. In the standalone mode,user equipment 100 may produce image data as a result of running applications (including an associated operating system) selected by a user in response to user inputs.User equipment 100 may display such produced image data ondisplay unit 160 ofuser equipment 100 as a single screen display mode as shown in a diagram (A) ofFIG. 2 . The single screen display mode may be a display mode that displays only one application window at a time although multiple applications are in operation as a background mode. For example, typical user equipment may display only one application window associated with one that a user most recently activates among applications in operation. - At step S7020, determination may be made as to whether to detect connection to an external device. For example, when
user equipment 100 is coupled toexternal device 200,port unit 170 ofuser equipment 100 may be coupled to corresponding port unit 250 ofexternal device 200. In this case,user equipment 100 may detect such physical connection toexternal device 200 based on a detection signal generated atport unit 170 ofuser equipment 100. The present invention, however, is not limited thereto.User equipment 100 may detect connection toexternal device 200 based on communications withexternal device 200 through a wireless link. For example,user equipment 100 may detect connection toexternal device 200 by exchanging a request message and a response message through a wireless link. When a docking device is already coupled touser equipment 100 as a hub device and another external device is coupled to such a hub device, the docking device may detect such connection to the external device in the same manner described above. After detection, such a hub device may inform of the detected connection touser equipment 100. - When connection to an external device is not detected (No—S7020),
user equipment 100 may continuously operate as the standalone mode and display image data at the single screen display mode at step S7010. - When connection to an external device is detected (Yes—S7020), host-device connection may be established at step S7030. For example,
controller 180 ofuser equipment 100 may establish the host-device connection betweenuser equipment 100 andexternal device 200. By establishing the host-device connection, an operation environment similar or about identical to that ofuser equipment 100 may be provided to a user throughexternal device 200.User equipment 100 may be described as a host device in accordance with an embodiment of the present invention. The present invention, however, is not limited thereto.External device 200 connected touser equipment 100 may be a host device in accordance with another embodiment of the present invention. Such establishing the host-device connection will be described in more detail with reference toFIG. 8 . During the host-device connection, a host-device connection display setting may be set based on information on a display unit of the coupled external device. Such operation will be described in more detail with reference toFIG. 8 . - At step S7040, user equipment may create image data produced as a result of running applications based on the host-device connection display setting and transmit the created image data to the coupled external device. For example,
user equipment 100 may create image data as a result of activated applications based on the host-device connection display setting. Such a host-device connection display setting may be set during establishing the host-device connection betweenuser equipment 100 andexternal device 200. Based on the host-device connection display setting,user equipment 100 may create image data according to at least one of a screen size, a resolution, a DPI, and a display orientation ofdisplay unit 260 ofexternal device 200. For example, whenuser equipment 100 is coupled toexternal device 200,user equipment 100 may create image data with a display orientation fordisplay unit 260 of external device, which is different than that ofdisplay unit 160 ofuser equipment 100, as shown in a diagram (A) ofFIG. 2 . Furthermore,user equipment 100 may create image data of a certain application differently than that created fordisplay unit 160 ofuser equipment 100. Particularly, whenuser equipment 100 creates a graphic user interface fordisplay unit 260 ofexternal device 200,user equipment 100 may create the graphic user interface with more menus and icons than that created fordisplay unit 160 ofuser equipment 100. For example, whenuser equipment 100 is coupled toexternal device 200,user equipment 100 may createmini App tray 640 and scrolldirection icons 604 within the graphic user interface, which are different than a graphic user interface displayed onr user equipment 100. - At step S7050, the coupled external device may be controlled to display the transferred image data on a display unit thereof in a single screen display mode. For example,
user equipment 100 may controlexternal device 200 to display the transferred image data ondisplay unit 260 in the single screen display mode, as shown in diagram (A) ofFIG. 6 . Althoughexternal device 200 is described as simply displaying image data received fromuser equipment 100, the present invention is not limited thereto. For example,external device 200 may modify the image data fromuser equipment 100 according to own display properties and conditions and display the modified image data ondisplay unit 260 ofexternal device 200. - At step S7060, determination may be made as to whether a user input is an activation input for activating a new application when the user input is received from a user. For example, when
user equipment 100 receives the user input from the user,user equipment 100 may determine whether the received user input is an activation input for activating one of applications installed inuser equipment 100. - When the received user input is not the activation input (No—S7060),
user equipment 100 may perform operations associated with the user input. Then,user equipment 100 may create and transmit image data, as a result of performing the operation, based on host-device connection display setting at step S7040 and continuously controlexternal device 200 to display the created image data in the single screen display mode at step S7050. - When the user input is the activation input (Yes—S7060), such activation input may initiate a multitasking operation mode of
user equipment 100. The multitasking operation mode may be an operating state of simultaneously running at least two applications. For example, whenuser equipment 100 is turned on and coupled toexternal device 200, an operating system ofuser equipment 100 may be executed and produce image data for a default home screen and display the default home screen ondisplay unit 260 ofexternal device 200, as shown in a diagram (A) ofFIG. 6 . The default home screen may be a graphic user interface (GUI) displayed on a display unit whenuser equipment 100 is initially turned on or whenuser equipment 100 is in an idle state after turned on. Such default home screen may be created by an operating system ofuser equipment 100. Such operating system might be considered as an application. While displaying the home screen as shown in the diagram (A) ofFIG. 6 , a user input may be received for activatingapplication 601. Such user input may initiate a multitasking operation mode. - At step S7070, determination may be made as to whether a display area size of the coupled external device is greater than a reference size of a display unit when the user input is determined as the activation input (Yes—S7060). For example,
user equipment 100 may determine whether the display size ofexternal device 200 is greater than a reference display size upon the receipt of the activation input. That is, when the multitasking operation mode is initiated,user equipment 100 may determine whether the display size ofexternal device 200 is greater than the reference display size. Such determination may be made based on information onexternal device 200 which is obtained while establishing the host-device connection at the step S7030. - In the step S7070, is the method determines whether
external device 200 coupled touser equipment 100 has a display size suitable for displaying at least two application windows simultaneously. Each application window may be a graphic user interface produced as a result of performing an associated application. That is, it is determined whetherexternal device 200 has a display size suitable for a multiscreen display mode in accordance with at least one embodiment of the present invention. In order to display multiple application windows in the multiscreen display mode,external device 200 may have a display size large enough for simultaneously displaying at least two application windows each of which might has a display size ofuser equipment 100. For example, whenuser equipment 100 has a display size of four inches,external device 200 may have a display size of about eight inches for suitably displaying two application windows at once. If the display size ofexternal device 200 is not greater than about eight inches,user equipment 100 may controlexternal device 200 to display image data in a single screen display mode. - Such a reference display size may be decided in consideration of various factors including a display size of
user equipment 100, a size of one application window, and a typical display size of each type of external devices. The reference display size may be set by a manufacturer ofuser equipment 100. In this case, such reference display size may be decided in a designing process ofuser equipment 100 and stored inuser equipment 100. Furthermore, the reference display size may be dynamically set by each user ofuser equipment 100. For example, a user interface may be provided to user to input a reference display size. A related user may input a predetermined display size such as about ten inches as the reference display size. In general, a tablet PC may a display size of about ten inches. Alternatively, a user interface may be provided to a user to select at least one of an external device type such as a desktop personal computer (PC), a tablet PC, a laptop PC, or a TV. A related user may input a predetermined external device type and a typical display size of the selected external device type may be set as the reference display size. Such user interface for setting the reference display size may be provided afteruser equipment 100 is coupled toexternal device 200. That is, a related user may change the reference display size afteruser equipment 100 is coupled toexternal device 200. - Furthermore, the step S7070 may be omitted in another embodiment of the present invention. For example, when a new application is activated,
user equipment 100 may controlexternal device 200 to display at least two application windows in the multiscreen display mode without considering the display size ofexternal device 200. In addition, instead of the step S7070,user equipment 100 may provide another user interface for enabling a user to select one of a single screen display mode and a multiscreen display mode after a new application is activated while displaying an application window in a single display mode. As described above, switching between a single screen display mode and a multiscreen display mode may be performed through various methods in accordance with at least one embodiment of the present invention. - When the display size of
external device 200 is not greater than the reference display size (No—S7060),user equipment 100 may create image data of the newly activated application based on the host-device connection display setting, transmit the created image data toexternal device 200 at step S7040, and controlexternal device 200 to display the image data in the single screen mode a step S7050. Particularly, whenexternal device 200 has a display size not enough to simultaneously display at least two application windows,user equipment 100 may controlexternal device 200 to display the same screen thatuser equipment 100 displays ondisplay unit 160 of user equipment 100 (i.e., mirrored screen) but based on the host-device connection display setting. - At step S7080, the number of applications for the multitasking operation mode may be determined when the display size of
external device 200 is greater than the reference display size (Yes—S7060). For example,user equipment 100 may determine the number of applications to be performed as the multitasking statue. According to the determined number of applications,user equipment 100 may decide the number of application windows to be displayed in the multiscreen display mode in accordance with at least one embodiment of the present invention. - At step S7090, multiscreen mode display setting associated with the determined number may be obtained. For example,
user equipment 100 may obtain information on multiscreen mode display setting associated with the determined number of applications to be performed in the multitasking statue. That is,user equipment 100 may retrieve such a multiscreen mode display setting frommemory 150 ofuser equipment 100. The multiscreen mode display setting may denote display properties for displaying at least two application windows in the multiscreen display mode. For example, the multiscreen mode display setting may include various display properties such as the number of application windows in a multiscreen display mode, a display size of each application window, a position and a display orientation of each application window, arrangement of each application window, control menus and icons for controlling an overall graphic user interface of the multiscreen display mode and each application window, and arrangement and sizes of the control menus and icons, but the present invention is not limited thereto. For example, a diagram (C) ofFIG. 6 may show two application windows displayed in a dual screen display mode. As shown, two application windows 610-2 and 630 are displayed each in two divided display areas ofdisplay unit 260 ofexternal device 200. Furthermore, closingicon 603 andmini app tray 640 are displayed with two application windows 610-2 and 630. Such arrangement, sizes, and display orientations of two application windows 610-2 and 630 and the control menus and icons may be determined based on the retrieved multiscreen mode display setting in accordance with at least one embodiment of the present invention. Such multiscreen mode display setting may be stored inmemory 150 in a form of a mapping table. Based on the determined number of applications in the multitasking status, related multiscreen display setting may be retrieved. For example, when two applications are running in the multitasking statue, multiscreen display setting associated with a dual screen display mode may be retrieved frommemory 150. - The multiscreen mode display setting may be determined based on various parameters of
user equipment 100 andexternal device 200 coupled touser equipment 100. For example, the multiscreen mode display setting may be determined based on a processing power and a memory size ofuser equipment 100 and a display size ofexternal device 200. That is, the processing power and the memory size ofuser equipment 100 may be used to determine the maximum display size ofexternal device 200 because the maximum display area ofexternal device 200 may differ according to the processing power and the memory ofuser equipment 100. Furthermore, the display size ofexternal device 200 may be considered to determine the maximum number of application windows in the multiscreen display mode. For example, when the display size ofexternal device 200 is larger than about 20 inches, at least four application windows may be displayed in the multiscreen mode. However, it may be difficult to display more than two application windows in the multiscreen display mode when the display size ofexternal device 200 is smaller than about 10 inches. The multiscreen mode display setting may be determined and stored inuser equipment 100 by a related manufacturer, but the present invention is not limited thereto. For example, the multiscreen mode display setting may be determined and stored inuser equipment 100 by a related user. In this case,user equipment 100 may provide a user interface or an application for setting such multiscreen mode display setting. The information of the multiscreen mode display setting may be stored inmemory 150 in a form of a lookup table, but the present invention is not limited thereto. For example,user equipment 100 may obtain such multiscreen mode display setting from other entity through a communication network in associated with an external device coupled touser equipment 100. That is,user equipment 100 may obtain information on the coupled external device upon the connection to the external device and request an associated multiscreen mode display setting to a related web server through a communication network. In response to the request,user equipment 100 may obtain the associated multiscreen mode display setting from the related web server. - At step S7100, image data of each application may be generated based on the obtained multiscreen mode display setting. For example,
user equipment 100 may create image data as a result of running each application in response to user inputs associated with each application. Furthermore,user equipment 100 may refer related information in the obtained multiscreen mode display setting for creating each application window, such as a display size and a display orientation of each application window. As shown in a diagram (B) ofFIG. 6 ,user equipment 100 may create image data for application window 620-1 and create image data for application window 610-1. The image data for application window 610-1 may be produced as a result of activatingapplication icon 601. - Referring to
FIG. 7B , image data of a multiscreen display mode may be created based on the obtained multiscreen mode display setting at step S7110. For example,user equipment 100 may combine the created image data of each application window and create control menu and icons based on the obtained multiscreen mode display setting in accordance with at least one embodiment of the present invention. That is,user equipment 100 may create multiscreen image data by combining the created image data for application window 610-1 and the created image data for application window 620-1 based on the obtained multiscreen mode display setting as shown in a diagram (B) ofFIG. 6 . - At step S7120, the created multiscreen image data may be transferred to the coupled external device. For example,
user equipment 100 may transmit the created multiscreen image data toexternal device 200. - At step S7130, the coupled external device may be controlled to display the multiscreen image data. For example,
user equipment 100 may controlexternal device 200 to display the multiscreen image data as shown in the diagram (B) ofFIG. 6 . That is,user equipment 100 may controlexternal device 200 to simultaneously display application window 610-1 and another application window 620-1 in a dual screen display mode as shown in the diagram (B) ofFIG. 6 . - At step S7140,
user equipment 100 may determine a type of a user input upon the receipt of the user input. When user input is not received (No—S7140),user equipment 100 may continuously display application windows in the multiscreen mode at step S7100 to S7130. - When the received user input is an activation input for activating a new application (New app—S7140),
user equipment 100 may determine whether the number of application windows associated with the current multiscreen display mode reaches the maximum number of application windows allowed within the current multiscreen display mode at step S7150. The maximum number may also denote the maximum number of application windows allowed to be displayed at once within the current multiscreen display mode. Such information may be included in the multiscreen mode display setting, but the present invention is not limited thereto. For example, when a related user activates application icon 602 in application window 620-1 while displaying the multiscreen image data as shown in the diagram (B) ofFIG. 6 ,user equipment 100 may determine whether the number of multitasking application windows reaches the maximum number based on the associated multiscreen mode display setting. - When the number of the multitasking application windows is not equal to the maximum number (No—S7150), the step S7090 may be performed. For example, the previous number of application windows in the multiscreen display mode may be increased by one and a multiscreen mode display setting may be newly obtained based on the updated number of application windows. Then, image data may be created based on the obtained multiscreen mode display setting at step S7100 to S7130.
- When the number of application windows reaches the maximum number (Yes—S7150),
user equipment 100 may interrupt creating image data of one of previously activated applications at step S7160. For example,external device 200 may have two as the maximum number of application windows allowed to be displayed in a multiscreen display mode because of a display size ofexternal device 200. Such information may be included in the associated multiscreen mode display setting. When application icon 602 is activated while application window 610-1 and application window 620-1 are displayed in a dual screen mode, the number of application windows reaches the maximum number because the number of application windows in the current multiscreen display mode and the maximum number is two. In this case,user equipment 100 may interrupt one of applications to create image data thereof. Such interrupted application may be selected by various conditions. For example, an operating system may be the first one to be interrupted. Alternatively, the oldest one of the activated applications, except the operating system, may be selected and interrupted to create image data, but the present invention is not limited thereto. In case of the diagram (B) ofFIG. 6 , the operating system is interrupted to create image data thereof. Although the selected application is interrupted to create image data, operation of the selected application is not interrupted. The selected application may be still running in a background mode. - At step S7170, image data of the newly activated application may be generated. For example,
user equipment 100 may produce image data of the newly activated application associated with the activated application icon 602 of the diagram (B) ofFIG. 6 . That is, image data for application window 630 (diagram (C) ofFIG. 6 ) is produced. Using the produced image data,user equipment 100 may create image data of the multiscreen display mode and controlexternal device 200 to display the created image data in the multiscreen display mode at step S7110 to S7130. For example, application window 610-2 andapplication window 630 may be displayed in the dual screen display mode as shown in the diagram (C) ofFIG. 6 . Furthermore,control menus 640 andicons FIG. 6 . - Referring to
FIG. 7C ,user equipment 100 may determine whether the user input is a closing input for closing one of application windows displayed in the multiscreen mode at step S7180 when the received user input is not the activation input (Other—S7140). For example, the closing input may be initiated by clickingclosing icon 603 shown in the diagram (C) ofFIG. 6 . - When the user input is the closing input (Yes—S7180),
user equipment 100 may interrupt creating image data of the application window associated with the closing input at step S7190. For example, when closingicon 603 of application window 610-2 is activated (diagram (C) ofFIG. 6 ),user equipment 100 may interrupt creating image data of the application associated with application window 610-2. As described, the application may be running in a background mode. - At step S7200,
user equipment 100 may determine whether the associated multiscreen display mode is a dual screen display mode. When the associated multiscreen display mode is the dual screen display mode as shown in the diagram (C) ofFIG. 6 (Yes—S7200),user equipment 100 may determine whether any application is running in the background mode at step S7210. - When there is an application running in the background mode (Yes—S7210),
user equipment 100 may resume one of the applications running in the background mode to create image data at step S7220. When multiple applications are running in the background mode, one lastly interrupted may be selected to be resumed, but the present invention is not limited thereto. Although multiple applications are running in the background mode, the operating system ofuser equipment 100 may be selected as an application to be resumed as shown in a diagram (D) ofFIG. 6 . After resuming, the created image data may be combined and displayed as the dual screen display mode at the steps S7110 to S7130. As shown in the diagram (D) ofFIG. 6 , application window 6230-2 of the operating system may be resumed and displayed withapplication window 603 of the lastly activated application in the dual screen mode. - When no application is running in the background mode (No—S7210),
user equipment 100 may create and transmit image data of remaining application based on the host-device connection display setting at step S7040 and controlexternal device 200 to display the created image data in the single screen display mode at step S7050. - Furthermore, when the associated multiscreen display mode is not the dual screen mode (No—S7200),
user equipment 100 may decrease the number of applications in the multitasking operation mode by one at step S7230. Using the decreased application number,user equipment 100 may obtain an associated multiscreen mode display setting at step S7090 and controlexternal device 200 to display remaining application windows in the multiscreen mode at steps S7100 to S7130. - When the user input is not the closing input (No—S7180),
user equipment 100 may perform operation related to the user input at step S7240 and create image data of an associated application window based on a result of the performed operation at step S7250. Then,user equipment 100 may continuously controlexternal device 200 to display the application windows in the multiscreen mode at steps S7100 to S7130. - As described, the multiscreen display mode is described as being initiated without consideration of a type of application in accordance with at least one embodiment of the present invention. The present invention, however, is not limited thereto. For example, a type of an activated application may be considered to initiate the multiscreen display mode in accordance with another embodiment of the present invention. Particularly, a multiscreen display mode may be initiated only when a user activates a designated application such as an Internet browser, an image viewer, a moving image player, and a documenter editor. Furthermore, a multiscreen display mode may be initiated only when a user activates two related applications such as an Internet browser with a document editor and an image viewer with an email writer. As described, the initiation of the multiscreen display mode may be set in various methods.
- As described,
external device 200 is described as being controlled to display an overall graphic user interface (GUI) of a multiscreen display mode in a landscape orientation and each application window of the overall GUI in a portrait orientation, but the present invention is not limited thereto. Such orientation may be controlled differently in accordance with another embodiment of the present invention. For example, one of application windows may be displayed in a portrait orientation and the other may be displayed in a landscape orientation while the overall GUI of the multiscreen display mode in a portrait orientation. Such display orientations of the overall GUI of the multiscreen display mode and each application window may be set in the multiscreen mode display setting. Furthermore,external device 200 is described as being controlled to display the overall GUI of a multiscreen display mode in a landscape orientation and a display area ofexternal device 200 is described as being divided into a left display area and a right display area. The present invention, however, is not limited thereto. For example,external device 200 may be controlled to display a multiscreen display mode in a portrait orientation and the display area ofexternal device 200 may be divided into a top display area and a bottom display area in accordance with another embodiment of the present invention. - Furthermore, the display area of
external device 200 is described as being divided evenly, but the present invention is not limited thereto. For example, the display area ofexternal device 200 may be divided unevenly according to a type of each application running in a multitasking mode. - After detecting the connection to the external device, the host-device connection may be established as described in step S7030 of
FIG. 7A . Such operation will be described in more detail with reference toFIG. 8 . -
FIG. 8 shows a method for establishing host-device connection at least one embodiment of the present invention. - Referring to
FIG. 8 , when the detection of the connection toexternal device 200 is detected (Yes—S7020 ofFIG. 7A ), an operation mode may be changed to a connected mode at step S8010. For example,controller 180 may change the operation mode to the connected mode whencontroller 180 senses the connection toexternal device 200. The connected mode may be opposite to a standalone mode or a disconnected mode. The connected mode may denote an operation mode ofuser equipment 100 whenuser equipment 100 is coupled toexternal device 200. - At step S8020, display device information of external device may be obtained. For example, the display device information of
external device 200 may include information on a screen size, a resolution, a display orientation, and a dot per inch (DPI) ofdisplay unit 260 ofexternal device 200. Such display device information may be obtained through a request. Particularly,user equipment 100 may request display unit information toexternal device 200 and obtain the display unit information fromexternal device 200. Alternatively,user equipment 100 may identify a display unit type ofexternal device 200 and retrieve related display unit information frominternal memory 150. Particularly,agent 182 may request and receive display unit information fromexternal device 200. Based on the display unit information,agent 182 may identify hardware specification ofdisplay unit 260 ofexternal device 200. For example,agent 182 may receive extended display identification data (EDID) fromexternal device 200. The EDID may be information on hardware specification ofdisplay unit 260 ofexternal device 200. The EDID may include information on a manufacturer, a model number, an EDID version, an appropriate DPI value, a screen size, supporting screen resolutions, luminance, and the number of pixels. The present invention, however, is not limited thereto. For example,user equipment 100 may store, ininternal memory 150, display unit information of candidate external devices that might be connected touser equipment 100. The stored display unit information may be mapped to a device ID of each candidate external device. Such mapping information may be managed byagent 182 ofuser equipment 100. In this case,user equipment 100 may receive or recognize a device ID ofexternal device 200. Based on the device ID,user equipment 100 may obtain the display unit information ofdisplay unit 260 ofexternal device 200 from the stored display unit information. - At step S8030, determination may be made as to whether it is necessary to reconfigure initial display settings based on the obtained display device information. For example,
controller 180 may determine whether it is necessary to reconfigure an initial display setting based on the obtained information. - When it is necessary to reconfigure the initial display setting (Yes—S8030), the initial display setting may be reconfigured based on the obtained display device information as a host-device connection display setting at step S8040. For example,
controller 180 may reconfigure the initial display setting based on the obtained display device information ofexternal device 200. After reconfiguration, the host-device connection display setting is stored inmemory 150 ofuser equipment 100. - When reconfiguration is not necessary (No—S8030), the initial display setting may be used as the host-device connection display setting without modification at step S8050. For example,
controller 180 may store the initial display setting as the host-device connection display setting inmemory 150 ofuser equipment 100. - The host-device connection display setting stored in
memory 150 may be retrieved and used for displaying the image data on the coupled external device at step S7110 (FIG. 7 ) in accordance with at least one embodiment of the present invention. - When
user equipment 100 operates in a standalone mode,user equipment 100 may display image data based on the initial display setting ofdisplay unit 160 ofuser equipment 100. Afteruser equipment 100 is connected toexternal device 200,user equipment 100 may display the image data ondisplay unit 260 ofexternal device 200 based on the host-connection display setting.User equipment 100 may be required to reconfigure the initial display setting based on a resolution ofdisplay unit 260 ofexternal device 200. When a resolution ofdisplay unit 260 ofexternal device 200 is identical to or compatible to that fordisplay unit 160 ofuser equipment 100, reconfiguration of image data may not be necessary. - In addition to the resolution, displaying setting may be reconfigured based on other parameters included in the obtained display device information, for example, a screen size, a display orientation, and a DPI. For example,
display unit 160 ofuser equipment 100 may have a screen size different fromdisplay unit 260 ofexternal device 200. In this case, such display setting may be reconfigured based on the screen size fordisplay unit 260 ofexternal device 200. - Furthermore, it may be necessary to modify image data produced for
display unit 160 ofexternal device 200, to be suitable fordisplay unit 260 ofexternal device 200. In this case,video processing unit 140 may process the image data based on the display setting, including a screen size, a display orientation, and a DPI, suitable fordisplay unit 260 ofexternal device 200 and transmit the processed image data toexternal device 200. Alternatively,controller 180 may transmit image data created fordisplay unit 160 ofuser equipment 100 toexternal device 200 without reconfiguration andexternal device 200 may reconfigure the received image data based on a DPI fordisplay unit 260 ofexternal device 200. Such operation may be performed throughsignal processing unit 240 ofexternal device 200. - In accordance with at least one embodiment of the present invention,
display unit 260 ofexternal device 200 may optimally display images through reconfiguring image data based on a resolution and a DPI ofdisplay unit 260 ofexternal device 200. In addition to the resolution and the DPI, a display orientation may be considered to create or to reconfigure image data in accordance with embodiments of the present invention. - For example,
user equipment 100 such as a smart phone may have a portrait display orientation as a default display orientation.External devices 200 such as laptop notebook or tablet PC, known as a smart pad, may have a landscape display orientation as a default display orientation. When such a default display orientation is different betweenuser equipment 100 andexternal device 200,agent 182 may i) obtain information on a default display orientation ofdisplay unit 260 ofexternal device 200 based on the obtained display unit information including a resolution, a screen size, and product identification and ii) determine whether the default display orientation ofexternal device 200 is identical to or different from that ofuser equipment 100 based on the obtained display device information. When the default display orientation is not identical, andcontroller 180 may reconfigure image data based on the default display orientation ofexternal device 200 in addition to the resolution and the DPI ofexternal device 200. - Reference herein to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the invention. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments necessarily mutually exclusive of other embodiments. The same applies to the term “implementation.”
- As used in this application, the word “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other aspects or designs. Rather, use of the word exemplary is intended to present concepts in a concrete fashion.
- Additionally, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or”. That is, unless specified otherwise, or clear from context, “X employs A or B” is intended to mean any of the natural inclusive permutations. That is, if X employs A; X employs B; or X employs both A and B, then “X employs A or B” is satisfied under any of the foregoing instances. In addition, the articles “a” and “an” as used in this application and the appended claims should generally be construed to mean “one or more” unless specified otherwise or clear from context to be directed to a singular form.
- Moreover, the terms “system,” “component,” “module,” “interface,”, “model” or the like are generally intended to refer to a computer-related entity, either hardware, a combination of hardware and software, software, or software in execution. For example, a component may be, but is not limited to being, a process running on a controlling unit, a controlling unit, an object, an executable, a thread of execution, a program, and/or a computer. By way of illustration, both an application running on a controller and the controller can be a component. One or more components may reside within a process and/or thread of execution and a component may be localized on one computer and/or distributed between two or more computers.
- The present invention can be embodied in the form of methods and apparatuses for practicing those methods. The present invention can also be embodied in the form of program code embodied in tangible media, such as magnetic recording media, optical recording media, solid state memory, floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention. The present invention can also be embodied in the form of program code, for example, whether stored in a storage medium, loaded into and/or executed by a machine, or transmitted over some transmission medium or carrier, such as over electrical wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the invention. When implemented on a general-purpose controlling unit, the program code segments combine with the controlling unit to provide a unique device that operates analogously to specific logic circuits. The present invention can also be embodied in the form of a bitstream or other sequence of signal values electrically or optically transmitted through a medium, stored magnetic-field variations in a magnetic recording medium, etc., generated using a method and/or an apparatus of the present invention.
- It should be understood that the steps of the exemplary methods set forth herein are not necessarily required to be performed in the order described, and the order of the steps of such methods should be understood to be merely exemplary. Likewise, additional steps may be included in such methods, and certain steps may be omitted or combined, in methods consistent with various embodiments of the present invention.
- As used herein in reference to an element and a standard, the term “compatible” means that the element communicates with other elements in a manner wholly or partially specified by the standard, and would be recognized by other elements as sufficiently capable of communicating with the other elements in the manner specified by the standard. The compatible element does not need to operate internally in a manner specified by the standard.
- No claim element herein is to be construed under the provisions of 35 U.S.C. §112, sixth paragraph, unless the element is expressly recited using the phrase “means for” or “step for.”
- Although embodiments of the present invention have been described herein, it should be understood that the foregoing embodiments and advantages are merely examples and are not to be construed as limiting the present invention or the scope of the claims. Numerous other modifications and embodiments can be devised by those skilled in the art that will fall within the spirit and scope of the principles of this disclosure, and the present teaching can also be readily applied to other types of apparatuses. More particularly, various variations and modifications are possible in the component parts and/or arrangements of the subject combination arrangement within the scope of the disclosure, the drawings and the appended claims. In addition to variations and modifications in the component parts and/or arrangements, alternative uses will also be apparent to those skilled in the art.
Claims (20)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/726,830 US9514306B2 (en) | 2011-12-26 | 2012-12-26 | Restricting operation results from being transferred to coupled external device |
US17/463,978 US11715439B2 (en) | 2011-12-23 | 2021-09-01 | Dynamically controlling display mode of external device coupled to user equipment |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020110141016A KR101522399B1 (en) | 2011-12-23 | 2011-12-23 | Method for displaying image from handheld terminal to display device and handheld terminal thereof |
KR10-2011-0141016 | 2011-12-23 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/463,978 Continuation US11715439B2 (en) | 2011-12-23 | 2021-09-01 | Dynamically controlling display mode of external device coupled to user equipment |
Publications (1)
Publication Number | Publication Date |
---|---|
US20130162502A1 true US20130162502A1 (en) | 2013-06-27 |
Family
ID=48653993
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/726,404 Abandoned US20130162502A1 (en) | 2011-12-23 | 2012-12-24 | Dynamically controlling display mode of external device coupled to user equipment |
US17/463,978 Active US11715439B2 (en) | 2011-12-23 | 2021-09-01 | Dynamically controlling display mode of external device coupled to user equipment |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/463,978 Active US11715439B2 (en) | 2011-12-23 | 2021-09-01 | Dynamically controlling display mode of external device coupled to user equipment |
Country Status (2)
Country | Link |
---|---|
US (2) | US20130162502A1 (en) |
KR (1) | KR101522399B1 (en) |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120038541A1 (en) * | 2010-08-13 | 2012-02-16 | Lg Electronics Inc. | Mobile terminal, display device and controlling method thereof |
US20120227098A1 (en) * | 2011-03-03 | 2012-09-06 | Microsoft Corporation | Sharing user id between operating system and application |
US20140189549A1 (en) * | 2013-01-02 | 2014-07-03 | Canonical Limited | User interface for a computing device |
US20140237421A1 (en) * | 2013-02-20 | 2014-08-21 | Google Inc. | Intelligent window placement with multiple windows using high dpi screens |
US20140359493A1 (en) * | 2013-05-30 | 2014-12-04 | Samsung Electronics Co., Ltd. | Method, storage medium, and electronic device for mirroring screen data |
EP2843919A1 (en) * | 2013-09-02 | 2015-03-04 | Samsung Electronics Co., Ltd | Method and apparatus for providing service by using screen mirroring |
US20150065056A1 (en) * | 2013-08-30 | 2015-03-05 | Samsung Electronics Co., Ltd. | Multi display method, storage medium, and electronic device |
WO2015045788A1 (en) * | 2013-09-26 | 2015-04-02 | 株式会社リコー | Distribution management device, distribution method, and program |
WO2015056867A1 (en) * | 2013-10-17 | 2015-04-23 | Samsung Electronics Co., Ltd. | Display apparatus and method of controlling display apparatus |
EP2849053A3 (en) * | 2013-09-13 | 2015-06-03 | Samsung Electronics Co., Ltd | Screen image mirroring method and apparatus |
CN104822082A (en) * | 2014-02-05 | 2015-08-05 | 三星电子株式会社 | Display apparatus, method for controlling the same, and computer-readable recording medium |
US20150266378A1 (en) * | 2014-03-18 | 2015-09-24 | Obigo Inc. | Method for configuring user interface of head unit of vehicle dynamically by using mobile terminal, and head unit and computer-readable recording media using the same |
CN105282602A (en) * | 2014-07-07 | 2016-01-27 | 乐视致新电子科技(天津)有限公司 | Data processing method, apparatus and mobile terminal equipment |
US20160027399A1 (en) * | 2013-03-15 | 2016-01-28 | Intel Corporation | Mobile computing device technology and systems and methods utilizing the same |
US9398261B1 (en) * | 2012-07-20 | 2016-07-19 | Time Warner Cable Enterprises Llc | Transitioning video call between devices |
US20160210016A1 (en) * | 2013-09-25 | 2016-07-21 | Pixtree Technologies, Inc. | Apparatus and method for sharing contents |
US20160216876A1 (en) * | 2015-01-22 | 2016-07-28 | Samsung Electronics Co., Ltd. | Display apparatus, control apparatus, and operating methods thereof |
USD765708S1 (en) * | 2015-07-27 | 2016-09-06 | Microsoft Corporation | Display screen with animated graphical user interface |
US20160274955A1 (en) * | 2013-10-08 | 2016-09-22 | Zte Corporation | Method and Device for Activating and Controlling Application in Multi-Screen System, and Mobile Terminal |
USD768689S1 (en) * | 2015-07-27 | 2016-10-11 | Microsoft Corporation | Display screen with animated graphical user interface |
KR20170000738A (en) * | 2015-06-24 | 2017-01-03 | 삼성전자주식회사 | Apparatus and method for split screen display on mobile device |
USD777739S1 (en) * | 2014-02-21 | 2017-01-31 | Lenovo (Beijing) Co., Ltd. | Display screen or portion thereof with graphical user interface |
USD784373S1 (en) * | 2014-02-21 | 2017-04-18 | Lenovo (Beijing) Co., Ltd. | Display screen or portion thereof with graphical user interface |
WO2017087072A1 (en) * | 2015-11-17 | 2017-05-26 | Intel Corporation | Contextual display state management for multi-display systems |
US20170160882A1 (en) * | 2015-12-07 | 2017-06-08 | Samsung Electronics Co., Ltd. | Electronic apparatus and controlling method thereof |
US20170177290A1 (en) * | 2015-12-17 | 2017-06-22 | International Business Machines Corporation | Display redistribution between a primary display and a secondary display |
CN107111712A (en) * | 2015-12-14 | 2017-08-29 | 策安保安有限公司 | The system and method that 3D abstract objects for high entropy information security threat are modeled |
US20170322763A1 (en) * | 2016-05-06 | 2017-11-09 | Lenovo (Beijing) Co., Ltd. | Control method and electronic device |
EP3243333A1 (en) * | 2015-01-07 | 2017-11-15 | Microsoft Technology Licensing, LLC | Automatic home screen determination based on display device |
US20170344333A1 (en) * | 2016-05-24 | 2017-11-30 | Samsung Electronics Co., Ltd. | Screen controlling method and electronic device for supporting the same |
US10228835B2 (en) * | 2016-12-23 | 2019-03-12 | Beijing Kingsoft Internet Security Software Co., Ltd. | Method for displaying information, and terminal equipment |
US20190163431A1 (en) * | 2017-11-28 | 2019-05-30 | Ncr Corporation | Multi-device display processing |
US10346122B1 (en) * | 2018-10-18 | 2019-07-09 | Brent Foster Morgan | Systems and methods for a supplemental display screen |
JP2019114050A (en) * | 2017-12-22 | 2019-07-11 | セイコーエプソン株式会社 | Processing device, display system, and program |
US10438525B2 (en) | 2014-09-12 | 2019-10-08 | Samsung Electronics Co., Ltd. | Method of controlling display of electronic device and electronic device thereof |
US20190333479A1 (en) * | 2018-04-30 | 2019-10-31 | Ramzi Khalil Maalouf | System, apparatus, and method for optimizing viewing experience on an intelligent terminal |
WO2020018103A1 (en) * | 2018-07-19 | 2020-01-23 | Hewlett-Packard Development Company, L.P. | Conversion of glyphs to images |
US20200042150A1 (en) * | 2018-08-02 | 2020-02-06 | Aac Acoustic Technologies (Shenzhen) Co., Ltd. | Method for Determining Working Mode, Touch Device and Readable Storage Medium |
CN111479495A (en) * | 2017-11-28 | 2020-07-31 | 深圳迈瑞生物医疗电子股份有限公司 | Monitor and display screen switching method thereof |
US10760728B1 (en) | 2018-09-25 | 2020-09-01 | Ramzi Khalil Maalouf | Stand for a terminal system with adjustable screen orientation |
US11068226B2 (en) | 2017-06-09 | 2021-07-20 | Huawei Technologies Co., Ltd. | Display method and apparatus |
US11289055B2 (en) * | 2019-03-20 | 2022-03-29 | Wistron Corporation | Display device and operating method thereof |
WO2022123390A1 (en) * | 2020-12-11 | 2022-06-16 | 株式会社半導体エネルギー研究所 | Operation method for display system |
US11379042B2 (en) * | 2017-07-10 | 2022-07-05 | Telefonaktiebolaget Lm Ericsson (Publ) | Transmission of haptic input |
US20220300153A1 (en) * | 2019-08-29 | 2022-09-22 | Honor Device Co., Ltd. | Control method applied to screen projection scenario and related device |
US11471757B2 (en) * | 2019-12-31 | 2022-10-18 | Giga-Byte Technology Co., Ltd. | Electronic device and method of automatically triggering hot key using display image |
US20230176806A1 (en) * | 2020-04-20 | 2023-06-08 | Huawei Technologies Co., Ltd. | Screen Projection Display Method and System, Terminal Device, and Storage Medium |
US20230350622A1 (en) * | 2022-05-02 | 2023-11-02 | Dell Products L.P. | Dynamically configuring external display devices |
US20230388588A1 (en) * | 2014-12-15 | 2023-11-30 | Rovi Guides, Inc. | Methods and systems for distributing media guidance among multiple devices |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR102215860B1 (en) * | 2013-09-12 | 2021-02-16 | 삼성전자 주식회사 | Electronic device and control method thereof |
KR102313306B1 (en) * | 2015-07-28 | 2021-10-14 | 엘지전자 주식회사 | Image display apparatus, and mobile termial |
KR102557935B1 (en) * | 2016-03-10 | 2023-07-21 | 삼성전자주식회사 | Electronic device and method for controlling display thereof |
KR20210067769A (en) * | 2019-11-29 | 2021-06-08 | 삼성전자주식회사 | An electronic device for controlling an external electronic device comprising a display |
KR20220017193A (en) * | 2020-08-04 | 2022-02-11 | 삼성전자주식회사 | Electronic device and method for providing application scrren of diplay of external device thereof |
KR20220156219A (en) * | 2021-05-18 | 2022-11-25 | 삼성전자주식회사 | Wearable electronic device and external electronic device accommodating wearable electronic device |
US11927985B2 (en) | 2021-05-18 | 2024-03-12 | Samsung Electronics Co., Ltd. | Wearable electronic device and external electronic device accommodating wearable electronic device |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030231143A1 (en) * | 2002-04-22 | 2003-12-18 | Pioneer Corporation | Information terminal and information terminal control method |
US20080303746A1 (en) * | 2007-06-07 | 2008-12-11 | Igt | Displaying and using 3d graphics on multiple displays provided for gaming environments |
US20120008854A1 (en) * | 2009-11-13 | 2012-01-12 | Samsung Electronics Co., Ltd. | Method and apparatus for rendering three-dimensional (3D) object |
US20120050183A1 (en) * | 2010-08-27 | 2012-03-01 | Google Inc. | Switching display modes based on connection state |
US20120081312A1 (en) * | 2010-10-01 | 2012-04-05 | Imerj LLC | Smartpad split screen |
US20120088548A1 (en) * | 2010-10-06 | 2012-04-12 | Chanphill Yun | Mobile terminal, display device and controlling method thereof |
Family Cites Families (104)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3317763B2 (en) | 1993-11-05 | 2002-08-26 | 富士通株式会社 | Program starting method and processing device thereof |
JP2951572B2 (en) | 1994-09-12 | 1999-09-20 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Image data conversion method and system |
US5835733A (en) | 1994-12-22 | 1998-11-10 | Texas Instruments Incorporated | Method and apparatus for implementing a single DMA controller to perform DMA operations for devices on multiple buses in docking stations, notebook and desktop computer system |
US7831930B2 (en) | 2001-11-20 | 2010-11-09 | Universal Electronics Inc. | System and method for displaying a user interface for a remote control application |
JP2000163361A (en) | 1998-11-27 | 2000-06-16 | Toshiba Corp | Computer system and environment setting method |
US6286066B1 (en) | 1998-12-15 | 2001-09-04 | Dell U.S.A., L.P. | Hot-plug interface for detecting adapter card insertion and removal |
US6401157B1 (en) | 1999-04-30 | 2002-06-04 | Compaq Information Technologies Group, L.P. | Hot-pluggable component detection logic |
US6516367B1 (en) | 1999-06-24 | 2003-02-04 | International Business Machines Corporation | Method and system for detecting bus device configuration changes |
US6697892B1 (en) | 1999-07-08 | 2004-02-24 | Intel Corporation | Port expansion system |
US6535947B1 (en) | 2000-05-30 | 2003-03-18 | International Business Machines Corporation | Methods, systems and computer program products for logically segmenting devices on a universal serial bus |
US6804740B1 (en) | 2000-09-27 | 2004-10-12 | Dell Products L.P. | Docking station for use with a portable computer system |
US7890741B2 (en) | 2000-12-01 | 2011-02-15 | O2Micro International Limited | Low power digital audio decoding/playing system for computing devices |
US7076536B2 (en) | 2000-12-21 | 2006-07-11 | Microsoft Corporation | Method and system to access software pertinent to an electronic peripheral device at an address based on a peripheral device identifier |
US7165109B2 (en) | 2001-01-12 | 2007-01-16 | Microsoft Corporation | Method and system to access software pertinent to an electronic peripheral device based on an address stored in a peripheral device |
US20020121548A1 (en) | 2001-03-05 | 2002-09-05 | Ho-Lung Lu | Hand held client system with an external storage meduim |
US7228366B2 (en) | 2001-06-29 | 2007-06-05 | Intel Corporation | Method and apparatus for deterministic removal and reclamation of work items from an expansion bus schedule |
KR100474724B1 (en) | 2001-08-04 | 2005-03-08 | 삼성전자주식회사 | Apparatus having touch screen and external display device using method therefor |
US9026709B2 (en) | 2010-10-01 | 2015-05-05 | Z124 | Auto-waking of a suspended OS in a dockable system |
TW514786B (en) | 2001-09-28 | 2002-12-21 | Su Fang Yu | Processing method and computer system for driver in intelligent peripherals |
KR200290286Y1 (en) | 2002-03-16 | 2002-09-26 | 김정한 | PDA Docking Station with large LCD and keyboard |
CN1324504C (en) | 2002-04-22 | 2007-07-04 | 普莱斯威尔股份有限公司 | Application sharing security |
US6774866B2 (en) | 2002-06-14 | 2004-08-10 | Etenna Corporation | Multiband artificial magnetic conductor |
US7209124B2 (en) | 2002-08-08 | 2007-04-24 | Hewlett-Packard Development Company, L.P. | Multiple-position docking station for a tablet personal computer |
US20060036788A1 (en) | 2002-09-24 | 2006-02-16 | Monster Cable Products, Inc. | HDMI cable interface |
US6862724B1 (en) | 2002-09-25 | 2005-03-01 | Altera Corporation | Reconfigurable programmable logic system with peripheral identification data |
KR100487618B1 (en) | 2002-12-11 | 2005-05-03 | 엘지전자 주식회사 | Mobile phone having various display apparatuses |
KR100555901B1 (en) | 2003-02-18 | 2006-03-03 | 삼성전자주식회사 | Mobile apparatus having function for palying multi-media and method there of |
JP4420647B2 (en) | 2003-04-15 | 2010-02-24 | シャープ株式会社 | Control system |
US7117388B2 (en) | 2003-04-28 | 2006-10-03 | International Business Machines Corporation | Dynamic, Non-invasive detection of hot-pluggable problem components and re-active re-allocation of system resources from problem components |
US20040218036A1 (en) | 2003-04-29 | 2004-11-04 | Boss Scott D. | System and method for managing public and private information |
US7533408B1 (en) | 2003-06-13 | 2009-05-12 | Michael Arnouse | Portable computing system, apparatus and method |
KR100793208B1 (en) | 2003-08-04 | 2008-01-10 | 엘지전자 주식회사 | Method for controling a display mode in portable computer |
US7158154B2 (en) | 2003-06-18 | 2007-01-02 | Lg Electronics Inc. | Method for controlling display mode in portable computer |
US20040266425A1 (en) | 2003-06-24 | 2004-12-30 | Sbc, Inc. | Wireless wide area network charger and cradle |
US7312764B2 (en) | 2003-09-26 | 2007-12-25 | The General Electric Company | Methods and apparatus for displaying images on mixed monitor displays |
WO2005067604A2 (en) | 2004-01-05 | 2005-07-28 | Oqo Incorporated | Docking station for mobile computing device |
US7551175B2 (en) | 2004-03-10 | 2009-06-23 | Panasonic Corporation | Image transmission system and image transmission method |
JP2005284657A (en) | 2004-03-29 | 2005-10-13 | Denso It Laboratory Inc | Personal digital assistant |
KR20050096578A (en) | 2004-03-31 | 2005-10-06 | 에스케이텔레텍주식회사 | Method for utilizing touch screen of mobile phone as an external input device for personal computer |
JP3817249B2 (en) | 2004-04-28 | 2006-09-06 | 株式会社エヌ・ティ・ティ・ドコモ | Mobile device and communication control method |
KR20060018083A (en) | 2004-08-23 | 2006-02-28 | 엘지전자 주식회사 | Apparatus and method for graphic expansion of portable computer using docking system |
JP2006094367A (en) | 2004-09-27 | 2006-04-06 | Nec Corp | Surround speaker docking system, mobile terminal device connected thereto, and sound musical sound reproducing method thereof |
EP1672471A1 (en) | 2004-12-14 | 2006-06-21 | Thomson Multimedia Broadband Belgium | Content playback device with touch screen |
US7450084B2 (en) | 2004-12-17 | 2008-11-11 | Microsoft Corporation | System and method for managing computer monitor configurations |
US7200702B2 (en) | 2005-02-18 | 2007-04-03 | Microsoft Corporation | Mobile device expansion system |
KR101119320B1 (en) | 2005-04-29 | 2012-03-15 | 엘지전자 주식회사 | Apparatus and method of firmware updating for movable storage apparatus |
US7386868B2 (en) | 2005-07-14 | 2008-06-10 | Quantum Corporation | External desktop dock for a cartridge-based data storage unit |
US7884836B2 (en) | 2005-08-30 | 2011-02-08 | Ati Technologies Ulc | Notifying a graphics subsystem of a physical change at a display device |
US20070077965A1 (en) | 2005-10-05 | 2007-04-05 | Patrick Fox | Portable docking station for cell phone |
US7685322B2 (en) | 2006-02-28 | 2010-03-23 | Microsoft Corporation | Port number emulation for wireless USB connections |
JP4914252B2 (en) | 2006-03-23 | 2012-04-11 | キヤノン株式会社 | Image processing apparatus, display screen transmission method, and control program |
US20070245398A1 (en) | 2006-04-12 | 2007-10-18 | Bellsouth Intellectual Property Corporation | Universal parental control |
EP2060115A4 (en) | 2006-09-06 | 2011-07-27 | Nokia Corp | Mobile terminal device, dongle and external display device having an enhanced video display interface |
US7952748B2 (en) | 2006-10-24 | 2011-05-31 | Hewlett-Packard Development Company, L.P. | Display device output adjustment system and method |
US20080152305A1 (en) | 2006-12-21 | 2008-06-26 | General Instrument Corporation | Portable Media Content Storage and Rendering Device |
JP2008158342A (en) | 2006-12-25 | 2008-07-10 | Canon Software Inc | Information processor, method of controlling information processor, program, and recording medium |
US9092638B2 (en) | 2007-08-16 | 2015-07-28 | Blackberry Limited | System and method for managing docking applications for a portable electronic device |
TW200919453A (en) | 2007-10-31 | 2009-05-01 | Asustek Comp Inc | External storage module and shock absorption element thereof |
US20090163139A1 (en) | 2007-12-19 | 2009-06-25 | General Instrument Corporation | Apparatus and Method of Mobile Media Presentation Docking Station for Portable Electronic Device |
US8090030B2 (en) | 2008-01-04 | 2012-01-03 | Silicon Image, Inc. | Method, apparatus and system for generating and facilitating mobile high-definition multimedia interface |
AU2009203870A1 (en) | 2008-01-07 | 2009-07-16 | Smart Technologies Ulc | Method of launching a selected application in a multi-monitor computer system and multi-monitor computer system employing the same |
KR20080027813A (en) | 2008-03-10 | 2008-03-28 | (주)씨에스랩글로벌 | The method and process of sharing window for screen sharing in multipoint conference system |
US20100064248A1 (en) | 2008-09-09 | 2010-03-11 | Samsung Electronics Co., Ltd. | Method for displaying information window and display apparatus thereof |
US20100060549A1 (en) * | 2008-09-11 | 2010-03-11 | Ely Tsern | Method and system for dynamically generating different user environments with secondary devices with displays of various form factors |
KR101548958B1 (en) | 2008-09-18 | 2015-09-01 | 삼성전자주식회사 | A method for operating control in mobile terminal with touch screen and apparatus thereof. |
KR20100039592A (en) * | 2008-10-08 | 2010-04-16 | 에스케이 텔레콤주식회사 | User interface system and method and device |
US20100153501A1 (en) | 2008-12-15 | 2010-06-17 | Jan Gabriel | Business process information system |
US20100251243A1 (en) | 2009-03-27 | 2010-09-30 | Qualcomm Incorporated | System and method of managing the execution of applications at a portable computing device and a portable computing device docking station |
KR20100108885A (en) | 2009-03-31 | 2010-10-08 | 신성환 | Remote a/s method by computer mouse pointer in video phone call between computer and mobile phone |
JP4834123B2 (en) | 2009-04-17 | 2011-12-14 | レノボ・シンガポール・プライベート・リミテッド | Docking device |
KR20100128630A (en) | 2009-05-28 | 2010-12-08 | 주식회사 케이티 | Mobile terminal for using input means of portable device and input method using the same |
KR101649162B1 (en) | 2009-06-11 | 2016-08-23 | 엘지전자 주식회사 | Operating a Mobile Termianl |
US9762961B2 (en) | 2009-08-10 | 2017-09-12 | Steelseries Aps | Apparatus and method for managing parental control |
US8214545B2 (en) | 2009-08-12 | 2012-07-03 | Streaming Networks (Pvt) Ltd. | Multi-functional USB apparatus with auto-configuration and USB battery cap |
JP5604827B2 (en) | 2009-08-21 | 2014-10-15 | ソニー株式会社 | Transmitting apparatus, receiving apparatus, program, and communication system |
KR101092295B1 (en) | 2009-09-18 | 2011-12-13 | (주)옴니텔 | Remote monitoring system and method for sefeguarding children |
KR101632879B1 (en) | 2009-10-07 | 2016-06-23 | 엘지전자 주식회사 | Apparatus for displaying image and method for operating the same |
US8281366B1 (en) | 2009-10-14 | 2012-10-02 | Symantec Corporation | Systems and methods for using guardian proximity to control computing activities of children |
US20110099507A1 (en) | 2009-10-28 | 2011-04-28 | Google Inc. | Displaying a collection of interactive elements that trigger actions directed to an item |
KR101500008B1 (en) | 2009-11-25 | 2015-03-18 | 현대자동차주식회사 | System for connecting car handset unit with external device |
US8487888B2 (en) | 2009-12-04 | 2013-07-16 | Microsoft Corporation | Multi-modal interaction on multi-touch display |
JP5471453B2 (en) | 2010-01-05 | 2014-04-16 | 船井電機株式会社 | Portable information processing device |
KR101690786B1 (en) | 2010-02-12 | 2016-12-28 | 삼성전자주식회사 | Device and method for performing multi-tasking |
KR20110111857A (en) | 2010-04-05 | 2011-10-12 | 주식회사 케이엠알아이 | Mobile terminal for connection with docking station, and processing method thereof |
KR20110115489A (en) | 2010-04-15 | 2011-10-21 | 주식회사 케이엠알아이 | Docking station used in vehicle, mobile terminal, and processing method thereof |
KR101695810B1 (en) | 2010-05-07 | 2017-01-13 | 엘지전자 주식회사 | Mobile terminal and method for controlling thereof |
JP5671838B2 (en) | 2010-05-21 | 2015-02-18 | ソニー株式会社 | Data transmitting apparatus, data receiving apparatus, data transmitting method and data receiving method |
KR101660742B1 (en) | 2010-05-31 | 2016-09-28 | 엘지전자 주식회사 | Mobile terminal and method for controlling thereof |
JP5545645B2 (en) | 2010-06-10 | 2014-07-09 | アルパイン株式会社 | Multi-device image display control system |
US20120011451A1 (en) | 2010-07-08 | 2012-01-12 | International Business Machines Corporation | Selective screen sharing |
JP4818454B1 (en) | 2010-08-27 | 2011-11-16 | 株式会社東芝 | Display device and display method |
KR101017866B1 (en) | 2010-09-08 | 2011-03-04 | 주식회사 텔레칩스 | Method for control bus using navigation |
US9024866B2 (en) | 2010-09-14 | 2015-05-05 | Crestron Electronics Inc. | Control system for augmenting a portable touch screen device |
KR20100009920U (en) | 2010-09-20 | 2010-10-08 | 박상현 | Smart Phone Installableor Detachable Portable Touchscreen Terminal Using Smart Phone as a Host |
US8694656B2 (en) | 2010-11-09 | 2014-04-08 | Sony Corporation | System and method for creating a viewing social network |
US9143359B2 (en) | 2010-12-17 | 2015-09-22 | Verizon Patent And Licensing Inc. | Mobile phone docking station for VoIP |
US8879420B2 (en) | 2010-12-17 | 2014-11-04 | Verizon Patent And Licensing Inc. | Mobile phone docking station VPNs |
US8369893B2 (en) | 2010-12-31 | 2013-02-05 | Motorola Mobility Llc | Method and system for adapting mobile device to accommodate external display |
US8717198B2 (en) | 2011-03-25 | 2014-05-06 | Lg Electronics Inc. | Communication connecting apparatus and method for detecting mobile units in a vehicle |
US8504853B2 (en) | 2011-05-18 | 2013-08-06 | Nokia Corporation | Method, apparatus, and computer program product for cable detection and power negotiation |
US9220066B2 (en) | 2011-06-20 | 2015-12-22 | At&T Intellectual Property I, L.P. | Bundling data transfers and employing tail optimization protocol to manage cellular radio resource utilization |
US9013366B2 (en) | 2011-08-04 | 2015-04-21 | Microsoft Technology Licensing, Llc | Display environment for a plurality of display devices |
US8964979B2 (en) | 2011-10-07 | 2015-02-24 | Silicon Image, Inc. | Identification and handling of data streams using coded preambles |
US20130104149A1 (en) | 2011-10-25 | 2013-04-25 | Handong Lnc Co., Ltd. | Selective data processing method between docked terminals and selective data processing system using the same |
-
2011
- 2011-12-23 KR KR1020110141016A patent/KR101522399B1/en active IP Right Grant
-
2012
- 2012-12-24 US US13/726,404 patent/US20130162502A1/en not_active Abandoned
-
2021
- 2021-09-01 US US17/463,978 patent/US11715439B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030231143A1 (en) * | 2002-04-22 | 2003-12-18 | Pioneer Corporation | Information terminal and information terminal control method |
US20080303746A1 (en) * | 2007-06-07 | 2008-12-11 | Igt | Displaying and using 3d graphics on multiple displays provided for gaming environments |
US20120008854A1 (en) * | 2009-11-13 | 2012-01-12 | Samsung Electronics Co., Ltd. | Method and apparatus for rendering three-dimensional (3D) object |
US20120050183A1 (en) * | 2010-08-27 | 2012-03-01 | Google Inc. | Switching display modes based on connection state |
US20120081312A1 (en) * | 2010-10-01 | 2012-04-05 | Imerj LLC | Smartpad split screen |
US20120088548A1 (en) * | 2010-10-06 | 2012-04-12 | Chanphill Yun | Mobile terminal, display device and controlling method thereof |
Cited By (95)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120038541A1 (en) * | 2010-08-13 | 2012-02-16 | Lg Electronics Inc. | Mobile terminal, display device and controlling method thereof |
US20120227098A1 (en) * | 2011-03-03 | 2012-09-06 | Microsoft Corporation | Sharing user id between operating system and application |
US10027925B2 (en) | 2012-07-20 | 2018-07-17 | Time Warner Cable Enterprises Llc | Transitioning video call between devices |
US9398261B1 (en) * | 2012-07-20 | 2016-07-19 | Time Warner Cable Enterprises Llc | Transitioning video call between devices |
US10142453B2 (en) | 2013-01-02 | 2018-11-27 | Canonical Limited | User interface for a computing device |
US20140189549A1 (en) * | 2013-01-02 | 2014-07-03 | Canonical Limited | User interface for a computing device |
US11245785B2 (en) | 2013-01-02 | 2022-02-08 | Canonical Limited | User interface for a computing device |
US11706330B2 (en) | 2013-01-02 | 2023-07-18 | Canonical Limited | User interface for a computing device |
US10122838B2 (en) | 2013-01-02 | 2018-11-06 | Canonical Limited | User interface for a computing device |
US20140237421A1 (en) * | 2013-02-20 | 2014-08-21 | Google Inc. | Intelligent window placement with multiple windows using high dpi screens |
US10796072B2 (en) | 2013-02-20 | 2020-10-06 | Google Llc | Intelligent window placement with multiple windows using high DPI screens |
US10152459B2 (en) * | 2013-02-20 | 2018-12-11 | Google Llc | Intelligent window placement with multiple windows using high DPI screens |
US10032431B2 (en) * | 2013-03-15 | 2018-07-24 | Intel Corporation | Mobile computing device technology and systems and methods utilizing the same |
US20160027399A1 (en) * | 2013-03-15 | 2016-01-28 | Intel Corporation | Mobile computing device technology and systems and methods utilizing the same |
US20140359493A1 (en) * | 2013-05-30 | 2014-12-04 | Samsung Electronics Co., Ltd. | Method, storage medium, and electronic device for mirroring screen data |
US20150065056A1 (en) * | 2013-08-30 | 2015-03-05 | Samsung Electronics Co., Ltd. | Multi display method, storage medium, and electronic device |
EP3039563B1 (en) * | 2013-08-30 | 2021-12-01 | Samsung Electronics Co., Ltd. | Multi display method, storage medium, and electronic device |
US9924018B2 (en) * | 2013-08-30 | 2018-03-20 | Samsung Electronics Co., Ltd. | Multi display method, storage medium, and electronic device |
EP2843919A1 (en) * | 2013-09-02 | 2015-03-04 | Samsung Electronics Co., Ltd | Method and apparatus for providing service by using screen mirroring |
US9652193B2 (en) | 2013-09-02 | 2017-05-16 | Samsung Electronics Co., Ltd. | Method and apparatus for providing service by using screen mirroring |
EP2849053A3 (en) * | 2013-09-13 | 2015-06-03 | Samsung Electronics Co., Ltd | Screen image mirroring method and apparatus |
US9594417B2 (en) | 2013-09-13 | 2017-03-14 | Samsung Electronics Co., Ltd. | Screen image mirroring method and apparatus |
US20160210016A1 (en) * | 2013-09-25 | 2016-07-21 | Pixtree Technologies, Inc. | Apparatus and method for sharing contents |
US10761715B2 (en) * | 2013-09-25 | 2020-09-01 | Pixtree Technologies, Inc. | Apparatus and method for sharing contents |
WO2015045788A1 (en) * | 2013-09-26 | 2015-04-02 | 株式会社リコー | Distribution management device, distribution method, and program |
JPWO2015045788A1 (en) * | 2013-09-26 | 2017-03-09 | 株式会社リコー | Distribution management apparatus, distribution method, and program |
US9894391B2 (en) | 2013-09-26 | 2018-02-13 | Ricoh Company, Limited | Distribution management apparatus, distribution method, and program |
CN105580378A (en) * | 2013-09-26 | 2016-05-11 | 株式会社理光 | Distribution management device, distribution method, and program |
US20160274955A1 (en) * | 2013-10-08 | 2016-09-22 | Zte Corporation | Method and Device for Activating and Controlling Application in Multi-Screen System, and Mobile Terminal |
US9933988B2 (en) * | 2013-10-17 | 2018-04-03 | Samsung Electronics Co., Ltd. | Display apparatus and method of controlling display apparatus |
WO2015056867A1 (en) * | 2013-10-17 | 2015-04-23 | Samsung Electronics Co., Ltd. | Display apparatus and method of controlling display apparatus |
US20180181363A1 (en) * | 2013-10-17 | 2018-06-28 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling of display apparatus |
US20150113425A1 (en) * | 2013-10-17 | 2015-04-23 | Samsung Electronics Co., Ltd. | Display apparatus and method of controlling display apparatus |
US10606544B2 (en) * | 2013-10-17 | 2020-03-31 | Samsung Electronics Co., Ltd. | Display apparatus and method for controlling of display apparatus |
CN104822082A (en) * | 2014-02-05 | 2015-08-05 | 三星电子株式会社 | Display apparatus, method for controlling the same, and computer-readable recording medium |
USD777739S1 (en) * | 2014-02-21 | 2017-01-31 | Lenovo (Beijing) Co., Ltd. | Display screen or portion thereof with graphical user interface |
USD784373S1 (en) * | 2014-02-21 | 2017-04-18 | Lenovo (Beijing) Co., Ltd. | Display screen or portion thereof with graphical user interface |
US9358886B2 (en) * | 2014-03-18 | 2016-06-07 | Obigo Inc. | Method for configuring user interface of head unit of vehicle dynamically by using mobile terminal, and head unit and computer-readable recording media using the same |
US20150266378A1 (en) * | 2014-03-18 | 2015-09-24 | Obigo Inc. | Method for configuring user interface of head unit of vehicle dynamically by using mobile terminal, and head unit and computer-readable recording media using the same |
EP3096530A4 (en) * | 2014-07-07 | 2016-11-23 | Le Holdings Beijing Co Ltd | Data processing method and apparatus and mobile terminal device |
CN105282602A (en) * | 2014-07-07 | 2016-01-27 | 乐视致新电子科技(天津)有限公司 | Data processing method, apparatus and mobile terminal equipment |
EP3172638B1 (en) * | 2014-09-12 | 2020-01-08 | Samsung Electronics Co., Ltd. | Method of controlling display of electronic device and electronic device thereof |
US10438525B2 (en) | 2014-09-12 | 2019-10-08 | Samsung Electronics Co., Ltd. | Method of controlling display of electronic device and electronic device thereof |
US20230388588A1 (en) * | 2014-12-15 | 2023-11-30 | Rovi Guides, Inc. | Methods and systems for distributing media guidance among multiple devices |
US10956008B2 (en) | 2015-01-07 | 2021-03-23 | Microsoft Technology Licensing, Llc | Automatic home screen determination based on display device |
EP3243333A1 (en) * | 2015-01-07 | 2017-11-15 | Microsoft Technology Licensing, LLC | Automatic home screen determination based on display device |
US11061549B2 (en) * | 2015-01-22 | 2021-07-13 | Samsung Electronics Co., Ltd. | Display apparatus, control apparatus, and operating methods thereof |
US10579242B2 (en) * | 2015-01-22 | 2020-03-03 | Samsung Electronics Co., Ltd. | Display apparatus, control apparatus, and operating methods thereof including controlling a display mode of the display apparatus based on a status signal and transmitting GUI to an external apparatus |
US20160216876A1 (en) * | 2015-01-22 | 2016-07-28 | Samsung Electronics Co., Ltd. | Display apparatus, control apparatus, and operating methods thereof |
EP3300377A3 (en) * | 2015-01-22 | 2018-07-18 | Samsung Electronics Co., Ltd. | Display apparatus, control apparatus, and operating methods thereof |
KR20170000738A (en) * | 2015-06-24 | 2017-01-03 | 삼성전자주식회사 | Apparatus and method for split screen display on mobile device |
KR102492555B1 (en) * | 2015-06-24 | 2023-01-27 | 삼성전자주식회사 | Apparatus and method for split screen display on mobile device |
EP3314890A4 (en) * | 2015-06-24 | 2018-05-16 | Samsung Electronics Co., Ltd. | Apparatus and method for split screen display on mobile device |
US10043487B2 (en) | 2015-06-24 | 2018-08-07 | Samsung Electronics Co., Ltd. | Apparatus and method for split screen display on mobile device |
USD768689S1 (en) * | 2015-07-27 | 2016-10-11 | Microsoft Corporation | Display screen with animated graphical user interface |
USD765708S1 (en) * | 2015-07-27 | 2016-09-06 | Microsoft Corporation | Display screen with animated graphical user interface |
WO2017087072A1 (en) * | 2015-11-17 | 2017-05-26 | Intel Corporation | Contextual display state management for multi-display systems |
US20170160882A1 (en) * | 2015-12-07 | 2017-06-08 | Samsung Electronics Co., Ltd. | Electronic apparatus and controlling method thereof |
CN106843780A (en) * | 2015-12-07 | 2017-06-13 | 三星电子株式会社 | Electronic equipment and its control method |
US10419453B2 (en) * | 2015-12-14 | 2019-09-17 | Certis Cisco Security Pte Ltd | System and method for 3D abstract object modelling of high entropic information security threats |
CN107111712A (en) * | 2015-12-14 | 2017-08-29 | 策安保安有限公司 | The system and method that 3D abstract objects for high entropy information security threat are modeled |
EP3198504B1 (en) * | 2015-12-14 | 2022-08-31 | Certis Cisco Security Pte Ltd | System and method for 3d abstract object modelling of high entropic information security threats |
US10089057B2 (en) * | 2015-12-17 | 2018-10-02 | International Business Machines Corporation | Display redistribution between a primary display and a secondary display |
US20170177290A1 (en) * | 2015-12-17 | 2017-06-22 | International Business Machines Corporation | Display redistribution between a primary display and a secondary display |
US10223061B2 (en) * | 2015-12-17 | 2019-03-05 | International Business Machines Corporation | Display redistribution between a primary display and a secondary display |
US20170322763A1 (en) * | 2016-05-06 | 2017-11-09 | Lenovo (Beijing) Co., Ltd. | Control method and electronic device |
US20170344333A1 (en) * | 2016-05-24 | 2017-11-30 | Samsung Electronics Co., Ltd. | Screen controlling method and electronic device for supporting the same |
US10228835B2 (en) * | 2016-12-23 | 2019-03-12 | Beijing Kingsoft Internet Security Software Co., Ltd. | Method for displaying information, and terminal equipment |
US11372613B2 (en) | 2017-06-09 | 2022-06-28 | Huawei Technologies Co., Ltd. | Display method and apparatus |
EP3623932B1 (en) * | 2017-06-09 | 2024-03-06 | Huawei Technologies Co., Ltd. | Display method and device |
US11740851B2 (en) | 2017-06-09 | 2023-08-29 | Huawei Technologies Co., Ltd. | Display method and apparatus |
US11068226B2 (en) | 2017-06-09 | 2021-07-20 | Huawei Technologies Co., Ltd. | Display method and apparatus |
US11379042B2 (en) * | 2017-07-10 | 2022-07-05 | Telefonaktiebolaget Lm Ericsson (Publ) | Transmission of haptic input |
US10732916B2 (en) * | 2017-11-28 | 2020-08-04 | Ncr Corporation | Multi-device display processing |
US20200356255A1 (en) * | 2017-11-28 | 2020-11-12 | Shenzhen Mindray Bio-Medical Electronics Co., Ltd. | Monitor and display screen switching method therefor |
CN111479495A (en) * | 2017-11-28 | 2020-07-31 | 深圳迈瑞生物医疗电子股份有限公司 | Monitor and display screen switching method thereof |
US11656757B2 (en) * | 2017-11-28 | 2023-05-23 | Shenzhen Mindray Bio-Medical Electronics Co., Ltd. | Monitor and display screen switching method therefor |
US20190163431A1 (en) * | 2017-11-28 | 2019-05-30 | Ncr Corporation | Multi-device display processing |
JP7013850B2 (en) | 2017-12-22 | 2022-02-01 | セイコーエプソン株式会社 | Processing equipment, display systems, and programs |
JP2019114050A (en) * | 2017-12-22 | 2019-07-11 | セイコーエプソン株式会社 | Processing device, display system, and program |
US10650790B2 (en) | 2018-04-30 | 2020-05-12 | Ramzi Khalil Maalouf | System, apparatus, and method for optimizing viewing experience on an intelligent terminal |
WO2019212575A1 (en) * | 2018-04-30 | 2019-11-07 | Ramzi Khalil Maalouf | System, apparatus, and method for optimizing viewing experience on an intelligent terminal |
US20190333479A1 (en) * | 2018-04-30 | 2019-10-31 | Ramzi Khalil Maalouf | System, apparatus, and method for optimizing viewing experience on an intelligent terminal |
US11455971B2 (en) * | 2018-07-19 | 2022-09-27 | Hewlett-Packard Development Company, L.P. | Conversion of glyphs to images |
WO2020018103A1 (en) * | 2018-07-19 | 2020-01-23 | Hewlett-Packard Development Company, L.P. | Conversion of glyphs to images |
US20200042150A1 (en) * | 2018-08-02 | 2020-02-06 | Aac Acoustic Technologies (Shenzhen) Co., Ltd. | Method for Determining Working Mode, Touch Device and Readable Storage Medium |
US10760728B1 (en) | 2018-09-25 | 2020-09-01 | Ramzi Khalil Maalouf | Stand for a terminal system with adjustable screen orientation |
US10346122B1 (en) * | 2018-10-18 | 2019-07-09 | Brent Foster Morgan | Systems and methods for a supplemental display screen |
US11289055B2 (en) * | 2019-03-20 | 2022-03-29 | Wistron Corporation | Display device and operating method thereof |
US20220300153A1 (en) * | 2019-08-29 | 2022-09-22 | Honor Device Co., Ltd. | Control method applied to screen projection scenario and related device |
US11809704B2 (en) * | 2019-08-29 | 2023-11-07 | Honor Device Co., Ltd. | Control method applied to screen projection scenario and related device |
US11471757B2 (en) * | 2019-12-31 | 2022-10-18 | Giga-Byte Technology Co., Ltd. | Electronic device and method of automatically triggering hot key using display image |
US20230176806A1 (en) * | 2020-04-20 | 2023-06-08 | Huawei Technologies Co., Ltd. | Screen Projection Display Method and System, Terminal Device, and Storage Medium |
WO2022123390A1 (en) * | 2020-12-11 | 2022-06-16 | 株式会社半導体エネルギー研究所 | Operation method for display system |
US20230350622A1 (en) * | 2022-05-02 | 2023-11-02 | Dell Products L.P. | Dynamically configuring external display devices |
Also Published As
Publication number | Publication date |
---|---|
US11715439B2 (en) | 2023-08-01 |
US20210398504A1 (en) | 2021-12-23 |
KR20130073262A (en) | 2013-07-03 |
KR101522399B1 (en) | 2015-05-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11715439B2 (en) | Dynamically controlling display mode of external device coupled to user equipment | |
US9766785B2 (en) | Selectively tranferring image data from user equipment to external device | |
US11586293B2 (en) | Display control method and apparatus | |
US20130050122A1 (en) | Controlling user equipment as touch pad for external device connected thereto | |
US20120274656A1 (en) | Controlling display setting according to external device connected to user equipment | |
KR102241291B1 (en) | An electronic device and operating method thereof | |
US8949494B2 (en) | User equipment connectable to an external device | |
US9542338B2 (en) | Controlling applications according to connection state and execution condition | |
US8959267B2 (en) | Controlling an external device connected to user equipment | |
EP4130951A1 (en) | Content sharing method and electronic device | |
WO2021169959A1 (en) | Application starting method and electronic device | |
US20200257411A1 (en) | Method for providing user interface related to note and electronic device for the same | |
WO2020151460A1 (en) | Object processing method and terminal device | |
KR20220092611A (en) | Application sharing method, first electronic device and computer-readable storage medium | |
WO2020215950A1 (en) | Interface display method and terminal device | |
WO2020192297A1 (en) | Screen interface switching method and terminal device | |
US20130326092A1 (en) | Processing input event of external device | |
WO2020211596A1 (en) | Control method and terminal device | |
US20140181726A1 (en) | Method and electronic device for providing quick launch access and storage medium | |
WO2020173316A1 (en) | Image display method, terminal, and mobile terminal | |
WO2020042921A1 (en) | Screen control method and electronic device | |
KR20210025967A (en) | Mobile terminal and electronic device comprising the mobile terminal | |
US9514306B2 (en) | Restricting operation results from being transferred to coupled external device | |
WO2020168882A1 (en) | Interface display method and terminal device | |
US20130166789A1 (en) | Controlling device setting based on device setting guide information |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KT CORPORATION, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEE, JUNG-WOOK;KANG, YOU-JIN;LEE, SEOUNG-WOO;AND OTHERS;REEL/FRAME:029524/0691 Effective date: 20121221 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: ADVISORY ACTION MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: NOTICE OF APPEAL FILED |
|
STCV | Information on status: appeal procedure |
Free format text: APPEAL BRIEF (OR SUPPLEMENTAL BRIEF) ENTERED AND FORWARDED TO EXAMINER |
|
STCV | Information on status: appeal procedure |
Free format text: EXAMINER'S ANSWER TO APPEAL BRIEF MAILED |
|
STCV | Information on status: appeal procedure |
Free format text: ON APPEAL -- AWAITING DECISION BY THE BOARD OF APPEALS |
|
STCV | Information on status: appeal procedure |
Free format text: BOARD OF APPEALS DECISION RENDERED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- AFTER EXAMINER'S ANSWER OR BOARD OF APPEALS DECISION |