WO2016181436A1 - Image output control method, image output control program, and display device - Google Patents

Image output control method, image output control program, and display device Download PDF

Info

Publication number
WO2016181436A1
WO2016181436A1 PCT/JP2015/063281 JP2015063281W WO2016181436A1 WO 2016181436 A1 WO2016181436 A1 WO 2016181436A1 JP 2015063281 W JP2015063281 W JP 2015063281W WO 2016181436 A1 WO2016181436 A1 WO 2016181436A1
Authority
WO
WIPO (PCT)
Prior art keywords
screen
display
display device
application
image
Prior art date
Application number
PCT/JP2015/063281
Other languages
French (fr)
Japanese (ja)
Inventor
忍武 時田
Original Assignee
富士通株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士通株式会社 filed Critical 富士通株式会社
Priority to CN201580079658.9A priority Critical patent/CN107533448A/en
Priority to EP15891762.5A priority patent/EP3296859A4/en
Priority to PCT/JP2015/063281 priority patent/WO2016181436A1/en
Priority to JP2017517461A priority patent/JP6504248B2/en
Publication of WO2016181436A1 publication Critical patent/WO2016181436A1/en
Priority to US15/787,895 priority patent/US20180039470A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/12—Synchronisation between the display unit and other units, e.g. other display units, video-disc players
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G09G5/14—Display of multiple viewports
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2354/00—Aspects of interface with display user
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G2360/00—Aspects of the architecture of display systems
    • G09G2360/04—Display device controller operating with a plurality of display units

Definitions

  • the present invention relates to an image output control method, an image output control program, and a display device.
  • a small screen and a large screen are used by connecting a large screen external display or projector to a tablet terminal with a small screen of about 6 to 8 inches.
  • a technology for switching between a mirror display mode for displaying the same data on the screens of the mobile terminal and the external display device and an extended display mode for displaying different data, and selecting the extended display mode based on the activation of a predetermined application is known (see, for example, Patent Document 1).
  • an application for a tablet-type terminal is created with an optimal design for a small screen mounted on the tablet terminal.
  • an application designed for a small screen is displayed on a large screen.
  • the size of characters and buttons may be displayed larger than expected on the external display, the layout may be corrupted depending on the resolution, or may not fit in the drawing area of the screen.
  • an object of the present invention is to solve a problem in outputting an image to a plurality of display devices having different screen functions.
  • an image output control method in which a computer executes a process of outputting an image using screens of a plurality of display devices having different screen functions.
  • the other display device of the plurality of display devices realizes the screen function, and the other display device performs the screen function.
  • the display device according to the present embodiment includes a tablet terminal 10 and an external display 20.
  • the tablet terminal 10 and the external display 20 are connected.
  • the two screens of the tablet terminal 10 and the external display 20 are managed integrally.
  • the tablet terminal 10 and the external display 20 are examples of a display device.
  • the screen mounted on the tablet terminal 10 is about 6 to 8 inches, which is smaller than the screen of the external display 20. Therefore, in recent years, as shown in FIG. 1, a small screen tablet terminal 10 is connected to a large screen external display 20 or projector, and a plurality of display devices are used to function as an alternative to a PC. Yes.
  • the tablet terminal 10 and the external display 20 are examples of a plurality of display devices having different screen functions.
  • the screen of the tablet terminal 10 (hereinafter also referred to as “main body screen”) and the screen of the external display 20 (hereinafter also referred to as “external screen”) are examples of the screens of a plurality of display devices.
  • the difference in screen functions of the plurality of display devices includes at least one of a difference in screen resolution and the presence or absence of a screen touch function.
  • a tablet terminal 10 as a main body, and when an application operates on an OS (Operating System) of the tablet terminal 10, a screen output control process according to this embodiment described later is executed.
  • OS Operating System
  • the external display 20 may be a television, a projector, a signage, or other display device as long as it is a display device having a screen larger than the main body screen of the tablet terminal 10.
  • a cable for connecting to the external display 20 an HDMI (registered trademark) (High-DefinitioninMultimedia Interface) cable or a DisplayPort cable can be used.
  • a DVI (Digital Visual Interface) cable or an analog RGB cable may be used.
  • the tablet terminal 10 and the external display 20 may be wirelessly connected.
  • FIG. 2 shows patterns (hereinafter also referred to as “display patterns”) that can be considered as combinations of image output destinations on the main body screen of the tablet terminal 10 and the external screen of the external display 20.
  • display patterns can be considered as combinations of image output destinations on the main body screen of the tablet terminal 10 and the external screen of the external display 20.
  • OS for example, if it is Windows (registered trademark), it is possible to select one of the display patterns in FIG. 2 and perform screen output.
  • Each display pattern 1 to 5 will be described below.
  • a screen managed by the OS is displayed on the main body screen, and even if the external display 20 is connected to the tablet terminal 10, the external screen is in a non-operating state and nothing is displayed.
  • the main body screen of the tablet terminal 10 is a main display
  • the external screen of the external display 20 is a second display, which is expanded and displayed on two screens.
  • the OS manages the display area of the main body screen and the external screen as a continuous drawing area, and different contents are displayed on the main body screen and the external screen.
  • the coordinate origin is set on the main body screen, and the upper left corner of the main body screen is the coordinate origin (0, 0) (see FIG. 6).
  • a desktop icon and a task tray are displayed on the main body screen.
  • the extended display in which the coordinate origin is set on the main body screen in this manner is hereinafter referred to as extended display (1).
  • the display pattern 3 is expanded and displayed on two screens, with the external screen as the main display and the main body screen as the second display.
  • the OS manages the display area of the main body screen and the external screen as a continuous drawing area, and different contents are displayed on the main body screen and the external screen.
  • the coordinate origin is set on the external screen, and the upper left corner of the external screen is the coordinate origin (0, 0).
  • desktop icons and task trays are displayed on the external screen.
  • the extended display in which the coordinate origin is set on the external screen in this way is hereinafter referred to as extended display (2).
  • ⁇ Display pattern 4 The display pattern 4 is duplicated and displayed on two screens, a main body screen and an external screen. In this case, the main body screen and the external screen are regarded as drawing areas having the same resolution, and the same contents are displayed on both screens.
  • ⁇ Display pattern 5 The display pattern 5 is displayed on the external screen only. In this case, a screen managed by the OS is displayed on the external screen, and even when the external display 20 is connected to the tablet terminal 10, the main body screen is in a non-operating state and nothing is displayed.
  • Some applications for the tablet terminal 10 have a function of creating an image with an optimal design when displayed on a small main body screen mounted on the tablet terminal 10 and displaying the image on the main body screen in an easy-to-see manner. Some are made with a user interface that is easy to operate with a touch panel on the main body screen.
  • an application designed for a small screen is displayed on a large screen, and therefore the size of characters and buttons may be displayed larger than expected.
  • the resolution there may be a display situation in which the layout is broken or the image protrudes from the drawing area of the screen.
  • buttons user interfaces
  • the external screen of the external display 20 is displayed.
  • the screen displays only four buttons.
  • an application is started during a presentation by a projector, such a display is drawn on the entire screen.
  • the touch panel function is not mounted on the external display 20, the buttons displayed on the external screen cannot be directly touch-operated, so it is necessary to operate using a mouse or the like, which improves user operability and convenience.
  • the actual display method depends on the OS mechanism and application. For example, if the size of the parts (each image) on the screen is automatically adjusted so that the parts such as buttons that make up the application fit on the main body screen, the layout will be correct even if the UI parts fit on the external screen. Sometimes it cannot be expressed correctly. Further, when such automatic adjustment is not performed, the drawing area of the external screen may be protruded as shown in FIG. Further, if the touch panel function is not mounted on the external display 20, the buttons displayed on the external screen cannot be directly touch-operated. Further, even if the external display 20 is equipped with a touch panel function, it is not possible to touch the buttons in the protruding portion.
  • the layout is corrupted when the application for the tablet terminal 10 is displayed on the external display. Eliminate such problems. Moreover, the subject that a touch operation cannot be performed by being displayed on the external display 20 which is not equipped with a touch panel is solved.
  • An application that executes the image output control method according to the present embodiment is activated on the OS 2 of the tablet terminal 10 as shown in FIG. 4, for example.
  • the application 1 executed in the present embodiment includes a startup processing unit 11 and a main processing unit 12.
  • the activation processing unit 11 executes image output control when the application 1 is activated.
  • the main processing unit 12 performs processing necessary for the application 1.
  • the activation processing unit 11 includes a screen display state determination unit 13, a drawing area designation unit 14, and a screen switching processing unit 15.
  • the screen display state determination unit 13 checks the display state of the screen when the application 1 is activated.
  • the drawing area designating unit 14 designates an area on the screen for displaying an image created by executing the application 1.
  • the screen switching processing unit 15 requests the OSS to switch the screen output destination (display destination) as necessary.
  • the OS 2 has a screen management unit 16.
  • the screen management unit 16 manages the connection state of display devices such as the tablet terminal 10 having a main body screen and the external display 20 having an external screen, and the display state on which display.
  • a graphics driver 17 is installed in OS2.
  • the Graphics driver 17 has a screen switching control unit 18.
  • the screen switching control unit 18 performs switching control of the screen output destination for the graphics controller (see FIG. 6) in response to a screen switching request from the OS 2.
  • the unit 13 acquires from the screen management unit 16 of the OS 2 information on the connection state of other display devices such as the external display 20 at that time and information on the screen output destination.
  • the connection state of the display can be grasped by detecting that a connection line such as an HDMI cable is connected to the tablet terminal 10 and the external display 20.
  • the screen display state determination unit 13 obtains screen output destination information by acquiring the screen mode from the screen management unit 16.
  • the screen mode is set in the screen mode setting table 4.
  • FIG. 5 shows an example of the screen mode setting table 4.
  • the screen mode setting table 4 is set with a screen mode 41 and a display pattern 42 before starting the application, and a screen operation 43 when the application 1 is started for each display pattern 42 is defined. “ON” is set in the screen mode 41 of the display pattern 42 set at that time.
  • Each display pattern corresponds to the display pattern of FIG.
  • the screen mode setting table 4 is stored in the storage unit 3 of the tablet terminal 10.
  • the registration table 5 stored in the storage unit 3 will be described in a modification of the present embodiment.
  • the operation 43 when the application 1 is started may be to start the application as it is on the main body screen. Is defined. In this case, switching of the screen output destination does not occur.
  • the screen mode 41 of the display pattern 5 is ON.
  • the user is in a state of outputting and using the screen only on the external display 20 connected to the tablet terminal 10, and the main body screen is invalid. Therefore, the screen switching processing unit 15 that has acquired the screen mode 41 requests the screen management unit 16 of the OS 2 to switch the screen output destination.
  • the OS requests the graphics driver 17 to switch the screen. As a result, the main body screen becomes effective and display on the main body screen becomes possible.
  • the drawing area designating unit 14 of the application 1 applies the application 1 to the drawing area corresponding to the main body screen based on the drawing area information acquired from the screen management unit 16 of the OS 2. Control the display of this window.
  • FIG. 6 shows an example of a drawing area set by the drawing area designating unit 14 according to the present embodiment.
  • FIG. 6 shows a drawing area managed by the OS 2 when two screens are expanded and displayed.
  • OS such as Windows
  • the drawing areas of two screens are managed as one continuous area.
  • drawing areas of different sizes are connected and managed as one drawing area as shown in FIG. 6B.
  • the windows W1 to W3 of the application 1 can be freely arranged in this drawing area.
  • FIG. 2 An example of the display pattern combining the main body screen and the external screen is as shown in FIG.
  • the activated application 1 is displayed on the main body screen by performing the operation 43 at the time of application activation shown in FIG. To.
  • the tablet terminal 10 includes a CPU 100, a main memory 201, an eMMC (embedded Multi Media Card) 202, a touch panel 203, and a built-in display 204.
  • the CPU 100 includes a graphics controller 101, a memory controller 102, a storage controller 103, and a USB controller 104.
  • the Memory controller 102 manages the main memory (main memory) 201 of the tablet terminal 10.
  • the Graphics Controller 101 manages the display content of the screen and the display device such as the external display 20.
  • the Graphics controller 101 manages a part of the area in the main memory 201 as a VRAM (Video RAM) area, and manages the state of the drawing area using the main memory 201.
  • the Graphics® Controller 101 is connected to the built-in display 204. Further, the Graphics Controller 101 can be connected to the external display 20 using an HDMI cable or the like.
  • a non-volatile storage (auxiliary storage) such as eMMC 202 is connected to the Storage Controller 103.
  • the eMMC 202 and the like store OS2 and application 1.
  • the touch panel 203 enables an input operation by touching the screen of the built-in display 204.
  • the tablet terminal 10 functions as an input device and provides an operation means to the user.
  • the touch panel 203 is connected by the USB controller 104, but may be connected by other interfaces.
  • the tablet terminal 10 may be equipped with a digitizer or both instead of the touch panel.
  • the Memory controller 102 and the Graphics controller 101 are included in the CPU 100, but these controllers may be configured by a chip different from the CPU 100.
  • the main body is equipped with the built-in display 204 and generally has no keyboard, and the touch panel 203 or the digitizer directly touches the main body screen of the tablet terminal 10 on the screen. Input operation is possible.
  • the terminal side may be a PC (personal computer) equipped with a keyboard.
  • the terminal side may be a mobile device such as a smartphone, a portable information terminal (PDA: Personal Digital Assistant), a mobile phone, a portable music device, or a game device.
  • PDA Personal Digital Assistant
  • OS2 device drivers for each device are installed to operate various devices.
  • the Graphics driver 17 is installed in FIG.
  • an application 1 that is the main body of the present embodiment is installed in the OS 2. Processing performed from the application 1 to the device driver is executed by access from an API (Application Programming Interface) whose specifications are published by the OS 2 or the device driver. Therefore, when the application 1 switches the screen output destination between the main body screen of the tablet terminal 10 and the external screen of the external display 20, the application 1 requests the OS 2 to switch using the API. The OS 2 requests the Graphics driver 17 to switch. Eventually, the Graphics driver 17 controls the hardware Graphics Controller 101 based on software processing to realize necessary processing.
  • API Application Programming Interface
  • the above is the overall configuration, functional configuration, hardware configuration, software configuration, and basic operation policy of the display device when realizing the image output control method according to the present embodiment. 6 is realized by causing the CPU 101 to execute a process of outputting an image using the main body screen and the external screen by the image output control program installed in the OS 2.
  • two methods a first method and a second method, are conceivable as a method for mounting the image output control process in the application 1.
  • the first method is a method of mounting on a specific application 1 designed for the tablet terminal 10.
  • the second method is a method implemented in a launcher for starting an application group. The first method will be described below in the present embodiment, and the second method will be described in a modification of the present embodiment.
  • the function of this embodiment is implemented in the application 1 itself designed for a small screen.
  • the function of the image output control process of the present embodiment is implemented in the process such as startup and initialization called first in the process of the application 1. The flow of the image output control process executed when the application 1 is activated will be described with reference to FIG.
  • the activation processing unit 11 determines whether or not the external display 20 is connected (step S10). Here, if it is determined that the external display 20 is not connected, only the main body screen is the output destination. For this reason, the activation processing unit 11 operates the application 1 without particularly performing additional processing (step S14), and ends this processing.
  • the screen display state determination unit 13 determines the screen output destination based on the screen mode setting table 4 (step S12).
  • the screen display state determination unit 13 determines the screen output destination based on the screen mode 41 set in the screen mode setting table 4 shown in FIG.
  • the activation processing unit 11 activates the application 1 on the main body screen without performing any additional processing (step S14), and ends this processing.
  • the output destination of the screen is a drawing area that combines the main body screen and the external screen, and is expanded and displayed on both screens.
  • the screen switching processing unit 15 specifies the drawing area of the main body screen and switches the coordinate origin so that the screen output destination is the main body screen.
  • the activation processing unit 11 activates the application 1 on the main body screen after switching (step S16), and ends this process.
  • the method of specifying the main body screen is not limited to the method of specifying the coordinates of the drawing area corresponding to the main body screen when the main body screen and the external screen are continuous drawing areas.
  • the OS 2 manages an ID that uniquely identifies each screen and can specify the display destination of the application 1
  • the main body screen is specified as the display destination of the application 1 using the ID that identifies this screen. May be.
  • the screen output destination is a drawing area that combines the main body screen and the external screen, and is duplicated and displayed on both screens.
  • the screen output destination is only the external display. In these cases, it is necessary to enable the main body screen and switch the screen output destination to the main body screen. Therefore, when the main body screen is invalid, the drawing area designating unit 14 designates the main body screen as the drawing area, and records information on the screen output destination before switching in the main memory 201 or the like (step S18). . Thereafter, the screen switching processing unit 15 switches the screen output destination to the extended display (2).
  • the activation processing unit 11 activates the application 1 in the drawing area of the main body screen (step S20), and ends this process.
  • the application 1 when the application 1 is activated, the application 1 is always displayed on the main body screen.
  • the specific application 1 of the design optimized for the small screen of the tablet terminal 10 when the specific application 1 of the design optimized for the small screen of the tablet terminal 10 is started, the external display 20 or the projector is connected, and the screen is output there. Display defects can be solved. That is, in this embodiment, the display defect can be solved by always displaying the application 1 in the drawing area of the main body screen of the tablet terminal 10.
  • the main body screen is originally invalid and the image is displayed on the main body screen. I can't do it.
  • the screen output destination is switched when the application 1 is started in that case, and the application 1 is started after the disabled main body screen is validated. Display on the screen is possible.
  • “to enable the main body screen” is specifically switched to the extended display (2) of the display pattern 3.
  • it is possible to change the output destination of the screen by designating the external display 20 as the main display while keeping the display on the external display 20 side valid while making the main body screen valid.
  • the content that has been displayed on the external display 20 until then can be held while being displayed on the external display 20.
  • the external display 20 side is changed to the main display so that the smooth operation can be continued without changing the work environment on the external screen. be able to.
  • FIG. 10A An example of the operation image is shown in FIG. An external display 20 is connected to the tablet terminal 10.
  • the screen is output only to the external display 20, and the tablet terminal 10 is disabled.
  • a window W1 and an icon Q are displayed on the desktop screen displayed on the external display 20.
  • the user uses the mouse to click the icon Q, and selects and activates the specific application 1.
  • the screen output destination is first changed according to the definition of the extended display (2).
  • the main body screen becomes effective.
  • FIG. 10B the image R generated by the application 1 is displayed in the drawing area of the main body screen. Note that the content displayed on the external display 20 is held while being displayed on the external display 20.
  • the external display 20 is connected to the tablet terminal 10, and a duplicate display state in which an image with the same content is displayed on the main body screen and the external screen is displayed.
  • the application 1 is activated by selecting the specific application 1 indicated by the icon Q from the desktop screen displayed on the external display 20.
  • the image R generated by the application 1 is displayed in the drawing area of the main body screen after the screen output destination is changed to the extended display (2) as in the example of FIG.
  • the screen of the application 1 designed to be optimal for the screen size of the tablet terminal 10 is displayed small on the external display 20 due to a difference in resolution or being displayed protruding.
  • the screen generated by the application 1 is displayed on the main body screen.
  • the termination process shown in FIG. 12 is executed when the application 1 is terminated.
  • the drawing area designating unit 14 determines whether the screen output destination has been changed at the time of activation (step S22). When it is determined that the screen has been changed, the drawing area designating unit 14 returns the screen output destination to the state before the application 1 is started based on the original screen output destination information recorded in the main memory 201 (step S24). This process ends. If it is determined that no change has been made, the process is immediately terminated.
  • the screen output control function is implemented in the launcher for starting application 1. Therefore, the application 1 designed for the tablet terminal 10 to be activated does not need to be equipped with the screen output control function. Therefore, the same effect by the screen output control can be given to all applications included in the launcher.
  • the launcher provides a means of registering multiple applications frequently used by the user and displaying the applications in a list so that the user can start up immediately. For example, in the tablet terminal 10 of FIG. 13, a launcher in which icons L1 to L12 for starting a plurality of applications frequently used by the user are displayed as a list is registered.
  • FIG. 14 shows a flow when an application is selected from the launcher and starting of the selected application is started.
  • the launcher determines whether to start up on the main body screen based on the display attribute information 54 of the application (application name 52, installation folder 53) linked to the icon 51 specified by the user.
  • Step S30 Here, in the case of an application that is not registered to be activated on the main body screen, it is not necessary to execute the function of the image output control process, and the designated application is activated as it is (Step S14). The process ends.
  • step S10 the process proceeds to step S10, and steps after step S10 are executed.
  • Steps subsequent to step S10 are assigned the same step numbers as the screen output control process shown in FIG. 9 and are the same processes, and thus description thereof is omitted here.
  • the output destination before switching original output destination
  • a process of returning the screen output destination to the state before starting the application is executed when the application ends.
  • the screen switching process (FIG. 12) is executed when it is recognized that the process of the application for which the launcher is designated is completed.
  • the application generation screen is always displayed on the main body screen of the tablet terminal 10 when the application registered in the launcher is started.
  • the touch operation can be performed on the main body screen of the tablet terminal 10.
  • the application generation screen is displayed on the main body side, an input operation by touching the screen can be secured even when the external display 20 is not equipped with a touch panel.
  • the image output control method, the image output control program, and the display device have been described in the above embodiment.
  • the image output control method, the image output control program, and the display device according to the present invention are not limited to the above embodiment.
  • Various modifications and improvements are possible within the scope of the present invention.
  • the configuration of the display device according to the above-described embodiment and its modification is merely an example, and does not limit the scope of the present invention. It goes without saying that there are various system configuration examples depending on the application and purpose. For example, the number of display devices to which tablet terminals are connected is not limited to one, and a plurality of display devices may be used.
  • an external display is used as one display apparatus and a tablet terminal is the other display apparatus among several display apparatuses with a difference in screen function, and the function of a screen is in one display apparatus.
  • the screen function is realized on the other display device.
  • the present invention is not limited to this, and one display device is one of a plurality of display devices having a difference in screen function, and the other display device is a plurality of other display devices having a difference in screen function.
  • the display device may be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Multimedia (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)
  • Digital Computer Display Output (AREA)

Abstract

Provided is an image output control method in which a computer executes a process which outputs an image using screens of a plurality of display devices which have differences in screen function. If it is not possible to implement the screen function upon one display device of the plurality of display devices due to the differences in screen function, the screen function is implemented with another display device of the plurality of display devices, and after the implementation of the screen function with the other display device, the display device to which the image is outputted is switched to the one display device.

Description

画像出力制御方法、画像出力制御プログラム及び表示装置Image output control method, image output control program, and display device
　本発明は、画像出力制御方法、画像出力制御プログラム及び表示装置に関する。 The present invention relates to an image output control method, an image output control program, and a display device.
　６～８インチ程度の小型画面が搭載されたタブレット型の端末に、大型画面の外部ディスプレイやプロジェクタを接続し、小型画面と大型画面とを使用することが行われている。例えば、携帯端末及び外部表示装置の画面に同一データを表示させるミラー表示モードと、異なるデータを表示させる拡張表示モードとが切替可能であって所定のアプリケーションの起動に基づき拡張表示モードを選択する技術が知られている（例えば、特許文献１参照）。 A small screen and a large screen are used by connecting a large screen external display or projector to a tablet terminal with a small screen of about 6 to 8 inches. For example, a technology for switching between a mirror display mode for displaying the same data on the screens of the mobile terminal and the external display device and an extended display mode for displaying different data, and selecting the extended display mode based on the activation of a predetermined application Is known (see, for example, Patent Document 1).
特開２０１１－２１７２３６号公報JP 2011-217236 A 特開２０１４－５３０１４号公報JP 2014-53014 A
　しかしながら、小型画面を有する端末向けに作成されたアプリケーションを、大型画面を有する外部ディスプレイやプロジェクタで表示すると、アプリケーションが想定していない大きなサイズで画像が表示されたり、レイアウトが崩れて表示されたりする。 However, when an application created for a terminal having a small screen is displayed on an external display or projector having a large screen, the image may be displayed in a large size that the application does not expect, or the layout may be corrupted. .
　例えば、タブレット型の端末用のアプリケーションは、タブレット端末に搭載された小型画面に対して最適なデザインで作成されている。そのようなアプリケーションを外部ディスプレイに表示する場合、小型画面用にデザインされたアプリケーションが大画面に表示されることになる。このため、外部ディスプレイには、文字やボタンのサイズが想定以上に大きく表示されたり、解像度によってはレイアウトが崩れたり、あるいは、画面の描画領域に納まらなかったりすることがある。 For example, an application for a tablet-type terminal is created with an optimal design for a small screen mounted on the tablet terminal. When such an application is displayed on an external display, an application designed for a small screen is displayed on a large screen. For this reason, the size of characters and buttons may be displayed larger than expected on the external display, the layout may be corrupted depending on the resolution, or may not fit in the drawing area of the screen.
　そこで、一側面では、本発明は、画面の機能に差がある複数の表示装置に画像を出力する際の不具合を解消することを目的とする。 Therefore, in one aspect, an object of the present invention is to solve a problem in outputting an image to a plurality of display devices having different screen functions.
　一つの案では、画面の機能に差がある複数の表示装置の画面を使用して画像を出力する処理をコンピュータが実行する画像出力制御方法であって、前記画面の機能の差により前記複数の表示装置のうちの一方の表示装置にて画面の機能を実現できない場合、該複数の表示装置のうちの他方の表示装置にて画面の機能を実現し、前記他方の表示装置にて画面の機能を実現した後、画像の出力先の表示装置を前記一方の表示装置に切り替える、画像出力制御方法が提供される。 In one proposal, there is provided an image output control method in which a computer executes a process of outputting an image using screens of a plurality of display devices having different screen functions. When one of the display devices cannot realize the screen function, the other display device of the plurality of display devices realizes the screen function, and the other display device performs the screen function. After realizing the above, there is provided an image output control method for switching the display device to which the image is output to the one display device.
　一側面によれば、画面の機能に差がある複数の表示装置に画像を出力する際の不具合を解消することができる。 に よ According to one aspect, it is possible to solve the problems in outputting images to a plurality of display devices having different screen functions.
一実施形態にかかる表示装置の全体構成の一例を示す図。The figure which shows an example of the whole structure of the display apparatus concerning one Embodiment. 一実施形態にかかる表示パターンの一例を示す表。The table | surface which shows an example of the display pattern concerning one Embodiment. 大画面のレイアウトが崩れる場合を説明するための図。The figure for demonstrating the case where the layout of a big screen collapses. 一実施形態にかかるタブレット端末の機能構成の一例を示す図。The figure which shows an example of a function structure of the tablet terminal concerning one Embodiment. 一実施形態にかかる表示パターン毎のアプリケーション起動時の動作例を示す図。The figure which shows the operation example at the time of the application starting for every display pattern concerning one Embodiment. 一実施形態にかかる描画領域の一例を示す図。The figure which shows an example of the drawing area | region concerning one Embodiment. 一実施形態にかかるタブレット端末のハードウェア構成の一例を示す図。The figure which shows an example of the hardware constitutions of the tablet terminal concerning one Embodiment. 一実施形態にかかるタブレット端末のソフトウェア構成の一例を示す図。The figure which shows an example of the software configuration of the tablet terminal concerning one Embodiment. 一実施形態にかかるアプリケーション起動処理の一例を示すフローチャート。The flowchart which shows an example of the application starting process concerning one Embodiment. 一実施形態にかかるアプリケーション起動処理の結果の画面例を示す図。The figure which shows the example of a screen of the result of the application starting process concerning one Embodiment. 一実施形態にかかるアプリケーション起動処理の結果の画面例を示す図。The figure which shows the example of a screen of the result of the application starting process concerning one Embodiment. 一実施形態にかかるアプリケーション終了処理の一例を示すフローチャート。The flowchart which shows an example of the application completion | finish process concerning one Embodiment. 一実施形態にかかるランチャー表示画面と表示属性情報テーブルの一例を示す図。The figure which shows an example of the launcher display screen and display attribute information table concerning one Embodiment. 一実施形態の変形例にかかるアプリケーション起動処理の一例を示すフローチャート。The flowchart which shows an example of the application starting process concerning the modification of one Embodiment.
　以下、本発明の実施形態について添付の図面を参照しながら説明する。なお、本明細書及び図面において、実質的に同一の機能構成を有する構成要素については、同一の符号を付することにより重複した説明を省く。 Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, the duplicate description is abbreviate | omitted by attaching | subjecting the same code | symbol.
　［全体構成］
　まず、本発明の一実施形態にかかる表示装置の全体構成の一例について、図１を参照しながら説明する。本実施形態にかかる表示装置は、タブレット端末１０及び外部ディスプレイ２０を有する。タブレット端末１０及び外部ディスプレイ２０は接続されている。本実施形態では、タブレット端末１０及び外部ディスプレイ２０の２つの画面が一体的に管理される。タブレット端末１０及び外部ディスプレイ２０は、表示装置の一例である。 [overall structure]
First, an example of the overall configuration of a display device according to an embodiment of the present invention will be described with reference to FIG. The display device according to the present embodiment includes a tablet terminal 10 and an external display 20. The tablet terminal 10 and the external display 20 are connected. In the present embodiment, the two screens of the tablet terminal 10 and the external display 20 are managed integrally. The tablet terminal 10 and the external display 20 are examples of a display device.
　タブレット端末１０に搭載された画面は６～８インチ程度であり、外部ディスプレイ２０の画面よりも小さい。そこで、近年、図１に示すように小型画面のタブレット端末１０に大画面の外部ディスプレイ２０やプロジェクタを接続し、複数の表示装置を用いてＰＣの代替機のように機能させることが行われている。 The screen mounted on the tablet terminal 10 is about 6 to 8 inches, which is smaller than the screen of the external display 20. Therefore, in recent years, as shown in FIG. 1, a small screen tablet terminal 10 is connected to a large screen external display 20 or projector, and a plurality of display devices are used to function as an alternative to a PC. Yes.
　タブレット端末１０及び外部ディスプレイ２０は、画面の機能に差がある複数の表示装置の一例である。タブレット端末１０の画面（以下、「本体画面」ともいう。）及び外部ディスプレイ２０の画面（以下、「外部画面」ともいう。）は、複数の表示装置の画面の一例である。複数の表示装置の画面の機能の差には、画面の解像度の差及び画面のタッチ機能の有無の少なくともいずれかが含まれる。 The tablet terminal 10 and the external display 20 are examples of a plurality of display devices having different screen functions. The screen of the tablet terminal 10 (hereinafter also referred to as “main body screen”) and the screen of the external display 20 (hereinafter also referred to as “external screen”) are examples of the screens of a plurality of display devices. The difference in screen functions of the plurality of display devices includes at least one of a difference in screen resolution and the presence or absence of a screen touch function.
　本実施形態では、本体としてタブレット端末１０があり、このタブレット端末１０のＯＳ（Operating System）上でアプリケーションが動作する際に、後述される本実施形態にかかる画面出力制御処理が実行される。 In this embodiment, there is a tablet terminal 10 as a main body, and when an application operates on an OS (Operating System) of the tablet terminal 10, a screen output control process according to this embodiment described later is executed.
　外部ディスプレイ２０は、タブレット端末１０の本体画面よりも大型の画面を有する表示装置であれば、テレビでもよいし、プロジェクタでもよいし、サイネージでもよいし、その他の表示装置でもよい。外部ディスプレイ２０と接続するためのケーブルはＨＤＭＩ（登録商標）（High-Definition Multimedia Interface）ケーブル又はＤｉｓｐｌａｙＰｏｒｔケーブルを使用することができる。ＤＶＩ（Digital Visual Interface）ケーブル又はアナログＲＧＢケーブルを使用してもよい。タブレット端末１０と外部ディスプレイ２０とは、無線接続（Wireless Display）されていてもよい。 The external display 20 may be a television, a projector, a signage, or other display device as long as it is a display device having a screen larger than the main body screen of the tablet terminal 10. As a cable for connecting to the external display 20, an HDMI (registered trademark) (High-DefinitioninMultimedia Interface) cable or a DisplayPort cable can be used. A DVI (Digital Visual Interface) cable or an analog RGB cable may be used. The tablet terminal 10 and the external display 20 may be wirelessly connected.
　本実施形態では、図１に示した表示装置の構成において、タブレット端末１０の本体に内蔵した本体画面及び外部ディスプレイ２０の外部画面間において必要に応じて画像の出力先の切り替えが行われる。図２には、タブレット端末１０の本体画面及び外部ディスプレイ２０の外部画面において画像の出力先の組み合わせとして考えられるパターン（以下、「表示パターン」ともいう。）を示す。ＯＳの仕様によるが、たとえばＷｉｎｄｏｗｓ（登録商標）であれば、図２の表示パターンのいずれかを選択して画面出力を行うことができる。各表示パターン１～５を以下に説明する。
・表示パターン１
　表示パターン１では、本体画面のみに画面表示が行われれる。この場合、本体画面にＯＳが管理する画面が表示され、外部ディスプレイ２０がタブレット端末１０に接続されていても外部画面は非稼働状態で何も表示されない状態である。
・表示パターン２
　表示パターン２では、タブレット端末１０の本体画面がメインディスプレイ、外部ディスプレイ２０の外部画面がセカンドディスプレイになり、２画面に拡張表示される。この場合、ＯＳが、本体画面と外部画面の表示領域を連続した描画領域として管理している状態であり、本体画面及び外部画面には異なる内容が表示される。特にこの状態では、本体画面に座標原点が設定され、本体画面の左上が座標原点（０，０）になる（図６参照）。この場合、例えばデスクトップのアイコンやタスクトレイなどは本体画面に表示される。このように本体画面に座標原点が設定される拡張表示を以下、拡張表示（１）と表記する。
・表示パターン３
　表示パターン３は、外部画面がメインディスプレイ、本体画面がセカンドディスプレイになり、２画面に拡張表示される。この場合、ＯＳが、本体画面と外部画面の表示領域を連続した描画領域として管理している状態であり、本体画面と外部画面には異なる内容が表示される。特にこの状態では、外部画面に座標原点が設定され、外部画面の左上が座標原点（０，０）になる。この場合、例えばデスクトップのアイコンやタスクトレイなどは外部画面に表示される。このように外部画面に座標原点が設定される拡張表示を以下、拡張表示（２）と表記する。
・表示パターン４
　表示パターン４は、本体画面及び外部画面の２画面に複製表示される。この場合、本体画面及び外部画面を同じ解像度の描画領域と見なして、両方の画面に同じ内容を表示する。
・表示パターン５
　表示パターン５は、外部画面のみに画面表示が行われれる。この場合、外部画面にＯＳが管理する画面が表示され、外部ディスプレイ２０がタブレット端末１０に接続されていても本体画面は非稼働状態で何も表示されない状態である。 In the present embodiment, in the configuration of the display device illustrated in FIG. 1, an image output destination is switched between a main body screen built in the main body of the tablet terminal 10 and an external screen of the external display 20 as necessary. FIG. 2 shows patterns (hereinafter also referred to as “display patterns”) that can be considered as combinations of image output destinations on the main body screen of the tablet terminal 10 and the external screen of the external display 20. Depending on the specifications of the OS, for example, if it is Windows (registered trademark), it is possible to select one of the display patterns in FIG. 2 and perform screen output. Each display pattern 1 to 5 will be described below.
・ Display pattern 1
In display pattern 1, screen display is performed only on the main body screen. In this case, a screen managed by the OS is displayed on the main body screen, and even if the external display 20 is connected to the tablet terminal 10, the external screen is in a non-operating state and nothing is displayed.
・ Display pattern 2
In the display pattern 2, the main body screen of the tablet terminal 10 is a main display, and the external screen of the external display 20 is a second display, which is expanded and displayed on two screens. In this case, the OS manages the display area of the main body screen and the external screen as a continuous drawing area, and different contents are displayed on the main body screen and the external screen. Particularly in this state, the coordinate origin is set on the main body screen, and the upper left corner of the main body screen is the coordinate origin (0, 0) (see FIG. 6). In this case, for example, a desktop icon and a task tray are displayed on the main body screen. The extended display in which the coordinate origin is set on the main body screen in this manner is hereinafter referred to as extended display (1).
・ Display pattern 3
The display pattern 3 is expanded and displayed on two screens, with the external screen as the main display and the main body screen as the second display. In this case, the OS manages the display area of the main body screen and the external screen as a continuous drawing area, and different contents are displayed on the main body screen and the external screen. Particularly in this state, the coordinate origin is set on the external screen, and the upper left corner of the external screen is the coordinate origin (0, 0). In this case, for example, desktop icons and task trays are displayed on the external screen. The extended display in which the coordinate origin is set on the external screen in this way is hereinafter referred to as extended display (2).
・ Display pattern 4
The display pattern 4 is duplicated and displayed on two screens, a main body screen and an external screen. In this case, the main body screen and the external screen are regarded as drawing areas having the same resolution, and the same contents are displayed on both screens.
・ Display pattern 5
The display pattern 5 is displayed on the external screen only. In this case, a screen managed by the OS is displayed on the external screen, and even when the external display 20 is connected to the tablet terminal 10, the main body screen is in a non-operating state and nothing is displayed.
　［レイアウトが崩れる場合］
　タブレット端末１０用のアプリケーションには、タブレット端末１０に搭載された小型の本体画面に表示する際に最適なデザインの画像を作成し、本体画面上で見易く表示する機能があるものがある。また、本体画面上のタッチパネルで操作しやすいユーザーインターフェースで作られているものがある。 [If the layout breaks down]
Some applications for the tablet terminal 10 have a function of creating an image with an optimal design when displayed on a small main body screen mounted on the tablet terminal 10 and displaying the image on the main body screen in an easy-to-see manner. Some are made with a user interface that is easy to operate with a touch panel on the main body screen.
　そのようなアプリケーションを外部画面に表示した場合、小型画面用にデザインされたアプリケーションが大画面に表示されるため、文字やボタンのサイズが想定以上に大きく表示される場合がある。また、解像度によってはレイアウトが崩れたり、画像が画面の描画領域からはみ出してしまうといった表示状況となる場合がある。 When such an application is displayed on an external screen, an application designed for a small screen is displayed on a large screen, and therefore the size of characters and buttons may be displayed larger than expected. In addition, depending on the resolution, there may be a display situation in which the layout is broken or the image protrudes from the drawing area of the screen.
　また、タブレット端末１０用のアプリケーションが、タッチパネルやデジタイザで操作する際にタッチし易いように作られていても、タッチパネルを搭載しない外部ディスプレイ２０ではタッチによる入力操作ができず、ユーザの操作性を損なう結果となる。例えば、本体画面の解像度と外部画面の解像度の異同によって発生し得る表示状況を、図３を参照しながら説明する。
（本体画面の解像度＝外部画面の解像度）
　本体画面の解像度と外部画面の解像度とが同じ場合、表示パターン５（外部ディスプレイ２０のみに表示）に設定すると、図３（ａ）に示すように、本体画面に表示された画像は、レイアウトが崩れることなくそのまま外部画面に表示される。本体画面には画像は表示されない状態となる。 Further, even if the application for the tablet terminal 10 is designed to be easy to touch when operating with a touch panel or a digitizer, the external display 20 not equipped with the touch panel cannot perform input operation by touch, and the operability of the user is improved. Results in loss. For example, a display situation that may occur due to the difference between the resolution of the main body screen and the resolution of the external screen will be described with reference to FIG.
(System screen resolution = External screen resolution)
When the resolution of the main body screen and the resolution of the external screen are the same, if the display pattern 5 (displayed only on the external display 20) is set, the image displayed on the main body screen has a layout as shown in FIG. It will be displayed on the external screen as it is. An image is not displayed on the main body screen.
　しかし、タブレット端末１０用にデザインされたアプリケーションが、６インチ程度の小サイズの画面にてタッチ操作がし易いように画面を作成している場合、外部画面では必要以上に画像が大きく表示されることがある。例えば、図３（ｂ）に示すように、本体画面の全画面に最大化して表示され、その中に４つほどのボタン(ユーザーインターフェース)が配置されている場合、外部ディスプレイ２０の外部画面に４つのボタンだけが表示されるような画面になる。また、プロジェクタでプレゼンテーションをしている間にアプリケーションが起動した場合、スクリーン一面にそのような表示が描画されることになる。また、外部ディスプレイ２０にタッチパネルの機能が搭載されていなければ、外部画面に表示されたボタン等は直接タッチ操作できないため、マウス等を使って操作する必要があり、ユーザの操作性及び利便性に欠ける。
（本体画面の解像度＞外部画面の解像度）
　本体画面の解像度が外部画面の解像度よりも高い場合、同様に表示パターン５（外部ディスプレイ２０のみに表示）に設定すると、解像度が高い本体画面に表示された画像が解像度が低い外部画面に表示される。このため、アプリケーションがＯＳにより実行されたときに本体画面に表示されるレイアウトをそのまま外部画面にて再現することは困難である。 However, when an application designed for the tablet terminal 10 creates a screen so that a touch operation is easy on a small screen of about 6 inches, the image is displayed larger than necessary on the external screen. Sometimes. For example, as shown in FIG. 3B, when the display is maximized on the whole screen of the main body screen and about four buttons (user interfaces) are arranged therein, the external screen of the external display 20 is displayed. The screen displays only four buttons. In addition, when an application is started during a presentation by a projector, such a display is drawn on the entire screen. In addition, if the touch panel function is not mounted on the external display 20, the buttons displayed on the external screen cannot be directly touch-operated, so it is necessary to operate using a mouse or the like, which improves user operability and convenience. Lack.
(Main unit screen resolution> External screen resolution)
When the resolution of the main body screen is higher than the resolution of the external screen, similarly, if the display pattern 5 (displayed only on the external display 20) is set, the image displayed on the main body screen with a high resolution is displayed on the external screen with a low resolution. The For this reason, it is difficult to reproduce the layout displayed on the main body screen when the application is executed by the OS as it is on the external screen.
　実際にどのように表示されるかはＯＳの仕組みやアプリケーションによる。例えば、アプリケーションを構成するボタンなどの部品が本体画面に納まるように画面上の部品(各画像)のサイズを自動調整するようになっている場合、ＵＩ部品が外部画面に納まったとしてもレイアウトが正しく表現できないことがある。また、そのような自動調整が行われない場合、図３（ｃ）に示すように、外部画面の描画領域をはみ出してしまうことがある。また、外部ディスプレイ２０にタッチパネルの機能が搭載されていなければ、外部画面に表示されたボタン等を直接タッチ操作できない。また、外部ディスプレイ２０にタッチパネルの機能が搭載されていたとしても、はみ出した部分のボタンをタッチすることができない。
（本体画面の解像度＜外部画面の解像度）
　本体画面の解像度が外部画面の解像度よりも低い場合、同様に表示パターン５（外部ディスプレイ２０のみに表示）に設定すると、解像度が低い本体画像に表示された画像を、解像度が高い外部画面に表示することになる。このため、図３（ｄ）に示すように、外部画面の描画領域には十分納まるが、極端に小さい画像が表示される可能性がある。この場合においても外部ディスプレイ２０にタッチパネルの機能が搭載されていなければ、外部画面に表示されたボタン等を直接タッチ操作できない。また、外部ディスプレイ２０にタッチパネルの機能が搭載されていたとしても、極端に小さい画像が表示されている場合にはタッチし難く、誤操作したり、実質的にタッチが困難な表示状態となる。 The actual display method depends on the OS mechanism and application. For example, if the size of the parts (each image) on the screen is automatically adjusted so that the parts such as buttons that make up the application fit on the main body screen, the layout will be correct even if the UI parts fit on the external screen. Sometimes it cannot be expressed correctly. Further, when such automatic adjustment is not performed, the drawing area of the external screen may be protruded as shown in FIG. Further, if the touch panel function is not mounted on the external display 20, the buttons displayed on the external screen cannot be directly touch-operated. Further, even if the external display 20 is equipped with a touch panel function, it is not possible to touch the buttons in the protruding portion.
(Main unit screen resolution <External screen resolution)
If the resolution of the main body screen is lower than the resolution of the external screen, similarly, if the display pattern 5 (displayed only on the external display 20) is set, the image displayed on the main body image with a low resolution is displayed on the external screen with a high resolution. Will do. For this reason, as shown in FIG. 3D, an extremely small image may be displayed although it fits sufficiently in the drawing area of the external screen. Even in this case, if the touch panel function is not mounted on the external display 20, the buttons displayed on the external screen cannot be directly touched. Even if the external display 20 is equipped with a touch panel function, when an extremely small image is displayed, it is difficult to touch, and a display state in which it is erroneously operated or substantially difficult to touch is obtained.
　そこで、本実施形態では、上述のようにタブレット端末１０の本体画面と外部ディスプレイ２０の外部画面のサイズや解像度が異なるため、外部ディスプレイにタブレット端末１０用のアプリケーションが表示されたときにレイアウトが崩れる等の不具合を解消する。また、タッチパネルを搭載していない外部ディスプレイ２０に表示されてしまうことでタッチ操作ができないという課題を解決する。 Therefore, in the present embodiment, since the size and resolution of the main body screen of the tablet terminal 10 and the external screen of the external display 20 are different as described above, the layout is corrupted when the application for the tablet terminal 10 is displayed on the external display. Eliminate such problems. Moreover, the subject that a touch operation cannot be performed by being displayed on the external display 20 which is not equipped with a touch panel is solved.
　［機能構成］
　本実施形態にかかる画像出力制御方法を実行するアプリケーションは、例えば、図４に示すようにタブレット端末１０のＯＳ２上で起動される。本実施形態で実行されるアプリケーション１は、起動処理部１１とメイン処理部１２とを有する。起動処理部１１は、アプリケーション１の起動時に画像出力制御を実行する。メイン処理部１２は、アプリケーション１で必要な処理を行う。 [Function configuration]
An application that executes the image output control method according to the present embodiment is activated on the OS 2 of the tablet terminal 10 as shown in FIG. 4, for example. The application 1 executed in the present embodiment includes a startup processing unit 11 and a main processing unit 12. The activation processing unit 11 executes image output control when the application 1 is activated. The main processing unit 12 performs processing necessary for the application 1.
　起動処理部１１は、画面表示状態判定部１３と描画領域指定部１４と画面切替処理部１５とを有する。画面表示状態判定部１３は、アプリケーション１の起動時に画面の表示状態をチェックする。描画領域指定部１４は、アプリケーション１の実行により作成した画像を表示する画面上の領域を指定する。画面切替処理部１５は、必要に応じて画面の出力先（表示先）の切替をＯＳＳに要求する。 The activation processing unit 11 includes a screen display state determination unit 13, a drawing area designation unit 14, and a screen switching processing unit 15. The screen display state determination unit 13 checks the display state of the screen when the application 1 is activated. The drawing area designating unit 14 designates an area on the screen for displaying an image created by executing the application 1. The screen switching processing unit 15 requests the OSS to switch the screen output destination (display destination) as necessary.
　ＯＳ２は、画面管理部１６を有する。画面管理部１６は、本体画面を有するタブレット端末１０や外部画面を有する外部ディスプレイ２０等のディスプレイデバイスの接続状態、及びどのディスプレイに表示しているかの表示状態を管理する。 OS 2 has a screen management unit 16. The screen management unit 16 manages the connection state of display devices such as the tablet terminal 10 having a main body screen and the external display 20 having an external screen, and the display state on which display.
　また、ＯＳ２にはGraphics driver１７がインストールされている。Graphics driver１７は、画面切替制御部１８を有する。画面切替制御部１８は、ＯＳ２からの画面切替の要求に応じて、Graphics Controller（図６参照）に対して画面出力先の切替制御を行う
　アプリケーション１の起動が開始されると、画面表示状態判定部１３がＯＳ２の画面管理部１６からその時点の外部ディスプレイ２０等の他の表示装置の接続状態、画面出力先の情報を取得する。本実施形態では、ディスプレイの接続状態は、ＨＤＭＩケーブル等の接続線がタブレット端末１０と外部ディスプレイ２０とに接続されたことを検出することで把握することができる。 In addition, a graphics driver 17 is installed in OS2. The Graphics driver 17 has a screen switching control unit 18. The screen switching control unit 18 performs switching control of the screen output destination for the graphics controller (see FIG. 6) in response to a screen switching request from the OS 2. The unit 13 acquires from the screen management unit 16 of the OS 2 information on the connection state of other display devices such as the external display 20 at that time and information on the screen output destination. In the present embodiment, the connection state of the display can be grasped by detecting that a connection line such as an HDMI cable is connected to the tablet terminal 10 and the external display 20.
　画面表示状態判定部１３は、画面管理部１６から画面モードを取得することで画面出力先の情報を得る。画面モードは、画面モード設定テーブル４に設定されている。図５に画面モード設定テーブル４の一例を示す。画面モード設定テーブル４は、画面モード４１とアプリケーション起動前の表示パターン４２と設定され、各表示パターン４２のアプリケーション１起動時の画面動作４３が定義されている。その時点で設定されている表示パターン４２の画面モード４１には「ＯＮ」が設定されている。なお、各表示パターンは、図２の表示パターンに対応している。画面モード設定テーブル４は、タブレット端末１０の記憶部３に記憶されている。なお、記憶部３に記憶された登録テーブル５については、本実施形態の変形例において説明する。 The screen display state determination unit 13 obtains screen output destination information by acquiring the screen mode from the screen management unit 16. The screen mode is set in the screen mode setting table 4. FIG. 5 shows an example of the screen mode setting table 4. The screen mode setting table 4 is set with a screen mode 41 and a display pattern 42 before starting the application, and a screen operation 43 when the application 1 is started for each display pattern 42 is defined. “ON” is set in the screen mode 41 of the display pattern 42 set at that time. Each display pattern corresponds to the display pattern of FIG. The screen mode setting table 4 is stored in the storage unit 3 of the tablet terminal 10. The registration table 5 stored in the storage unit 3 will be described in a modification of the present embodiment.
　図５の例では、画面モード設定テーブル４に設定されているアプリケーション起動前の表示パターン４２が「１」の場合、アプリケーション１起動時の動作４３としては、本体画面にそのままアプリを起動することが定義されている。この場合、画面出力先の切り替えは発生しない。 In the example of FIG. 5, when the display pattern 42 before starting the application set in the screen mode setting table 4 is “1”, the operation 43 when the application 1 is started may be to start the application as it is on the main body screen. Is defined. In this case, switching of the screen output destination does not occur.
　アプリケーション１起動前の表示パターン４２が「２」の場合、アプリケーション１起動時の動作４３としては、本体画面と外部画面とを合わせた描画領域のうち、本体画面の描画領域にアプリケーション１を起動する。この場合、画面出力先の切り替えは発生しない。 When the display pattern 42 before the activation of the application 1 is “2”, as the operation 43 when the application 1 is activated, the application 1 is activated in the drawing area of the main body screen among the drawing areas including the main body screen and the external screen. . In this case, switching of the screen output destination does not occur.
　アプリケーション１起動前の表示パターン４２が「３」の場合、アプリケーション１起動時の動作４３としては、本体画面と外部画面とを合わせた描画領域のうち、本体画面の描画領域にアプリケーション１を起動する。この場合、画面出力先の切り替えは発生しない。 When the display pattern 42 before the activation of the application 1 is “3”, as the operation 43 when the application 1 is activated, the application 1 is activated in the drawing area of the main body screen among the drawing areas including the main body screen and the external screen. . In this case, switching of the screen output destination does not occur.
　アプリケーション１起動前の表示パターン４２が「４」の場合、アプリケーション１起動時の動作４３としては、出力先を「拡張表示（２）」に切り替え、本体画面の描画領域にアプリケーション１を起動する。 When the display pattern 42 before the activation of the application 1 is “4”, as the operation 43 when the application 1 is activated, the output destination is switched to “extended display (2)”, and the application 1 is activated in the drawing area of the main body screen.
　アプリケーション１起動前の表示パターン４２が「５」の場合、アプリケーション１起動時の動作４３としては、出力先を「拡張表示（２）」に切り替え、本体画面の描画領域にアプリケーション１を起動する。 When the display pattern 42 before the activation of the application 1 is “5”, as the operation 43 when the application 1 is activated, the output destination is switched to “extended display (2)”, and the application 1 is activated in the drawing area of the main body screen.
　図５の例では、表示パターン５の画面モード４１がＯＮになっている。この場合、ユーザは、タブレット端末１０に接続されている外部ディスプレイ２０のみに画面を出力して使用している状態であり、本体画面は無効になっている。そこで、画面モード４１を取得した画面切替処理部１５は、ＯＳ２の画面管理部１６に画面出力先の切替を要求する。ＯＳはその要求を受けて、Graphics driver１７に画面切替を要求する。これにより、本体画面が有効になり、本体画面への表示が可能になる。 In the example of FIG. 5, the screen mode 41 of the display pattern 5 is ON. In this case, the user is in a state of outputting and using the screen only on the external display 20 connected to the tablet terminal 10, and the main body screen is invalid. Therefore, the screen switching processing unit 15 that has acquired the screen mode 41 requests the screen management unit 16 of the OS 2 to switch the screen output destination. In response to the request, the OS requests the graphics driver 17 to switch the screen. As a result, the main body screen becomes effective and display on the main body screen becomes possible.
　切り替えの必要がない場合又は画面の切り替えが完了したら、アプリケーション１の描画領域指定部１４は、ＯＳ２の画面管理部１６から取得した描画領域の情報に基づいて本体画面に該当する描画領域にアプリケーション１のウィンドウを表示するように制御する。 When switching is not necessary or when screen switching is completed, the drawing area designating unit 14 of the application 1 applies the application 1 to the drawing area corresponding to the main body screen based on the drawing area information acquired from the screen management unit 16 of the OS 2. Control the display of this window.
　図６は、本実施形態にかかる描画領域指定部１４が設定する描画領域の一例を示す。図６には、２つの画面を拡張表示しているときにＯＳ２が管理する描画領域が示される。例えばＷｉｎｄｏｗｓ等のＯＳでは、２つの画面の描画領域は連続した一つの領域として管理される。 FIG. 6 shows an example of a drawing area set by the drawing area designating unit 14 according to the present embodiment. FIG. 6 shows a drawing area managed by the OS 2 when two screens are expanded and displayed. For example, in an OS such as Windows, the drawing areas of two screens are managed as one continuous area.
　たとえば、図６（ａ）のように、タブレット端末１０の本体画面及び外部ディスプレイ２０の外部画面の解像度が同じ場合、同じサイズの２つの描画領域を接続した領域が描画領域として管理される。 For example, as shown in FIG. 6A, when the resolutions of the main body screen of the tablet terminal 10 and the external screen of the external display 20 are the same, an area connecting two drawing areas of the same size is managed as the drawing area.
　一方、異なる解像度の本体画面及び外部画面が接続されている場合、図６（ｂ）のように、異なるサイズの描画領域が接続されて一つの描画領域として管理される。アプリケーション１のウィンドウＷ１～Ｗ３は、この描画領域内で自由に配置することができる。 On the other hand, when a main screen and an external screen having different resolutions are connected, drawing areas of different sizes are connected and managed as one drawing area as shown in FIG. 6B. The windows W1 to W3 of the application 1 can be freely arranged in this drawing area.
　本体画面と外部画面とを組み合わせた表示パターンの一例は、図２に示した通りである。本実施形態では、図２に示したそれぞれの表示パターンの状態でアプリケーション１を起動したときに、図５に示すアプリケーション起動時の動作４３を行うことで起動したアプリケーション１を本体画面に表示するようにする。 An example of the display pattern combining the main body screen and the external screen is as shown in FIG. In the present embodiment, when the application 1 is activated in the state of each display pattern shown in FIG. 2, the activated application 1 is displayed on the main body screen by performing the operation 43 at the time of application activation shown in FIG. To.
　［ハードウェア構成］
　次に、タブレット端末１０のハードウェア構成の一例について、図７を参照して説明する。タブレット端末１０は、ＣＰＵ１００、メインメモリ２０１、ｅＭＭＣ（embedded Multi Media Card）２０２、タッチパネル２０３及び内蔵ディスプレイ２０４を有する。ＣＰＵ１００は、Graphics Controller１０１、Memory Controller１０２、Storage Controller１０３、USB Controller１０４を有する。 [Hardware configuration]
Next, an example of the hardware configuration of the tablet terminal 10 will be described with reference to FIG. The tablet terminal 10 includes a CPU 100, a main memory 201, an eMMC (embedded Multi Media Card) 202, a touch panel 203, and a built-in display 204. The CPU 100 includes a graphics controller 101, a memory controller 102, a storage controller 103, and a USB controller 104.
　Memory Controller１０２は、タブレット端末１０のメインメモリ（主記憶）２０１を管理する。Graphics Controller１０１は、画面の表示内容の管理や外部ディスプレイ２０等の表示装置の管理を行う。Graphics Controller１０１は、メインメモリ２０１内の一部の領域をＶＲＡＭ（Video RAM）領域として管理し、メインメモリ２０１を使用して描画領域の状態を管理する。Graphics Controller１０１は、内蔵ディスプレイ２０４と接続されている。また、Graphics Controller１０１は、ＨＤＭＩケーブルなどを使用して外部ディスプレイ２０と接続することが可能である。 The Memory controller 102 manages the main memory (main memory) 201 of the tablet terminal 10. The Graphics Controller 101 manages the display content of the screen and the display device such as the external display 20. The Graphics controller 101 manages a part of the area in the main memory 201 as a VRAM (Video RAM) area, and manages the state of the drawing area using the main memory 201. The Graphics® Controller 101 is connected to the built-in display 204. Further, the Graphics Controller 101 can be connected to the external display 20 using an HDMI cable or the like.
　Storage Controller１０３には、ｅＭＭＣ２０２などの不揮発ストレージ(補助記憶)が接続されている。ｅＭＭＣ２０２等には、ＯＳ２やアプリケーション１が格納されている。例えば、タッチパネル２０３は、内蔵ディスプレイ２０４の画面上のタッチによる入力操作を可能とする。これにより、タブレット端末１０は、入力装置として機能し、ユーザーに操作手段を提供する。図７の例では、タッチパネル２０３は、USB Controller１０４で接続されているが、その他のインターフェースで接続されてもよい。また、タブレット端末１０には、タッチパネルではなく、デジタイザ、あるいはその両方が搭載されてもよい。 A non-volatile storage (auxiliary storage) such as eMMC 202 is connected to the Storage Controller 103. The eMMC 202 and the like store OS2 and application 1. For example, the touch panel 203 enables an input operation by touching the screen of the built-in display 204. Thereby, the tablet terminal 10 functions as an input device and provides an operation means to the user. In the example of FIG. 7, the touch panel 203 is connected by the USB controller 104, but may be connected by other interfaces. The tablet terminal 10 may be equipped with a digitizer or both instead of the touch panel.
　なお、この例ではＣＰＵ１００の中にMemory Controller１０２やGraphics Controller１０１を内包したが、これらのコントローラは、ＣＰＵ１００とは別のチップで構成してもよい。 In this example, the Memory controller 102 and the Graphics controller 101 are included in the CPU 100, but these controllers may be configured by a chip different from the CPU 100.
　以上に説明したように、本体には内蔵ディスプレイ２０４が搭載され、一般的にはキーボードは搭載されておらず、タッチパネル２０３又はデジタイザにより、タブレット端末１０の本体画面を直接タッチすることで画面上での入力操作が可能になっている。ここではタブレット端末１０と記載しているが、端末側はキーボードを搭載したＰＣ(パーソナルコンピュータ)であってもよい。また、端末側はスマートフォン、携帯型情報端末（ＰＤＡ：Personal Digital Assistant）、携帯電話、携帯型音楽機器、ゲーム機器等の携帯機器であってもよい。 As described above, the main body is equipped with the built-in display 204 and generally has no keyboard, and the touch panel 203 or the digitizer directly touches the main body screen of the tablet terminal 10 on the screen. Input operation is possible. Although the tablet terminal 10 is described here, the terminal side may be a PC (personal computer) equipped with a keyboard. Further, the terminal side may be a mobile device such as a smartphone, a portable information terminal (PDA: Personal Digital Assistant), a mobile phone, a portable music device, or a game device.
　［ソフトウェア構成］
　次に、タブレット端末１０のソフトウェア構成の一例について、図８を参照して説明する。なお、本実施形態では、タブレット端末１０では、アプリケーション１はＣＰＵ１００の制御によりＯＳ２で動作しているものとする。 Software configuration
Next, an example of the software configuration of the tablet terminal 10 will be described with reference to FIG. In the present embodiment, in the tablet terminal 10, the application 1 is assumed to be operating on the OS 2 under the control of the CPU 100.
　ＯＳ２には、各種デバイスを動作させるためそれぞれのデバイス用のデバイスドライバーがインストールされている。本実施形態では、特にGraphicsの機能を使用するため、図８ではGraphics driver１７がインストールされている。また、ＯＳ２には、本実施形態の主体となるアプリケーション１がインストールされている。アプリケーション１からデバイスドライバーに対して行われる処理は、ＯＳ２やデバイスドライバーが仕様を公開しているＡＰＩ(Application Programming Interface)からのアクセスにより実行される。したがって、アプリケーション１がタブレット端末１０の本体画面及び外部ディスプレイ２０の外部画面間で画面出力先の切り替えを行う場合、アプリケーション１はＡＰＩを使ってＯＳ２に切り替えを依頼する。ＯＳ２は、Graphics driver１７に対して切り替えを要求する。最終的には、Graphics driver１７がソフトウェアの処理に基づき、ハードウェアのGraphics Controller１０１を制御して必要な処理を実現する。以上が本実施形態にかかる画像出力制御方法を実現する場合の表示装置の全体構成、機能構成、ハードウェア構成、ソフトウェア構成及び基本的な動作ポリシーである。図６の各部の機能は、ＯＳ２にインストールされた画像出力制御プログラムが、本体画面及び外部画面を使用して画像を出力する処理をＣＰＵ１０１に実行させることにより実現される。 In OS2, device drivers for each device are installed to operate various devices. In this embodiment, since the Graphics function is used in particular, the Graphics driver 17 is installed in FIG. In addition, an application 1 that is the main body of the present embodiment is installed in the OS 2. Processing performed from the application 1 to the device driver is executed by access from an API (Application Programming Interface) whose specifications are published by the OS 2 or the device driver. Therefore, when the application 1 switches the screen output destination between the main body screen of the tablet terminal 10 and the external screen of the external display 20, the application 1 requests the OS 2 to switch using the API. The OS 2 requests the Graphics driver 17 to switch. Eventually, the Graphics driver 17 controls the hardware Graphics Controller 101 based on software processing to realize necessary processing. The above is the overall configuration, functional configuration, hardware configuration, software configuration, and basic operation policy of the display device when realizing the image output control method according to the present embodiment. 6 is realized by causing the CPU 101 to execute a process of outputting an image using the main body screen and the external screen by the image output control program installed in the OS 2.
　以下、画像出力制御処理のアプリケーション１への実装方法について示す。本実施形態では、画像出力制御処理をアプリケーション１へ実装する方法として第１の方法と第２の方法との２つの方法が考えられる。第１の方法は、タブレット端末１０用にデザインされた特定のアプリケーション１に実装する方法である。第２の方法は、アプリケーション群を起動するためのランチャに実装する方法である。第１の方法は、本実施形態にて以下に説明し、第２の方法は、本実施形態の変形例にて説明する。 The following describes how to implement image output control processing in application 1. In the present embodiment, two methods, a first method and a second method, are conceivable as a method for mounting the image output control process in the application 1. The first method is a method of mounting on a specific application 1 designed for the tablet terminal 10. The second method is a method implemented in a launcher for starting an application group. The first method will be described below in the present embodiment, and the second method will be described in a modification of the present embodiment.
　（特定のアプリケーション１に実装する場合：第１の方法）
　この場合、小型画面用にデザインしたアプリケーション１自体に本実施形態の機能を実装する。具体的には、アプリケーション１の処理のうち最初に呼ばれる起動、初期化等の処理の中に本実施形態の画像出力制御処理の機能を実装する。アプリケーション１の起動時に実行される画像出力制御処理の流れを図９を参照して説明する。 (When implemented in a specific application 1: First method)
In this case, the function of this embodiment is implemented in the application 1 itself designed for a small screen. Specifically, the function of the image output control process of the present embodiment is implemented in the process such as startup and initialization called first in the process of the application 1. The flow of the image output control process executed when the application 1 is activated will be described with reference to FIG.
　まず、起動処理部１１は、外部ディスプレイ２０の接続の有無を判定する（ステップＳ１０）。ここで、外部ディスプレイ２０が接続されていないと判定された場合、本体画面のみが出力先になる。このため、起動処理部１１は、特に追加の処理を行うことなくアプリケーション１を動作させ（ステップＳ１４）、本処理を終了する。 First, the activation processing unit 11 determines whether or not the external display 20 is connected (step S10). Here, if it is determined that the external display 20 is not connected, only the main body screen is the output destination. For this reason, the activation processing unit 11 operates the application 1 without particularly performing additional processing (step S14), and ends this processing.
　一方、外部ディスプレイ２０が接続されていると判定された場合、画面表示状態判定部１３は、画面モード設定テーブル４に基づき、画面の出力先を判定する（ステップＳ１２）。画面表示状態判定部１３は、図５に示す画面モード設定テーブル４に設定された画面モード４１により画面出力先を判定する。 On the other hand, when it is determined that the external display 20 is connected, the screen display state determination unit 13 determines the screen output destination based on the screen mode setting table 4 (step S12). The screen display state determination unit 13 determines the screen output destination based on the screen mode 41 set in the screen mode setting table 4 shown in FIG.
　例えば、画面モード４１が表示パターン１に設定（ＯＮ）されている場合、画面の出力先は本体画面のみである。この場合、画面出力先を本体画面に切り替える必要はない。よって、起動処理部１１は、特に追加の処理を行うことなく本体画面にアプリケーション１を起動し（ステップＳ１４）、本処理を終了する。 For example, when the screen mode 41 is set to display pattern 1 (ON), the output destination of the screen is only the main body screen. In this case, it is not necessary to switch the screen output destination to the main body screen. Therefore, the activation processing unit 11 activates the application 1 on the main body screen without performing any additional processing (step S14), and ends this processing.
　画面モード４１が表示パターン２又は表示パターン３に設定（ＯＮ）されている場合、画面の出力先は本体画面と外部画面とを合わせた描画領域であり、両画面に拡張表示される。この場合、画面切替処理部１５は、本体画面がメインディスプレイであってもセカンドディスプレイであっても、本体画面の描画領域を指定して画面出力先が本体画面になるように座標原点を切り替える。起動処理部１１は、切替後に本体画面にアプリケーション１を起動し（ステップＳ１６）、本処理を終了する。 When the screen mode 41 is set to the display pattern 2 or the display pattern 3 (ON), the output destination of the screen is a drawing area that combines the main body screen and the external screen, and is expanded and displayed on both screens. In this case, regardless of whether the main body screen is the main display or the second display, the screen switching processing unit 15 specifies the drawing area of the main body screen and switches the coordinate origin so that the screen output destination is the main body screen. The activation processing unit 11 activates the application 1 on the main body screen after switching (step S16), and ends this process.
　なお、本体画面の指定の方法は、本体画面及び外部画面を連続した描画領域とした場合に本体画面に該当する描画領域の座標を指定する方法に限られない。例えば、ＯＳ２が個々の画面を一意に識別するＩＤを管理し、それによってアプリケーション１の表示先を指定できる場合は、この画面を識別するＩＤを使用してアプリケーション１の表示先に本体画面を指定してもよい。 Note that the method of specifying the main body screen is not limited to the method of specifying the coordinates of the drawing area corresponding to the main body screen when the main body screen and the external screen are continuous drawing areas. For example, when the OS 2 manages an ID that uniquely identifies each screen and can specify the display destination of the application 1, the main body screen is specified as the display destination of the application 1 using the ID that identifies this screen. May be.
　画面モード４１が表示パターン４に設定（ＯＮ）されている場合、画面出力先は、本体画面及び外部画面を合わせた描画領域であり、両画面に複製表示される。また、図５のように画面モード４１が表示パターン５に設定（ＯＮ）されている場合、画面出力先は、外部ディスプレイのみである。これらの場合、本体画面を有効にし、画面出力先を本体画面に切り替える必要がある。よって、描画領域指定部１４は、本体画面が無効になっている場合には、本体画面を描画領域に指定し、切り替え前の画面出力先の情報をメインメモリ２０１等に記録する（ステップＳ１８）。その後、画面切替処理部１５は、画面出力先を拡張表示（２）に切り替える。起動処理部１１は、本体画面の描画領域にアプリケーション１を起動し（ステップＳ２０）、本処理を終了する。 When the screen mode 41 is set to the display pattern 4 (ON), the screen output destination is a drawing area that combines the main body screen and the external screen, and is duplicated and displayed on both screens. When the screen mode 41 is set to the display pattern 5 (ON) as shown in FIG. 5, the screen output destination is only the external display. In these cases, it is necessary to enable the main body screen and switch the screen output destination to the main body screen. Therefore, when the main body screen is invalid, the drawing area designating unit 14 designates the main body screen as the drawing area, and records information on the screen output destination before switching in the main memory 201 or the like (step S18). . Thereafter, the screen switching processing unit 15 switches the screen output destination to the extended display (2). The activation processing unit 11 activates the application 1 in the drawing area of the main body screen (step S20), and ends this process.
　以上に説明した画像出力制御処理によれば、アプリケーション１を起動したときは、常にアプリケーション１は本体画面に表示される。これにより、本実施形態では、タブレット端末１０の小型画面に最適化されたデザインの特定のアプリケーション１を起動したときに、外部ディスプレイ２０やプロジェクタを接続し、そちらに画面を出力している場合の表示の不具合を解消できる。つまり、本実施形態では、そのアプリケーション１を必ずタブレット端末１０の本体画面の描画領域内に表示させることで、表示の不具合を解消できる。 According to the image output control process described above, when the application 1 is activated, the application 1 is always displayed on the main body screen. Thereby, in this embodiment, when the specific application 1 of the design optimized for the small screen of the tablet terminal 10 is started, the external display 20 or the projector is connected, and the screen is output there. Display defects can be solved. That is, in this embodiment, the display defect can be solved by always displaying the application 1 in the drawing area of the main body screen of the tablet terminal 10.
　例えば、アプリケーション１を起動しようとしたときに、画面出力先を外部ディスプレイ２０のみにして本体画面を無効にしている表示パターン５の場合、本来は本体画面は無効であるため本体画面に画像を表示することはできない。 For example, when the display pattern 5 in which only the external display 20 is set as the screen output destination and the main body screen is invalidated when the application 1 is started, the main body screen is originally invalid and the image is displayed on the main body screen. I can't do it.
　そこで、本実施形態では、その場合にはアプリケーション１を起動しようとしたときに画面出力先が切り替えられ、無効になっている本体画面を有効にした上でアプリケーション１が起動され、アプリケーション１による本体画面への表示が可能となる。このとき、「本体画面を有効にする」とは、具体的には表示パターン３の拡張表示（２）に切り替えることとする。これにより、本体画面を有効にしつつ、外部ディスプレイ２０側の表示も有効のまま、かつ、外部ディスプレイ２０をメインディスプレイに指定して画面の出力先を変更することができる。これにより、それまで外部ディスプレイ２０に表示されていた内容は、外部ディスプレイ２０上に表示されたまま保持することが可能である。この結果、本実施形態の画面表示から元の画面表示に画面の表示を切り替えたときに外部ディスプレイ２０側をメインディスプレイにすることで外部画面上の作業環境を変えることなく円滑な作業を続行することができる。 Therefore, in this embodiment, the screen output destination is switched when the application 1 is started in that case, and the application 1 is started after the disabled main body screen is validated. Display on the screen is possible. At this time, “to enable the main body screen” is specifically switched to the extended display (2) of the display pattern 3. As a result, it is possible to change the output destination of the screen by designating the external display 20 as the main display while keeping the display on the external display 20 side valid while making the main body screen valid. As a result, the content that has been displayed on the external display 20 until then can be held while being displayed on the external display 20. As a result, when the screen display is switched from the screen display of the present embodiment to the original screen display, the external display 20 side is changed to the main display so that the smooth operation can be continued without changing the work environment on the external screen. be able to.
　動作のイメージの一例を図１０に示す。タブレット端末１０に外部ディスプレイ２０が接続されている。図１０（ａ）の例では、画面は外部ディスプレイ２０のみに出力され、タブレット端末１０は無効になっている。外部ディスプレイ２０に表示されているデスクトップ画面にはウィンドウＷ１及びアイコンＱが表示されている。この画面状態から、ユーザは、マウスを使ってアイコンＱをクリックし、特定のアプリケーション１を選択して起動させる。このとき、本実施形態にかかる画面出力制御処理の機能がアプリケーション１に実装されている場合、まず画面出力先が拡張表示（２）の定義に従い変更される。これにより、本体画面が有効になる。次に、図１０（ｂ）に示すように、アプリケーション１にて生成された画像Ｒが本体画面の描画領域内に表示される。なお、外部ディスプレイ２０に表示されていた内容は、外部ディスプレイ２０上に表示されたまま保持される。 An example of the operation image is shown in FIG. An external display 20 is connected to the tablet terminal 10. In the example of FIG. 10A, the screen is output only to the external display 20, and the tablet terminal 10 is disabled. A window W1 and an icon Q are displayed on the desktop screen displayed on the external display 20. From this screen state, the user uses the mouse to click the icon Q, and selects and activates the specific application 1. At this time, when the function of the screen output control processing according to the present embodiment is installed in the application 1, the screen output destination is first changed according to the definition of the extended display (2). Thereby, the main body screen becomes effective. Next, as shown in FIG. 10B, the image R generated by the application 1 is displayed in the drawing area of the main body screen. Note that the content displayed on the external display 20 is held while being displayed on the external display 20.
　図１１の例では、タブレット端末１０に外部ディスプレイ２０が接続されていて、本体画面と外部画面には同じ内容の画像が表示される複製表示の状態になっている。この場合、外部ディスプレイ２０に表示されているデスクトップ画面からアイコンＱで示される特定のアプリケーション１が選択されることで、アプリケーション１が起動される。その際、図１０の例と同様に画面出力先を拡張表示（２）に変更してから本体画面の描画領域内にアプリケーション１にて生成された画像Ｒが表示される。 In the example of FIG. 11, the external display 20 is connected to the tablet terminal 10, and a duplicate display state in which an image with the same content is displayed on the main body screen and the external screen is displayed. In this case, the application 1 is activated by selecting the specific application 1 indicated by the icon Q from the desktop screen displayed on the external display 20. At that time, the image R generated by the application 1 is displayed in the drawing area of the main body screen after the screen output destination is changed to the extended display (2) as in the example of FIG.
　これにより、タブレット端末１０の画面サイズで最適なようにデザインされたアプリケーション１の画面が、解像度の違いにより外部ディスプレイ２０に小さく表示されたり、はみ出して表示されたりしてしまうことを回避できる。また、無効になっている本体画面を有効にすることで、アプリケーション１により生成された画面が本体画面に表示される。これにより、タブレット端末１０のタッチパネルで画面上から入力操作を行うことが可能になる。また、外部ディスプレイ側で何か作業をしていたとしても外部ディスプレイ側の表示は維持されたままなので作業をそのまま継続することが可能である。 Thereby, it is possible to prevent the screen of the application 1 designed to be optimal for the screen size of the tablet terminal 10 from being displayed small on the external display 20 due to a difference in resolution or being displayed protruding. Further, by enabling the invalid main body screen, the screen generated by the application 1 is displayed on the main body screen. Thereby, it becomes possible to perform input operation from the screen with the touch panel of the tablet terminal 10. Further, even if something is done on the external display side, the display on the external display side is maintained, so that the work can be continued as it is.
　また、アプリケーション１を起動するときに、本実施形態の画像出力制御処理により画面出力先を切り替えた場合、アプリケーション１を終了する際に図１２に示す終了処理が実行される。アプリケーション１の終了処理では、描画領域指定部１４は、起動時に画面出力先を変更したかを判定する（ステップＳ２２）。変更したと判定された場合、描画領域指定部１４は、メインメモリ２０１に記録されている元の画面出力先の情報に基づき、画面出力先をアプリケーション１起動前の状態に戻し（ステップＳ２４）、本処理を終了する。変更していないと判定された場合、ただちに本処理は終了される。 Further, when the application 1 is started up and the screen output destination is switched by the image output control process of the present embodiment, the termination process shown in FIG. 12 is executed when the application 1 is terminated. In the termination process of the application 1, the drawing area designating unit 14 determines whether the screen output destination has been changed at the time of activation (step S22). When it is determined that the screen has been changed, the drawing area designating unit 14 returns the screen output destination to the state before the application 1 is started based on the original screen output destination information recorded in the main memory 201 (step S24). This process ends. If it is determined that no change has been made, the process is immediately terminated.
　［変形例］
　（ランチャーに実装する場合：第２の方法）
　最後に、本実施形態の変形例にかかる画面出力制御処理について、図１３及び図１４を参照しながら説明する。変形例では、画面出力制御の機能をランチャーに実装する場合を例に挙げて説明する。 [Modification]
(When mounted on the launcher: Second method)
Finally, screen output control processing according to a modification of the present embodiment will be described with reference to FIGS. 13 and 14. In the modification, a case where the function of screen output control is implemented in the launcher will be described as an example.
　この場合、アプリケーション１を起動するためのランチャーに上記画面出力制御の機能を実装する。したがって、起動するべきタブレット端末１０用にデザインされたアプリケーション１には、上記画面出力制御の機能を実装する必要はない。したがって、ランチャーに含まれるすべてのアプリケーションに対して上記画面出力制御による同様の効果を与えることができる。 In this case, the screen output control function is implemented in the launcher for starting application 1. Therefore, the application 1 designed for the tablet terminal 10 to be activated does not need to be equipped with the screen output control function. Therefore, the same effect by the screen output control can be given to all applications included in the launcher.
　ランチャーは、ユーザーがよく使う複数のアプリケーションを登録しておくことで、それらのアプリケーションを一覧表示してユーザーがすぐに起動できるような手段を提供する。例えば、図１３のタブレット端末１０には、ユーザーがよく使う複数のアプリケーションを起動するためのアイコンＬ１～Ｌ１２が一覧表示されたランチャーが登録されている。 The launcher provides a means of registering multiple applications frequently used by the user and displaying the applications in a list so that the user can start up immediately. For example, in the tablet terminal 10 of FIG. 13, a launcher in which icons L1 to L12 for starting a plurality of applications frequently used by the user are displayed as a list is registered.
　ランチャーにアプリケーションを登録するとき、登録テーブル５には、アプリケーション名５２、インストールフォルダ５３等の表示属性情報を登録する必要がある。アプリケーション名５２に応じてアイコン５１を登録してもよい。本変形例では、これらの表示属性情報に、登録しようとしているアプリケーションを本体画面で起動するかどうかを示す起動画面情報５４が付加される。ユーザーは、ランチャーに登録しようとするアプリケーションを必ず本体画面で起動したい場合、起動画面情報５４に本体画面を指定して登録する。 When registering an application in the launcher, it is necessary to register display attribute information such as the application name 52 and the installation folder 53 in the registration table 5. The icon 51 may be registered according to the application name 52. In this modification, start screen information 54 indicating whether or not the application to be registered is started on the main body screen is added to these display attribute information. When the user wants to start an application to be registered in the launcher without fail on the main body screen, the user designates and registers the main body screen in the start screen information 54.
　ランチャーからアプリケーションを選択して、選択されたアプリケーションの起動を開始する場合のフローを図１４に示す。まず、ランチャーは、登録テーブル５に基づき、ユーザにより指定されたアイコン５１にリンクしたアプリケーョン（アプリケーション名５２、インストールフォルダ５３）の表示属性情報５４により本体画面で起動するかどうかを判定する。（ステップＳ３０）ここで、本体画面で起動するように登録されていないアプリケーションの場合、上記画像出力制御処理の機能の実行は不要であり、指定されたアプリケーションをそのまま起動する（ステップＳ１４）、本処理を終了する。 FIG. 14 shows a flow when an application is selected from the launcher and starting of the selected application is started. First, based on the registration table 5, the launcher determines whether to start up on the main body screen based on the display attribute information 54 of the application (application name 52, installation folder 53) linked to the icon 51 specified by the user. (Step S30) Here, in the case of an application that is not registered to be activated on the main body screen, it is not necessary to execute the function of the image output control process, and the designated application is activated as it is (Step S14). The process ends.
　一方、本体画面で起動するように登録されたアプリケーションの場合、ステップＳ１０に進み、ステップＳ１０以降のステップが実行される。ステップＳ１０以降のステップには、図９に示す画面出力制御処理と同一ステップ番号が付され、同一処理であるため、ここでの説明は省略する。 On the other hand, in the case of an application registered to start on the main body screen, the process proceeds to step S10, and steps after step S10 are executed. Steps subsequent to step S10 are assigned the same step numbers as the screen output control process shown in FIG. 9 and are the same processes, and thus description thereof is omitted here.
　また、ランチャーに実装する場合も上記実施形態と同様に、指定されたアプリケーションを起動するときに画面の出力先を切り替えた場合、切り替え前の出力先（元の出力先）を記録しておく。そして、アプリケーション終了時に画面出力先をアプリケーション起動前の状態に戻す処理が実行される。この場合は、ランチャーが指定されたアプリケーションの処理が終了したことを認識した時点で、画面の切り替え処理（図１２）が実行される。 Also, when installing in the launcher, as in the above embodiment, if the output destination of the screen is switched when starting the designated application, the output destination before switching (original output destination) is recorded. Then, a process of returning the screen output destination to the state before starting the application is executed when the application ends. In this case, the screen switching process (FIG. 12) is executed when it is recognized that the process of the application for which the launcher is designated is completed.
　以上に説明したように、本実施形態の変形例にかかる画面出力制御方法によれば、ランチャーに登録されたアプリケーションを起動したときに、必ずタブレット端末１０の本体画面でアプリケーションの生成画面が表示される。これにより、大画面の外部ディスプレイやプロジェクタに画面表示され、画面のレイアウトが崩れて外部ディスプレイ２０においてタッチ操作が困難になったとしても、タブレット端末１０の本体画面でタッチ操作を行うことができる。また、必ず本体側にアプリケーションの生成画面が表示されることで、外部ディスプレイ２０にタッチパネルを搭載していない場合にも、画面へのタッチによる入力操作を確保することができる。 As described above, according to the screen output control method according to the modification of the present embodiment, the application generation screen is always displayed on the main body screen of the tablet terminal 10 when the application registered in the launcher is started. The As a result, even if the screen is displayed on a large-screen external display or projector and the screen layout is broken and the touch operation becomes difficult on the external display 20, the touch operation can be performed on the main body screen of the tablet terminal 10. In addition, since the application generation screen is displayed on the main body side, an input operation by touching the screen can be secured even when the external display 20 is not equipped with a touch panel.
　また、本体画面を無効状態から有効な状態にするために画面出力先を切り替える動作を実行した場合においても、それまでユーザーが作業をしていた外部ディスプレイ２０の表示内容は保持される。このため、ユーザーの作業を妨げることなく、上記効果を得られる。 In addition, even when an operation of switching the screen output destination is executed in order to change the main body screen from the invalid state to the valid state, the display content of the external display 20 that the user has been working on is retained. For this reason, the said effect is acquired, without disturbing a user's work.
　以上により、本実施形態及びその変形例にかかる画面出力制御方法によれば、画面の機能に差がある複数の表示装置に画像を出力する際の不具合を解消することができる。 As described above, according to the screen output control method according to the present embodiment and the modification thereof, it is possible to solve the problem in outputting an image to a plurality of display devices having different screen functions.
　以上、画像出力制御方法、画像出力制御プログラム及び表示装置を上記実施形態により説明したが、本発明にかかる画像出力制御方法、画像出力制御プログラム及び表示装置は上記実施形態に限定されるものではなく、本発明の範囲内で種々の変形及び改良が可能である。また、上記実施形態及び変形例が複数存在する場合、矛盾しない範囲で組み合わせることができる。 As described above, the image output control method, the image output control program, and the display device have been described in the above embodiment. However, the image output control method, the image output control program, and the display device according to the present invention are not limited to the above embodiment. Various modifications and improvements are possible within the scope of the present invention. In addition, when there are a plurality of the above-described embodiments and modifications, they can be combined within a consistent range.
　例えば、上記実施形態及びその変形例にかかる表示装置の構成は一例であり、本発明の範囲を限定するものではなく、用途や目的に応じて様々なシステム構成例があることは言うまでもない。例えば、タブレット端末が接続される表示装置は、一台に限られず、複数台であってもよい。 For example, the configuration of the display device according to the above-described embodiment and its modification is merely an example, and does not limit the scope of the present invention. It goes without saying that there are various system configuration examples depending on the application and purpose. For example, the number of display devices to which tablet terminals are connected is not limited to one, and a plurality of display devices may be used.
　また、上記実施形態及びその変形例では、画面の機能に差がある複数の表示装置のうち外部ディスプレイを一方の表示装置、タブレット端末を他方の表示装置として、一方の表示装置にて画面の機能を実現できない場合、他方の表示装置にて画面の機能を実現した。しかしながら、これに限らず、一方の表示装置は、画面の機能に差がある複数の表示装置のいずれか一方であり、他方の表示装置は、画面の機能に差がある複数の表示装置の他の表示装置であってもよい。 Moreover, in the said embodiment and its modification, an external display is used as one display apparatus and a tablet terminal is the other display apparatus among several display apparatuses with a difference in screen function, and the function of a screen is in one display apparatus. When the above cannot be realized, the screen function is realized on the other display device. However, the present invention is not limited to this, and one display device is one of a plurality of display devices having a difference in screen function, and the other display device is a plurality of other display devices having a difference in screen function. The display device may be used.
　１：アプリケーション
　２：ＯＳ
　４：画面モード設定テーブル
　５：登録テーブル
　１０：タブレット端末
　１１：起動処理部
　１２：メイン処理部
　１３：画面表示状態判定部
　１４：描画領域指定部
　１５：画面切替処理部
　１６：画面管理部
　１７：Ｇｒａｐｈｉｃｓ　ｄｒｉｖｅｒ
　１８：画面切替制御部
　２０：外部ディスプレイ
　１００：ＣＰＵ
　１０１：Graphics Controller
　１０２：Memory Controller
　１０３：Storage Controller
　１０４：USB Controller
　２０１：メインメモリ
　２０２：ｅＭＭＣ
　２０３：タッチパネル
　２０４：内蔵ディスプレイ 1: Application 2: OS
4: Screen mode setting table 5: Registration table 10: Tablet terminal 11: Activation processing unit 12: Main processing unit 13: Screen display state determination unit 14: Drawing area designation unit 15: Screen switching processing unit 16: Screen management unit 17: Graphics driver
18: Screen switching control unit 20: External display 100: CPU
101: Graphics Controller
102: Memory Controller
103: Storage Controller
104: USB Controller
201: Main memory 202: eMMC
203: Touch panel 204: Built-in display

Claims (9)

  1. 　画面の機能に差がある複数の表示装置の画面を使用して画像を出力する処理をコンピュータが実行する画像出力制御方法であって、
    　前記画面の機能の差により前記複数の表示装置のうちの一方の表示装置にて画面の機能を実現できない場合、該複数の表示装置のうちの他方の表示装置にて画面の機能を実現し、
    　前記他方の表示装置にて画面の機能を実現した後、画像の出力先の表示装置を前記一方の表示装置に切り替える、
    　画像出力制御方法。     An image output control method in which a computer executes a process of outputting an image using screens of a plurality of display devices having different screen functions,
    If the screen function cannot be realized in one of the plurality of display devices due to the difference in function of the screen, the function of the screen is realized in the other display device of the plurality of display devices,
    After realizing the screen function on the other display device, the display device to which the image is output is switched to the one display device.
    Image output control method.
  2. 　操作されたアプリケーションの起動の際に前記他方の表示装置に画像を出力し、該他方の表示装置にて画面の機能を実現し、
    　前記アプリケーションの終了の際に画像の出力先の表示装置を前記一方の表示装置に切り替える、
    　請求項１に記載の画像出力制御方法。     An image is output to the other display device when the operated application is started, and the screen function is realized on the other display device;
    When the application ends, the display device to which the image is output is switched to the one display device.
    The image output control method according to claim 1.
  3. 　ランチャーに登録された複数のアプリケーションのうち、画像の出力先を示す表示属性情報が登録されているアプリケーションが操作された場合、該アプリケーションの起動時に前記表示属性情報に基づき特定される前記複数の表示装置のうちのいずれかにて画面の機能を実現する、
    　請求項２に記載の画像出力制御方法。     When an application in which display attribute information indicating an image output destination is registered is operated among a plurality of applications registered in the launcher, the plurality of displays specified based on the display attribute information when the application is activated Realize screen functions on any of the devices,
    The image output control method according to claim 2.
  4. 　画面の機能に差がある複数の表示装置の画面を使用して画像を出力する処理をコンピュータに実行させるための画像出力制御プログラムであって、
    　前記画面の機能の差により前記複数の表示装置のうちの一方の表示装置にて画面の機能を実現できない場合、該複数の表示装置のうちの他方の表示装置にて画面の機能を実現し、
    　前記他方の表示装置にて画面の機能を実現した後、画像の出力先の表示装置を前記一方の表示装置に切り替える、
    　画像出力制御プログラム。     An image output control program for causing a computer to execute a process of outputting an image using screens of a plurality of display devices having different screen functions,
    If the screen function cannot be realized in one of the plurality of display devices due to the difference in function of the screen, the function of the screen is realized in the other display device of the plurality of display devices,
    After realizing the screen function on the other display device, the display device to which the image is output is switched to the one display device.
    Image output control program.
  5. 　操作されたアプリケーションの起動の際に前記他方の表示装置に画像を出力し、該他方の表示装置にて画面の機能を実現し、
    　前記アプリケーションの終了の際に画像の出力先の表示装置を前記一方の表示装置に切り替える、
    　請求項４に記載の画像出力制御プログラム。     An image is output to the other display device when the operated application is started, and the screen function is realized on the other display device;
    When the application ends, the display device to which the image is output is switched to the one display device.
    The image output control program according to claim 4.
  6. 　ランチャーに登録された複数のアプリケーションのうち、画像の出力先を示す表示属性情報が登録されているアプリケーションが操作された場合、該アプリケーションの起動時に前記表示属性情報に基づき特定される前記複数の表示装置のうちのいずれかにて画面の機能を実現する、
    　請求項５に記載の画像出力制御プログラム。     When an application in which display attribute information indicating an image output destination is registered is operated among a plurality of applications registered in the launcher, the plurality of displays specified based on the display attribute information when the application is activated Realize screen functions on any of the devices,
    The image output control program according to claim 5.
  7. 　画面の機能に差がある自画面と他の表示装置の画面とを使用して画像を出力する表示装置であって、
    　前記画面の機能の差により前記表示装置と前記他の表示装置のうちの一方の表示装置にて画面の機能を実現できない場合、前記表示装置と前記他の表示装置のうちの他方の表示装置にて画面の機能を実現し、
    　前記他方の表示装置にて画面の機能を実現した後、画像の出力先の表示装置を前記一方の表示装置に切り替える画面切替処理部、
    　を有する表示装置。     A display device that outputs an image using a self-screen having a difference in screen function and a screen of another display device,
    When the screen function cannot be realized in one of the display device and the other display device due to the difference in the screen function, the other display device in the display device and the other display device To realize screen functions,
    After realizing the screen function on the other display device, a screen switching processing unit that switches the image output destination display device to the one display device,
    A display device.
  8. 　前記画面切替処理部は、
    　操作されたアプリケーションの起動の際に前記他方の表示装置に画像を出力し、該他方の表示装置にて画面の機能を実現し、
    　前記アプリケーションの終了の際に画像の出力先の表示装置を前記一方の表示装置に切り替える、
    　請求項７に記載の表示装置。     The screen switching processing unit
    An image is output to the other display device when the operated application is started, and the screen function is realized on the other display device;
    When the application ends, the display device to which the image is output is switched to the one display device.
    The display device according to claim 7.
  9. 　前記画面切替処理部は、
    　ランチャーに登録された複数のアプリケーションのうち、画像の出力先を示す表示属性情報が登録されているアプリケーションが操作された場合、該アプリケーションの起動時に前記表示属性情報に基づき特定される前記複数の表示装置のうちのいずれかにて画面の機能を実現する、
    　請求項８に記載の表示装置。     The screen switching processing unit
    When an application in which display attribute information indicating an image output destination is registered is operated among a plurality of applications registered in the launcher, the plurality of displays specified based on the display attribute information when the application is activated Realize screen functions on any of the devices,
    The display device according to claim 8.
PCT/JP2015/063281 2015-05-08 2015-05-08 Image output control method, image output control program, and display device WO2016181436A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201580079658.9A CN107533448A (en) 2015-05-08 2015-05-08 Image output control method, image Output Control Program and display device
EP15891762.5A EP3296859A4 (en) 2015-05-08 2015-05-08 Image output control method, image output control program, and display device
PCT/JP2015/063281 WO2016181436A1 (en) 2015-05-08 2015-05-08 Image output control method, image output control program, and display device
JP2017517461A JP6504248B2 (en) 2015-05-08 2015-05-08 Image output control method, image output control program and display device
US15/787,895 US20180039470A1 (en) 2015-05-08 2017-10-19 Image output control method and display device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2015/063281 WO2016181436A1 (en) 2015-05-08 2015-05-08 Image output control method, image output control program, and display device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/787,895 Continuation US20180039470A1 (en) 2015-05-08 2017-10-19 Image output control method and display device

Publications (1)

Publication Number Publication Date
WO2016181436A1 true WO2016181436A1 (en) 2016-11-17

Family

ID=57248948

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2015/063281 WO2016181436A1 (en) 2015-05-08 2015-05-08 Image output control method, image output control program, and display device

Country Status (5)

Country Link
US (1) US20180039470A1 (en)
EP (1) EP3296859A4 (en)
JP (1) JP6504248B2 (en)
CN (1) CN107533448A (en)
WO (1) WO2016181436A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107728838A (en) * 2017-09-28 2018-02-23 努比亚技术有限公司 A kind of terminal display management method, mobile terminal and computer-readable recording medium

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6988060B2 (en) * 2016-05-25 2022-01-05 株式会社リコー Image processing equipment, image processing system, image processing method and program
WO2019045144A1 (en) * 2017-08-31 2019-03-07 (주)레벨소프트 Medical image processing apparatus and medical image processing method which are for medical navigation device
US10346122B1 (en) * 2018-10-18 2019-07-09 Brent Foster Morgan Systems and methods for a supplemental display screen
CN110399080A (en) * 2019-07-31 2019-11-01 联想(北京)有限公司 A kind of output control method, terminal and more device systems

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008517525A (en) * 2004-10-19 2008-05-22 ソニー エリクソン モバイル コミュニケーションズ， エービー Portable wireless communication apparatus displaying information on a plurality of display screens, operating method of the portable wireless communication apparatus, and computer program for operating the portable wireless communication apparatus
JP2008164988A (en) * 2006-12-28 2008-07-17 Rockridgesound Japan Co Ltd Multi-display system
JP2013008036A (en) * 2012-07-26 2013-01-10 Canon Inc Image processing apparatus and control method thereof, information processing apparatus and control method thereof, and program

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4262619B2 (en) * 2004-03-19 2009-05-13 クラリオン株式会社 Information processing apparatus, control method thereof, and program
US7962854B2 (en) * 2004-10-19 2011-06-14 Sony Ericsson Mobile Communications Ab Systems, methods and computer program products for displaying content on multiple display screens using handheld wireless communicators
KR20130007811A (en) * 2011-07-11 2013-01-21 삼성전자주식회사 Method and apparatus for displaying screen of portable terminal connected with external device
JP5197834B1 (en) * 2011-11-24 2013-05-15 株式会社東芝 Electronic device, electronic device control method, electronic device control program
US9632648B2 (en) * 2012-07-06 2017-04-25 Lg Electronics Inc. Mobile terminal, image display device and user interface provision method using the same
JP2013114698A (en) * 2013-01-21 2013-06-10 Toshiba Corp Electronic apparatus, electronic apparatus control method, electronic apparatus control program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008517525A (en) * 2004-10-19 2008-05-22 ソニー エリクソン モバイル コミュニケーションズ， エービー Portable wireless communication apparatus displaying information on a plurality of display screens, operating method of the portable wireless communication apparatus, and computer program for operating the portable wireless communication apparatus
JP2008164988A (en) * 2006-12-28 2008-07-17 Rockridgesound Japan Co Ltd Multi-display system
JP2013008036A (en) * 2012-07-26 2013-01-10 Canon Inc Image processing apparatus and control method thereof, information processing apparatus and control method thereof, and program

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3296859A4 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107728838A (en) * 2017-09-28 2018-02-23 努比亚技术有限公司 A kind of terminal display management method, mobile terminal and computer-readable recording medium

Also Published As

Publication number Publication date
US20180039470A1 (en) 2018-02-08
JP6504248B2 (en) 2019-04-24
EP3296859A1 (en) 2018-03-21
EP3296859A4 (en) 2018-04-25
CN107533448A (en) 2018-01-02
JPWO2016181436A1 (en) 2018-02-15

Similar Documents

Publication Publication Date Title
US10133396B2 (en) Virtual input device using second touch-enabled display
JP5174372B2 (en) Function icon display system and method
US8878778B2 (en) Information processing apparatus, and control method and program therefor
KR100593982B1 (en) Device and method for providing virtual graffiti and recording medium thereof
US20180039470A1 (en) Image output control method and display device
EP2701044A1 (en) Information processing device, information processing method, and computer-readable recording medium which records program
US20120327443A1 (en) Terminal device capable of remotely operating image forming apparatus, non-transitory storage medium storing therein computer-readable program executed by terminal device, and remote operation system including terminal device
US20050273466A1 (en) Display apparatus and management method for virtual workspace thereof
US20120174020A1 (en) Indication of active window when switching tasks in a multi-monitor environment
US11435870B2 (en) Input/output controller and input/output control program
JP5893456B2 (en) Display control apparatus, control method therefor, program, and storage medium
JP5119763B2 (en) Information device provided with touch panel, icon selection method and program used therefor
WO2015004848A1 (en) Gesture input device
JP2017111551A (en) Information processing device, program, and information processing system
JP5974657B2 (en) Information processing apparatus, information processing method, and information processing program
WO2017022031A1 (en) Information terminal device
US20150007106A1 (en) Information processing apparatus
JP2022179604A (en) Information processing apparatus, information processing method, and program
JP4765893B2 (en) Touch panel mounting device, external device, and operation method of external device
JP2019053196A (en) Information processing device, and screen control method
US20210208778A1 (en) Contiguous planar display operable to have area functioning as primary display and area functioning as secondary display
CN106716350B (en) Apparatus and method for providing user interface screen
JP7277423B2 (en) APPLICATION EXECUTION DEVICE, CONTROL METHOD THEREOF, AND PROGRAM
JP7228964B2 (en) Information processing device, information processing method, and program
JP2016038619A (en) Mobile terminal device and operation method thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15891762

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2015891762

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2017517461

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE