WO2020245989A1 - Personal digital assistant - Google Patents

Personal digital assistant Download PDF

Info

Publication number
WO2020245989A1
WO2020245989A1 PCT/JP2019/022586 JP2019022586W WO2020245989A1 WO 2020245989 A1 WO2020245989 A1 WO 2020245989A1 JP 2019022586 W JP2019022586 W JP 2019022586W WO 2020245989 A1 WO2020245989 A1 WO 2020245989A1
Authority
WO
WIPO (PCT)
Prior art keywords
information terminal
mobile information
area
user
touch
Prior art date
Application number
PCT/JP2019/022586
Other languages
French (fr)
Japanese (ja)
Inventor
吉澤　和彦
眞弓 中出
Original Assignee
マクセル株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by マクセル株式会社 filed Critical マクセル株式会社
Priority to PCT/JP2019/022586 priority Critical patent/WO2020245989A1/en
Publication of WO2020245989A1 publication Critical patent/WO2020245989A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Definitions

  • the present invention relates to a mobile information terminal capable of folding a touch screen.
  • Patent Document 1 in the case of the "outside folding type", since the touch screen is on the outside even in the folded state, it can be displayed in, for example, half the area of the touch screen. This will be useful to the user. At that time, if the display area is predetermined, it is inconvenient because if the user has the display surface on the back side, it must be turned inside out. Further, although the back surface cannot be used for display when viewed from the user, it can be used as a touch detection function, which is convenient for the user. At that time, it is desirable to appropriately switch which surface is to be displayed or which surface is touchable according to the usage pattern of the user. Such improvement in usability has not been considered in the prior art including Patent Document 1.
  • An object of the present invention is to provide a mobile information terminal that appropriately switches the effective area of the display function and the touch detection function according to the usage pattern of the user even when the touch screen is folded.
  • the present invention is a portable information terminal that can be folded with the touch screen on the outside, and the touch screen is an integrated arrangement of a display unit for displaying an image and a touch panel for detecting a user's touch operation.
  • the open / close sensor for detecting the open / closed state of the mobile information terminal, the attitude sensor for detecting the posture of the mobile information terminal with respect to the user, and the touch screen divided into a plurality of regions along the bending position, and the open / close sensor. Based on the detection result of the attitude sensor, each of the divided regions is provided with an area control unit for enabling / disabling the display operation of the display unit and enabling / disabling the touch detection operation of the touch panel.
  • the area control unit enables the display operation and the touch detection operation of the entire area of the touch screen when the mobile information terminal is open, and when the mobile information terminal is closed, the area control unit is on the upper surface when viewed from the user.
  • the display operation and the touch detection operation of the area are enabled, and the display operation and the touch detection operation of the area on the lower surface and the side surface when viewed from the user are invalidated.
  • an area capable of display operation and touch detection is provided according to the usage pattern of the user, so that a convenient mobile information terminal can be provided.
  • the figure which shows the appearance (open state) of a mobile information terminal The figure which shows the appearance (in the middle of folding) of a mobile information terminal.
  • the figure which shows the appearance (closed state) of a mobile information terminal The figure explaining the area division of a touch screen.
  • FIGS. 1A to 1D are views showing the appearance of a mobile information terminal according to this embodiment.
  • the state of opening / closing operation is shown separately in FIGS. 1A to 1D.
  • the X, Y, and Z axes described in the drawings will be used for description.
  • FIG. 1A shows a state in which the mobile information terminal 1 is opened
  • FIG. 1A is a perspective view seen from the touch screen 2 side (Z direction) which is a display surface
  • FIG. 1B is an upper view seen from the upper direction (Y direction). It is an end view.
  • the periphery of the touch screen 2 is held by the frame 3 and can be folded by the hinge 4.
  • the touch screen 2 has a configuration in which a display unit 131 for displaying an image described later and a touch panel 122 for performing touch detection are integrated, and a bendable, for example, an organic EL element is adopted for the display unit 131.
  • a large screen image can be displayed on the touch screen 2 in the open state.
  • the acceleration sensor 154 detects the direction of gravity with respect to the touch screen 2
  • the open / close sensor 155 (155') detects the open / closed state of the touch screen 2.
  • the right end 3R of the frame 3 in the X direction has a stepped portion 5 having an increased thickness in the Z direction, in order to accommodate the left end 3L of the folded frame 3.
  • FIG. 1B shows a state in which the mobile information terminal 1 is being folded.
  • the portable information terminal 1 of this example is an "outside folding type" that folds the touch screen 2 on the outside.
  • the left end 3L of the frame 3 rearward by the Z axis with the hinge 4 as a fulcrum By rotating the left end 3L of the frame 3 rearward by the Z axis with the hinge 4 as a fulcrum, the left side 2L of the touch screen 2 is folded in the direction of the arrow 6.
  • FIG. 1C shows a state (closed state) in which the mobile information terminal is folded.
  • (A) is a perspective view
  • (b) is an upper end view seen from the Y direction.
  • the left side 2L of the touch screen 2 is further rotated in the direction of the arrow 6, and the folding is completed.
  • the left end portion 3L of the frame 3 is housed in the step portion 5 of the right end portion 3R, and the thickness of the frame 3 in the Z direction is substantially constant.
  • the touch screen 2 is closed, the size of the touch screen 2R viewed from the Z direction is about half that of the open state (FIG. 1A).
  • FIG. 1D is a diagram illustrating the area division of the touch screen 2.
  • the surface of the touch screen 2 that can be seen (operated) by the user changes.
  • the effective area that operates as the touch screen 2 is switched accordingly. Therefore, the area of the touch screen 2 is divided into three areas R1, R2, and R3 in the X direction.
  • the boundary of each region is set along the bending position by the hinge 4. As a result, when the mobile information terminal 1 is closed, the regions R1 and R3 are flat, and the regions R2 are curved.
  • the area of the region R1 is larger than the area of the region R3 because of the stepped portion 5 provided on the frame 3, but the size of the area is not particularly significant and the stepped portion 5 It can be made equivalent by eliminating. Further, the boundary of each region (the boundary between the regions R1 and R2 and the boundary between the regions R2 and R3) does not have to coincide with the boundary between the frame 3 and the hinge 4.
  • FIG. 2A is a diagram showing an example of the hardware configuration of the mobile information terminal 1.
  • the mobile information terminal 1 includes a main control unit 101, a system bus 102, a RAM 103, a storage unit 110, an operation input unit 120, an image processing unit 130, a voice processing unit 140, a sensor unit 150, a communication unit 160, an extended interface unit 170, and an area. It is configured to include a control unit 180.
  • the main control unit 101 is a microprocessor unit that controls the entire mobile information terminal 1 according to a predetermined operation program.
  • the system bus 102 is a data communication path for transmitting and receiving various commands and data between the main control unit 101 and each operation block in the mobile information terminal 1.
  • the RAM (RandomAccessMemory) 103 serves as a work area when executing a basic operation program or other operation programs.
  • the RAM 103 may be integrated with the main control unit 101.
  • the storage unit 110 stores the operation program, operation setting value, and the like of the mobile information terminal 1.
  • an operation program downloaded from the network and various data created by the operation program can be stored.
  • the storage unit 110 needs to hold the stored information even when the mobile information terminal 1 is not supplied with power from the outside. Therefore, for example, devices such as a semiconductor element memory such as a flash ROM and an SSD (Solid State Drive), a magnetic disk drive such as an HDD (Hard Disc Drive), and the like are used.
  • the operation input unit 120 receives the user's operation input to the mobile information terminal 1.
  • the operation input unit 120 includes an operation unit 121 in which button switches and the like are arranged, and a touch panel 122 that detects that a user's finger touches based on a change in capacitance or the like.
  • the touch panel 122 is integrally arranged with the display unit 131 to form the touch screen 2.
  • the image processing unit 130 is composed of a display unit 131, an image signal processing unit 132, a first imaging unit 133, and a second imaging unit 134.
  • the display unit 131 is a display device such as an organic EL, and displays the image data processed by the image signal processing unit 132 and provides it to the user of the mobile information terminal 1.
  • the image signal processing unit 132 includes a video RAM (not shown) and drives the display unit 131 based on the input image data.
  • the first imaging unit 133 and the second imaging unit 134 are imaging units for an out-camera (for rear photography) and an in-camera (for front photography), and are CCD (Charge Coupled Device), CMOS (Complementary Metal Oxide Semiconductor) sensors, and the like. The light input from the lens is converted into an electric signal using the electronic device of the above, and the image data of the subject is captured.
  • the voice processing unit 140 is composed of a voice output unit 141, a voice signal processing unit 142, and a voice input unit 143.
  • the voice output unit 141 is a speaker, and provides the user of the mobile information terminal 1 with the voice signal processed by the voice signal processing unit 142.
  • the voice input unit 143 is a microphone, which converts a user's voice or the like into voice data and inputs it.
  • the sensor unit 150 is a group of various sensors for detecting the state of the mobile information terminal 1. As a sensor, it has a GPS (Global Positioning System) receiver 151, a gyro sensor 152, a geomagnetic sensor 153, an acceleration sensor 154, and an open / close sensor 155, and detects the position, tilt, direction, movement, and open / closed state of the portable information terminal 1. ..
  • the acceleration sensor 154 detects the direction of gravity with respect to the mobile information terminal 1 by, for example, a MEMS sensor.
  • the open / close sensor 155 detects the folded open / closed state of the portable information terminal 1 by, for example, an optical method (light emitting / light receiving element) or a magnetic method (magnet / magnetic sensor).
  • the open / close sensor 155 may be installed on the hinge 4 to detect the folding angle of the hinge 4.
  • the communication unit 160 is composed of a LAN (Local Area Network) communication unit 161, a telephone network communication unit 162, and a Bluetooth (registered trademark) communication unit 163.
  • the LAN communication unit 161 is connected to a network such as the Internet via an access point or the like, and transmits / receives data to / from a server on the network.
  • the telephone network communication unit 162 performs telephone communication (call) and data transmission / reception by wireless communication with a base station or the like of a mobile telephone communication network.
  • the expansion interface 170 is a group of interfaces for expanding the functions of the personal digital assistant 1, and is composed of a video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like.
  • the area control unit 180 divides an area into the touch screen 2, that is, the touch panel 122 and the display unit 131, and performs touch detection and valid / invalid area control of the display operation for each divided area.
  • the configuration example of the mobile information terminal 1 shown in FIG. 2A includes many configurations that are not essential for the operation of this embodiment, and even if these configurations are not provided, the effect of this embodiment is impaired. There is no such thing.
  • FIG. 2B is a diagram showing a configuration for performing area control of the mobile information terminal 1.
  • the touch screen 2 is configured by overlapping the touch panel 122 and the display unit 131 and integrating them.
  • the area control unit 180 performs touch detection and display operations in the entire area of the touch screen 2.
  • the area control unit 180 divides the touch screen 2 into a plurality of areas R1, R2, R3, and enables / disables the touch detection and enables / disables the display operation for each divided area. Set and control the area.
  • the area control at this time can be set to be valid / invalid in a plurality of ways, and the user can specify a desired setting by the control mode 181.
  • the touch panel 122 does not perform the touch operation detection operation, and the display unit 131 does not perform the display operation.
  • the touch operation function in the effective area and the display screen in the effective area may be changed.
  • the power supply related to the touch detection and the display operation is turned off for the invalid area to save power of the mobile information terminal 1.
  • the acceleration sensor 154 detects the vertical direction of the mobile information terminal 1 (touch screen 2) with respect to gravity, and the open / close sensor 155 detects the folded / closed state of the mobile information terminal 1. These detection signals are input to the area control unit 180, and the area control unit 180 controls the area of operation of the touch screen 2 according to the posture and open / closed state of the mobile information terminal 1 and according to the designated control mode 181. ..
  • the user uses the mobile information terminal 1 in a case where the mobile information terminal 1 is held substantially horizontally and the touch screen 2 is viewed from above. Therefore, if the direction of gravity is detected by the acceleration sensor 154, it is possible to determine which region of the touch screen 2 is the surface viewed by the user.
  • FIG. 3 is a flowchart showing the area control process of the mobile information terminal 1.
  • the main control unit 101 and the area control unit 180 execute the following processing.
  • S202 The open / closed state of the housing is determined by the open / close signal. In the state of being opened and closed, a threshold value is set in the sensor signal for determination. If the housing is in the open state, the process proceeds to S203. If it is in the closed state, the process proceeds to S204.
  • the area control unit 180 sets the entire area (R1, R2, R3) of the touch screen 2 as an effective area. That is, the touch operation detection operation is executed in the entire area of the touch panel 122, and the display operation is executed in the entire area of the display unit 131.
  • the acceleration sensor 154 detects the posture of the housing of the mobile information terminal 1. That is, it is determined which of the flat regions R1 and R3 of the touch screen 2 is on the upper surface side in the direction of gravity. At this time, even if the user holds the housing of the mobile information terminal 1 at an angle from the horizontal state, it is possible to determine which of the two regions R1 and R3 of the touch screen 2 is on the upper surface side.
  • the area control unit 180 sets and displays the effective area / invalid area of the touch operation for each of the divided areas R1, R2, and R3 of the touch screen 2 according to the posture detection result of S204 and the designated control mode 181. Set the effective area / invalid area of. For example, the region on the upper surface side in the direction of gravity is valid, and the region on the lower surface side is invalid.
  • control mode of dividing the area of the touch screen 2 and setting valid / invalid for each area.
  • the user closes the mobile information terminal 1 and holds the surface of the touch screen 2 substantially horizontally with respect to the direction of gravity.
  • FIGS. 4A and 4B are diagrams showing a first example of area control (control mode 1).
  • the left side of the drawing shows the posture of the closed mobile information terminal 1 as viewed from the Y-axis direction.
  • the arrow G is the direction of gravity.
  • the touch screen 2 is expanded in the X-axis direction to show the enable / disable setting of each area.
  • FIG. 4A shows a case where the divided region R1 of the touch screen 2 is held so as to be above the direction of gravity. That is, what the user can see is the surface of the divided region R1.
  • the area control unit 180 effectively sets the area R1 on the upper surface to enable display operation and touch detection.
  • the lower surface and side surface areas R3 and R2 that cannot be seen by the user are set to be invalid, making display operation and touch detection impossible.
  • only touch detection may be disabled, and the approximate color of the frame 3 or the like may be fixedly displayed.
  • FIG. 4B shows a case where the posture of FIG. 4A is turned upside down and held, and the divided region R3 of the touch screen 2 is held so as to be above the direction of gravity.
  • the area control unit 180 effectively sets the area R3 on the upper surface to enable display operation and touch detection.
  • the lower surface and side surface areas R1 and R2 that cannot be seen by the user are set to be invalid, making display operation and touch detection impossible.
  • FIG. 5 is a diagram showing a second example of area control (control mode 2).
  • the posture of the mobile information terminal 1 is the same as that in FIG. 4A.
  • the area control unit 180 effectively sets the upper surface area R1 of the touch screen 2 and invalidates the side surface area R2, as in the first example of FIG.
  • the difference from FIG. 4 is that the display operation is invalid for the lower surface area R3, but the touch detection is enabled. That is, the area R3 on the lower surface can be used as a touch pad.
  • the image displayed in the upper surface area R1 can be scrolled or zoomed by touching the lower surface area R3.
  • the lower surface area R3 may be used as a touch pad by making the entire surface effective for touch operation, but it is further divided in the Y direction (Y1, Y2) and only one (for example, only Y1) is effective and used as a touch pad. You may.
  • the area R3 which is the upper surface of the touch screen 2 is effectively set, and the area R1 which is the lower surface can be used as a touch pad.
  • FIG. 6 is a diagram showing a third example of area control (control mode 3).
  • the posture of the mobile information terminal 1 is the same as that in FIG. 4A.
  • the area control unit 180 effectively sets the upper surface area R1 of the touch screen 2 and invalidates the lower surface area R3, as in the first example of FIG.
  • the difference from FIG. 4 is that the display operation is invalid for the side area R2, but the touch detection is enabled. That is, the side area R2 can be used as a slide pad.
  • the area R3 on the upper surface of the touch screen 2 is effectively set, and the area R2 on the side surface can be used as a slide pad.
  • FIG. 7 is a diagram showing a fourth example of area control (control mode 4).
  • the posture of the mobile information terminal 1 is the same as that in FIG. 4A.
  • the control mode 4 is a modification of the control mode 3 (FIG. 6), and the area control unit 180 provides a dead zone R4 at the boundary between the upper surface area R1 and the side surface area R2. Then, neither touch operation nor display operation can be performed in the area of the dead zone R4. As a result, it is possible to clearly distinguish the user's touch operation with respect to the upper surface area R1 and the side surface area R2, and to prevent erroneous detection of the operation caused by straddling both.
  • the dead zone R4 may be set to invalidate only touch detection, and the approximate color of the frame 3 or the like may be fixedly displayed to clearly indicate that the dead band R4 is a dead band.
  • a dead zone R5 (not shown) is similarly provided at the boundary between the upper surface region R3 and the side surface region R2 of the touch screen 2. Just do it.
  • a dead zone R5 is further provided between the regions R3 and R2 shown in FIG. 7, the upper surface region R1 effectively sets the touch detection and the display operation, and the regions R2 and R3 are the touch detection. Only may be enabled.
  • the area R2 may be used as a slide pad to operate the scroll operation in the Y direction
  • the area R3 may be used as the touch pad to perform the scroll operation in the X direction.
  • control mode 1 to control mode 4 The area control example (control mode 1 to control mode 4) described above can be selected and switched by the user.
  • the user uses the mobile information terminal 1 by holding the mobile information terminal 1 substantially horizontally and operating the touch screen 2 from above, but the present invention is limited to this. Not done.
  • the mobile information terminal 1 may be held vertically and the touch screen 2 may be operated while being viewed from the side. In this case, it is necessary to detect the posture of the mobile information terminal 1 with respect to the user and perform the area control instead of performing the area control based on the gravity direction detected by the acceleration sensor 154.
  • the first imaging unit 133 (out-camera: installed on the opposite surface of the second imaging unit 134 of the step portion 5) and the second imaging unit 134 (out-camera: installed on the opposite surface of the second imaging unit 134 of the step portion 5)
  • a smartphone has been described as an example of a mobile information terminal, but it goes without saying that the present invention can be similarly applied to an information terminal having a foldable touch screen on the outside.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

Provided is a personal digital assistant 1 that is foldable with a touch screen 2 facing outside, wherein the touch screen is formed by integrating a display section 131 for displaying an image and a touch panel 122 for detecting the touch operation of a user and includes an open/close sensor 155 for detecting the open and closed status of the personal digital assistant and an orientation sensor (acceleration sensor 154) for detecting the orientation of the personal digital assistant. A region control unit 180 divides the touch screen 2 into a plurality of regions R1 to R3 along a folding position, and enables or disables the display operation of the display unit 131 and enables or disables the touch detection operation of the touch panel 122 for each divided region on the basis of the detection results of the open/close sensor and the attitude sensor. When the personal digital assistant is closed, the operation in the region R1 that is a top surface is enabled and the operation in the regions R3, R2 that are a bottom surface and a side surface, respectively, are disabled.

Description

携帯情報端末Mobile information terminal
　本発明は、タッチスクリーンを折り畳み可能な携帯情報端末に関する。 The present invention relates to a mobile information terminal capable of folding a touch screen.
　近年、スマートフォンなどの携帯情報端末において、タッチスクリーン（表示部とタッチパネル）が折り畳み可能な構造が発表されている。その際、タッチスクリーンを外側にして折り畳む「外折りタイプ」と、タッチスクリーンを内側にして折り畳む「内折りタイプ」がある。折り畳み構造とすることで持ち運びが容易となり、広げると大画面表示になり動画などを閲覧するのに向いている。また「外折りタイプ」の場合には、折り畳んだ状態でもタッチスクリーンは外側にあるため、タッチスクリーンの一部領域に表示する構成も提案されている。(例えば特許文献１参照)。 In recent years, a structure in which a touch screen (display unit and touch panel) can be folded has been announced in a mobile information terminal such as a smartphone. At that time, there are an "outer fold type" that folds the touch screen on the outside and an "inner fold type" that folds the touch screen on the inside. The foldable structure makes it easy to carry, and when unfolded, it becomes a large screen display and is suitable for viewing videos. Further, in the case of the "outside folding type", since the touch screen is on the outside even in the folded state, a configuration has been proposed in which the touch screen is displayed in a part of the touch screen. (See, for example, Patent Document 1).
国際公開第２０１８／１１９６７４号International Publication No. 2018/119674
　特許文献１に開示されるように、「外折りタイプ」の場合には、折り畳んだ状態でもタッチスクリーンは外側にあるため、例えばタッチスクリーンの半分の領域に表示することができる。これはユーザにとって有用となる。その際、表示する領域が予め決められていると、仮にユーザが表示面を裏側に持っていると裏返しせねばならず、不便である。また、ユーザから見て裏側の面は表示には使えないが、タッチ検出機能としては使用可能であり、ユーザにとって便利なものとなる。その際、ユーザの使用形態に応じて、どの面に表示させるか、あるいはどの面をタッチ可能とするかについて、適切に切り替えることが望ましい。このような使い勝手の向上については、特許文献１を含め従来技術では考慮されなかった。 As disclosed in Patent Document 1, in the case of the "outside folding type", since the touch screen is on the outside even in the folded state, it can be displayed in, for example, half the area of the touch screen. This will be useful to the user. At that time, if the display area is predetermined, it is inconvenient because if the user has the display surface on the back side, it must be turned inside out. Further, although the back surface cannot be used for display when viewed from the user, it can be used as a touch detection function, which is convenient for the user. At that time, it is desirable to appropriately switch which surface is to be displayed or which surface is touchable according to the usage pattern of the user. Such improvement in usability has not been considered in the prior art including Patent Document 1.
　本発明の目的は、タッチスクリーンを折り畳んだ状態においても、ユーザの使用形態に応じて、表示機能とタッチ検出機能の有効な領域を適切に切り替える携帯情報端末を提供することである。 An object of the present invention is to provide a mobile information terminal that appropriately switches the effective area of the display function and the touch detection function according to the usage pattern of the user even when the touch screen is folded.
　本発明は、タッチスクリーンを外側にして折り畳み可能な携帯情報端末であって、前記タッチスクリーンは画像を表示する表示部と、ユーザのタッチ操作を検出するタッチパネルとを一体化して配置したものであり、前記携帯情報端末の開閉状態を検出する開閉センサと、ユーザに対する前記携帯情報端末の姿勢を検出する姿勢センサと、前記タッチスクリーンを折り曲げ位置に沿って複数の領域に分割し、前記開閉センサと前記姿勢センサの検出結果に基づいて、分割した夫々の領域について、前記表示部の表示動作の有効／無効と前記タッチパネルのタッチ検出動作の有効／無効を設定する領域制御部と、を備える。 The present invention is a portable information terminal that can be folded with the touch screen on the outside, and the touch screen is an integrated arrangement of a display unit for displaying an image and a touch panel for detecting a user's touch operation. The open / close sensor for detecting the open / closed state of the mobile information terminal, the attitude sensor for detecting the posture of the mobile information terminal with respect to the user, and the touch screen divided into a plurality of regions along the bending position, and the open / close sensor. Based on the detection result of the attitude sensor, each of the divided regions is provided with an area control unit for enabling / disabling the display operation of the display unit and enabling / disabling the touch detection operation of the touch panel.
　例えば前記領域制御部は、前記携帯情報端末が開いた状態では、前記タッチスクリーンの全領域の表示動作とタッチ検出動作を有効とし、前記携帯情報端末が閉じた状態では、ユーザから見て上面となる領域の表示動作とタッチ検出動作を有効とし、ユーザから見て下面及び側面となる領域の表示動作とタッチ検出動作を無効とする。 For example, the area control unit enables the display operation and the touch detection operation of the entire area of the touch screen when the mobile information terminal is open, and when the mobile information terminal is closed, the area control unit is on the upper surface when viewed from the user. The display operation and the touch detection operation of the area are enabled, and the display operation and the touch detection operation of the area on the lower surface and the side surface when viewed from the user are invalidated.
　本発明によれば、タッチスクリーンを折り畳んだ状態においても、ユーザの使用形態に応じて表示動作とタッチ検出が可能な領域を設けたので、使い勝手の良い携帯情報端末を提供できる。 According to the present invention, even when the touch screen is folded, an area capable of display operation and touch detection is provided according to the usage pattern of the user, so that a convenient mobile information terminal can be provided.
携帯情報端末の外観（開状態）を示す図。The figure which shows the appearance (open state) of a mobile information terminal. 携帯情報端末の外観（折り畳み途中）を示す図。The figure which shows the appearance (in the middle of folding) of a mobile information terminal. 携帯情報端末の外観（閉状態）を示す図。The figure which shows the appearance (closed state) of a mobile information terminal. タッチスクリーンの領域分割を説明する図。The figure explaining the area division of a touch screen. 携帯情報端末のハードウェア構成の一例を示す図。The figure which shows an example of the hardware composition of a mobile information terminal. 携帯情報端末の領域制御を行うための構成を示す図。The figure which shows the structure for performing area control of a mobile information terminal. 領域制御処理を示すフローチャート。The flowchart which shows the area control processing. 領域制御の第１例（制御モード１）を示す図。The figure which shows the 1st example (control mode 1) of area control. 領域制御の第１例（制御モード１）を示す図。The figure which shows the 1st example (control mode 1) of area control. 領域制御の第２例（制御モード２）を示す図。The figure which shows the 2nd example (control mode 2) of area control. 領域制御の第３例（制御モード３）を示す図。The figure which shows the 3rd example (control mode 3) of area control. 領域制御の第３例（制御モード４）を示す図。The figure which shows the 3rd example (control mode 4) of area control.
　以下、本発明の実施形態を図面を用いて説明する。
  図１Ａ～図１Ｄは、本実施例に係る携帯情報端末の外観を示す図である。ここでは折り畳み型スマートフォンを例に、開閉動作の状態を図１Ａ～図１Ｄに分けて示している。なお、端末の方向を区別するため、図面に記述したＸ，Ｙ，Ｚ軸を用いて説明する。 Hereinafter, embodiments of the present invention will be described with reference to the drawings.
1A to 1D are views showing the appearance of a mobile information terminal according to this embodiment. Here, taking a foldable smartphone as an example, the state of opening / closing operation is shown separately in FIGS. 1A to 1D. In order to distinguish the direction of the terminal, the X, Y, and Z axes described in the drawings will be used for description.
　図１Ａは携帯情報端末１を開いた状態を示し、（ａ）は表示面であるタッチスクリーン２側（Ｚ方向）から見た斜視図、（ｂ）は上方向（Ｙ方向）から見た上端面図である。タッチスクリーン２の周囲はフレーム３で保持されており、ヒンジ４により折り畳み可能となっている。タッチスクリーン２は後述する画像を表示する表示部１３１と、タッチ検出を行うタッチパネル１２２が一体化された構成であり、表示部１３１には、折り曲げ可能な例えば有機ＥＬ素子を採用する。開いた状態のタッチスクリーン２では、大画面の画像を表示できる。フレーム３の上部には、後述する第２撮像部（インカメラ）１３４や音声出力部（スピーカ）１４１などが設置されている。フレーム３の内部には、後述する加速度センサ１５４や開閉センサ１５５(１５５’)が設置されている。加速度センサ１５４はタッチスクリーン２に対する重力方向を検出し、開閉センサ１５５(１５５’)はタッチスクリーン２の開閉状態を検出する。フレーム３のＸ方向右端３Ｒには、Ｚ方向厚さを大きくした段差部５を有しているが、これは折り畳んだフレーム３の左端３Ｌを収納するためである。 1A shows a state in which the mobile information terminal 1 is opened, FIG. 1A is a perspective view seen from the touch screen 2 side (Z direction) which is a display surface, and FIG. 1B is an upper view seen from the upper direction (Y direction). It is an end view. The periphery of the touch screen 2 is held by the frame 3 and can be folded by the hinge 4. The touch screen 2 has a configuration in which a display unit 131 for displaying an image described later and a touch panel 122 for performing touch detection are integrated, and a bendable, for example, an organic EL element is adopted for the display unit 131. A large screen image can be displayed on the touch screen 2 in the open state. A second imaging unit (in-camera) 134, an audio output unit (speaker) 141, and the like, which will be described later, are installed on the upper part of the frame 3. Inside the frame 3, an acceleration sensor 154 and an open / close sensor 155 (155'), which will be described later, are installed. The acceleration sensor 154 detects the direction of gravity with respect to the touch screen 2, and the open / close sensor 155 (155') detects the open / closed state of the touch screen 2. The right end 3R of the frame 3 in the X direction has a stepped portion 5 having an increased thickness in the Z direction, in order to accommodate the left end 3L of the folded frame 3.
　図１Ｂは携帯情報端末１を折り畳み途中の状態を示す。本例の携帯情報端末１は、タッチスクリーン２を外側にして折り畳む「外折りタイプ」である。ヒンジ４を支点として、フレーム３の左端３ＬをＺ軸後方に回転させることで、タッチスクリーン２の左面２Ｌを矢印６の方向に折り畳んでいる。 FIG. 1B shows a state in which the mobile information terminal 1 is being folded. The portable information terminal 1 of this example is an "outside folding type" that folds the touch screen 2 on the outside. By rotating the left end 3L of the frame 3 rearward by the Z axis with the hinge 4 as a fulcrum, the left side 2L of the touch screen 2 is folded in the direction of the arrow 6.
　図１Ｃは携帯情報端末を折り畳み終了の状態（閉じた状態）を示す。（ａ）は斜視図、（ｂ）はＹ方向から見た上端面図である。タッチスクリーン２の左面２Ｌをさらに矢印６の方向に回転させ、折り畳みが終了した状態である。フレーム３の左端部３Ｌは、右端部３Ｒの段差部５に収納され、フレーム３のＺ方向厚みはほぼ一定となっている。タッチスクリーン２が閉じた状態では、Ｚ方向から見たタッチスクリーン２Ｒの大きさは、開いた状態（図１Ａ）と比べて約半分となる。 FIG. 1C shows a state (closed state) in which the mobile information terminal is folded. (A) is a perspective view, and (b) is an upper end view seen from the Y direction. The left side 2L of the touch screen 2 is further rotated in the direction of the arrow 6, and the folding is completed. The left end portion 3L of the frame 3 is housed in the step portion 5 of the right end portion 3R, and the thickness of the frame 3 in the Z direction is substantially constant. When the touch screen 2 is closed, the size of the touch screen 2R viewed from the Z direction is about half that of the open state (FIG. 1A).
　図１Ｄはタッチスクリーン２の領域分割を説明する図である。携帯情報端末１を開閉することで、ユーザから見える（操作できる）タッチスクリーン２の面は変化する。本実施例ではそれに合わせてタッチスクリーン２として動作する有効な領域を切り替える。そのため、タッチスクリーン２の領域をＸ方向に３つの領域Ｒ１，Ｒ２，Ｒ３に分割する。各領域の境界は、ヒンジ４による折り曲げ位置に沿って設定する。その結果、携帯情報端末１を閉じた状態では、領域Ｒ１とＲ３は平面に、領域Ｒ２は曲面になる。なお、本例の構造では、フレーム３に設けた段差部５のため領域Ｒ１の面積が領域Ｒ３の面積よりも大きくなっているが、面積の大小は特に意味のあるものではなく、段差部５をなくせば同等にすることもできる。また、各領域の境界（領域Ｒ１とＲ２の境界、領域Ｒ２とＲ３の境界）は、フレーム３とヒンジ４の境界に一致する必要はない。 FIG. 1D is a diagram illustrating the area division of the touch screen 2. By opening and closing the mobile information terminal 1, the surface of the touch screen 2 that can be seen (operated) by the user changes. In this embodiment, the effective area that operates as the touch screen 2 is switched accordingly. Therefore, the area of the touch screen 2 is divided into three areas R1, R2, and R3 in the X direction. The boundary of each region is set along the bending position by the hinge 4. As a result, when the mobile information terminal 1 is closed, the regions R1 and R3 are flat, and the regions R2 are curved. In the structure of this example, the area of the region R1 is larger than the area of the region R3 because of the stepped portion 5 provided on the frame 3, but the size of the area is not particularly significant and the stepped portion 5 It can be made equivalent by eliminating. Further, the boundary of each region (the boundary between the regions R1 and R2 and the boundary between the regions R2 and R3) does not have to coincide with the boundary between the frame 3 and the hinge 4.
　図２Ａは、携帯情報端末１のハードウェア構成の一例を示す図である。ここでは、スマートフォンとしての基本動作とともに、折り畳み状態に応じて動作を制御する構成としている。携帯情報端末１は、主制御部１０１、システムバス１０２、ＲＡＭ１０３、ストレージ部１１０、操作入力部１２０、画像処理部１３０、音声処理部１４０、センサ部１５０、通信部１６０、拡張インタフェース部１７０、領域制御部１８０、を備えて構成される。 FIG. 2A is a diagram showing an example of the hardware configuration of the mobile information terminal 1. Here, in addition to the basic operation as a smartphone, the operation is controlled according to the folded state. The mobile information terminal 1 includes a main control unit 101, a system bus 102, a RAM 103, a storage unit 110, an operation input unit 120, an image processing unit 130, a voice processing unit 140, a sensor unit 150, a communication unit 160, an extended interface unit 170, and an area. It is configured to include a control unit 180.
　主制御部１０１は、所定の動作プログラムに従って携帯情報端末１全体を制御するマイクロプロセッサユニットである。システムバス１０２は、主制御部１０１と携帯情報端末１内の各動作ブロックとの間で各種コマンドやデータの送受信を行うためのデータ通信路である。 The main control unit 101 is a microprocessor unit that controls the entire mobile information terminal 1 according to a predetermined operation program. The system bus 102 is a data communication path for transmitting and receiving various commands and data between the main control unit 101 and each operation block in the mobile information terminal 1.
　ＲＡＭ（Random Access Memory）１０３は、基本動作プログラムやその他の動作プログラム実行時のワークエリアとなる。ＲＡＭ１０３は、主制御部１０１と一体構成であっても良い。 The RAM (RandomAccessMemory) 103 serves as a work area when executing a basic operation program or other operation programs. The RAM 103 may be integrated with the main control unit 101.
　ストレージ部１１０は、携帯情報端末１の動作プログラムや動作設定値等を記憶する。また、ネットワーク上からダウンロードした動作プログラムや該動作プログラムで作成した各種データ等を記憶可能である。ストレージ部１１０は、携帯情報端末１に外部から電源が供給されていない状態であっても記憶している情報を保持する必要がある。従って、例えば、フラッシュＲＯＭやＳＳＤ（Solid State Drive）などの半導体素子メモリ、ＨＤＤ（Hard Disc Drive）などの磁気ディスクドライブ、等のデバイスが用いられる。 The storage unit 110 stores the operation program, operation setting value, and the like of the mobile information terminal 1. In addition, an operation program downloaded from the network and various data created by the operation program can be stored. The storage unit 110 needs to hold the stored information even when the mobile information terminal 1 is not supplied with power from the outside. Therefore, for example, devices such as a semiconductor element memory such as a flash ROM and an SSD (Solid State Drive), a magnetic disk drive such as an HDD (Hard Disc Drive), and the like are used.
　操作入力部１２０は、携帯情報端末１に対するユーザの操作入力を受け付ける。操作入力部１２０は、ボタンスイッチ等を並べた操作部１２１と、静電容量等の変化に基づいてユーザの手指が触れたことを検出するタッチパネル１２２で構成される。なお、タッチパネル１２２は表示部１３１と一体的に配置され、タッチスクリーン２を構成する。 The operation input unit 120 receives the user's operation input to the mobile information terminal 1. The operation input unit 120 includes an operation unit 121 in which button switches and the like are arranged, and a touch panel 122 that detects that a user's finger touches based on a change in capacitance or the like. The touch panel 122 is integrally arranged with the display unit 131 to form the touch screen 2.
　画像処理部１３０は、表示部１３１、画像信号処理部１３２、第１撮像部１３３、第２撮像部１３４で構成される。表示部１３１は、例えば有機ＥＬ等の表示デバイスであり、画像信号処理部１３２で処理した画像データを表示し、携帯情報端末１のユーザに提供する。画像信号処理部１３２は図示を省略したビデオＲＡＭを備え、入力した画像データに基づいて表示部１３１を駆動する。第１撮像部１３３及び第２撮像部１３４は、アウトカメラ（背面撮影用）及びインカメラ（前面撮影用）の撮影ユニットであり、ＣＣＤ（Charge Coupled Device）やＣＭＯＳ（Complementary Metal Oxide Semiconductor）センサ等の電子デバイスを用いてレンズから入力した光を電気信号に変換し、被写体の画像データを取り込む。 The image processing unit 130 is composed of a display unit 131, an image signal processing unit 132, a first imaging unit 133, and a second imaging unit 134. The display unit 131 is a display device such as an organic EL, and displays the image data processed by the image signal processing unit 132 and provides it to the user of the mobile information terminal 1. The image signal processing unit 132 includes a video RAM (not shown) and drives the display unit 131 based on the input image data. The first imaging unit 133 and the second imaging unit 134 are imaging units for an out-camera (for rear photography) and an in-camera (for front photography), and are CCD (Charge Coupled Device), CMOS (Complementary Metal Oxide Semiconductor) sensors, and the like. The light input from the lens is converted into an electric signal using the electronic device of the above, and the image data of the subject is captured.
　音声処理部１４０は、音声出力部１４１、音声信号処理部１４２、音声入力部１４３で構成される。音声出力部１４１はスピーカであり、音声信号処理部１４２で処理した音声信号を携帯情報端末１のユーザに提供する。音声入力部１４３はマイクであり、ユーザの声などを音声データに変換して入力する。 The voice processing unit 140 is composed of a voice output unit 141, a voice signal processing unit 142, and a voice input unit 143. The voice output unit 141 is a speaker, and provides the user of the mobile information terminal 1 with the voice signal processed by the voice signal processing unit 142. The voice input unit 143 is a microphone, which converts a user's voice or the like into voice data and inputs it.
　センサ部１５０は、携帯情報端末１の状態を検出するための各種センサ群である。センサとして、ＧＰＳ（Global Positioning System）受信部１５１、ジャイロセンサ１５２、地磁気センサ１５３、加速度センサ１５４、開閉センサ１５５を有し、携帯情報端末１の位置、傾き、方角、動き、開閉状態を検出する。加速度センサ１５４は、例えばＭＥＭＳセンサにより携帯情報端末１に対する重力の方向を検出する。開閉センサ１５５は、例えば光方式（発光／受光素子）や磁気方式（磁石／磁力センサ）により、携帯情報端末１の折り畳み開閉状態を検出する。開閉センサ１５５は、ヒンジ４に設置されて、ヒンジ４の折り畳み角度を検出するようにしても良い。 The sensor unit 150 is a group of various sensors for detecting the state of the mobile information terminal 1. As a sensor, it has a GPS (Global Positioning System) receiver 151, a gyro sensor 152, a geomagnetic sensor 153, an acceleration sensor 154, and an open / close sensor 155, and detects the position, tilt, direction, movement, and open / closed state of the portable information terminal 1. .. The acceleration sensor 154 detects the direction of gravity with respect to the mobile information terminal 1 by, for example, a MEMS sensor. The open / close sensor 155 detects the folded open / closed state of the portable information terminal 1 by, for example, an optical method (light emitting / light receiving element) or a magnetic method (magnet / magnetic sensor). The open / close sensor 155 may be installed on the hinge 4 to detect the folding angle of the hinge 4.
　通信部１６０は、ＬＡＮ（Local Area Network）通信部１６１、電話網通信部１６２、Ｂｌｕｅｔｏｏｔｈ（登録商標）通信部１６３で構成される。ＬＡＮ通信部１６１はアクセスポイント等を介してインターネット等のネットワークと接続され、ネットワーク上のサーバとデータの送受信を行う。電話網通信部１６２は移動体電話通信網の基地局等との無線通信により、電話通信（通話）及びデータの送受信を行う。 The communication unit 160 is composed of a LAN (Local Area Network) communication unit 161, a telephone network communication unit 162, and a Bluetooth (registered trademark) communication unit 163. The LAN communication unit 161 is connected to a network such as the Internet via an access point or the like, and transmits / receives data to / from a server on the network. The telephone network communication unit 162 performs telephone communication (call) and data transmission / reception by wireless communication with a base station or the like of a mobile telephone communication network.
　拡張インタフェース１７０は、携帯情報端末１の機能を拡張するためのインタフェース群であり、映像／音声インタフェース、ＵＳＢ（Universal Serial Bus）インタフェース、メモリインタフェース等で構成される。 The expansion interface 170 is a group of interfaces for expanding the functions of the personal digital assistant 1, and is composed of a video / audio interface, a USB (Universal Serial Bus) interface, a memory interface, and the like.
　領域制御部１８０は、タッチスクリーン２すなわちタッチパネル１２２と表示部１３１に対して領域を分割し、分割領域ごとにタッチ検出と表示動作の有効／無効の領域制御を行う。 The area control unit 180 divides an area into the touch screen 2, that is, the touch panel 122 and the display unit 131, and performs touch detection and valid / invalid area control of the display operation for each divided area.
　なお、図２Ａに示した携帯情報端末１の構成例は、本実施例の動作に必須ではない構成も多数含んでおり、これらが備えられていない構成であっても本実施例の効果を損なうことはない。 It should be noted that the configuration example of the mobile information terminal 1 shown in FIG. 2A includes many configurations that are not essential for the operation of this embodiment, and even if these configurations are not provided, the effect of this embodiment is impaired. There is no such thing.
　図２Ｂは、携帯情報端末１の領域制御を行うための構成を示す図である。タッチスクリーン２は、タッチパネル１２２と表示部１３１を重ねて一体化して構成されている。タッチスクリーン２が開いている場合、領域制御部１８０は、タッチスクリーン２の全領域においてタッチ検出と表示動作を行う。タッチスクリーン２が閉じている場合、領域制御部１８０は、タッチスクリーン２を複数の領域Ｒ１，Ｒ２，Ｒ３に分割して、分割領域ごとにタッチ検出の有効／無効と表示動作の有効／無効を設定して領域制御を行う。このときの領域制御は有効／無効の設定の仕方が複数通り可能であり、ユーザは所望の設定を制御モード１８１により指定することができる。 FIG. 2B is a diagram showing a configuration for performing area control of the mobile information terminal 1. The touch screen 2 is configured by overlapping the touch panel 122 and the display unit 131 and integrating them. When the touch screen 2 is open, the area control unit 180 performs touch detection and display operations in the entire area of the touch screen 2. When the touch screen 2 is closed, the area control unit 180 divides the touch screen 2 into a plurality of areas R1, R2, R3, and enables / disables the touch detection and enables / disables the display operation for each divided area. Set and control the area. The area control at this time can be set to be valid / invalid in a plurality of ways, and the user can specify a desired setting by the control mode 181.
　無効として設定した領域では、タッチパネル１２２についてはタッチ操作の検出動作を行わず、表示部１３１については表示動作を行わない。これに伴い、有効領域でのタッチ操作の機能と、有効領域での表示画面を変更してもよい。さらには、無効領域に対してはタッチ検出や表示動作に係る電源の供給をオフとして、携帯情報端末１の省電力を図るようにする。 In the area set as invalid, the touch panel 122 does not perform the touch operation detection operation, and the display unit 131 does not perform the display operation. Along with this, the touch operation function in the effective area and the display screen in the effective area may be changed. Further, the power supply related to the touch detection and the display operation is turned off for the invalid area to save power of the mobile information terminal 1.
　加速度センサ１５４は携帯情報端末１（タッチスクリーン２）の重力に対する上下方向を検出し、開閉センサ１５５は携帯情報端末１の折り畳み開閉状態を検出する。これらの検出信号は領域制御部１８０に入力され、領域制御部１８０は携帯情報端末１の姿勢と開閉状態に応じて、また指定された制御モード１８１に従い、タッチスクリーン２の動作の領域制御を行う。 The acceleration sensor 154 detects the vertical direction of the mobile information terminal 1 (touch screen 2) with respect to gravity, and the open / close sensor 155 detects the folded / closed state of the mobile information terminal 1. These detection signals are input to the area control unit 180, and the area control unit 180 controls the area of operation of the touch screen 2 according to the posture and open / closed state of the mobile information terminal 1 and according to the designated control mode 181. ..
　以下では、ユーザが携帯情報端末１を使用する形態は、携帯情報端末１をほぼ水平に保持しタッチスクリーン２を上から見下ろして操作する場合を想定している。よって、加速度センサ１５４により重力方向を検出すれば、タッチスクリーン２のどの領域がユーザの見る面であるかを判定できる。 In the following, it is assumed that the user uses the mobile information terminal 1 in a case where the mobile information terminal 1 is held substantially horizontally and the touch screen 2 is viewed from above. Therefore, if the direction of gravity is detected by the acceleration sensor 154, it is possible to determine which region of the touch screen 2 is the surface viewed by the user.
　図３は、携帯情報端末１の領域制御処理を示すフローチャートである。主制御部１０１と領域制御部１８０は、次の処理を実行する。
  Ｓ２０１：開閉センサ１５５により、携帯情報端末１の筐体（フレーム３）の開閉信号を検出する。 FIG. 3 is a flowchart showing the area control process of the mobile information terminal 1. The main control unit 101 and the area control unit 180 execute the following processing.
S201: The open / close sensor 155 detects the open / close signal of the housing (frame 3) of the mobile information terminal 1.
　Ｓ２０２：開閉信号により筐体の開閉状態を判定する。なお、開閉途中の状態ではセンサ信号に閾値を設けて判定する。筐体が開状態である場合には、Ｓ２０３の処理に進む。閉状態である場合には、Ｓ２０４の処理に進む。 S202: The open / closed state of the housing is determined by the open / close signal. In the state of being opened and closed, a threshold value is set in the sensor signal for determination. If the housing is in the open state, the process proceeds to S203. If it is in the closed state, the process proceeds to S204.
　Ｓ２０３：領域制御部１８０は、タッチスクリーン２の全領域（Ｒ１，Ｒ２，Ｒ３）を有効領域として設定する。即ち、タッチパネル１２２の全領域においてタッチ操作の検出動作を実行し、表示部１３１の全領域において表示動作を実行する。 S203: The area control unit 180 sets the entire area (R1, R2, R3) of the touch screen 2 as an effective area. That is, the touch operation detection operation is executed in the entire area of the touch panel 122, and the display operation is executed in the entire area of the display unit 131.
　Ｓ２０４：筐体が閉状態のときは、加速度センサ１５４により携帯情報端末１の筐体の姿勢を検出する。すなわち、タッチスクリーン２の平面の領域Ｒ１，Ｒ３のうち、いずれが重力方向に上面側にあるかを判断する。このとき、ユーザが携帯情報端末１の筐体を水平状態から傾けて保持したとしても、タッチスクリーン２の２つの領域Ｒ１，Ｒ３のいずれが上面側にあるかを確定できる。 S204: When the housing is closed, the acceleration sensor 154 detects the posture of the housing of the mobile information terminal 1. That is, it is determined which of the flat regions R1 and R3 of the touch screen 2 is on the upper surface side in the direction of gravity. At this time, even if the user holds the housing of the mobile information terminal 1 at an angle from the horizontal state, it is possible to determine which of the two regions R1 and R3 of the touch screen 2 is on the upper surface side.
　Ｓ２０５：領域制御部１８０は、Ｓ２０４の姿勢検出結果と指定された制御モード１８１に従い、タッチスクリーン２の夫々の分割領域Ｒ１，Ｒ２，Ｒ３について、タッチ操作の有効領域／無効領域の設定、表示動作の有効領域／無効領域の設定を行う。例えば、重力方向に上面側となる領域は有効とし、下面側となる領域は無効とする。 S205: The area control unit 180 sets and displays the effective area / invalid area of the touch operation for each of the divided areas R1, R2, and R3 of the touch screen 2 according to the posture detection result of S204 and the designated control mode 181. Set the effective area / invalid area of. For example, the region on the upper surface side in the direction of gravity is valid, and the region on the lower surface side is invalid.
　その後Ｓ２０１に戻り、上記の処理を繰り返すことで、携帯情報端末１の開閉状態や姿勢状態が変化するごとに、各領域の有効／無効の設定を切り替える。 After that, by returning to S201 and repeating the above processing, the valid / invalid setting of each area is switched every time the open / closed state or the posture state of the mobile information terminal 1 changes.
　以下、タッチスクリーン２の領域分割と領域毎の有効／無効の設定の例（制御モード）を説明する。いずれも、ユーザは携帯情報端末１を閉じて、タッチスクリーン２の面を重力方向に対して略水平に保持している場合を想定する。 Hereinafter, an example (control mode) of dividing the area of the touch screen 2 and setting valid / invalid for each area will be described. In each case, it is assumed that the user closes the mobile information terminal 1 and holds the surface of the touch screen 2 substantially horizontally with respect to the direction of gravity.
　図４Ａと図４Ｂは、領域制御の第１例（制御モード１）を示す図である。図面左側は、閉じた携帯情報端末１のＹ軸方向から見た姿勢を示す。矢印Ｇは重力方向である。図面右側は、タッチスクリーン２をＸ軸方向に展開して各領域の有効／無効の設定を示している。 4A and 4B are diagrams showing a first example of area control (control mode 1). The left side of the drawing shows the posture of the closed mobile information terminal 1 as viewed from the Y-axis direction. The arrow G is the direction of gravity. On the right side of the drawing, the touch screen 2 is expanded in the X-axis direction to show the enable / disable setting of each area.
　図４Ａは、タッチスクリーン２の分割領域Ｒ１が重力方向に対して上側になるよう保持した場合である。つまり、ユーザから見えるのは分割領域Ｒ１の面である。このとき領域制御部１８０は、上面の領域Ｒ１を有効に設定し、表示動作とタッチ検出を可能とする。一方、ユーザから見えない下面と側面の領域Ｒ３、Ｒ２を無効に設定し、表示動作とタッチ検出を不可能にする。或いは、領域Ｒ３とＲ２は、タッチ検出のみを無効に設定し、フレーム３の近似色等を固定表示するようにしても良い。 FIG. 4A shows a case where the divided region R1 of the touch screen 2 is held so as to be above the direction of gravity. That is, what the user can see is the surface of the divided region R1. At this time, the area control unit 180 effectively sets the area R1 on the upper surface to enable display operation and touch detection. On the other hand, the lower surface and side surface areas R3 and R2 that cannot be seen by the user are set to be invalid, making display operation and touch detection impossible. Alternatively, in the areas R3 and R2, only touch detection may be disabled, and the approximate color of the frame 3 or the like may be fixedly displayed.
　図４Ｂは、図４Ａの姿勢を上下反転して保持した場合であり、タッチスクリーン２の分割領域Ｒ３が重力方向に対して上側になるよう保持している。このとき領域制御部１８０は、上面の領域Ｒ３を有効に設定し、表示動作とタッチ検出を可能にする。一方、ユーザから見えない下面と側面の領域Ｒ１、Ｒ２を無効に設定し、表示動作とタッチ検出を不可能にする。 FIG. 4B shows a case where the posture of FIG. 4A is turned upside down and held, and the divided region R3 of the touch screen 2 is held so as to be above the direction of gravity. At this time, the area control unit 180 effectively sets the area R3 on the upper surface to enable display operation and touch detection. On the other hand, the lower surface and side surface areas R1 and R2 that cannot be seen by the user are set to be invalid, making display operation and touch detection impossible.
　図５は、領域制御の第２例（制御モード２）を示す図である。携帯情報端末１の姿勢は図４Ａと同じである。領域制御部１８０は、タッチスクリーン２の上面の領域Ｒ１を有効に設定し、側面の領域Ｒ２を無効に設定するのは、図４の第１例と同様である。図４と異なる点は、下面の領域Ｒ３について表示動作は無効とするが、タッチ検出を有効に設定したことである。すなわち、下面の領域Ｒ３をタッチパッドとして使用可能にする。これにより、上面の領域Ｒ１に表示している画像に対して、下面の領域Ｒ３をタッチ操作することにより、画像のスクロールやズーム動作を行うことが可能となる。なお、下面の領域Ｒ３は全面をタッチ操作有効としてタッチパッドとして使用しても良いが、さらにＹ方向に分割（Ｙ１，Ｙ２）して、一方のみ（例えばＹ１のみ）を有効としてタッチパッドとして使用しても良い。 FIG. 5 is a diagram showing a second example of area control (control mode 2). The posture of the mobile information terminal 1 is the same as that in FIG. 4A. The area control unit 180 effectively sets the upper surface area R1 of the touch screen 2 and invalidates the side surface area R2, as in the first example of FIG. The difference from FIG. 4 is that the display operation is invalid for the lower surface area R3, but the touch detection is enabled. That is, the area R3 on the lower surface can be used as a touch pad. As a result, the image displayed in the upper surface area R1 can be scrolled or zoomed by touching the lower surface area R3. The lower surface area R3 may be used as a touch pad by making the entire surface effective for touch operation, but it is further divided in the Y direction (Y1, Y2) and only one (for example, only Y1) is effective and used as a touch pad. You may.
　なお、図示しないが、図５の姿勢を上下反転して保持した場合は、タッチスクリーン２の上面となる領域Ｒ３を有効に設定し、下面となる領域Ｒ１をタッチパッドとして使用可能にする。 Although not shown, when the posture of FIG. 5 is turned upside down and held, the area R3 which is the upper surface of the touch screen 2 is effectively set, and the area R1 which is the lower surface can be used as a touch pad.
　図６は、領域制御の第３例（制御モード３）を示す図である。携帯情報端末１の姿勢は図４Ａと同じである。領域制御部１８０は、タッチスクリーン２の上面の領域Ｒ１を有効に設定し、下面の領域Ｒ３を無効に設定するのは、図４の第１例と同様である。図４と異なる点は、側面の領域Ｒ２について表示動作は無効とするが、タッチ検出を有効に設定したことである。すなわち、側面の領域Ｒ２をスライドパッドとして使用可能にする。これにより、上面の領域Ｒ１に表示している画像に対して、側面の領域Ｒ２をタッチ操作することにより、画像のスクロール動作（Ｙ方向）などを行うことが可能となる。 FIG. 6 is a diagram showing a third example of area control (control mode 3). The posture of the mobile information terminal 1 is the same as that in FIG. 4A. The area control unit 180 effectively sets the upper surface area R1 of the touch screen 2 and invalidates the lower surface area R3, as in the first example of FIG. The difference from FIG. 4 is that the display operation is invalid for the side area R2, but the touch detection is enabled. That is, the side area R2 can be used as a slide pad. As a result, it is possible to perform an image scrolling operation (Y direction) by touching the side area R2 with respect to the image displayed in the upper surface area R1.
　なお、図示しないが、図６の姿勢を上下反転して保持した場合は、タッチスクリーン２の上面となる領域Ｒ３を有効に設定し、側面の領域Ｒ２をスライドパッドとして使用可能にする。 Although not shown, when the posture of FIG. 6 is turned upside down and held, the area R3 on the upper surface of the touch screen 2 is effectively set, and the area R2 on the side surface can be used as a slide pad.
　図７は、領域制御の第４例（制御モード４）を示す図である。携帯情報端末１の姿勢は図４Ａと同じである。制御モード４は制御モード３（図６）の変形例であり、領域制御部１８０は、上面の領域Ｒ１と側面の領域Ｒ２の境界部に不感帯Ｒ４を設ける。そして、不感帯Ｒ４の領域ではタッチ操作も表示動作も行えないようにする。これにより、上面の領域Ｒ１及び側面の領域Ｒ２に対するユーザのタッチ操作を明確に区別し、両方に跨ることで生じる操作の誤検知を防止することが可能となる。なお、不感帯Ｒ４は、タッチ検出のみを無効に設定し、フレーム３の近似色等を固定表示するようにして不感帯であることを明示するようにしても良い。 FIG. 7 is a diagram showing a fourth example of area control (control mode 4). The posture of the mobile information terminal 1 is the same as that in FIG. 4A. The control mode 4 is a modification of the control mode 3 (FIG. 6), and the area control unit 180 provides a dead zone R4 at the boundary between the upper surface area R1 and the side surface area R2. Then, neither touch operation nor display operation can be performed in the area of the dead zone R4. As a result, it is possible to clearly distinguish the user's touch operation with respect to the upper surface area R1 and the side surface area R2, and to prevent erroneous detection of the operation caused by straddling both. Note that the dead zone R4 may be set to invalidate only touch detection, and the approximate color of the frame 3 or the like may be fixedly displayed to clearly indicate that the dead band R4 is a dead band.
　なお、図示しないが、図７の姿勢を上下反転して保持した場合は、タッチスクリーン２の上面となる領域Ｒ３と側面の領域Ｒ２の境界部に同様に不感帯Ｒ５（図示せず）を設ければよい。 Although not shown, when the posture of FIG. 7 is turned upside down and held, a dead zone R5 (not shown) is similarly provided at the boundary between the upper surface region R3 and the side surface region R2 of the touch screen 2. Just do it.
　また、図示は省略するが、図７に示した領域Ｒ３とＲ２の間に、更に不感帯Ｒ５を設け、上面の領域Ｒ１はタッチ検出と表示動作を有効に設定し、領域Ｒ２とＲ３はタッチ検出のみを有効に設定しても良い。この場合、領域Ｒ２をスライドパッドとして使用してＹ方向のスクロール動作の操作を行い、領域Ｒ３をタッチパッドとして使用してＸ方向のスクロール動作の操作を行うようにしても良い。 Although not shown, a dead zone R5 is further provided between the regions R3 and R2 shown in FIG. 7, the upper surface region R1 effectively sets the touch detection and the display operation, and the regions R2 and R3 are the touch detection. Only may be enabled. In this case, the area R2 may be used as a slide pad to operate the scroll operation in the Y direction, and the area R3 may be used as the touch pad to perform the scroll operation in the X direction.
　以上に説明した領域制御の例（制御モード１～制御モード４）は、ユーザが選択して切り替えることが可能である。 The area control example (control mode 1 to control mode 4) described above can be selected and switched by the user.
　以上の実施例では、ユーザが携帯情報端末１を使用する形態は、携帯情報端末１をほぼ水平に保持しタッチスクリーン２を上から見下ろして操作する場合を想定したが、本発明はこれに限定されない。ユーザの他の使用形態として、携帯情報端末１を縦置き状態で保持しタッチスクリーン２を横から見ながら操作する場合もある。この場合は、加速度センサ１５４で検出した重力方向を基準に領域制御を行うのではなく、ユーザに対する携帯情報端末１の姿勢を検出して領域制御を行う必要がある。縦置き状態を含め様々な使用形態に対応するには、姿勢センサとして第１撮像部１３３（アウトカメラ：段差部５の第２撮像部１３４の反対の面に設置）や第２撮像部１３４（インカメラ）を用いる方法がある。すなわち、携帯情報端末１に対しユーザの存在する方向を第１撮像部１３３や第２撮像部１３４の撮影画像から判断し、タッチスクリーン２のどの領域がユーザの見る面であるかを判定すれば良い。 In the above embodiments, it is assumed that the user uses the mobile information terminal 1 by holding the mobile information terminal 1 substantially horizontally and operating the touch screen 2 from above, but the present invention is limited to this. Not done. As another usage pattern of the user, the mobile information terminal 1 may be held vertically and the touch screen 2 may be operated while being viewed from the side. In this case, it is necessary to detect the posture of the mobile information terminal 1 with respect to the user and perform the area control instead of performing the area control based on the gravity direction detected by the acceleration sensor 154. In order to support various usage patterns including the vertical installation state, the first imaging unit 133 (out-camera: installed on the opposite surface of the second imaging unit 134 of the step portion 5) and the second imaging unit 134 (out-camera: installed on the opposite surface of the second imaging unit 134 of the step portion 5) There is a method using in-camera). That is, if the direction in which the user exists with respect to the mobile information terminal 1 is determined from the captured images of the first imaging unit 133 and the second imaging unit 134, and which region of the touch screen 2 is the surface to be viewed by the user is determined. good.
　また、以上の実施例では、携帯情報端末としてスマートフォンを例に説明したが、外側に折り畳み可能なタッチスクリーンを有する情報端末であれば、本発明を同様に適用できることは言うまでもない。 Further, in the above embodiment, a smartphone has been described as an example of a mobile information terminal, but it goes without saying that the present invention can be similarly applied to an information terminal having a foldable touch screen on the outside.
　１：携帯情報端末、
　２：タッチスクリーン、
　３：フレーム、
　４：ヒンジ、
　１２２：タッチパネル、
　１３１：表示部、
　１３４：第２撮像部（インカメラ）、
　１４１：音声出力部（スピーカ）、
　１５４：加速度センサ、
　１５５：開閉センサ、
　１８０：領域制御部、
　１８１：制御モード、
　Ｒ１，Ｒ２，Ｒ３，Ｒ４：分割領域。 1: Mobile information terminal,
2: Touch screen,
3: Frame,
4: Hinge,
122: Touch panel,
131: Display,
134: Second imaging unit (in-camera),
141: Audio output unit (speaker),
154: Accelerometer,
155: Open / close sensor,
180: Area control unit,
181: Control mode,
R1, R2, R3, R4: Divided area.

Claims (8)

  1. 　タッチスクリーンを外側にして折り畳み可能な携帯情報端末において、
    　前記タッチスクリーンは画像を表示する表示部と、ユーザのタッチ操作を検出するタッチパネルとを一体化して配置したものであり、
    　前記携帯情報端末の開閉状態を検出する開閉センサと、
    　ユーザに対する前記携帯情報端末の姿勢を検出する姿勢センサと、
    　前記タッチスクリーンを折り曲げ位置に沿って複数の領域に分割し、前記開閉センサと前記姿勢センサの検出結果に基づいて、分割した夫々の領域について、前記表示部の表示動作の有効／無効と前記タッチパネルのタッチ検出動作の有効／無効を設定する領域制御部と、
    　を備えることを特徴とする携帯情報端末。     In a mobile information terminal that can be folded with the touch screen on the outside
    The touch screen is an integrated arrangement of a display unit for displaying an image and a touch panel for detecting a user's touch operation.
    An open / close sensor that detects the open / closed state of the mobile information terminal,
    A posture sensor that detects the posture of the mobile information terminal with respect to the user, and
    The touch screen is divided into a plurality of regions along the bending position, and based on the detection results of the open / close sensor and the posture sensor, the display operation of the display unit is enabled / disabled and the touch panel is enabled for each of the divided regions. The area control unit that sets the enable / disable of the touch detection operation of
    A mobile information terminal characterized by being equipped with.
  2. 　請求項１に記載の携帯情報端末において、
    　前記領域制御部は、
    　前記携帯情報端末が開いた状態では、前記タッチスクリーンの全領域の表示動作とタッチ検出動作を有効とし、
    　前記携帯情報端末が閉じた状態では、ユーザから見て上面となる領域の表示動作とタッチ検出動作を有効とし、ユーザから見て下面及び側面となる領域の表示動作とタッチ検出動作を無効とすることを特徴とする携帯情報端末。     In the mobile information terminal according to claim 1,
    The area control unit
    When the mobile information terminal is open, the display operation and the touch detection operation of the entire area of the touch screen are enabled.
    When the mobile information terminal is closed, the display operation and the touch detection operation of the area on the upper surface when viewed from the user are enabled, and the display operation and the touch detection operation on the area on the lower surface and the side surface when viewed from the user are invalidated. A mobile information terminal characterized by that.
  3. 　請求項１に記載の携帯情報端末において、
    　前記領域制御部は、
    　前記携帯情報端末が開いた状態では、前記タッチスクリーンの全領域の表示動作とタッチ検出動作を有効とし、
    　前記携帯情報端末が閉じた状態では、ユーザから見て上面となる領域の表示動作とタッチ検出動作を有効とし、ユーザから見て下面となる領域の表示動作を無効、タッチ検出動作を有効とし、ユーザから見て側面となる領域の表示動作とタッチ検出動作を無効とすることを特徴とする携帯情報端末。     In the mobile information terminal according to claim 1,
    The area control unit
    When the mobile information terminal is open, the display operation and the touch detection operation of the entire area of the touch screen are enabled.
    When the mobile information terminal is closed, the display operation and the touch detection operation of the area on the upper surface when viewed from the user are enabled, the display operation of the area on the lower surface when viewed from the user is disabled, and the touch detection operation is enabled. A mobile information terminal characterized by disabling the display operation and touch detection operation of an area that is a side view from the user.
  4. 　請求項１に記載の携帯情報端末において、
    　前記領域制御部は、
    　前記携帯情報端末が開いた状態では、前記タッチスクリーンの全領域の表示動作とタッチ検出動作を有効とし、
    　前記携帯情報端末が閉じた状態では、ユーザから見て上面となる領域の表示動作とタッチ検出動作を有効とし、ユーザから見て下面となる領域の表示動作とタッチ検出動作を無効とし、ユーザから見て側面となる領域の表示動作を無効、タッチ検出動作を有効とすることを特徴とする携帯情報端末。     In the mobile information terminal according to claim 1,
    The area control unit
    When the mobile information terminal is open, the display operation and the touch detection operation of the entire area of the touch screen are enabled.
    When the mobile information terminal is closed, the display operation and the touch detection operation of the area on the upper surface when viewed from the user are enabled, the display operation and the touch detection operation on the lower surface when viewed from the user are disabled, and the user A mobile information terminal characterized by disabling the display operation of the area on the side when viewed and enabling the touch detection operation.
  5. 　請求項４に記載の携帯情報端末において、
    　前記領域制御部は、前記携帯情報端末が閉じた状態では、ユーザから見て上面となる領域とユーザから見て側面となる領域の境界に、タッチ検出動作を無効とする不感帯を設けたことを特徴とする携帯情報端末。     In the mobile information terminal according to claim 4.
    The area control unit has provided a dead zone that invalidates the touch detection operation at the boundary between the area that is the upper surface when viewed from the user and the area that is the side surface when viewed from the user when the mobile information terminal is closed. A featured mobile information terminal.
  6. 　請求項１に記載の携帯情報端末において、
    　前記姿勢センサとして、前記携帯情報端末に対する重力方向を検出する加速度センサを用いることを特徴とする携帯情報端末。     In the mobile information terminal according to claim 1,
    A mobile information terminal characterized by using an acceleration sensor that detects the direction of gravity with respect to the mobile information terminal as the posture sensor.
  7. 　請求項１に記載の携帯情報端末において、
    　前記領域制御部は、前記表示部のうち表示動作を無効とした領域、及び前記タッチパネルのうちタッチ検出動作を無効とした領域に対しての電源の供給をオフとすることを特徴とする携帯情報端末。     In the mobile information terminal according to claim 1,
    The area control unit is characterized in that the power supply to the area of the display unit in which the display operation is disabled and the area of the touch panel in which the touch detection operation is disabled are turned off. Terminal.
  8. 　請求項１に記載の携帯情報端末において、
    　前記領域制御部は、分割した夫々の領域について有効／無効の設定の仕方が複数通り可能であり、ユーザは所望の設定を制御モードにより指定することができることを特徴とする携帯情報端末。     In the mobile information terminal according to claim 1,
    The area control unit is a mobile information terminal characterized in that a plurality of ways of setting valid / invalid for each divided area are possible, and a user can specify a desired setting by a control mode.
PCT/JP2019/022586 2019-06-06 2019-06-06 Personal digital assistant WO2020245989A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/022586 WO2020245989A1 (en) 2019-06-06 2019-06-06 Personal digital assistant

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2019/022586 WO2020245989A1 (en) 2019-06-06 2019-06-06 Personal digital assistant

Publications (1)

Publication Number Publication Date
WO2020245989A1 true WO2020245989A1 (en) 2020-12-10

Family

ID=73653136

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2019/022586 WO2020245989A1 (en) 2019-06-06 2019-06-06 Personal digital assistant

Country Status (1)

Country Link
WO (1) WO2020245989A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115047992A (en) * 2022-08-15 2022-09-13 深圳润方创新技术有限公司 Graph drawing method and system based on web drawing board

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140285449A1 (en) * 2013-03-20 2014-09-25 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US20180018929A1 (en) * 2016-07-13 2018-01-18 Motorola Mobility Llc Deformable Electronic Device and Methods and Systems for Display Remediation to Compensate Performance Degradation
WO2018018442A1 (en) * 2016-07-27 2018-02-01 深圳市柔宇科技有限公司 Display interface control method and device for misoperation prevention, and terminal
JP2018084908A (en) * 2016-11-22 2018-05-31 富士ゼロックス株式会社 Terminal device and program

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140285449A1 (en) * 2013-03-20 2014-09-25 Lg Electronics Inc. Foldable display device providing adaptive touch sensitive area and method for controlling the same
US20180018929A1 (en) * 2016-07-13 2018-01-18 Motorola Mobility Llc Deformable Electronic Device and Methods and Systems for Display Remediation to Compensate Performance Degradation
WO2018018442A1 (en) * 2016-07-27 2018-02-01 深圳市柔宇科技有限公司 Display interface control method and device for misoperation prevention, and terminal
JP2018084908A (en) * 2016-11-22 2018-05-31 富士ゼロックス株式会社 Terminal device and program

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115047992A (en) * 2022-08-15 2022-09-13 深圳润方创新技术有限公司 Graph drawing method and system based on web drawing board

Similar Documents

Publication Publication Date Title
CN106341522B (en) Mobile terminal and control method thereof
CN113557495B (en) Method for providing image using foldable display and electronic device supporting the same
TWI621072B (en) Camera-based orientation fix from portrait to landscape
US20210216184A1 (en) Electronic device
JP5815275B2 (en) Portable terminal device and program
JPWO2016035421A1 (en) Pan / tilt operating device, camera system, pan / tilt operating program, and pan / tilt operating method
WO2011118429A1 (en) Information processing device, display switching method, program, and recording medium
JP2011034196A (en) Portable terminal device and program
KR101780508B1 (en) Mobile terminal and method for discriminating between user's left and right ears during a call
CN110417960B (en) Folding method of foldable touch screen and electronic equipment
EP3614239B1 (en) Electronic device control in response to finger rotation upon fingerprint sensor and corresponding methods
JP2018084908A (en) Terminal device and program
JP2014071377A (en) Image display control device, image display device, program and image display method
JP5057115B2 (en) Terminal device and program
WO2020245989A1 (en) Personal digital assistant
JP7155242B2 (en) Personal digital assistant
JP5561808B2 (en) Portable terminal device and program
JP2015207093A (en) Portable terminal device
JP5676728B2 (en) Portable terminal device and program
JP5569993B2 (en) Portable terminal device and program
US20220308638A1 (en) Method for obtaining data indicating direction, electronic device and storage medium
JP2014229233A (en) Screen control device, information processing device, display control method, and program
TWI492149B (en) Displaying method and portable device
CN118092594A (en) Screen control method and device, electronic equipment and storage medium
JP2010074796A (en) Electronic apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19931740

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19931740

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP