CN112041792A - Display device - Google Patents
Display device Download PDFInfo
- Publication number
- CN112041792A CN112041792A CN201980029053.7A CN201980029053A CN112041792A CN 112041792 A CN112041792 A CN 112041792A CN 201980029053 A CN201980029053 A CN 201980029053A CN 112041792 A CN112041792 A CN 112041792A
- Authority
- CN
- China
- Prior art keywords
- motion
- information
- display
- type
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000033001 locomotion Effects 0.000 claims abstract description 273
- 238000001514 detection method Methods 0.000 claims abstract description 48
- 230000004044 response Effects 0.000 claims abstract description 15
- 238000000034 method Methods 0.000 claims description 44
- 238000012935 Averaging Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009471 action Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 230000001815 facial effect Effects 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 239000007787 solid Substances 0.000 description 2
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000013589 supplement Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1684—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
- G06F1/1694—Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/166—Editing, e.g. inserting or deleting
- G06F40/171—Editing, e.g. inserting or deleting by use of digital ink
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Hardware Design (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Artificial Intelligence (AREA)
- User Interface Of Digital Computer (AREA)
- Controls And Circuits For Display Device (AREA)
- Devices For Indicating Variable Information By Combining Individual Elements (AREA)
- Position Input By Displaying (AREA)
Abstract
The display device includes a display screen to display information, a memory to store information for display on the display screen, a motion detection device to detect motion of the display device, and a processor programmed to control display of the information on the display screen and to control the display screen to erase at least a portion of the information displayed on the display screen in response to motion detected by the motion detection device, wherein the motion detection device is configured to sense a plurality of types of motion, and the processor is programmed to identify the type of motion sensed and to selectively erase the information displayed on the display screen in accordance with the identified type of motion.
Description
Technical Field
The present invention relates to a display device for displaying erasable information.
Background
Display devices are widely used in portable and mobile devices such as mobile phones, tablet computer devices, and laptop computers. The challenge for designers of portable devices is to design a display apparatus that is light, battery efficient, and convenient to use.
Disclosure of Invention
The present invention provides a display device including: a display screen for displaying information in a plurality of different areas; a memory for storing information for display on different areas of a display screen; motion detection means for detecting a motion of the display device; and a processor programmed to control display of information in different areas on the display screen and to control the display screen to erase at least a portion of the information displayed on the display screen in response to motion detected by the motion detection device, wherein the motion detection device is configured to detect a plurality of types of motion and the processor is programmed to identify the detected type of motion and to selectively erase information displayed in different areas on the display screen in accordance with the identified type of motion.
The invention also provides a method of controlling a display device having a display screen and motion detector means for detecting motion, the method comprising displaying information in a plurality of different regions on the display screen; detecting a plurality of types of movement of the display device; and selectively erasing information displayed in different areas on the display screen according to the type of motion detected.
The present invention also provides a display device including: the display screen is used for displaying various types of information; a memory for storing information for display on a display screen; motion detection means for detecting a motion of the display device; and a processor programmed to control display of information on the display screen to display different information types and to control the display screen to erase at least a portion of the information displayed on the display screen in response to motion detected by the motion detection device, wherein the motion detection device is configured to detect a plurality of motion types and the processor is programmed to identify a detected motion type and to selectively erase the information type displayed on the display screen in accordance with the identified motion type.
The invention also provides a method of controlling a display device having a display screen and motion detector means for detecting motion, the method comprising displaying information of a plurality of different information types on the display screen; detecting a plurality of types of movement of the display device; and selectively erasing the type of information displayed on the display screen according to the detected type of motion.
The present invention also provides a display device including: the display screen is used for displaying information; a memory for storing motion type erase data including an identification of a motion type and a corresponding erase operation, and information for display on a display screen; motion detection means for detecting a motion of the display device; user input means for receiving user input identifying an erase operation during a learning phase; and a processor programmed to, in a learning phase, when a user input identifying a control operation is received, identify a type of motion from the motion detected by the motion detection device and store the received user input in motion type erasure data in correspondence with data identifying the type of motion, and after the learning phase, when the motion detection device detects motion, identify the type of motion using the motion type erasure data and perform a corresponding erasure operation to erase at least a portion of the information displayed on the display screen.
The invention also provides a method of controlling a display apparatus having a motion detector device for detecting motion of the device, the method comprising: during the learning phase: receiving a user input identifying an erase operation; detecting motion of the display device using the motion detector means; identifying a type of motion from the motion detected by the motion detection device; storing the received user input corresponding to the data identifying the motion type as motion type erasure data; repeating the steps of receiving, detecting, identifying and storing; in the operation stage: displaying information on a display screen; detecting motion of the display device using the motion detector means; and using the motion type control data to identify the motion type and perform a corresponding erase operation to erase at least a portion of the information displayed on the display screen.
Drawings
FIG. 1 is a schematic diagram illustrating an example display device;
FIG. 2 is a schematic diagram showing an alternative display of an example display device;
FIG. 3 is a flow diagram illustrating an example learning phase;
FIG. 4 is a flow diagram illustrating example stages of operation; and
FIG. 5 is a schematic diagram illustrating electronic components of an example display device.
Detailed Description
In the following detailed description, reference is made to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration specific embodiments in which the inventive subject matter may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the embodiments, and it is to be understood that other embodiments may be utilized and that structural, logical and electrical changes may be made without departing from the scope of the inventive subject matter. Such embodiments of the inventive subject matter may be referred to herein, individually and/or collectively, by the term "invention" merely for convenience and without intending to voluntarily limit the scope of this application to any single invention or inventive concept if more than one is in fact disclosed.
The following description is, therefore, not to be taken in a limiting sense, and the scope of the present subject matter is defined by the appended claims and their equivalents.
In the following embodiments, the same components are denoted by the same reference numerals.
In the following embodiments, the term data store or memory is intended to encompass any computer-readable storage medium and/or device (or collection of data storage media and/or devices). Examples of data storage include, but are not limited to, optical disks (e.g., CD-ROM, DVD-ROM, etc.), magnetic disks (e.g., hard disk, floppy disk, etc.), memory circuits (e.g., solid state drive, Random Access Memory (RAM), etc.), and so forth.
In one embodiment, the functions or algorithms described herein are implemented in hardware, software, or a combination of software and hardware. The software comprises computer executable instructions stored on a computer readable carrier medium such as a memory or other type of storage device. Further, the described functionality may correspond to modules, which may be software, hardware, firmware, or any combination thereof. Multiple functions are performed in one or more modules as needed, and the described embodiments are merely examples. The software is executed on a digital signal processor, ASIC, microprocessor, or other type of processor.
Some embodiments implement functions in two or more specific interconnected hardware modules or devices with related control and data signals communicated between and through the modules, or as portions of an application-specific integrated circuit. Thus, the exemplary process flow is applicable to software, firmware, and hardware implementations.
General embodiments provide a display apparatus including: a display screen for displaying information; a memory for storing information for display on a display screen; motion detection means for detecting a motion of the display device; and a processor programmed to control display of information on the display screen and, in response to motion detected by the motion detection device, to control the display screen to erase at least a portion of the information displayed on the display screen, wherein the motion detection device is configured to detect a plurality of types of motion and the processor is programmed to identify the type of motion detected and to selectively erase the information displayed on the display screen in accordance with the identified type of motion.
The present invention is applicable to a portable display device, but is not limited thereto. The display device may be applied to any display device that is capable of moving in a reciprocating, rotating or shaking motion. Such display devices are typically portable and wireless, but may simply be moved and connected by wires. The display device may be part of another device and is therefore removable in use to allow a user to effect a shaking, rotating or reciprocating motion to erase displayed information. The display may be rigid or flexible. The display may be detachable. There may be more than one display and the displays may be of different types, e.g. one flexible and one rigid.
In one example, at least a portion of the information displayed on the display screen is erased in response to a shaking or reciprocating motion greater than a threshold value detected by the motion detection device. This avoids unintentional erasure of the displayed information due to shaking of the display device, for example when travelling in a vehicle, train or airplane. Erasure of information may require more forceful movement to initiate erasure.
In one example, erasing the displayed information also causes the information to be erased or deleted in memory, at least for the set of information being displayed, such that the action is equivalent to a delete key on the keyboard (although the information may still reside in memory to allow the erase operation to be cancelled).
The motion may be detected in multiple directions, and the direction of the shaking or reciprocating motion may be detected to selectively erase information displayed on the display screen.
The device may be programmed or the user may select so that certain directions of movement of the display device or certain types of movement of the display device, such as different movement patterns, may result in different erase operations. For example, the different erase operations may involve erase operations in different screen areas, such as a box on a web page or an input area in an application executing on the display device, or involve erasure of different types of display information. For example, one type of motion or a motion in a different direction may result in erasure of a displayed image, erasure of typed text, erasure of handwritten text, erasure of a form or spreadsheet, and so forth.
The type of motion that the user may use for the erase operation may include shaking or reciprocating motion of the display device, and may be any one of, for example, linear motion, reciprocating motion, rotational motion, rocking motion, seesaw motion, shaking motion, or rock motion. The displacement or amplitude of the "shake", the frequency or rate of the "shake" and/or the speed or force of the "shake" may also be components of the type of motion of the display device. The motion may include a complex mixture or aggregation of motions or types of motions, e.g., rotations with shaking at the same time, or a sequence of motions, e.g., rotation after shaking, or rotation in one direction followed by rotation in another direction. Thus, the motion sequences may be sequences of the same motion type or different motion types.
The display device may be programmed to allow a user to teach its type of motion and to perform an erase operation in response to the detected type of motion. For example, the display device may display an erase option during a learning or startup phase while requesting the user to initiate a desired type of motion to be used for the erase operation. The user may be required to perform several operations in order for the processor to implement a learning process to learn and store the type of motion corresponding to the selected erase operation. The type of motion and the erase operation may be learned for individual users. For example, the user may enter their name or signature to use the display device, and the learned motion types and erase operations are then stored for use by the user when the user enters their name or signature.
In one example, a display device may include an input means for receiving input for displaying information. The input device may include a touch sensitive display and/or a pen. The pen allows the user to enter handwritten text and graphics.
One aspect provides a carrier medium, such as a non-transitory storage medium storing code for execution by a processor of a machine to implement the method, or a transitory medium carrying processor-executable code for execution by a processor of a machine to implement the method. Embodiments may be implemented in programmable digital logic implementing computer code. The code may be provided to programmable logic, such as a processor or microprocessor, on a carrier medium. One such embodiment of a carrier medium is a transitory medium, i.e., a signal such as an electrical, electromagnetic, acoustic, magnetic, or optical signal. Another form of carrier medium is a non-transitory storage medium storing the code, such as a solid state memory, a magnetic medium (hard drive) or an optical medium (compact disc (CD) or Digital Versatile Disc (DVD)).
In one example, the display Device may be used as a display unit in any of the examples of display devices disclosed in co-pending application GB1722249.8 filed on 29.12.2017, the contents of which are incorporated herein by reference in their entirety, or as an apparatus disclosed in a co-pending british patent application entitled "apparatus Operation Control", filed on the same date as this application, the contents of which are incorporated herein by reference in their entirety.
Specific embodiments will now be described with reference to the accompanying drawings.
Fig. 1 is a schematic diagram showing a display device.
The display device 2 comprises a display screen 1 capable of displaying information. In this example, the display screen displays three kinds of information, i.e., the entered text 11, the handwritten text 41, and the image 31. The information may be displayed by any application executing on the device, such as a web browser, an email application, a word processor, a spreadsheet, an image editor, and so forth. The information displayed may be, for example, a document or form having areas to be completed or filled in, for example, address areas and name areas in standard form letters or fields in a form. Handwritten text may be entered using the pen device 50. The screen display 1 may be sensitive to the proximity of the pen device 50 to detect the coordinates of the pen device 50 to track its position and thus produce the entered handwritten text 41. The display screen 1 may be touch sensitive to allow input of information and commands to the display device, for example by means of touch sensitive options and/or display of a keyboard.
The direction of motion that the display device may experience is displayed below the display device as a way to erase the displayed information. The motion may be a back and forth linear or reciprocating motion in any of three directions along three axes x, y and z in three dimensions as indicated by the cross arrows. Additionally or alternatively, the motion may be non-linear, curved, or rotational, as indicated by the curved arrow.
In the example of fig. 1, movement of the display device may erase all displayed information or selected portions, such as one or more of typed text 11, handwritten text 41, or image 31.
Fig. 2 shows an alternative display screen 20 of the display device. In this example, there are three different display areas, namely, a typed-text display area 10 having a typed text 11 displayed, an image display area 30 displaying an image 31, and a handwritten-text display area 40 displaying a handwritten text 41 created using a pen 50.
The movement of the display device of this example may be a back and forth linear or reciprocating movement in any of three directions along three axes x, y and z in three dimensions as indicated by the crossed arrows in fig. 1. Additionally or alternatively, the movement may be non-linear, curved, or rotational, as indicated by the curved arrow in fig. 1.
In the example of fig. 2, movement of the display device may erase all of the displayed information or selective portions, such as information in one or more of display area 10, display area 30, and display area 40.
Although different types of information are shown and described in fig. 2 as being displayed in different display areas, different display areas may display the same type of information or any combination of types of information. Further, the display area may display mixed information types. The example of fig. 2 is for illustration only.
Thus, the type of motion detected by the motion detection means of the display device may detect any of a plurality of types of motion patterns in any dimension or direction. Examples of different motion patterns are: front-to-back rocking, left-to-right rocking, up-and-down rocking, left-to-right turning (left-to-right tilting), up-and-down turning (up-and-down tilting), and rotation. Each of these motion patterns represents lateral (rocking) or rotational motion along or about one of the three axes shown in fig. 1. Two types of each of these motion types may be detected based on the starting motion. For example, front-to-back may be back-to-front or front-to-back, left-to-right may be left-to-right or right-to-left, rotation may be clockwise or counterclockwise, and so forth.
The memory of the display device may store a set of erase commands to be implemented by the processor for each type of motion detected by the motion detection means and identified by the processor from the signal from the motion detection means. These commands may be predefined or downloaded from a data source, or they may be user defined.
The display device may be programmed to allow a user to teach its type of motion and to perform an erase operation in response to the detected type of motion. For example, the display device may display an erase option during a learning or startup phase while requesting the user to initiate a desired type of motion to be used for the erase operation. The user may need to perform several operations in order for the processor to implement a learning process to learn and store the type of motion corresponding to the selected erase operation. Then, the display device stores a pattern of detected movement of each erasing operation used in a future movement detection operation for performing the erasing operation.
Fig. 3 is a flow chart illustrating a learning phase of the display device.
In step S1, the display apparatus enters a learning phase. This may be automatic upon start-up of the display device or as a result of some other operation of the display device, or it may be a result of a user selection, i.e. a use input, such as using the input means of the display device. In step S2, the display of the display device displays a menu defining control operations that the user can select to perform using the action as a user input. The displayed menu may simply be a list or a drop down menu, for example. The list may be organized into categories of erase operation types, such as erasing a letter, erasing a word, erasing text, erasing all text in a display area or frame, erasing an image, erasing displayed history data, erasing a frame or display area, and so forth.
In step S3, a user selection of an erase operation menu item is received, and then in step S4, the display device waits for a motion detector means (e.g., an accelerometer) to detect a motion of the display device. The motion is recorded for a short period of time (e.g., 1 to 2 seconds) suitable for capturing the motion pattern. To improve the accuracy of the matching process and allow for a change in the user' S motion pattern, in step S5, the process loops back to ask the user to repeat the motion input a number (N) of times, e.g., any number of times from 3 to 10 times. More iterations improve the accuracy of the matching process, but reduce the usability of the display device: the user will lose patience because the motion pattern needs to be repeated too many times.
At the end of the loop back process, the recorded repeatedly recorded motion patterns are averaged in step S6 and the average is used in step S7 to store as part of the information about the motion type in the stored motion type erasure data. Data indicating the degree of deviation between the recorded movement patterns may also be stored as part of the movement type data in order to assist the matching process during the operational phase, i.e. to assist in assessing whether the match is within the expected deviation of the stored average movement pattern. An identifier identifying the corresponding erase operation is also stored as part of the stored motion type erase data.
Then, the process will return to step S2 to allow the user to select another erase operation from the menu. If the user has completed the select erase operation, the user may elect to exit the learning phase.
Fig. 4 is a flow chart illustrating the operational phase of the display device after the learning phase.
In step S10, the display device enters the operational stage and in step S11, information is displayed on the display screen. The information may be displayed in different areas, such as the frames or windows shown in fig. 1 and 2. The information displayed may also be of different information types, such as text or images. In step S12, movement of the display device is detected. In step S13, the pattern of the motion is compared with the pattern of the motion type in the stored motion type wipe data to determine whether the motion matches the motion type. If no match is found (step S14), the process returns to step S12 to detect further motion. If a match is found with the motion data of the matching type in step S14, a corresponding erase operation is identified in the motion-type erase data in step S15, and an erase operation is performed in step S16. The matched erasing operation may be an operation of erasing information in one of the areas or erasing a type of information such as text or an image. The process then returns to step S12 to detect the next movement of the device for further control operations.
In fig. 4, the motion data of a plurality of recorded motion operations is averaged. However, the invention is not limited to averaging and only one motion detection may be used, or one number may be recorded and stored separately to match the motion pattern separately during the operational phase.
In fig. 4, a menu is presented to the user to select an erase operation, teaching the display device the type of motion to use for the erase operation. Users can also use the user input device to define their own erase operations. Furthermore, the display device may automatically enter a learning phase, e.g. at start-up, and require the user to input a sequence of motion types for controlling the sequence of operations. The type of motion and the erase operation may be learned for individual users. For example, the user may enter their name or signature to use the display device, and the learned motion types and erase operations are then stored for use by the user when the user enters their name or signature.
FIG. 5 is a schematic diagram illustrating electronic components of an example display device.
The processor 100 is connected to a static or non-volatile memory 102 that stores code, such as operating system code, used by the processor 100 and for storing displayed data and information in a non-volatile manner. Volatile memory 103 is provided for storing application code implemented by processor 100 as well as data and information for display and erase control. The volatile memory may store code (e.g., code modules) including code for identifying a motion pattern detected by the motion sensor 104 and code for controlling the display screen 105 in response to erasing the displayed information (e.g., code modules).
A display screen 105 is connected to the processor 100 for displaying information. Display screen 105 may include a touch sensitive display to provide an input device. A pen 50 (shown in fig. 1) may be used with the display screen 105 to allow entry of handwritten text or drawings. A camera 106 may also optionally be connected to the processor 100 to capture images. The camera 106 may also serve as an input device for inputting information and commands using gesture recognition performed by the processor on images captured by the camera 106.
A network connector 101 is connected to the processor 100 for communication with a communication or computer network. The communication link may communicate data, information, and control between the display device and other display devices or computers over a network. The network connector 101 may connect to a communications or computer network using a wired or wireless connection. For example, the wired connection may be an ethernet connection or a telephone connection to a LAN, such that the network connector 101 acts as a modem or router. The wireless connection may be WIFI, WiMAX, CDMA, GSM, GPRS, wireless local loop, or WAN. For low range and low power wireless communication, bluetooth may be used.
A motion sensor 104 is connected to the processor 100 to detect motion of the display device. The motion sensor 104 may include any conventional motion sensor, such as an accelerometer. The motion sensor 104 is capable of detecting motion of the display device in any direction, i.e., it is a multi-axis motion sensor to detect motion along any one of three orthogonal axes in three dimensions.
In any of the examples above, the display device may have display screens on both sides so that the display device can be flipped to view information on both sides. The erase operation may be applied to both sides or only one side. In one example, this may be selectively set. The display or displays may also be removable from the mounting frame.
In one or more embodiments, the display device may include a docking portion or mount to which the display screen is detachably or detachably mounted so that the display screen may be used separately from the mount. The mount and display screen may communicate between each other using a wireless link, such that the mount may contain some components of the display device, such as a processor and memory, while the display screen may contain only those components necessary to operate the display screen, detect movement of the display screen, and communicate with the processor. In one embodiment, more than one display screen may be provided that is detachable from the mount, with each display screen operating independently to provide an erase operation through motion detection using a shared processor in the mount.
The display device may include one or more speakers for audio output and one or more microphones for audio input. Further, the display device may be connected to peripheral devices such as a keyboard and/or pointing device through a wired or wireless connection to allow information and commands to be input to the display device.
In any of the above examples, the display device may include other input means, such as a keyboard, a pointing device (e.g., a mouse), or a touch screen, to enable a user to input control and information in conjunction with a motion detection control input method. The input device may also be used to perform conventional erasing operations to supplement the motion erasing capabilities of the display device, such as keyboard deletion, text selection and display deletion operations, and the like. Further, a camera may be provided to allow image capture, enabling gesture input as a method of control or information input.
In embodiments, in addition to or instead of motion control input, a camera may be provided in the device to capture video in a direction facing the user, such that the user may use gestures to control the erasure of information displayed on the display screen according to the type of gesture recognized. Gesture control may include identifying motion of a body part of the user (i.e., a hand, facial feature, or overall body position), or identifying an object that the user is moving, such as a wand, ruler, or something the user is wearing. Pattern recognition techniques may be used to recognize the types of gestures and identify them. Example gesture types may include a left or right hand flick (sweep), or an up or down hand swipe.
Where gesture control is provided in conjunction with motion control, for example where a user cannot pick up the display device, for example where their hands are wet or dirty, the gesture may be used to control the erase operation. Further, the display screen may be controlled to respond to the detected gesture type and identify a comparable or associated motion type that controls the same erase operation and control the display screen such that the display screen mimics the motion equivalent of the gesture command. For example, if the motion command to wipe text in the display area is a left-to-right rotation, when an equivalent or associated gesture command is recognized, such as waving a hand from left to right, the display may rotate the display from left to right to return confirmation to the user that the gesture command has been recognized as a motion command.
In one aspect, the present invention provides gesture control rather than motion control. In this aspect, the display device may: comprises a display screen for displaying information; a memory for storing information for display on a display screen; a gesture detection device (e.g., a camera and recognition software) for detecting gestures; and a processor programmed to control display of information on the display screen and, in response to a gesture detected by the gesture detection device, to control the display screen to erase at least a portion of the information displayed on the display screen, wherein the gesture detection device is configured to sense a plurality of gesture types and the processor is programmed to identify the sensed gesture types and to selectively erase the information displayed on the display screen in accordance with the identified gesture types. Thus, in this aspect, gesture recognition operates in the same manner as motion detection, and thus, in the motion detection example described above, in this aspect, motion may be replaced by gestures.
In this aspect, the display device may be mobile or fixed/attached. A camera may be provided in the device to capture video in a direction facing the user so that the user may use the gesture to control the erasure of information displayed on the display screen according to the type of gesture recognized. Gesture control may include recognizing movement of a body part of the user (i.e., a hand, facial features, or entire body position). Pattern recognition techniques may be used to recognize the types of gestures and identify them. Example gesture types may include a left or right hand flick, or an up or down hand flick, or a hand swipe.
It will be readily understood by those skilled in the art that various other changes in the details, materials, and arrangements of the parts and method stages which have been described and illustrated in order to explain the nature of this subject matter may be made without departing from the principles and scope of the subject matter as expressed in the subjoined claims.
Claims (34)
1. A display device, comprising:
a display screen for displaying information in a plurality of different areas;
a memory for storing information for display on different areas of the display screen;
motion detection means for detecting a motion of the display device; and
a processor programmed to control display of the information on the display screen in the different regions and, in response to motion detected by the motion detection device, to control the display screen to erase at least a portion of the information displayed on the display screen, wherein the motion detection device is configured to detect a plurality of types of motion and the processor is programmed to identify the type of motion detected and to selectively erase information displayed on the display screen in different regions according to the identified type of motion.
2. A display device according to claim 1, wherein the processor is programmed to selectively erase at least a portion of the information displayed on the display screen in different regions in response to a shaking or reciprocating motion detected by the motion detection means that is greater than a threshold value.
3. The display device of claim 1 or 2, wherein the processor is programmed to delete erased display information in the memory.
4. A display device according to any of the preceding claims, wherein the motion detection means is configured to detect a plurality of motion patterns in a plurality of directions, and the processor is programmed to identify a detected motion pattern and to selectively erase information displayed on the display screen in different regions according to the identified pattern.
5. A display device, comprising:
a display screen for displaying a plurality of types of information;
a memory for storing information for display on the display screen;
motion detection means for detecting a motion of the display device; and
a processor programmed to control display of the information on the display screen to display the different information types and to control the display screen to erase at least a portion of the information displayed on the display screen in response to motion detected by the motion detection device, wherein the motion detection device is configured to detect a plurality of motion types and the processor is programmed to identify a detected motion type and to selectively erase the information type displayed on the display screen in accordance with the identified motion type.
6. A display device according to claim 5, wherein the processor is programmed to selectively erase the type of information displayed in response to a shaking or reciprocating motion greater than a threshold value detected by the motion detection means.
7. The display device of claim 5 or 6, wherein the processor is programmed to delete erased display information in the memory.
8. A display device according to any of claims 5 to 7, wherein the motion detection means is configured to detect a plurality of motion patterns in a plurality of directions, and the processor is programmed to identify a detected motion pattern and to selectively erase the type of information displayed in dependence on the identified pattern.
9. A display device according to any of the preceding claims, comprising input means for inputting information for display.
10. The display apparatus of claim 9, wherein the input device comprises a pen device and the display screen is touch sensitive to information input.
11. A display device, comprising:
a display screen for displaying information;
a memory for storing motion type erase data including an identification of a motion type and a corresponding erase operation, and information for display on the display screen;
motion detection means for detecting a motion of the display device;
a user input device for receiving a user input identifying an erase operation during a learning phase; and
a processor programmed to, in the learning phase, when a user input identifying a control operation is received, identify a type of motion from the motion detected by the motion detection device and store the received user input in the motion type erasure data in correspondence with data identifying the type of motion, and after the learning phase, when the motion detection device detects motion, identify a type of motion using the motion type erasure data and perform a corresponding erasure operation to erase at least a portion of the information displayed on the display screen.
12. A display device according to claim 11, wherein the processor is programmed to identify the type of movement by averaging the detected movement received from the movement detection means a plurality of times when receiving user input identifying a control operation in the learning phase, and to store the received user input in the movement type erasure data in correspondence with the data identifying the type of movement.
13. A display device according to claim 11 or 12, wherein the processor is programmed to, in the learning phase, receive a plurality of user inputs and identify the type of motion from the motion detected by the motion detection means for each user input, and store the received user inputs in the motion type erasure data in correspondence with the data identifying the type of motion.
14. The display device of any of claims 11-13, wherein the processor is programmed to identify a plurality of motion types comprising a combination of motions in a plurality of directions.
15. The display device of claim 14, wherein the plurality of directions comprise at least one of a landscape and/or a rotational direction.
16. The display device according to any one of claims 11 to 15, wherein the information is displayed in a plurality of areas, and the erasing operations for different types of motion identify erasing operations for different areas.
17. The display device according to any one of claims 11 to 15, wherein the displayed information includes a plurality of different types of information, and the erasing operations for the different types of motions identify an erasing operation for the different types of information.
18. A method of controlling a display device having a display screen and motion detector means for detecting motion, the method comprising:
displaying information in a plurality of different regions on the display screen;
detecting a plurality of types of motion of the display device; and
selectively erasing information displayed in different areas on the display screen according to the type of motion detected.
19. The method of claim 18, wherein at least a portion of the information displayed on the display screen in different regions is selectively erased in response to a shaking or reciprocating motion greater than a threshold value detected by the motion detection device.
20. The method of claim 18 or 19, wherein the information is stored in a memory, including deleting erased display information in the memory.
21. A method according to any of claims 18 to 20, wherein a plurality of movement patterns in a plurality of directions are detected, and information displayed in different regions on the display screen is selectively erased in dependence on the detected patterns.
22. A method of controlling a display device having a display screen and motion detector means for detecting motion, the method comprising:
displaying information of a plurality of different information types on the display screen;
detecting a plurality of types of motion of the display device; and
selectively erasing the type of information displayed on the display screen according to the type of motion detected.
23. The method of claim 22, wherein at least a portion of the type of information displayed on the display screen is selectively erased in response to a shaking or reciprocating motion greater than a threshold value detected by the motion detection device.
24. The method of claim 22 or 23, wherein the information is stored in the memory, including deleting erased display information in the memory.
25. A method according to any one of claims 22 to 24, wherein a plurality of movement patterns in a plurality of directions are detected, and the type of information displayed on the display screen is selectively erased in dependence on the detected patterns.
26. A method according to any of claims 22 to 25, comprising receiving input of information for display.
27. The method of claim 26, wherein the information is input by a pen device and the display screen is touch sensitive to information input.
28. A method of controlling a display apparatus having a motion detector device for detecting motion of the device, the method comprising:
in the learning phase:
receiving a user input identifying an erase operation;
detecting motion of the display device using the motion detector means;
identifying a type of motion from the motion detected by the motion detection device;
storing the received user input as motion type erasure data in correspondence with the data identifying the motion type;
and repeating the receiving, detecting, identifying and storing steps; and
in the operation stage:
displaying information on a display screen;
detecting motion of the display device using the motion detector means; and
the motion type control data is used to identify a motion type and a corresponding erase operation is performed to erase at least a portion of the information displayed on the display screen.
29. The method of claim 28, wherein in the learning phase, when a user input identifying an erase operation is received, the type of motion is identified by averaging the detected motion received from the motion detection device a plurality of times, and the received user input is stored in the motion type erase data in correspondence with data identifying the type of motion.
30. The method of claim 28 or 29, wherein the type of motion comprises a combination of motions in multiple directions.
31. The method of claim 30, wherein the plurality of directions comprises at least one of a lateral direction and/or a rotational direction.
32. The method of any of claims 29 to 31, wherein the information is displayed in a plurality of areas and erase operations for different motion types identify erase operations for different areas.
33. The method of any of claims 9 to 12, wherein the displayed information comprises a plurality of different types of information, and the erase operations for different motion types identify erase operations for different types of information.
34. A carrier medium carrying processor implementable code for execution by a processor to carry out the method of any of claims 18 to 33.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| GB1805278.7 | 2018-03-29 | ||
| GB1805278.7A GB2572437A (en) | 2018-03-29 | 2018-03-29 | Display apparatus |
| PCT/GB2019/050931 WO2019186201A1 (en) | 2018-03-29 | 2019-03-29 | Display apparatus |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112041792A true CN112041792A (en) | 2020-12-04 |
Family
ID=62142353
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201980029053.7A Pending CN112041792A (en) | 2018-03-29 | 2019-03-29 | Display device |
Country Status (7)
| Country | Link |
|---|---|
| EP (1) | EP3776150A1 (en) |
| JP (1) | JP7379364B2 (en) |
| KR (1) | KR20210002509A (en) |
| CN (1) | CN112041792A (en) |
| GB (1) | GB2572437A (en) |
| SG (1) | SG11202009633PA (en) |
| WO (1) | WO2019186201A1 (en) |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110053641A1 (en) * | 2008-11-10 | 2011-03-03 | Samsung Electronics Co., Ltd. | Motion input device for portable terminal and operation method using the same |
| WO2012078654A1 (en) * | 2010-12-07 | 2012-06-14 | Google Inc. | Editing based on force-based physical cues |
| CN102681667A (en) * | 2012-04-24 | 2012-09-19 | 华为终端有限公司 | Text input backspacing method and terminal |
| CN102681695A (en) * | 2012-04-25 | 2012-09-19 | 北京三星通信技术研究有限公司 | Cursor control method and device |
| CN104350459A (en) * | 2012-03-30 | 2015-02-11 | 诺基亚公司 | User interfaces, associated apparatus and methods |
| JP2015114700A (en) * | 2013-12-09 | 2015-06-22 | 株式会社Ｎｔｔドコモ | Object display device |
| CN105183325A (en) * | 2015-10-27 | 2015-12-23 | 上海斐讯数据通信技术有限公司 | User-defined input method and system |
| US20160291864A1 (en) * | 2010-11-12 | 2016-10-06 | Blackberry Limited | Method of interacting with a portable electronic device |
| CN106104424A (en) * | 2014-03-15 | 2016-11-09 | 微软技术许可有限责任公司 | Trainable sensor-based gesture recognition |
| CN106850956A (en) * | 2016-12-21 | 2017-06-13 | 珠海市魅族科技有限公司 | Information deletion method and device |
| JP2017134632A (en) * | 2016-01-28 | 2017-08-03 | カシオ計算機株式会社 | Display device, display control method and program |
Family Cites Families (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4853302B2 (en) * | 2007-01-19 | 2012-01-11 | 日本電気株式会社 | Command input device for portable terminal and command input method for portable terminal |
| WO2009105821A1 (en) * | 2008-02-29 | 2009-09-03 | Hamish Mclennan | A method and system responsive to intentional movement of a device |
| KR101457116B1 (en) * | 2011-11-07 | 2014-11-04 | 삼성전자주식회사 | Electronic apparatus and Method for controlling electronic apparatus using voice recognition and motion recognition |
| CN107122106A (en) * | 2017-04-25 | 2017-09-01 | 北京洋浦伟业科技发展有限公司 | The delet method and device of a kind of usage record |
-
2018
- 2018-03-29 GB GB1805278.7A patent/GB2572437A/en not_active Withdrawn
-
2019
- 2019-03-29 JP JP2020552779A patent/JP7379364B2/en active Active
- 2019-03-29 EP EP19717550.8A patent/EP3776150A1/en not_active Withdrawn
- 2019-03-29 WO PCT/GB2019/050931 patent/WO2019186201A1/en active Application Filing
- 2019-03-29 SG SG11202009633PA patent/SG11202009633PA/en unknown
- 2019-03-29 KR KR1020207031286A patent/KR20210002509A/en unknown
- 2019-03-29 CN CN201980029053.7A patent/CN112041792A/en active Pending
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20110053641A1 (en) * | 2008-11-10 | 2011-03-03 | Samsung Electronics Co., Ltd. | Motion input device for portable terminal and operation method using the same |
| US20160291864A1 (en) * | 2010-11-12 | 2016-10-06 | Blackberry Limited | Method of interacting with a portable electronic device |
| WO2012078654A1 (en) * | 2010-12-07 | 2012-06-14 | Google Inc. | Editing based on force-based physical cues |
| CN104350459A (en) * | 2012-03-30 | 2015-02-11 | 诺基亚公司 | User interfaces, associated apparatus and methods |
| CN102681667A (en) * | 2012-04-24 | 2012-09-19 | 华为终端有限公司 | Text input backspacing method and terminal |
| CN102681695A (en) * | 2012-04-25 | 2012-09-19 | 北京三星通信技术研究有限公司 | Cursor control method and device |
| JP2015114700A (en) * | 2013-12-09 | 2015-06-22 | 株式会社Ｎｔｔドコモ | Object display device |
| CN106104424A (en) * | 2014-03-15 | 2016-11-09 | 微软技术许可有限责任公司 | Trainable sensor-based gesture recognition |
| CN105183325A (en) * | 2015-10-27 | 2015-12-23 | 上海斐讯数据通信技术有限公司 | User-defined input method and system |
| JP2017134632A (en) * | 2016-01-28 | 2017-08-03 | カシオ計算機株式会社 | Display device, display control method and program |
| CN106850956A (en) * | 2016-12-21 | 2017-06-13 | 珠海市魅族科技有限公司 | Information deletion method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2021519975A (en) | 2021-08-12 |
| SG11202009633PA (en) | 2020-10-29 |
| GB201805278D0 (en) | 2018-05-16 |
| JP7379364B2 (en) | 2023-11-14 |
| GB2572437A (en) | 2019-10-02 |
| EP3776150A1 (en) | 2021-02-17 |
| KR20210002509A (en) | 2021-01-08 |
| WO2019186201A1 (en) | 2019-10-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20230319565A1 (en) | Method of wearable device displaying icons, and wearable device for performing the same | |
| AU2014219558B2 (en) | Method for controlling display of multiple objects depending on input related to operation of mobile terminal, and mobile terminal therefor | |
| EP2811420A2 (en) | Method for quickly executing application on lock screen in mobile device, and mobile device therefor | |
| CN104011639B (en) | Method, equipment and graphic user interface for providing visual effect on touch-screen display | |
| US9842571B2 (en) | Context awareness-based screen scroll method, machine-readable storage medium and terminal therefor | |
| US20130031507A1 (en) | Systems and methods for scrolling a document by providing visual feedback of a transition between portions of the document | |
| EP2743846A2 (en) | Information search method and device and computer readable recording medium thereof | |
| US10949668B2 (en) | Electronic apparatus and method for controlling thereof | |
| CN104246683A (en) | Object control method performed in device including transparent display, the device, and computer readable recording medium thereof | |
| CN103119546A (en) | Transitional view on a portable electronic device | |
| US20120139827A1 (en) | Method and apparatus for interacting with projected displays using shadows | |
| CN103765367A (en) | Information processing apparatus, information processing method, and program | |
| KR102186103B1 (en) | Context awareness based screen scroll method, machine-readable storage medium and terminal | |
| CN112041792A (en) | Display device | |
| CN112041804A (en) | Device operation control | |
| US8629846B2 (en) | Information processing apparatus and information processing method | |
| KR102138233B1 (en) | Display control apparatus and method for controlling the same | |
| JP5640165B2 (en) | User operation control program, portable device, and user operation control method | |
| KR101541639B1 (en) | Electronic device and method for controlling electronic device | |
| JP5738465B2 (en) | User operation control program, portable device, and user operation control method | |
| JP5873945B2 (en) | User operation control program, portable device, and user operation control method | |
| JP2014119994A (en) | Information processing terminal, control method for information processing terminal, and program | |
| JP2014149851A (en) | User operation control program, mobile device, and user operation control method | |
| KR20120051340A (en) | Text input method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: DE Ref document number: 40042776 Country of ref document: HK |