CN116438509A

CN116438509A - Novel composite computer keyboard

Info

Publication number: CN116438509A
Application number: CN202180038726.2A
Authority: CN
Inventors: 高秋生
Original assignee: Individual
Current assignee: Individual
Priority date: 2020-05-25
Filing date: 2021-05-23
Publication date: 2023-07-14
Also published as: WO2021242651A3; WO2021242651A2

Abstract

The invention adds a touch screen to the physical keyboard of the personal computer or the notebook computer as additional handwriting input. The new keyboard with small-sized touch screen provides a convenient way for handwriting notes, drawing or painting, and converting handwritten characters into formal characters. The new keyboard with large-size touch screen can work together with the personal computer/notebook computer as the personal computer/notebook computer, and has the advantage of inputting from the touch screen compared with the traditional personal computer/notebook computer. The new keyboard with the large-size touch screen can work together with a personal computer/notebook computer as a tablet computer, and has the advantages of being input from a physical key and a mouse compared with a common tablet computer. The novel keyboard with the large-size touch screen can work together with a personal computer/notebook computer as the personal computer/notebook computer and a tablet computer at the same time, and has the input advantages compared with the traditional personal computer/notebook computer and a common tablet computer. An optional fingerprint sensor may provide a fingerprint for account login, signing documents, and authentication security applications.

Description

Novel composite computer keyboard

Cross-reference to related application

I claim the benefit of the following provisional patent application filed in the united states patent and trademark office: application number 63/029,653,

application date

2020, 5, 25; application number 63/029,566, application date 2020, 5 month 25. Both applications are currently pending, i hereby claim to be incorporated by reference in this application.

Technical points

The present invention relates generally to improving the input functionality of existing computer keyboards for personal computers, pen-based notebooks and tablet computers. With existing keyboards, people use single key or combination keys for character-by-character input. The new keyboard has a touch screen added so that people can use handwriting input. The newly added touch screen supports a digital pen, a finger, or both as an input tool. One option for the new keyboard is to add a fingerprint sensor for security applications, such as user login.

The newly added touch screen can work in three modes. In the first mode, the touch screen records what is written on the screen, which corresponds to writing notes or drawing a drawing on paper. In the second mode, the touch screen is used as a software keyboard to convert handwritten characters to standard characters. This functionality is very useful for non-english languages. In a third mode, the touch screen is implemented by software as a screen keyboard.

When the new keyboard has a touch screen, the file contents can be displayed on the normal screen. In this case, a small-sized touch screen is sufficient, but the user needs to determine the input position using a mouse and select such input as fonts through application software. For writing work such as drawing, rubbing and labeling, it is more convenient to write or draw directly on a document displayed on the touch screen. In this case, a large-sized touch screen is required, and the touch screen works like a tablet computer, so that the work efficiency of more handwriting is higher.

Background information

Current touch screen technology has evolved to the point where handwriting input can be recorded very accurately. Newly developed techniques can convert handwritten characters to standard characters. These new technologies can help people enter content into a computer using handwriting instead of keys.

For regular english text, people hit the physical key input content with two hands while watching files displayed on a notebook or personal computer screen, which is more comfortable and efficient. For non-English languages, the handwritten characters are converted into standard characters by using software, so that convenience and high efficiency are realized. For handwriting or drawing, the arm is horizontally placed on the table, and handwriting is performed on the horizontally placed touch screen, so that the handwriting is more efficient; but looking down for a long time at the files displayed on the touch screen that is laid flat on the table is uncomfortable. The invention combines the advantages of conventional computers/notebooks and tablet computers through a variety of input methods.

Fingerprint technology has also evolved to a mature stage, with fingerprints providing a more secure and convenient method for security applications than signing and cryptography.

With new semiconductor technology, computer chips are becoming cheaper and smaller. A computer can run multiple applications quickly at the same time. The new keyboard can be used as a personal computer/notebook and tablet computer simultaneously by an improved input method. The user can make and store the content commonly used in files such as fingerprints and icons in advance, and then can output the prefabricated content by pressing several buttons very efficiently.

Summary of the invention

1. The invention aims to combine the advantages of the existing physical key and touch screen input. A virtual digital pen, a rubber-like, and a rectangular box for selecting content implemented in software are the main tools for inputting and editing on a touch screen. An alternative fingerprint sensor provides a more secure and convenient method for security applications.

2. The application supporting the new keyboard should be an image file. The user may input content to any location of the software interface. Regardless of whether the input is from a physical key or handwriting or drawing a line, the cursor position when clicking the mouse is the starting position for the new input. The last known cursor position will correspond to the origin of coordinates of the touch screen.

3. According to the present invention, a small-sized touch screen can be operated in three modes. The file content is displayed on a conventional display screen, and the user needs to determine the position, the color, the thickness of the line, the font type and the like on the application software by using a mouse, and can input by using a conventional physical key or an on-screen software key.

3.1 the first Mode of operation, called note Mode or N-Mode, the touch screen records what is written on the screen. In order to facilitate all operations of writing, erasing and the like, a digital pen with a pen icon is realized by software, and a user needs to click on the digital pen icon by a physical digital pen or a finger before writing. The touch screen can record each click until the touch pressure is released, and convert the continuous movement of the physical digital pen or finger between two points into a straight line or curve. The user may write or draw lines where the content has been displayed, where the overlap will overwrite the previously entered data. When the user presses the clear key, the mouse is clicked on the application software, or the program currently running on the normal screen (9) or (10) is switched to the other application software, the touch screen driver releases the memory which is not shared with the other application software, and the content displayed on the touch screen (4) is cleared. Each successive straight line or curve will consist of a set of coordinate points (X, Y). Each time an input, a single point or a continuous straight line or curve will be converted into a coordinate point or set of coordinate points. The data will be stored in xml or html or other tagged formats, examples of tags, points and lines. This function is similar to writing notes or drawing a graphic. The following are samples in data format.

<input>

</input>

3.2 for the first mode, the coordinates of the point or line are relative to the origin at the top left of the user interface with the digital pen and rubber icon. When the user clicks on an icon of the digital pen, he can write or draw his hand on the touch screen. The touch screen driver software sends the converted data to the application software and the same or another independent information queue that the touch screen driver for display can read. The display on the touch screen should precede the display on the application software. Content entered on the touch screen is displayed on the application software with the origin being a flickering cursor corresponding to the touch screen's origin of coordinates.

3.3 for the first mode, if the user writes wrong, he can wipe off part of the content displayed on the screen. A software eraser is implemented as a small-sized square by software. The user clicks the eraser icon using a digital pen or finger, whether clicking or continuously moving, the area wiped off is the area of the eraser, and the center is the strike point. The erased content is displayed as blank. The erased size and position data are sent to an information queue, the application software clears the display size which is the same as the touch area of the eraser, and the application software flashes the cursor to correspond to the origin of coordinates of the touch screen and updates the data.

3.4 for the first mode, a content selection tool with rectangular icons is implemented in software as a rectangle of adjustable size. After clicking the rectangular icon, the user draws a diagonal line of the rectangle, and a digital pen or a finger can be used for editing the content in the rectangular area. The area of the rectangle is determined by the starting point at the upper left side, the touch release point at the lower right side, and four sides of the rectangle after the touch point is released are displayed. If the user wants to edit the content displayed on the touch screen, he can select the edit area and then move the display position using a digital pen or a finger, or adjust the display size by pinching the finger. If the user wants to edit the content that has been entered, he should first press a soft edit key and then a new user interface with a digital pen, an eraser and rectangular box icons is displayed on the touch screen. The user first needs to click the software user interface with the mouse, then click the rectangular icon on the touch screen and draw the diagonal of the rectangle, and the size of the rectangle is determined by the touch starting and releasing points on the upper left side and the lower right side. The area of the editing area is the same as that of the rectangle, and the position of the editing area is determined by a cursor displayed on a normal screen, wherein the cursor corresponds to the origin of coordinates of the touch screen. Four sides of the rectangle are displayed on the application software and touch screen. The position of the display can be adjusted by moving a digital pen or a finger, or the position of the display content can be adjusted more accurately by moving up, down, left and right keys with software. The display scale can be adjusted by finger pinching and Shu Fang, or more precisely by software up-scaling and down-scaling the arrows. Fig. 9 shows a user interface, but the user interface is not limited to fig. 9. The user can also click on the digital pen icon and then input new content, or click on the eraser icon and then remove some content by moving the eraser with a digital pen or a finger. If the selected content is moved to a new location, the originally displayed content is replaced with the new content. Each time an operation is completed, such as moving content, clicking an adjustment key, etc., the touch screen driver sends the converted data to the application software, and after the application software updates the data, the updated data is sent back to the touch screen driver for display. For the displayed content, the application software and the touch screen driver share the memory more efficiently. After the user finishes editing, clicking a finish button, returning the user interface to the input interface, and displaying the adjusted content of the application software on a conventional screen. During editing, if there is a click on a mouse on the application, the touch screen driver returns to the previous user interface.

3.5 second mode, the touch screen may convert handwritten or hand-drawn content into regular text. This Mode is called the conversion Mode or C-Mode. The touch screen driver converts touch or movement into target content, such as a list of Chinese characters or words, and displays the target content on the touch screen in real time; the user clicks on the target to select the correct content. The data will be stored as unicode. This functionality is very useful for non-english languages.

3.6 third mode, the touch screen may provide pre-made content or on-screen keyboards through a suitable user interface; the user may also make content, such as a fingerprint or an icon, in this mode. This Mode is called the pre-made Mode or B-Mode.

3.7 three modes are switched by a software button. The software button is initially in a note Mode or N-Mode, and the N-Mode is displayed on the button; clicking the button will switch to a conversion Mode or C-Mode, which is displayed on the button; clicking the button will switch to B-Mode, which is displayed on the button; clicking the button again will return to the note Mode or N-Mode.

4. The content entered on the touch screen may be a single character, one or more lines of characters, a curve or a graph, and so forth. If the touch screen display is full, the user touches the clear button to clear the display content, the part of the touch screen driver used for displaying is cleared to the temporary memory, and if the touch screen driver and application software share data, the memory address is updated.

5. The edit, clear, and complete buttons described above may be implemented in software or hardware, and are intended to be implemented using software. Software buttons are used in the files of the present invention.

6. For drawing, erasing, or marking writing with different colors, it is more convenient to display the application software directly on the touch screen, and the user can write with a digital pen or finger, draw a picture, determine a position, select a color, thickness of a line, character type, and the like. In this case, a large-sized touch screen is required to display the contents of the application software.

7. The large-sized touch screen operates in three modes, a personal computer/notebook mode, a tablet mode, and a personal and tablet common mode. The operating system should provide APIs for the application software so that the application software can use the touch screen as a user interface for on-screen display of the touch screen, make digital pens, erasers, edit content selection boxes, etc. on the application software and its user interface.

7.1 first mode of operation, the large-sized touch screen and the personal computer/notebook supporting the new keyboard operate as a personal computer/notebook. In the personal computer/notebook mode, the application software is turned on a conventional screen, and the application software can use the system API to generate a screen-displayed touch screen that has similar functionality as a small-sized screen, but that is larger in size to be displayed on a large-sized touch screen.

7.2 second mode of operation, large-sized touch screens and personal/notebook computers supporting new keyboards work as tablet computers. In this mode of operation, all file icons displayed on the regular screen are also displayed on the touch screen. Touching these icons will launch the application software and be displayed on the touch screen. The user can write, erase and edit directly on the application software using the digital pen, eraser, content selection rectangular box, etc. displayed on the application software as described above. The application software may also use the functionality of a small-sized screen displayed by a touch screen provided by the system. In tablet mode, the user may also enter through the physical keyboard, the keyboard displayed on the screen, and the mouse.

7.3 when two different application software are started on the conventional screen and the large-size touch screen at the same time, the application software started on the conventional screen can take the touch screen, the physical key and the mouse displayed on the screen as input equipment; application software launched on the touch screen may be entered through a physical key, a mouse, or directly from the touch screen.

7.4 third mode of operation, an application is started on the regular screen, and at the same time the application is started on the large-sized touch screen, and the application started on the regular screen works in the personal computer/notebook mode described in 6.1; application software started on the large-size touch screen works in the tablet computer mode described in 6.2. The best user experience is provided by physical keys and a mouse for file input displayed on a conventional screen, and by handwriting on a touch screen for file input displayed on the touch screen. The operating system needs to coordinate the input and output of the application software displayed on the two screens, and the input data needs to be displayed on the two screens simultaneously before the next input. Application software needs to support new input technologies.

8. The touch screen may be designed as a pull-on member attached to the bottom of the keyboard so that the user can more conveniently carry the keyboard and write. When the touch screen is pulled out from the bottom of the keyboard, a power switch is triggered to provide power for the touch screen; when the touch screen is plugged back to the bottom of the keyboard, the power switch is triggered to cut off the power supply. There are many ways to design a trigger power switch and the invention does not go further into the details of the trigger switch.

9. An alternative fingerprint sensor may provide a more secure and convenient method for security applications in accordance with the present invention.

10. According to the present invention, input and output, GPU, operating system, application software, etc. need to be modified to support the new keyboard.

Drawings

Figure 1 provides a top view from above of a new keyboard lying flat on a table with a small touch screen placed on the bottom right of the keyboard.

Figure 2 provides a top view from above of a new keyboard lying flat on a table with a large touch screen positioned on the right portion of the keyboard.

Figure 3 provides a top view from above of a new keyboard lying flat on a table with a large sized touch screen that can be pulled out to the right of the keyboard.

FIG. 4 provides a three-dimensional view of a notebook computer with a new keyboard, a mouse and a digital pen placed on the sides of the notebook computer.

Fig. 5 provides a three-dimensional view of a personal computer having a new keyboard and a conventional display screen, with a mouse and a digital pen placed on the sides of the keyboard, the new keyboard and computer being connected by a cable, or by a wireless connection. In order to make the new keyboard compatible with the conventional personal computer, the parts of the physical keyboard and the mouse pad are not changed, and the personal computer, the keyboard and the mouse are connected by separate cables.

Fig. 6 provides mode switching of the note mode, the conversion mode, and the pre-made mode of the small-sized keypad.

FIG. 7 provides an initial user interface for a small-sized keyboard, with lines with size scales controlling the extent of writing and drawing that a user can write or draw with a digital pen or finger within a rectangular box. Touching the N-Mode button, the user interface is switched to a switching Mode shown in FIG. 8 or a C-Mode interface, and touching the edit button can select the edit range on the application software; and the touch of the cleaning button can clean the buffer memory and display of the touch screen.

FIG. 8 provides a user interface for a small-sized keyboard in a conversion Mode or C-Mode, with lines controlling the rectangular extent of writing or drawing. Touching the lang button, a list of languages is displayed on the touch screen, and the user can select a desired one of the languages by touching. The user can write on the touch screen, the written content is immediately displayed on the touch screen, and the driver software converts the written content into possible text and displays the text above the screen. The user can select the text by touching or delete the text with a virtual eraser. Pressing the clear button clears the content displayed on the touch screen and pressing the C-Mode button will switch to B-Mode.

FIG. 9 provides a user interface for a small-sized keyboard to edit application software content in a note Mode or N-Mode. The user may draw a diagonal line with a digital pen or finger to decide the top left and bottom right corners of the rectangle for the selected content. The position of the selected content corresponds to the origin coordinates of the touch screen through the cursor coordinates. The content selected on the application software is also displayed on the touch screen, and the software keys can move the display content up, down, left and right. The size of the display can be adjusted by a scale that changes the value with software up and down arrows. After the icon of the virtual digital pen or the eraser is pressed by the finger or the digital pen, the content in the selection frame can be added or deleted.

FIG. 10 provides a user interface for a small size keyboard in a pre-made Mode or B-Mode. Pressing a sign button, and displaying a list of signatures on a touch screen; the signature required for the re-touch is output to the application file. Pressing a finger button, and displaying a column of fingerprints on a touch screen; the fingerprint required for re-touch is output to the application file. Pressing an icon button, and displaying a list of icons on a touch screen; the icon required for re-pressing is output to the application file. Pressing the build button, the user interface switches to one of those listed in fig. 11, 12, or 13, depending on the option selected.

FIG. 11 provides a user interface for a small-sized keyboard when signature is made, and the touch screen displays a plurality of options after the user presses the build button in the interface shown in FIG. 10. After the user selects the signature item, the touch screen displays the interface shown in fig. 11. The user signs on the touch screen by using a digital pen (13), then presses a save button to save the signature, or presses a clear key to clear the buffer memory and then re-signs. When the user presses the signature button, the touch screen displays a list of signatures, presses one of the signatures, presses the delete button, and deletes the stored signature. Pressing the B-Mode button switches the user interface to the interface shown in fig. 10.

FIG. 12 provides a user interface for a small-sized keyboard when fingerprinted, and after a user touches the build button in the interface shown in FIG. 10, the touch screen displays a plurality of options. After the user selects the fingerprint item, the touch screen displays the interface shown in fig. 12, on which text prompting the user to place the thumb on the fingerprint sensor is displayed. The user puts the thumb of the right hand on the fingerprint sensor, and after a moment, the touch screen displays the fingerprint and the characters which are ready, and the user presses a save button to save the fingerprint or presses a clear key to clear the buffer memory and then remaps the fingerprint. When the user presses the finger button, the touch screen displays a list of fingerprints, presses one of the fingerprints, presses the delete button, and deletes the stored fingerprint. Pressing the B-Mode button switches the user interface to the interface shown in fig. 10.

FIG. 13 provides a portion of the user interface of the small-sized keyboard when making icons, and the touch screen displays a plurality of options after the user presses the build button in the interface shown in FIG. 10. The display should also display a number of options such as color, line thickness, etc., which will not be further described in the present invention. After the user selects the icon option, the touch screen displays the interface shown in fig. 13, and the user draws an icon on the touch screen by using a digital pen (13), then presses a save button to save the icon, or presses a clear key to clear the buffer memory and then remaps the icon. When the user presses the icon button, the touch screen displays a list of icons, presses one of the icons, presses the delete button, and deletes the stored icon. Pressing the B-Mode button switches the user interface to the interface shown in fig. 10.

The following is a detailed description of the main components of the new keyboard.

1. A new keyboard has physical keys, a mouse pad, a small-sized or pullable touch screen, and an optional fingerprint sensor.

2. The physical key, like the key on a conventional keyboard, is shown only as a few keys. Conventional keyboards have an area that is a duplicate key and when a large-sized touch screen is placed on the right side of the new keyboard, the new keyboard tends to remove the duplicate key.

3. A mouse pad is not different from a conventional keyboard.

4. A small-sized touch screen is placed on the right bottom side of the new keyboard and can be mounted in other parts of the keyboard.

5. An optional fingerprint sensor.

6. And a large-sized touch screen arranged on the right side of the keyboard. The file icons displayed on the conventional screen are also displayed on the touch screen. Touching the file icon will launch the application software and the user can use the touch screen, physical key and mouse to enter the application software launched on the touch screen.

7. A touch screen is displayed on a large-sized touch screen, and functions similarly to a small-sized touch screen. Regardless of whether the currently running application is a conventional screen or is launched on a touch screen, the user may use the touch screen displayed on the screen to provide input for the currently running application.

8. A large size touch screen that can be pulled, the touch screen being placed at the bottom of the keyboard. When the touch screen is pulled out, a power trigger switch is turned on to supply power to the touch screen; when the touch screen is plugged back, the power trigger switch is turned off, and power supply to the touch screen is cut off.

9. A conventional display screen on a notebook computer.

10. A physical mouse.

11. A notebook computer with a novel keyboard.

12. A conventional display screen on a personal computer.

13. A digital pen for a touch screen.

14. A personal computer supporting a new keyboard.

15. File icons displayed on a regular screen of a personal computer or a notebook computer are also displayed on a large-sized touch screen.

16. And a cable connecting the personal computer, the mouse and the keyboard. In order to make the new keyboard compatible with the traditional personal computer, the physical key, the mouse pad and other parts are not changed, and the touch screen is connected with the personal computer by another cable.

17. The lines with index graduations are used for the coordinate positions.

18. Areas for writing and drawing.

19. A software button with an N-Mode character on the surface indicates that the touch screen is at N-Mode. Pressing this button translates to C-Mode.

20. A software clear button, which is pressed, the touch screen driver software will clear the display. Under the user interfaces shown in fig. 11, 12, 13, pressing the clear button will delete the selected saved content.

21. A software button with a C-Mode character on the surface indicates that the touch screen is in the C-Mode or conversion Mode. Pressing this button translates to B-Mode.

22. An edit software button is pressed and the user interface switches to that shown in fig. 9 for editing content.

23. A language software button, which is pressed to switch between different languages.

24. A line indicating the coordinates of the writing area.

25. A software up button, touching which moves up selected content in the application software.

26. A software move down button, touching which moves down selected content in the application software.

27. A software move left button that is touched to move left the content selected in the application software.

28. A software right shift button, touching which shifts the content selected in the application software right.

29. A software done button, touching which ends the content editing, the touch screen driver software switches the user interface to that shown in fig. 7 for input.

30. One software adds an arrow, touching which will increase the display scale of the selected content in the application software.

31. One software reduces the arrow and touching the arrow will reduce the display scale of the selected content in the application software.

32. A value of the display scale, which is equal to the new display size of the selected content divided by the original display size.

33. A text box that controls the display size of the selected content on the application.

34. A software button with a B-Mode character on the surface indicates that the touch screen is in a production Mode. Pressing this button translates to N-Mode.

35. A software production button, pressing this button will display a list of options that can be produced, such as icons, signatures, etc. The touch signature option will switch to the user interface shown in fig. 11, the touch fingerprint option will switch to the user interface shown in fig. 12, and the touch icon option will switch to the user interface shown in fig. 13.

36. A software sign button, under the interface shown in fig. 10 and 11, is pressed to display a list of signatures. Under the interface shown in fig. 10, pressing the displayed signature will output the signature to the application software. Under the interface shown in fig. 11, pressing the displayed signature and then pressing the clear button will delete the saved signature.

37. A software fingerprint button, under the interface shown in figures 10 and 11, is pressed to display a list of fingerprints. Under the interface shown in fig. 10, a touch-and-press displayed fingerprint will output the fingerprint to the application software. Under the interface shown in fig. 11, pressing the displayed fingerprint and then pressing the clear button will delete the saved fingerprint.

38. A software icon button, under the interface shown in fig. 10 and 11, is pressed to display a list of icons. Under the interface shown in fig. 10, pressing the displayed icon will output the icon to the application software. Under the interface shown in fig. 11, pressing the displayed icon and then pressing the clear button will delete the saved icon.

39. A software save button, which is pressed to save the content displayed on the touch screen.

40. An icon of a software pen, after being pressed by a digital pen or finger, can be written or drawn on the touch screen by the user.

41. After pressing the icon with a digital pen or a finger, the user can press the application software with the eraser to delete the content of the eraser area, and the touch point is the center of the square. Conventional screens and touch screens also clear deleted content displays.

42. After a rectangular software icon is pressed by a digital pen or a finger, the user draws a diagonal line of the rectangle to determine the rectangle, the editing area on the application software is the same as the rectangle, and the coordinates of the cursor correspond to the origin of coordinates of the touch screen.

43. The origin of coordinates of the touch screen, which is the intersection of the two lines on the left and top of the touch screen.

44. A new keyboard with a large-sized touch screen.

Detailed Description

When a notebook computer (11) or a personal computer (14) is opened, a user can put the thumb of the right hand on the fingerprint sensor (5) to log in.

For the first mode of the small-sized screen (4), the best mode of operation is to input a lot of regular text and a small number of handwritten and pictorial notes. User a attempts to make an application that supports handwriting input similar to word or PDF. When the application is started, user a enters a few regular lines of text on the application with the physical key (2) and then he writes with a digital pen (13) or a finger on the user interface shown in fig. 7 displayed on the touch screen (4). He then draws several curves, the content of the input being displayed immediately on the above-mentioned touch screen (4) and on the application software of the conventional screen (9) or (12). After he touches the virtual rubber icon (41), some error contents still displayed on the touch screen (4) are erased, some erased contents are positioned in the middle of the touch screen, and after he touches the selection frame icon (42) with a finger, he selects the right displayed contents and drags the left. After the touch screen (4) displays almost full screen, the user presses the clear software icon (20), and the touch screen driver clears the content displayed on the touch screen (4). User a perceives that some content of the application software displayed on the regular screen (8) or (12) needs to be adjusted, he presses the software editing button (22), and the user interface switches to that shown in fig. 9. First, he presses the rectangular selection box icon (42) on top of the touch screen with a digital pen (13), and then he draws a diagonal line on the touch screen (4) that determines the size of the rectangle. The application software displayed on the regular screen (9) or (12) also selects a rectangle of the same size, the position of which depends on the cursor coordinates corresponding to the origin of the touch screen. After the content on the application software is selected, the selected content is also displayed on the touch screen (4). He can then more precisely adjust the display size of the selected content by finger pinching or pressing the software up arrow (30) or down arrow (31), or more precisely adjust the display position of the selected content by pulling or pressing the application software up key (25), down key (26), left key (27), right key (28). He can add new content after pressing the icon (40) of the pen with the digital pen (13) or the finger, and can delete the content by pressing the icon (41) of the eraser on the touch screen (4) with the digital pen (13) or the finger. After he has finished editing, he presses the finish button (29) and the user interface returns to that shown in fig. 7 for input. User a wants the handwriting to be blue, he moves the cursor with the mouse (10) to the color icon on top of the note application, selecting blue. He again handwriting, the displayed content being blue. Finally he completes the note and signs the document.

For the second mode of the small-sized screen (4), the best mode of operation is to input a file other than english. User B is a chinese person who wants to write a letter but does not want to input chinese characters with pinyin. First, he clicks the word icon (15) displayed on the regular screen (9) with the mouse (10) to start the word software, then he presses the software N-Mode (19) button, and the touch screen (4) displays a new user interface with the software buttons C-Mode and lang. User B touches the software lang button to select Chinese. He starts writing a chinese character with a digital pen (13), and the handwriting input is converted into a list of possible regular chinese characters and displayed on top of the touch screen (4). He touches the correct chinese word, which is sent to word software in unicode. The letter is also translated into english. After he finishes inputting Chinese characters, he inputs English parts by using the physical key (2). After he has completed all inputs, he needs a signature. He presses the software C-Mode button (19), which turns to the B-Mode button (34). He presses a signature button (36) and a list of saved signatures appears on the touch screen (4), he presses one of the signatures.

For the third mode of the small-sized screen (4), the best way to work is to input already made content, such as a fingerprint or signature. User C presses the N-Mode button (19) twice, which translates into the B-Mode button (34) of the user interface shown in FIG. 10. He touches the press button (35) presenting a list of choices, he selects the fingerprint choice, presenting a new user interface with the text "put your right thumb on the fingerprint sensor" as shown in fig. 12. He places his thumb on the fingerprint sensor (5) for a while, the fingerprint and the text "ready" appear on the touch screen (4), and touches the save button again to save the fingerprint and return to the previous user interface, and touches the clear button again to start fingerprint input. User C presses a make button (35) in the user interface shown in FIG. 10, a list of options appears, he selects an icon option, the touch screen (4) displays the new user interface shown in FIG. 12, there is a "enter from file" button, and the user can enter a picture file by pressing this button; after the picture is displayed on the touch screen (4), the user presses a save button to save the picture. He can also draw an icon on the touch screen (4) and then press the save button (39) to save the icon. After the icon is saved, the user interface on the touch screen returns to the previous interface.

For a large-size touch screen (6), in a tablet computer mode, the best working mode is drawing, painting or more handwriting work. The user D is designing a vehicle component with a new keyboard (1) with a large touch screen (8) attached to the bottom that can be pulled. Firstly, he pulls out the touch screen (8), triggers a power switch to supply power to the touch screen (8), and all file icons are displayed on the touch screen (8). Then he touches the drawing software icon on the large-size screen (8) with his finger, and after the drawing software is started, a blank is displayed on the touch screen (8) which can be pulled, and the top end of the drawing software user interface is provided with a pen icon (40), an eraser icon (41) and a rectangle icon (42). User D enters the name of the car part with the physical key (2) at the top of the software blank and he draws a drawing with a digital pen (13) on the screen (8). He can select the color or thickness of the line on the user interface of the drawing software directly by using a digital pen (13) or a mouse (10), can erase the content by using a virtual eraser (41), or can move the selected content by using a virtual rectangular frame (42). And after he completes the drawing design, saving the file. Then he pushes the touch screen (8) back to the bottom of the keyboard, triggering the power switch to cut off the power supply to the touch screen (8).

And a large-sized touch screen (6), wherein in a personal computer or notebook mode, a touch screen (7) having the same function as the small-sized touch screen (4) is displayed on the touch screen (6) or (8). Its best mode of operation is most regular character entry and a small amount of handwriting and drawing work. To make a Chinese document, the user E clicks on a word icon (15) displayed on a conventional screen (12) to start word software, and the on-screen display touch screen on the touch screen (6) or (8) appears. He then uses the physical key (2) to input Chinese by pinyin, but he cannot find some Chinese characters by pinyin. The user E presses a software N-Mode (19) button on the touch screen (7), which switches to a conversion Mode or C-Mode. He then writes a Chinese character on the touch screen (7) with a digital pen (13), and the handwriting input is converted into a list of possible regular Chinese characters and displayed on top of the touch screen (7). User E finds the correct Chinese character and presses the word with a digital pen (13), and the touch screen driver sends the word to word software in unicode. User E then needs to draw a simple drawing in the file and he presses the C-Mode software button, which switches to B-Mode and he presses the B-Mode button, which switches back to N-Mode. The on-screen touch screen (7) displays the user interface shown in fig. 7, and he then draws several straight lines and curves in the area (18). Next, several red curves need to be entered, the user E clicks red with the mouse on the user interface of the word software, and he then draws several curves on the on-screen touch screen, which curves are displayed as red on the drawing software.

The large-size touch screen (6) or (8) works in a personal computer/notebook mode and a tablet computer dual mode, and the best working mode is that a student reads books on the conventional screen (6) or (8) and writes notes on the touch screen (4). Student D opens a book on the regular screen (6) with reading software that allows him to write notes on the book while he needs to write classroom notes. He opens a PDF-like software on the touch screen (4), he needs to write a note on the book, and he then moves the cursor to the empty place with the mouse. The book will pop up the on-screen display (7) with the system APIs by software and he selects yellow after pressing the color icon with the digital pen (3). He then writes a few notes on the on-screen display screen (7) and the touch screen driver sends the notes to the book by software, the notes being shown yellow in the blank of the book near the last position of the cursor. In a classroom he needs to write notes on the touch screen (6). After he touches the note user interface with a digital pen (13), the on-screen touch screen (7) disappears. He can write or draw his picture with a digital pen (13), he can erase some content with a virtual eraser (41), or move selected content.

The best user experience and efficient input of the new keyboard when one file is open on the regular screen (9) or (12) and the same file is open on the touch screen (6) or (8). Both programs use the same data in the shared memory. The user E clicks on the file interface on the regular screen (12) to start to tap the physical key (2) to input characters. The input contents are displayed on both the regular screen (12) and the touch screen (8). He then needs to draw a picture on the file and he draws a triangle with the ruler after pressing the pen's icon (40) on the file user interface. He then finds the icons of straight line, curve, circle, etc., and he quickly draws a circle after pressing the icon of circle with a digital pen. He toggles between the regular screen (12) and the touch screen (8), which is very comfortable for entering text and drawing on the document.

Variations of the invention

There are many places where the invention can be varied, and the following are examples.

The touch screen may be designed as a detachable component.

For a left-handed user, the touch screen should be on the left side of the keyboard.

The arrangement of the touch screen and the fingerprint sensor may be different from fig. 1 or 2.

The user interface arrangement of the touch screen (4) may be different from fig. 7.

Title:

novel composite computer keyboard

Technical points

The present invention relates generally to improving the input functionality of computer keyboards currently used in personal computers, notebook computers and tablet computers. With existing keyboards, people use keys or combination keys to enter characters one by one. A touch screen is added to the new keyboard so that people can use handwriting as input. The touch screen may support a pen or a finger or both as input tools. An optional fingerprint sensor may also be added to the keyboard for security applications, such as user login.

The touch screen may operate in two modes. For the first mode, the touch screen records the content written on the screen. This function is similar to writing notes on paper. For the second mode, the touch screen is used as a software keyboard that can convert handwritten characters to formal characters, a function that is very useful for non-english languages.

When the keyboard has a touch screen for input, the contents of the document can be displayed on a regular screen. In this case, a small-sized touch screen is good enough. It is more convenient to draw, wipe or highlight such writing on a touch screen. In this case, a large-sized touch screen is required.

Project background

Currently, touch screen technology has evolved to a stage where handwriting input can be recorded very accurately. Newly developed techniques can convert handwritten characters to formal characters. These new technologies help people enter content into a computer by handwriting rather than by using keys alone.

Fingerprint technology has also been developed to the maturity stage. For security applications, fingerprints provide a more secure and convenient way than signatures or conventional passwords.

Summary of the invention

It is an object of the invention to combine the advantages of key and handwriting input. An alternative fingerprint provides a safer and more convenient way for security applications.

According to the present invention, the touch screen may operate in two modes. For the first mode, the touch screen records content written on the screen. This function is similar to handwriting notes on paper. For the second mode, the touch screen is used as a software keyboard that can convert handwritten characters to formal characters. This functionality is very useful for non-english languages.

According to the invention, the new keyboard can help people write regular notes with a computer, and the contents of the documents can be displayed on a regular screen. In this case, a small-sized touch screen is good enough. It is more convenient to draw, wipe or highlight such writing on a touch screen. In this case, a large-sized touch screen is required.

An alternative fingerprint sensor may provide a safer and more convenient method for security applications in accordance with the present invention.

According to the present invention, input/output, a display card, an operating system, application software, etc. need to be modified to support the functions of the touch screen.

Drawings

Figure 1 provides a principal top view looking down from above when a new keyboard is placed on a table. A small-sized touch screen is placed in the lower right corner of the keyboard.

Figure 2 provides a principal top view looking down from above when a new keyboard is placed on a desk. A large-sized touch screen is placed on the right part of the keyboard

The following is detailed information about the main components of the device

1. Areas with regular physical bonds. Conventional keyboards have areas with repeated keys, and when a large-sized touch screen is placed on the right portion of the keyboard, the new keyboard tends to remove those repeated keys.

2. A mouse pad on a conventional keyboard.

3. A new touch screen.

4. A new fingerprint sensor, which is optional.

Detailed description of the preferred embodiments

When the computer is turned on, the user can log in using the fingerprint (4).

For the first mode, when the user opens a note, the user can input handwritten characters or drawings on the touch screen (3) using a pen or finger, which provides the user with a way to write notes in a conventional manner. If the content is displayed on a regular screen, a small-sized screen is good enough. It is more convenient to draw, wipe or highlight such writing on a touch screen. In this case, a large-sized touch screen is required.

For the second mode, the touch screen (3) acts as a software keyboard for converting handwritten characters into formal characters. For example, when a user opens a word processor to write a Chinese document, the user may use the touch screen (3) to input formal Chinese characters through handwriting conversion rather than Chinese pinyin. For large-sized touch screens, a small portion of the screen may be implemented as a handwriting transducer.

Variations of the invention

There are many variations of the present invention, examples of which are presented herein.

The touch screen may be designed as a pull-able member attached to the bottom of the keyboard.

The touch screen may be designed as a detachable component.

For a left-handed user, the touch screen should be located on the left side of the keyboard.

The location of the touch screen or fingerprint may be different from that shown in fig. 1 or fig. 2.

Title:

novel composite computer keyboard

Technical points

The present invention relates generally to improving the input functionality of computer keyboards currently used in personal computers, notebook computers and tablet computers. Existing keyboards are made of plastic or other materials and people press a key or combination of keys to enter characters or other functions.

The new keyboard uses as input a touch screen having two modes of operation.

For the first mode, the touch screen is implemented as a conventional keyboard, with the user touching software keys instead of pressing physical keys.

For the second mode, the touch screen works as a tablet computer, displaying the content of the document. The user may use the pen to write, draw, erase or highlight, etc., the touch screen also allows a finger to act as a touch controller.

The switching between the three modes of operation may be implemented with hardware or software buttons.

An optional fingerprint sensor is added to the touch screen and can be used in a more secure and convenient manner for security applications.

Background

Currently, touch screen technology has evolved to a stage where handwriting input can be recorded very accurately. Newly developed techniques can convert handwritten characters to formal characters. These new technologies help people enter content into a computer by handwriting rather than by using keys alone. Software technology may also implement a virtual keyboard on the touch screen.

Summary of the invention

The object of the invention is to combine the advantages of keys and handwriting input together, realizing a virtual keyboard on a touch screen, and an optional fingerprint providing a safer and more convenient way for security applications.

According to the invention, the new keyboard uses a touch screen as input, which has two modes of operation. For the first mode, the touch screen is implemented as a conventional keyboard. For the second mode, the touch screen is used as a tablet. The touch screen displays content, and a user may write, draw, wipe or highlight with a pen, etc. on the touch screen. The touch screen also allows a finger to act as a touch controller. Switching between the two modes of operation may be implemented as hardware or software buttons.

According to the invention, a virtual keyboard will provide a better experience, as the user only needs to touch soft keys instead of pressing physical keys.

An alternative fingerprint sensor may provide a safer and more convenient way for security applications according to the present invention.

Drawings

Figure 1 provides a principal top view looking down from above when a new keyboard is placed on a table.

The following is detailed information about the main components of the device.

1. As a touch screen for a conventional keyboard. Conventional keyboards have a mouse pad, which is optional to implement.

2. A hardware button that can switch the keyboard and tablet.

3. A new fingerprint sensor. It is optional.

Detailed description of the preferred embodiments

When the computer is turned on, the touch screen (1) operates as a keyboard. The user can log in using the fingerprint (3).

For the first mode, the user can touch a software key as input, which has a better experience than pressing a physical key. If a mouse pad is not implemented, a conventional mouse may be used.

For the second mode, the touch screen (1) operates as a flat screen displaying the document content. The user may write, draw, wipe or highlight with a pen on the touch screen, etc. The touch screen also allows a finger to act as a touch controller.

When the user presses the switch button (2), the touch screen will switch from the keyboard to the tablet screen to the third mode and vice versa.

Variations of the invention

The touch screen may be implemented as a combination of a keyboard and a tablet screen.

The position of the switch button (2) or the fingerprint (3) may be different from that shown in fig. 1.

Claims

1. A new computer keyboard (1) comprises:

the physical key (2) is the same as the conventional physical keyboard,

the mouse pad (3) is the same as the conventional physical keyboard,

a small-sized touch screen (4) with driving software and storage as a new input device,

an optional fingerprint sensor (5) with driver software and storage,

the new keyboard (1) described above has an arrangement as shown in figure 1 but is not limited to this arrangement,

the physical key (2) or the mouse pad (3) or the touch screen (4) can be used as an input device of application software displayed on a conventional screen (9) or (12) along with a digital pen (13) or a finger.

2. The new keyboard (1) of claim 1, wherein the touch screen (4) and the driving software thereof can record writing or drawing on the screen (4) after a digital pen (13) or a finger touches an icon (40) of the pen in the user interface (7), the touch is one point, the continuous movement is a straight line or a curve, and the data on the same point can be cleared when the data is input again on the point just touched. When the part of the touch screen driver responsible for display and application software receives data sent from the part responsible for sensor, the data of the person to be infused will be displayed on the application software of the touch screen (4) and the conventional screen (9) or (12).

3. The new keyboard (1) according to claim 1,2, wherein the touch screen (4) and its driver software can input data by means of a digital pen (13) or a finger, the content of the new input displayed on the touch screen (4) being the same as that displayed on the application software, the display position being dependent on the last clicked cursor position on the regular screen (9) or (12), which corresponds to the origin of coordinates (43).

4. The new keyboard (1) of claims 1,2 and 3, when a digital pen (3) or a finger presses an eraser icon (41) and then presses or moves on a user interface (7) on a touch screen (4), the eraser is realized as a square with a small area by software, the touch point is the center of the square, the touch screen (4) and the driving software thereof will clear the currently displayed content with the size of the area of the eraser (41) on the touch screen (4), the application software will clear and erase the display with the same area as the content, the position of the display is determined by the position corresponding to a coordinate origin (43) of a cursor clicked last, and the data of the area erased on the touch screen (4) and a conventional screen (9) or (12) is updated to be blank.

5. The new keyboard (1) of claims 1,2,3,4, when the user presses the clear key (20) on the user interface (7), or clicks the mouse on the application software, or replaces the currently running application software with another application software, the touch screen (4) and its driver software will clear the display of the touch screen (4), and if not shared by the application software, the memory will be cleared; but the application software will not clear or update any data unless the content currently displayed on the touch screen (4) is not displayed on the regular screen (9) or (12).

6. The new keyboard (1) of the above claims 1,2,3,4,5 is very convenient and efficient for handwriting notes, drawings or drawings; it is particularly useful for a substantial signature, as opposed to a digital signature or a mouse-entered signature.

7. The new keyboard (1) of the above claims 1,2,3,4,5,6, the touch screen (4) thereof and its driver software can convert the coordinates (x, y) of points, lines and curves entered on the application software into a set of data in the form of xml or html or similar to the form of xml below.

<input>

</input>

8. The new keyboard (1) of the above claims 1,2,3,4,5,6,7, wherein the touch screen (4) and its driving software can be used as input to adjust the display position for the application software to update the content, by pressing an adjustable rectangular icon (42) on the touch screen (4) with a digital pen (13) or a finger, the size of which is determined by a diagonal line starting from the upper left side to the lower right side, the center of the rectangle is the pressing point, the cursor last clicked on the regular screen (9) or (12) corresponds to the origin (43) of the touch screen (4), the four sides of the rectangle are simultaneously displayed on the touch screen (4) and the regular screen (9) or (12), and the content selected on the application software is displayed on the touch screen (4).

9. The new keyboard (1) of the above claim 8, wherein the touch screen (4) can be used for adjusting the display position of the rectangular editing area selected on the application software on the conventional screen (9) or (12) by pulling by a digital pen (40) or a finger, or more precisely touching the software up-shift key (25), the software down-shift key (26), the software left-shift key (27) and the software right-shift key (28); or adjusting the display size by increasing or decreasing the display scale value (32) by finger pressure or more precisely by touching the increase arrow (30) or the decrease arrow (31), which is the new display size of the application software divided by the original display size, the content of the selected area being covered by the newly moved content.

10. The new keyboard (1) of claims 1,2,3,4,5,6,7,8 and 9, the touch screen (4) and its driver software can input content to the selected rectangular area by a digital pen (13) or finger that touches the pen icon (40); or the contents of the selected rectangular area are cleared by a digital pen (13) or finger which presses an icon (41) of the eraser.

11. The new keyboard (1) of the above claims 1,2,3,4,5,6,7,8 and 9, the touch screen (4) and its driver software can convert the written characters on the touch screen (4) into regular characters according to the length and order of input, which is particularly efficient for non-english characters stored as unicode.

12. The new keyboard (1) of the above claim 1, the touch screen (4) and its driving software, with the user interfaces of fig. 11, 12 and 13, can make, save and delete complex contents, such as signatures, fingerprints, icons, which can be output to the application software in the user interface of fig. 10, the detailed steps are described in the specification.

13. A new computer keyboard (44) comprising:

the physical key (2) is the same as the conventional physical keyboard,

the mouse pad (3) is the same as the conventional physical keyboard,

a large-sized touch screen (6) with driving software and storage as a new input device,

An optional fingerprint sensor (5) with driver software and storage,

the new keyboard (44) has an arrangement as shown in but not limited to figure 5,

the physical key (2) or the mouse pad (3) or the touch screen (6) can be used as an input device of application software displayed on the conventional screen (9) or (12) or the touch screen (6) along with a digital pen (13) or a finger, all file icons (15) are simultaneously displayed on the conventional screen (9) or (12) or the touch screen (6), and files opened by touching the file icons on the touch screen (6) are also displayed on the large-size touch screen (6).

14. The new keyboard (44) of claim 13, wherein the on-screen displayed touch screen (7) has the same functions and user interfaces as the touch screen (4) of claims 1,2,3,4,5,6,7,8,9, 10, 11, 12, is displayed on the large-size touch screen (6) through the system API on the application software, and is an application software input displayed on the large-size touch screen (6) or the regular screen (9) or (12).

15. The new keyboard (44) of claims 13, 14, the large-size display screen (6) of which can be used together with a personal computer (14) or a notebook computer (11) as a tablet computer, can be input from the on-screen display screen (7) or directly from the large-size touch screen (6) through a digital pen (13) or finger on a user interface of application software with a pen icon (40), an eraser icon (41) and other editing tools, and can also be input from a physical key (2) or a mouse (10) and a mouse pad (3). Compared with a conventional tablet computer, the regular characters are more comfortable and convenient to input by using the physical key and the mouse than the keyboard is displayed on the screen. Compared with a conventional tablet computer with a physical keyboard, the tablet computer with the physical keyboard has the advantages that the front arm is placed on a desk, and writing on a screen placed on the desk is more convenient and comfortable than writing on a screen placed on the desk obliquely.

16. The new keyboard (44) of claims 13, 14, wherein the physical keys (2), mouse (10) and mouse pad (3) can be used with a personal computer (14) or notebook computer (11) as a personal computer or notebook computer. Compared with a traditional personal computer or a notebook computer, the portable computer has the advantage of handwriting or drawing input from an on-screen touch screen (7).

17. The new keyboard (44) of claims 13, 14, 15 and 16 can be used with a personal computer (14) or a notebook computer (11) as a personal computer or both a notebook computer and a tablet computer. When two different applications are opened simultaneously on the regular screen (9) or (12) and the touch screen (6), the user can work more efficiently on one file suitable for a tablet computer and one file suitable for a personal computer.

18. The new keyboard (44) according to claims 13, 14, 15, 16 provides an optimal user experience when the same application is opened simultaneously on the regular screen (9) or (12) and the touch screen (6), the user can enter content for the application opened on the regular screen (9) or (12) by means of the physical key (2) or the mouse (10), or can write or draw on the touch screen (6) directly using a pen (40) or an eraser (41) like tool embedded in the application interface. The operating system needs to coordinate the input and output of the two on-screen applications, and the data that has been input before the next input should be displayed on both screens.

19. The new keyboard (1) of claim 1 and the new keyboard (44) of claim 13, the small-sized touch screen (4) or the large-sized touch screen (6) of which can be designed as a pullable screen attached to the bottom of a physical keyboard, thus being easier to carry and more comfortable to write when the arm is put on a desk.

20. The new keyboard (1) of claim 1, 19 and the new keyboard (44) of claim 13, 19, wherein the retractable touch screen, whether large or small, can be designed with a tactile switch that is powered on when the touch screen is pulled out and powered off when the touch screen is plugged in.

21. The new keyboard (44) of claims 13, 14, 15, 16, 17, 18, 19, 20, the touch screen (6) or (8) of which can be designed to be independent of the physical key (2) and the connection of the physical key to the personal computer (14), so that the new keyboard (44) can be compatible with a conventional personal computer that does not support the new keyboard.

22. The new keyboard (1) of claim 1, 19, 20 and the new keyboard (44) of claim 13, 19, 20, 21, the optional fingerprint sensor (5) thereof and its driver software can fingerprint for secure login, replacement of file signature or authentication.

23. The new keyboard (1) of claims 1,2,3,4,5,6,7,8,9, 10, 11, 12, 19, 20, 22 and the new keyboard (44) of claims 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, a plurality of icons (40) providing different types of points, lines and curves of pen, a plurality of square rubber icons (41) of different sizes, displayed on a user interface (7) (8) (9) (10) (11) (12) (13) on a touch screen (4), or on a user interface of application software of a large-sized touch screen (6) or (8).

24. The new keyboard (1) of claims 1,2,3,4,5,6,7,8,9, 10, 11, 12, 19, 20, 22, 23 and the new keyboard (44) of claims 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, if all user interfaces on the touch screen (4) or (6) or (8) are designed to have no pen icon (40), the user can write or draw on the touch screen without the need to touch the pen icon (40) by using a digital pen or finger, but erasing such work requires touching the eraser (41) again after completing the erasing work to prepare the touch screen for writing and drawing.

25. The new keyboard (1) of claims 1,2,3,4,5,6,7,8,9, 10, 11, 12, 19, 20, 22, 23, 24 and the new keyboard (44) of claims 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24 require the operating system, GPU and other components to support multiple rows of input and output through shared memory, information queuing, new system APIs, etc.; the application software of the graphic class is needed, and a user can output content to any place of the application software at the position where the cursor is finally clicked, wherein the coordinate origin of the touch screen corresponding to the cursor is the new input reference coordinate, and the input comes from the physical key (2) or handwriting or drawing.