CN114510159A - Writing track display method and device and storage medium - Google Patents
Writing track display method and device and storage medium Download PDFInfo
- Publication number
- CN114510159A CN114510159A CN202111653542.5A CN202111653542A CN114510159A CN 114510159 A CN114510159 A CN 114510159A CN 202111653542 A CN202111653542 A CN 202111653542A CN 114510159 A CN114510159 A CN 114510159A
- Authority
- CN
- China
- Prior art keywords
- writing
- area
- display
- track
- writing track
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 238000003860 storage Methods 0.000 title claims abstract description 21
- 230000001133 acceleration Effects 0.000 claims abstract description 26
- 230000015572 biosynthetic process Effects 0.000 claims description 18
- 238000004590 computer program Methods 0.000 claims description 16
- 230000008569 process Effects 0.000 claims description 11
- 230000004044 response Effects 0.000 claims description 8
- 230000008859 change Effects 0.000 claims description 4
- 230000001960 triggered effect Effects 0.000 claims description 3
- 230000002452 interceptive effect Effects 0.000 abstract description 14
- 230000000007 visual effect Effects 0.000 abstract description 4
- 238000005192 partition Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 9
- 230000006870 function Effects 0.000 description 7
- 238000003786 synthesis reaction Methods 0.000 description 7
- 238000004891 communication Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000009826 distribution Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/0416—Control or interface arrangements specially adapted for digitisers
- G06F3/04162—Control or interface arrangements specially adapted for digitisers for exchanging data with external devices, e.g. smart pens, via the digitiser sensing hardware
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application provides a writing track display method and device and a storage medium, and relates to the field of interactive intelligent tablets. The method comprises the following steps: receiving writing operation of a user; displaying a first writing track in a first area of a first display layer following the writing operation; if the writing operation meets the area updating condition, updating the acceleration area on the first display layer to be a second area, and displaying a second writing track following the writing operation in the second area; the display of the first writing track and the second writing track is synthesized through hardware; and displaying a third writing track on the second display layer, wherein the display of the third writing track is synthesized through software. The application accelerates the display of the writing track on the writing interface, gives the user the feeling of writing with the hand in the visual effect, improves the use experience of the user, realizes the partition area writing of the whole writing interface, and avoids the problem of insufficient bandwidth.
Description
Technical Field
The application relates to the field of interactive intelligent panels, in particular to a writing track display method and device and a storage medium.
Background
When each operating system (such as a window system, an Android system or a Linux system) displays a window, the window management service of the operating system is from windows of different components and systems. Taking an Android system as an example, each window corresponds to a Surface object (Surface is essentially a memory area), each Surface object corresponds to a Layer value (hierarchy), and if the Layer value is larger, the corresponding window is displayed on the larger top to block other windows.
Each time a rendering program in each operating system updates a display screen, all Surface objects corresponding to all display windows on the display screen need to be overlaid according to the size of their own Layer to form a bitmap file having the same size as the display screen, and render and write the bitmap file into an idle Framebuffer (a Framebuffer is a video display device driven by a video output device from a memory buffer containing complete frame data, and is specifically a driver interface), and wait for a vsync signal (vertical synchronization signal) to enable the rendering program to use the idle Framebuffer as the currently displayed Framebuffer according to the vsync signal, so that the screen is displayed on the display, and thus rendering and updating of the display screen are completed.
For electronic equipment such as an intelligent tablet and the like with a display screen with a touch-sensitive Surface, when a user performs touch writing on the display screen, in the process of refreshing the display screen to display the writing track of the user by the method, the writing track on the display screen is delayed due to the fact that the writing track of the Surface object is superimposed and synthesized and a certain time is needed for waiting for a vsync signal, and therefore the phenomenon that the writing track on the screen does not follow the writing of the user and is correspondingly synchronously displayed occurs, and user experience is poor.
In view of this, the related art is to: the writing track is directly drawn on a Framebuffer corresponding to an idle hardware layer, however, in order to improve the physical examination of the user, not only the problem of delay of writing track display needs to be considered, but also the definition of the writing track needs to be improved, and in order to improve the definition of writing track display, the hardware layer may be set to have a higher resolution (e.g., 3840 × 2160), but if the resolution of the hardware layer is set to be higher, the problem of insufficient bandwidth may be generated, thereby causing an abnormal or lost screen displayed picture.
Disclosure of Invention
A plurality of aspects of the application provide a writing track display method, a device and a storage medium, which accelerate the display of the writing track on the writing interface, give a user the feeling of handwriting following the hand in the visual effect, improve the use experience of the user, realize the partition area writing of the whole writing interface, and avoid the problem of insufficient bandwidth.
The embodiment of the application provides a writing track display method, which comprises the following steps:
receiving writing operation of a user;
displaying a first writing track in a first area of a first display layer along with the writing operation, wherein the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation;
if the writing operation meets the area updating condition, updating the acceleration area on the first display layer to be a second area, and displaying a second writing track following the writing operation in the second area, wherein the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing trajectory and the second writing trajectory is synthesized by hardware;
and displaying a third writing track on a second display layer, wherein the third writing track is displayed through software synthesis, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
An embodiment of the present application further provides a writing trace display device, including:
the receiving module is used for receiving the writing operation of a user;
the first display module is used for displaying a first writing track in a first area of a first display layer along with the writing operation, and the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation;
a second display module, configured to update an acceleration area on the first display layer to a second area if the writing operation satisfies an area update condition, and display a second writing track following the writing operation in the second area, where the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing trajectory and the second writing trajectory is synthesized by hardware;
and the third display module is used for displaying a third writing track on a second display layer, wherein the third writing track is displayed through software synthesis, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
The embodiment of the application also provides computer equipment which comprises a memory, a processor and a computer program which is stored on the memory and can run on the processor, wherein the processor realizes the writing track display method when executing the computer program.
An embodiment of the present application further provides a computer-readable storage medium, in which a computer program for executing the writing trace display method is stored.
In the embodiment of the application, writing operation of a user is received, writing operation is followed, a first writing track is displayed in a first area of a first display layer, if the writing operation meets an area updating condition, an acceleration area on the first display layer is updated to be a second area, and a second writing track following the writing operation is displayed in the second area. And the third writing track is displayed on the second display layer, the first writing track and the second writing track are displayed through hardware synthesis, the third writing track is displayed through software synthesis, the third writing track corresponds to the plurality of first touch points and the plurality of second touch points, and the problem that the writing tracks on the screen do not follow the writing of a user and correspond to synchronous display is solved. It should be understood that the display response speed of the first writing track and the second writing track synthesized through hardware is faster than that of the third writing track synthesized through software, so that the display of the writing tracks on the writing interface is accelerated through the above arrangement, the handwriting following feeling is provided for a user in the visual effect, and the use experience of the user is improved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a schematic flow chart of a writing trajectory display method provided in an embodiment of the present application;
fig. 2 is a schematic structural diagram of a writing trace display device according to an embodiment of the present application;
fig. 3 is a schematic diagram of a computer device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the technical solutions of the present application will be described in detail and completely with reference to the following specific embodiments of the present application and the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The method aims at the problems that the writing track on the screen does not follow the writing of a user and corresponds to synchronous display at present, and the problem of insufficient bandwidth can be caused if the resolution of a hardware layer is set to be high. In some embodiments of the present application, a first writing track is displayed in a first area of a first display layer by receiving a writing operation of a user, and if the writing operation satisfies an area update condition, an acceleration area on the first display layer is updated to a second area, and a second writing track following the writing operation is displayed in the second area, where the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation, and the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points, so that a split-area writing in the whole writing interface is realized, the first writing track and the second writing track formed in the writing operation of the user have a sequential order, and both writing in the whole writing interface is not required, and even if the resolution of a hardware layer is set to be higher, the problem of insufficient bandwidth does not occur (for example, originally, directly write "one" on the whole interface, that is to avoid the bandwidth insufficiency, then need to reduce the resolution ratio, but this application can understand to write "bow" earlier, write "long" again, like this, write "bow" and "long" when, even do not reduce the resolution ratio, also can not appear the insufficient problem of bandwidth). And the third writing track is displayed on the second display layer, the first writing track and the second writing track are displayed through hardware synthesis, the third writing track is displayed through software synthesis, the third writing track corresponds to the plurality of first touch points and the plurality of second touch points, and the problem that the writing tracks on the screen do not follow the writing of a user and correspond to synchronous display is solved. It should be understood that the display response speed of the first writing track and the second writing track synthesized through hardware is faster than that of the third writing track synthesized through software, so that the display of the writing tracks on the writing interface is accelerated through the above arrangement, the handwriting following feeling is provided for a user in the visual effect, and the use experience of the user is improved.
The writing track display method provided by the embodiment of the application can be executed by a terminal device, the terminal device can be realized in a software and/or hardware mode, and the terminal device can be formed by two or more physical entities or one physical entity. The terminal equipment can be a computer, a mobile phone, a tablet, a projector or an interactive intelligent tablet and the like. In the embodiment, an interactive smart tablet is taken as an example of a terminal device for description, where the interactive smart tablet may be an integrated device that controls content displayed on a display tablet and implements human-computer interaction operations through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal, and the like.
In an embodiment, the interactive smart tablet display screen is a touch screen, and the touch screen includes a capacitive screen, an electromagnetic screen, an infrared screen, or the like. The touch screen may receive a touch operation input by a user through a finger or an input device. Wherein the input device includes but is not limited to: capacitive pens, electromagnetic pens and/or infrared pens, etc. In addition, the smart interactive tablet may establish a data connection with at least one external device. Among these, external devices include, but are not limited to: a stylus and a mouse. The embodiment of the communication mode of the data connection between the external device and the intelligent interactive tablet is not limited, and the communication mode can be a USB connection mode, an Internet mode, a local area network mode, a Bluetooth mode, a Wi-Fi mode or a ZigBee mode and the like.
In an embodiment, the main controller of the smart tablet runs an Android system, and in addition, the computing module in communication connection with the main controller may also run a PC system, for example, a Windows system, that is, a user interface displayed by the smart tablet may be a user interface of the Android system or a user interface of the Windows system. The user can switch the interface display according to the requirement.
Optionally, writing application software such as electronic whiteboard software and annotation software is installed in the interactive smart tablet, and the writing application software may be installed in the interactive smart tablet in advance, or may be downloaded from a third-party device or a server and installed for use after the interactive smart tablet is started. The third-party device is not limited in the embodiment. A user can perform writing operation through writing software installed on the intelligent interactive tablet, which is exemplified by a writing track display process of the Android system, and of course, the operation process of the writing track display method on other operating systems such as a window system and a Linux system is similar to that on the Android system, and is not described herein again.
Fig. 1 is a schematic flow chart of a writing trajectory display method according to an embodiment of the present application. As shown in fig. 1, the method includes:
and step 101, receiving writing operation of a user.
In this embodiment, when it is detected that a user performs a writing operation on a writing interface of writing software of the smart interactive tablet, the smart interactive tablet may acquire the writing operation on the current writing interface, where the writing operation is a screen touch event within a range of the current writing interface. For the screen touch event, it may be, for example: a piece of text written by the user, or a graphic drawn by the user, etc.
And 102, displaying a first writing track in a first area of the first display layer along with the writing operation, wherein the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation.
It should be understood that the first writing track is formed according to a plurality of first touch points sequentially generated when the user performs a writing operation on the screen. After the current writing operation of the user is obtained, the first area of the first display layer displays the first writing track following the writing operation.
Wherein the area update condition includes: the first writing track reaches the boundary of the first area, or the writing speed change value corresponding to the writing operation reaches a set threshold value.
In a specific implementation, for example, when the user is currently writing a "bow" character, half of the writing is found to reach the boundary of the first area, the acceleration area on the first display layer is updated to be the second area, and a second writing track following the writing operation, that is, the remaining half of the "bow" character, is displayed in the second area of the first display layer. Similarly, when the user is writing the "bow" word currently, and the writing speed variation value of the user is found to reach the set threshold value in the writing process, the acceleration area on the first display layer is updated to be the second area, and then the second writing track following the writing operation is displayed in the second area of the first display layer, namely the remaining half of the "bow" word.
The "first area" and the "second area" referred to in the embodiment of the present application are only one implementation manner, and how many "areas" the first display layer is to be updated to are determined according to actual situations, and specifically, when the area update condition of the acceleration area is not satisfied, the area update is stopped.
It should be understood that the display of the first writing track and the second writing track is synthesized through hardware, that is, the first display layer is represented as a hardware layer. And because the bow characters are written in the first area of the first display layer and the updated second area separately, the data volume of the hardware layer in single writing is reduced, and the problem of insufficient bandwidth generated for improving the resolution of the hardware layer is solved.
In this embodiment, in order to allocate an appropriate memory space for each writing track, before the writing track is displayed in the acceleration region of the first display layer, a memory space matched with the size of the acceleration region may be allocated. Specifically, before the first region of the first display layer displays the first writing track, a first memory space matching the size of the first region may be allocated; before the second area displays a second writing track following the writing operation, a second memory space matching the size of the second area may be allocated.
Wherein the sizes of the first region and the second region may be determined according to the following method:
according to the display delay characteristics corresponding to the writing software, the size of an acceleration area is determined in the first display layer, the acceleration area comprises a first area and a second area, and the writing operation is triggered in the process of using the writing software.
Specifically, for example, when writing is performed in the first writing software, the writing whiteboard delay in the first writing software is high, and then there are more portions to be accelerated, and the acceleration area is set to be larger (for example, to write a "one", it may be that the hardware layer has been written right after the software layer of the first writing software is started, and then the accelerated portion is the entire "one", so the area to be accelerated is large). On the contrary, when writing is performed in the second writing software, the writing whiteboard in the second writing software is sensitive in reflection, and the delay is low, so that the portion to be accelerated is small, and the acceleration region can be set to be relatively small.
For the positions of the first area and the second area, the embodiment of the application is obtained by the following method:
determining the position of the first area in the first display layer according to the initial position of the writing operation;
and determining the position of the second area in the first display layer according to the end position of the first writing track when the area updating condition is met.
In this embodiment, for example, assuming that the starting position of the writing operation is located at the center of the writing screen, the position of the first area in the first display layer is determined as the center of the writing screen. Assuming that the area update condition is satisfied when writing to the right half of the writing screen following the writing operation, the end position of the first writing trajectory is regarded as the position of the second area in the first display layer.
In the embodiment of the present application, in order to facilitate a writing operation by a user, the first display layer may be initialized to a transparent color.
It should be noted that, after the user draws the writing track in the acceleration area of the first display layer, the first display layer may be synthesized with other hardware layers (for example, a hardware mouse layer, etc.), and then wait for the vertical synchronization signal, and after the vertical synchronization signal arrives, send the writing track to the display screen for displaying. Based on this, in order to be able to smoothly display the first writing trajectory in the first area, the second writing trajectory is displayed in the second area. In an embodiment of the present application, displaying a first writing track in a first area of a first display layer includes:
and reading a first writing track drawn in a first memory space matched with the first area in response to the vertical synchronizing signal so as to display the first writing track in the first area of the first display layer.
Displaying a second writing track following the writing operation in a second area, comprising:
and reading a second writing track drawn in the second memory space matched with the second area in response to the vertical synchronizing signal so as to display the second writing track in the second area of the first display layer.
And 104, displaying a third writing track on the second display layer, wherein the third writing track is displayed through software synthesis, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
In specific implementation, after the current writing operation of the user is obtained, the second display layer displays a third writing track formed according to the writing operation. The third writing track corresponds to the first touch points and the second touch points, for example, the third writing track is a "piece" character, and then the first touch points can form a "bow" character, and the second touch points can form a "long" character. It should be understood that the display of the third writing track is synthesized by software, that is, the second display layer is represented as a software layer.
Specifically, the content on the first display layer is displayed without software synthesis, and the first writing track and the second writing track are written into the device file corresponding to the first display layer to display the first writing track and the second writing track. And displaying the content on the second display layer by software synthesis, so that the third writing track is written into the device file corresponding to the second display layer to display the third writing track. Since the content on the first display layer is displayed without software composition, the writing trace is displayed faster than the second display layer.
The following will briefly explain this by taking the first display layer as a mouse cursor hardware display layer and the second display layer as a common view layer as an example:
supposing that the current writing interface comprises a mouse cursor hardware display Layer, a media Layer and at least one common view Layer, the display of the content on the common view Layer needs software synthesis, namely, a plurality of display windows corresponding to the common view Layer superpose respective bitmap files according to the size and position of the Layer thereof to synthesize a bitmap file, the bitmap file is synthesized in a mode of occupying a CPU, the bitmap file is rendered and written into an idle Framebuffer, the display of the content on the mouse cursor hardware display Layer and the media Layer does not need software synthesis, the display of the content on the mouse cursor hardware display Layer and the media Layer is synthesized and displayed in a hardware synthesis mode (hardware combination abstraction Layer, HWcomposer), and the content displayed by the mouse cursor hardware display Layer and the media Layer is synthesized and displayed on the Framebuffer corresponding to the device file through the HWcomposer Layer driven by one or a plurality of special synthesis chips, and then when refreshing and displaying the current writing interface, superposing and fusing Framebuffers synthesized by a software display layer and Framebuffers on different hardware layers by a hardware synthesis mode to display on a display, and completing superposed display of all layers on the display screen, namely, displaying the content on the common view layer by a soft layer synthesized by a GPU, submitting the result to the HWcomposer for display, and displaying the display content on the mouse cursor hardware display layer and the media layer after self-processing by the HWcomposer, so that the synthesis of the display content of the mouse cursor hardware display layer and the media layer cannot influence the synthesis of the common view layer, and the response speed of the mouse cursor hardware display layer is higher than that of the common view layer because the priority of the mouse cursor hardware display layer is higher than that of the common view layer.
The following provides a specific embodiment to explain the technical solution of the present application:
and S1, determining the size of the first area of the first display layer according to the display delay characteristic corresponding to the current writing software.
And S2, allocating a first memory space matched with the size of the area.
S3, initializing the first memory space to a transparent color, i.e., initializing the first display layer to a transparent color.
And S4, determining the position of the first area in the first display layer according to the starting position of the writing operation of the user.
And S5, displaying a first writing track in the first area of the first display layer according to the size and the position of the first area of the first display layer and the writing operation.
And S6, if the writing operation meets the area updating condition, updating the acceleration area on the first display layer to be the second area, and determining the size and the position of the second area based on the method.
And S7, displaying a second writing track following the writing operation in the second area.
And S8, displaying a third writing track on the second display layer according to the writing operation, synthesizing the first display layer and other hardware layers, and sending the track to the display screen for displaying after the vertical synchronizing signal arrives.
To sum up, this application does not use whole hardware picture layer as writing the layer, adopts the local area who contains the writing orbit in the hardware picture layer as writing the layer moreover, has reduced the data bulk on hardware picture layer, has solved the promotion and has write the orbit resolution ratio when the not enough problem of bandwidth. In addition, the size of the local area is not limited, the writing track line segment can be displayed, and the size of the local area can be dynamically adjusted according to time and space positions. In addition, the method and the device solve the problem of high writing delay, avoid the problems that other windows cannot be refreshed and the picture is torn and the like due to the fact that the Framebuffer synthesized by the software layers is used as the writing layer by using the hardware layers as the writing layer, and also ensure that the mouse can be normally used.
Based on the same inventive concept, the embodiment of the present application further provides a writing trace display device, such as the following embodiments. Because the principle of the writing track display device for solving the problems is similar to the writing track display method, the writing track display device can be implemented by the writing track display method, and repeated parts are not described again. As used hereinafter, the term "unit" or "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 2 is a schematic structural diagram of a writing trace display device according to an embodiment of the present application, and as shown in fig. 2, the writing trace display device includes:
the receiving module is used for receiving the writing operation of a user;
the first display module 201 is configured to display a first writing track in a first area of the first display layer following the writing operation, where the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation.
The second display module 202 is configured to update the acceleration area on the first display layer to a second area if the writing operation satisfies the area update condition, and display a second writing track following the writing operation in the second area, where the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing trajectory and the second writing trajectory is synthesized by hardware.
The third display module 203 is configured to display a third writing track on the second display layer, where the third writing track is displayed by software composition, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
In an embodiment of the present application, the apparatus further includes:
the first determining module is used for determining the size of an acceleration area in the first display layer according to the display delay characteristics corresponding to the writing software, the acceleration area comprises a first area and a second area, and the writing operation is triggered in the process of using the writing software.
In an embodiment of the present application, the apparatus further includes:
the second determining module is used for determining the position of the first area in the first display layer according to the initial position of the writing operation;
and the third determining module is used for determining the position of the second area in the first display layer according to the end position of the first writing track when the area updating condition is met.
In the embodiment of the present application, the area update condition includes: the first writing track reaches the boundary of the first area, or the writing speed change value corresponding to the writing operation reaches a set threshold value.
In an embodiment of the present application, the apparatus further includes:
and the distribution module is used for distributing the memory space matched with the size of the acceleration region.
In an embodiment of the present application, the first display module 201 is further configured to:
reading a first writing track drawn in a first memory space matched with the first area in response to a vertical synchronizing signal so as to display the first writing track in the first area of the first display layer;
the second display module 202 is further configured to:
and reading a second writing track drawn in the second memory space matched with the second area in response to the vertical synchronizing signal so as to display the second writing track in the second area of the first display layer.
In an embodiment of the present application, the first display layer is initialized to a transparent layer.
To achieve the above object, according to another aspect of the present application, there is also provided a computer apparatus. As shown in fig. 3, the computer device comprises a memory, a processor, a communication interface and a communication bus, wherein a computer program that can be run on the processor is stored in the memory, and the steps of the method of the above embodiment are realized when the processor executes the computer program.
The processor may be a Central Processing Unit (CPU). The Processor may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, or a combination thereof.
The memory, as a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and units, such as the corresponding program units in the above-described method embodiments of the present application. The processor executes various functional applications of the processor and the processing of the work data by executing the non-transitory software programs, instructions and modules stored in the memory, that is, the method in the above method embodiment is realized.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor, and the like. Further, the memory may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory located remotely from the processor, and such remote memory may be coupled to the processor via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more units are stored in the memory and when executed by the processor perform the method of the above embodiments.
An embodiment of the present application further provides a computer-readable storage medium, in which a computer program for executing the above method is stored.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a micro-control unit of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the micro-control unit of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
In a typical configuration, a computing device includes one or more micro control units (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include forms of volatile memory in a computer readable medium, Random Access Memory (RAM) and/or non-volatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of a computer-readable medium.
Computer-readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), Digital Versatile Disks (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. As defined herein, a computer readable medium does not include a transitory computer readable medium such as a modulated data signal and a carrier wave.
It should also be noted that the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.
The above description is only an example of the present application and is not intended to limit the present application. Various modifications and changes may occur to those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims (10)
1. A writing trajectory display method is characterized by comprising the following steps:
receiving writing operation of a user;
displaying a first writing track in a first area of a first display layer along with the writing operation, wherein the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation;
if the writing operation meets the area updating condition, updating the acceleration area on the first display layer to be a second area, and displaying a second writing track following the writing operation in the second area, wherein the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing trajectory and the second writing trajectory is synthesized by hardware;
and displaying a third writing track on a second display layer, wherein the third writing track is displayed through software synthesis, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
2. The method of claim 1, wherein before the first area of the first display layer displays the first writing track, the method further comprises:
determining the size of an acceleration area in the first display layer according to a display delay characteristic corresponding to writing software, wherein the acceleration area comprises the first area and the second area, and the writing operation is triggered in the process of using the writing software.
3. The method of claim 2, further comprising:
determining the position of the first area in the first display layer according to the starting position of the writing operation;
and determining the position of the second area in the first display layer according to the end position of the first writing track when the area updating condition is met.
4. The method of claim 1, wherein the region update condition comprises: and the first writing track reaches the boundary of the first area, or the writing speed change value corresponding to the writing operation reaches a set threshold value.
5. The method of claim 2, further comprising:
and allocating a memory space matched with the size of the acceleration region.
6. The method of claim 5, wherein displaying the first writing track in the first area of the first display layer comprises:
reading the first writing track drawn in a first memory space matched with the first area in response to a vertical synchronizing signal so as to display the first writing track in the first area of the first display layer;
the displaying a second writing track following the writing operation in the second area comprises:
and responding to a vertical synchronizing signal, reading the second writing track drawn in a second memory space matched with the second area, and displaying the second writing track in the second area of the first display layer.
7. A method according to any of claims 1-6, wherein the first display layer is initialized to a transparent layer.
8. A writing trajectory display device characterized by comprising:
the receiving module is used for receiving the writing operation of a user;
the first display module is used for displaying a first writing track in a first area of a first display layer along with the writing operation, and the first writing track corresponds to a plurality of first touch points sequentially generated by the writing operation;
a second display module, configured to update an acceleration area on the first display layer to a second area if the writing operation satisfies an area update condition, and display a second writing track following the writing operation in the second area, where the second writing track corresponds to a plurality of second touch points generated after the plurality of first touch points; wherein the display of the first writing trajectory and the second writing trajectory is synthesized by hardware;
and the third display module is used for displaying a third writing track on a second display layer, wherein the third writing track is displayed through software synthesis, and the third writing track corresponds to the plurality of first touch points and the plurality of second touch points.
9. A computer device comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor implements the writing trace display method according to any one of claims 1 to 7 when executing the computer program.
10. A computer-readable storage medium storing a computer program for executing the writing trace display method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111653542.5A CN114510159A (en) | 2021-12-30 | 2021-12-30 | Writing track display method and device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111653542.5A CN114510159A (en) | 2021-12-30 | 2021-12-30 | Writing track display method and device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114510159A true CN114510159A (en) | 2022-05-17 |
Family
ID=81547595
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111653542.5A Pending CN114510159A (en) | 2021-12-30 | 2021-12-30 | Writing track display method and device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114510159A (en) |
Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6798907B1 (en) * | 2001-01-24 | 2004-09-28 | Advanced Digital Systems, Inc. | System, computer software product and method for transmitting and processing handwritten data |
| CN107422974A (en) * | 2017-07-21 | 2017-12-01 | 广州视源电子科技股份有限公司 | Handwriting writing display method and system based on dual systems, storage medium and equipment |
| CN107450831A (en) * | 2017-07-21 | 2017-12-08 | 广州视源电子科技股份有限公司 | Handwriting display processing method and system based on dual systems, storage medium and equipment |
| CN107450832A (en) * | 2017-07-21 | 2017-12-08 | 广州视源电子科技股份有限公司 | Handwriting display method and system based on dual systems, storage medium and equipment |
| US20180025248A1 (en) * | 2015-02-12 | 2018-01-25 | Samsung Electronics Co., Ltd. | Handwriting recognition method and apparatus |
| CN108089763A (en) * | 2018-01-08 | 2018-05-29 | 广州视源电子科技股份有限公司 | Writing track display method, device, equipment and storage medium |
| CN109032494A (en) * | 2018-08-15 | 2018-12-18 | 广州视源电子科技股份有限公司 | Intelligent interaction system, writing track display method and device, tablet and medium |
| CN109144382A (en) * | 2018-07-10 | 2019-01-04 | 广州视源电子科技股份有限公司 | Handwriting display method and device based on dual systems, terminal equipment and storage medium |
| CN110174991A (en) * | 2019-05-17 | 2019-08-27 | 广州视源电子科技股份有限公司 | highlight pen processing method and device |
| CN110580125A (en) * | 2018-06-07 | 2019-12-17 | 广州视源电子科技股份有限公司 | partial refreshing method, device, equipment and medium for display interface |
| WO2019237636A1 (en) * | 2018-06-15 | 2019-12-19 | 广州视源电子科技股份有限公司 | Dual-system device and writing method and apparatus thereof, and interactive intelligent tablet |
| CN110597444A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Handwriting display method and device, terminal device and storage medium |
| CN110941383A (en) * | 2019-10-11 | 2020-03-31 | 广州视源电子科技股份有限公司 | Double-screen display method, device, equipment and storage medium |
| CN111596856A (en) * | 2020-05-06 | 2020-08-28 | 深圳市世纪创新显示电子有限公司 | Handwriting writing method and system based on auxiliary screen touch and storage medium |
| CN111651079A (en) * | 2020-05-18 | 2020-09-11 | 广州视源电子科技股份有限公司 | Handwriting display method, device, equipment and computer storage medium |
| US20210349562A1 (en) * | 2020-05-11 | 2021-11-11 | Samsung Electronics Co., Ltd. | Touch and display control device with fast touch responsiveness, display device including the same, method of operating the same and electronic system including the same |
-
2021
- 2021-12-30 CN CN202111653542.5A patent/CN114510159A/en active Pending
Patent Citations (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6798907B1 (en) * | 2001-01-24 | 2004-09-28 | Advanced Digital Systems, Inc. | System, computer software product and method for transmitting and processing handwritten data |
| US20180025248A1 (en) * | 2015-02-12 | 2018-01-25 | Samsung Electronics Co., Ltd. | Handwriting recognition method and apparatus |
| CN107422974A (en) * | 2017-07-21 | 2017-12-01 | 广州视源电子科技股份有限公司 | Handwriting writing display method and system based on dual systems, storage medium and equipment |
| CN107450831A (en) * | 2017-07-21 | 2017-12-08 | 广州视源电子科技股份有限公司 | Handwriting display processing method and system based on dual systems, storage medium and equipment |
| CN107450832A (en) * | 2017-07-21 | 2017-12-08 | 广州视源电子科技股份有限公司 | Handwriting display method and system based on dual systems, storage medium and equipment |
| CN108089763A (en) * | 2018-01-08 | 2018-05-29 | 广州视源电子科技股份有限公司 | Writing track display method, device, equipment and storage medium |
| CN110580125A (en) * | 2018-06-07 | 2019-12-17 | 广州视源电子科技股份有限公司 | partial refreshing method, device, equipment and medium for display interface |
| CN110597444A (en) * | 2018-06-12 | 2019-12-20 | 广州视源电子科技股份有限公司 | Handwriting display method and device, terminal device and storage medium |
| WO2019237636A1 (en) * | 2018-06-15 | 2019-12-19 | 广州视源电子科技股份有限公司 | Dual-system device and writing method and apparatus thereof, and interactive intelligent tablet |
| CN109144382A (en) * | 2018-07-10 | 2019-01-04 | 广州视源电子科技股份有限公司 | Handwriting display method and device based on dual systems, terminal equipment and storage medium |
| CN109032494A (en) * | 2018-08-15 | 2018-12-18 | 广州视源电子科技股份有限公司 | Intelligent interaction system, writing track display method and device, tablet and medium |
| CN110174991A (en) * | 2019-05-17 | 2019-08-27 | 广州视源电子科技股份有限公司 | highlight pen processing method and device |
| CN110941383A (en) * | 2019-10-11 | 2020-03-31 | 广州视源电子科技股份有限公司 | Double-screen display method, device, equipment and storage medium |
| CN111596856A (en) * | 2020-05-06 | 2020-08-28 | 深圳市世纪创新显示电子有限公司 | Handwriting writing method and system based on auxiliary screen touch and storage medium |
| US20210349562A1 (en) * | 2020-05-11 | 2021-11-11 | Samsung Electronics Co., Ltd. | Touch and display control device with fast touch responsiveness, display device including the same, method of operating the same and electronic system including the same |
| CN111651079A (en) * | 2020-05-18 | 2020-09-11 | 广州视源电子科技股份有限公司 | Handwriting display method, device, equipment and computer storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110597444B (en) | Handwriting display method and device, terminal device and storage medium | |
| CN109032722B (en) | Method, device, equipment and medium for updating display effect of UI component | |
| CN109144382B (en) | Handwriting display method and device based on dual systems, terminal equipment and storage medium | |
| US10157593B2 (en) | Cross-platform rendering engine | |
| CN111651079B (en) | Handwriting display method, device, equipment and computer storage medium | |
| WO2020048026A1 (en) | Annotation display method, device and apparatus, and storage medium | |
| CN109375980B (en) | Touch drawing method based on Andriod system | |
| CN109799945B (en) | Method and device for scrolling and displaying long list of small programs, electronic equipment and storage medium | |
| US11561637B2 (en) | Method and device of drawing handwriting track, electronic apparatus, medium, and program product | |
| CN112486611B (en) | Page switching display method and device, storage medium and electronic equipment | |
| CN103400565B (en) | A kind of interface piecemeal method for refreshing based on GDI | |
| CN110262749B (en) | Webpage operation method, device, container, equipment and medium | |
| CN107562324B (en) | Data display control method and terminal | |
| CN107391148B (en) | View element saving method and device, electronic equipment and computer storage medium | |
| CN112130948A (en) | Display control method and device, computer readable medium and electronic device | |
| WO2020211029A1 (en) | Note redrawing method, writing device, and storage medium | |
| CN114510159A (en) | Writing track display method and device and storage medium | |
| WO2022087981A1 (en) | Handwriting displaying method and apparatus based on android system, and storage medium | |
| CN115016671A (en) | Touch display control device, touch display device, equipment and method | |
| CN112379875A (en) | TD GUIE graphic system and QT graphic rendering library data interaction method | |
| CN115373558A (en) | Screen projection method, device, equipment and storage medium | |
| CN115639920B (en) | Drawing method, electronic device, and readable storage medium | |
| CN116304242A (en) | Data processing method, device, electronic equipment and storage medium | |
| CA2741743C (en) | Hardware accelerated caret rendering | |
| WO2024065097A1 (en) | Blackboard-writing content display method, electronic device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |