CN116149588A

CN116149588A - Display method and display device

Info

Publication number: CN116149588A
Application number: CN202310104622.8A
Authority: CN
Inventors: 杜鑫磊; 王敏; 崔毅
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Priority date: 2023-02-07
Filing date: 2023-02-07
Publication date: 2023-05-23

Abstract

The embodiment of the application discloses a display method and display equipment, relates to the technical field of display, and can avoid more operations of a user in a writing process, thereby improving the experience of the user. The specific scheme is as follows: displaying an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in display equipment, the interface to be written comprises contents to be written and a form to be filled in, the form to be filled in comprises a plurality of cells, and the cells are used for correspondingly filling the contents to be written in; receiving writing operation input by a user in a writing area of an interface to be written; responding to the writing operation, displaying the writing content of the user, and determining whether the writing content of the user is matched with the content to be written; displaying first written content in at least one cell corresponding to the user written content under the condition that the user written content is matched with the content to be written, wherein the first written content corresponds to the user written content; the user writing content in the writing area is cleared.

Description

Display method and display device

Technical Field

The application relates to the technical field of display, in particular to a display method and display equipment.

Background

Currently, electronic whiteboard applications are widely applied to electronic devices such as display devices. The user can write and draw corresponding image-text contents on the screen of the display device comprising the electronic whiteboard application in a mode of touching by using media such as a whiteboard pen and a mouse or fingers, and after the user finishes writing on the screen of the display device or the whiteboard, the user can write the contents in the next stage in a mode of erasing part of the contents or directly and completely removing the contents.

However, for display devices with smaller screens, the user's need to write freely may not be satisfied. For example, when a user writes poetry of more content on the screen of the display device, it is possible that one poetry is transcribed to half, and the screen of the display device has no free position for the user to continue writing. At this time, the user can only shrink the current writing content or add a new page to continue transcription, which results in more operations of the user in the writing process and poorer user experience.

Disclosure of Invention

The embodiment of the application provides a display method and display equipment, which can avoid more operations of a user in a writing process, thereby improving the experience of the user.

In order to achieve the above purpose, the embodiments of the present application adopt the following technical solutions:

In a first aspect, a display device is provided, which may include: the display is configured to display an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in display equipment, the interface to be written comprises contents to be written and a form to be filled in, the form to be filled in comprises a plurality of cells, and the cells are used for correspondingly filling the contents to be written in; the touch control component is configured to receive writing operation input by a user in a writing area of an interface to be written; and a controller coupled to the display and the touch assembly, respectively, and configured to: responding to the writing operation, controlling a display to display the writing content of the user, and determining whether the writing content of the user is matched with the content to be written; under the condition that the user writing content is matched with the content to be written, controlling a display to display first writing content in at least one cell corresponding to the user writing content, wherein the first writing content corresponds to the user writing content; the control display clears the user writing in the writing area.

Based on the display device of the first aspect, after the user writes the content, the content written by the user can be displayed in the form to be filled in the display interface, and then the content written by the user can be cleared, so that the user can continue to write in the display interface, thereby avoiding more operations of the user in the writing process, and improving the user experience. In addition, the method and the device for writing the content display device display the content written by the user in the to-be-filled form in the display interface, and the to-be-filled form corresponds to the to-be-written content, so that the user can know the writing progress conveniently.

With reference to the first aspect, in another possible implementation manner, the controller may be further configured to: displaying first prompt information under the condition that the writing content of the user is not matched with the writing content to be written, wherein the first prompt information is used for prompting the user that the writing content is wrong; responding to the modification operation input by the user in the writing area, controlling the display to display user modification content, and determining whether the user modification content is matched with the content to be written; controlling a display to display second writing content in at least one cell corresponding to the user modifying content under the condition that the user modifying content is matched with the content to be written, wherein the second writing content corresponds to the user modifying content; the control display clears the user modified content in the writing area.

Based on the possible implementation manner, whether the content written by the user is wrong or not can be determined, and the user can be prompted to write the wrong content under the condition that the content written by the user is wrong, so that the user can modify the content written with the wrong content, and after the user modifies, whether the content modified by the user is correct or not is continuously determined, and under the condition that the content modified by the user is correct, the content modified by the user can be correspondingly displayed in the table to be filled.

With reference to the first aspect, in another possible implementation manner, the interface to be written may further include a display area and a region to be filled, where the display area is used for displaying the content to be written, the region to be filled is used for displaying the form to be filled, and the display area and the region to be filled do not overlap.

Based on the possible implementation manner, the content to be written can be displayed in the display area included in the interface to be written, and the form to be filled is displayed in the area to be filled included in the interface to be written, and the display area and the area to be filled are not overlapped, so that the content written by the user is displayed in the form to be filled in the display interface, and the user can conveniently learn the writing progress.

With reference to the first aspect, in another possible implementation manner, the content to be written may include text to be written and a first punctuation mark, and the controller may be further configured to: generating a plurality of cells according to the content to be written and second punctuation marks which are in one-to-one correspondence with the first punctuation marks, wherein the cells are in one-to-one correspondence with the text to be written in the content to be written; generating a form to be filled according to the plurality of cells and the second punctuation mark, and controlling the display to display the form to be filled in the area to be filled.

Based on the possible implementation manner, a table to be filled corresponding to the content to be written can be generated according to the text to be written and the first punctuation mark included in the content to be written, and the table to be filled can include a plurality of cells corresponding to the text to be written in the content to be written one by one and a second punctuation mark corresponding to the first punctuation mark.

With reference to the first aspect, in another possible implementation manner, the controller may be further configured to: matching the writing text included in the user writing content with the text to be written corresponding to the unmatched cell according to the sequence, and determining whether the user writing content is matched with the text to be written; the unmatched cells are cells in the plurality of cells that do not display the user writing.

Based on the possible implementation manner, the writing text included in the writing content of the user and the text to be written corresponding to the unmatched cell can be matched in sequence, so that whether the writing content of the user is matched with the content to be written or not can be determined.

In a second aspect, a display method is provided, which may include: displaying an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in display equipment, the interface to be written comprises contents to be written and a form to be filled in, the form to be filled in comprises a plurality of cells, and the cells are used for correspondingly filling the contents to be written in; receiving writing operation input by a user in a writing area of an interface to be written; responding to the writing operation, displaying the writing content of the user, and determining whether the writing content of the user is matched with the content to be written; displaying first written content in at least one cell corresponding to the user written content under the condition that the user written content is matched with the content to be written, wherein the first written content corresponds to the user written content; the user writing content in the writing area is cleared.

With reference to the second aspect, in another possible implementation manner, the display method may further include: displaying first prompt information under the condition that the writing content of the user is not matched with the writing content to be written, wherein the first prompt information is used for prompting the user that the writing content is wrong; responding to the modification operation input by the user in the writing area, displaying user modification content, and determining whether the user modification content is matched with the content to be written; displaying second writing content in at least one cell corresponding to the user modifying content under the condition that the user modifying content is matched with the content to be written, wherein the second writing content corresponds to the user modifying content; the user modification content in the writing area is cleared.

With reference to the second aspect, in another possible implementation manner, the interface to be written may further include a display area and a region to be filled in, where the display area is used for displaying the content to be written, the region to be filled in is used for displaying the form to be filled in, and the display area and the region to be filled in are not overlapped.

With reference to the second aspect, in another possible implementation manner, the content to be written includes text to be written and a first punctuation mark, before displaying the form to be filled in, the display method may further include: generating a plurality of cells according to the content to be written and second punctuation marks which are in one-to-one correspondence with the first punctuation marks, wherein the cells are in one-to-one correspondence with the text to be written in the content to be written; generating a form to be filled according to the plurality of cells and the second punctuation mark, and controlling the display to display the form to be filled in the area to be filled.

With reference to the second aspect, in another possible implementation manner, determining whether the user writing content matches the content to be written may include: matching the writing text included in the user writing content with the text to be written corresponding to the unmatched cell according to the sequence, and determining whether the user writing content is matched with the text to be written; the unmatched cells are cells in the plurality of cells that do not display the user writing.

In a third aspect, a display device is provided, which has the functionality to implement the method according to the second aspect described above. The functions can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

In a fourth aspect, there is provided a display device including: a processor and a memory; the memory is configured to store computer-executable instructions that, when executed by the first device, cause the first device to perform the display method of any one of the second aspects.

In a fifth aspect, there is provided a display device including: a processor; the processor is configured to couple to the memory and execute the display method according to any one of the second aspect according to the instruction after reading the instruction in the memory.

In a sixth aspect, there is provided a computer readable storage medium having instructions stored therein which, when run on a computer, cause the computer to perform the display method of any one of the second aspects above.

In a seventh aspect, there is provided a computer program product comprising instructions which, when run on a computer, cause the computer to perform the display method of any of the second aspects above.

In an eighth aspect, there is provided an apparatus (e.g. the apparatus may be a system-on-a-chip) comprising a processor for supporting a display device to implement the functions referred to in the second aspect above. In one possible design, the apparatus further includes a memory for storing program instructions and data necessary for the display device. When the device is a chip system, the device can be formed by a chip, and can also comprise the chip and other discrete devices.

The technical effects of any one of the design manners of the second aspect to the eighth aspect may be referred to the technical effects of the different design manners of the first aspect, and will not be repeated here.

Drawings

Fig. 1 is a schematic diagram of a display interface for poetry transcription of a conventional display device;

Fig. 2 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment of the present application;

fig. 3 is a schematic hardware structure of a control device 100 according to an embodiment of the present application;

fig. 4 is a schematic hardware structure of a display device 200 according to an embodiment of the present application;

fig. 5 is a software configuration diagram of a display device 200 according to an embodiment of the present application;

fig. 6 is a schematic area diagram of a display interface of a display device according to an embodiment of the present application;

FIG. 7 is a schematic flow chart of a display method according to an embodiment of the present disclosure;

fig. 8 is one of display schematic diagrams of a display device according to an embodiment of the present application;

FIG. 9 is a second display diagram of a display device according to an embodiment of the present disclosure;

FIG. 10 is a third display diagram of a display device according to an embodiment of the present disclosure;

FIG. 11 is a fourth schematic diagram of a display device according to an embodiment of the present disclosure;

FIG. 12 is a fifth schematic diagram of a display device according to an embodiment of the present disclosure;

FIG. 13 is a sixth schematic diagram of a display device according to an embodiment of the present disclosure;

FIG. 14 is a schematic diagram of a display device according to an embodiment of the present disclosure;

FIG. 15 is a second flow chart of a display method according to the embodiment of the present application;

FIG. 16 is a third flow chart of a display method according to the embodiment of the present disclosure;

fig. 17 is a schematic structural diagram of a display device according to an embodiment of the present application.

Detailed Description

For purposes of clarity and implementation of the present application, the following description will make clear and complete descriptions of exemplary implementations of the present application with reference to the accompanying drawings in which exemplary implementations of the present application are illustrated, it being apparent that the exemplary implementations described are only some, but not all, of the examples of the present application.

It should be noted that the brief description of the terms in the present application is only for convenience in understanding the embodiments described below, and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms "first," second, "" third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for limiting a particular order or sequence, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "and/or" in this application is merely an association relation describing an associated object, and indicates that three relations may exist, for example, a and/or B may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the front and rear association objects are an or relationship.

For example, as shown in fig. 1, taking the content written by the user through the display device with the built-in electronic whiteboard as the poetry to be transcribed, the display device may display the poetry with transcription, for example, the display device may display the poetry of Bai Juyi in the display interface of the screen, where the poetry content is "four months of life, and the temple flowers are fully born. The long-time spring enters the foraging place and is not known to transfer to the place. The display device may also display a toolbar in the display interface, which may include multiple multi-controls that may perform different operations on the content written by the user, such as a marking operation, an operation to select the written content, an operation to narrow the written content, or an operation to add a new written page, etc. The user can write in the blank area in the display interface, namely, the user writes the poem in the writing area in the display interface.

When the screen of the display device is smaller, the display interface of the display device is smaller, and correspondingly, the writing area in the display interface is smaller. Because the writing area in the display interface is smaller, after the user transcribes half of the content, the writing area in the display interface has no free place for the user to continuously transcribe. As shown in fig. 1, "fort is full of flowers, temple flowers are beginning to bloom" is transcribed at the user. After the two poems, the writing area in the display interface has no free place for the user to continuously transcribe the rest poems. At this time, in order to continue copying the remaining verses, the user may reduce the copied content through the related controls in the toolbar, so that the user may continue to copy in the free place of the writing area, or the user may add a new writing page through the related controls in the toolbar, so that the user may continue to copy in the writing area of the newly added writing page. Therefore, in order to enable the user to continue transcription, the user needs to perform related operations, which results in more operations during writing, and poor user experience.

In view of the foregoing, embodiments of the present application provide a display method and a display device, where the display device may include an electronic whiteboard application, and the method may display content written by a user in a content display interface after the user writes the content, and erase the content written by the user, so that the user may continue to write in the display interface, thereby avoiding more operations of the user in the writing process, and improving user experience.

The following describes a display method provided in an embodiment of the present application.

The display device provided by the embodiment of the application can have various implementation forms, for example, can be

Fig. 2 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 2, a user may operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display device 200 by inputting user instructions through keys on a remote control, voice input, control panel input, etc.

In some embodiments, a smart device 300 (e.g., mobile terminal, tablet, computer, notebook, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on a smart device.

In some embodiments, the display device may receive instructions not using the smart device or control device described above, but rather receive control of the user by touch or gesture, or the like.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control device configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 3 exemplarily shows a block diagram of a configuration of the control apparatus 100 in accordance with an exemplary embodiment. As shown in fig. 3, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, and function as an interaction between the user and the display device 200.

By way of example, taking a display device as a television, fig. 4 shows a schematic structural diagram of a display device according to an embodiment of the present application.

As shown in fig. 4, the display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

In some embodiments the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

The display 260 includes a display screen component for presenting a picture, and a driving component for driving image display, a component for receiving an image signal from the controller output, displaying video content, image content, and a menu manipulation Interface, and a user manipulation User Interface (UI).

The display 260 may be a liquid crystal display, an OLED display, a projection device, or a projection screen.

The communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

A user interface, which may be used to receive control signals from the control device 100 (e.g., an infrared remote control, etc.).

The detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; alternatively, the detector 230 includes an image collector such as a camera, which may be used to collect external environmental scenes, user attributes, or user interaction gestures, or alternatively, the detector 230 includes a sound collector such as a microphone, or the like, which is used to receive external sounds.

The external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

The modem 210 receives broadcast television signals through a wired or wireless reception manner, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.

In some embodiments, the controller 250 and the modem 210 may be located in separate devices, i.e., the modem 210 may also be located in an external device to the main device in which the controller 250 is located, such as an external set-top box or the like.

The controller 250 controls the operation of the display device and responds to the user's operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), video processor, audio processor, graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

The user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

A "user interface" is a media interface for interaction and exchange of information between an application or operating system and a user, which enables conversion between an internal form of information and a user-acceptable form. A commonly used presentation form of the user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a user interface related to computer operations that is displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the display device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the display 260 in the display apparatus 200 is configured to display a user interface, an image, text, video, etc., and the controller 250 in the display apparatus 200 is configured to provide the user interface, the image, the text, the video, etc. to the display 260, the controller 250 or the control device 100 may control the fixed component, and thereby enable rotation of the display apparatus 200 through the fixed component to transition the display apparatus 200 between the landscape state and the portrait state.

In some embodiments, the display device 200 may enable the display device 200 to support a touch interactive function by adding a touch component 280. In general, the touch assembly 280 may together form a touch screen with the display 260. On the touch screen, the user can input different control instructions through touch operation. For example, a user may input touch instructions such as clicking, sliding, long pressing, double clicking, etc., and different touch instructions may represent different control functions.

To implement the different touch actions described above, the touch assembly 280 may generate different electrical signals when the user inputs the different touch actions, and transmit the generated electrical signals to the controller 250. The controller 250 may perform feature extraction on the received electrical signal to determine a control function to be performed by the user based on the extracted features.

For example, when a user enters a click touch action at any program icon location in the application program interface, the touch assembly 280 will sense the touch action and generate an electrical signal. After receiving the electrical signal, the controller 250 may determine the duration of the level corresponding to the touch action in the electrical signal, and recognize that the user inputs the click command when the duration is less than the preset time threshold. The controller 250 then extracts the location features generated by the electrical signals to determine the touch location. When the touch position is within the application icon display range, it is determined that a click touch instruction is input by the user at the application icon position. Accordingly, the click touch instruction is used to perform a function of running a corresponding application program in the current scenario, and thus the controller 250 may start running the corresponding application program.

For another example, when the user inputs a sliding motion in the media presentation page, the touch assembly 280 also sends the sensed electrical signal to the controller 250. The controller 250 first determines the duration of the signal corresponding to the touch action in the electrical signal. When the duration time is determined to be longer than the preset time threshold value, the position change condition generated by the signals is judged, and obviously, the generation position of the signals changes for the interactive touch action, so that the user is determined to input a sliding touch instruction. The controller 250 then determines the sliding direction of the sliding touch command according to the change condition of the signal generating position, and controls the page turning of the display screen in the media display page so as to display more media options. Further, the controller 250 may further extract characteristics such as a sliding speed and a sliding distance of the sliding touch instruction, and perform a picture control of turning pages according to the extracted characteristics, so as to achieve a following effect.

Similarly, for the touch instructions such as double-click and long-press, the controller 250 may extract different features, determine the type of the touch instruction through feature judgment, and execute corresponding control functions according to a preset interaction rule. In some embodiments, the touch assembly 280 also supports multi-touch so that a user can enter touch actions on the touch screen via multiple fingers, e.g., multi-finger clicks, multi-finger long presses, multi-finger swipes, etc.

The touch control action can be matched with a specific application program to realize a specific function. For example, after the user opens the "whiteboard" application, the display 260 may present a drawing area, the user may draw a specific touch action track in the drawing area through the sliding touch command, and the controller 250 determines a touch action pattern through the touch action detected by the touch component 280, and controls the display 260 to display in real time, so as to satisfy the demonstration effect. It will be appreciated that in general, implementation of display device functions requires software in addition to the hardware support described above.

Fig. 4 is a software structural block diagram of a display device provided in an embodiment of the present application.

In some embodiments, as shown in fig. 4, the system of the display device is divided into four layers, namely, an application (Applications) layer (abbreviated as "application layer"), an application framework (Application Framework) layer (abbreviated as "framework layer"), a An Zhuoyun-line (Android run time) and a system library layer (abbreviated as "system runtime layer"), and a kernel layer from top to bottom.

In some embodiments, at least one application program is running in the application program layer, and these application programs may be a Window (Window) program of an operating system, a system setting program, a clock program, or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer corresponds to a processing center that decides to let the applications in the application layer act. Through the API interface, the application program can access the resources in the system and acquire the services of the system in the execution. In some examples, the dialog system included with the display device may be located in a framework layer of the system of the display device.

As shown in fig. 4, the application framework layer in the embodiment of the present application includes a manager (manager), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used to interact with all activities that are running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a Package Manager (Package Manager) for retrieving various information about an application Package currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual applications as well as the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

The methods in the following embodiments may be implemented in a display device having the above-described hardware structure or software structure.

In order to achieve the scheme that after a user writes content, the content written by the user is displayed in a content display interface, and the content written by the user is erased, so that the user can continue to write in the display interface, more operations of the user in the writing process can be avoided, and user experience is improved. In the embodiment of the application, the display interface corresponding to the electronic whiteboard application included in the display device can be divided into different areas, and different functions can be realized in the different areas.

For example, as shown in fig. 6, a display interface corresponding to an electronic whiteboard application included in the display device may include a writing area, a poetry list display area, and a toolbar area. The writing area may include a form area to be filled in and a blank area.

And a writing area which can receive the operation written by the user and display the content written by the user, that is, the user can write in the writing area. After the user finishes writing in the writing area once, the display device can correspondingly display the content written by the user in the form area to be filled in, and clear the content written by the user in the writing area, so that the user can continue writing in the writing area when writing next time.

The writing area comprises a form area to be filled and a blank area which can receive the writing operation of a user and display the writing content of the user. The form area to be filled in the writing area can also display a form corresponding to the content to be written, and the content written by the user can be correspondingly displayed in the form.

The poetry list display area can be used for displaying the content to be written by the user.

The toolbar area may be used to display icons that display controls that perform different operations on content written by the user. For example, the toolbar may include multiple controls that may perform different operations on content written by the user, such as a marking operation, a selection of written content, a zoom-out of written content, or an addition of a new written page. And displaying icons corresponding to the multiple multi-controls in the toolbar area.

The following describes in detail the display method provided in the embodiment of the present application with reference to fig. 7. As shown in fig. 7, the display method provided in the embodiment of the present application may include the following S701-S717.

S701, displaying a whiteboard application interface, wherein the whiteboard application interface is a display interface corresponding to the whiteboard application.

The display device may comprise a whiteboard application, i.e. an electronic whiteboard application. When the user needs to write the content through the whiteboard application of the display device, the user can operate the whiteboard application of the display device, such as clicking an icon corresponding to the whiteboard application of the display device, so that the display device can display an interface corresponding to the whiteboard application. I.e. the whiteboard application interface is the interface corresponding to the whiteboard application comprised by the display device.

S702, receiving display operation of a user, wherein the display operation is used for indicating to display the content to be written.

After the display device displays the whiteboard application interface, that is, displays the interface corresponding to the whiteboard application, the display device may receive a display operation of the user, and the display operation may be used to instruct to display the content to be written.

In some examples, a display operation may also be used to indicate to switch displayed content to be written. For example, the user may switch the content to be written displayed in the whiteboard application interface through a display operation.

In some examples, the whiteboard application interface may include a select writing content control, and the user may select different content to be written by selecting the writing content control. For example, the user may select a poem to be transcribed by selecting a writing content control, the poem to be transcribed being the content to be written. That is, the display device may receive an operation of selecting the writing content control by the user, so that the display device may display the content to be written, that is, the display device may receive a display operation by the user, the display operation being for instructing to display the content to be written.

In some examples, the whiteboard application interface may include a toolbar region, which may include a select writing content control, through which a user may select content to be written.

For example, taking a whiteboard application transcription poetry included by the user through the display device as an example, after the display device displays the whiteboard application interface, the user can select the poetry to be transcribed through a writing content selection control in a toolbar included by the whiteboard application interface, that is, the display device can receive an operation of selecting the writing content control by the user, that is, the display device can receive a display operation of the user, and the display operation is used for indicating to display the content to be transcribed.

S703, displaying a content display interface to be written in response to the display operation, wherein the content display interface to be written comprises content to be written.

After the display device receives a display operation of the user, the display device may display a content to be written display interface, which may include content to be written, in response to the display operation. In some examples, the content to be written display interface may be an interface that displays correspondence of the content to be written in a display area of the whiteboard application interface. That is, the whiteboard application interface may include a presentation area, which may be used to display the content to be written, thereby displaying the content to be written display interface. The display area may also be referred to as a poetry list display area.

For example, continuing to take a whiteboard application transcription poetry included by the user through the display device as an example, after the display device displays the whiteboard application interface, the user may select a poetry to be transcribed through a select writing content control in a toolbar included in the whiteboard application interface. Namely, the display device receives the operation of the user on selecting the writing content control, the display operation is used for indicating and displaying the content to be written, as shown in fig. 8, in the poem of the content to be written of Bai Juyi, the poem content is 'four months fragrant, and the temple flowers are full of life'. The long-time spring enters the foraging place and is not known to transfer to the place. When the method is used, the display equipment can also display the content to be written in the display area in the whiteboard application interface, namely, the display area in the whiteboard application interface displays that the temple flowers of Dalin temple are full of April and the temple flowers are full of all April. The user can return to the place without foraging for a long time and can not know to turn to the place, namely the display equipment can display a content display interface to be written, and the content display interface to be written comprises the content to be written.

S704, generating a corresponding table according to the content to be written, and displaying an interface to be written, wherein the interface to be written comprises the table corresponding to the content to be written.

After the display device displays the content to be written on the display interface, that is, the display area of the whiteboard application interface displays the content to be written, the display device may generate a corresponding table according to the content to be written, that is, the table corresponding to the content to be written. In this embodiment of the present application, the table corresponding to the content to be written may be referred to as a to-be-filled table.

In some examples, the table corresponding to the content to be written may include a plurality of sub-tables, each sub-table may correspond to a character included in the content to be written one by one, and in this embodiment, the sub-tables may also be referred to as cells, that is, the form to be filled may include a plurality of cells, and the plurality of cells may be used to correspondingly fill the content to be written. For example, when the content to be written includes "inter-person forty-fei" the content to be written is 'inter-person April fragrant' and the corresponding table can be

. That is, the display device may generate a corresponding table according to the number of words and the number of lines of each poem, that is, the format of the generated table is consistent with the format of the content to be written. After the corresponding form is generated, the display device can automatically adjust the size of the form according to the area of the writing area, so that the writing area can completely display the generated form.

After the display device generates the table corresponding to the content to be written, the display device may store a correspondence between each sub-table and the characters included in the content to be written, so that the content written by the user may be displayed in the corresponding sub-table according to the stored correspondence between each sub-table and the characters included in the content to be written.

In other examples, the table corresponding to the content to be written may include not only a plurality of sub-tables, each of which may correspond one-to-one to the characters included in the content to be written, but also punctuation marks in the content to be written. For example, when the content to be written includes "the four-month-to-four, temple flowers are full of all. When the content to be written is in the' four months of fragrance, the temple flowers are full of all around. ", the corresponding table may be

After the display device generates a corresponding table according to the content to be written, that is, the table corresponding to the content to be written, the display device may display an interface to be written, and the interface to be written may include the table corresponding to the content to be written. In some examples, the interface to be written may be an interface that displays a table correspondence for the content to be written for a writing area in the whiteboard application interface. That is, the whiteboard application interface may include a writing area that may be used to display a table corresponding to the content to be written.

In some examples, the writing area may also include a form to be filled in area, which may be used to display a form corresponding to the content to be written.

For example, taking a whiteboard application in which a display device is included as an example, after the display device receives an operation of selecting a writing content control by a user, as shown in fig. 8, in poetry of Bai Juyi to be written, "Dalin temple, poetry content is" four months of life, and temple is full of life. The long-time spring enters the foraging place and is not known to transfer to the place. When the method is used, the display equipment can display the content to be written on the display interface, namely the display equipment can display the content to be written on the display area in the whiteboard application interface, namely the display area in the whiteboard application interface displays the method that the temple flowers of Dalin temple are white and easy to be people in the four months and the temple flowers are full of each other. The long-time spring enters the foraging place and is not known to transfer to the middle-time place. After the display device displays the content to be written, the display device may generate a table corresponding to the content to be written according to the content to be written, and display an interface to be written, where the interface to be written includes the table corresponding to the content to be written. The interface to be written may be an interface corresponding to a display form in a writing area of the whiteboard application interface. As shown in FIG. 9, the table corresponding to the content to be written may be

Display device canThe interface to be written can be an interface corresponding to a form, which is included in a writing area of the whiteboard application interface and is to be filled in the form area, and the form corresponds to the content to be written.

S705, receiving the writing operation of the user in the writing area of the interface to be written.

After the display device displays the interface to be written, that is, after the display device displays the form in the writing area of the whiteboard application interface, the user can write this time in the writing area of the interface to be written, for example, copy part of the content in the content to be written. I.e. the display device may receive writing operations entered by the user in a writing area of the interface to be written.

S706, responding to the current writing operation of the user, and displaying the current writing content of the user in a writing area of the interface to be written.

After receiving the current writing operation of the user in the writing area of the interface to be written, the display device can display the content written by the user in the writing area of the interface to be written in response to the current writing operation.

In some examples, the writing area may include a blank area where the user may write, i.e., the display device may receive the user's current writing operation and use it to display the user's current writing content.

In some examples, when the form area to be filled in is included in the writing area, and the form area to be filled in is used for displaying a form corresponding to the content to be written, the user may also write this time in the form to be filled in included in the writing area. When the user writes this time in the form to be filled in, the display device may float the content that displays the user writing this time above the form.

For example, taking a whiteboard application poetry included in the display device by the user as an example, after the display device displays a table corresponding to the content to be written as shown in fig. 9 on the interface to be written, that is

The user can write this time in the blank area included in the writing area of the interface to be written, that is, the user can copy the content to be written displayed in the display area in the blank area included in the writing area of the interface to be written, as shown in fig. 10, the user can copy "four-month fragrant out between people" in the blank area. After the display device receives the current writing operation of the user in the writing area of the interface to be written, the display device responds to the current writing operation to display the content written by the user in the writing area of the interface to be written, namely the display device can display 'four months of people are full of fragrance' in the writing area.

S707, determining whether the content written by the user at the time is matched with the content corresponding to the table.

After the display device displays the content written by the user at the writing area of the interface to be written, the display device can determine whether a table matched with the content written by the user at the time exists in the table, that is, the display device can determine whether the content written by the user at the time is matched with the content corresponding to the table. Because the table corresponding to the content to be written corresponds to the content to be written one by one, the display device determines whether a table matched with the content written by the user at the time exists in the table, that is, the display device determines whether the content written by the user at the time is matched with the content to be written, that is, the display device can determine whether the content written by the user at the time is correct. When the display equipment determines that the table matched with the content written by the user at the time exists in the table, the display equipment can determine that the content written by the user at the time is correct, and when the display equipment determines that the table matched with the content written by the user at the time does not exist in the table, the display equipment can determine that the content written by the user at the time is wrong.

In the case where it is determined that there is a table matching the content written by the user this time in the table, the following S708 may be continued to be executed; in the case where it is determined that there is a table in the table that does not match the content written by the user at this time, the following S712 may be continued.

In some examples, when the display device stores a correspondence between each sub-table and a character included in the content to be written, the display device determines whether each character in the content that the user writes this time matches each sub-table according to the stored correspondence between each sub-table and the character included in the content to be written.

In some examples, the display device identifies the written content of the user in the period from the beginning of the pen-down to the hand-up being greater than one second as an identification unit, namely, the written content of the user in the period from the beginning of the pen-down to the hand-up being greater than one second is identified as the written content of the time, and the content corresponding to the identification unit is matched with the table corresponding to the content to be written.

In some examples, the display device may match the matching order of the written content with the form in order, that is, match the form with the written content of the user in order of the form, when determining whether there is a form in the form that matches the written content of the user at the time, and the form that has already participated in the matching is no longer participated in the next matching.

S708, displaying the content written by the user in the corresponding table.

When the display device determines that the content written by the user is correct, the display device can display the content written by the user in the corresponding table.

For example, taking a whiteboard application in which the user uses a display device as an example, as shown in fig. 10, the user transcribes "forty-aromatic nature among people" in a white area. After the display equipment receives the current writing operation of the user in the writing area of the interface to be written, the content written by the user in the writing area of the interface to be written is displayed in response to the current writing operation, namely the display equipment displays 'four-month fragrant and complete among people' in the writing area. Then, the display device can determine whether a table matched with the content written by the user at the time exists in the table, namely, the display device determines whether the 'four-month aromatic nature' written by the user at the time is correct. In the case that the display device determines that "inter-person forty-aromatic-fimbriae" written by the user is correct, as shown in fig. 11, the display device may correspondingly display "inter-person forty-aromatic-fimbriae" in the table, that is, display the content written by the user in the table corresponding to "inter-person forty-aromatic-fimbriae".

S709, clearing the content written in the writing area by the user.

After the content written by the user at this time is displayed in the table corresponding to the display device, the display device can clear the content written by the user at this time in the writing area, so that the user can continue writing in the writing area, for example, the user can continue copying the rest of the poem in the writing area.

For example, continuing to take the example of a user applying a transcription poem through a whiteboard included in the display device, a table matching the content written by the user this time is determined to exist in the table in the display device, the display device correspondingly displays the 'inter-person four-month fragrant' in the table under the condition that the 'inter-person four-month fragrant' written by the user is correct, namely, the display device displays the content written by the user in the table corresponding to the 'inter-person four-month fragrant'. Then, as shown in fig. 11, the display device may clear the content written in the writing area by the user this time, so that the user may continue to copy the remaining poetry in the writing area of the display device.

S710, determining whether the writing of the content to be written is completed.

After the display device clears the content written in the writing area by the user this time, the display device may determine whether the content to be written is written to completion.

In the case where it is determined that the writing of the content to be written is completed, the following S711 may be continuously executed; in the case where it is determined that the content to be written is not written to be completed, the above-described S705 may be continued to be performed.

In some examples, the display device may determine whether the content to be written is complete by determining whether the content written by the user is displayed in the tables corresponding to the content to be written, i.e., the content written by the user is displayed in the tables corresponding to the content to be written, the display device may determine that the content to be written is complete, the content written by the user is not completely displayed in the tables corresponding to the content to be written, and the display device may determine that the content to be written is not complete.

S711, displaying the content to be written in the table.

In the case that the display device determines that the writing of the content to be written is completed, the display device may display the content to be written in a table corresponding to the content to be written.

For example, continuing to take a user's application of a transcription poem through a whiteboard included in the display device as an example, a poem "Dalin temple flowers" with a content to be written of Bai Juyi is "four months aromatic among people," and temple flowers are beginning to prevail. The long-time spring enters the foraging place and is not known to transfer to the place. In the case where the display device determines that the writing of the content to be written is completed, the display device may display the content to be written in a table corresponding to the content to be written, as shown in fig. 12, the display device may display the content to be written in a table corresponding to the content to be written, that is, "four months and four flowers are all people, and temple flowers are all beginning in a table corresponding to the content to be written. The long-time spring enters the foraging place and is not known to transfer to the place. "

In some examples, after the display device displays the content to be written in the table corresponding to the content to be written, the user may select to display the next content to be written, or display the last content to be written

For example, the user may select the next content to be written through a corresponding control included in the toolbar of the whiteboard application interface. The user can also select the next content to be written through the corresponding control included in the display area, or the user can select the last content to be written through the corresponding control included in the display area.

It should be noted that, when the display device determines that the content to be written is not written, the user may select to display the next content to be written or display the last content to be written.

For example, taking a whiteboard application poetry included by a user through a display device as an example, in conjunction with fig. 12, the content written by the user is displayed in a corresponding table by the display device, that is, the display device displays "four months of arduos among people, the temple flowers are full of all the time" in the table corresponding to the content to be written. The long-time spring enters the foraging place and is not known to transfer to the place. After that, the display device clears the content written in the writing area by the user this time. At this time, the user may select the next content to be written through a corresponding control included in the display area, such as the next control, or the user may select the previous content to be written through a corresponding control included in the display area, such as the previous control.

And S712, displaying prompt information, wherein the prompt information is used for prompting that the written content of the user is wrong.

In the case that the display device determines that there is a table that does not match the content written by the user at the time in the table, the display device may display a prompt (which may be referred to as first prompt in the embodiment of the present application) for prompting that the content written by the user has an error.

In some examples, displaying the prompt may include a box that may frame the content that the user wrongly written, thereby prompting the user where the written content is wrong.

For example, continuing with the example of a user applying a transcription poem through a whiteboard included in the display device, the user may transcribe "unknowingly" into this in a whitespace area (i.e., a writing area) in the interface to be written. After the display device receives the current writing operation of the user in the writing area of the interface to be written, the display device responds to the current writing operation to display the content written by the user in the writing area of the interface to be written, namely the display device displays ' don't know that the user is coming into the writing area '. The display device may then determine whether a form exists in the form that matches the content that the user was writing at this time, i.e., the display device determines whether the "unknowingly passed in here" written at this time by the user is correct. In the case that the display device determines that the "don't know that the user is coming in here" written this time is incorrect, as shown in fig. 13, the display device may display a box, that is, a prompt message, and the box may frame the "coming" word, so as to prompt the user that the written content is incorrect.

S713, receiving modification operation of a user in a writing area of the interface to be written.

After the display device displays the prompt information, the prompt information is used for prompting that the content written by the user has errors, and the display device can receive the modification operation of the user in the writing area of the interface to be written. I.e. the user may modify the wrong writing in the writing area of the interface to be written.

In some examples, the modifying operation may be used to modify the error content written by the user, i.e., the modifying operation may be used to modify the error character, and the modifying operation may also be used to modify the content written by the user this time, i.e., the modifying operation may be used to modify the content written by the user this time.

And S714, displaying the content modified by the user in a writing area of the interface to be written in response to the modification operation.

After receiving a modification operation of a user at a writing area of an interface to be written, the display device may display content modified by the user at the writing area of the interface to be written in response to the modification operation.

For example, continuing to take a whiteboard application transcription poetry included by the user through the display device as an example, when the content written by the user at this time is "unknown incoming here," the display device determines whether the "unknown incoming here" written by the user at this time is correct. In the case that the display device determines that the "don't know that the user is coming in here" written this time is incorrect, as shown in fig. 13, the display device may display a box, that is, a prompt message, and the box may frame the "coming" word, so as to prompt the user that the written content is incorrect. After that, the user may modify the wrong "pass" word, that is, the display device may receive the modification operation of the user in the writing area of the interface to be written, and in response to the modification operation, as shown in fig. 14, the display device may display the content modified by the user in the writing area of the interface to be written, that is, "don't know to go to here.

S715, determining whether a table matched with the content modified by the user exists in the table.

After the display device displays the user-modified content in the writing area of the interface to be written, the display device may determine whether there is a form in the form that matches the user-modified content.

In the case where it is determined that there is no table matching the user-modified content in the table, the above-described S712 may be continuously performed; in the case where it is determined that there is a table matching the user-modified content in the table, the following S716 may be continued.

S716, displaying the content modified by the user in the corresponding table.

In the case where the display device determines that there is a table matching the user-modified content in the table, the display device may display the user-modified content in the corresponding table.

For example, continuing to take a whiteboard application transcription poetry included by the user through the display device as an example, when the content written by the user at this time is "unknown incoming here," the display device determines whether the "unknown incoming here" written by the user at this time is correct. In the case that the display device determines that the "don't know what is coming in here" written by the user this time is incorrect, the display device may receive a modification operation of the user in the writing area of the interface to be written, and in response to the modification operation, as shown in fig. 14, the display device may display the content modified by the user in the writing area of the interface to be written, that is, "don't know what is coming in here". In the case where the display device may determine whether there is a table in the table that matches the user-modified content, the display device may display the user-modified content in the corresponding table, turn "unknowingly" of the user modification into this, and display in the corresponding table.

S717, the content modified by the user in the writing area is cleared.

After the display device displays the user-modified content in the corresponding table, the display device may clear the user of the modified content in the writing area.

According to the scheme, after the user writes the content, the content written by the user is displayed in the display interface, and the content written by the user is erased, so that the user can continue to write in the display interface, more operations of the user in the writing process can be avoided, and the user experience is improved.

In order to facilitate understanding, a display method provided in the embodiment of the present application will be schematically described below with reference to fig. 15 by taking a case where a user applies a transcription poem through a whiteboard of a display device.

As shown in fig. 15, the process of the user applying the transcription poetry through the whiteboard of the display device may include: the display device may display an interface corresponding to the whiteboard application. After the display device displays the interface corresponding to the whiteboard application, the user can select poems (i.e. contents to be written) for transcription in the interface corresponding to the whiteboard application, for example, the user can switch poems in the poem list interface in the interface corresponding to the whiteboard application.

After the user selects the poetry to be transcribed, the display device may read the content of the current poetry. Thereafter, the display device may generate a table consistent with the current poetry format (i.e., a table corresponding to the content to be written). One space in the table corresponding to the content to be written corresponds to one character in poetry. After the display device generates a form consistent with the current poetry format, the display device may display the form in the exhibition area.

Thereafter, the user may begin writing, i.e., the user may write in the writing area. The display device may display content written by the user. During the display of the user-written content by the display device, the display device may determine whether the user has a hand-up time of greater than 1 second. In the event that the user has not been raised for more than 1 second, the display device may continue to display the content written by the user.

Under the condition that the user's hand lifting time is longer than 1 second, namely the user finishes writing this time, the display device can acquire the writing content of the writing area of the user. After the display device obtains the written content of the user writing area, the display device may identify the written content so that the display device may sequentially match the identified written content with the characters mapped by the form.

And under the condition that the recognized written content is completely matched with the characters mapped by the table, the display equipment can fill the written content into the corresponding table, namely, the written content of the user is displayed in the corresponding table. After the display device fills the written content into the corresponding table, the display device can clear the writing of the writing area, namely, the written content of the user in the writing area is erased.

The display device may then determine whether the form area is filled, i.e., whether the content to be written is complete. In the case where it is determined that the form area is filled, the display device may end transcription of the present poetry. In the case where the form area is not filled, the user may begin writing, i.e., the user may transcribe in the writing area.

In the event that the recognized written content does not exactly match the characters of the form map, the display device may prompt the user to transcription with errors. In case of a user modification error, i.e. the user modifies 2 the written content in the writing area. The display device may obtain the written content of the written area, continue to identify the written content, and thereby continue to sequentially match the identified written content with the characters mapped by the form. In the event that the user does not modify the error, the display device may continue to prompt the user to transcribe the error.

For ease of understanding, the display method provided in the embodiment of the present application is described below with reference to fig. 16. The display method can be applied to a display device. The display device may include: display, touch-control subassembly and controller. The display can be configured to display an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in the display device, the interface to be written comprises contents to be written and a form to be filled in, the form to be filled in comprises a plurality of cells, and the cells are used for correspondingly filling the contents to be written in. The touch control component can be configured to receive writing operation input by a user in a writing area of an interface to be written. The controller is coupled with the display and the touch control component respectively, and can be configured to execute the display method described below.

As shown in fig. 16, the display method may include the following S1601-S1606.

S1601, displaying an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in display equipment, and the interface to be written includes contents to be written and forms to be filled in.

The display device may include a whiteboard application through which the user may write, such as through which the user may transcription poems. When a user writes through the whiteboard application, the display device can display an interface to be written, namely an interface corresponding to the whiteboard application.

The interface to be written may include content to be written and a form to be filled in. The content to be written may be content written by the user, for example, when the user performs poetry transcription, the content to be written may be poetry to be transcribed by the user. The form to be filled in may include a plurality of cells for correspondingly filling in the content to be written.

In some examples, the interface to be written may also include a presentation area and an area to be filled. The presentation area may be used to display the content to be written. The area to be filled can be used for displaying the form to be filled, and the display area and the area to be filled are not overlapped, so that the display of the content to be written and the display of the form to be filled can not be affected.

In some examples, the interface to be written may also include a writing area. The writing area may be used to receive writing operations entered by the user, i.e. the user may write in a writing area comprised by the interface to be written. The writing area may overlap with the area to be filled. When the writing area and the to-be-filled area overlap, the content written by the user in the writing area included in the to-be-written interface can float above the to-be-filled area, for example, the content written by the user in the writing area included in the to-be-written interface can float above the to-be-filled form.

In some examples, the content to be written may include text to be written and a first punctuation mark (i.e., a punctuation mark in the content to be written), and the display device may generate the form to be filled in from the content to be written before the display device displays the form to be filled in.

For example, the display device may generate a plurality of cells according to the content to be written, and a second punctuation mark (i.e., a punctuation mark to be filled in the table) corresponding to the first punctuation mark one to one, where the plurality of cells correspond to the text to be written in the content to be written one to one. Then, the display device may generate a form to be filled according to the plurality of cells and the second punctuation mark, and display the form to be filled in the area to be filled.

In this embodiment of the present application, the display device displays an interface to be written, where the interface to be written is an interface corresponding to a whiteboard application included in the display device, and a specific embodiment of the to-be-written surface including contents to be written and a form to be filled may refer to the embodiments in S701 to S704. The embodiments of the present application are not described herein.

S1602, receiving writing operation input by a user in a writing area of an interface to be written.

And displaying an interface to be written on the display device, wherein the interface to be written is an interface corresponding to a whiteboard application included in the display device, and after the interface to be written includes contents to be written and forms to be filled in, the display device can receive writing operation input by a user in a writing area of the interface to be written.

In some examples, the user's writing operation may include an operation between the user writing in the writing area and the user stopping writing. The stopping of the writing by the user can be determined when the stopping time of the writing by the user is longer than a preset time. The preset duration may be determined according to the actual situation, which is not limited in this embodiment of the present application, for example, the preset duration may be 1 second.

In this embodiment of the present application, a specific implementation manner in which the display device receives a writing operation input by a user in a writing area of an interface to be written may refer to the implementation manner in S705 described above. The embodiments of the present application are not described herein.

S1603, in response to the writing operation, the user writing content is displayed.

After the display device receives a writing operation input by a user in a writing area of the interface to be written, the display device may display the user writing content, e.g., the display device may display the user writing content in the writing area of the interface to be written.

In this embodiment of the present application, the display device displays a specific embodiment of the content written by the user in response to the writing operation, and reference may be made to the embodiment in S706 above. The embodiments of the present application are not described herein.

S1604, determining whether the user writing content matches the content to be written.

After the display device displays the user written content, the display device may determine whether the user written content matches the content to be written, i.e., the display device may determine whether the user written content is correct. In the case where the display device determines that the user writing content matches the content to be written, i.e., the display device determines that the user writing content is correct, the display device may continue to execute S1605 described below. In the case where the display device determines that the user writing content does not match the content to be written, i.e., the display device determines that the user writing content has an error, the display device may continue to execute S1607 described below.

In some examples, where the form to be filled in includes a plurality of cells, the display device determining whether the user written content matches the content to be written may include: the display device sequentially matches the user writing content with the to-be-written content corresponding to the unmatched cells in the to-be-filled table, that is, the to-be-written content corresponding to the matched cells in the to-be-filled table does not need to be sequentially matched with the user writing content. The unmatched cells may be cells of the plurality of cells that do not display the user's written content. The matched cells may be cells of the plurality of cells that have displayed the user written content.

In some examples, when the content to be written includes text to be written, the form to be filled in includes a plurality of cells, and the plurality of cells correspond one-to-one to the text to be written in the content to be written, the display device determining whether the user writing content matches the content to be written may include: and the display equipment matches the writing text included in the user writing content with the text to be written corresponding to the unmatched cell according to the sequence, and determines whether the user writing content is matched with the content to be written. The unmatched cells are cells in the plurality of cells that do not display the user writing.

In this embodiment, the embodiment in which the display device determines whether the user writing content matches the content to be written may refer to the embodiment in S707 described above. The embodiments of the present application are not described herein.

S1605, displaying a first writing content in at least one cell corresponding to the user writing content, where the first writing content corresponds to the user writing content.

In the case that the display device determines that the user writing content matches the content to be written, that is, the user writing content is correct, the display device may display the first writing content in at least one cell corresponding to the user writing content. The first written content corresponds to user written content.

In some examples, when the display device displays the first written content, the user may select a font corresponding to the displayed first written content. The fonts corresponding to the first writing content can be standard fonts or fonts written by the user, namely, when the display equipment displays the first writing content, the first writing content can be displayed according to handwriting written by the user.

In this embodiment of the present application, the display device displays the first writing content in at least one cell corresponding to the user writing content, and for a specific embodiment of the first writing content corresponding to the user writing content, reference may be made to the embodiment in S708 above. The embodiments of the present application are not described herein.

S1606, the user writing content in the writing area is cleared.

After the display device displays the first writing content in at least one cell corresponding to the user writing content, the display device may clear the user writing content in the writing area so that the user may continue writing in the writing area.

In this embodiment of the present application, the specific implementation of the display device for clearing the user writing content in the writing area may refer to the implementation in S709 described above. The embodiments of the present application are not described herein.

S1607, displaying first prompt information, wherein the first prompt information is used for prompting a user that written content has errors.

And under the condition that the display device determines that the written content of the user is not matched with the content to be written, namely that the written content of the user is wrong, the display device can display first prompt information. The first prompt may be used to prompt the user that the written content is incorrect.

After the display device displays the first prompt information, the first prompt information is used for prompting the user that the written content has errors, the display device can receive modification operation input by the user in the writing area, namely, the user can modify the written content of the user in the writing area. In response to a modification operation entered by the user in the writing area, the display device may display user modified content.

After the display device displays the user-modified content, the display device may determine whether the user-modified content matches the content to be written. In the case where the user-modified content matches the content to be written, the display device may display second written content in at least one cell corresponding to the user-modified content, the second written content corresponding to the user-modified content.

In some examples, when the display device displays the second written content, the user may select a font corresponding to the displayed second written content. The fonts corresponding to the second writing content can be standard fonts or fonts written by the user, namely, when the display equipment displays the second writing content, the second writing content can be displayed according to handwriting written by the user.

After the display device displays the second writing content in at least one cell corresponding to the user-modified content, the display device may clear the user-modified content in the writing area.

In this embodiment of the present application, the display device displays the first prompt information, where the first prompt information is used to prompt the user that the writing content is wrong, and reference may be made to the embodiment in S712. The embodiments of the present application are not described herein.

According to the scheme, after the user writes the content, the content written by the user can be displayed in the to-be-filled form in the display interface, and then the content written by the user can be cleared, so that the user can continue to write in the display interface, more operations of the user in the writing process can be avoided, and the user experience is improved. In addition, the method and the device for writing the content display device display the content written by the user in the to-be-filled form in the display interface, and the to-be-filled form corresponds to the to-be-written content, so that the user can know the writing progress conveniently.

Corresponding to the method in the foregoing embodiment, the embodiment of the present application further provides a display device. The display apparatus may be applied to a display device for implementing the method in the foregoing embodiment. The functions of the display device can be realized by hardware, and can also be realized by executing corresponding software by hardware. The hardware or software includes one or more modules corresponding to the functions described above.

For example, fig. 17 shows a schematic structural diagram of a display device 17, and as shown in fig. 17, the display device 17 may include: a display module 1701, a receiving module 1702, a determining module 1703, a clearing module 1704, and the like.

The display module 1701 may be configured to display an interface to be written, where the interface to be written is an interface corresponding to a whiteboard application included in the display device, the interface to be written includes contents to be written and a form to be filled in, and the form to be filled in includes a plurality of cells, where the plurality of cells are used to correspondingly fill in the contents to be written.

The receiving module 1702 may be configured to receive a writing operation input by a user in a writing area of an interface to be written.

The display module 1701 may also be used for displaying user written content in response to a writing operation.

A determination module 1703 may be used to determine if the user writing content matches the content to be written.

The display module 1701 may be further configured to display, in a case where the user writing content matches the content to be written, a first writing content in at least one cell corresponding to the user writing content, where the first writing content corresponds to the user writing content.

The purge module 1704 may be used to purge the user writing in the writing area.

In one possible implementation, the display module 1701 may be further configured to display a first prompt, where the user writing content does not match the content to be written, and the first prompt is used to prompt the user that the writing content is wrong.

The display module 1701 may also be configured to display user modified content in response to a modification operation entered by a user in the writing area.

The determination module 1703 may also be used to determine if the user modified content matches the content to be written.

The display module 1701 may be further configured to display second writing content in at least one cell corresponding to the user modified content, where the user modified content matches the content to be written, and the second writing content corresponds to the user modified content.

The purge module 1704 may also be used to purge user modified content in the writing area.

In one possible implementation, the interface to be written further includes a display area for displaying the content to be written and a region to be filled in for displaying the form to be filled in, the display area and the region to be filled in not overlapping.

In one possible implementation, the display device 17 may further include a generating module 1705.

The generating module 1705 may be configured to generate a plurality of cells according to the content to be written, and a second punctuation mark corresponding to the first punctuation mark in a one-to-one correspondence, where the plurality of cells correspond to the text to be written in the content to be written in a one-to-one correspondence.

The generating module 1705 may be further configured to generate a table to be filled in according to the plurality of cells and the second punctuation mark.

The display module 1701 may also be configured to display a form to be filled in the area to be filled in.

In a possible implementation manner, the determining module 1703 may be further configured to match, in order, a written text included in the user writing content with a text to be written corresponding to an unmatched cell, and determine whether the user writing content is matched with the content to be written; the unmatched cells are cells in the plurality of cells that do not display the user writing.

It should be understood that the division of units or modules (hereinafter referred to as units) in the above apparatus is merely a division of logic functions, and may be fully or partially integrated into one physical entity or may be physically separated. And the units in the device can be all realized in the form of software calls through the processing element; or can be realized in hardware; it is also possible that part of the units are implemented in the form of software, which is called by the processing element, and part of the units are implemented in the form of hardware.

For example, each unit may be a processing element that is set up separately, may be implemented as integrated in a certain chip of the apparatus, or may be stored in a memory in the form of a program, and the functions of the unit may be called and executed by a certain processing element of the apparatus. Furthermore, all or part of these units may be integrated together or may be implemented independently. The processing element described herein, which may also be referred to as a processor, may be an integrated circuit with signal processing capabilities. In implementation, each step of the above method or each unit above may be implemented by an integrated logic circuit of hardware in a processor element or in the form of software called by a processing element.

In one example, the units in the above apparatus may be one or more integrated circuits configured to implement the above method, for example: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of at least two of these integrated circuit forms.

For another example, when the units in the apparatus may be implemented in the form of a scheduler of processing elements, the processing elements may be general-purpose processors, such as CPUs or other processors that may invoke programs. For another example, the units may be integrated together and implemented in the form of a system on chip SOC.

In one implementation, the above means for implementing each corresponding step in the above method may be implemented in the form of a processing element scheduler. For example, the apparatus may comprise a processing element and a storage element, the processing element invoking a program stored in the storage element to perform the method described in the above method embodiments. The memory element may be a memory element on the same chip as the processing element, i.e. an on-chip memory element.

In another implementation, the program for performing the above method may be on a memory element on a different chip than the processing element, i.e. an off-chip memory element. At this point, the processing element invokes or loads a program from the off-chip storage element onto the on-chip storage element to invoke and execute the method described in the method embodiments above.

For example, embodiments of the present application may also provide an apparatus, such as: the display device may include: a processor, a memory for storing instructions executable by the processor. The processor is configured to execute the above instructions, causing the display device to implement the display method as described in the previous embodiments. The memory may be located within the display device or may be located external to the display device. And the processor includes one or more.

In yet another implementation, the unit implementing each step in the above method may be configured as one or more processing elements, where the processing elements may be disposed on a display device corresponding to the foregoing, and the processing elements may be integrated circuits, for example: one or more ASICs, or one or more DSPs, or one or more FPGAs, or a combination of these types of integrated circuits. These integrated circuits may be integrated together to form a chip.

For example, the embodiment of the application also provides a chip, and the chip can be applied to the display device. The chip includes one or more interface circuits and one or more processors; the interface circuit and the processor are interconnected through a circuit; the processor receives and executes computer instructions from the memory of the display device through the interface circuit to implement the methods described in the method embodiments above.

Embodiments of the present application also provide a computer readable storage medium having computer program instructions stored thereon. The computer program instructions, when executed by a display device, enable the display device to implement a display method as described above.

The embodiment of the application also provides a computer program product, which comprises computer instructions for running on the display device, and when the computer instructions run on the display device, the display device can realize the display method. From the foregoing description of the embodiments, it will be apparent to those skilled in the art that, for convenience and brevity of description, only the above-described division of functional modules is illustrated, and in practical application, the above-described functional allocation may be implemented by different functional modules according to needs, i.e. the internal structure of the apparatus is divided into different functional modules to implement all or part of the functions described above.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the modules or units is merely a logical functional division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another apparatus, or some features may be omitted, or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and the parts displayed as units may be one physical unit or a plurality of physical units, may be located in one place, or may be distributed in a plurality of different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a readable storage medium. With such understanding, the technical solutions of the embodiments of the present application may be essentially or partly contributing to the prior art or all or part of the technical solutions may be embodied in the form of a software product, such as: and (5) program. The software product is stored in a program product, such as a computer readable storage medium, comprising instructions for causing a device (which may be a single-chip microcomputer, chip or the like) or processor (processor) to perform all or part of the steps of the methods described in the various embodiments of the application. And the aforementioned storage medium includes: a usb disk, a removable hard disk, a ROM, a RAM, a magnetic disk, or an optical disk, etc.

For example, embodiments of the present application may also provide a computer-readable storage medium having computer program instructions stored thereon. The computer program instructions, when executed by a display device, cause the display device to implement the display method as described in the foregoing method embodiments.

The foregoing is merely a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope of the present disclosure should be covered in the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A display device, the display device comprising:

the display is configured to display an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in the display equipment, the interface to be written comprises contents to be written and a form to be filled in, the form to be filled in comprises a plurality of cells, and the cells are used for correspondingly filling in the contents to be written in;

the touch control component is configured to receive writing operation input by a user in a writing area of the interface to be written;

a controller coupled to the display and the touch assembly, respectively, and configured to:

controlling the display to display user writing content in response to the writing operation, and determining whether the user writing content is matched with the content to be written;

controlling the display to display first writing content in at least one cell corresponding to the user writing content under the condition that the user writing content is matched with the content to be written, wherein the first writing content corresponds to the user writing content;

and controlling the display to clear the user writing content in the writing area.

2. The display device of claim 1, wherein the controller is further configured to:

displaying first prompt information when the user writing content is not matched with the content to be written, wherein the first prompt information is used for prompting that the user writing content has errors;

responding to the modification operation input by the user in the writing area, controlling the display to display user modification content, and determining whether the user modification content is matched with the content to be written or not;

controlling the display to display second writing content in at least one cell corresponding to the user modifying content under the condition that the user modifying content is matched with the content to be written, wherein the second writing content corresponds to the user modifying content;

controlling the display to clear the user-modified content in the writing area.

3. The display device according to claim 1 or 2, wherein the interface to be written further comprises a display area for displaying the content to be written and a region to be filled in for displaying the form to be filled in, the display area and the region to be filled in not overlapping.

4. A display device as recited in claim 3, wherein the content to be written comprises text to be written and a first punctuation mark, the controller further configured to:

generating a plurality of cells and second punctuations which are in one-to-one correspondence with the first punctuations according to the content to be written, wherein the cells are in one-to-one correspondence with texts to be written in the content to be written;

and generating the form to be filled according to the plurality of cells and the second punctuation mark, and controlling the display to display the form to be filled in the area to be filled.

5. The display device of claim 4, wherein the controller is further configured to:

matching the writing text included in the user writing content with the text to be written corresponding to the unmatched cell according to the sequence, and determining whether the user writing content is matched with the text to be written; the unmatched cells are cells in the plurality of cells, in which the user writing content is not displayed.

6. A display method, the method comprising:

displaying an interface to be written, wherein the interface to be written is an interface corresponding to a whiteboard application included in the display equipment, the interface to be written comprises contents to be written and a form to be filled in, the form to be filled in comprises a plurality of cells, and the cells are used for correspondingly filling in the contents to be written in;

Receiving writing operation input by a user in a writing area of the interface to be written;

displaying user writing content in response to the writing operation, and determining whether the user writing content is matched with the content to be written;

displaying first writing content in at least one cell corresponding to the user writing content under the condition that the user writing content is matched with the content to be written, wherein the first writing content corresponds to the user writing content;

and clearing the writing content of the user in the writing area.

7. The method of claim 6, wherein the method further comprises:

responding to the modification operation input by the user in the writing area, displaying user modification content, and determining whether the user modification content is matched with the content to be written or not;

displaying second writing content in at least one cell corresponding to the user modification content under the condition that the user modification content is matched with the content to be written, wherein the second writing content corresponds to the user modification content;

And clearing the user modified content in the writing area.

8. The method of claim 6 or 7, wherein the interface to be written further comprises a display area for displaying the content to be written and a region to be filled in for displaying the form to be filled in, the display area and the region to be filled in not overlapping.

9. The method of claim 8, wherein the content to be written comprises text to be written and a first punctuation mark, the method further comprising, prior to displaying the form to be filled in:

10. The method of claim 9, wherein the determining whether the user written content matches the content to be written comprises: