CN113835609A - Display method, system, electronic device and storage medium - Google Patents
Display method, system, electronic device and storage medium Download PDFInfo
- Publication number
- CN113835609A CN113835609A CN202111136473.0A CN202111136473A CN113835609A CN 113835609 A CN113835609 A CN 113835609A CN 202111136473 A CN202111136473 A CN 202111136473A CN 113835609 A CN113835609 A CN 113835609A
- Authority
- CN
- China
- Prior art keywords
- display area
- track content
- track
- processor
- window
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000003993 interaction Effects 0.000 claims abstract description 13
- 230000002452 interceptive effect Effects 0.000 claims description 61
- 230000008569 process Effects 0.000 claims description 7
- 238000010586 diagram Methods 0.000 description 10
- 238000004891 communication Methods 0.000 description 7
- 238000012545 processing Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 230000004044 response Effects 0.000 description 4
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 229910052739 hydrogen Inorganic materials 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011982 device technology Methods 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/048—Indexing scheme relating to G06F3/048
- G06F2203/04803—Split screen, i.e. subdividing the display area or the window area into separate subareas
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the application discloses a display method, a display system, an electronic device and a storage medium, wherein a first processor responds first track data of an operation body detected based on a first display area to be first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in the interaction window displayed in the first display area; the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area; the first processor also obtains a display position of the track content display area. Based on the scheme, the problem that the consistency is poor when the display content is updated only through the second processor can be avoided, and the problem that the display content determined by the first processor is not in the content display area can be avoided.
Description
Technical Field
The present application relates to the field of electronic device technologies, and in particular, to a display method and system, an electronic device, and a storage medium.
Background
At present, more and more electronic devices use an electronic ink screen (i.e., an E ink screen) which is displayed by receiving video stream signal output, and when handwriting application software (such as drawing, handwriting note, OneNote, whiteboard, etc.) is used on the E ink screen, the problem of poor screen display stroke following writing property exists.
To overcome the above problem, one solution is to draw lines in combination with hardware, i.e. first receive the track data from the touch pad directly with the driver chip (TCON) of the E ink screen, use this track data to present lines directly on the E ink screen, and then cover this area with the real lines in the received video stream signal output. However, this scheme may occur when an input trace is displayed in a non-drawing area (e.g., a button, a title bar, a non-handwriting software area, etc.) and then a message is sent.
Disclosure of Invention
The application aims to provide a display method, a display system, an electronic device and a storage medium, and comprises the following technical scheme:
a method of displaying, the method comprising:
the first processor responds to first track data of an operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area;
the method further comprises the following steps:
the first processor obtains a display position of the track content display area.
In the above method, preferably, the acquiring, by the first processor, the display position of the track content display area includes:
the first processor receives the display position of the track content display area sent by the second processor; alternatively, the first and second electrodes may be,
the first processor analyzes the interactive window to obtain the display position of the track content display area;
the first processor responds first track data of an operation body detected based on the first display area to first track content, and the method comprises the following steps:
and the first processor responds the track data positioned in the display position in the first track data to be the first track content.
In the above method, preferably, the acquiring, by the second processor, a display position of the track content display area includes:
the second processor reads the display position of the track content display area through an interface provided by an application program to which the interactive window belongs; alternatively, the first and second electrodes may be,
and the second processor analyzes the interactive window and determines the display position of the track content display area.
The method preferably further includes a process of analyzing the interactive window, including:
enumerating all the sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with the area larger than a threshold value;
detecting a track content display area of a first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any one target sub-window;
and if so, determining the display position of the track content display area.
Preferably, the above method, detecting the track content display area of the first target sub-window, includes:
searching same-color rectangular areas at four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area;
if N rectangular areas in the same-color rectangular areas at the four positions are located at N vertex angles of the same target rectangle, searching the same-color right-angled triangular areas at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is greater than the sum of two adjacent right-angle sides of the rectangular area;
and if N right-angled triangle areas in the homochromatic right-angled triangle areas at the four positions are positioned at N top angles of the target rectangle, determining that the area where the target rectangle is positioned is a track content display area.
Preferably, the above method, detecting the track content display area of the first target sub-window, includes:
searching same-color rectangular areas at four positions of upper left, upper right, lower left and lower right in the first target sub-window area;
if N rectangular areas in the homochromatic rectangular areas at the four positions are located at N vertex angles of the same target rectangle, judging whether the right-angled triangular areas at the four vertex angles of the target rectangular area are homochromatic right-angled triangular areas; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is greater than the sum of two adjacent right-angle sides of the rectangular area;
and if so, determining that the area where the target rectangle is located is the track content display area.
In the above method, preferably, the acquiring, by the first processor, the display position of the track content display area includes:
the first processor judges whether the first track content is different from the second track content;
and if so, determining the display position of the track content display area according to the second track content and the part of the second track content, which is lacked relative to the first track content.
The above method, preferably, further comprises:
the second processor determining distances of the track content display area to respective edges of the interaction window;
if the position of the interactive window is determined to be changed, updating the display position of the track content display area according to the distance and the changed display position of the interactive window;
and sending the updated display position of the track content display area to the first processor.
In the method, preferably, the first processor is a processor for refreshing the first display area, and the second processor is a processor for determining display content.
A display system, comprising:
the first processor is used for responding first track data of an operation body detected based on a first display area to first track content and displaying the first track content through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor is used for responding to the first track data to obtain second track content, and updating the first track content displayed in the first display area by using the second track content; the second track content is located in the track content display area;
the first processor is further configured to obtain a display position of the track content display area.
An electronic device, comprising:
a memory for storing a program;
and the processor is used for calling and executing the program in the memory, and realizing the steps of the display method according to any one of the above items by executing the program.
A readable storage medium, having stored thereon a computer program which, when executed by a processor, carries out the steps of the display method as claimed in any one of the preceding claims.
According to the display method, the display system, the electronic device and the storage medium, the first processor responds to the first track data of the operation body detected based on the first display area as the first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in the interaction window displayed in the first display area; the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area; the first processor also obtains a display position of the track content display area. Based on the scheme of the application, the first processor responds to the first track data of the operation body detected based on the first display area as the first track content and displays the first track content, then the second processor responds to the first track data to obtain the second track content, and updates the first track content by using the second track content, wherein the first processor also obtains the display position of the track content display area, so that the first processor can respond to the track data of the operation body detected based on the first display area according to the display position of the track content display area to obtain the track content only displayed in the track content display area, the problem that the display content is poor in writing following performance only by updating the display content through the second processor can be avoided, and the problem that the display content determined by the first processor is not in the content display area can be avoided.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings based on the drawings without creative efforts.
Fig. 1 is a flowchart of an implementation of a display method provided in an embodiment of the present application;
FIG. 2 is a diagram illustrating an example of a user operating an interactive window displayed in a first display area according to an embodiment of the present application;
FIG. 3 is a flowchart of an implementation of analyzing an interactive window according to an embodiment of the present application;
FIG. 4 is a flowchart of an implementation of detecting a trajectory content display area of a first target sub-window according to an embodiment of the present disclosure;
FIG. 5 is a flowchart of an implementation of detecting a trajectory content display area of a first target sub-window according to an embodiment of the present disclosure;
FIG. 6 is a flowchart of an implementation of the first processor obtaining a display position of a track content display area according to an embodiment of the present disclosure;
FIG. 7 is a diagram illustrating an example of a first processor obtaining a display position of a track content display area according to an embodiment of the present application;
FIG. 8 is a diagram illustrating an example of a first processor obtaining a display position of a track content display area according to an embodiment of the present application;
fig. 9 is a schematic structural diagram of a display system according to an embodiment of the present application;
fig. 10 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
The terms "first," "second," "third," "fourth," and the like in the description and in the claims, as well as in the drawings described above, if any, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application described herein are capable of operation in other sequences than described or illustrated herein.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without inventive step, are within the scope of the present disclosure.
The display method provided by the embodiment of the application can be used in an electronic device, the electronic device is provided with a touch display device, such as a liquid crystal touch screen or an electronic ink screen, and a display area (marked as a first display area) of the touch display device can display content and can detect an operation track of an operation body. The electronic device has a first processor and a second processor, wherein,
when the operation body performs touch operation in the first display area, the first display area can detect track data (marked as first track data) of the operation body, the first display area sends the first track data to the first processor, the first processor responds to the first track data to obtain first track content, and the first track content is displayed through the first display area.
The first display area or the first processor can send the first track data to the second processor, so that the second processor responds to the first track data to obtain second track content and updates the first track content displayed in the first display area with the second track content (for example, the second processor sends the second track content to the first processor to instruct the first processor to update the first track content displayed in the first display area to the second display content).
Optionally, the second processor may acquire an image of the operation body through the image acquisition device, and obtain first trajectory data of the operation body by processing the acquired image, based on which, the second processor may project the second trajectory content to the first display area through the projection device.
In the prior art, when the first track content is displayed, a situation that part of the track content in the first track content is not in the track content display area of the interactive window exists, and when the first track content is updated by using the second track content, the part of the track content which is not in the track content display area of the interactive window disappears, so that the intelligence is poor, and the input experience of a user is poor. To overcome this problem, the present application is proposed:
the first processor responds to first track data of an operation body detected based on the first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in the interaction window displayed in the first display area;
the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area;
the first processor further acquires the display position of the track content display area, so that the first processor can obtain the track content only displayed in the track content display area according to the display position of the track content display area and responding to the track data of the operation body detected based on the first display area.
The first processor may obtain a display position of the track content display area prior to responding to the first track data; alternatively, the first and second electrodes may be,
the first processor may determine the display position of the track content display area after the second processor responds to the first track data, for example, determine the display position of the track content display area according to the track change condition after the second track content updates the first track content.
The specific implementation mode can refer to the subsequent content.
Optionally, as shown in fig. 1, an implementation flowchart of a display method provided in the embodiment of the present application may include:
step S101: the first processor acquires a display position of a track content display area in an interactive window displayed in the first display area.
Optionally, the first processor may receive the display position of the track content display area sent by the second processor; alternatively, the first and second electrodes may be,
the first processor may analyze the interactive window to obtain a display position of the track content display area.
Step S102: the first processor responds track data positioned in the display position in the first track data to be first track content, and the first track content is displayed through the first display area;
the first track content is entirely located in a track content display area in the interaction window displayed in the first display area.
As shown in fig. 2, an exemplary diagram of a user operating an interactive window displayed in a first display area is provided for the embodiment of the present application. In this example, the first display area displays an interactive window of drawing software, a trajectory content display area in the interactive window is a rectangular area with four points P1, P2, P3 and P4 as vertexes, and the movement of the operating body (i.e., the finger of the user) from point a to point B in the first display area performs a linear motion, so that the first trajectory content is a straight line segment from a to C as shown in fig. 2 according to the embodiment of the present application. In the prior art, the content of the first trace is a straight line segment from a to B as shown in fig. 2.
Step S103: the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area of the interactive window.
In the embodiment of the present application, the application software to which the interactive window belongs is run on the second processor, so that the second processor can know the display position of the track content display area of the interactive window, and can only respond to the track data located in the display position to obtain the second track content located in the track content display area of the interactive window.
The second track content is identical to the first track content. Taking the scene shown in fig. 2 as an example, the second trajectory content is also a straight line segment from a to C.
And after obtaining the second track content, the second processor displays the second track content through the first display area, namely, the first track content is updated to the second track content.
According to the display method provided by the embodiment of the application, the first processor can obtain the display position of the track content display area in the interactive window displayed in the first display area, so that when responding to the first track data detected by the first display area, the first processor can only respond to the track data located in the track content display area to obtain the first track content located only in the track content display area, and the track content located outside the track content display area cannot appear, and further when the second processor updates the first track content by using the second track content, the situation that the track content located outside the track content display area disappears cannot appear, the intelligence of the display method is improved, and the user experience is improved.
In an optional embodiment, in a case that the first processor may receive the display position of the track content display area sent by the second processor, the manner of the second processor acquiring the display position of the track content display area may be:
and the second processor reads the display position of the track content display area through an interface provided by the application program to which the interactive window belongs. The application program to which the interactive window belongs is aware of the display position of the track content display area in the first display area, and thus, if the application program to which the interactive window belongs provides an access interface, the second process can read the display position of the track content display area through the access interface.
Alternatively, the first and second electrodes may be,
and the second processor analyzes the interactive window and determines the display position of the track content display area.
In an optional embodiment, the first processor analyzes the interactive window, and the process of determining the display position of the track content display area is the same as the process of determining the display position of the track content display area by the second processor, where the second processor may send the interactive window to the first processor, so that the first processor may analyze the interactive window. A specific implementation process of analyzing the interactive window is described below, and an implementation flowchart of analyzing the interactive window provided in the embodiment of the present application is shown in fig. 3, and may include:
step S301: enumerating all the sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with an area larger than a threshold value.
Optionally, for example, to reduce the data processing amount, only all visible sub-windows of the interactive window may be enumerated.
As an example, the target sub-window may be a visible sub-window having an area at least larger than half of the area of the interactive window.
Alternatively, if the child window is not enumerated, the interactive window may be directly taken as the target child window.
Step S302: detecting a track content display area of the first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any one of the target sub-windows.
Optionally, the track content display area is a rectangular area, and therefore, it may be detected whether a rectangular area satisfying the condition exists in the first target sub-window, and if the rectangular area exists, it is determined that the rectangular area is the track content display area, and the display position of the rectangular area is the display position of the track content display area.
Step S302: and if so, determining the display position of the track content display area.
In an alternative embodiment, a flowchart of the above-mentioned implementation of detecting the track content display area of the first target sub-window is shown in fig. 4, and may include:
step S401: and searching the same-color rectangular areas at four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area.
Optionally, four positions of the top left, top right, bottom left and bottom right in the first target sub-window region may be used as initial positions, a rectangular frame is placed at each initial position, and at each initial position, one vertex angle of the rectangular frame coincides with one vertex angle of the first target sub-window region. As an example, the size of the rectangular frame may be a square frame with a size of 1cm × 1cm, and it is determined whether four rectangular regions at the initial position in the first target sub-window region are of the same color, if so, step S402 is performed, otherwise, the positions of the four rectangular frames are adjusted, it is determined whether the four rectangular regions after the positions are adjusted are of the same color, if so, step S402 is performed, otherwise, the step of adjusting the positions of the four rectangular frames is performed until the four rectangular regions of the same color are found, or the first target sub-window region is traversed.
Optionally, the adjusting the positions of the four rectangular frames may include:
moving at least one rectangular frame in the four rectangular frames to a direction close to the center of the first target sub-window area by a preset step length; the moving to the direction close to the center of the first target sub-window area may include, but is not limited to, the following moving modes: moving a first preset step length in parallel with a first edge of the first target sub-window area; moving a second preset step length in parallel with a second edge of the first target sub-window area; moving a third preset step length along the diagonal of the first target sub-window area; wherein the first edge and the second edge are perpendicular to each other.
The first preset step length, the second preset step length and the third preset step length may be the same or different.
Step S402: if N rectangular areas in the homochromatic rectangular areas at the four positions are located at N vertex angles of the same target rectangle (marked as a first target rectangle), searching homochromatic right-angled triangular areas at four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area; n is a positive integer greater than 2, i.e. N is equal to 3 or 4; the sum of two right-angle sides of each right-angle triangular area is larger than the sum of two adjacent right-angle sides of the rectangular area.
The N rectangular regions are located at N vertex angles of the same target rectangle, which means that each of the N rectangular regions has a vertex angle coinciding with a vertex angle of the same rectangle (the rectangle is denoted as the target rectangle).
When searching the homochromatic right-angled triangle region of four positions of top left, top right, bottom left and bottom right in the first target sub-window region, the four positions of top left, top right, bottom left and bottom right in the first target sub-window region can be used as initial positions, a right-angled triangle frame is placed at each initial position, and at each initial position, the right-angled vertex angle of the right-angled triangle frame coincides with a vertex angle of the first target sub-window region. Judging whether the four right-angled triangle areas at the initial positions in the first target sub-window area are homochromatic, if so, executing step S403, otherwise, adjusting the positions of the four right-angled triangle frames, judging whether the four right-angled triangle areas after the positions are adjusted are homochromatic, if so, executing step S403, otherwise, returning to the step of executing the adjustment of the positions of the four right-angled triangle frames until the four homochromatic right-angled triangle areas are found, or, finishing the traversal of the first target sub-window area.
As an example, the two legs of the right triangle frame may be 1cm and 2cm, respectively.
As an example, the two legs of the right triangle frame may be 1.5cm and 1.5cm, respectively.
Optionally, the adjusting the positions of the four right-angled triangle frames may include:
moving at least one of the four right-angled triangular frames to a direction close to the center of the first target sub-window area by a preset step length; the moving to the direction close to the center of the first target sub-window area may include, but is not limited to, the following moving modes: moving a first preset step length in parallel with a first edge of the first target sub-window area; moving a second preset step length in parallel with a second edge of the first target sub-window area; moving a third preset step length along the diagonal of the first target sub-window area; wherein the first edge and the second edge are perpendicular to each other.
The first preset step length, the second preset step length and the third preset step length may be the same or different.
Step S403: and if N right-angled triangle areas in the homochromatic right-angled triangle areas at the four positions are positioned at N top angles of the target rectangle, determining the area where the target rectangle is positioned as a track content display area.
That is, if N rectangular triangle regions among the same-color rectangular triangle regions at four positions are located in the same target rectangle, and the target rectangle is the first target rectangle, it may be determined that the region in which the first target rectangle is located is the track content display region.
In an alternative embodiment, a flowchart of the above-mentioned implementation of detecting the track content display area of the first target sub-window is shown in fig. 5, and may include:
step S501: and searching the same-color rectangular areas at four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area.
The specific implementation process may refer to step S401, which is not described herein again.
Step S502: if N rectangular areas in the same-color rectangular areas at the four positions are located at N vertex angles of the same target rectangle, judging whether the right-angled triangular areas at the four vertex angles of the target rectangular area are the same-color right-angled triangular areas or not; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is larger than the sum of two adjacent right-angle sides of the rectangular area.
And placing a right-angled triangle at each of the four vertex angles of the target rectangular region, wherein the right-angled vertex angle of each right-angled triangle is coincided with one vertex angle of the target rectangular region.
Step S503: and if so, determining the area of the target rectangle as a track content display area.
If at least three of the four right-angled triangle regions are homochromatic right-angled triangle regions, it can be determined that the region where the target rectangle is located is the trajectory content display region.
Compared with the embodiment shown in fig. 4, in the embodiment of the present application, 4 homochromatic right-angled triangle regions are not searched, but whether four right-angled triangle regions at four vertex angles of the target rectangle are homochromatic right-angled triangle regions is directly determined, so that the data processing workload is reduced, and the display efficiency is further improved.
In an optional embodiment, the first processor may obtain the second track content in response to the first track data, and obtain the display position of the track content display area in the interactive window displayed in the first display area after updating the first track content displayed in the first display area by using the second track content.
Optionally, an implementation flowchart of obtaining the display position of the track content display area by the first processor according to the embodiment of the present application is shown in fig. 6, and may include:
step S601: the first processor judges whether the first track content is different from the second track content.
The first processor may record a position of the first track content, and after the first track content is updated by using the second track content, determine whether the position of the first track content still has the first track content, and if not, indicate that the first track content is different from the second track content.
Step S602: and if so, determining the display position of the track content display area according to the second track content and the part of the second track content, which is lacked relative to the first track content.
If the first track content is different from the second track content, the part of the second track content which is lacked relative to the first track content and the second track content can be spliced to obtain the first track content, the splicing point is a point on the boundary of the track content display area, and the boundary of the track content display area is perpendicular to or parallel to the boundary of the interactive window, based on which at least part of the boundary of the track content display area can be determined according to the splicing point and the boundary of the track content display area and the boundary of the interactive window.
As shown in fig. 7, for the first processor provided in this embodiment of the present application, an exemplary diagram of the display position of the track content display area is obtained, in this example, a user may first draw a straight line in a direction shown by D '-E' in the first display area through the operation body, two end points of the straight line are located outside the track content display area, then, the first processor obtains the track content shown by D '-E' in response to the track data on D '-E' detected by the first display area, and the second processor obtains the track content shown by D-E in response to the track data on D '-E', so that the first processor compares the track content shown by D '-E' with the track content shown by D-E to obtain the splicing points D and E, and the user may also draw a straight line in a direction shown by F '-G' in the first display area through the operation body, the two end points of the straight line are positioned outside the track content display area, then the first processor responds to the track data on F '-G' detected by the first display area to obtain the track content shown by F '-G', the second processor responds to the track data on F '-G' to obtain the track content shown by F-G, thus, the first processor compares the trace content shown as F '-G' with the trace content shown as F-G to obtain the splice points F and G, and then the first processor can make a straight line parallel to F-G at point D, making a straight line parallel to F-G at point E, making a straight line parallel to D-E at point F, a straight line is drawn at point G parallel to D-E so that the rectangular area formed by the four straight lines drawn at D, E, F, G is the track content display area.
As shown in fig. 8, for the first processor provided in the embodiment of the present application, an exemplary diagram of the display position of the trajectory content display area is obtained, in which the user can draw four straight lines in a "well" shape in the first display area through the operation body, where the four straight lines include two sets of straight lines perpendicular to each other, each set includes two straight lines parallel to each other, based on the foregoing method, two intersection points of each straight line and the boundary of the trajectory content display area can be determined, as shown in fig. 8, the four straight lines together obtain 8 intersection points, which are H, D, J, F, E, I, G, K respectively, and two intersection points having the same coordinate of one dimension but not belonging to one straight line are determined as two points located at the same boundary of the trajectory content display area, for example, H, D is two points at the same boundary of the trajectory content display area, J, F is two points at the same boundary of the trajectory content display area, E. if I is two points on the same boundary of the track content display area, and G, K is two points on the same boundary of the track content display area, a rectangular area formed by a straight line H, D, a straight line J, F, a straight line E, I and a straight line G, K is the track content display area.
In the embodiments shown in fig. 7 and 8, the application program where the interactive window is located may be opened by the user, so that after the application program presents the interactive window, the line drawing operation shown in fig. 7 or 8 is performed in the first display area, so that the first processor may determine the track content display area according to the track data of the operation.
In another embodiment, the user may not perform the line drawing operation, but directly perform handwriting input in the first display area according to the requirement of the user, where the trajectory data of the handwriting input may be entirely located at the position of the trajectory content display area, or partially located at the position of the trajectory content display area, and partially located outside the position of the trajectory content display area, or entirely located outside the position of the trajectory content display area. And subsequently, the first processor responds to the track data as first track content and displays the first track content every time the track data of the operation body is detected, the second processor responds to the track data to obtain second track content and updates the track content obtained by the first processor, then the determined splicing points after each update are recorded, and statistical analysis is carried out on the splicing points obtained by multiple operations to obtain a track content display area.
In an optional embodiment, the display method provided in the embodiment of the present application may further include:
the second processor determines distances of the track content display area to respective edges of the interactive window.
And if the position of the interactive window is determined to be changed, updating the display position of the track content display area according to the distance and the changed display position of the interactive window.
In the embodiment of the present application, after the position of the interactive window is changed, the display position of the track content display area is also changed correspondingly, and after the display position of the track content display area is changed, the display position of the track content display area is not required to be determined according to the method, and the updated display position of the track content display area can be determined only according to the distance of each edge of the interactive window and the changed display position of the interactive window.
And sending the updated display position of the track content display area to the second processor.
Optionally, the first processor may be a processor for refreshing the first display area, for example, a driving chip of the touch display device may be used. The second processor may be a processor for determining the content of the display, for example, a central processing unit CPU.
Optionally, the first processor and the second processor may communicate via a serial bus interface, or may communicate via a Windows Management Instrument (WMI) mode.
Corresponding to the method embodiment, an embodiment of the present application further provides a display system, and a schematic structural diagram of the display system provided in the embodiment of the present application is shown in fig. 9, and may include:
a first processor 901 and a second processor 902; wherein the content of the first and second substances,
the first processor 901 is configured to respond first track data of an operation body detected based on a first display area to first track content, and display the first track content through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor 902 is configured to obtain second track content in response to the first track data, and update the first track content displayed in the first display area with the second track content; the second track content is located in the track content display area;
the first processor 901 is further configured to obtain a display position of the track content display area.
In the display system provided by the embodiment of the application, the first processor can obtain the display position of the track content display area in the interactive window displayed in the first display area, so that when responding to the first track data detected by the first display area, the first processor can only respond to the track data located in the track content display area to obtain the first track content located only in the track content display area, and the track content located outside the track content display area cannot appear, and further when the second processor updates the first track content by using the second track content, the situation that the track content located outside the track content display area disappears cannot appear, the intelligence of the display method is improved, and the user experience is improved.
In an optional embodiment, the first processor, when obtaining the display position of the track content display area, is configured to:
receiving the display position of the track content display area sent by the second processor; alternatively, the first and second electrodes may be,
analyzing the interactive window to obtain the display position of the track content display area;
the first processor is used for responding first track data of an operation body detected based on the first display area to first track content, and is used for:
and responding the track data positioned in the display position in the first track data as the first track content.
In an optional embodiment, when the second processor obtains the display position of the track content display area, the second processor is configured to:
reading the display position of the track content display area through an interface provided by an application program to which the interactive window belongs; alternatively, the first and second electrodes may be,
and analyzing the interactive window to determine the display position of the track content display area.
In an optional embodiment, when the first processor or the second processor analyzes the interactive window, the first processor or the second processor is configured to:
enumerating all the sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with the area larger than a threshold value;
detecting a track content display area of a first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any one target sub-window;
and if so, determining the display position of the track content display area.
In an optional embodiment, when the first processor or the second processor performs the track content display area detection on the first target sub-window, the first processor or the second processor is configured to:
searching same-color rectangular areas at four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area;
if N rectangular areas in the same-color rectangular areas at the four positions are located at N vertex angles of the same target rectangle, searching the same-color right-angled triangular areas at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is greater than the sum of two adjacent right-angle sides of the rectangular area;
and if N right-angled triangle areas in the homochromatic right-angled triangle areas at the four positions are positioned at N top angles of the target rectangle, determining that the area where the target rectangle is positioned is a track content display area.
In an optional embodiment, when the first processor or the second processor performs the track content display area detection on the first target sub-window, the first processor or the second processor is configured to:
searching same-color rectangular areas at four positions of upper left, upper right, lower left and lower right in the first target sub-window area;
if N rectangular areas in the homochromatic rectangular areas at the four positions are located at N vertex angles of the same target rectangle, judging whether the right-angled triangular areas at the four vertex angles of the target rectangular area are homochromatic right-angled triangular areas; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is greater than the sum of two adjacent right-angle sides of the rectangular area;
and if so, determining that the area where the target rectangle is located is the track content display area.
In an optional embodiment, when the first processor obtains the display position of the track content display area, the first processor is configured to:
judging whether the first track content is different from the second track content;
and if so, determining the display position of the track content display area according to the second track content and the part of the second track content, which is lacked relative to the first track content.
In an optional embodiment, the second processor is further configured to:
determining the distance from the track content display area to each edge of the interactive window;
if the position of the interactive window is determined to be changed, updating the display position of the track content display area according to the distance and the changed display position of the interactive window;
and sending the updated display position of the track content display area to the first processor.
In an optional embodiment, the first processor is a processor for refreshing the first display area, and the second processor is a processor for determining display content.
Corresponding to the method embodiment, the present application further provides an electronic device, a schematic structural diagram of which is shown in fig. 10, and the electronic device may include: at least two processors (processor 11, processor 12), at least one communication interface 2, at least one memory 3, at least one communication bus 4 and at least one touch display device 5;
the processor 11, the processor 12, the communication interface 2, the memory 3 and the touch display device 5 can complete mutual communication through the communication bus 4;
the processor 11 may be a driving chip of the touch display device; the processor 12 may be a central processing unit CPU, or an application Specific Integrated circuit asic, or one or more Integrated circuits configured to implement embodiments of the present application, or the like;
the memory 3 may include a high-speed RAM memory, and may further include a non-volatile memory (non-volatile memory) or the like, such as at least one disk memory;
wherein the memory 3 stores a program, and the processor 11 and the processor 12 may call the program stored in the memory 3 for:
the first processor responds to first track data of an operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area;
the method further comprises the following steps:
the first processor obtains a display position of the track content display area.
Alternatively, the detailed function and the extended function of the program may be as described above.
Embodiments of the present application further provide a storage medium, where a program suitable for execution by a processor may be stored, where the program is configured to:
the first processor responds to first track data of an operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area;
the method further comprises the following steps:
the first processor obtains a display position of the track content display area.
Alternatively, the detailed function and the extended function of the program may be as described above.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the several embodiments provided in the present application, it should be understood that the disclosed system and method may be implemented in other ways. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
It should be understood that the technical problems can be solved by combining and combining the features of the embodiments from the claims.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application or portions thereof that substantially contribute to the prior art may be embodied in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the application. Thus, the present application is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (10)
1. A method of displaying, the method comprising:
the first processor responds to first track data of an operation body detected based on a first display area as first track content, and the first track content is displayed through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor responds to the first track data to obtain second track content, and the first track content displayed in the first display area is updated by the second track content; the second track content is located in the track content display area;
the method further comprises the following steps:
the first processor obtains a display position of the track content display area.
2. The method of claim 1, the first processor obtaining a display position of the track content display area, comprising:
the first processor receives the display position of the track content display area sent by the second processor; alternatively, the first and second electrodes may be,
the first processor analyzes the interactive window to obtain the display position of the track content display area;
the first processor responds first track data of an operation body detected based on the first display area to first track content, and the method comprises the following steps:
and the first processor responds the track data positioned in the display position in the first track data to be the first track content.
3. The method of claim 2, the second processor obtaining a display position of the track content display area, comprising:
the second processor reads the display position of the track content display area through an interface provided by an application program to which the interactive window belongs; alternatively, the first and second electrodes may be,
and the second processor analyzes the interactive window and determines the display position of the track content display area.
4. The method of claim 2 or 3, the process of analyzing the interactive window comprising:
enumerating all the sub-windows of the interactive window to screen out at least one target sub-window; the target sub-window is a sub-window with the area larger than a threshold value;
detecting a track content display area of a first target sub-window to judge whether the track content display area exists in the first target sub-window; the first target sub-window is any one target sub-window;
and if so, determining the display position of the track content display area.
5. The method of claim 4, wherein the detecting the trajectory content display region for the first target sub-window comprises:
searching same-color rectangular areas at four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area;
if N rectangular areas in the same-color rectangular areas at the four positions are located at N vertex angles of the same target rectangle, searching the same-color right-angled triangular areas at the four positions of the top left, the top right, the bottom left and the bottom right in the first target sub-window area; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is greater than the sum of two adjacent right-angle sides of the rectangular area;
and if N right-angled triangle areas in the homochromatic right-angled triangle areas at the four positions are positioned at N top angles of the target rectangle, determining that the area where the target rectangle is positioned is a track content display area.
6. The method of claim 4, wherein the detecting the trajectory content display region for the first target sub-window comprises:
searching same-color rectangular areas at four positions of upper left, upper right, lower left and lower right in the first target sub-window area;
if N rectangular areas in the homochromatic rectangular areas at the four positions are located at N vertex angles of the same target rectangle, judging whether the right-angled triangular areas at the four vertex angles of the target rectangular area are homochromatic right-angled triangular areas; n is a positive integer greater than 2; the sum of two right-angle sides of each right-angle triangular area is greater than the sum of two adjacent right-angle sides of the rectangular area;
and if so, determining that the area where the target rectangle is located is the track content display area.
7. The method of claim 1, the first processor obtaining a display position of the track content display area, comprising:
the first processor judges whether the first track content is different from the second track content;
and if so, determining the display position of the track content display area according to the second track content and the part of the second track content, which is lacked relative to the first track content.
8. The method of claim 1, further comprising:
the second processor determining distances of the track content display area to respective edges of the interaction window;
if the position of the interactive window is determined to be changed, updating the display position of the track content display area according to the distance and the changed display position of the interactive window;
and sending the updated display position of the track content display area to the first processor.
9. The method of any of claims 1-8, the first processor being a processor for refreshing the first display area, the second processor being a processor for determining display content.
10. A display system, comprising:
the first processor is used for responding first track data of an operation body detected based on a first display area to first track content and displaying the first track content through the first display area; at least part of the first track content is located in a track content display area in an interaction window displayed in the first display area;
the second processor is used for responding to the first track data to obtain second track content, and updating the first track content displayed in the first display area by using the second track content; the second track content is located in the track content display area;
the first processor is further configured to obtain a display position of the track content display area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111136473.0A CN113835609A (en) | 2021-09-27 | 2021-09-27 | Display method, system, electronic device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111136473.0A CN113835609A (en) | 2021-09-27 | 2021-09-27 | Display method, system, electronic device and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113835609A true CN113835609A (en) | 2021-12-24 |
Family
ID=78970846
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111136473.0A Pending CN113835609A (en) | 2021-09-27 | 2021-09-27 | Display method, system, electronic device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113835609A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150220797A1 (en) * | 2014-02-06 | 2015-08-06 | Sony Corporation | Information processing system, information processing method, and program |
| CN108475178A (en) * | 2017-04-21 | 2018-08-31 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus and its content input method |
| CN110134261A (en) * | 2019-05-22 | 2019-08-16 | 贵州大学 | It is a kind of to restore the electronic pen really write |
| CN112783408A (en) * | 2021-01-28 | 2021-05-11 | 维沃移动通信有限公司 | Gesture navigation method and device of electronic equipment, equipment and readable storage medium |
-
2021
- 2021-09-27 CN CN202111136473.0A patent/CN113835609A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150220797A1 (en) * | 2014-02-06 | 2015-08-06 | Sony Corporation | Information processing system, information processing method, and program |
| CN108475178A (en) * | 2017-04-21 | 2018-08-31 | 深圳市柔宇科技有限公司 | Head-mounted display apparatus and its content input method |
| CN110134261A (en) * | 2019-05-22 | 2019-08-16 | 贵州大学 | It is a kind of to restore the electronic pen really write |
| CN112783408A (en) * | 2021-01-28 | 2021-05-11 | 维沃移动通信有限公司 | Gesture navigation method and device of electronic equipment, equipment and readable storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107577495B (en) | Interface display method, device and terminal | |
| US8098879B2 (en) | Information processing device, image movement instructing method, and information storage medium | |
| CN106547534B (en) | Device and method for displaying page expansion point | |
| CN107506123B (en) | It adjusts operation and executes method, apparatus and terminal | |
| US11403819B2 (en) | Three-dimensional model processing method, electronic device, and readable storage medium | |
| US20140111483A1 (en) | Monitoring interactions between two or more objects within an environment | |
| CN108733296B (en) | Method, device and equipment for erasing handwriting | |
| US20160349972A1 (en) | Data browse apparatus, data browse method, and storage medium | |
| CN111309203B (en) | Method and device for acquiring positioning information of mouse cursor | |
| US10031667B2 (en) | Terminal device, display control method, and non-transitory computer-readable recording medium | |
| CN105824531A (en) | Method and device for adjusting numbers | |
| JP2015158900A (en) | Information processing device, information processing method and information processing program | |
| CN112306235A (en) | Gesture operation method, device, equipment and storage medium | |
| US11494961B2 (en) | Sticker generating method and apparatus, and medium and electronic device | |
| CN108492349A (en) | Processing method, device and equipment for writing strokes and storage medium | |
| CN110740315A (en) | Camera correction method and device, electronic equipment and storage medium | |
| EP3125089B1 (en) | Terminal device, display control method, and program | |
| CN111506532B (en) | Method for fast switching transmission channel on display device by different USB host devices | |
| CN113835609A (en) | Display method, system, electronic device and storage medium | |
| CN116645672A (en) | Method, system, terminal and medium based on image frame selection recognition and automatic input | |
| CN114863008B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN110737417A (en) | demonstration equipment and display control method and device of marking line thereof | |
| EP3051401B1 (en) | Image display apparatus, image enlargement method, and image enlargement program | |
| JP2015061157A (en) | Information display device, input information correction program, and input information correction method | |
| US10846878B2 (en) | Multi-axis equal spacing smart guides |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |