CN113360031A - Display method, display device, electronic equipment and storage medium - Google Patents

Display method, display device, electronic equipment and storage medium Download PDF

Info

Publication number
CN113360031A
CN113360031A CN202110318668.0A CN202110318668A CN113360031A CN 113360031 A CN113360031 A CN 113360031A CN 202110318668 A CN202110318668 A CN 202110318668A CN 113360031 A CN113360031 A CN 113360031A
Authority
CN
China
Prior art keywords
display
electronic pen
information
splash
ink
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110318668.0A
Other languages
Chinese (zh)
Inventor
刘彦泽
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Priority to CN202110318668.0A priority Critical patent/CN113360031A/en
Publication of CN113360031A publication Critical patent/CN113360031A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812—Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/00—2D [Two Dimensional] image generation
    • G06T11/60—Editing figures and text; Combining figures or text

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The application discloses a display method, a display device, electronic equipment and a storage medium, and belongs to the technical field of electronic equipment. The method is applied to the electronic pen and comprises the following steps: acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device; determining splash-ink image information according to the motion information, the posture information and the relative position information; the splash-ink image information is sent to a display device for the display device to display a splash-ink image characterized by the splash-ink image information. According to the embodiment of the application, the splash-ink painting can be realized when the electronic pen is used, and the use experience of a user is improved.

Description

Display method, display device, electronic equipment and storage medium
Technical Field
The application belongs to the technical field of electronic equipment, and particularly relates to a display method and device, electronic equipment and a storage medium.
Background
As the application range of the display device is wider and wider, the user's demand for convenience in using the display device is increasing. At present, various electronic pens have been developed as handwriting input tools, and users can directly use the electronic pens to perform handwriting input on display devices, thereby improving the convenience of human-computer interaction.
The electronic pen can be used for being matched with drawing software to replace a traditional pencil, a pen, a writing brush and the like to input texts and draw pictures, and brings convenient experience for users. However, at present, when an electronic pen is used, the drawing form of splash-ink drawing cannot be realized, and the use requirements of users of splash-ink drawing cannot be met.
Disclosure of Invention
An object of the embodiments of the present application is to provide a display method, an apparatus, an electronic device, and a storage medium, which can implement splash-ink painting when using an electronic pen, and improve the user experience.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a display method, where the method is applied to an electronic pen, and the electronic pen is in communication connection with a display device, where the method includes:
acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device;
determining splash-ink image information according to the motion information, the posture information and the relative position information;
the splash-ink image information is sent to a display device for the display device to display a splash-ink image characterized by the splash-ink image information.
In a second aspect, an embodiment of the present application provides a display method, where the method is applied to a display device, and the display device is in communication connection with an electronic pen, and the method includes:
receiving splash-ink image information sent by an electronic pen, wherein the splash-ink image information is determined by the electronic pen according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and a screen of a display device;
an image of the splash-ink is displayed, the image information being representative of the splash-ink.
In a third aspect, an embodiment of the present application provides a display apparatus, where the apparatus is applied to an electronic pen, and the electronic pen is in communication connection with a display device, and the apparatus includes:
the electronic pen comprises an acquisition module, a display module and a display module, wherein the acquisition module is used for acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device;
the determining module is used for determining the splash-ink image information according to the motion information, the posture information and the relative position information;
and the sending module is used for sending the splash-ink image information to the display device so that the display device can display the splash-ink image represented by the splash-ink image information.
In a fourth aspect, an embodiment of the present application provides a display apparatus, where the apparatus is applied to a display device, and the display device is in communication connection with an electronic pen, and the apparatus includes:
the electronic pen comprises a receiving module, a display device and a display device, wherein the receiving module is used for receiving splash-ink image information sent by the electronic pen, and the splash-ink image information is determined by the electronic pen according to motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device;
and the display module is used for displaying the splash-ink image represented by the splash-ink image information.
In a fifth aspect, embodiments of the present application provide an electronic device comprising a processor, a memory, and a program or instructions stored on the memory and executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method according to the first aspect, or the program or instructions, when executed by the processor, implementing the steps of the method according to the second aspect.
In a sixth aspect, embodiments of the present application provide a readable storage medium on which a program or instructions are stored, which when executed by a processor implement the steps of the method according to the first aspect, or which when executed by a processor implement the steps of the method according to the second aspect.
In a seventh aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect, or to implement the method according to the second aspect.
In the embodiment of the application, the electronic pen can determine the splash-ink image information according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device, and send the splash-ink image information to the display device. So that the display device can display the splash-ink image represented by the splash-ink image information. So can realize splashing the painting when using the electronic pen, satisfy the user demand that the user splashed the painting, improve user's use experience.
Drawings
Fig. 1 is a schematic structural diagram of a display system according to an embodiment of the present application;
fig. 2 is a schematic flowchart of a display method according to an embodiment of the present application;
FIG. 3 is a schematic view of an acceleration curve provided by an embodiment of the present application;
FIG. 4 is a schematic flow chart of another display method provided in the embodiments of the present application;
FIG. 5 is a schematic flow chart of another display method provided in the embodiments of the present application;
fig. 6 is a schematic structural diagram of a display device according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of another display device provided in an embodiment of the present application;
fig. 8 is a schematic hardware structure diagram of an electronic device according to an embodiment of the present application;
fig. 9 is a hardware configuration diagram of another electronic device provided in an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
In order to solve the problems in the background art, embodiments of the present application provide a display method, an apparatus, an electronic device, and a storage medium. The electronic pen can determine the splash-ink image information according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device, and send the splash-ink image information to the display device. So that the display device can display the splash-ink image represented by the splash-ink image information. So can realize splashing the painting when using the electronic pen, satisfy the user demand that the user splashed the painting, improve user's use experience.
The display method, the display apparatus, the electronic device, and the storage medium provided in the embodiments of the present application are described in detail with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Fig. 1 is a schematic diagram of an architecture of a display system according to an embodiment of the present disclosure, and as shown in fig. 1, the display system may include an electronic pen 110 and a display device 120, which is not limited herein.
Among them, the electronic pen 110 is a device for writing or drawing on a screen of the display device 120, which incorporates various sensors, such as a gravity sensor, an acceleration sensor, and the like. Wherein the acceleration sensor may be a gyroscope. The display device 120 is a device having a screen, which may be a mobile electronic device or a non-mobile electronic device. For example, the Mobile electronic device may be a Mobile phone, a tablet Computer, a notebook Computer, a palmtop Computer, an Ultra-Mobile Personal Computer (UMPC), and the like, and the non-Mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), and the like.
As shown in fig. 1, an electronic pen 110 is communicatively coupled to a display device 120. Alternatively, the communication means may be wired communication or wireless communication. Illustratively, the electronic pen 110 and the display device 120 may communicate via bluetooth.
As an example, the display system may be applied to an application scenario of splash-ink painting. Referring to fig. 1, the electronic pen 110 may acquire motion information and posture information of the body and relative position information of the body and a screen of the display device, and determine splash image information for representing a splash image according to the motion information, the posture information and the relative position information, and then transmit the splash image information to the display device 120 so that the display device 120 displays the splash image represented by the splash image information. Therefore, the using requirements of users on splash-ink painting can be met, and the using experience of the users is improved.
A display method provided by an embodiment of the present invention will be described below. Among them, the display method can be applied to the display system shown in fig. 1.
Fig. 2 is a schematic flowchart of a display method provided in an embodiment of the present application, and as shown in fig. 2, the method may include the following steps:
s210, the electronic pen obtains the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device.
In one embodiment, the electronic pen may first acquire motion information of the body, and in a case where the motion information satisfies a preset condition, that is, in a case where the electronic pen is in an ink splash painting state, acquire posture information of the body and relative position information of the body and a screen of the display device, thereby reducing data acquisition pressure of the electronic pen.
The motion information may include acceleration, such as acceleration of the electronic pen on an X-axis, a Y-axis, and a Z-axis in a rectangular spatial coordinate system centered on the electronic pen. The pose information may include an angle of the electronic pen, for example, an angle of the electronic pen with respect to an X-axis, a Y-axis, and a Z-axis in a spatial rectangular coordinate system centered on the electronic pen. The relative position information is used for representing the relative position information relationship between the electronic pen and the display device, and may include a relative distance and a relative direction, for example, the distance and the direction of the electronic pen relative to the screen of the display device when the electronic pen uses the screen of the display device as a reference point.
For example, the electronic pen may acquire the acceleration of the electronic pen in real time, and acquire the posture information and the relative position information in the case that the magnitude of the acceleration is greater than or equal to a preset acceleration threshold. It can be understood that the preset acceleration threshold may be flexibly set according to actual situations, and is not limited herein. Therefore, whether the electronic pen is in an ink splashing drawing state or not can be accurately determined by monitoring the acceleration.
In a specific embodiment, the electronic pen may collect the acceleration of the electronic pen through a gyroscope to generate an acceleration curve. As shown in fig. 3, when the acceleration curve exceeds the preset acceleration threshold, the included angle of the electronic pen is collected by the gravity sensor, and the relative distance and the relative direction between the electronic pen and the screen of the display device, which are collected by the front camera, the TOF module or the dot matrix projector of the display device, are obtained from the display device.
Taking the example of the front camera acquiring the relative distance and the relative direction, the display device can acquire an electronic pen image through the front camera, and determine the relative distance and the relative direction between the electronic pen and the screen of the display device according to the size and the position of the electronic pen in the image.
And S220, determining the splash-ink image information by the electronic pen according to the motion information, the posture information and the relative position information.
In one embodiment, the splash-ink image information may include a display position, a display shape, and a display size of the ink droplets.
The electronic pen may first determine the initial velocity of the ink drop, i.e., the velocity at which the ink drop exits the electronic pen, based on the motion information and the attitude information. And determining the time of flight of the ink drop based on the relative position information and the initial velocity. And determining the end position of the plane where the ink drop falls on the screen according to the relative position information, the initial speed and the flight time. Then, it is judged whether the end position is located in the screen, that is, whether the ink droplet lands in the screen. In the case where the end position is located in the screen, it is determined that the end position is a display position of the ink droplet. Then, based on the initial velocity and the flight time, the end velocity of the landing of the ink droplet at the display position, i.e., the velocity of the landing of the ink droplet in the screen, is determined. Thereby, the display shape and the display size of the ink droplets are determined based on the termination speed, and the splash-ink image information for characterizing the splash-ink image is accurately determined.
As one example, the electronic pen may first calculate a first velocity component, a second velocity component, and a third velocity component of the termination velocity. Wherein the first velocity component is a velocity component of the terminal velocity in a first direction, the second velocity component is a velocity component of the terminal velocity in a second direction, and the third velocity component is a velocity component of the terminal velocity in a third direction. The first direction and the second direction are located on the plane of the screen, the third direction is perpendicular to the plane of the screen, and the first direction, the second direction and the third direction are perpendicular to each other. Then, the display shape of the ink droplet is determined based on the first velocity component and the second velocity component, and the display size of the ink droplet is determined based on the third velocity component. Thus, the display shape and the display size of the ink droplets can be accurately determined according to the velocity components in different directions.
For example, the display shape corresponding to the first velocity component and the second velocity component may be searched from the preset correspondence relationship between the first velocity component and the second velocity component and the display shape, and the display shape may be used as the display shape of the ink droplet. And searching the display size corresponding to the third speed component from the preset corresponding relation between the third speed component and the display size, and taking the display size as the display size of the ink drop. Alternatively, the third velocity component may be input to a liquid area calculation formula, and a liquid area corresponding to the third velocity component may be calculated as the display size of the ink droplet.
And S230, the electronic pen sends the splash-ink image information to the display device.
And S240, the display device displays the splash-ink image represented by the splash-ink image information.
Specifically, the display device receives the splash-ink image information sent by the electronic pen and displays a splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the electronic pen can determine the splash-ink image information according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device, and send the splash-ink image information to the display device. So that the display device can display the splash-ink image represented by the splash-ink image information. So can realize splashing the painting when using the electronic pen, satisfy the user demand that the user splashed the painting, improve user's use experience.
The following describes in detail a display method provided in an embodiment of the present application with reference to a specific example, specifically as follows:
the method comprises the following steps that step 1, an electronic pen acquires acceleration of the electronic pen in a space rectangular coordinate system with the electronic pen as a center in real time through a built-in gyroscope, and the acceleration acquired in a first time period is recorded, wherein the first time period is a time period in which the acceleration is larger than or equal to a preset acceleration threshold value. The magnitude of the initial velocity of the ink drop is then calculated based on the acceleration over the first time period and the duration of the first time period.
And 2, acquiring the included angle of the electronic pen in a space rectangular coordinate system taking the electronic pen as the center by the electronic pen through a built-in gravity sensor in a first time period, and determining the direction of the initial speed of the ink drop according to the included angle.
And 3, acquiring an electronic pen image by the display equipment through the electronic pen acquisition in the first time period, and determining the relative distance and the relative direction between the electronic pen and the display equipment according to the size of the electronic pen in the image.
And 4, establishing a space rectangular coordinate system by the electronic pen by taking the display equipment as a center, wherein the origin of coordinates can be the center of a screen of the display equipment, the X axis can be the width direction of the screen, the Y axis can be the length direction of the screen, and the Z axis can be the direction perpendicular to the plane of the screen. It is understood that the X-axis, Y-axis, and Z-axis of the spatial rectangular coordinate system centered on the display device are the first direction, the second direction, and the third direction, respectively.
And 5, converting the initial speed by the electronic pen into a coordinate system from a space rectangular coordinate system taking the electronic pen as the center to a space rectangular coordinate system taking the display device as the center, and determining the coordinates of the starting point of the ink drop in the space rectangular coordinate system taking the display device as the center according to the relative distance and the relative direction.
And 6, calculating the flight time of the ink drop by the electronic pen according to the starting point coordinate and the converted initial speed, calculating the end point coordinate, namely the end point position of the ink drop in a space rectangular coordinate system taking the electronic pen as the center, according to the starting point coordinate, the converted initial speed and the flight time, and determining the end point coordinate as the display position of the ink drop under the condition that the end point coordinate is positioned in a screen. Then, based on the converted initial velocity and the flight time, the end velocity of the landing of the ink droplet at the display position is calculated. Thereby, the display shape and the display size of the ink droplet are determined based on the termination speed, and the splattered image information including the display position, the display shape, and the display size of the ink droplet is obtained. It will be appreciated that the number of ink drops may be determined by the acceleration of the electronic pen, which may be plural, and is not limited herein.
For example, when the screen of the display device is horizontally placed, the coordinates of the start point of the ink droplet may be D0：(x0，y0，z0) The end coordinate may be D1：(x1，y10), the initial velocity after the conversion of the ink droplet may be
Figure BDA0002992293040000081
The termination velocity of the ink droplets may be
Figure BDA0002992293040000082
Wherein,
Figure BDA0002992293040000083
Figure BDA0002992293040000084
since the ink droplets are only influenced by gravity when flying out
Figure BDA0002992293040000085
The time of flight may be calculated according to a first formula, wherein the first formula may be as follows:
Figure BDA0002992293040000086
where T denotes the time of flight and g denotes the acceleration of gravity.
X may then be calculated according to a second formula1Calculating y according to a third formula1Wherein the second formula and the third formula may be as follows:
x1＝x0+Vx0T (2)
y1＝y0+Vy0T (3)
it can be understood that the center of the screen is the origin of the whole coordinate system, and the coordinates of the boundary of the screen can be obtained, so that D can be judged1：(x1，y10) is located within the screen of the display device. At D1：(x1，y10), in the case of being located within the screen of the display device, V may be calculated according to a fourth formulaz1Wherein the fourth formula may be as follows:
Vz1＝Vz0+gT (4)
then, can be based on Vx0And Vy0Determining the display shape of the ink droplet according to Vz1The display size of the ink droplets is determined, resulting in image information including splattering.
And 7, the electronic pen sends splash-ink information to the display device through Bluetooth.
And 8, the display device receives the splash-ink information sent by the display device through the Bluetooth and displays a splash-ink image represented by the splash-ink information.
In one embodiment, scenes that are characteristic of a traditional pen writing can also be simulated by the electronic pen, for example: after a common pen and a gel ink pen are thrown lightly, ink on the pen head becomes more and handwriting becomes thicker when the pen starts to write.
Fig. 4 is a schematic flowchart of another display method provided in an embodiment of the present application, and as shown in fig. 4, the display method is applied to an electronic pen, and the electronic pen is in communication connection with a display device, and the display method includes the following steps:
and S410, acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device.
In one embodiment, the electronic pen may acquire motion information, and acquire the posture information and the relative position information in case that the motion information satisfies a preset condition, thereby reducing data acquisition pressure of the electronic pen.
For example, the motion information may include acceleration, and the electronic pen may acquire the posture information and the relative position information in a case where the magnitude of the acceleration is greater than or equal to a preset acceleration threshold. Therefore, whether the electronic pen is in an ink splashing drawing state or not can be accurately determined by monitoring the acceleration.
And S420, determining the splash-ink image information according to the motion information, the posture information and the relative position information.
In one embodiment, the splash-ink image information may include a display position, a display shape, and a display size of the ink droplets.
The electronic pen may first determine the initial velocity of the ink drop based on the motion information and the attitude information. And determining the time of flight of the ink drop based on the relative position information and the initial velocity. And determining the end position of the plane where the ink drop falls on the screen according to the relative position information, the initial speed and the flight time. And then determines whether the end position is located in the screen. In the case where the end position is located in the screen, it is determined that the end position is a display position of the ink droplet. Then, based on the initial velocity and the time of flight, the end velocity at which the ink droplets land at the display position is determined. Thereby, the display shape and the display size of the ink droplets are determined based on the termination speed, and the splash-ink image information for characterizing the splash-ink image is accurately determined.
As one example, the electronic pen may first calculate a first velocity component, a second velocity component, and a third velocity component of the termination velocity. Wherein the first velocity component is a velocity component of the terminal velocity in a first direction, the second velocity component is a velocity component of the terminal velocity in a second direction, and the third velocity component is a velocity component of the terminal velocity in a third direction. The first direction and the second direction are located on the plane of the screen, the third direction is perpendicular to the plane of the screen, and the first direction, the second direction and the third direction are perpendicular to each other. Then, the display shape of the ink droplet is determined based on the first velocity component and the second velocity component, and the display size of the ink droplet is determined based on the third velocity component. Thus, the display shape and the display size of the ink droplets can be accurately determined according to the velocity components in different directions.
And S430, sending the splash-ink image information to a display device for the display device to display the splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the electronic pen can determine the splash-ink image information according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device, and send the splash-ink image information to the display device for the display device to display the splash-ink image represented by the splash-ink image information. So can realize splashing the painting when using the electronic pen, satisfy the user demand that the user splashed the painting, improve user's use experience.
The method executed by the electronic pen in the embodiment shown in fig. 4 is the same as the method executed by the electronic pen in the embodiment shown in fig. 2, and is not repeated herein for brevity.
Fig. 5 is a schematic flowchart of another display method provided in an embodiment of the present application, and as shown in fig. 5, the display method is applied to a display device, and the display device is in communication connection with an electronic pen, and the display method includes the following steps:
and S510, receiving splash-ink image information sent by the electronic pen.
The splash-ink image information is determined by the electronic pen according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device.
And S520, displaying the splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the display device can receive the splash-ink image information sent by the electronic pen and display the splash-ink image represented by the splash-ink image information. The splash-ink painting can be realized when the electronic pen is used, the use requirement of the splash-ink painting of a user is met, and the use experience of the user is improved.
The method performed by the display device in the embodiment shown in fig. 5 is the same as the method performed by the display device in the embodiment shown in fig. 2, and is not repeated herein for brevity.
It should be noted that the execution main body of the display method provided in the embodiment of the present application may be a display device applied to an electronic pen, or a control module used for executing the display method in the display device; the execution main body of the display method provided by the embodiment can be a display device applied to the display equipment, or a control module used for executing the display method in the display device; in the embodiments of the present application, a method for performing display by using a display device applied to an electronic pen and a method for performing display by using a display device applied to a display device are taken as examples, and a display device applied to an electronic pen and a display device applied to a display device provided in the embodiments of the present application are described.
Fig. 6 is a schematic structural diagram of a display apparatus according to an embodiment of the present application, and as shown in fig. 6, the display apparatus 600 is applied to an electronic pen, the electronic pen is in communication connection with a display device, and the display apparatus 600 includes:
the acquiring module 610 is configured to acquire motion information and posture information of the electronic pen, and relative position information of the electronic pen and a screen of the display device.
A determining module 620, configured to determine the splash-ink image information according to the motion information, the posture information, and the relative position information.
A sending module 630, configured to send the splash-ink image information to a display device, so that the display device displays the splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the electronic pen can determine the splash-ink image information according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device, and send the splash-ink image information to the display device for the display device to display the splash-ink image represented by the splash-ink image information. So can realize splashing the painting when using the electronic pen, satisfy the user demand that the user splashed the painting, improve user's use experience.
In one embodiment, the obtaining module 610 includes:
an acquisition unit for acquiring motion information.
And the acquisition unit is also used for acquiring the posture information and the relative position information under the condition that the motion information meets the preset condition, so that the data acquisition pressure of the electronic pen is reduced.
In one embodiment, the splash-ink image information includes a display position, a display shape, and a display size of the ink droplets.
The determining module 620 includes: and the determining unit is used for determining the initial speed of the ink drop according to the motion information and the attitude information.
And the determining unit is also used for determining the flight time of the ink drop according to the relative position information and the initial speed.
And the determining unit is also used for determining the end position of the plane where the ink drop falls on the screen according to the relative position information, the initial speed and the flight time.
And the determining unit is also used for determining the ending speed of the landing of the ink drop at the display position according to the initial speed and the flight time.
And the determining unit is also used for determining the display shape and the display size of the ink drop according to the termination speed and accurately determining the splash-ink image information for representing the splash-ink image.
In an embodiment, the determining unit is specifically configured to: a first velocity component, a second velocity component, and a third velocity component of the termination velocity are calculated. The first speed component is a speed component of the termination speed in a first direction, the second speed component is a speed component of the termination speed in a second direction, the third speed component is a speed component of the termination speed in a third direction, the first direction and the second direction are located on a plane where a screen is located, the third direction is perpendicular to the plane where the screen is located, and the first direction, the second direction and the third direction are perpendicular to each other.
The display shape of the ink droplets is determined based on the first velocity component and the second velocity component.
The display size of the ink droplets is determined based on the third velocity component. Thus, the display shape and the display size of the ink droplets can be accurately determined according to the velocity components in different directions.
Fig. 7 is a schematic structural diagram of another display apparatus provided in an embodiment of the present application, and as shown in fig. 7, a display apparatus 700 is applied to a display device, the display device is communicatively connected to an electronic pen, and the display apparatus 700 includes:
and the receiving module 710 is configured to receive splash-ink image information sent by the electronic pen. The splash-ink image information is determined by the electronic pen according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device.
And a display module 720 for displaying the splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the display device can receive the splash-ink image information sent by the electronic pen and display the splash-ink image represented by the splash-ink image information. The splash-ink painting can be realized when the electronic pen is used, the use requirement of the splash-ink painting of a user is met, and the use experience of the user is improved.
It is to be noted that the display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an IOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
It can be understood that the display device provided in the embodiment of the present application can implement each process implemented by the method embodiments of fig. 2 to fig. 5, and details are not described here again to avoid repetition.
As shown in fig. 8, an electronic device 800 is further provided in this embodiment of the present application, and includes a processor 801, a memory 802, and a program or an instruction stored in the memory 802 and executable on the processor 801, where the program or the instruction is executed by the processor 801 to implement the processes in the display method embodiment, and can achieve the same technical effects, and no further description is provided herein to avoid repetition.
Fig. 9 is a hardware configuration diagram of another electronic device provided in an embodiment of the present application. The electronic device 900 includes, but is not limited to: a radio frequency unit 901, a network module 902, an audio output unit 903, an input unit 904, a sensor 905, a display unit 906, a user input unit 907, an interface unit 908, a memory 909, and a processor 910.
Those skilled in the art will appreciate that the electronic device 900 may further include a power source (e.g., a battery) for supplying power to various components, and the power source may be logically connected to the processor 910 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system. The electronic device structure shown in fig. 9 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is not repeated here.
The sensor 905 is used for acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device.
A processor 910 for determining the splattered image information based on the motion information, pose information, and relative position information.
And the radio frequency unit 901 is used for sending the splash-ink image information to the display device so that the display device can display the splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the splash-ink image information can be determined according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device, and the splash-ink image information is sent to the display device so that the display device can display a splash-ink image represented by the splash-ink image information. So can realize splashing the painting when using the electronic pen, satisfy the user demand that the user splashed the painting, improve user's use experience.
In one embodiment, the sensor 905 is specifically configured to: and acquiring the motion information, and acquiring the posture information and the relative position information under the condition that the motion information meets the preset condition, so that the data acquisition pressure of the electronic pen is reduced.
In one embodiment, the splash-ink image information includes a display position, a display shape, and a display size of the ink droplets.
The processor 910 is specifically configured to: based on the motion information and the attitude information, an initial velocity of the ink drop is determined.
Based on the relative position information and the initial velocity, the time of flight of the ink drop is determined.
And determining the end position of the plane where the ink drop falls on the screen according to the relative position information, the initial speed and the flight time.
Based on the initial velocity and the time of flight, the terminal velocity at which the ink drops land at the display location is determined.
According to the termination speed, the display shape and the display size of the ink droplets are determined, and splash-ink image information for characterizing a splash-ink image is accurately determined.
In one embodiment, the processor 910 is specifically configured to: a first velocity component, a second velocity component, and a third velocity component of the termination velocity are calculated. The first speed component is a speed component of the termination speed in a first direction, the second speed component is a speed component of the termination speed in a second direction, the third speed component is a speed component of the termination speed in a third direction, the first direction and the second direction are located on a plane where a screen is located, the third direction is perpendicular to the plane where the screen is located, and the first direction, the second direction and the third direction are perpendicular to each other.
The display shape of the ink droplets is determined based on the first velocity component and the second velocity component.
The display size of the ink droplets is determined based on the third velocity component. Thus, the display shape and the display size of the ink droplets can be accurately determined according to the velocity components in different directions.
An embodiment of the present application further provides an electronic device, as shown in fig. 9.
The radio frequency unit 901 is configured to receive splash-ink image information sent by the electronic pen. The splash-ink image information is determined by the electronic pen according to the motion information and the posture information of the electronic pen and the relative position information of the electronic pen and the screen of the display device.
A display unit 906 for displaying the splash-ink image represented by the splash-ink image information.
In the embodiment of the application, the splash-ink image information sent by the electronic pen can be received, and a splash-ink image represented by the splash-ink image information is displayed. The splash-ink painting can be realized when the electronic pen is used, the use requirement of the splash-ink painting of a user is met, and the use experience of the user is improved.
It should be understood that, in the embodiment of the present application, the input Unit 904 may include a Graphics Processing Unit (GPU) and a microphone, and the Graphics Processing Unit processes image data of still pictures or videos obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 906 may include a display panel, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 907 includes a touch panel and other input devices. Touch panels, also known as touch screens. The touch panel may include two parts of a touch detection device and a touch controller. Other input devices may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. Memory 909 can be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 910 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications. It is to be appreciated that the modem processor described above may not be integrated into processor 910.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device in the above embodiment. Readable storage media, including computer-readable storage media, such as Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, etc.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the display method embodiment, and the same technical effect can be achieved.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims (10)

1. A display method is applied to an electronic pen which is in communication connection with a display device, and comprises the following steps:
acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device;
determining splash-ink image information according to the motion information, the posture information and the relative position information;
and sending the splash image information to the display device for the display device to display a splash image represented by the splash image information.
2. The method according to claim 1, wherein the acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a display device comprises:
acquiring the motion information;
and acquiring the attitude information and the relative position information under the condition that the motion information meets a preset condition.
3. The method of claim 1 or 2, wherein the splattered image information includes a display position, a display shape, and a display size of an ink droplet, and the determining the splattered image information according to the motion information, the posture information, and the relative position information includes:
determining an initial velocity of the ink drop according to the motion information and the attitude information;
determining the flight time of the ink drop according to the relative position information and the initial speed;
determining the final position of the plane where the ink drop falls on the screen according to the relative position information, the initial speed and the flight time;
determining a termination speed of landing of the ink drop at the display position according to the initial speed and the flight time;
and determining the display shape and the display size of the ink drop according to the termination speed.
4. The method of claim 3, wherein said determining a display shape and a display size of said ink drop based on said termination velocity comprises:
calculating a first velocity component, a second velocity component and a third velocity component of the termination velocity, wherein the first velocity component is a velocity component of the termination velocity in a first direction, the second velocity component is a velocity component of the termination velocity in a second direction, the third velocity component is a velocity component of the termination velocity in a third direction, the first direction and the second direction are in a plane of the screen, the third direction is perpendicular to the plane of the screen, and the first direction, the second direction and the third direction are perpendicular to each other;
determining a display shape of the ink droplet according to the first velocity component and the second velocity component;
determining a display size of the ink droplet according to the third velocity component.
5. A display method is applied to a display device which is in communication connection with an electronic pen, and comprises the following steps:
receiving splash-ink image information sent by the electronic pen, wherein the splash-ink image information is determined by the electronic pen according to motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of a display device;
displaying a splash-ink image characterized by the splash-ink image information.
6. A display apparatus, wherein the apparatus is applied to an electronic pen, the electronic pen is connected with a display device in communication, the apparatus comprises:
the acquisition module is used for acquiring motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display equipment;
the determining module is used for determining splash-ink image information according to the motion information, the posture information and the relative position information;
and the sending module is used for sending the splash-ink image information to the display device so that the display device can display the splash-ink image represented by the splash-ink image information.
7. The apparatus of claim 6, wherein the splattered image information includes a display position, a display shape, and a display size of the ink droplets, and the determining module comprises:
a determining unit, configured to determine an initial velocity of the ink droplet according to the motion information and the attitude information;
the determining unit is further used for determining the flight time of the ink drop according to the relative position information and the initial speed;
the determining unit is further configured to determine an end position of the plane where the ink droplet lands on the screen according to the relative position information, the initial speed, and the flight time;
the determining unit is further used for determining the ending speed of the ink drop falling at the display position according to the initial speed and the flight time;
the determining unit is further configured to determine a display shape and a display size of the ink droplet according to the termination speed.
8. A display device, wherein the device is applied to a display device, the display device is connected with an electronic pen in a communication way, and the device comprises:
the electronic pen comprises a receiving module, a display module and a display module, wherein the receiving module is used for receiving splash-ink image information sent by the electronic pen, and the splash-ink image information is determined by the electronic pen according to motion information and posture information of the electronic pen and relative position information of the electronic pen and a screen of the display device;
and the display module is used for displaying the splash-ink image represented by the splash-ink image information.
9. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the display method according to any one of claims 1 to 4 or the program or instructions when executed by the processor implementing the steps of the display method according to claim 5.
10. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the display method according to any one of claims 1-4, or which, when executed by a processor, implement the steps of the display method according to claim 5.
CN202110318668.0A 2021-03-25 2021-03-25 Display method, display device, electronic equipment and storage medium Pending CN113360031A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110318668.0A CN113360031A (en) 2021-03-25 2021-03-25 Display method, display device, electronic equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110318668.0A CN113360031A (en) 2021-03-25 2021-03-25 Display method, display device, electronic equipment and storage medium

Publications (1)

Publication Number Publication Date
CN113360031A true CN113360031A (en) 2021-09-07

Family

ID=77525033

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110318668.0A Pending CN113360031A (en) 2021-03-25 2021-03-25 Display method, display device, electronic equipment and storage medium

Country Status (1)

Country Link
CN (1) CN113360031A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114827972A (en) * 2022-06-28 2022-07-29 荣耀终端有限公司 Method for establishing connection with stylus pen and electronic equipment

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107924286A (en) * 2015-08-13 2018-04-17 三星电子株式会社 The input method of electronic equipment and electronic equipment
CN110647246A (en) * 2018-06-26 2020-01-03 英特尔公司 Predictive detection of user intent in stylus use
CN112183521A (en) * 2020-09-30 2021-01-05 中国银行股份有限公司 Intelligent input method, system, equipment and readable storage medium
CN112402974A (en) * 2020-11-23 2021-02-26 成都完美时空网络技术有限公司 Game scene display method and device, storage medium and electronic equipment

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107924286A (en) * 2015-08-13 2018-04-17 三星电子株式会社 The input method of electronic equipment and electronic equipment
CN110647246A (en) * 2018-06-26 2020-01-03 英特尔公司 Predictive detection of user intent in stylus use
CN112183521A (en) * 2020-09-30 2021-01-05 中国银行股份有限公司 Intelligent input method, system, equipment and readable storage medium
CN112402974A (en) * 2020-11-23 2021-02-26 成都完美时空网络技术有限公司 Game scene display method and device, storage medium and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114827972A (en) * 2022-06-28 2022-07-29 荣耀终端有限公司 Method for establishing connection with stylus pen and electronic equipment
CN114827972B (en) * 2022-06-28 2022-11-08 荣耀终端有限公司 Method for establishing connection with stylus pen and electronic equipment

Similar Documents

Publication Publication Date Title
KR101825154B1 (en) Overlapped handwriting input method
EP3617995A1 (en) Augmented reality processing method, object recognition method, and related apparatus
US20140300542A1 (en) Portable device and method for providing non-contact interface
EP2752740A1 (en) Drawing control method, apparatus and mobile terminal
CN113209601B (en) Interface display method and device, electronic equipment and storage medium
WO2022253041A1 (en) Image display method and electronic device
CN110544287A (en) Picture matching processing method and electronic equipment
CN113360031A (en) Display method, display device, electronic equipment and storage medium
CN103677235A (en) Interactive augmented reality system, portable communication device and interaction method
CN113703631A (en) Writing control method and device, electronic equipment and storage medium
WO2022016650A1 (en) Smart pen image processing method, apparatus and electronic device
WO2022016649A1 (en) Method and apparatus for image processing of smart pen, and electronic device
CN109165072A (en) Expression package generation method and device
CN112269481A (en) Method and device for controlling friction force adjustment and electronic equipment
CN112929734A (en) Screen projection method and device and electronic equipment
CN112287708A (en) Near Field Communication (NFC) analog card switching method, device and equipment
CN113703577A (en) Drawing method and device, computer equipment and storage medium
US20220122335A1 (en) Scaling and rendering virtual hand
CN110795016A (en) Display method and electronic equipment
CN112540683B (en) Intelligent ring, handwritten character recognition method and electronic equipment
US20130342437A1 (en) Image data generation using a handheld electronic device
JP5605281B2 (en) WRITE INFORMATION DISPLAY SYSTEM, WRITE INFORMATION DISPLAY DEVICE, AND WRITE INFORMATION DISPLAY METHOD
CN112074419B (en) Transceiver system
CN115686328A (en) Contactless interaction method and device in free space, electronic equipment and storage medium
CN111811452A (en) Distance measurement method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination