CN108596105B - Augmented reality painting and calligraphy system - Google Patents
Augmented reality painting and calligraphy system Download PDFInfo
- Publication number
- CN108596105B CN108596105B CN201810384037.7A CN201810384037A CN108596105B CN 108596105 B CN108596105 B CN 108596105B CN 201810384037 A CN201810384037 A CN 201810384037A CN 108596105 B CN108596105 B CN 108596105B
- Authority
- CN
- China
- Prior art keywords
- painting
- information
- calligraphy
- pattern
- positioning mark
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000010422 painting Methods 0.000 title claims abstract description 99
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 18
- 238000005516 engineering process Methods 0.000 claims abstract description 17
- 238000000034 method Methods 0.000 claims description 11
- 239000003086 colorant Substances 0.000 claims description 10
- 230000008859 change Effects 0.000 claims description 8
- 230000001133 acceleration Effects 0.000 claims description 7
- 230000000694 effects Effects 0.000 claims description 3
- 238000000605 extraction Methods 0.000 claims description 3
- 238000003709 image segmentation Methods 0.000 claims description 3
- 238000009877 rendering Methods 0.000 claims description 3
- 238000010586 diagram Methods 0.000 description 11
- 238000004590 computer program Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 239000004973 liquid crystal related substance Substances 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/001—Texturing; Colouring; Generation of texture or colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/20—Drawing from basic elements, e.g. lines or circles
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/04—Context-preserving transformations, e.g. by using an importance map
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/20—Image preprocessing
- G06V10/24—Aligning, centring, orientation detection or correction of the image
- G06V10/245—Aligning, centring, orientation detection or correction of the image by locating a pattern; Special marks for positioning
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention discloses an augmented reality painting and calligraphy system, which comprises: the painting and calligraphy object is provided with a positioning mark for positioning and is an object for writing and drawing; the storage unit is used for storing pattern information used for writing and drawing; the shooting unit is used for shooting a painting and calligraphy object with a positioning mark to obtain shot image information, and the positioning mark is positioned in the image information; the processing unit is respectively connected with the storage unit, the shooting unit and the display unit and is used for acquiring pattern information used for writing and drawing in the storage unit; acquiring a painting and calligraphy object shot by a shooting unit, determining data information for displaying the pattern information on the painting and calligraphy object through AR technology according to a positioning mark in the painting and calligraphy object and a user, and sending the data information to a display unit; and the display unit is used for displaying the painting and calligraphy object and the pattern information according to the data information, and is fixedly connected with the shooting unit.
Description
Technical Field
The invention relates to the field of computers, in particular to an augmented reality painting and calligraphy system.
Background
In the prior art of drawing teaching, wall painting and ground painting, even some of the drawings of fonts, graphs and pictures are drawn on a single plane or a plurality of planes, one method is to project the objects to be drawn on the plane to be drawn through a projector, but the method has an obvious defect that when the fonts, the graphs, the pictures and the like are drawn, the position of a line and the color to be drawn are difficult to accurately determine due to the shielding of hands and the like.
Disclosure of Invention
In order to solve the above problems, the present invention provides an augmented reality painting and calligraphy system, which displays a drawing pattern, an image, and the like on a display screen by an augmented reality technology, thereby facilitating rapid drawing of the pattern. The invention provides an augmented reality painting and calligraphy system, comprising:
the painting and calligraphy object is provided with a positioning mark for positioning and is an object for writing and drawing;
the storage unit is used for storing pattern information used for writing and drawing;
the shooting unit is used for shooting a painting and calligraphy object with a positioning mark to obtain shot image information, and the positioning mark is positioned in the image information;
the processing unit is respectively connected with the storage unit, the shooting unit and the display unit and is used for acquiring pattern information used for writing and drawing in the storage unit; acquiring a painting and calligraphy object shot by a shooting unit, determining data information for displaying the pattern information on the painting and calligraphy object through AR technology according to a positioning mark in the painting and calligraphy object and a user, and sending the data information to a display unit;
the display unit is used for displaying the painting and calligraphy object and the pattern information according to the data information and is fixedly connected with the shooting unit;
the processing unit obtains space position information of the painting and calligraphy object according to the positioning mark, determines data information for displaying the pattern information on the painting and calligraphy object through an AR technology according to pattern information selected by a user and size and direction of the pattern information set by the user relative to the positioning mark, and sends the data information to the display unit, and the display unit displays the pattern information in the image information according to the data information.
In a preferred embodiment of the method of the invention,
the surface of the painting and calligraphy object used for painting and calligraphy is a plane;
and the positioning mark is positioned on the surface for painting and calligraphy.
Preferably, the first and second liquid crystal materials are,
the positioning mark is a plane pattern;
the positioning marks are printed or pasted on the surface for painting and calligraphy.
Preferably, the first and second liquid crystal materials are,
the pattern information for writing and drawing stored in the storage unit is
Is obtained by other devices writing to the memory cell,
or the like, or, alternatively,
the result of shooting by a shooting unit;
or the like, or, alternatively,
and processing the image shot by the shooting unit.
Preferably, the first and second liquid crystal materials are,
the processing unit is further configured to perform image processing on the pattern information according to a setting of a user before determining data information for displaying the pattern information on the painting and calligraphy object by using an AR technique, and the image processing includes:
the image segmentation and/or the image filter use, the filter includes one or more of extraction filter, liquefaction filter, vanishing point filter, stylization filter, painting brush edge-tracing filter, fuzzy filter, distortion adjustment filter, sharpening filter, sketch filter, texturing filter, pixelation filter, rendering filter, artistic effect filter, and variegated filter.
Preferably, the pattern information set by the user includes:
one or more of initial position information of the pattern, zoom information of the pattern, movement information of the pattern, rotation information of the pattern, and color gradation information of the pattern, which are set by a user;
wherein the content of the first and second substances,
when the initial position information of the pattern is not set by a user, the processing unit takes a default value preset by a system as the initial position information of the pattern;
the color layering information of the pattern is set for color layering set by a user, the color layering set comprises the number of color layering layers and/or an area for color layering, and when the number of color layering layers is not set by the user, the processing unit performs color layering on the pattern according to a preset color layering rule;
the processing unit performs color layering on the pattern according to a preset color layering rule, and the implementation is as follows:
the processing unit clusters the colors according to the coordinates of the colors in the patterns in the color space, and when the number of the clustered classifications is greater than the upper limit of the preset number of layers, the processing unit adjusts the clustering parameters and reduces the number of the clustered classifications until the number of the clustered classifications is not greater than the upper limit of the preset number of layers;
the processing unit takes each classification as a color hierarchy and selects the color hierarchy in a preset or user-selected sequence, wherein the preset sequence comprises one or more of an inside and outside sequence of a color space, a coordinate sequence of the color in the color space and a size sequence of a space range occupied by the color.
In a preferred embodiment of the method of the invention,
a plurality of positioning marks are arranged on the surface for painting and calligraphy;
when the positioning mark in the shot image information is one, the processing unit sets the size and the direction of the pattern information by the positioning mark;
when more than one positioning mark is in the shot image information, the processing unit selects one positioning mark according to a preset mark selection rule to be used for setting the size and the direction of the pattern information;
the preset mark selection rule comprises the following steps:
when the positioning mark is a plane pattern, selecting the pattern with the highest pattern integrity;
one positioning mark is randomly selected from a plurality of positioning marks to be selected or the positioning mark closest to the center of the captured image is selected.
In a preferred embodiment of the method of the invention,
the painting and calligraphy object has a plurality of planes for painting and calligraphy, and the planes are communicated;
the planes are provided with one or more positioning marks;
when more than one positioning mark is in the shot image information, the processing unit determines the plane where the positioning mark is located according to each positioning mark; the processing unit obtains the intersection line and the relative angle of the planes of different positioning marks according to the plane of the positioning mark, and the processing unit takes the intersection line adjacent to each positioning mark as the boundary of the plane determined by the positioning mark; the processing unit determines data information of each plane for displaying the pattern information on the painting and calligraphy object through AR technology according to the pattern information selected by the user and located in the storage unit, the size and the direction of the pattern information set by the user relative to one of the plurality of positioning marks, and the boundary and the relative angle of the plane where the plurality of positioning marks are located, wherein the data information of each plane is limited to the data information of the plane within the boundary.
Preferably, the augmented reality painting and calligraphy system further includes:
a three-axis acceleration sensor and a gyroscope;
the three-axis acceleration sensor and the gyroscope are fixedly connected with the display unit, are communicated with the processing unit and are used for acquiring the change of the spatial position and the direction of the display unit;
after the processing unit obtains the spatial position information of the painting and calligraphy object according to the positioning mark, when the shooting unit cannot shoot the positioning mark, the processing unit re-determines the spatial position information of the plane for painting and calligraphy according to the spatial position information of the plane for painting and calligraphy determined when the positioning mark is shot and the change quantity of the spatial position and the direction of the display unit, and determines the data information for displaying the pattern information on the painting and calligraphy object through AR technology according to the re-determined spatial position information of the plane for painting and calligraphy, the pattern information selected by the user and located in the storage unit, and the size and the orientation of the pattern information set by the user relative to the positioning mark.
Some of the benefits of the present invention may include:
the augmented reality painting and calligraphy system provided by the invention can display the graphs and images to be drawn by the user through the display equipment, thereby avoiding the occurrence of light shielding and the like, and being convenient for being used in various places which are difficult to project, so that the user can conveniently draw the graphs and images in various places.
Additional features and advantages of the invention will be set forth in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention will be realized and attained by the structure particularly pointed out in the written description and claims hereof as well as the appended drawings.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this specification, illustrate embodiments of the invention and together with the description serve to explain the principles of the invention and not to limit the invention. In the drawings:
FIG. 1 is a schematic diagram of an augmented reality painting and calligraphy system according to an embodiment of the invention;
FIG. 2 is a drawing illustration according to an embodiment of the present invention;
FIG. 3 is a diagram illustrating a pattern after image processing according to an embodiment of the present invention;
FIG. 4 is a schematic diagram illustrating an augmented reality painting and calligraphy system according to an embodiment of the invention.
Detailed Description
The preferred embodiments of the present invention will be described in conjunction with the accompanying drawings, and it will be understood that they are described herein for the purpose of illustration and explanation and not limitation.
Fig. 1 is a schematic diagram of an augmented reality painting and calligraphy system according to an embodiment of the present invention, as shown in fig. 1, including:
the painting and calligraphy object is provided with a positioning mark for positioning, is an object for writing and drawing, and is a real entity object such as paper, a wall and the like;
a storage unit for storing pattern information for writing and drawing;
the shooting unit is used for shooting a painting and calligraphy object with a positioning mark to obtain shot image information, and the positioning mark is positioned in the image information;
the processing unit is respectively connected with the storage unit, the shooting unit and the display unit and is used for acquiring pattern information used for writing and drawing in the storage unit; acquiring a painting and calligraphy object shot by a shooting unit, determining data information for displaying the pattern information on the painting and calligraphy object through AR technology according to a positioning mark in the painting and calligraphy object and a user, and sending the data information to a display unit;
the display unit is used for displaying the painting and calligraphy object and the pattern information according to the data information and is fixedly connected with the shooting unit;
the processing unit obtains space position information of the painting and calligraphy object according to the positioning mark, determines data information for displaying the pattern information on the painting and calligraphy object through an AR technology according to pattern information selected by a user and size and direction of the pattern information set by the user relative to the positioning mark, and sends the data information to the display unit, and the display unit displays the pattern information in the image information according to the data information.
The augmented reality painting and calligraphy system provided by the invention can display the graphs and images to be drawn by a user through the display equipment, thereby avoiding the occurrence of the conditions of light shielding and the like, and being convenient to be used in various places which are difficult to project, so that the user can conveniently draw the graphs and images in various places.
Since the positioning process by one or more positioning marks can represent only a limited planar state, and for curved surfaces and the like, the case where there are few positioning marks tends to cause difficulty in recognition, and in order to prevent such a case from being used, in one embodiment of the present invention,
the surface of the painting and calligraphy object used for painting and calligraphy is a plane;
and the positioning mark is positioned on the surface for painting and calligraphy.
Since the system uses a camera unit, in order to reduce costs, a mark that can be positioned by a camera, i.e., without using an electronic tag or the like, is used, and in one embodiment of the present invention,
the positioning mark is a plane pattern; the plane pattern is preferably a black-and-white pattern to ensure that the influence on the identification is small when the light changes, and particularly, the plane pattern can also comprise a trademark pattern and the like to facilitate the publicity of the product.
The positioning marks are printed or pasted on the surface for painting and calligraphy, the technology can be conveniently used for various scenes by using a pasting mode, and the printing has better stability.
In order to facilitate the user to obtain the information of the pattern for writing and drawing, the user can directly shoot the character, drawing, font, etc. to be written and drawn by the shooting unit, such as a self-timer mode, in one embodiment of the invention,
the pattern information for writing and drawing stored in the storage unit is
Is obtained by the other device writing to the memory cell,
or the like, or a combination thereof,
the result of shooting by a shooting unit;
or the like, or, alternatively,
and processing the image shot by the shooting unit.
Since users often prefer a certain style of painting and wish to draw realistic images after stylization or the like, in one embodiment of the invention,
the processing unit is further configured to, before determining data information for displaying the pattern information on the painting and calligraphy object by using the AR technology, perform image processing on the pattern information according to a setting of a user, where the image processing includes:
the image segmentation and/or the image filter use, the filter includes one or more of extraction filter, liquefaction filter, vanishing point filter, stylization filter, painting brush edge-tracing filter, fuzzy filter, distortion adjustment filter, sharpening filter, sketch filter, texturing filter, pixelation filter, rendering filter, artistic effect filter, and variegated filter.
In another embodiment of the present invention, as shown in fig. 2-4, fig. 2 is a pattern 201 for drawing stored in a storage unit, and a user extracts a line drawing of the pattern for drawing through a processing unit, and as shown in fig. 3, the pattern is a processed pattern 301 obtained by processing the image of the pattern 201 by the processing unit. As shown in fig. 4, in an embodiment of the present invention, a schematic diagram of an augmented reality painting and calligraphy system is used, a user shoots a page 401 (painting and calligraphy object) printed with a positioning mark 402 through a camera 403 (shooting unit) and then sends shot image information to a processor (processing unit) packaged in a smart terminal 405 (smart phone, tablet computer, or the like), the processor (processing unit) obtains spatial position information of the page 401 (painting and calligraphy object) according to the positioning mark 402, and determines data information for displaying the pattern 301 on the page 401 (painting and calligraphy object) through AR technology according to the pattern 301 selected by the user and located in a storage unit packaged in the smart terminal 405 (smart phone, tablet computer, or the like) and sends the data information to a display unit 404 according to the size and orientation of the pattern 301 set by the user relative to the positioning mark 402, the display unit 404 displays the image information (including the shot page 406, positioning mark 407 on the page, and other shot images) and the display unit 408 on the page 406, and the shot image information is displayed on the display screen 408, and the shot image information includes the shot image information and displayed on the page 408.
Since a user may draw a large or small range of paintings, and when the area that can be photographed by the photographing unit is limited, the photographing unit (and the display unit) may be moved to continue drawing in another area, and therefore, processing such as zooming, rotating, and moving may be performed, and on the other hand, the user may draw a certain color first and then draw another color, and therefore, color of a pattern needs to be displayed in a differentiated manner, in an embodiment of the present invention, the pattern information set by the user includes:
one or more of initial position information of the pattern, zoom information of the pattern, movement information of the pattern, rotation information of the pattern, and color gradation information of the pattern, which are set by a user;
wherein the content of the first and second substances,
when the initial position information of the pattern is not set by a user, the processing unit takes a default value preset by a system as the initial position information of the pattern;
the color layering information of the patterns is color layering setting set by a user, the color layering setting comprises the number of layers of color layering and/or a region for color layering, and when the number of the layers of the color layering is not set by the user, the processing unit carries out color layering on the patterns according to a preset color layering rule;
in order to facilitate the user to layer colors, the work of the user may be reduced by using a clustering method, wherein the processing unit performs color layering on the patterns according to a preset color layering rule, and the implementation is as follows:
the processing unit clusters the colors according to the coordinates of the colors in the patterns in the color space, and when the number of the clustered classifications is greater than the upper limit of the preset number of layers, the processing unit adjusts the clustering parameters and reduces the number of the clustered classifications until the number of the clustered classifications is not greater than the upper limit of the preset number of layers;
the processing unit takes each classification as a color hierarchy and selects the color hierarchy in a preset or user-selected sequence, wherein the preset sequence comprises one or more of an inside and outside sequence of a color space, a coordinate sequence of the color in the color space and a size sequence of a space range occupied by the color.
When the pattern to be drawn is too large, the problem that the whole drawing area cannot be photographed by the photographing unit occurs, so that the positioning mark may not be photographed when a certain area is photographed, in order to prevent this, several more positioning marks need to be provided, in order to perform normal positioning in the case of a plurality of positioning marks, in one embodiment of the present invention,
a plurality of positioning marks are arranged on the surface for painting and calligraphy;
when the positioning mark in the shot image information is one, the processing unit sets the size and the direction of the pattern information by the positioning mark;
when more than one positioning mark is in the shot image information, the processing unit selects one positioning mark according to a preset mark selection rule to be used for setting the size and the direction of the pattern information;
the preset mark selection rule comprises the following steps:
when the positioning mark is a plane pattern, selecting the pattern with the highest pattern integrity;
one positioning mark is randomly selected from a plurality of positioning marks to be selected or the positioning mark closest to the center of the captured image is selected.
Where a wall or the like requires continuous drawing of a pattern, there is often a sudden change in the plane of drawing, and in order to be able to draw in this case, the spatial position, boundaries and relative angle of each plane need to be determined, in one embodiment of the invention,
the painting and calligraphy object has a plurality of planes for painting and calligraphy, and the planes are communicated;
the planes are provided with one or more positioning marks;
when more than one positioning mark is arranged in the shot image information, the processing unit determines the plane where the positioning mark is positioned according to each positioning mark; the processing unit obtains the intersection line and the relative angle of the planes of different positioning marks according to the plane of the positioning mark, and the processing unit takes the intersection line adjacent to each positioning mark as the boundary of the plane determined by the positioning mark; the processing unit determines data information of each plane for displaying the pattern information on the painting and calligraphy object through AR technology according to the pattern information selected by the user and located in the storage unit, the size and the direction of the pattern information set by the user relative to one of the plurality of positioning marks, and the boundary and the relative angle of the plane where the plurality of positioning marks are located, wherein the data information of each plane is limited to the data information of the plane within the boundary.
In order to solve the problem that the positioning mark cannot be shot when the positioning mark is not properly set, in an embodiment of the invention, the augmented reality painting and calligraphy system further includes:
a three-axis acceleration sensor and a gyroscope;
the three-axis acceleration sensor and the gyroscope are fixedly connected with the display unit, are communicated with the processing unit and are used for acquiring the change of the spatial position and direction of the display unit, and the change of the position and angle of the shooting unit (and the display unit) can be obtained through the data of the acceleration and the gyroscope;
after the processing unit obtains the spatial position information of the painting and calligraphy object according to the positioning mark, when the shooting unit cannot shoot the positioning mark, the processing unit re-determines the spatial position information of the plane for painting and calligraphy according to the spatial position information of the plane for painting and calligraphy determined when the positioning mark is shot and the change quantity of the spatial position and the direction of the display unit, and determines the data information for displaying the pattern information on the painting and calligraphy object through AR technology according to the re-determined spatial position information of the plane for painting and calligraphy, the pattern information selected by the user and located in the storage unit, and the size and the orientation of the pattern information set by the user relative to the positioning mark.
The augmented reality painting and calligraphy system provided by the invention can display the graphs and images to be drawn by a user through the display equipment, thereby avoiding the occurrence of the conditions of light shielding and the like, and being convenient to be used in various places which are difficult to project, so that the user can conveniently draw the graphs and images in various places.
According to the augmented reality painting and calligraphy system provided by the invention, the on, off and operation parameters of each intelligent terminal can be automatically set according to the use habit of a user, so that the trouble caused by forgetting to set by the user is avoided.
The present invention has been described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flowchart illustrations and/or block diagrams, and combinations of flows and/or blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.
Claims (8)
1. An augmented reality painting and calligraphy system, comprising:
the painting and calligraphy object is provided with a positioning mark for positioning and is an object for writing and drawing;
a storage unit for storing pattern information for writing and drawing;
the shooting unit is used for shooting a painting and calligraphy object with a positioning mark to obtain shot image information, and the positioning mark is positioned in the image information;
the processing unit is respectively connected with the storage unit, the shooting unit and the display unit and is used for acquiring pattern information used for writing and drawing in the storage unit; acquiring a painting and calligraphy object shot by a shooting unit, determining data information for displaying the pattern information on the painting and calligraphy object through AR technology according to a positioning mark in the painting and calligraphy object and a user, and sending the data information to a display unit;
the display unit is used for displaying the painting and calligraphy object and the pattern information according to the data information and is fixedly connected with the shooting unit;
the processing unit obtains spatial position information of the painting and calligraphy object according to the positioning mark, determines data information for displaying the pattern information on the painting and calligraphy object through an AR technology according to pattern information selected by a user and size and direction of the pattern information set by the user relative to the positioning mark, and sends the data information to a display unit, and the display unit displays the pattern information in the image information according to the data information;
the pattern information set by the user comprises:
one or more of initial position information of the pattern, zooming information of the pattern, moving information of the pattern, rotation information of the pattern, and color layering information of the pattern, which are set by a user;
wherein, the first and the second end of the pipe are connected with each other,
when the initial position information of the pattern is not set by a user, the processing unit takes a default value preset by a system as the initial position information of the pattern;
the color layering information of the patterns is color layering setting set by a user, the color layering setting comprises the number of layers of color layering and/or a region for color layering, and when the number of the layers of the color layering is not set by the user, the processing unit carries out color layering on the patterns according to a preset color layering rule;
the processing unit performs color layering on the pattern according to a preset color layering rule, and the implementation is as follows:
the processing unit clusters the colors according to the coordinates of the colors in the patterns in the color space, and when the number of the clustered colors is greater than the upper limit of the preset number of hierarchical levels, the processing unit adjusts the clustering parameters and reduces the number of the clustered colors until the number of the clustered colors is not greater than the upper limit of the preset number of the hierarchical levels;
the processing unit takes each classification as a color hierarchy and selects the color hierarchy in a preset or user-selected sequence, wherein the preset sequence comprises one or more of an inside and outside sequence of a color space, a coordinate sequence of the color in the color space and a size sequence of a space range occupied by the color.
2. The system of claim 1,
the surface of the painting and calligraphy object used for painting and calligraphy is a plane;
and the positioning mark is positioned on the surface for painting and calligraphy.
3. The system of claim 2,
the positioning mark is a plane pattern;
the positioning marks are printed or pasted on the surface for painting and calligraphy.
4. The system of claim 1,
the pattern information for writing and drawing stored in the storage unit is
Is obtained by the other device writing to the memory cell,
or the like, or a combination thereof,
the result is shot by a shooting unit;
or the like, or, alternatively,
and processing the image shot by the shooting unit.
5. The system of claim 1,
the processing unit is further configured to perform image processing on the pattern information according to a setting of a user before determining data information for displaying the pattern information on the painting and calligraphy object by using an AR technique, and the image processing includes:
the image segmentation and/or the image filter use, the filter includes one or more of extraction filter, liquefaction filter, vanishing point filter, stylization filter, painting brush edge-tracing filter, fuzzy filter, distortion adjustment filter, sharpening filter, sketch filter, texturing filter, pixelation filter, rendering filter, artistic effect filter, and variegated filter.
6. The system of claim 2,
a plurality of positioning marks are arranged on the surface for painting and calligraphy;
when the positioning mark in the shot image information is one, the processing unit sets the size and the direction of the pattern information by the positioning mark;
when more than one positioning mark is in the shot image information, the processing unit selects one positioning mark according to a preset mark selection rule to be used for setting the size and the direction of the pattern information;
the preset mark selection rule comprises the following steps:
when the positioning mark is a plane pattern, selecting the pattern with the highest pattern integrity;
one positioning mark is randomly selected from a plurality of positioning marks to be selected or the positioning mark closest to the center of the captured image is selected.
7. The system of claim 2,
the painting and calligraphy object has a plurality of planes for painting and calligraphy, and the planes are communicated;
the planes are provided with one or more positioning marks;
when more than one positioning mark is in the shot image information, the processing unit determines the plane where the positioning mark is located according to each positioning mark; the processing unit obtains the intersection line and the relative angle of the planes of different positioning marks according to the plane of the positioning mark, and the processing unit takes the intersection line adjacent to each positioning mark as the boundary of the plane determined by the positioning mark; the processing unit determines data information of each plane for displaying the pattern information on the painting and calligraphy object through the AR technology according to the pattern information selected by the user and positioned in the storage unit, the size and the direction of the pattern information set by the user relative to one positioning mark in the plurality of positioning marks, and the boundary and the relative angle of the plane where the plurality of positioning marks are positioned, wherein the data information of each plane is limited to the data information of the plane within the boundary.
8. The system of claim 2, further comprising:
a three-axis acceleration sensor and a gyroscope;
the three-axis acceleration sensor and the gyroscope are fixedly connected with the display unit, are communicated with the processing unit and are used for acquiring the change of the spatial position and the direction of the display unit;
after the processing unit obtains the spatial position information of the painting and calligraphy object according to the positioning mark, when the shooting unit can not shoot the positioning mark, the processing unit re-determines the spatial position information of the plane for painting and calligraphy according to the spatial position information of the plane for painting and calligraphy determined when the positioning mark is shot and the change quantity of the spatial position and the direction of the display unit, and determines data information for displaying the pattern information on the painting and calligraphy object through AR technology according to the re-determined spatial position information of the plane for painting and calligraphy, the pattern information selected by a user and located in the storage unit and the size and the orientation of the pattern information set by the user relative to the positioning mark.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810384037.7A CN108596105B (en) | 2018-04-26 | 2018-04-26 | Augmented reality painting and calligraphy system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810384037.7A CN108596105B (en) | 2018-04-26 | 2018-04-26 | Augmented reality painting and calligraphy system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108596105A CN108596105A (en) | 2018-09-28 |
| CN108596105B true CN108596105B (en) | 2023-02-03 |
Family
ID=63609543
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810384037.7A Active CN108596105B (en) | 2018-04-26 | 2018-04-26 | Augmented reality painting and calligraphy system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108596105B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110188600B (en) * | 2019-04-15 | 2023-06-27 | 广东智媒云图科技股份有限公司 | Drawing evaluation method, system and storage medium |
| CN111312012B (en) * | 2020-02-27 | 2022-05-06 | 广东工业大学 | Calligraphy exercise guiding method and device |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1696605A (en) * | 2004-05-14 | 2005-11-16 | 佳能株式会社 | Marker placement information estimating method and information processing device |
| CN101031866A (en) * | 2004-05-28 | 2007-09-05 | 新加坡国立大学 | Interactive system and method |
| CN101734022A (en) * | 2008-11-14 | 2010-06-16 | 唯思美卡片（上海）有限公司 | Spot color printing technique for active digital printing |
| CN102122392A (en) * | 2010-01-08 | 2011-07-13 | 索尼公司 | Information processing apparatus, information processing system, and information processing method |
| CN103181157A (en) * | 2011-07-28 | 2013-06-26 | 三星电子株式会社 | Plane-characteristic-based markerless augmented reality system and method for operating same |
| CN104574307A (en) * | 2014-12-30 | 2015-04-29 | 北京科技大学 | Method for extracting primary colors of painting work image |
| CN106023692A (en) * | 2016-05-13 | 2016-10-12 | 广东博士早教科技有限公司 | AR interest learning system and method based on entertainment interaction |
| CN107241610A (en) * | 2017-05-05 | 2017-10-10 | 众安信息技术服务有限公司 | A kind of virtual content insertion system and method based on augmented reality |
| CN107833264A (en) * | 2017-11-13 | 2018-03-23 | 百度在线网络技术（北京）有限公司 | A kind of image processing method, device, equipment and computer-readable recording medium |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20110136035A (en) * | 2010-06-14 | 2011-12-21 | 주식회사 비즈모델라인 | Adaptive augmented reality device to real world |
| JP5734700B2 (en) * | 2011-02-24 | 2015-06-17 | 京セラ株式会社 | Portable information device and virtual information display program |
| KR102065418B1 (en) * | 2013-09-24 | 2020-01-13 | 엘지전자 주식회사 | Mobile terminal and controlling method thereof |
| CN104574508A (en) * | 2015-01-14 | 2015-04-29 | 山东大学 | Multi-resolution model simplifying method oriented to virtual reality technology |
| US9652897B2 (en) * | 2015-06-25 | 2017-05-16 | Microsoft Technology Licensing, Llc | Color fill in an augmented reality environment |
| GB2601067B (en) * | 2016-03-02 | 2022-08-31 | Holition Ltd | Locating and augmenting object features in images |
| CN106937085A (en) * | 2016-12-12 | 2017-07-07 | 大连文森特软件科技有限公司 | Drawing accessory system based on AR augmented realities |
| CN106774874B (en) * | 2016-12-12 | 2020-01-21 | 快创科技（大连）有限公司 | Cooking auxiliary system based on AR augmented reality technology and based on color evaluation |
| CN106934849A (en) * | 2017-02-20 | 2017-07-07 | 哲想方案（北京）科技有限公司 | A kind of interactive large-size screen monitors drafting system |
| CN107273806A (en) * | 2017-05-18 | 2017-10-20 | 上海斐讯数据通信技术有限公司 | A kind of painting and calligraphy exercising method and system based on virtual reality |
-
2018
- 2018-04-26 CN CN201810384037.7A patent/CN108596105B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1696605A (en) * | 2004-05-14 | 2005-11-16 | 佳能株式会社 | Marker placement information estimating method and information processing device |
| CN101031866A (en) * | 2004-05-28 | 2007-09-05 | 新加坡国立大学 | Interactive system and method |
| CN101734022A (en) * | 2008-11-14 | 2010-06-16 | 唯思美卡片（上海）有限公司 | Spot color printing technique for active digital printing |
| CN102122392A (en) * | 2010-01-08 | 2011-07-13 | 索尼公司 | Information processing apparatus, information processing system, and information processing method |
| CN103181157A (en) * | 2011-07-28 | 2013-06-26 | 三星电子株式会社 | Plane-characteristic-based markerless augmented reality system and method for operating same |
| CN104574307A (en) * | 2014-12-30 | 2015-04-29 | 北京科技大学 | Method for extracting primary colors of painting work image |
| CN106023692A (en) * | 2016-05-13 | 2016-10-12 | 广东博士早教科技有限公司 | AR interest learning system and method based on entertainment interaction |
| CN107241610A (en) * | 2017-05-05 | 2017-10-10 | 众安信息技术服务有限公司 | A kind of virtual content insertion system and method based on augmented reality |
| CN107833264A (en) * | 2017-11-13 | 2018-03-23 | 百度在线网络技术（北京）有限公司 | A kind of image processing method, device, equipment and computer-readable recording medium |
Non-Patent Citations (3)
| Title |
|---|
| Image-based augmentation of virtual object for handy camera video sequence using arbitrary multiple planes;Y. Uematsu;《 IEEE International Conference on Image Processing 2005》;20051114;第1-4页 * |
| 基于RGB-D摄像机的增强现实***关键技术研究;李佳宁;《中国优秀博硕士学位论文全文数据库(博士)信息科技辑》;20171215;第2017年卷(第12期);正文第4页、图1-2、正文第6页、图1-4 * |
| 增强现实中实时跟踪技术的研究;陈烁,;《中国优秀博硕士学位论文全文数据库(硕士)信息科技辑》;20141015;第2014年卷(第10期);正文第45页、图5.4(a) * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108596105A (en) | 2018-09-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110610453B (en) | Image processing method and device and computer readable storage medium | |
| US9516214B2 (en) | Information processing device and information processing method | |
| CN108876934B (en) | Key point marking method, device and system and storage medium | |
| CN111401266B (en) | Method, equipment, computer equipment and readable storage medium for positioning picture corner points | |
| US7751627B2 (en) | Image dominant line determination and use | |
| CN106688031A (en) | Apparatus and method for supplying content aware photo filters | |
| US20110050685A1 (en) | Image processing apparatus, image processing method, and program | |
| CN103885611A (en) | Method and device for adjusting image | |
| US10902656B2 (en) | System and method for generating a digital image collage | |
| CN108596105B (en) | Augmented reality painting and calligraphy system | |
| US20140169697A1 (en) | Editor for assembled group images | |
| CN114202640A (en) | Data acquisition method and device, computer equipment and storage medium | |
| US10444959B2 (en) | Method and apparatus for managing multiple views for graphics data | |
| US10643491B2 (en) | Process, system and method for step-by-step painting of an image on a transparent surface | |
| CN110942092B (en) | Graphic image recognition method and recognition system | |
| CN114913308A (en) | Camera tracking method, device, equipment and storage medium | |
| JP7183020B2 (en) | Image processing device, image processing method, and program | |
| CN103997607A (en) | Image obtaining method, corresponding device and electronic mobile terminal containing device | |
| WO2023039327A1 (en) | Display of digital media content on physical surface | |
| CN115454365A (en) | Picture processing method and device, electronic equipment and medium | |
| WO2018151612A1 (en) | Texture mapping system and method | |
| CN114430466A (en) | Material display method, device, electronic equipment, storage medium and program product | |
| CN113763546A (en) | Card preview method and device and electronic equipment | |
| US6356267B1 (en) | Method of creating two dimensional shapes drawing system | |
| JP6914369B2 (en) | Vector format small image generation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |