CN106780680A - Three-dimensional animation generation method, terminal and system based on augmented reality - Google Patents
Three-dimensional animation generation method, terminal and system based on augmented reality Download PDFInfo
- Publication number
- CN106780680A CN106780680A CN201611068961.1A CN201611068961A CN106780680A CN 106780680 A CN106780680 A CN 106780680A CN 201611068961 A CN201611068961 A CN 201611068961A CN 106780680 A CN106780680 A CN 106780680A
- Authority
- CN
- China
- Prior art keywords
- threedimensional model
- image
- dimensional animation
- dimensional
- action data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The invention provides a kind of three-dimensional animation generation method based on augmented reality, terminal and system, it is related to augmented reality field, first, the photographing module collection environment view of terminal, secondly, data processing module receives the three-dimensional animation of the threedimensional model with action data, and three-dimensional animation is combined with environment view, wherein, threedimensional model is built by the threedimensional model constructing system in system, action data is generated by the action data generation system in system, finally, output module three-dimensional animation of the output equipped with environment view.The content-form for alleviating prior art presence is single, lacks telepresenc, the technical problem of the use feeling difference of user, the content-form of abundant teaching is reached, strengthen the telepresenc of implementation process, be easy to user to carry out the observational learning of multi-angle, improve the technique effect of the experience of user.
Description
Technical field
The present invention relates to augmented reality field, more particularly, to a kind of three-dimensional animation life based on augmented reality
Into method, terminal and system.
Background technology
Augmented reality (Augmented Reality, abbreviation AR), is that the information provided by computer system increases user
The technology perceived to real world, by virtual Information application to real world, and dummy object, the scene that computer is generated
Or system prompt information superposition is in real scene, so as to realize the enhancing to reality.Augmented reality is digitizing technique
Development and extension, it not only presents the information of real world, and virtual information is shown simultaneously, two kinds of information
It is complementary to one another, is superimposed, more real complete new experience is brought with impression to user.
At present, teaching pattern is personally instructed for the tradition of dynamic action to gradually decrease, and be based on the form such as video on line from
Learn teaching pattern gradually to popularize, it has the advantages such as learning time freedom is strong, the place small, scale of limitation is easy to control.Universal
Tutor auxiliary platform teaching material is more based on the two-dimensional contents such as papery teaching material, video, and small part is the static three-dimensional personage of computer synthesis
Three-dimensional content.
In process of the present invention is realized, inventor has found that at least there are the following problems in the prior art：All kinds of teaching materials are in reality
It is now relatively independent in form, fail the concentrated reflection content of courses of multi-angle, the content of auxiliary teaching material is single uninteresting, lacks enough
Telepresenc, student only imagined to complete to dynamic contents such as true man's motions by the illustration and video content of papery teaching material
Grope study, it is impossible to which realization is rich in the observational learning of the 360 degrees omnidirection to dynamic action of telepresenc in the same space.Cause
This, it is single to there is content-form in prior art, lacks telepresenc, the technical problem of the use feeling difference of user.
The content of the invention
In view of this, object of the present invention is to provide a kind of three-dimensional animation generation side based on augmented reality
Method, terminal and system, it is single with the content-form for alleviating prior art presence, lack telepresenc, the use feeling of user is poor
Technical problem.
In a first aspect, the embodiment of the invention provides a kind of three-dimensional animation generation method based on augmented reality, wrap
Include：
Acquisition step：Collection environment view；
Receiving step：Receive the three-dimensional animation of the threedimensional model with action data, and by three-dimensional animation and environment view
With reference to；
Output step：Three-dimensional animation of the output equipped with environment view.
With reference in a first aspect, the embodiment of the invention provides the first possible implementation method of first aspect, wherein, connect
Also include before receiving step：
Identification step：Identification is integrated with the tag card of characteristic information and identification image, obtains the three-dimensional corresponding to tag card
Model.
With reference in a first aspect, the embodiment of the invention provides second possible implementation method of first aspect, wherein, three
Dimension module is specially：
The tridimensional virtual model that target image is spliced by three-dimensional scanner and generated；
Target image is obtained for the image of camera acquisition destination object.
With reference in a first aspect, the embodiment of the invention provides the third possible implementation method of first aspect, wherein, move
It is specially as data：
Position data to the destination object of tracker record carries out calculating treatment, the three dimensional space coordinate data of generation.
Second aspect, the embodiment of the present invention also provides a kind of terminal of the motion teaching material based on augmented reality, including：
Photographing module, data processing module and output module；
Photographing module is used to gather environment view；
Data processing module is used to receive the three-dimensional animation of the threedimensional model with action data, and by three-dimensional animation and ring
Border view is combined；
Output module is used to export the three-dimensional animation equipped with environment view.
With reference to second aspect, the first possible implementation method of second aspect is the embodiment of the invention provides, wherein, also
Including：Identification module；
Identification module is used to recognize the tag card for being integrated with characteristic information and the tag card of identification image, obtains and correspond to mark
Know the threedimensional model of card.
The third aspect, the embodiment of the present invention also provides a kind of motion teaching material generation system based on augmented reality, bag
Include：Threedimensional model constructing system, action data generation system and above-mentioned terminal；
Threedimensional model constructing system is used to build the threedimensional model in three-dimensional animation；
Action data generation system is used to generate the action data of threedimensional model.
With reference to the third aspect, the first possible implementation method of the third aspect is the embodiment of the invention provides, wherein, three
Dimension module constructing system includes：Video camera, three-dimensional scanner and scan image processor；
The image of camera acquisition destination object, obtains target image；
Three-dimensional scanner is spliced target image, generates scan image；
Scan image processor carries out screening synthesis treatment to scan image, generates threedimensional model.
With reference to the third aspect, second possible implementation method of the third aspect is the embodiment of the invention provides, wherein, move
Include as data generation system：Tracker and position data processor；
Tracker records the position of destination object, generates the position data of destination object；
Position data processor carries out calculating treatment to position data, generates action data.
With reference to the first possible implementation method of the third aspect, the third of the third aspect is the embodiment of the invention provides
Possible implementation method, wherein, video camera also includes：Image capture controller；
Image capture controller is used for remote synchronization collection and the real-time Transmission of image.
The embodiment of the present invention brings following beneficial effect：
In the three-dimensional animation generation method based on augmented reality, terminal and system that the embodiment of the present invention is provided,
First, the photographing module collection environment view of terminal, secondly, data processing module receives the threedimensional model with action data
Three-dimensional animation, and three-dimensional animation is combined with environment view, wherein, threedimensional model is by the threedimensional model constructing system structure in system
Build, action data is generated by the action data generation system in system, finally, output module three-dimensional of the output equipped with environment view
Animation.The technical scheme enriches teaching by the way of structure threedimensional model, motion capture technology and AR technologies are combined
Content-form, makes it have interest, improves the learning initiative of user, enhances the telepresenc of implementation process, is easy to use
Family carries out the observational learning of multi-angle, improves the experience of user, and the content-form for alleviating prior art presence is single,
Lack telepresenc, the technical problem of the use feeling difference of user.
Other features and advantages of the present invention will be illustrated in the following description, also, the partly change from specification
Obtain it is clear that or being understood by implementing the present invention.The purpose of the present invention and other advantages are in specification, claims
And specifically noted structure is realized and obtained in accompanying drawing.
To enable the above objects, features and advantages of the present invention to become apparent, preferred embodiment cited below particularly, and coordinate
Appended accompanying drawing, is described in detail below.
Brief description of the drawings
In order to illustrate more clearly of the specific embodiment of the invention or technical scheme of the prior art, below will be to specific
The accompanying drawing to be used needed for implementation method or description of the prior art is briefly described, it should be apparent that, in describing below
Accompanying drawing is some embodiments of the present invention, for those of ordinary skill in the art, before creative work is not paid
Put, other accompanying drawings can also be obtained according to these accompanying drawings.
Fig. 1 is the flow chart of the three-dimensional animation generation method based on augmented reality provided in an embodiment of the present invention；
Fig. 2 be generation method provided in an embodiment of the present invention in, threedimensional model build specific method flow chart；
Fig. 3 be generation method provided in an embodiment of the present invention in, action data generation specific method flow chart；
Fig. 4 is the structural representation of the terminal of the motion teaching material based on augmented reality provided in an embodiment of the present invention；
Fig. 5 is the structural representation that the motion teaching material based on augmented reality provided in an embodiment of the present invention generates system
Figure.
Icon：
100- terminals；110- identification modules；120- photographing modules；130- data processing modules；140- output modules；200-
Threedimensional model constructing system；210- video cameras；220- three-dimensional scanners；230- scan image processors；300- action datas are given birth to
Into system；310- trackers；320- position data processors.
Specific embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with accompanying drawing to the present invention
Technical scheme be clearly and completely described, it is clear that described embodiment is a part of embodiment of the invention, rather than
Whole embodiments.Based on the embodiment in the present invention, those of ordinary skill in the art are not making creative work premise
Lower obtained every other embodiment, belongs to the scope of protection of the invention.
At present, learning time freedom is strong, place limits because it has for the self-study teaching pattern based on forms such as videos on line
Make the advantages such as small, scale is easy to control gradually to popularize, all kinds of teaching materials are more based on the two-dimensional contents such as papery teaching material, video, small part
It is the three-dimensional content of the static three-dimensional personage of computer synthesis.But, student only enters by the illustration and video content of papery teaching material
Row is imagined to complete to grope study to dynamic contents such as true man's motions, it is impossible to which realization is rich in the right of telepresenc in the same space
The observational learning of the 360 degrees omnidirection of dynamic action, the content-form of prior art is single, lacks telepresenc, the use of user
Impression is poor.Based on this, the three-dimensional animation generation method based on augmented reality provided in an embodiment of the present invention, terminal and it is
System, can enrich the content-form of teaching, strengthen the telepresenc of implementation process, be easy to user to carry out the observational learning of multi-angle,
Improve the experience of user.
For ease of understanding the present embodiment, now to based on augmented reality three disclosed in the embodiment of the present invention
Dimension animation producing method, terminal and system describe in detail.
Embodiment one：
Referring to Fig. 1, the flow chart of the three-dimensional animation generation method based on augmented reality provided in an embodiment of the present invention.
A kind of three-dimensional animation generation method based on augmented reality is the embodiment of the invention provides, including：
Acquisition step S1：Collection environment view.Specifically, the mobile terminal that user is held is furnished with can take pictures taking
The photographing module of scape, when user is needed in three-dimensional animation of the current scene using auxiliary teaching material, can be by above-mentioned shooting
Module carries out the collection of environment view so that virtual three-dimensional animation is combined with the real scene of reality, enhances and played
The telepresenc of user in journey.
Receiving step S2：The three-dimensional animation of the threedimensional model with action data is received, and by three-dimensional animation and environment map
Scape is combined.Specifically, the data processing module of mobile terminal receives the three-dimensional animation needed for imparting knowledge to students by way of data transfer,
The threedimensional model of the animation is the dummy model with the basic skeletal structure of human body, is easy to learner to observe and imitates, and the model can
Being the vivid, or virtual animation role image of true man.The action data of threedimensional model is carrying out animation for the model
In compulsory exercise when, the position data for being captured is key content that learner carries out learning by imitation, three-dimensional animation it is dynamic
The details of animation is embodied as data, its precision is finer, the details of the three-dimensional animation of generation is also more comprehensive, be conducive to improving
The observational learning effect of learner.Three-dimensional animation is combined with the environment view that step S1 is collected, the three-dimensional is realized
Model learner is presented on stereogenic where scene in, be easy to the observation of learner to imitate.
Output step S3：Three-dimensional animation of the output equipped with environment view.Specifically, the display of mobile terminal is by foregoing three
Dimension animation shows, and the terminal can be wearable device, or moveable Intelligent hardware terminal, such as intelligent hand
Machine, Intelligent flat, intelligent television etc., its display can be that the entity display screen of terminal, or visual stimulus are produced
Virtual screen.One is integrated in threedimensional model true to nature and with the accurately action data of the model of motion capture technical limit spacing
Rise, virtual teacher is taken to learner at one's side using AR technologies, the example displaying of two dimension is converted into more vivid specific
Three-dimensional animation, compensate for the shortcoming in learner's visual effect, and the technical scheme can support various presentation effects, such as：Visual angle is certainly
By, multi-angle observation, dazzling effect etc., the learning initiative of student is enhanced, and the observation to the multi-angle of example details has
Beneficial to the study of student.
In generation method provided in an embodiment of the present invention, identification step S0 is also included before receiving step：Identification is integrated with
Characteristic information and the tag card of identification image, obtain the threedimensional model corresponding to tag card.Specifically, mobile terminal is equipped with identification
Module, identification module is capable of identify that the tag card of the tag card for being integrated with characteristic information and identification image, and then acquisition corresponds to
The threedimensional model of tag card.Tag card is that matching has the characteristic element of being easy to identification module to recognize and the drafting to have the figure of role
The combining information of picture, i.e. Quick Response Code and picture.Identification module identification marking card is using two-dimensional code scanning technology and image recognition skill
Art, further, optical character identification (Optical Character Recognition, abbreviation OCR) technology check that paper
The character of upper printing, by detecting that dark, bright pattern determines its shape, then translates into calculating with character identifying method by shape
Machine word, picture recognition software performs fighting kit (Software Development Kit, abbreviation SDK) can be by picture
Discriminance analysis obtains information, and identification module can solve the problem that the difficult problem of identification video, pictorial information in the prior art.
In generation method provided in an embodiment of the present invention, threedimensional model is specially：Target image is spliced by three-dimensional scanner
And the tridimensional virtual model for generating, target image is the image acquisition of camera acquisition destination object.Referring to Fig. 2, the present invention
In the generation method that embodiment is provided, the flow chart of the specific method that threedimensional model builds.Further, the structure of threedimensional model
Method is：
S211：The image of camera acquisition destination object, obtains target image.Specifically, using 112 high accuracy cameras
Catch the model information of destination object, it is to avoid use infrared light sensation technology so that imaging precision is high, and effect is clear.In video camera
Image capture controller realize to the collection of the remote synchronization of image and real-time Transmission.Controller employs synthesis chip and completes same
Step treatment, can realize completing 3-D scanning within 0.05 second, create destination object model.Each video camera during shooting
Shutter key all transmits connection using the chip, can use all shutter key for shooting cameras of same remote control remote control, with
Realize that all shooting images are what the same time obtained.Realized electroshutter line, the number on every video camera using foregoing chip
A unique USB (Universal is all exported according to three interfaces of coffret and power line
Serial Bus, abbreviation USB) output interface, the interface processing mode realizes 3 input interfaces turning to 1 output interface
Change.
S212：Three-dimensional scanner is spliced target image, generates scan image.Specifically, complete in step S211
The USB interface of portion's video camera is connected to the power supply and data transfer box of three-dimensional scanner.Three-dimensional scanner is to the image that receives
Spliced, generated preliminary three dimensional character model.
S213：Scan image processor carries out screening synthesis treatment to scan image, generates threedimensional model.Specifically, sweeping
Image processor is retouched equipped with Agisoft softwares, scanning patter threedimensional model can be generated.Scan image processor is also equipped with
Unity3D softwares, can optimize treatment to the threedimensional model for obtaining, in the face number requirement maximum of model in Unity3D
Be limited to 65535 faces, wherein, face for model capacity minimum metering units, but foregoing three-dimensional scanner generation three dimensional character mould
Type belongs to high-precision model, and model face number reaches 30 to 500,000 face numbers (wherein comprising triangular facet and four edged surfaces), therefore need to be by subtracting
Face treatment reaches the face number requirement of Unity3D.The need for because of subsequent match action data, therefore all faces of threedimensional model are changed
For four edged surfaces and bind bone.The touch control rotation to model is realized, expands diminution, Voice command and interaction, enhancing study
Interest and telepresenc, strengthen learner learning initiative.So far, the high-quality threedimensional model with destination object feature
Build and complete, the threedimensional model for being generated really presents the stereochemical structure of destination object by micronization processes.
In generation method provided in an embodiment of the present invention, action data is specially：The destination object recorded to tracker
Position data carries out calculating treatment, the three dimensional space coordinate data of generation.Referring to Fig. 3, generation side provided in an embodiment of the present invention
In method, the flow chart of the specific method of action data generation.Further, the generation method of action data is：
S221：Tracker records the position of destination object, generates the position data of destination object.Specifically, to target pair
The motion capture equipment such as the key position magnetics sensing or optics of elephant obtain its accurately action data, and motion capture equipment can
Being tracker.Wherein, motion capture technology is related to the aspect such as the positioning of object and bearing measurement in dimensional measurement, physical space
Technology, the position data of gained can directly decode treatment by computer.
S222：Position data processor carries out calculating treatment to position data, generates action data.Specifically, positional number
Motion capture system is housed according to processor, is carried out calculating treatment while catching tracker position to position data and is obtained three-dimensional space
Between coordinate data.The high accuracy reduction of true man's motion class action data is realized, the research and development for acting class teaching material is provided
Enrich reliable science data.
The technical scheme enriches religion by the way of structure threedimensional model, motion capture technology and AR technologies are combined
Content-form, makes it have interest, improves the learning initiative of user, enhances the telepresenc of implementation process, just
The observational learning of multi-angle is carried out in user, the experience of user is improved.
Embodiment two：
Referring to Fig. 4, the structural representation of the terminal of the motion teaching material based on augmented reality provided in an embodiment of the present invention
Figure.The embodiment of the present invention also provides a kind of terminal 100 of the motion teaching material based on augmented reality, including：Photographing module
120th, data processing module 130 and output module 140.
Photographing module 120 is used to gather environment view.Specifically, the mobile terminal that user is held is furnished with and can be clapped
According to the photographing module found a view, when user is needed in three-dimensional animation of the current scene using auxiliary teaching material, can be by above-mentioned
Photographing module carries out the collection of environment view so that virtual three-dimensional animation is combined with the real scene of reality, enhances and broadcasts
The telepresenc of user during putting.
Data processing module 130 is used to receive the three-dimensional animation of the threedimensional model with action data, and by three-dimensional animation
Combined with environment view.Specifically, the data processing module of mobile terminal is received needed for imparting knowledge to students by way of data transfer
Three-dimensional animation, the threedimensional model of the animation is the dummy model with the basic skeletal structure of human body, is easy to learner to observe and imitates,
The model can be the vivid, or virtual animation role image of true man.The action data of threedimensional model exists for the model
When carrying out the compulsory exercise in animation, the position data for being captured is key content that learner carries out learning by imitation, three-dimensional
The action data of animation embodies the details of animation, and its precision is finer, and the details of the three-dimensional animation of generation is also more comprehensive, has
Beneficial to the observational learning effect for improving learner.Three-dimensional animation is combined with the foregoing environment view for collecting, is realized
The threedimensional model learner is presented on stereogenic where scene in, be easy to the observation of learner to imitate.
Output module 140 is used to export the three-dimensional animation equipped with environment view.Specifically, the display of mobile terminal will be preceding
State three-dimensional animation to show, the terminal can be wearable device, or moveable Intelligent hardware terminal, such as intelligence
Mobile phone, Intelligent flat, intelligent television etc., its display can be that the entity display screen of terminal, or visual stimulus are produced
Raw virtual screen.It is integrated in threedimensional model true to nature and with the accurately action data of the model of motion capture technical limit spacing
Together, virtual teacher is taken to learner at one's side using AR technologies, the example displaying of two dimension is converted into more vivid specific
Three-dimensional animation, compensate for the shortcoming in learner's visual effect, the technical scheme can support various presentation effects, such as：Visual angle
Freely, multi-angle observation, dazzling effect etc., enhance the learning initiative of student, and the observation of the multi-angle to example details
Be conducive to the study of student.
Terminal provided in an embodiment of the present invention also includes identification module 110, and identification module 110 is integrated with feature for identification
Information and the tag card of the tag card of identification image, obtain the threedimensional model corresponding to tag card.Specifically, mobile terminal is furnished with
Identification module, identification module is capable of identify that the tag card of the tag card for being integrated with characteristic information and identification image, and then obtains right
Should be in the threedimensional model of tag card.Tag card be matching have be easy to identification module recognize characteristic element and drafting have role's
The combining information of image, i.e. Quick Response Code and picture.Identification module identification marking card uses two-dimensional code scanning technology and image recognition
Technology, further, OCR technique check that the character printed on paper, by detecting that dark, bright pattern determines its shape, so
Shape is translated into computword with character identifying method afterwards, picture recognition SDK can be obtained by the discriminance analysis of picture
Information, identification module can solve the problem that the difficult problem of identification video, pictorial information in the prior art.
Embodiment three：
Referring to Fig. 5, the structure of the motion teaching material generation system based on augmented reality provided in an embodiment of the present invention is shown
It is intended to.The generation system of the motion teaching material based on augmented reality that the embodiment of the present invention is also provided, including threedimensional model builds
System 200, action data generates the terminal 100 that system 300 and embodiment two are provided.Further, threedimensional model builds system
Unite for building the threedimensional model in three-dimensional animation, action data generation system is used to generate the action data of threedimensional model.
The threedimensional model constructing system 200 that the embodiment of the present invention is provided includes video camera 210, the and of three-dimensional scanner 220
Scan image processor 230.
Video camera 210 gathers the image of destination object, obtains target image.Specifically, being caught using 112 high accuracy cameras
Catch the model information of destination object, it is to avoid use infrared light sensation technology so that imaging precision is high, and effect is clear.
Three-dimensional scanner 220 is spliced target image, generates scan image.Specifically, foregoing whole video cameras
USB interface is connected to the power supply and data transfer box of three-dimensional scanner.Three-dimensional scanner splices to the image for receiving, raw
Into preliminary three dimensional character model.
Scan image processor 230 carries out screening synthesis treatment to scan image, generates threedimensional model.Specifically, scanning
Image processor is equipped with Agisoft softwares, scanning patter can be generated into threedimensional model.Scan image processor is also equipped with
Unity3D softwares, can optimize treatment to the threedimensional model for obtaining, in the face number requirement maximum of model in Unity3D
Be limited to 65535 faces, wherein, face for model capacity minimum metering units, but foregoing three-dimensional scanner generation three dimensional character mould
Type belongs to high-precision model, and model face number reaches 30 to 500,000 face numbers (wherein comprising triangular facet and four edged surfaces), therefore need to be by subtracting
Face treatment reaches the face number requirement of Unity3D.The need for because of subsequent match action data, therefore all faces of threedimensional model are changed
For four edged surfaces and bind bone.The touch control rotation to model is realized, expands diminution, Voice command and interaction, enhancing study
Interest and telepresenc, strengthen learner learning initiative.So far, the high-quality threedimensional model with destination object feature
Build and complete, the threedimensional model for being generated really presents the stereochemical structure of destination object by micronization processes.
The action data generation system 300 that the embodiment of the present invention is provided includes tracker 310 and position data processor
320。
Tracker 310 records the position of destination object, generates the position data of destination object.Specifically, to destination object
Key position magnetics sensing or the motion capture equipment such as optics obtain its accurately action data, motion capture equipment can be with
It is tracker.Wherein, motion capture technology is related to the aspect such as the positioning of object and bearing measurement in dimensional measurement, physical space
Technology, the position data of gained can directly decode treatment by computer.
Position data processor 320 carries out calculating treatment to position data, generates action data.Specifically, position data
Processor is equipped with motion capture system, carries out calculating treatment while catching tracker position to position data and obtains three dimensions
The data of coordinate.The high accuracy reduction of true man's motion class action data is realized, the research and development for acting class teaching material provides rich
Rich reliable science data.
The video camera that the embodiment of the present invention is provided also includes image capture controller, and image capture controller is used for image
Remote synchronization collection and real-time Transmission.Image capture controller in video camera is realized gathering the remote synchronization of image and real
When transmit.Controller employs synthesis chip and completes synchronization process, can realize completing 3-D scanning within 0.05 second, creates
Destination object model.The shutter key of each video camera transmits connection using the chip during shooting, can use same remote control
The all shutter key for shooting camera of device remote control, to realize that all shooting images are what the same time obtained.Using foregoing core
Piece realizes three interfaces of the electroshutter line on every video camera, data transmission interface and power line all to export unique
A USB output interface, the interface processing mode realizes 3 input interfaces to 1 conversion of output interface.
In force, the building mode of threedimensional model can also have multiple choices to above-described embodiment, such as：
Mode one, above-mentioned threedimensional model is synthesized using softwares such as 3DMAX, MAYA.
Mode two, chooses existing threedimensional model in network or database.
In force, the generating mode of action data can also have multiple choices to above-described embodiment, such as：
Mode one, above-mentioned threedimensional model uses the softwares such as 3DMAX, MAYA to be generated.
Mode two, chooses existing action data in network or database.
Terminal provided in an embodiment of the present invention, the motion teaching material based on augmented reality provided with above-described embodiment
Terminal has identical technical characteristic, so can also solve identical technical problem, reaches identical technique effect.
In the three-dimensional animation generation method based on augmented reality, terminal and system that the embodiment of the present invention is provided,
First, the photographing module collection environment view of terminal, secondly, data processing module receives the threedimensional model with action data
Three-dimensional animation, and three-dimensional animation is combined with environment view, wherein, threedimensional model is by the threedimensional model constructing system structure in system
Build, action data is generated by the action data generation system in system, finally, output module three-dimensional of the output equipped with environment view
Animation.The technical scheme enriches teaching by the way of structure threedimensional model, motion capture technology and AR technologies are combined
Content-form, makes it have interest, improves the learning initiative of user, enhances the telepresenc of implementation process, is easy to use
Family carries out the observational learning of multi-angle, improves the experience of user, and the content-form for alleviating prior art presence is single,
Lack telepresenc, the technical problem of the use feeling difference of user.
The meter of three-dimensional animation generation method, terminal and system based on augmented reality that the embodiment of the present invention is provided
Calculation machine program product, including the computer-readable recording medium of program code is stored, the instruction that described program code includes can
For performing the method described in previous methods embodiment, implement and can be found in embodiment of the method, will not be repeated here.
It is apparent to those skilled in the art that, for convenience and simplicity of description, the system of foregoing description
With the specific work process of device, the corresponding process in preceding method embodiment is may be referred to, will not be repeated here.
If the function is to realize in the form of SFU software functional unit and as independent production marketing or when using, can be with
Storage is in a computer read/write memory medium.Based on such understanding, technical scheme is substantially in other words
The part contributed to prior art or the part of the technical scheme can be embodied in the form of software product, the meter
Calculation machine software product is stored in a storage medium, including some instructions are used to so that a computer equipment (can be individual
People's computer, server, or network equipment etc.) perform all or part of step of each embodiment methods described of the invention.
And foregoing storage medium includes：USB flash disk, mobile hard disk, read-only storage (ROM, Read-Only Memory), arbitrary access are deposited
Reservoir (RAM, Random Access Memory), magnetic disc or CD etc. are various can be with the medium of store program codes.
Finally it should be noted that：Embodiment described above, specific embodiment only of the invention, is used to illustrate the present invention
Technical scheme, rather than its limitations, protection scope of the present invention is not limited thereto, although with reference to the foregoing embodiments to this hair
It is bright to be described in detail, it will be understood by those within the art that：Any one skilled in the art
The invention discloses technical scope in, it can still modify to the technical scheme described in previous embodiment or can be light
Change is readily conceivable that, or equivalent is carried out to which part technical characteristic；And these modifications, change or replacement, do not make
The essence of appropriate technical solution departs from the spirit and scope of embodiment of the present invention technical scheme, should all cover in protection of the invention
Within the scope of.Therefore, protection scope of the present invention should be based on the protection scope of the described claims.
Claims (10)
1. a kind of three-dimensional animation generation method based on augmented reality, it is characterised in that including：
Acquisition step：Collection environment view；
Receiving step：The three-dimensional animation of the threedimensional model with action data is received, and by the three-dimensional animation and the environment
View is combined；
Output step：The three-dimensional animation of the output equipped with the environment view.
2. method according to claim 1, it is characterised in that also include before the receiving step：
Identification step：Identification is integrated with the tag card of characteristic information and identification image, obtains corresponding to the described of the tag card
Threedimensional model.
3. method according to claim 1, it is characterised in that the threedimensional model is specially：
The tridimensional virtual model that target image is spliced by three-dimensional scanner and generated；
The target image is obtained for the image of camera acquisition destination object.
4. method according to claim 1, it is characterised in that the action data is specially：
Position data to the destination object of tracker record carries out calculating treatment, the three dimensional space coordinate data of generation.
5. it is a kind of based on augmented reality motion teaching material terminal, it is characterised in that including：Photographing module, data processing
Module and output module；
The photographing module is used to gather environment view；
The data processing module is used to receive the three-dimensional animation of the threedimensional model with action data, and by the three-dimensional animation
Combined with the environment view；
The output module is used to export the three-dimensional animation equipped with the environment view.
6. terminal according to claim 5, it is characterised in that also include：Identification module；
The identification module is used to recognize the tag card for being integrated with characteristic information and the tag card of identification image, obtains and correspond to institute
State the threedimensional model of tag card.
7. a kind of motion teaching material based on augmented reality generates system, it is characterised in that including：Threedimensional model builds system
System, action data generation system and the terminal as described in claim 5 or 6；
The threedimensional model constructing system is used to build the threedimensional model in three-dimensional animation；
The action data generation system is used to generate the action data of the threedimensional model.
8. system according to claim 7, it is characterised in that the threedimensional model constructing system includes：Video camera, three-dimensional
Scanner and scan image processor；
The image of the camera acquisition destination object, obtains target image；
The three-dimensional scanner is spliced the target image, generates scan image；
The scan image processor carries out screening synthesis treatment to the scan image, generates the threedimensional model.
9. system according to claim 7, it is characterised in that the action data generation system includes：Tracker and position
Put data processor；
The tracker records the position of destination object, generates the position data of destination object；
The position data processor carries out calculating treatment to the position data, generates the action data.
10. system according to claim 8, it is characterised in that the video camera also includes：Image capture controller；
Described image acquisition controller is used for remote synchronization collection and the real-time Transmission of described image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611068961.1A CN106780680A (en) | 2016-11-28 | 2016-11-28 | Three-dimensional animation generation method, terminal and system based on augmented reality |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611068961.1A CN106780680A (en) | 2016-11-28 | 2016-11-28 | Three-dimensional animation generation method, terminal and system based on augmented reality |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106780680A true CN106780680A (en) | 2017-05-31 |
Family
ID=58904983
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611068961.1A Pending CN106780680A (en) | 2016-11-28 | 2016-11-28 | Three-dimensional animation generation method, terminal and system based on augmented reality |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106780680A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107895515A (en) * | 2017-12-20 | 2018-04-10 | 岭南师范学院 | The CAD teaching methods and tutoring system of a kind of augmented reality |
| CN110286767A (en) * | 2019-06-25 | 2019-09-27 | 惠州学院 | A method of based on teaching material making virtual display course in kind |
| CN111681308A (en) * | 2020-04-13 | 2020-09-18 | 深圳市大富网络技术有限公司 | Three-dimensional model construction system, method and computer storage medium |
| CN111986309A (en) * | 2020-07-24 | 2020-11-24 | 山东金东数字创意股份有限公司 | System and method for generating special film Pre-vis based on three-dimensional scanning |
| CN114022616A (en) * | 2021-11-16 | 2022-02-08 | 北京城市网邻信息技术有限公司 | Model processing method and device, electronic device and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102411854A (en) * | 2011-09-01 | 2012-04-11 | 苏州梦想人软件科技有限公司 | Classroom teaching mixing technology application system based on enhanced reality and method thereof |
| CN102800065A (en) * | 2012-07-13 | 2012-11-28 | 苏州梦想人软件科技有限公司 | Augmented reality equipment and method based on two-dimensional code identification and tracking |
| CN102945637A (en) * | 2012-11-29 | 2013-02-27 | 河海大学 | Augmented reality based embedded teaching model and method |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
| CN103544724A (en) * | 2013-05-27 | 2014-01-29 | 华夏动漫集团有限公司 | System and method for realizing fictional cartoon character on mobile intelligent terminal by augmented reality and card recognition technology |
-
2016
- 2016-11-28 CN CN201611068961.1A patent/CN106780680A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102411854A (en) * | 2011-09-01 | 2012-04-11 | 苏州梦想人软件科技有限公司 | Classroom teaching mixing technology application system based on enhanced reality and method thereof |
| CN102800065A (en) * | 2012-07-13 | 2012-11-28 | 苏州梦想人软件科技有限公司 | Augmented reality equipment and method based on two-dimensional code identification and tracking |
| CN102945637A (en) * | 2012-11-29 | 2013-02-27 | 河海大学 | Augmented reality based embedded teaching model and method |
| CN103544724A (en) * | 2013-05-27 | 2014-01-29 | 华夏动漫集团有限公司 | System and method for realizing fictional cartoon character on mobile intelligent terminal by augmented reality and card recognition technology |
| CN103366610A (en) * | 2013-07-03 | 2013-10-23 | 熊剑明 | Augmented-reality-based three-dimensional interactive learning system and method |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107895515A (en) * | 2017-12-20 | 2018-04-10 | 岭南师范学院 | The CAD teaching methods and tutoring system of a kind of augmented reality |
| CN110286767A (en) * | 2019-06-25 | 2019-09-27 | 惠州学院 | A method of based on teaching material making virtual display course in kind |
| CN111681308A (en) * | 2020-04-13 | 2020-09-18 | 深圳市大富网络技术有限公司 | Three-dimensional model construction system, method and computer storage medium |
| CN111986309A (en) * | 2020-07-24 | 2020-11-24 | 山东金东数字创意股份有限公司 | System and method for generating special film Pre-vis based on three-dimensional scanning |
| CN111986309B (en) * | 2020-07-24 | 2023-11-28 | 山东金东数字创意股份有限公司 | System and method for generating special film Pre-vis based on three-dimensional scanning |
| CN114022616A (en) * | 2021-11-16 | 2022-02-08 | 北京城市网邻信息技术有限公司 | Model processing method and device, electronic device and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Erolin | Interactive 3D digital models for anatomy and medical education | |
| CN111028330B (en) | Three-dimensional expression base generation method, device, equipment and storage medium | |
| CN106780680A (en) | Three-dimensional animation generation method, terminal and system based on augmented reality | |
| CN109584295A (en) | The method, apparatus and system of automatic marking are carried out to target object in image | |
| CN106355153A (en) | Virtual object display method, device and system based on augmented reality | |
| CN106023692A (en) | AR interest learning system and method based on entertainment interaction | |
| US20220277525A1 (en) | User-exhibit distance based collaborative interaction method and system for augmented reality museum | |
| CN108154551A (en) | The method and system of real-time dynamic reconstruction three-dimensional (3 D) manikin | |
| CN110211222B (en) | AR immersion type tour guide method and device, storage medium and terminal equipment | |
| CN115525144A (en) | Multi-object interaction equipment based on virtual reality and interaction method thereof | |
| CN106293099A (en) | Gesture identification method and system | |
| Wang et al. | Wuju opera cultural creative products and research on visual image under VR technology | |
| CN112071130A (en) | Knowledge education system and education method based on VR technology | |
| CN104933278B (en) | A kind of multi-modal interaction method and system for disfluency rehabilitation training | |
| CN111383313B (en) | Virtual model rendering method, device, equipment and readable storage medium | |
| Wang et al. | Enhancing visualisation of anatomical presentation and education using marker-based augmented reality technology on web-based platform | |
| Kavitha et al. | Immersive learning aid for children with autism (ASD) using object recognition | |
| CN115454256A (en) | Digital oath word tombstone device | |
| Izard et al. | App design and implementation for learning human anatomy through virtual and augmented reality | |
| Li et al. | Application of virtual reality and augmented reality technology in Teaching | |
| Elkoubaiti et al. | A generic architecture of augmented and virtual reality in classrooms | |
| De Paolis et al. | Augmented Reality, Virtual Reality, and Computer Graphics: 6th International Conference, AVR 2019, Santa Maria al Bagno, Italy, June 24–27, 2019, Proceedings, Part II | |
| Kaswan et al. | AI‐Based AR/VR Models in Biomedical Sustainable Industry 4.0 | |
| CN114779942A (en) | Virtual reality immersive interaction system, equipment and method | |
| KR101643569B1 (en) | Method of displaying video file and experience learning using this |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170531 |