CN111210495A - Three-dimensional model driving method, device, terminal and computer readable storage medium - Google Patents
Three-dimensional model driving method, device, terminal and computer readable storage medium Download PDFInfo
- Publication number
- CN111210495A CN111210495A CN201911423264.7A CN201911423264A CN111210495A CN 111210495 A CN111210495 A CN 111210495A CN 201911423264 A CN201911423264 A CN 201911423264A CN 111210495 A CN111210495 A CN 111210495A
- Authority
- CN
- China
- Prior art keywords
- dimensional model
- bone
- target
- target bone
- driving
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 64
- 210000000988 bone and bone Anatomy 0.000 claims abstract description 472
- 230000033001 locomotion Effects 0.000 claims description 95
- 241001465754 Metazoa Species 0.000 claims description 54
- 238000011156 evaluation Methods 0.000 claims description 20
- 238000004590 computer program Methods 0.000 claims description 3
- 230000008569 process Effects 0.000 description 18
- 238000010586 diagram Methods 0.000 description 11
- 230000003993 interaction Effects 0.000 description 10
- 230000009471 action Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 238000004364 calculation method Methods 0.000 description 5
- 230000007613 environmental effect Effects 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 241000282577 Pan troglodytes Species 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 230000009193 crawling Effects 0.000 description 3
- 238000006073 displacement reaction Methods 0.000 description 3
- 230000009191 jumping Effects 0.000 description 3
- 230000004807 localization Effects 0.000 description 3
- 238000013507 mapping Methods 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 210000001562 sternum Anatomy 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application discloses a three-dimensional model driving method, a three-dimensional model driving device, a terminal and a computer readable storage medium, wherein the method comprises the following steps: determining a target bone of the three-dimensional model, wherein the target bone is obtained from at least two candidate bones; and binding the target bone with the three-dimensional model, wherein the target bone is used for driving the three-dimensional model to move. In this way, a three-dimensional model can select a target bone for binding from a plurality of candidate bones, so that more selectivity can be achieved.
Description
Technical Field
The present application relates to the field of computers, and in particular, to a method, an apparatus, a terminal, and a computer-readable storage medium for driving a three-dimensional model.
Background
Three-dimensional models are polygonal representations of objects, typically displayed using a computer or other video device. The displayed object may be a real-world entity or a fictional object. Anything that exists in physical nature can be represented by a three-dimensional model.
At present, the animation effect of the three-dimensional model can be realized by using application software of three-dimensional modeling.
Disclosure of Invention
The application mainly provides a three-dimensional model driving method, a three-dimensional model driving device, a terminal and a computer readable storage medium.
The first technical scheme adopted by the application is as follows: determining a target bone of the three-dimensional model, wherein the target bone is obtained from at least two candidate bones; and binding the target bone with the three-dimensional model, wherein the target bone is used for driving the three-dimensional model to move.
Wherein determining the target bone of the three-dimensional model comprises:
acquiring grid vertex position information of the three-dimensional model;
calculating the skeleton structure of the three-dimensional model by using the position information of the grid vertex;
a target bone that matches the bone structure of the three-dimensional model is determined from the at least two candidate bones.
Wherein, after determining a target bone matching the bone structure of the three-dimensional model from the at least two candidate bones, the method comprises:
evaluating the matching degree of the skeleton structure of the three-dimensional model and the target skeleton according to a preset rule, and displaying an evaluation result on a terminal interface;
and receiving a selection instruction input according to the evaluation result, wherein the selection instruction is used for indicating whether the target bone is bound with the three-dimensional model or not.
Wherein binding the target bone to the three-dimensional model comprises:
calculating the relative relation between the grid vertex of the three-dimensional model and the bone point of the target bone;
and setting the dynamic relative relation between the grid vertex of the three-dimensional model and the bone point of the target bone by using the relative relation so as to bind the target bone with the three-dimensional model, thereby driving the three-dimensional model by using the target bone.
After the target bone is bound with the three-dimensional model, the method further comprises the following steps:
acquiring an image containing a target object in real time through a camera, wherein the three-dimensional model is a virtual model corresponding to the target object;
acquiring the motion parameters of the target object according to the image;
and driving the movement of the bone points of the target bone according to the motion parameters so as to drive the motion of the three-dimensional model through the movement of the bone points.
After the target bone is bound with the three-dimensional model, the method further comprises the following steps:
acquiring preset motion parameters;
and driving the bone points of the target bone to move according to the preset motion parameters so as to drive the three-dimensional model to move through the movement of the bone points.
Wherein determining the target bone of the three-dimensional model comprises:
determining a first target bone of the three-dimensional model in a first form or a second target bone of the three-dimensional model in a second form;
binding the target bone to the three-dimensional model includes:
and binding the first target bone with the three-dimensional model so that the three-dimensional model is driven through the first target bone, or unbinding the three-dimensional model from the first target bone and binding the second target bone with the three-dimensional model so that the three-dimensional model is driven through the second target bone.
Wherein, after binding the target bone with the three-dimensional model, the method comprises:
acquiring surrounding environment data through a camera;
constructing a virtual environment with reference to the environment data;
the three-dimensional model bound to the target bone is placed within the virtual environment such that the three-dimensional model bound to the target bone is driven in the virtual environment.
The method for obtaining the candidate bones comprises the following steps:
assembling the skeletal limbs of all parts of different animal bodies provided in the skeletal database to obtain candidate skeletons.
The second technical scheme adopted by the application is as follows: a three-dimensional model driving device comprises a determining module, a judging module and a judging module, wherein the determining module is used for determining a target bone of a three-dimensional model, and the target bone is obtained from at least two candidate bones; and the binding module is used for binding the target skeleton and the three-dimensional model, wherein the target skeleton is used for driving the three-dimensional model to move.
The third technical scheme adopted by the application is as follows: a three-dimensional model driving terminal comprises a memory and a processor, wherein the processor is coupled with the memory and is used for executing a three-dimensional model driving method.
The fourth technical scheme adopted by the application is as follows: a computer readable storage medium having computer program instructions stored thereon which, when executed by a processor, implement a three-dimensional model-driven method.
The beneficial effect of this application: the target bone used for binding the three-dimensional model is determined from a plurality of candidate bones, so that the problem that one three-dimensional model only has one corresponding target bone which can be used for matching is solved, more candidate bones are provided for matching the three-dimensional model, and the selectable range is wider.
Drawings
FIG. 1 is a schematic flow chart diagram of an embodiment of a three-dimensional model-driven method of the present application;
FIG. 2 is a schematic diagram of a user interaction interface showing selection of a three-dimensional model file in an embodiment of the three-dimensional model driven method of the present application;
FIG. 3 is a schematic view of a user interaction interface showing a selected three-dimensional model file in an embodiment of the three-dimensional model driven method of the present application;
FIG. 4 is a schematic diagram of a user interaction interface showing the alignment of a three-dimensional model to a target bone in an embodiment of the three-dimensional model-driven method of the present application;
FIG. 5 is a schematic diagram of a user interaction interface illustrating selection of a preset animation-driven three-dimensional model in an embodiment of the three-dimensional model-driven method of the present application;
FIG. 6 is a schematic diagram of a user interaction interface showing driving of a three-dimensional model in a preset environment according to an embodiment of the three-dimensional model driving method of the present application;
FIG. 7 is a schematic structural diagram of an embodiment of the three-dimensional model driving apparatus of the present application;
fig. 8 is a schematic structural diagram of an embodiment of a three-dimensional model driving terminal according to the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
Referring to fig. 1, fig. 1 is a schematic flow chart of an embodiment of a three-dimensional model driving method according to the present application. As shown in fig. 1, the three-dimensional model driving method of the present embodiment includes the steps of:
and S101, determining a target bone of the three-dimensional model, wherein the target bone is obtained from at least two candidate bones.
The three-dimensional model can be established by software of a mobile terminal modeling device, made by professional three-dimensional modeling software or be a virtual three-dimensional image. The target bone is obtained from at least two candidate bones. Wherein the candidate bones include human bones, animal bones, and virtual model bones. The virtual model skeleton includes any morphology of skeleton. The means for obtaining the candidate bones may comprise assembling the skeletal limbs of all parts of different animal bodies provided in the skeletal database to obtain the candidate bones. Skeletal limbs include the cranium, vertebrae, coccyx, sternum, etc. of the respective animal body. These different parts of the skeletal limb segment may be assembled to obtain a new bone candidate. In addition, the candidate bones may be preset by the system or drawn by the user. Wherein the system preset means that the system is self-contained or the user downloads and stores the data in the database on the network. And drawing a target skeleton by the user, namely drawing the target skeleton on the three-dimensional modeling application software of the terminal equipment by the user.
A target bone that matches the bone structure of the three-dimensional model is determined from the at least two candidate bones. The target bone matched with the bone structure of the three-dimensional model may be any bone in the bone database, and is not limited to the candidate bone with the highest matching degree with the bone structure of the three-dimensional model as the target bone.
After a target skeleton matched with the three-dimensional model is determined, evaluating the matching degree of the skeleton structure of the three-dimensional model and the target skeleton according to a preset rule, and displaying an evaluation result on a terminal interface; and receiving a selection instruction input according to the evaluation result, wherein the selection instruction is used for indicating whether the target bone is bound with the three-dimensional model or not. After receiving a determination selection instruction input by a user, the terminal can bind the target skeleton with the three-dimensional model, and if a return selection instruction input by the user is received, the terminal puts the target skeleton back into the skeleton database. And reselecting a target bone from the candidate bones by the user.
The preset rule can be that the bone structure of the three-dimensional model is matched with the bone points of the target bone, and the matching degree is evaluated according to the matching degree. The specific matching degree value can be displayed, and the movement speed and the preliminary driving state of the three-dimensional model after the three-dimensional model is bound with the target skeleton can be displayed on the basis. After the evaluation result is displayed, the user can decide whether to bind according to the evaluation result, and if the matching degree is not high, but the terminal still receives the matching instruction, the terminal will force the target skeleton to be bound with the three-dimensional model.
Wherein the target bone of the three-dimensional model can be determined according to the shape of the three-dimensional model. Specifically, a first target bone of the three-dimensional model in a first form or a second target bone in a second form is determined. The first form and the second form belong to different motion forms; or one of the first form and the second form is a static form, and the other is a moving form; the motion form comprises one of a jumping form, a walking form, a flying form and a crawling form.
For example, the first form is a form of walking with two feet, and can bind a human-shaped bone or a bone such as a chimpanzee, and the second form can be a form of flying, and can bind a target bone of a four-foot flying animal.
Therefore, after a target bone is determined according to different forms of the three-dimensional model, if the form of the three-dimensional model needs to be changed, the bound first target bone needs to be unbound. For example, if the first form is a form in which the feet walk to be converted into the second form, for example, a form in which the feet fly, the first form can bind the human-shaped skeleton, and after the human-shaped skeleton is unbound, the second form can bind the skeleton of the quadruped aeroanimal. Thus, the method according to the present application also enables binding of different target bones for different modalities of a three-dimensional model.
Referring to fig. 2 and 3, fig. 2 is a schematic view of a user interaction interface showing selection of a three-dimensional model file according to the present embodiment, and fig. 3 is a schematic view of a user interaction interface showing a selected three-dimensional model file. The user can select the three-dimensional model at the terminal, and when the terminal receives a click instruction aiming at the three-dimensional model, the three-dimensional model is selected as a driving object, and the selected three-dimensional model is displayed on the terminal interface.
In the process of determining the target skeleton of the three-dimensional model, firstly, analyzing the three-dimensional model file to obtain the grid vertex position information of the three-dimensional model, calculating the skeleton structure of the three-dimensional model by utilizing the grid vertex position information of the three-dimensional model, and assembling the calculated skeleton structure to obtain the complete skeleton structure. And then, matching the bone structure of the three-dimensional model in a bone database to obtain a target bone. Therefore, obtaining the bone structure of the three-dimensional model by calculating mesh vertex information of the three-dimensional model may facilitate determination of a target bone corresponding to the three-dimensional model from among the candidate bones.
Specifically, the target bone is obtained from at least two candidate bones according to the assembled complete bone structure. In this embodiment, the method for selecting the target bone specifically includes receiving an instruction of a user for clicking a candidate bone, and taking the candidate bone corresponding to the click instruction as the target bone in response to the click instruction. In this case, the evaluation result of the matching degree between the three-dimensional model and the target skeleton can be displayed on the terminal interface for the user to refer to.
Therefore, after the target bone is determined, the matching degree of the bone structure of the three-dimensional model and the target bone can be evaluated according to the preset rule, and by providing the result of the evaluation of the matching degree, the user can decide whether to continue to bind the three-dimensional model and the target bone according to the result, so that the driving after the three-dimensional model and the target bone with high matching degree are bound is more natural.
In other embodiments, the target bone may be obtained by matching each candidate bone with a preset method in the bone database. The preset mode may be that matching is performed according to the feature data of the bone structure of the obtained three-dimensional model and the feature data of each candidate bone in the bone database, and a candidate bone meeting the matching degree with the feature data of the bone structure of the three-dimensional model is searched, the size of the matching degree may be customized by a user or defaulted by a system, after the candidate bone meeting the condition is found, the candidate bone meeting the condition is displayed on a terminal interface, and the target bone for matching is selected by the user or the candidate bone with the highest matching degree is defaulted by the system as the target bone of the three-dimensional model when the user does not select within a preset time. At this time, the feature data may be various levels of bone point features of the candidate bone or bone structure, including the number of main bone points and the positional relationship of the main bone points with each other.
And S102, binding the target skeleton with the three-dimensional model, wherein the target skeleton is used for driving the three-dimensional model to move.
Referring to fig. 4, fig. 4 is a schematic diagram of a user interaction interface for aligning a three-dimensional model to a target bone in the present embodiment. After the target skeleton is selected, the three-dimensional model is aligned to the target skeleton to serve as a standard pose of skeleton binding. Thereafter, the relative relationship of each mesh vertex of the three-dimensional model to a bone point of the target bone is calculated. The relative relationship comprises the corresponding relationship between each mesh vertex and the bone point of the target bone, and the relative relationship such as the reference distance and the angle. And setting a dynamic relative relation between the grid vertex of the three-dimensional model and the bone point of the target bone by utilizing the relative relation obtained by calculation, namely the corresponding relation between the grid vertex and the bone point of the target bone, and the relative relation between the reference distance, the reference angle and the like, so that the grid vertex corresponding to the grid vertex is controlled to move through the displacement or the rotation angle of the bone point, and then the grid vertices corresponding to the bone points move to drive other grid vertices to move. Therefore, the target skeleton is considered to be bound with the three-dimensional model, and the target skeleton can be used for driving the three-dimensional model. The dynamic relative relationship refers to how each mesh vertex moves with the movement of the bone point. For example, when a bone point moves from a position a to a position B, the mesh vertex corresponding to the bone point moves from the position C to the position D, and brings the mesh points not bound to the bone point to move relatively together, where the position C corresponds to the position a and the position D corresponds to the position B. Namely, by setting the dynamic relative relationship, it can be known how the three-dimensional model moves along with the movement of the target skeleton in the movement process, so that the three-dimensional model has the shape of the target skeleton. Therefore, after the dynamic relative relationship between the mesh vertex of the three-dimensional model and the bone point of the target bone is set, the motion of the three-dimensional model is more smooth when the three-dimensional model is driven.
For example, if the dynamic relative relationship between the mesh vertex of the three-dimensional model and the bone point of the target bone is not set, when the bone point of the target bone moves, the mesh vertex of the three-dimensional model may move to a corresponding position relatively mechanically, and in the whole driving process, just a few points move mechanically like the joint movement of a puppet, and if the dynamic relative relationship between the mesh vertex of the three-dimensional model and the bone point of the target bone is set, the mesh vertex not bound with the bone point can be driven to move relatively in the moving process of the bone point, so that the whole motion of driving the three-dimensional model is smoother.
In an embodiment, after the first target bone is bound to the three-dimensional model, the three-dimensional model is driven through the first target bone, and no matter whether the three-dimensional model is bound with the first target bone in the first form or not, when the form requirement state of the three-dimensional model is the second form, the bone structure of the three-dimensional model obtained through calculation needs to be continuously matched from at least two candidate bones, so that the second target bone is obtained. Before the process of binding the second target bone, the first target bone is unbound from the three-dimensional model, and the second target bone is bound with the three-dimensional model, so that the three-horizontal model is not driven according to the first target bone any longer, but is driven according to the second target bone.
By deriving the target bone matching the three-dimensional model from at least two candidate bones, the target bone to which a three-dimensional model can bind is made more selective.
The target skeleton to be bound is determined according to different forms of the three-dimensional model, so that a user can conveniently select the target skeleton to be bound according to the different forms of the three-dimensional model, and the problem that only one target skeleton can be set in any form of each three-dimensional model is solved.
After the target skeleton is bound with the three-dimensional model, an image containing a target object is collected through a camera, wherein the three-dimensional model is a virtual model corresponding to the target object. Specifically, the camera is turned on to acquire images of the human body, the animal body or the virtual model in the camera plane in real time, that is, after the camera is turned on, the human body, the animal body or the virtual model may appear on the camera plane. At this time, an image of the human body, the animal body or the virtual model is acquired, and the motion parameter of the target object is acquired according to the image, that is, the motion parameter of the skeleton point of the human body, the animal body or the virtual model is acquired, wherein the skeleton point is not all the skeleton points of the human body, the animal body or the virtual model but the skeleton key points thereof, such as each big relation node. And driving the movement of the bone points of the target bone according to the motion parameters so as to drive the motion of the three-dimensional model through the movement of the bone points.
Specifically, the obtained bone points of the human body, the animal body or the virtual model are corresponding to the bone points of the first target bone or the second target bone bound with the three-dimensional model, so that the bone points of the human body, the animal body or the virtual model and the bone points of the target bone bound with the three-dimensional model form a corresponding relationship.
After the corresponding relation is formed, the motion parameters of the skeleton points of the human body, the animal body or the virtual model can be acquired by carrying out real-time skeleton detection on the human body, the animal body or the virtual model through the camera. In addition, four-element information of each bone key point in the rotation process can be acquired, and the four-element information is rotation and orientation information of each bone key point in a three-dimensional space. The motion parameters of the skeleton points of the target skeleton correspond to the motion tracks of the detected skeleton points of the human body, the animal body or the virtual object, namely, the 3D position and posture of the human body, the animal body or the virtual model can be acquired in real time through the real-time skeleton detection of the human body, the animal body or the virtual object and can be used as the input information of the driving model, so that the three-dimensional model and the human body, the animal body or the virtual model act in the same direction. Therefore, the target object can be used for driving the three-dimensional model in real time, the effect of driving the three-dimensional model in real time on an application layer can be realized by driving the three-dimensional model in real time through the entity, animation of each target skeleton does not need to be preset, and the skeleton actions are more various.
Therefore, after the target skeleton is bound, the motion parameters of the target object are acquired in real time through the camera to drive the skeleton point of the target skeleton to move, and therefore the three-dimensional model is driven to move. The three-dimensional model can be driven in real time, so that the driven action is more various, and the action of the three-dimensional model is richer.
Referring to fig. 5, fig. 5 is a schematic diagram of a user interaction interface showing the selection of a preset animation-driven three-dimensional model in the present embodiment. In addition to real-time driving of the three-dimensional model by using the target object, the preset motion parameters can be obtained, wherein the preset motion parameters can be motion parameters of skeleton points in a preset animation of a real-recorded human body, animal body or virtual model, and the preset animation can be skeleton animation drawn on a terminal, skeleton animation carried by a system or skeleton animation downloaded by a user on the internet. After the preset motion parameters are obtained, the bone points of the target bone are driven to move according to the preset motion parameters, so that the three-dimensional model is driven to move through the movement of the bone points. So that a driving animation of the three-dimensional model can be obtained.
The method for driving the three-dimensional model by obtaining the preset motion parameters can be used when a proper target object cannot be found for driving, and the combination of the method for driving the three-dimensional model by obtaining the preset motion parameters and the real-time bone driving method of the target object can be suitable for more complex changing environments, so that the driving of the three-dimensional model is more convenient.
Referring to fig. 6, fig. 6 is a schematic view of a user interaction interface showing driving of a three-dimensional model in a preset environment in the present embodiment. Wherein the three-dimensional model can be driven in a virtual environment. The method comprises the steps of obtaining surrounding environment data through a camera, building a virtual environment according to the environment data, and placing a three-dimensional model bound with a target skeleton in the virtual environment, so that the three-dimensional model bound with the target skeleton is driven in the virtual environment. Specifically, the camera is turned on, the surrounding environment data is obtained in the normal shooting mode or other modes, for example, the environment data may be those objects in the surrounding environment, the appearance of the objects, the relative position relationship of each object, and the like, and the virtual environment is constructed with reference to the environment data, that is, the virtual objects may be used to replace the real objects in the obtained surrounding environment, and the appearance of the virtual objects and their relative position relationship are consistent with those in the real environment or are allowed to have a certain relative error, and the size of the relative error may be set by the user. The real-time construction of the virtual environment with reference to the environmental data is performed in real time, that is, the acquisition of the ambient environmental data is also performed in real time. The passage of virtual objects is in fact a process of reproducing the real environment. After the virtual environment has been created, the three-dimensional model bound to the target skeleton is placed in the virtual environment in the camera view, within which the three-dimensional model is driven or in which a driving animation of the three-dimensional model is played. For example, a virtual plane may be constructed from a real environment by SLAM (simultaneous localization and mapping), and a three-dimensional model may be placed on a plane of the environment in a camera screen, so that the three-dimensional model and the real environment may be more naturally fused.
In addition to driving the three-dimensional model in the virtual environment, the three-dimensional model may be directly driven in the acquired real surrounding environment or a driving animation for driving the three-dimensional model in a preset environment. When the three-dimensional model driving animation is selected to be played in the preset environment, the selected preset environment can be changed at any time.
The three-dimensional model driving method provided by the application can be suitable for scenes such as games, education, live broadcast, concerts, video calls, advertisements and the like.
Referring to fig. 7, fig. 7 is a schematic structural diagram of an embodiment of a three-dimensional model driving apparatus according to the present application. As shown in fig. 7, the three-dimensional model driving apparatus 70 of the present embodiment includes a determination module 71 and a binding module 72.
Wherein the determining module 71 is configured to determine a target bone of the three-dimensional model, the target bone being obtained from at least two candidate bones.
A binding module 72 for binding the target bone with the three-dimensional model, wherein the target bone is used for driving the three-dimensional model to move.
In a specific embodiment, the driving device 70 may further comprise a creating module 75, wherein the creating module 75 is configured to assemble the skeletal limbs of all parts of different animal bodies provided in the skeletal database to obtain the candidate skeleton. Skeletal limbs include the cranium, vertebrae, coccyx, sternum, etc. of the respective animal body. These different parts of the skeletal limb segment are assembled to obtain a new bone candidate.
In a specific embodiment, the determination module 71 determines a target bone matching the bone structure of the three-dimensional model from at least two candidate bones. The target bone matched with the bone structure of the three-dimensional model may be any bone in the bone database, and is not limited to the candidate bone with the highest matching degree with the bone structure of the three-dimensional model as the target bone.
After the determination module 71 determines the target skeleton matched with the three-dimensional model, the determination module 71 evaluates the matching degree of the skeleton structure of the three-dimensional model and the target skeleton according to a preset rule, and displays an evaluation result on a terminal interface; and receiving a selection instruction input according to the evaluation result, wherein the selection instruction is used for indicating whether the target bone is bound with the three-dimensional model or not. After receiving a determination selection instruction input by a user, the terminal can bind the target skeleton with the three-dimensional model, and if a return selection instruction input by the user is received, the terminal puts the target skeleton back into the skeleton database. And reselecting a target bone from the candidate bones by the user.
The preset rule may be that the determining module 71 performs matching according to the bone structure of the three-dimensional model and the bone point of the target bone, and evaluates the matching degree according to the matching degree of the bone point. The specific matching degree value can be displayed, and the movement speed and the preliminary driving state of the three-dimensional model after the three-dimensional model is bound with the target skeleton can be displayed on the basis. After the evaluation result is displayed, the user can decide whether to bind according to the evaluation result, and if the matching degree is not high, but the terminal still receives the matching instruction, the terminal will force the target skeleton to be bound with the three-dimensional model.
Wherein the determination module 71 may further determine the target bone according to the morphology of the three-dimensional model. Specifically, a first target bone of the three-dimensional model in a first form or a second target bone in a second form is determined. The first form and the second form belong to different motion forms; or one of the first form and the second form is a static form, and the other is a moving form; the motion form comprises one of a jumping form, a walking form, a flying form and a crawling form.
For example, the first form is a form of walking with two feet, and can bind a human-shaped bone or a bone such as a chimpanzee, and the second form can be a form of flying, and can bind a target bone of a four-foot flying animal.
Therefore, the determining module 71 determines the target bones according to different forms of the three-dimensional model, and after determining a target bone according to the first form of the three-dimensional model, if the form of the three-dimensional model needs to be changed, the bound first target bone needs to be unbound first. For example, if the first form is a form in which the feet walk to be converted into the second form, for example, a form in which the feet fly, the first form can bind the human-shaped skeleton, and after the human-shaped skeleton is unbound, the second form can bind the skeleton of the quadruped aeroanimal. Thus, the method according to the present application also enables binding of different target bones for different modalities of a three-dimensional model.
In the process of determining the target bone of the three-dimensional model, the determining module 71 firstly analyzes the three-dimensional model file, obtains the mesh vertex position information of the three-dimensional model, calculates the bone structure of the three-dimensional model by using the mesh vertex position information of the three-dimensional model, and assembles the calculated bone structure to obtain the complete bone structure. Next, the determination module 71 matches the bone structure of the three-dimensional model in the bone database to obtain the target bone. Therefore, obtaining the bone structure of the three-dimensional model by calculating mesh vertex information of the three-dimensional model may facilitate determination of a target bone corresponding to the three-dimensional model from among the candidate bones.
Specifically, the determination module 71 obtains the target bone from at least two candidate bones from the assembled complete bone structure. In the embodiment, the candidate bone corresponding to the click instruction is used as the target bone in response to the click instruction by receiving the instruction of clicking the candidate bone by the user. In this case, the evaluation result of the matching degree between the three-dimensional model and the target skeleton can be displayed on the terminal interface for the user to refer to.
Therefore, after determining the target bone, the determining module 71 can further evaluate the matching degree between the bone structure of the three-dimensional model and the target bone according to a preset rule, and by providing the result of the evaluation of the matching degree, the user can decide whether to continue to bind the three-dimensional model and the target bone according to the result, so that the driving after binding the three-dimensional model and the target bone with high matching degree is more natural.
In other embodiments, the determining module 71 may further match each candidate bone in a bone database according to a preset manner to obtain a target bone. The preset mode may be that matching is performed according to the feature data of the bone structure of the obtained three-dimensional model and the feature data of each candidate bone in the bone database, and a candidate bone meeting the matching degree with the feature data of the bone structure of the three-dimensional model is searched, the size of the matching degree may be customized by a user or defaulted by a system, after the candidate bone meeting the condition is found, the candidate bone meeting the condition is displayed on a terminal interface, and the target bone for matching is selected by the user or the candidate bone with the highest matching degree is defaulted by the system as the target bone of the three-dimensional model when the user does not select within a preset time. At this time, the feature data may be various levels of bone point features of the candidate bone or bone structure, including the number of main bone points and the positional relationship of the main bone points with each other.
After the target bone is selected, the binding module 72 aligns the three-dimensional model to the target bone as a standard pose for bone binding. Binding module 72 then calculates the relative relationship of each mesh vertex of the three-dimensional model to the bone points of the target bone. The relative relationship comprises the corresponding relationship between each mesh vertex and the bone point of the target bone, and the relative relationship such as the reference distance and the angle. And setting a dynamic relative relation between the grid vertex of the three-dimensional model and the bone point of the target bone by utilizing the relative relation obtained by calculation, namely the corresponding relation between the grid vertex and the bone point of the target bone, and the relative relation between the reference distance, the reference angle and the like, so that the grid vertex corresponding to the grid vertex is controlled to move through the displacement or the rotation angle of the bone point, and then the grid vertices corresponding to the bone points move to drive other grid vertices to move. Therefore, the target skeleton is considered to be bound with the three-dimensional model, and the target skeleton can be used for driving the three-dimensional model. The dynamic relative relationship refers to how each mesh vertex moves with the movement of the bone point. For example, when a bone point moves from a position a to a position B, the mesh vertex corresponding to the bone point moves from the position C to the position D, and brings the mesh points not bound to the bone point to move relatively together, where the position C corresponds to the position a and the position D corresponds to the position B. Namely, by setting the dynamic relative relationship, it can be known how the three-dimensional model moves along with the movement of the target skeleton in the movement process, so that the three-dimensional model has the shape of the target skeleton. Therefore, after the dynamic relative relationship between the mesh vertex of the three-dimensional model and the bone point of the target bone is set, the motion of the three-dimensional model is more smooth when the three-dimensional model is driven.
For example, if the dynamic relative relationship between the mesh vertex of the three-dimensional model and the bone point of the target bone is not set, when the bone point of the target bone moves, the mesh vertex of the three-dimensional model may move to a corresponding position relatively mechanically, and in the whole driving process, just a few points move mechanically like the joint movement of a puppet, and if the dynamic relative relationship between the mesh vertex of the three-dimensional model and the bone point of the target bone is set, the mesh vertex not bound with the bone point can be driven to move relatively in the moving process of the bone point, so that the whole motion of driving the three-dimensional model is smoother.
In an embodiment, after the first target bone is bound to the three-dimensional model, the three-dimensional model is driven through the first target bone, and no matter whether the three-dimensional model is bound with the first target bone in the first form or not, when the form requirement state of the three-dimensional model is the second form, the bone structure of the three-dimensional model obtained through calculation needs to be continuously matched from at least two candidate bones, so that the second target bone is obtained. Before the process of binding the second target bone, the first target bone is unbound from the three-dimensional model, and the second target bone is bound with the three-dimensional model, so that the three-horizontal model is not driven according to the first target bone any longer, but is driven according to the second target bone.
By deriving the target bone matching the three-dimensional model from at least two candidate bones, the target bone to which a three-dimensional model can bind is made more selective.
The target skeleton to be bound is determined according to different forms of the three-dimensional model, so that a user can conveniently select the target skeleton to be bound according to the different forms of the three-dimensional model, and the problem that only one target skeleton can be set in any form of each three-dimensional model is solved.
Further, the driving device 70 includes a driving module 73, where the driving module 73 is configured to capture an image including the target object through the camera after the binding module 72 binds the target skeleton with the three-dimensional model, where the three-dimensional model is a virtual model corresponding to the target object. Specifically, the camera is turned on and images of the human, animal or virtual model located in the camera plane are acquired. At this time, an image of the human body, the animal body or the virtual model is acquired, and the motion parameter of the target object is acquired according to the image, that is, the motion parameter of the skeleton point of the human body, the animal body or the virtual model is acquired, wherein the skeleton point is not all the skeleton points of the human body, the animal body or the virtual model but the skeleton key points thereof, such as each big relation node. And driving the movement of the bone points of the target bone according to the motion parameters so as to drive the motion of the three-dimensional model through the movement of the bone points.
Specifically, the driving module 73 corresponds the obtained bone points of the human body, animal body or virtual model to the bone points of the first target bone or the second target bone bound to the three-dimensional model, so that the bone points of the human body, animal body or virtual model and the bone points of the target bone bound to the three-dimensional model form a corresponding relationship.
After the corresponding relation is formed, the motion parameters of the skeleton points of the human body, the animal body or the virtual model can be acquired by carrying out real-time skeleton detection on the human body, the animal body or the virtual model through the camera. In addition, four-element information of each bone key point in the rotation process can be acquired, and the four-element information is rotation and orientation information of each bone key point in a three-dimensional space. The motion parameters of the skeleton points of the target skeleton correspond to the motion tracks of the detected skeleton points of the human body, the animal body or the virtual object, namely, the 3D position and posture of the human body, the animal body or the virtual model can be acquired in real time through the real-time skeleton detection of the human body, the animal body or the virtual object and can be used as the input information of the driving model, so that the three-dimensional model and the human body, the animal body or the virtual model act in the same direction. Therefore, the target object can be used for driving the three-dimensional model in real time, the effect of driving the three-dimensional model in real time on an application layer can be realized by driving the three-dimensional model in real time through the entity, animation of each target skeleton does not need to be preset, and the skeleton actions are more various.
Therefore, after the target skeleton is bound, the driving module 73 obtains the motion parameters of the target object in real time through the camera to drive the skeleton points of the target skeleton to move, so as to drive the three-dimensional model to move. The three-dimensional model can be driven in real time, so that the driven action is more various, and the action of the three-dimensional model is richer.
The driving module 73 may drive the three-dimensional model in real time by using the target object, and may obtain a preset motion parameter, where the preset motion parameter may be a motion parameter of a bone point in a preset animation of a real-recorded human body, animal body, or virtual model, and the preset animation may be a bone animation drawn on a terminal, a bone animation carried by a system, or a bone animation downloaded by a user on the internet. After the driving module 73 obtains the preset motion parameters, the bone points of the target bone are driven to move according to the preset motion parameters, so that the three-dimensional model is driven to move through the movement of the bone points. So that a driving animation of the three-dimensional model can be obtained.
The mode of obtaining the preset motion parameters to drive the three-dimensional model through the driving module 73 can be used when a proper target object cannot be found for driving, and the mode of obtaining the preset motion parameters to drive the three-dimensional model and the real-time bone driving mode of the target object are combined to be suitable for more complex-changing environments, so that the driving of the three-dimensional model is more convenient.
The driving device 70 includes an auxiliary driving module 74, where the auxiliary driving module 74 is configured to drive the three-dimensional model in the virtual environment, obtain surrounding environment data through the camera, construct the virtual environment with reference to the environment data, and place the three-dimensional model bound to the target bone in the virtual environment, so that the three-dimensional model bound to the target bone is driven in the virtual environment. Specifically, the camera is turned on, the surrounding environment data is obtained in the normal shooting mode or other modes, for example, the environment data may be those objects in the surrounding environment, the appearance of the objects, the relative position relationship of each object, and the like, and the virtual environment is constructed with reference to the environment data, that is, the virtual objects may be used to replace the real objects in the obtained surrounding environment, and the appearance of the virtual objects and their relative position relationship are consistent with those in the real environment or are allowed to have a certain relative error, and the size of the relative error may be set by the user. The real-time construction of the virtual environment with reference to the environmental data is performed in real time, that is, the acquisition of the ambient environmental data is also performed in real time. The passage of virtual objects is in fact a process of reproducing the real environment. After the auxiliary driving module 74 has built the virtual environment and has placed the three-dimensional model bound to the target skeleton in the virtual environment in the camera screen, the three-dimensional model is driven in the virtual environment or the driving animation of the three-dimensional model is played in the virtual environment. For example, a virtual plane may be constructed from the real environment by SLAM (simultaneous localization and mapping), and the three-dimensional model may be placed on the plane of the environment in the camera screen, so that the three-dimensional model and the real environment may be more naturally fused.
The auxiliary driving module 74 may drive the three-dimensional model directly in the acquired surrounding real environment or may drive animation of the three-dimensional model in a preset environment, in addition to driving the three-dimensional model in the virtual environment. When the three-dimensional model driving animation is selected to be played in the preset environment, the selected preset environment can be changed at any time.
The three-dimensional model driving device 70 provided by the present application is applicable to scenes such as games, education, live broadcasts, concerts, video calls, advertisements, and the like.
Referring to fig. 8, fig. 8 is a schematic structural diagram of an embodiment of a three-dimensional model driving terminal according to the present application. As shown in fig. 8, the three-dimensional model driving terminal 80 of the present embodiment includes a memory 81 and a processor 82. The processor 82 is coupled to the memory 81 for executing the three-dimensional model driving method.
The memory 81 stores various forms of candidate bones and bone limbs of all parts of different animal bodies, and the virtual model bones are obtained by assembling the candidate bones and the bone limbs. Skeletal limbs include the cranium, vertebrae, coccyx, sternum, etc. of the respective animal body, and program instructions are stored which, when executed, may implement the three-dimensional model-driven method. Wherein the candidate bones include human bones, animal bones, and virtual model bones. The virtual model skeleton includes any morphology of skeleton.
The processor 82 is coupled to the memory 81 to facilitate the processor 82 to execute the program in the memory 81 to implement the three-dimensional model driving method.
The processor 82 receives instructions for assembling the skeletal limbs and assembles the selected skeletal limbs to obtain new candidate bones.
The processor 82 may be configured to parse the three-dimensional model file to obtain mesh vertex position information of the three-dimensional model, calculate a bone structure of the three-dimensional model using the mesh vertex position information of the three-dimensional model, and assemble the calculated bone structure to obtain a complete bone structure.
The processor 82 is configured to determine a target bone from the at least two candidate bones that matches the bone structure of the three-dimensional model. Specifically, the processor 82 receives a click command of a user click on a candidate bone, and selects a target bone from the bone database in response to the click command. After the target skeleton is selected, the processor 82 evaluates the matching degree of the skeleton structure of the three-dimensional model and the target skeleton according to a preset rule, and displays an evaluation result on the interface of the terminal 80; and receiving a selection instruction input according to the evaluation result, wherein the selection instruction is used for indicating whether the target bone is bound with the three-dimensional model or not. The terminal 80 may bind the target bone to the three-dimensional model after receiving a positive selection command input by the user, and the terminal 80 may place the target bone back into the bone database after receiving a return selection command input by the user. And reselecting a target bone from the candidate bones by the user.
The preset rule may be that the processor 82 matches the bone points of the target bone according to the bone structure of the three-dimensional model, and evaluates the matching degree according to the matching degree of the bone points. The specific matching degree value can be displayed, and the movement speed and the preliminary driving state of the three-dimensional model after the three-dimensional model is bound with the target skeleton can be displayed on the basis. After displaying the evaluation result, the user can decide whether to bind according to the evaluation result, and if the matching degree is not high, but the terminal 80 still receives the matching instruction, the terminal 80 will force the target skeleton to bind with the three-dimensional model.
In other embodiments of the terminal 80, the processor 82 matches each target bone in the assembled complete bone structure-bone database in a predetermined manner to obtain a first target bone. The preset manner may be that the processor 82 matches the feature data of the bone structure of the three-dimensional model with the feature data of each target bone in the bone database, and searches for a target bone that satisfies a matching degree with the feature data of the bone structure of the three-dimensional model, where the matching degree may be customized by a user or default by a system. After the target bones meeting the conditions are found out, the target bones meeting the conditions are displayed on an interface of a three-dimensional model driving terminal 80, and when the target bones for matching are selected by a user or the target bones are selected by the user within preset time, the target bones with the highest matching degree are defaulted by a system to be used as first target bones of the three-dimensional model in a first state or second target bones of the three-dimensional model in a second state. At this time, the feature data may be various levels of bone point features of the target bone or bone structure, including the number of main bone points and the positional relationship of the main bone points.
The processor 82 may be used to calculate the relative relationship of the mesh vertices of the three-dimensional model to the bone points of the target bone. The relative relationship here includes a corresponding relationship between each mesh vertex and a bone point of the target bone, and a relative relationship such as a reference distance and an angle. And setting the dynamic relative relation between the mesh vertex of the three-dimensional model and the bone point of the target bone by using the relative relation obtained by calculation. The dynamic relative relationship between the grid vertex of the three-dimensional model and the bone point of the target bone is set by utilizing the corresponding relationship between the grid vertex and the bone point of the target bone, the reference distance, the reference angle and the like, so that the movement of the grid vertex corresponding to the bone point is controlled through the displacement or the rotation angle of the bone point, and then other grid vertices are driven to move through the movement of the grid vertices corresponding to the bone point, so that the target bone is considered to be bound with the three-dimensional model, and the three-dimensional model can be driven by utilizing the target bone. The dynamic relative relationship refers to how each mesh vertex moves with the movement of the bone point. For example, when a bone point moves from a position a to a position B, the mesh vertex corresponding to the bone point moves from the position C to the position D, and brings the mesh points not bound to the bone point to move relatively together, where the position C corresponds to the position a and the position D corresponds to the position B. Namely, by setting the dynamic relative relationship, it can be known how the three-dimensional model moves along with the movement of the target skeleton in the movement process, so that the three-dimensional model has the shape of the target skeleton.
Wherein the processor 82 may determine the target bone based on the morphology of the three-dimensional model. In particular, the processor 82 determines a first target bone of the three-dimensional model in a first configuration or a second target bone in a second configuration. The first form and the second form belong to different motion forms; or one of the first form and the second form is a static form, and the other is a moving form; the motion form comprises one of a jumping form, a walking form, a flying form and a crawling form.
For example, the first form is a form of walking with two feet, and can bind a human-shaped bone or a bone such as a chimpanzee, and the second form can be a form of flying, and can bind a target bone of a four-foot flying animal.
The processor 82 firstly determines a first target bone or a second target bone of the three-dimensional model in the first form or the second form, and then binds the first target bone or the second target bone with the three-dimensional model, wherein the target bone to be bound is determined according to different forms of the three-dimensional model, so that a user can conveniently select the target bone to be bound according to different forms of the three-dimensional model. After the processor 82 has bound the first target bone to the three-dimensional model, if the three-dimensional model is switched from the first configuration to the second configuration, the target bone of the three-dimensional model in the second state may be determined again, and the determination method is as described above, and the first target bone needs to be unbound from the three-dimensional model before the second target bone is bound. At this time, the first target skeleton does not work on the three-dimensional model, the three-dimensional model is driven through the second target skeleton, and the bound target skeleton is conveniently transformed according to the form of the three-dimensional model.
After the target skeleton is bound with the three-dimensional model, the processor 82 acquires an image containing the target object through the camera, wherein the three-dimensional model is a virtual model corresponding to the target object. In particular, the processor 82 turns on the camera to capture images of the human, animal or virtual model in real time in the camera plane, i.e., after turning on the camera, the human, animal or virtual model may appear in the camera plane. At this time, the processor 82 acquires an image of the human body, the animal body or the virtual model, and acquires the motion parameter of the target object according to the image, that is, the processor 82 acquires the motion parameter of the skeleton points of the human body, the animal body or the virtual model, where the skeleton points are not all the skeleton points of the human body, the animal body or the virtual model, but the skeleton key points thereof, such as the major relationship nodes. And driving the movement of the bone points of the target bone according to the motion parameters so as to drive the motion of the three-dimensional model through the movement of the bone points.
Specifically, the processor 82 corresponds the obtained bone points of the human body, animal body or virtual model to the bone points of the first target bone or the second target bone bound to the three-dimensional model, so that the bone points of the human body, animal body or virtual model and the bone points of the target bone bound to the three-dimensional model form a corresponding relationship.
After the corresponding relationship is formed, the processor 82 performs real-time bone detection on the human body, the animal body or the virtual model through the camera, and can acquire the motion parameters of the bone points of the human body, the animal body or the virtual model. In addition, the processor 82 may also obtain four-element information of each bone key point during the rotation process, where the four-element information is rotation and orientation information of each bone key point in a three-dimensional space. The motion parameters of the skeleton points of the target skeleton correspond to the motion tracks of the detected skeleton points of the human body, the animal body or the virtual object, namely, the 3D position and posture of the human body, the animal body or the virtual model can be acquired in real time through the real-time skeleton detection of the human body, the animal body or the virtual object and can be used as the input information of the driving model, so that the three-dimensional model and the human body, the animal body or the virtual model act in the same direction. Therefore, the target object can be used for driving the three-dimensional model in real time, the effect of driving the three-dimensional model in real time on an application layer can be realized by driving the three-dimensional model in real time through the entity, animation of each target skeleton does not need to be preset, and the skeleton actions are more various.
In another embodiment, the processor 82 obtains the preset motion parameter, where the preset motion parameter may be a motion parameter of a skeleton point in a preset animation of a real recorded human body, animal body or virtual model, and the preset animation may be a skeleton animation drawn on the terminal 80, a skeleton animation carried by the system itself, or a skeleton animation downloaded by the user on the internet. After the preset motion parameters are acquired, the processor 82 drives the bone points of the target bone to move according to the preset motion parameters, so that the movement of the bone points drives the three-dimensional model to move. So that a driving animation of the three-dimensional model can be obtained.
The mode of obtaining the preset motion parameters to drive the three-dimensional model through the processor 82 can be used when a suitable target object cannot be found for driving, and the mode of obtaining the preset motion parameters to drive the three-dimensional model and the real-time bone driving mode of the target object are combined to be suitable for more complex-changing environments, so that the driving of the three-dimensional model is more convenient.
After obtaining the driving animation of the three-dimensional model, the processor 82 may control playing the driving animation in the virtual environment. Ambient data is acquired by the camera and a virtual environment is constructed with reference to the ambient data, and the processor 82 places the three-dimensional model bound to the target bone in the virtual environment so that the three-dimensional model bound to the target bone is driven in the virtual environment. Specifically, the processor 82 turns on the camera, and obtains the surrounding environment data in the normal shooting mode or other modes, for example, the surrounding environment data may be those objects in the surrounding environment, the appearance of the objects, the relative position relationship of each object, and the like, and constructs the virtual environment with reference to the surrounding environment data, that is, the virtual objects may replace the obtained real objects in the surrounding environment, and the appearance of the virtual objects and their relative position relationship are consistent with or allow a certain relative error in the real environment, and the magnitude of the relative error may be set by the user. Wherein the real-time construction of the virtual environment by the processor 82 with reference to the environmental data is performed in real-time, i.e. the acquisition of the ambient data is also performed in real-time. The passage of virtual objects is in fact a process of reproducing the real environment. After the virtual environment has been constructed, the processor 82 places the three-dimensional model bound to the target skeleton within the virtual environment in the camera view, and then drives the three-dimensional model within the virtual environment or plays a driving animation of the three-dimensional model within the virtual environment. For example, a virtual plane may be constructed from the real environment by SLAM (simultaneous localization and mapping), and the three-dimensional model may be placed on the plane of the environment in the camera screen, so that the three-dimensional model and the real environment may be more naturally fused.
In other embodiments, the processor 82 may directly control the driving animation of playing the three-dimensional model in the acquired ambient real environment or play the driving animation of the three-dimensional model in the preset environment.
The three-dimensional model driving terminal 80 provided by the application can be applied to scenes such as games, education, live broadcast, concerts, video calls, advertisements and the like.
The present application further provides an embodiment of a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement a three-dimensional model-driven method.
Embodiments of the present application also provide a computer-readable storage medium. The computer-readable storage medium may include, for example, one or more of a hard disk, Random Access Memory (RAM), Read Only Memory (ROM), memory of a distributed computing system, an optical disk such as a Compact Disk (CD), Digital Versatile Disk (DVD), or blu-ray disk (BD) TM, a flash memory device, and a memory card, among others.
The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
Claims (12)
1. A three-dimensional model driving method, comprising:
determining a target bone of a three-dimensional model, wherein the target bone is obtained from at least two candidate bones;
binding the target bone to the three-dimensional model, wherein the target bone is used to drive the three-dimensional model in motion.
2. The method of claim 1, wherein the determining a target bone of the three-dimensional model comprises:
obtaining grid vertex position information of the three-dimensional model;
calculating a bone structure of the three-dimensional model using the mesh vertex position information;
determining the target bone matching the bone structure of the three-dimensional model from the at least two candidate bones.
3. The method of claim 2, wherein after said determining said target bone from said at least two candidate bones that matches a bone structure of said three-dimensional model, comprising:
evaluating the matching degree of the bone structure of the three-dimensional model and the target bone according to a preset rule, and displaying an evaluation result on a terminal interface;
receiving a selection instruction input according to the evaluation result, wherein the selection instruction is used for indicating whether the target bone is bound with the three-dimensional model.
4. The method of claim 2, wherein said binding said target bone to said three-dimensional model comprises:
calculating the relative relation between the grid vertex of the three-dimensional model and the bone point of the target bone;
and setting a dynamic relative relation between grid top points of a three-dimensional model and bone points of the target bone by using the relative relation so as to bind the target bone with the three-dimensional model, thereby driving the three-dimensional model by using the target bone.
5. The method of any of claims 1 to 4, wherein after said binding said target bone to said three-dimensional model, further comprising:
acquiring an image containing a target object in real time through a camera, wherein the three-dimensional model is a virtual model corresponding to the target object;
acquiring the motion parameters of the target object according to the image;
and driving the movement of the bone point of the target bone according to the motion parameter so as to drive the three-dimensional model to move through the movement of the bone point.
6. The method of any of claims 1 to 4, wherein after said binding said target bone to said three-dimensional model, further comprising:
acquiring preset motion parameters;
and driving the bone points of the target bone to move according to the preset motion parameters so as to drive the three-dimensional model to move through the movement of the bone points.
7. The method of any one of claims 1 to 4, wherein said determining a target bone of a three-dimensional model comprises:
determining a first target bone of the three-dimensional model in a first form or a second target bone of the three-dimensional model in a second form;
said binding said target bone to said three-dimensional model comprises:
binding the first target bone to the three-dimensional model such that the three-dimensional model is driven through the first target bone, or unbinding the three-dimensional model from the first target bone and binding the second target bone to the three-dimensional model such that the three-dimensional model is driven through the second target bone.
8. The method of claim 1, after said binding said target bone to said three-dimensional model, comprising:
acquiring surrounding environment data through a camera;
building a virtual environment with reference to the environment data;
placing the three-dimensional model bound to the target bone within the virtual environment such that the three-dimensional model bound to the target bone is driven in the virtual environment.
9. The method of claim 1, wherein obtaining the candidate bone comprises:
assembling the skeletal limbs of all parts of different animal bodies provided in a skeletal database to obtain the candidate skeleton.
10. A three-dimensional model driving apparatus, comprising:
a determination module for determining a target bone of a three-dimensional model, the target bone being derived from at least two candidate bones;
and the binding module is used for binding the target bone with the three-dimensional model, wherein the target bone is used for driving the three-dimensional model to move.
11. A three-dimensional model driven terminal comprising a memory and a processor, wherein the processor is coupled to the memory for performing the method of any of claims 1-9.
12. A computer-readable storage medium having computer program instructions stored thereon, which when executed by a processor implement the method of any one of claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911423264.7A CN111210495A (en) | 2019-12-31 | 2019-12-31 | Three-dimensional model driving method, device, terminal and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911423264.7A CN111210495A (en) | 2019-12-31 | 2019-12-31 | Three-dimensional model driving method, device, terminal and computer readable storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111210495A true CN111210495A (en) | 2020-05-29 |
Family
ID=70788491
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911423264.7A Withdrawn CN111210495A (en) | 2019-12-31 | 2019-12-31 | Three-dimensional model driving method, device, terminal and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111210495A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112581571A (en) * | 2020-12-02 | 2021-03-30 | 北京达佳互联信息技术有限公司 | Control method and device of virtual image model, electronic equipment and storage medium |
| CN113450452A (en) * | 2021-07-05 | 2021-09-28 | 网易（杭州）网络有限公司 | Three-dimensional model file conversion method and device |
| CN114596393A (en) * | 2022-01-24 | 2022-06-07 | 深圳市大富网络技术有限公司 | Skeleton model generation method, device, system and storage medium |
| CN114596393B (en) * | 2022-01-24 | 2024-06-07 | 深圳市大富网络技术有限公司 | Bone model generation method, device, system and storage medium |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103065348A (en) * | 2012-12-27 | 2013-04-24 | 江苏太奇通软件有限公司 | Two-dimension animation automatic generating method based on skeleton motion database |
| CN106780673A (en) * | 2017-02-13 | 2017-05-31 | 杨金强 | A kind of animation method and system |
| WO2017092196A1 (en) * | 2015-12-01 | 2017-06-08 | 深圳奥比中光科技有限公司 | Method and apparatus for generating three-dimensional animation |
| CN107657651A (en) * | 2017-08-28 | 2018-02-02 | 腾讯科技（上海）有限公司 | Expression animation generation method and device, storage medium and electronic installation |
| CN108961369A (en) * | 2018-07-11 | 2018-12-07 | 厦门幻世网络科技有限公司 | The method and apparatus for generating 3D animation |
| CN109816773A (en) * | 2018-12-29 | 2019-05-28 | 深圳市瑞立视多媒体科技有限公司 | A kind of driving method, plug-in unit and the terminal device of the skeleton model of virtual portrait |
| CN109993819A (en) * | 2019-04-09 | 2019-07-09 | 网易（杭州）网络有限公司 | Skinning method and device, the electronic equipment of virtual role |
-
2019
- 2019-12-31 CN CN201911423264.7A patent/CN111210495A/en not_active Withdrawn
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103065348A (en) * | 2012-12-27 | 2013-04-24 | 江苏太奇通软件有限公司 | Two-dimension animation automatic generating method based on skeleton motion database |
| WO2017092196A1 (en) * | 2015-12-01 | 2017-06-08 | 深圳奥比中光科技有限公司 | Method and apparatus for generating three-dimensional animation |
| CN106780673A (en) * | 2017-02-13 | 2017-05-31 | 杨金强 | A kind of animation method and system |
| CN107657651A (en) * | 2017-08-28 | 2018-02-02 | 腾讯科技（上海）有限公司 | Expression animation generation method and device, storage medium and electronic installation |
| CN108961369A (en) * | 2018-07-11 | 2018-12-07 | 厦门幻世网络科技有限公司 | The method and apparatus for generating 3D animation |
| CN109816773A (en) * | 2018-12-29 | 2019-05-28 | 深圳市瑞立视多媒体科技有限公司 | A kind of driving method, plug-in unit and the terminal device of the skeleton model of virtual portrait |
| CN109993819A (en) * | 2019-04-09 | 2019-07-09 | 网易（杭州）网络有限公司 | Skinning method and device, the electronic equipment of virtual role |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112581571A (en) * | 2020-12-02 | 2021-03-30 | 北京达佳互联信息技术有限公司 | Control method and device of virtual image model, electronic equipment and storage medium |
| CN112581571B (en) * | 2020-12-02 | 2024-03-12 | 北京达佳互联信息技术有限公司 | Control method and device for virtual image model, electronic equipment and storage medium |
| CN113450452A (en) * | 2021-07-05 | 2021-09-28 | 网易（杭州）网络有限公司 | Three-dimensional model file conversion method and device |
| CN114596393A (en) * | 2022-01-24 | 2022-06-07 | 深圳市大富网络技术有限公司 | Skeleton model generation method, device, system and storage medium |
| CN114596393B (en) * | 2022-01-24 | 2024-06-07 | 深圳市大富网络技术有限公司 | Bone model generation method, device, system and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11845008B2 (en) | Building virtual reality (VR) gaming environments using real-world virtual reality maps | |
| JP7028966B2 (en) | Modular Hierarchical Visual System for Autonomous Personal Companion | |
| CN103258338A (en) | Method and system for driving simulated virtual environments with real data | |
| Shum et al. | Interaction patches for multi-character animation | |
| Lamberti et al. | Virtual character animation based on affordable motion capture and reconfigurable tangible interfaces | |
| CN111210495A (en) | Three-dimensional model driving method, device, terminal and computer readable storage medium | |
| Kaur et al. | A review of platforms for simulating embodied agents in 3D virtual environments | |
| US9542747B2 (en) | Assembly simulation apparatus and method for wooden structure | |
| Mehm et al. | Content and content production | |
| Perea-Tanaka et al. | Towards tantalluc: Interactive mobile augmented reality application for the Museo de América in Madrid | |
| Delbridge | The cooling steam of the Polar Express: historical origins, properties and implications of performance capture | |
| CN114247132B (en) | Control processing method, device, equipment, medium and program product for virtual object | |
| Khode et al. | College Campus Virtual Experience Simulator | |
| Silveira | Humanoid Robotic Soccer Realistic Simulation | |
| Bakaoukas | and Monuments | |
| GÜRBÜZ | DESIGNING AN AUGMENTED REALITY BASED CITY BUILDING GAME USING CELLULAR AUTOMATA ALGORITHMS | |
| Gauxachs Sanz | 3D Procedural Modeling and Game Generation of the UJI Library | |
| Hernandez | Implementation of Augmented Reality to increase participation from young children in the hiking program Stikk Ut! | |
| Panayiotou | Rgb slemmings: An augmented reality game in your room | |
| Nakamura | The Soprants: conceptual and technical framework for a 3D interactive video game | |
| Graf et al. | Automatic Walkthrough Utilizing Building Information Modeling to Facilitate Architectural Visualization | |
| Charpentier | Accurate 3D Rigged Avatar Generation with a Kinect | |
| Shiratori | User Interfaces for Character Animation and Character Interaction | |
| Thalmann et al. | EG 2007 Course on Populating Virtual Environments with Crowds. | |
| Gu et al. | A pedagogical approach to exploring place and interaction design in collaborative virtual environments |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WW01 | Invention patent application withdrawn after publication | ||
| WW01 | Invention patent application withdrawn after publication |
Application publication date: 20200529 |