CN107222529A - Augmented reality processing method, WEB modules, terminal and cloud server - Google Patents
Augmented reality processing method, WEB modules, terminal and cloud server Download PDFInfo
- Publication number
- CN107222529A CN107222529A CN201710364711.0A CN201710364711A CN107222529A CN 107222529 A CN107222529 A CN 107222529A CN 201710364711 A CN201710364711 A CN 201710364711A CN 107222529 A CN107222529 A CN 107222529A
- Authority
- CN
- China
- Prior art keywords
- image
- cloud server
- web modules
- virtual object
- augmented reality
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 189
- 238000003672 processing method Methods 0.000 title claims abstract description 26
- 238000000034 method Methods 0.000 claims abstract description 67
- 230000009466 transformation Effects 0.000 claims description 70
- 239000011159 matrix material Substances 0.000 claims description 51
- 230000008859 change Effects 0.000 claims description 35
- 230000006835 compression Effects 0.000 claims description 13
- 238000007906 compression Methods 0.000 claims description 13
- 238000005070 sampling Methods 0.000 claims description 11
- 238000004590 computer program Methods 0.000 claims description 8
- 230000002708 enhancing effect Effects 0.000 claims description 6
- 238000000605 extraction Methods 0.000 claims description 5
- 239000011800 void material Substances 0.000 claims 1
- 238000004891 communication Methods 0.000 description 18
- 230000000694 effects Effects 0.000 description 18
- 102000002322 Egg Proteins Human genes 0.000 description 11
- 108010000912 Egg Proteins Proteins 0.000 description 11
- 210000003278 egg shell Anatomy 0.000 description 11
- 238000009877 rendering Methods 0.000 description 11
- 238000012545 processing Methods 0.000 description 10
- 238000005516 engineering process Methods 0.000 description 7
- 238000004422 calculation algorithm Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 6
- 239000000284 extract Substances 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 230000003993 interaction Effects 0.000 description 4
- PXFBZOLANLWPMH-UHFFFAOYSA-N 16-Epiaffinine Natural products C1C(C2=CC=CC=C2N2)=C2C(=O)CC2C(=CC)CN(C)C1C2CO PXFBZOLANLWPMH-UHFFFAOYSA-N 0.000 description 3
- 238000004364 calculation method Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000004927 fusion Effects 0.000 description 2
- 239000003550 marker Substances 0.000 description 2
- 238000007781 pre-processing Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 230000001953 sensory effect Effects 0.000 description 2
- 230000006399 behavior Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/131—Protocols for games, networked simulations or virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/02—Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Computer Networks & Wireless Communication (AREA)
- Multimedia (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the present invention provides a kind of augmented reality processing method, WEB modules, terminal and cloud server.Methods described includes：After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and capture the image of camera shooting；WEB modules send image to cloud server, so that cloud server is according to described image, obtain the coordinate information of the virtual object of correspondence described image, and coordinate information is used for the multiple coordinates for representing the form of virtual object in the picture；WEB modules receive coordinate information, and according to coordinate information, the form to virtual object is rendered, and obtains the first augmented reality information, and the first augmented reality information is superimposed by image with virtual object to be obtained.Methods described is sent the image of collection to cloud server by WEB modules, and the coordinate information for carrying out virtual object by cloud server is obtained, and is interacted using the existing WEB modules of terminal with cloud server, it is possible to decrease realize the cost of augmented reality.
Description
Technical field
The present embodiments relate to a kind of communication technical field, particularly a kind of augmented reality processing method, WEB modules,
Terminal and cloud server.
Background technology
Augmented reality (Augmented Reality technique, AR technology), it is that one kind believes real world
Breath and the integrated new technology of virtual world information " seamless ", are to be difficult in the certain time spatial dimension of real world script
The entity information (visual information, sound, taste or tactile etc.) experienced, by science and technology such as computers, after analog simulation again
Superposition, by virtual Information application to real world, real environment and virtual object have been added to same picture in real time
Face or space exist simultaneously, are perceived by human sensory, so as to reach the sensory experience of exceeding reality.
Augmented reality contain multimedia, three-dimensional modeling, real-time video show and control, Multi-sensor Fusion, reality
When track and registration, scene fusion etc. new technology and new tool.Because augmented reality is a kind of needs and user's online interaction
Real-time computing technique, there is high requirement to bandwidth and time delay.
Augmented reality implements process and is summarized as follows：Firstly, it is necessary to capture the target object in real world, and carry out
Quick identification, extraction feature, secondly, calculate three-dimensional coordinate information.Then, it is necessary to the information matches image obtained according to calculating
Storehouse, finally, is rendered, i.e., the object of respective virtual is added in reality scene in user interface.Image capture therein,
The matrix operation for being related to large amount of complex is recognized, calculates and renders, and with the increase of image resolution ratio and size, it is calculated
Complexity can also increase.
Due to the limitation of real-time and computational complexity, augmented reality method majority is to be based on special equipment in the prior art
(such as computer, helmet etc.) is come realizing：IMAQ, spy are realized using computer or wearable device (such as helmet, handle)
The operation such as extraction is levied, recognizes, calculate and renders.Although stronger computing capability can be provided and interactive real-time, user is met
Experience is preferable, but because equipment is huge, not portable, the price of this external equipment also costly, augmented reality in the prior art
Method too heavyweight, is suitable only for application-specific scene (such as the experience of special scenes in game, fixed-site), therefore, significantly
Limit the extensive generalization application of augmented reality.
In recent years, as mobile communication technology develops and the raising of intelligent mobile terminal disposal ability, intelligent terminal is gradually
Become a kind of terminal of AR applications generalization, the augmented reality based on intelligent mobile terminal starts to be paid attention to.
It should be noted that the augmented reality application majority based on intelligent mobile terminal is by intelligence in the prior art
The mode that terminal installs APP (Application, application program) realizes, it is this realize augmented reality during, image is adopted
Collection, feature extraction, identification, to calculate and the operation such as render be to be completed by APP in terminal local, the user that APP is not downloaded without
Method is serviced using augmented reality, it is to be understood that although terminal computing capability can be made full use of by being realized by APP,
Early development needs the flows such as design, function stamp, test so that APP can realize image capture, recognize, calculates and render
Function, causes early development cost high.In addition, also comparing heavyweight for a user, user is generally reluctant to mean
Single application scenario is gone specially to download and install an APP, and the difficulty that simple augmented reality application APP is promoted is very big,
Therefore to promote cost very high the later stage, thus realized by APP have the shortcomings that it is with high costs.
At present, prior art solves to realize the problem of augmented reality cost is high by terminal also without corresponding method.
The content of the invention
For the defect of prior art, the embodiment of the present invention provides a kind of augmented reality processing method, WEB modules, terminal
And cloud server.
On the one hand, the embodiment of the present invention provides a kind of augmented reality processing method, including：
After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and catch
Obtain the image of camera shooting；
The WEB modules send described image to cloud server, so that cloud server is according to described image, obtain
The coordinate information of the virtual object of correspondence described image, the coordinate information is used to represent shape of the virtual object in described image
Multiple coordinates of state；
The WEB modules receive the coordinate information, and according to the coordinate information, the form to the virtual object carries out wash with watercolours
Dye, obtains the first augmented reality information, the first augmented reality information is to be superimposed to obtain with the virtual object by described image
's.
On the other hand, the embodiment of the present invention also provides a kind of augmented reality processing method, including：
The image that the WEB modules of cloud server receiving terminal are sent, described image is that the WEB modules are receiving use
After the augmented reality request of family triggering, WEB modules call camera to be shot, and capture the image of camera shooting；
According to described image, the coordinate information of the virtual object of correspondence described image is obtained, the coordinate information is used to represent
Multiple coordinates of form of the virtual object in described image；
The coordinate information is sent to the WEB modules, so that the WEB modules are according to the coordinate information, to institute
The form for stating virtual object is rendered, and obtains the first augmented reality information, the first augmented reality information is by described image
It is superimposed what is obtained with the virtual object.
On the other hand, the embodiment of the present invention also provides a kind of WEB modules, including memory, processor and is stored in
On reservoir and the computer program that can run on a processor, it is characterised in that realized during the computing device described program
Following method.
After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and catch
Obtain the image of camera shooting；
The WEB modules send described image to cloud server, so that cloud server is according to described image, obtain
The coordinate information of the virtual object of correspondence described image, the coordinate information is used to represent shape of the virtual object in described image
Multiple coordinates of state；
The WEB modules receive the coordinate information, and according to the coordinate information, the form to the virtual object carries out wash with watercolours
Dye, obtains the first augmented reality information, the first augmented reality information is to be superimposed to obtain with the virtual object by described image
's.
On the other hand, the embodiment of the present invention also provides a kind of terminal, and the terminal includes above-mentioned WEB modules.
On the other hand, the embodiment of the present invention also provides a kind of computer-readable recording medium, is stored thereon with computer journey
Sequence, realizes following steps when described program is executed by processor：
After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and catch
Obtain the image of camera shooting；
The WEB modules send described image to cloud server, so that cloud server is according to described image, obtain
The coordinate information of the virtual object of correspondence described image, the coordinate information is used to represent shape of the virtual object in described image
Multiple coordinates of state；
The WEB modules receive the coordinate information, and according to the coordinate information, the form to the virtual object carries out wash with watercolours
Dye, obtains the first augmented reality information, the first augmented reality information is to be superimposed to obtain with the virtual object by described image
's.
On the other hand, the embodiment of the present invention also provides a kind of cloud server, including memory, processor and is stored in
On memory and the computer program that can run on a processor, following steps are realized during the computing device described program：
The image that the WEB modules of cloud server receiving terminal are sent, described image is that the WEB modules are receiving use
After the augmented reality request of family triggering, WEB modules call camera to be shot, and capture the image of camera shooting；
According to described image, the coordinate information of the virtual object of correspondence described image is obtained, the coordinate information is used to represent
Multiple coordinates of form of the virtual object in described image；
The coordinate information is sent to the WEB modules, so that the WEB modules are according to the coordinate information, to institute
The form for stating virtual object is rendered, and obtains the first augmented reality information, the first augmented reality information is by described image
It is superimposed what is obtained with the virtual object.
As shown from the above technical solution, augmented reality processing method provided in an embodiment of the present invention, WEB modules, terminal and
Cloud server, methods described gathers image by the WEB modules, and the image of collection is sent to cloud server, by
Cloud server carries out the coordinate information obtaining step of virtual object so that without separately downloading an APP, make full use of terminal to have
APP interacted with cloud server, you can realize augmented reality, thus can reduce the cost for realizing augmented reality.
Brief description of the drawings
Fig. 1 is a kind of schematic flow sheet of augmented reality processing method provided in an embodiment of the present invention；
A kind of schematic flow sheet for augmented reality processing method that Fig. 2 provides for further embodiment of this invention；
A kind of schematic flow sheet for augmented reality processing method that Fig. 3 provides for further embodiment of this invention；
A kind of schematic flow sheet for augmented reality processing method that Fig. 4 provides for further embodiment of this invention；
A kind of structural representation for augmented reality processing system that Fig. 5 provides for further embodiment of this invention；
A kind of structural representation for augmented reality processing system that Fig. 6 provides for further embodiment of this invention；
A kind of structural representation for WEB modules that Fig. 7 provides for further embodiment of this invention；
A kind of structural representation for terminal that Fig. 8 provides for further embodiment of this invention；
A kind of structural representation for cloud server that Fig. 9 provides for further embodiment of this invention.
Embodiment
To make the purpose, technical scheme and advantage of the embodiment of the present invention clearer, below in conjunction with the embodiment of the present invention
In accompanying drawing, the technical scheme in the embodiment of the present invention is explicitly described, it is clear that described embodiment be the present invention
A part of embodiment of embodiment, rather than whole embodiments.
Fig. 1 shows a kind of schematic flow sheet of augmented reality processing method provided in an embodiment of the present invention.
Reference picture 1, method provided in an embodiment of the present invention specifically includes following steps：
Step 11, receive user triggering augmented reality request after, the WEB modules of terminal call camera to be clapped
Take the photograph, and capture the image of camera shooting.
In the present embodiment, the IMAQ of augmented reality is carried out by the WEB modules of terminal.
Alternatively, the WEB modules are WEB (World Wide Web, global wide area network) parts of terminal, are that user exists
Information is searched and browsed on network there is provided patterned, easily accessed intuitive interface, is had a wide range of applications in the terminal,
As browser has a WEB modules, wechat, microblogging, QQ etc. have browser kernel, equally have WEB modules.
Specifically, the button of augmented reality request can be presented in WEB modules for user, and user accesses the net of the WEB modules
During page, operation WEB modules are interacted with terminal, and WEB modules receive the augmented reality request of user's triggering, the augmented reality
Service request is used to ask to service using augmented reality.
In this step, after the augmented reality request is received, WEB modules carry out IMAQ operation, are specially
Call camera to be shot, and the image that camera is shot is captured by WEB modules, described image is stored in WEB modules.
Step 12, the WEB modules send described image to cloud server, so that cloud server is according to the figure
Picture, obtains the coordinate information of the virtual object of correspondence described image, and the coordinate information is used to represent the virtual object in the figure
Multiple coordinates of form as in.
In the present embodiment, the WEB modules can be interacted by network with the cloud server, the high in the clouds clothes
Business device is can to carry out the server of augmented reality calculating, and with default virtual object database, wherein the correspondence that is stored with is described
The virtual object of image.
Specifically, the cloud server receives the described image that the WEB modules are sent, and recognizes the WEB modules
Identify whether to match with the mark of the WEB modules in augmented reality service list set in advance, if matching, self-virtualizing thing data
The virtual object of correspondence described image is obtained in storehouse, using algorithm of the prior art, calculating obtains the virtual object in the figure
Multiple coordinates of form as in.
Step 13, the WEB modules receive the coordinate information, according to the coordinate information, to the shape of the virtual object
State is rendered, and obtains the first augmented reality information, and the first augmented reality information is by described image and the virtual object
What superposition was obtained.
In this step, the WEB modules receive the coordinate information, and the form to the virtual object is rendered, will
The virtual object superposition on the image, obtains the first augmented reality information, and show the first obtained augmented reality information.
It is understood that most of terminal is respectively provided with browser, wechat, microblogging, that is to say, that most of
Terminal is respectively provided with the WEB modules, in the present embodiment, image acquisition step is carried out by the WEB modules, by the figure of collection
The coordinate obtaining step of virtual object is carried out by cloud server to cloud server as sending, in the present embodiment, by terminal
WEB modules are interacted with cloud server realizes augmented reality jointly so that without downloading an APP to realize that augmented reality is another,
Utilize the existing APP of terminal and cloud server, you can realize augmented reality.
In another embodiment, after methods described step 11, methods described also includes：
The WEB modules are pre-processed to described image, and the pretreatment is following at least one：Described image is adopted
Sample, compression, extraction feature.
Correspondingly, the step 12 is specifically, pretreated image is sent to cloud server.
In view of the limitation of bandwidth, by the WEB modules described image/video flowing is pre-processed after retransmit to cloud
Server is held, relatively small image/video stream can be obtained, so as to reduce the delay in transmitting procedure, to improve transmission effect
Rate.
The augmented reality processing method that the present embodiment is provided, at least with following technique effect：
Image is gathered by the WEB modules, and the image of collection is sent to cloud server, is entered by cloud server
The coordinate information obtaining step of row virtual object so that without separately downloading an APP, make full use of the existing APP of terminal and high in the clouds
Server is interacted, you can realize augmented reality, thus can reduce the cost for realizing augmented reality.
Fig. 2 shows a kind of schematic flow sheet for augmented reality processing method that further embodiment of this invention is provided.
Reference picture 2, on the basis of above-described embodiment, the augmented reality processing method that the present embodiment is provided.Methods described
Step 11, the mode of WEB modules capture camera can have a variety of, and the present embodiment illustrates one of which.
Step 21, receive user triggering augmented reality request after, WEB modules call camera to be shot, and
The video flowing that camera is shot is captured, the video flowing includes multiple orderly images.
Alternatively, WEB modules call camera to be shot, the video flowing that capture camera is shot, and the video flowing is
Include the video of multiple orderly images.
Step 22, the WEB modules are by the video stream to cloud server, so that cloud server is according to described
First image, obtains the coordinate information of the virtual object of correspondence first image, and the coordinate information is used to represent described
Multiple coordinates of form of the virtual object in first image.
Step 22 is similar to above-mentioned steps 12, and the WEB modules take the video stream to cloud server, high in the clouds
Device be engaged according to first image, the coordinate information of the virtual object of correspondence first image is obtained.
Step 23, the WEB modules receive the coordinate information, according to the coordinate information, to the shape of the virtual object
State is rendered, and obtains the first augmented reality information, the first augmented reality information be by first image with it is described
Virtual object superposition is obtained.
Step 23 is similar to above-mentioned steps 13, and the present embodiment is repeated no more.
Step 24, the WEB modules receive the angular transformation matrix that cloud server is sent, and the angular transformation matrix is used
In the angular transformation for indicating form of the virtual object in described image, the angular transformation matrix is cloud server tracking
The change of coordinate information of the true thing in continuous two images is come what is determined, and the virtual object is that cloud server judges
Know in described image have with the true thing that true thing is matched in default true thing database, then obtained according to the true thing
Obtain.
Alternatively, cloud server is detected to described image, and whether judgement is known in described image has with presetting
True thing database in true thing matching true thing, if so, it is described that correspondence is then obtained from default virtual object database
The virtual object of true thing.
Alternatively, cloud server is tracked to the position of the true thing, and tracking can use KCF
The track algorithm of image procossings such as (Kernerlized Correlation Filter, correlation filter), obtains described true
Corresponding change is done in the change of coordinate information of the thing in first and second image, the change of the coordinate information to tracing into
Change, the solution mode such as affine transformation can be used by solving transformation matrix, obtain the angular transformation matrix, and by angular transformation square
The WEB modules are delivered in paroxysm.
That is, the position of true thing changes in image, cloud server obtains corresponding virtual object, makes described
The angle of virtual object can also change, and the angular transformation of form of the virtual object in described image can be virtual object angle
The direction and position of change.
Step 25, the WEB modules are according to the angular transformation matrix, and the form to the virtual object is rendered, obtained
To the second augmented reality information, the second augmented reality information is superimposed with the virtual object by the true thing and obtained.
Alternatively, the WEB modules are according to the angular transformation matrix, and the form to the virtual object is rendered.
Specifically, the WEB modules are rendered in render process in the position of the true thing to the virtual object,
And angular transformation is carried out, wherein, the related skills of WebGL (Web Graphics Library, network graphic storehouse) can be used by rendering
Art, obtains the second augmented reality information so that the virtual object can carry out angular transformation in the video flowing.
It is understood that during user shoots the video flowing, any small movement of camera will all be led
Cause each image of video flowing to produce to change, true change in location of the thing in consecutive image described in cloud server real-time tracking,
Calculated in real time according to change in location and obtain corresponding angular transformation matrix so that the virtual object can be according to the change of the true thing
Change and change, realize more powerful augmented reality effect.
If judgement know in described image not with the true thing that true thing is matched in default true thing database, institute
State cloud server and return to feedback information to the WEB modules, to point out the figure that the WEB modules recapture camera is shot
Picture.
For example, described image is one bottle of wine on dining table, and the cloud server judges to know that described image is in completely
The trade mark of Xian Liao breweries, then the cloud server obtains the painted eggshell of the corresponding trade mark, if default painted eggshell is in the bottle of bottle
The position of lid, obtains coordinate information of the painted eggshell in image, and sends to the WEB modules, makes the WEB modules in described image
The position of middle bottle cap is rendered, and the painted eggshell is presented.
The cloud server judges to know the trade mark for not having brewery in described image, then the cloud server can basis
The feedback information stored in the virtual object database, obtains coordinate information of the feedback information in image, and send to the WEB
Module, makes the WEB modules be rendered the position of bottle cap in described image, and the feedback information, the feedback letter is presented
Breath can be the picture for pointing out user's dollying head.
In another embodiment, after methods described step 21, methods described also includes：
The WEB modules are pre-processed to the video flowing, and the pretreatment is following at least one：To the video
Stream sampling, compression.
Correspondingly, the step 22 is specifically, by pretreated video stream to cloud server.
In view of the limitation of bandwidth, by the WEB modules described image/video flowing is pre-processed after retransmit to cloud
Server is held, relatively small image/video stream can be obtained, so as to reduce the delay in transmitting procedure, to improve transmission effect
Rate.
The present embodiment provides augmented reality processing method, at least with following technique effect：
Video flowing is gathered by the WEB modules, and by the video stream of collection to cloud server, by cloud service
Device carries out real-time angular transformation to virtual object so that the virtual object that the WEB modules are shown can carry out angular transformation, real
Now more powerful augmented reality effect.
Fig. 3 shows a kind of schematic flow sheet for augmented reality processing method that further embodiment of this invention is provided.
Reference picture 3, on the basis of above-described embodiment, the augmented reality processing method that the present embodiment is provided.
Methods described includes：
The image that step 31, the WEB modules of cloud server receiving terminal are sent, described image is that the WEB modules exist
After the augmented reality request for receiving user's triggering, WEB modules call camera to be shot, and capture the figure of camera shooting
Picture.
In the present embodiment, it is similar to above-mentioned steps 11, IMAQ, cloud server are carried out by the WEB modules of terminal
The image that the WEB modules of receiving terminal are sent.
Step 32, according to described image, obtain the coordinate information of the virtual object of correspondence described image, the coordinate information is used
In the multiple coordinates for representing form of the virtual object in described image.
In the present embodiment, similar to above-mentioned steps 12, the cloud server is can to carry out the clothes of augmented reality calculating
Business device, and with default virtual object database, wherein the virtual object for the correspondence described image that is stored with.
Specifically, the cloud server, which is received, obtains correspondence described image in described image, self-virtualizing thing database
Virtual object, using algorithm of the prior art, calculates the multiple coordinates for obtaining form of the virtual object in described image.
Step 33, the coordinate information sent to the WEB modules, so that the WEB modules are believed according to the coordinate
Breath, the form to the virtual object is rendered, and obtains the first augmented reality information, the first augmented reality information is by institute
State image and be superimposed what is obtained with the virtual object.
In the present embodiment, similar to above-mentioned steps 13, the Cloud Server sends the coordinate information to the WEB
Module.
In another embodiment, cloud server is according to the coordinate information, and the form to the virtual object is carried out
Render, obtain the first augmented reality information, the first augmented reality information is to be superimposed by described image with the virtual object
Arrive.
That is, the step of rendering can be completed by cloud server, by the first augmented reality information of acquisition send to
The WEB modules.The rendering step of augmented reality is completed by cloud server so that the WEB modules of terminal can be received directly
Augmented reality information after rendering, so as to reduce the function of terminal, can further save the cost of the WEB modules of terminal.
The present embodiment provides augmented reality processing method, at least with following technique effect：
The image that WEB modules are gathered is received by cloud server, the coordinate information obtaining step of virtual object is carried out so that
Without separately downloading an APP, the existing WEB modules of terminal are made full use of to be interacted with cloud server, you can to realize terminal
Augmented reality effect, thus can reduce the cost for realizing augmented reality.
Fig. 4 shows a kind of schematic flow sheet for augmented reality processing method that further embodiment of this invention is provided.
Reference picture 4, on the basis of above-described embodiment, the augmented reality processing method that the present embodiment is provided.Methods described
Step 31, the image that the WEB modules of the cloud server receiving terminal are sent can have a variety of, and the present embodiment is illustrated wherein
It is a kind of.
The video flowing that step 41, the WEB modules of cloud server receiving terminal are sent, the video flowing is that the WEB exists
After the augmented reality request for receiving user's triggering, WEB modules call camera to be shot, and capture regarding for camera shooting
Frequently, the video flowing includes multiple orderly images.
Alternatively, WEB modules call camera to be shot, the video flowing that capture camera is shot, and the video flowing is
Include the video of multiple orderly images.
Step 42, cloud server obtain the virtual object of correspondence first image according to first image
Coordinate information, the coordinate information is used for the multiple coordinates for representing form of the virtual object in first image.
Step 42 is similar to above-mentioned steps 32, and cloud server obtains correspondence described first according to first image
Open the coordinate information of the virtual object of image.
Step 43, the coordinate information sent to the WEB modules, so that the WEB modules are believed according to the coordinate
Breath, the form to the virtual object is rendered, and obtains the first augmented reality information, the first augmented reality information is by institute
State image and be superimposed what is obtained with the virtual object.
Step 43 is similar to above-mentioned steps 33, and the present embodiment is repeated no more.
Step 44, cloud server, which judge to know in described image, to be had and true thing in default true thing database
The true thing matched somebody with somebody, then obtain corresponding virtual object according to the true thing, tracks seat of the true thing in continuous two image
The change of information is marked, to determine angular transformation matrix, the angular transformation matrix is used to indicate the virtual object in described image
In form angular transformation.
Alternatively, cloud server is tracked to the position of the true thing, and tracking can use KCF
The track algorithm of image procossings such as (Kernerlized Correlation Filter, correlation filter), obtains described virtual
Corresponding change is done in the change of coordinate information of the thing in first and second image, the change of the coordinate information to tracing into
Change, the solution mode such as affine transformation can be used by solving transformation matrix, obtain the angular transformation matrix, and by angular transformation square
The WEB modules are delivered in paroxysm.
Step 45, cloud server send the angular transformation matrix to the WEB modules, for the WEB modules
According to the angular transformation matrix, the form to the virtual object is rendered, and obtains the second augmented reality information, described second
Augmented reality information is superimposed with the virtual object by the true thing and obtained.
Alternatively, the WEB modules are according to the angular transformation matrix, and the form to the virtual object is rendered.
Specifically, the WEB modules carry out angular transformation in render process to the virtual object, wherein, rendering can be with
Using WebGL (Web Graphics Library, network graphic storehouse) correlation technique, the second augmented reality information is obtained so that
The virtual object can carry out angular transformation in the WEB modules.
It is understood that during user shoots the video flowing, any small movement of camera will all be led
Cause each image of video flowing to produce to change, change in location of the virtual object in consecutive image described in cloud server real-time tracking,
Calculated in real time according to change in location and obtain corresponding angular transformation matrix so that the virtual object can be according to the change of described image
And change, realize more powerful augmented reality effect.
If judgement know in described image not with the true thing that true thing is matched in default true thing database, institute
State cloud server and obtain corresponding feedback information, and feedback information is returned to the WEB modules, to point out the WEB modules
The image that recapture camera is shot.
For example, described image is one bottle of wine on dining table, and the cloud server judges to know that described image is in completely
The trade mark of Xian Liao breweries, then the cloud server obtains the painted eggshell of the corresponding trade mark, if default painted eggshell is in the bottle of bottle
The position of lid, obtains coordinate information of the painted eggshell in image, and sends to the WEB modules, makes the WEB modules in described image
The position of middle bottle cap is rendered, and the painted eggshell is presented.The cloud server judges to know do not have brewery in described image
Trade mark, then the cloud server can be according to the feedback information stored in the virtual object database, and acquisition feedback information is in figure
The coordinate information of picture, and send to the WEB modules, the WEB modules is rendered the position of bottle cap in described image,
The feedback information is presented, the feedback information can be the picture for pointing out user's dollying head.
Further, the change of coordinate information of the cloud server according to the trade mark of brewery in continuous two images
Change, to determine the angular transformation matrix of painted eggshell, the angular transformation matrix is used for translation-angle and the direction for indicating painted eggshell.
As user moves up camera so that the position of trade mark is moved down, then angle change matrix indicates the coloured silk
Egg is also moved down；Or user tilts down camera so that the position of trade mark is moved up, then angle change matrix is indicated
The painted eggshell is also moved up.
The augmented reality processing method that the present embodiment is provided, at least with following technique effect：
Video flowing is gathered by the WEB modules, and by the video stream of collection to cloud server, by cloud service
Device carries out real-time angular transformation to virtual object so that the virtual object that the WEB modules are shown can carry out angular transformation, real
Now more powerful augmented reality effect.
Fig. 5 shows a kind of structural representation for augmented reality processing system that further embodiment of this invention is provided.
Refering to Fig. 5, on the basis of above-described embodiment, the augmented reality processing system that further embodiment of this invention is provided,
It can be realized based on the WEB modules, the APP in terminal with the WEB modules has a variety of, and the present embodiment enters by taking wechat as an example
Row explanation.
At present, with a large amount of popularizations of wechat, wechat has become an important entrance of mobile Internet.Enterprises and institutions
Unit all reaches publicity enterprise product by wechat public number (including subscription number, service number, small routine etc.), realizes and user
One important means of interaction.For a user, it is not necessary to download special APP, only need to scan Quick Response Code just can be with
Some public number is rapidly paid close attention to, therefore, enterprises and institutions can carry out marketing and propaganda activity using wechat public number, inhale
Family is quoted to pay close attention to.But do not support the interactive function based on augmented reality in present public number/service number also, look forward to thing
Industry unit and user using augmented reality can not carry out some advertisings and on-line off-line in wechat public number
Marketing interactive service.
The behavior of user's access network address is supported by WEB modules in wechat public number, realizes that enhancing is existing based on WEB modules
The wechat public number of customization of the public number of real service for the present invention.
Augmented reality server is that high in the clouds can provide the server of augmented reality service.
Augmented reality processing system of the present invention includes the wechat public number customized, wechat public number platform and augmented reality
Server three subsystems.
The wechat public number subsystem of the customization, is that with the addition of enhancing on the basis of original general wechat public number
The wechat public number of real function, it includes user UI, data communication module, image capture module, image pre-processing module, 3D
Five submodules of rendering module.
The user UI submodules, are used for and user mutual, receive the request of user, the response of feedback server.
The data communication submodule, for entering row data communication with augmented reality server.
Described image gathers submodule, for calling the capture apparatus of terminal to be shot, and captures the figure photographed
As information.
Described image pre-processes submodule, for being sampled to the image that IMAQ submodule is captured, and compresses, and extracts
Feature etc. is pre-processed.
The 3D renders submodule, for being rendered to virtual information.
The wechat public number platform subsystem includes two submodules of user data and developer's interface.
The user data submodule, passes through wechat internal communications interface, immediate updating user profile.
Developer's interface sub-module, the OpenID for obtaining user, the information such as geographical position.
The augmented reality server subsystem, including true thing database, module of target detection, object tracking module,
Five submodules of coordinate transform computing module and data communication module.
The true thing database subsystem module, for storing the true thing information after true thing or processing, as in figure
Marker database.
The target detection submodule, for detecting whether there are true thing data in the image information that wechat public number is transmitted
True thing present in storehouse.
The object tracking submodule, for tracking true thing coordinate bit in the image that augmented reality server is received
Put.
The coordinate transform computing module, for obtaining virtual in default virtual object database according to the true thing
Thing, and calculate angular transformation matrix of the virtual object in described image.
The data communication submodule, for by position coordinates of the virtual object in augmented reality server and angular transformation
Matrix is sent to wechat public number.
Augmented reality processing system of the present invention, the method that above method embodiment can be achieved, specifically includes following steps：
Step 1：User UI receives augmented reality service request, and this request is sent into wechat by wechat internal links
Public number management platform.
Step 2：The data communication module of the wechat public number of customization and the data communication module of augmented reality server
Connection is set up, augmented reality service request is sent into augmented reality server.
Step 3：The data communication module of augmented reality server is obtained from developer's interface of wechat public number management platform
Take the OpenID at family, the information such as geographical position.
Step 4：Augmented reality server judges whether user has using enhancing by the OpenID and geographical position of user
The authority of reality service.It is specifically including but not limited to judge whether user has paid close attention to public number according to the OpenID of user, according to
Whether the geographical position of user, judge user in the vicinity of expression thing.If user has the authority used, into step 5.
Step 5：Set up and be bi-directionally connected between augmented reality server and the wechat public number of customization.
Step 6：Terminal camera is called in the image capture module application of the wechat public number of customization, if user authorizes
Using camera, image capture module calls terminal camera using technologies such as WebRTC, and regarding of capturing that camera photographs
Frequency flows.If user forbids, augmented reality server is sent this information to.
Step 7：The image pre-processing module of the wechat public number of customization is sampled to each image of video flowing, compression,
Extract the operation such as feature.Sampling can use the modes such as average sampling, and compression can convert the image into the higher lattice of compression ratio
Formula, SIFT (Scale-invariant feature transform, Scale invariant features transform) can be used by extracting feature,
SURF (speeded up robust features accelerate matching characteristic), ORB (oriented brief, succinct to be oriented to) etc.
The method of a series of images processing.
Step 8：The data communication module of the wechat public number of customization is existing to enhancing by pretreated video stream
Real server.
Step 9：Image information of the module of target detection of augmented reality server in true thing database to receiving
Detect.The method of detection can be matched with RANSAC scheduling algorithms.If detecting the true of matching in described image
Thing, then into step 10.
Step 10：The object tracking module of augmented reality server is tracked to the position of true thing, and tracking can make
Pass through augmented reality service with the positional information of the track algorithm of some image procossings such as KCF, and the true thing that tracking is obtained
The data communication module of device is sent to the wechat public number of customization.
Step 11：The coordinate transform computing module of augmented reality server obtains the virtual object of the true thing of correspondence, and to
Track to information do corresponding conversion, the solution mode such as affine transformation can be used by solving transformation matrix, and by obtained conversion
Matrix is sent to public number by the data communication module of augmented reality server.
Step 12：The 3D rendering modules of the wechat public number of customization are according to the position of the true thing received, it is determined that empty
Intend the position of thing, the posture of virtual object is determined according to transformation matrix, is rendered.WebGL correlation techniques can be used by rendering.
Fig. 6 shows a kind of structural representation for augmented reality processing system that further embodiment of this invention is provided.
The augmented reality processing system provided refering to Fig. 6, further embodiment of this invention, the wechat public affairs including customizing
Many numbers, wechat public number server and augmented reality server three subsystems.
The wechat public number subsystem of the customization includes user UI, data communication module, image capture module and aobvious
Show the multiple submodules such as module.
Wherein, the user UI submodules, the data communication submodule, described image collection submodule and phase in Fig. 5
Together, the system also includes display sub-module, and video or the image information that display server is transmitted are strengthened for showing.
The augmented reality server subsystem, including marker database, module of target detection, object tracking module,
Coordinate transform computing module, six submodules of 3D rendering modules and data communication module.
Wherein, the true thing database subsystem module, the target detection submodule, the object tracking submodule and figure
Identical in 5, the system also renders submodule including 3D, for the position coordinates and coordinate obtained according to object tracking submodule
The transformation matrix of coordinates that transformation calculations module is obtained carries out 3D on the image received and rendered；The data communication submodule,
For the rendered image for having 3D virtual informations to be sent into wechat public number.
Correspondingly, after above-mentioned steps 11, in addition to：Strengthen the 3D rendering modules of display server according to receiving
Tracking information determines virtual object location, the posture of virtual object is determined according to transformation matrix, in the true thing of the image received
3D is carried out on position to render.
Further, the image for rendering 3D virtual objects is sent to wechat by the data communication module of augmented reality server
Public number.
The APP that augmented reality is serviced in the prior art, each step of its augmented reality service is locally to complete, user
APP, which need to be downloaded, could realize augmented reality service.
In the present embodiment, in order to which the generalization for promoting the augmented reality based on intelligent mobile terminal is promoted and should
With, without user specially download installation APP, merely with the terminal of user mounted wechat and high in the clouds with WEB modules
Augmented reality server interaction is that augmented reality service can be achieved, so as to reduce exploitation APP cost, and in augmented reality
Augmented reality calculating is carried out on server, the burden of terminal can be mitigated, it is to be understood that augmented reality server has stronger
Big computing function, calculating speed is faster.
The augmented reality processing method that the present embodiment is provided, at least with following technique effect：
It is that enhancing can be achieved by using the augmented reality server interaction in the mounted wechat of the terminal of user and high in the clouds
Reality service, while the augmented reality service of low cost is realized, can accelerate calculation process, mitigate the burden of terminal again.
Fig. 7 shows a kind of structural representation for WEB modules that further embodiment of this invention is provided.
A kind of WEB modules provided refering to Fig. 7, further embodiment of this invention, the WEB modules include memory 71, place
Manage device 72 and be stored in the computer program that can be run on memory 71 and on a processor.
Following steps are realized during the computing device described program：
After the augmented reality request of user's triggering is received, call camera to be shot, and capture camera shooting
Image；
Described image is sent to cloud server, so that cloud server is according to described image, the correspondence figure is obtained
The coordinate information of the virtual object of picture, the coordinate information is used for the multiple seats for representing form of the virtual object in described image
Mark；
The coordinate information is received, according to the coordinate information, the form to the virtual object is rendered, and obtains first
Augmented reality information, the first augmented reality information is superimposed by described image with the virtual object to be obtained.
In another embodiment, following steps are realized during the computing device described program：
Call camera to be shot, and capture the video flowing of camera shooting, the video flowing includes multiple orderly
Image,
Correspondingly, described image is sent to cloud server, is specially：
By the video stream to cloud server, so that cloud server is according to first image, acquisition pair
The coordinate information of the virtual object of first image is answered, the coordinate information is used to represent the virtual object at described first
Multiple coordinates of form in image；
Correspondingly, receive after the coordinate information, methods described also includes：
The angular transformation matrix that cloud server is sent is received, the angular transformation matrix is used to indicate that the virtual object exists
The angular transformation of form in described image, the angular transformation matrix is that cloud server tracks the true thing continuous two
Open the change of the coordinate information in image to determine, the virtual object is that cloud server judges to know in described image have
True thing with true thing is matched in default true thing database, then acquire according to the true thing；
According to the angular transformation matrix, the form to the virtual object is rendered, and obtains the second augmented reality information,
The second augmented reality information is superimposed with the virtual object by the true thing and obtained.
After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and catch
Obtain the image of camera shooting；
The WEB modules send described image to cloud server, so that cloud server is according to described image, obtain
The coordinate information of the virtual object of correspondence described image, the coordinate information is used to represent shape of the virtual object in described image
Multiple coordinates of state；
The WEB modules receive the coordinate information, and according to the coordinate information, the form to the virtual object carries out wash with watercolours
Dye, obtains the first augmented reality information, the first augmented reality information is to be superimposed to obtain with the virtual object by described image
's.
Further, in another embodiment, following steps are realized during the computing device described program：
If the image that the WEB modules capture camera is shot, methods described also includes：The WEB modules are to the figure
As being pre-processed, the pretreatment is following at least one：To described image sampling, compression, extract feature：
Correspondingly, described image is sent to cloud server, is specially to send pretreated image to high in the clouds to take
Business device；
If the video flowing that the WEB modules capture camera is shot, methods described is also wrapped：The WEB modules are regarded to described
Frequency stream is pre-processed, and the pretreatment is following at least one：To video flowing sampling, compression：
Correspondingly, described image is sent to cloud server, is specially by pretreated video stream to high in the clouds
Server.
The WEB modules that the present embodiment is provided, available for the corresponding program of method for performing above method embodiment, this implementation
Repeat no more.
The WEB modules that the present embodiment is provided, at least with following technique effect：
By realizing collection image during the computing device described program, and the image of collection is sent to cloud service
Device, the coordinate information obtaining step of virtual object is carried out by cloud server so that without separately downloading an APP, make full use of end
Hold existing APP to be interacted with cloud server, you can to realize augmented reality, thus can reduce realize augmented reality into
This.
Fig. 8 shows a kind of structural representation for terminal that further embodiment of this invention is provided.
Refering to Fig. 8, the terminal that another embodiment is provided is invented, the terminal includes WEB modules, and the WEB modules include
Memory 71, processor 72 and it is stored in the computer program that can be run on memory 71 and on a processor.
Following steps are realized during the computing device described program：
After the augmented reality request of user's triggering is received, call camera to be shot, and capture camera shooting
Image；
Described image is sent to cloud server, so that cloud server is according to described image, the correspondence figure is obtained
The coordinate information of the virtual object of picture, the coordinate information is used for the multiple seats for representing form of the virtual object in described image
Mark；
The coordinate information is received, according to the coordinate information, the form to the virtual object is rendered, and obtains first
Augmented reality information, the first augmented reality information is superimposed by described image with the virtual object to be obtained.
In another embodiment, following steps are realized during the computing device described program：
Call camera to be shot, and capture the video flowing of camera shooting, the video flowing includes multiple orderly
Image,
Correspondingly, described image is sent to cloud server, is specially：
By the video stream to cloud server, so that cloud server is according to first image, acquisition pair
The coordinate information of the virtual object of first image is answered, the coordinate information is used to represent the virtual object at described first
Multiple coordinates of form in image；
Correspondingly, receive after the coordinate information, methods described also includes：
The angular transformation matrix that cloud server is sent is received, the angular transformation matrix is used to indicate that the virtual object exists
The angular transformation of form in described image, the angular transformation matrix is that cloud server tracks the true thing continuous two
Open the change of the coordinate information in image to determine, the virtual object is that cloud server judges to know in described image have
True thing with true thing is matched in default true thing database, then acquire according to the true thing；
According to the angular transformation matrix, the form to the virtual object is rendered, and obtains the second augmented reality information,
The second augmented reality information is superimposed with the virtual object by the true thing and obtained.
Further, in another embodiment, following steps are realized during the computing device described program：
If the image that the WEB modules capture camera is shot, methods described also includes：The WEB modules are to the figure
As being pre-processed, the pretreatment is following at least one：To described image sampling, compression, extract feature：
Correspondingly, described image is sent to cloud server, is specially to send pretreated image to high in the clouds to take
Business device；
If the video flowing that the WEB modules capture camera is shot, methods described is also wrapped：The WEB modules are regarded to described
Frequency stream is pre-processed, and the pretreatment is following at least one：To video flowing sampling, compression：
Correspondingly, described image is sent to cloud server, is specially by pretreated video stream to high in the clouds
Server.
The terminal that the present embodiment is provided, available for the corresponding program of method for performing above method embodiment, this implementation is not
Repeat again.
The terminal that the present embodiment is provided, at least with following technique effect：
The WEB modules collection image is realized during by the computing device described program, and the image of collection is sent out
Cloud server is delivered to, the coordinate information obtaining step of virtual object is carried out by cloud server so that one is downloaded without another
APP, makes full use of the existing APP of terminal to be interacted with cloud server, you can to realize augmented reality, thus can reduce realization
The cost of augmented reality.
On a kind of computer-readable recording medium that further embodiment of this invention is provided, the computer-readable recording medium
Be stored with computer program, and following steps are realized when described program is executed by processor：
After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and catch
Obtain the image of camera shooting；
The WEB modules send described image to cloud server, so that cloud server is according to described image, obtain
The coordinate information of the virtual object of correspondence described image, the coordinate information is used to represent shape of the virtual object in described image
Multiple coordinates of state；
The WEB modules receive the coordinate information, and according to the coordinate information, the form to the virtual object carries out wash with watercolours
Dye, obtains the first augmented reality information, the first augmented reality information is to be superimposed to obtain with the virtual object by described image
's.
In another embodiment, following steps are realized when described program is executed by processor：
The WEB modules call camera to be shot, and capture the video flowing of camera shooting, and the video flowing includes
Multiple orderly images,
Correspondingly, the WEB modules send described image to cloud server, are specially：
The WEB modules are by the video stream to cloud server, so that cloud server is according to described first
Image, obtains the coordinate information of the virtual object of correspondence first image, and the coordinate information is used to represent the virtual object
Multiple coordinates of form in first image；
Correspondingly, after the WEB modules receive the coordinate information, methods described also includes：
The WEB modules receive the angular transformation matrix that cloud server is sent, and the angular transformation matrix is used to indicate
The angular transformation of form of the virtual object in described image, the angular transformation matrix is that cloud server tracking is described true
The change of coordinate information in kind in continuous two images is come what is determined, and the virtual object is that cloud server judges to know institute
State in image have with the true thing that true thing is matched in default true thing database, then acquired according to the true thing
's；
The WEB modules are according to the angular transformation matrix, and the form to the virtual object is rendered, and obtains the second increasing
Strong reality information, the second augmented reality information is superimposed with the virtual object by the true thing and obtained.
In another embodiment, following steps are realized when described program is executed by processor：
If the image that the WEB modules capture camera is shot, methods described also includes：The WEB modules are to the figure
As being pre-processed, the pretreatment is following at least one：To described image sampling, compression, extract feature：
Correspondingly, the WEB modules send described image to cloud server, are specially to send out pretreated image
Deliver to cloud server；
If the video flowing that the WEB modules capture camera is shot, methods described is also wrapped：The WEB modules are regarded to described
Frequency stream is pre-processed, and the pretreatment is following at least one：To video flowing sampling, compression：
Correspondingly, the WEB modules send described image to cloud server, are specially by pretreated video flowing
Send to cloud server.
The computer-readable recording medium that the present embodiment is provided, realizes that the above method is real when described program is executed by processor
The method for applying example, this implementation is repeated no more.
The computer-readable recording medium that the present embodiment is provided, at least with following technique effect：
Image is gathered when being executed by processor by described program, and the image of collection is sent to cloud server, by
Cloud server carries out the coordinate information obtaining step of virtual object so that without separately downloading an APP, make full use of terminal to have
APP interacted with cloud server, you can realize augmented reality, thus can reduce the cost for realizing augmented reality.
Fig. 9 shows a kind of structural representation for cloud server that further embodiment of this invention is provided.
Refering to Fig. 9, a kind of cloud server that another embodiment is provided is invented, the cloud server includes memory
91st, processor 92 and it is stored in the computer program that can be run on memory 91 and on a processor.
Following steps are realized during the computing device described program：
The image that the WEB modules of receiving terminal are sent, described image is that the WEB modules are receiving the increasing of user's triggering
After strong reality request, WEB modules call camera to be shot, and capture the image of camera shooting；
According to described image, the coordinate information of the virtual object of correspondence described image is obtained, the coordinate information is used to represent
Multiple coordinates of form of the virtual object in described image；
The coordinate information is sent to the WEB modules, so that the WEB modules are according to the coordinate information, to institute
The form for stating virtual object is rendered, and obtains the first augmented reality information, the first augmented reality information is by described image
It is superimposed what is obtained with the virtual object.
In another embodiment, following steps are realized during the computing device described program：
The image that the WEB modules of receiving terminal are sent, be specially：
The video flowing that the WEB modules of receiving terminal are sent, the video flowing is that the WEB is receiving the increasing of user's triggering
After strong reality request, WEB modules call camera to be shot, and capture the video of camera shooting, and the video flowing includes
Multiple orderly images；
Correspondingly, according to first image, the coordinate information of the virtual object of correspondence first image, institute are obtained
State multiple coordinates that coordinate information is used to represent form of the virtual object in first image；
Correspondingly, described to send the coordinate information to the WEB modules, methods described also includes：
Judgement, which is known in described image, to be had and the true thing that true thing is matched in default true thing database, then basis
The true thing obtains corresponding virtual object, tracks the change of coordinate information of the true thing in continuous two image, comes true
Determine angular transformation matrix, the angular transformation matrix is used to indicate that the angle of form of the virtual object in described image to become
Change；
The angular transformation matrix is sent to the WEB modules, so that the WEB modules are according to the angular transformation square
Battle array, the form to the virtual object is rendered, and obtains the second augmented reality information, the second augmented reality information is by institute
State and true be superimposed what is obtained with the virtual object.
Further, in another embodiment, following steps are realized during the computing device described program：
If judgement know in described image not with the true thing that true thing is matched in default true thing database, obtain
Take corresponding feedback information；
Correspondingly, feedback information is returned to the WEB modules, to point out the WEB modules recapture camera to shoot
Image.
The cloud server that the present embodiment is provided, available for the corresponding program of method for performing above method embodiment, sheet
Implementation is repeated no more.
The cloud server that the present embodiment is provided, at least with following technique effect：
The image that WEB modules are gathered is received by performing, the program of the coordinate information obtaining step of virtual object is carried out so that
Without separately downloading an APP, the existing WEB modules of terminal are made full use of to be interacted with cloud server, you can to realize terminal
Augmented reality effect, thus can reduce the cost for realizing augmented reality.
Finally it should be noted that：Above example is only limited to the technical scheme for illustrating the embodiment of the present invention, rather than to it
System；Although the embodiment of the present invention is described in detail with reference to the foregoing embodiments, one of ordinary skill in the art should
Understand：It can still modify to the technical scheme described in foregoing embodiments, or to which part technical characteristic
Carry out equivalent substitution；And these modifications or replacement, the essence of appropriate technical solution is departed from each reality of the embodiment of the present invention
Apply the spirit and scope of a technical scheme.
Claims (10)
1. a kind of augmented reality processing method, it is characterised in that including：
After the augmented reality request of user's triggering is received, the WEB modules of terminal call camera to be shot, and capture is taken the photograph
The image shot as head；
The WEB modules send described image to cloud server, so that cloud server is according to described image, obtain correspondence
The coordinate information of the virtual object of described image, the coordinate information is used to represent form of the virtual object in described image
Multiple coordinates；
The WEB modules receive the coordinate information, and according to the coordinate information, the form to the virtual object is rendered,
The first augmented reality information is obtained, the first augmented reality information is superimposed by described image with the virtual object to be obtained.
2. according to the method described in claim 1, it is characterised in that：The WEB modules call camera to be shot, and capture
The video flowing that camera is shot, the video flowing includes multiple orderly images,
Correspondingly, the WEB modules send described image to cloud server, are specially：
The WEB modules are by the video stream to cloud server, so that cloud server is according to first image,
The coordinate information of the virtual object of correspondence first image is obtained, the coordinate information is used to represent the virtual object described
Multiple coordinates of form in first image；
Correspondingly, after the WEB modules receive the coordinate information, methods described also includes：
The WEB modules receive the angular transformation matrix that cloud server is sent, and the angular transformation matrix is described for indicating
The angular transformation of form of the virtual object in described image, the angular transformation matrix is that cloud server tracks the true thing
The change of coordinate information in continuous two images is come what is determined, and the virtual object is that cloud server judges to know the figure
As in have with the true thing that true thing is matched in default true thing database, then acquired according to the true thing；
The WEB modules are according to the angular transformation matrix, and the form to the virtual object is rendered, and obtain the second enhancing and show
Real information, the second augmented reality information is superimposed with the virtual object by the true thing and obtained.
3. method according to claim 1 or 2, it is characterised in that：If the figure that the WEB modules capture camera is shot
Picture, methods described also includes：The WEB modules are pre-processed to described image, and the pretreatment is following at least one：It is right
Described image sampling, compression, extraction feature：
Correspondingly, the WEB modules send described image to cloud server, be specially by pretreated image send to
Cloud server；
If the video flowing that the WEB modules capture camera is shot, methods described is also wrapped：The WEB modules are to the video flowing
Pre-processed, the pretreatment is following at least one：To video flowing sampling, compression：
Correspondingly, the WEB modules send described image to cloud server, are specially by pretreated video stream
To cloud server.
4. a kind of augmented reality processing method, it is characterised in that including：
The image that the WEB modules of cloud server receiving terminal are sent, described image, which is the WEB modules, to be touched receiving user
After the augmented reality request of hair, WEB modules call camera to be shot, and capture the image of camera shooting；
According to described image, the coordinate information of the virtual object of correspondence described image is obtained, the coordinate information is used to represent described
Multiple coordinates of form of the virtual object in described image；
The coordinate information is sent to the WEB modules, so that the WEB modules are according to the coordinate information, to the void
The form for intending thing is rendered, and obtains the first augmented reality information, the first augmented reality information is by described image and institute
State what virtual object superposition was obtained.
5. method according to claim 4, it is characterised in that：The WEB modules of the cloud server receiving terminal are sent
Image, be specially：
The video flowing that the WEB modules of cloud server receiving terminal are sent, the video flowing, which is the WEB, to be touched receiving user
After the augmented reality request of hair, WEB modules call camera to be shot, and capture the video of camera shooting, the video
Stream includes multiple orderly images；
Correspondingly, cloud server obtains the coordinate of the virtual object of correspondence first image according to first image
Information, the coordinate information is used for the multiple coordinates for representing form of the virtual object in first image；
Correspondingly, described to send the coordinate information to the WEB modules, methods described also includes：
Cloud server judge know in described image have with the true thing that true thing is matched in default true thing database,
Corresponding virtual object is then obtained according to the true thing, the change of coordinate information of the true thing in continuous two image is tracked
Change, to determine angular transformation matrix, the angular transformation matrix is used to indicate form of the virtual object in described image
Angular transformation；
Cloud server sends the angular transformation matrix to the WEB modules, so that the WEB modules are according to the angle
Transformation matrix, the form to the virtual object is rendered, and obtains the second augmented reality information, the second augmented reality information
Obtained by described be truly superimposed with the virtual object.
6. method according to claim 5, it is characterised in that：If judgement know in described image with it is default truly
The true thing of true thing matching in thing database, then the cloud server obtain corresponding feedback information；
Correspondingly, the cloud server returns to feedback information to the WEB modules, to point out the WEB modules recapture
The image that camera is shot.
7. a kind of WEB modules, including memory, processor and storage are on a memory and the calculating that can run on a processor
Machine program, it is characterised in that the method such as claim 1-3 any one is realized during the computing device described program.
8. a kind of terminal, it is characterised in that the terminal includes WEB modules as claimed in claim 7.
9. a kind of computer-readable recording medium, is stored thereon with computer program, it is characterised in that：Described program is by processor
The method such as claim 1-3 any one is realized during execution.
10. a kind of cloud server, including memory, processor and storage can be run on a memory and on a processor
Computer program, it is characterised in that the side such as claim 4-6 any one is realized during the computing device described program
Method.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710364711.0A CN107222529B (en) | 2017-05-22 | 2017-05-22 | Augmented reality processing method, WEB module, terminal and cloud server |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710364711.0A CN107222529B (en) | 2017-05-22 | 2017-05-22 | Augmented reality processing method, WEB module, terminal and cloud server |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107222529A true CN107222529A (en) | 2017-09-29 |
| CN107222529B CN107222529B (en) | 2022-04-26 |
Family
ID=59945054
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710364711.0A Active CN107222529B (en) | 2017-05-22 | 2017-05-22 | Augmented reality processing method, WEB module, terminal and cloud server |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107222529B (en) |
Cited By (28)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107509014A (en) * | 2017-09-12 | 2017-12-22 | 陈政益 | A kind of novel interactive application process based on AR interaction techniques |
| CN108037863A (en) * | 2017-12-12 | 2018-05-15 | 北京小米移动软件有限公司 | A kind of method and apparatus for showing image |
| CN108200415A (en) * | 2018-03-16 | 2018-06-22 | 广州成至智能机器科技有限公司 | Unmanned plane image frame processing system and its method based on augmented reality |
| CN108255487A (en) * | 2017-12-29 | 2018-07-06 | 北京邮电大学 | A kind of Web browser system and its method of work for supporting augmented reality function |
| CN108492352A (en) * | 2018-03-22 | 2018-09-04 | 腾讯科技（深圳）有限公司 | Implementation method, device, system, computer equipment and the storage medium of augmented reality |
| CN108597028A (en) * | 2018-04-11 | 2018-09-28 | 北京邮电大学 | A kind of method, apparatus and equipment of continuous load Web AR objects |
| CN108648236A (en) * | 2018-05-11 | 2018-10-12 | 武汉电力职业技术学院 | A kind of indirect method and control system for measurement of coordinates |
| CN108932632A (en) * | 2018-06-01 | 2018-12-04 | 北京市商汤科技开发有限公司 | Advertisement interactive approach and device, electronic equipment and storage medium |
| CN109360275A (en) * | 2018-09-30 | 2019-02-19 | 北京观动科技有限公司 | A kind of methods of exhibiting of article, mobile terminal and storage medium |
| CN109547953A (en) * | 2018-12-06 | 2019-03-29 | 北京邮电大学 | For the WebXR service enhancement method and device of short message |
| CN109636464A (en) * | 2018-12-11 | 2019-04-16 | 深圳市房多多网络科技有限公司 | Intelligence based on AR technology looks for room method and system |
| CN109658514A (en) * | 2017-10-11 | 2019-04-19 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and computer storage medium |
| CN109669539A (en) * | 2018-12-06 | 2019-04-23 | 国网江苏省电力有限公司无锡供电分公司 | A kind of wearable field operation man-machine interaction method of electric power, apparatus and system |
| CN110232338A (en) * | 2019-05-29 | 2019-09-13 | 北京邮电大学 | Lightweight Web AR recognition methods and system based on binary neural network |
| CN110471593A (en) * | 2019-07-31 | 2019-11-19 | 成都摹客科技有限公司 | The method, apparatus, system and storage medium of figure are cut based on web terminal compression |
| CN110553714A (en) * | 2019-08-31 | 2019-12-10 | 深圳市广宁股份有限公司 | Intelligent vibration augmented reality testing method and related product |
| CN111028359A (en) * | 2019-05-22 | 2020-04-17 | 珠海随变科技有限公司 | Augmented reality service configuration and request method, device, equipment and medium |
| CN111193841A (en) * | 2018-11-14 | 2020-05-22 | 深圳晨芯时代科技有限公司 | Augmented reality system |
| CN111416742A (en) * | 2020-03-19 | 2020-07-14 | 福建工程学院 | Quality evaluation method of shared equipment based on augmented reality simulation perspective |
| CN111443814A (en) * | 2020-04-09 | 2020-07-24 | 深圳市瑞云科技有限公司 | AR glasses system and method based on cloud rendering |
| CN111640179A (en) * | 2020-06-26 | 2020-09-08 | 百度在线网络技术（北京）有限公司 | Display method, device and equipment of pet model and storage medium |
| CN111986333A (en) * | 2020-09-01 | 2020-11-24 | Oppo广东移动通信有限公司 | Image generation method and device based on augmented reality, terminal and storage medium |
| CN112102479A (en) * | 2020-09-18 | 2020-12-18 | 贝壳技术有限公司 | Augmented reality method and device based on model alignment, storage medium and electronic equipment |
| CN112634773A (en) * | 2020-12-25 | 2021-04-09 | 北京市商汤科技开发有限公司 | Augmented reality presentation method and device, display equipment and storage medium |
| CN113055309A (en) * | 2019-12-28 | 2021-06-29 | 中移(成都)信息通信科技有限公司 | Resource loading method, device, equipment and medium |
| CN113486205A (en) * | 2021-07-06 | 2021-10-08 | 北京林业大学 | Plant science popularization information system based on augmented virtual reality technology |
| CN114025133A (en) * | 2021-11-02 | 2022-02-08 | 深圳艾灵网络有限公司 | Augmented reality projection method and system |
| US11263445B2 (en) | 2018-07-04 | 2022-03-01 | Baidu Online Network Technology (Beijing) Co., Ltd. | Method, apparatus and system for human body tracking processing |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102194007A (en) * | 2011-05-31 | 2011-09-21 | 中国电信股份有限公司 | System and method for acquiring mobile augmented reality information |
| US20120019526A1 (en) * | 2010-07-23 | 2012-01-26 | Samsung Electronics Co., Ltd. | Method and apparatus for producing and reproducing augmented reality contents in mobile terminal |
| CN102843349A (en) * | 2011-06-24 | 2012-12-26 | 中兴通讯股份有限公司 | Method, system, terminal and service for implementing mobile augmented reality service |
-
2017
- 2017-05-22 CN CN201710364711.0A patent/CN107222529B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20120019526A1 (en) * | 2010-07-23 | 2012-01-26 | Samsung Electronics Co., Ltd. | Method and apparatus for producing and reproducing augmented reality contents in mobile terminal |
| CN102194007A (en) * | 2011-05-31 | 2011-09-21 | 中国电信股份有限公司 | System and method for acquiring mobile augmented reality information |
| CN102843349A (en) * | 2011-06-24 | 2012-12-26 | 中兴通讯股份有限公司 | Method, system, terminal and service for implementing mobile augmented reality service |
Cited By (41)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107509014A (en) * | 2017-09-12 | 2017-12-22 | 陈政益 | A kind of novel interactive application process based on AR interaction techniques |
| CN109658514B (en) * | 2017-10-11 | 2022-03-11 | 腾讯科技（深圳）有限公司 | Data processing method and device and computer storage medium |
| CN109658514A (en) * | 2017-10-11 | 2019-04-19 | 腾讯科技（深圳）有限公司 | A kind of data processing method, device and computer storage medium |
| CN108037863A (en) * | 2017-12-12 | 2018-05-15 | 北京小米移动软件有限公司 | A kind of method and apparatus for showing image |
| CN108037863B (en) * | 2017-12-12 | 2021-03-30 | 北京小米移动软件有限公司 | Method and device for displaying image |
| CN108255487B (en) * | 2017-12-29 | 2024-01-23 | 北京邮电大学 | Web browser system supporting augmented reality function and working method thereof |
| CN108255487A (en) * | 2017-12-29 | 2018-07-06 | 北京邮电大学 | A kind of Web browser system and its method of work for supporting augmented reality function |
| CN108200415A (en) * | 2018-03-16 | 2018-06-22 | 广州成至智能机器科技有限公司 | Unmanned plane image frame processing system and its method based on augmented reality |
| CN108492352A (en) * | 2018-03-22 | 2018-09-04 | 腾讯科技（深圳）有限公司 | Implementation method, device, system, computer equipment and the storage medium of augmented reality |
| CN108492352B (en) * | 2018-03-22 | 2021-10-22 | 腾讯科技（深圳）有限公司 | Augmented reality implementation method, device, system, computer equipment and storage medium |
| CN108597028A (en) * | 2018-04-11 | 2018-09-28 | 北京邮电大学 | A kind of method, apparatus and equipment of continuous load Web AR objects |
| CN108648236A (en) * | 2018-05-11 | 2018-10-12 | 武汉电力职业技术学院 | A kind of indirect method and control system for measurement of coordinates |
| CN108932632A (en) * | 2018-06-01 | 2018-12-04 | 北京市商汤科技开发有限公司 | Advertisement interactive approach and device, electronic equipment and storage medium |
| US11263445B2 (en) | 2018-07-04 | 2022-03-01 | Baidu Online Network Technology (Beijing) Co., Ltd. | Method, apparatus and system for human body tracking processing |
| CN109360275A (en) * | 2018-09-30 | 2019-02-19 | 北京观动科技有限公司 | A kind of methods of exhibiting of article, mobile terminal and storage medium |
| CN109360275B (en) * | 2018-09-30 | 2023-06-20 | 北京观动科技有限公司 | Article display method, mobile terminal and storage medium |
| CN111193841A (en) * | 2018-11-14 | 2020-05-22 | 深圳晨芯时代科技有限公司 | Augmented reality system |
| CN109669539A (en) * | 2018-12-06 | 2019-04-23 | 国网江苏省电力有限公司无锡供电分公司 | A kind of wearable field operation man-machine interaction method of electric power, apparatus and system |
| CN109669539B (en) * | 2018-12-06 | 2022-02-08 | 国网江苏省电力有限公司无锡供电分公司 | Electric wearable field operation man-machine interaction method, device and system |
| CN109547953A (en) * | 2018-12-06 | 2019-03-29 | 北京邮电大学 | For the WebXR service enhancement method and device of short message |
| CN109636464A (en) * | 2018-12-11 | 2019-04-16 | 深圳市房多多网络科技有限公司 | Intelligence based on AR technology looks for room method and system |
| CN111028359A (en) * | 2019-05-22 | 2020-04-17 | 珠海随变科技有限公司 | Augmented reality service configuration and request method, device, equipment and medium |
| CN110232338A (en) * | 2019-05-29 | 2019-09-13 | 北京邮电大学 | Lightweight Web AR recognition methods and system based on binary neural network |
| CN110232338B (en) * | 2019-05-29 | 2021-02-05 | 北京邮电大学 | Lightweight Web AR (augmented reality) identification method and system based on binary neural network |
| CN110471593A (en) * | 2019-07-31 | 2019-11-19 | 成都摹客科技有限公司 | The method, apparatus, system and storage medium of figure are cut based on web terminal compression |
| CN110553714A (en) * | 2019-08-31 | 2019-12-10 | 深圳市广宁股份有限公司 | Intelligent vibration augmented reality testing method and related product |
| CN113055309A (en) * | 2019-12-28 | 2021-06-29 | 中移(成都)信息通信科技有限公司 | Resource loading method, device, equipment and medium |
| CN111416742A (en) * | 2020-03-19 | 2020-07-14 | 福建工程学院 | Quality evaluation method of shared equipment based on augmented reality simulation perspective |
| CN111443814B (en) * | 2020-04-09 | 2023-05-05 | 深圳市瑞云科技有限公司 | AR (augmented reality) glasses system based on cloud rendering |
| CN111443814A (en) * | 2020-04-09 | 2020-07-24 | 深圳市瑞云科技有限公司 | AR glasses system and method based on cloud rendering |
| CN111640179A (en) * | 2020-06-26 | 2020-09-08 | 百度在线网络技术（北京）有限公司 | Display method, device and equipment of pet model and storage medium |
| CN111640179B (en) * | 2020-06-26 | 2023-09-01 | 百度在线网络技术（北京）有限公司 | Display method, device, equipment and storage medium of pet model |
| CN111986333A (en) * | 2020-09-01 | 2020-11-24 | Oppo广东移动通信有限公司 | Image generation method and device based on augmented reality, terminal and storage medium |
| CN111986333B (en) * | 2020-09-01 | 2024-05-03 | Oppo广东移动通信有限公司 | Image generation method, device, terminal and storage medium based on augmented reality |
| CN112102479B (en) * | 2020-09-18 | 2021-09-28 | 贝壳找房(北京)科技有限公司 | Augmented reality method and device based on model alignment, storage medium and electronic equipment |
| CN112102479A (en) * | 2020-09-18 | 2020-12-18 | 贝壳技术有限公司 | Augmented reality method and device based on model alignment, storage medium and electronic equipment |
| CN112634773A (en) * | 2020-12-25 | 2021-04-09 | 北京市商汤科技开发有限公司 | Augmented reality presentation method and device, display equipment and storage medium |
| CN112634773B (en) * | 2020-12-25 | 2022-11-22 | 北京市商汤科技开发有限公司 | Augmented reality presentation method and device, display equipment and storage medium |
| CN113486205A (en) * | 2021-07-06 | 2021-10-08 | 北京林业大学 | Plant science popularization information system based on augmented virtual reality technology |
| CN113486205B (en) * | 2021-07-06 | 2023-07-25 | 北京林业大学 | Plant science popularization information system based on augmented virtual reality technology |
| CN114025133A (en) * | 2021-11-02 | 2022-02-08 | 深圳艾灵网络有限公司 | Augmented reality projection method and system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107222529B (en) | 2022-04-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107222529A (en) | Augmented reality processing method, WEB modules, terminal and cloud server | |
| CN107222468A (en) | Augmented reality processing method, terminal, cloud server and edge server | |
| JP6644833B2 (en) | System and method for rendering augmented reality content with albedo model | |
| CN107820593B (en) | Virtual reality interaction method, device and system | |
| CN108875633B (en) | Expression detection and expression driving method, device and system and storage medium | |
| US20180181802A1 (en) | Recognizing combinations of body shape, pose, and clothing in three-dimensional input images | |
| US8644551B2 (en) | Systems and methods for tracking natural planar shapes for augmented reality applications | |
| CN110716645A (en) | Augmented reality data presentation method and device, electronic equipment and storage medium | |
| US20140210857A1 (en) | Realization method and device for two-dimensional code augmented reality | |
| CN108288306A (en) | The display methods and device of virtual objects | |
| CN107204031A (en) | Information displaying method and device | |
| WO2014123954A2 (en) | Information processing method and system | |
| CN108416902A (en) | Real-time object identification method based on difference identification and device | |
| US20220066569A1 (en) | Object interaction method and system, and computer-readable medium | |
| WO2014114118A1 (en) | Realization method and device for two-dimensional code augmented reality | |
| CN106797458A (en) | The virtual change of real object | |
| CN106384388B (en) | The real-time try-in method of internet glasses and system based on HTML5 and augmented reality | |
| CN113220251B (en) | Object display method, device, electronic equipment and storage medium | |
| US20210382605A1 (en) | Systems and methods for augmented or mixed reality writing | |
| CN110598139A (en) | Web browser augmented reality real-time positioning method based on 5G cloud computing | |
| CN112308977A (en) | Video processing method, video processing apparatus, and storage medium | |
| JP7419003B2 (en) | Information display device, information display method, and information display system | |
| CN115482556A (en) | Method for key point detection model training and virtual character driving and corresponding device | |
| CN111192308B (en) | Image processing method and device, electronic equipment and computer storage medium | |
| CN106919260B (en) | Webpage operation method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230808 Address after: 100176 No. 1, Zhonghe street, Beijing Economic and Technological Development Zone, Daxing District, Beijing Patentee after: CHINA UNICOM ONLINE INFORMATION TECHNOLOGY Co.,Ltd. Address before: 100876 Beijing city Haidian District Xitucheng Road No. 10 Patentee before: Beijing University of Posts and Telecommunications |