CN108377398A - Based on infrared AR imaging methods, system and electronic equipment - Google Patents
Based on infrared AR imaging methods, system and electronic equipment Download PDFInfo
- Publication number
- CN108377398A CN108377398A CN201810364811.8A CN201810364811A CN108377398A CN 108377398 A CN108377398 A CN 108377398A CN 201810364811 A CN201810364811 A CN 201810364811A CN 108377398 A CN108377398 A CN 108377398A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- server
- facial image
- video
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 42
- 230000001815 facial effect Effects 0.000 claims abstract description 108
- 230000003190 augmentative effect Effects 0.000 claims abstract description 100
- 238000012545 processing Methods 0.000 claims abstract description 40
- 238000001514 detection method Methods 0.000 claims abstract description 14
- 230000006872 improvement Effects 0.000 claims abstract description 13
- 230000004044 response Effects 0.000 claims abstract description 10
- 238000000034 method Methods 0.000 claims description 28
- 230000015654 memory Effects 0.000 claims description 23
- 230000002708 enhancing effect Effects 0.000 claims description 6
- 238000005498 polishing Methods 0.000 claims description 6
- 238000004891 communication Methods 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 2
- 210000004209 hair Anatomy 0.000 claims description 2
- 229910001285 shape-memory alloy Inorganic materials 0.000 description 55
- 239000000758 substrate Substances 0.000 description 26
- 230000003287 optical effect Effects 0.000 description 24
- 230000008093 supporting effect Effects 0.000 description 20
- 238000003860 storage Methods 0.000 description 13
- 230000000694 effects Effects 0.000 description 11
- 230000006870 function Effects 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 7
- 230000003993 interaction Effects 0.000 description 6
- 229910000521 B alloy Inorganic materials 0.000 description 5
- 230000009471 action Effects 0.000 description 4
- 238000004590 computer program Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000005611 electricity Effects 0.000 description 4
- 210000001508 eye Anatomy 0.000 description 4
- 230000006641 stabilisation Effects 0.000 description 4
- 238000011105 stabilization Methods 0.000 description 4
- 238000005286 illumination Methods 0.000 description 3
- 238000007654 immersion Methods 0.000 description 3
- 230000008859 change Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 2
- 239000010931 gold Substances 0.000 description 2
- 229910052737 gold Inorganic materials 0.000 description 2
- 238000007373 indentation Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 238000004904 shortening Methods 0.000 description 2
- 230000001052 transient effect Effects 0.000 description 2
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 229910045601 alloy Inorganic materials 0.000 description 1
- 239000000956 alloy Substances 0.000 description 1
- 210000005252 bulbus oculi Anatomy 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000001816 cooling Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 210000004709 eyebrow Anatomy 0.000 description 1
- 230000002349 favourable effect Effects 0.000 description 1
- 210000001061 forehead Anatomy 0.000 description 1
- 210000003128 head Anatomy 0.000 description 1
- 238000010438 heat treatment Methods 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000002452 interceptive effect Effects 0.000 description 1
- 238000002386 leaching Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000003032 molecular docking Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 239000007779 soft material Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/172—Classification, e.g. identification
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/23418—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
The embodiment of the present invention provide it is a kind of based on infrared AR imaging methods, system and electronic equipment, including：The infrared signal that mobile terminal detection augmented reality equipment is sent out, and corresponding augmented reality device identification is determined according to the infrared signal；Augmented reality equipment acquires facial image, and the facial image is sent to the server；Operational order of the mobile terminal in response to user, the video frame images of currently playing video and the augmented reality device identification are sent to server, so that the server determines target facial image according to the augmented reality device identification from the facial image, augmented reality processing is carried out to the video frame images according to the target facial image, and the video frame images are sent to the corresponding targets improvement real world devices of the augmented reality device identification by treated.
Description
Technical field
The present invention relates to technical field of image processing more particularly to a kind of based on infrared AR imaging methods, system and electricity
Sub- equipment.
Background technology
AR (Augmented Reality, augmented reality) is a kind of improved technology based on virtual reality, can be incited somebody to action
Reality scene is superimposed in real time with virtual scene, provides more life-like scene to the user, further enhances the heavy of user
Leaching sense.
However, inventor has found in the implementation of the present invention, it is typically all to be referred to by video provider in the prior art
The interaction how user carries out augmented reality is led, when user encounters oneself interested video, if the video does not enhance
Real function, then user the interaction of augmented reality cannot be carried out with the video, reduce user experience, while it is existing to limit enhancing
Real technology development.
Invention content
It is provided in an embodiment of the present invention based on infrared AR imaging methods, system and electronic equipment, at least to solve phase
The above problem in the technology of pass.
The embodiment of the present invention on the one hand provide it is a kind of based on infrared AR imaging methods, including：
The infrared signal that mobile terminal detection augmented reality equipment is sent out, and corresponding increasing is determined according to the infrared signal
Strong real world devices mark；The mobile terminal in response to user operational order, by the video frame images of currently playing video and
The augmented reality device identification is sent to server, so that the server is by augmented reality treated the video frame figure
As being sent to the corresponding targets improvement real world devices of the augmented reality device identification；Wherein, the video passes through institute for user
State the video of mobile terminal shooting.
Further, the method further includes：Augmented reality equipment acquires facial image, and the facial image is sent
To the server；The server determines target face figure according to the augmented reality device identification from the facial image
Picture.
Further, the method further includes：The server obtains characteristic information, root from the target facial image
It is generated and the matched first 3D facial images of the target facial image according to the characteristic information；The server is to described first
3D facial images carry out polishing processing, obtain the 2nd 3D facial images；The server according to the first 3D facial images and
The 2nd 3D facial images carry out shadow processing to the target facial image.
Further, the method further includes：The mobile terminal is determined according to the infrared signal in the video
The first object location information is sent to the server by first object location information.
Further, the augmented reality processing specifically includes:The server according to the first object location information,
The target facial image is added in the video frame images.
Further, the augmented reality processing specifically includes：The server analyzes the video frame images,
Determine the second target position information；The server adds the target facial image according to second target position information
It adds in the video frame images.
Further,
It is described that the video is shot by the camera of mobile terminal based in infrared AR imaging methods,
The camera includes that camera lens, automatic Focus voice coil motor, imaging sensor and minisize memory alloy optics are anti-
Device is trembled, the camera lens is packed on the automatic Focus voice coil motor, the optics that described image sensor obtains the camera lens
Scene conversion is image data, and the automatic Focus voice coil motor is mounted on the minisize memory alloy optical anti-vibration device, is moved
The processor of dynamic terminal shakes minisize memory alloy optical anti-vibration device described in data-driven according to the camera lens that gyroscope detects
Action, realizes the jitter compensation of camera lens；
The minisize memory alloy optical anti-vibration device includes movable plate and substrate, and the automatic Focus voice coil motor is mounted on
On the movable plate, the size of the substrate is more than the movable plate, and the movable plate is installed on the substrate, the activity
Multiple movable supportings are equipped between plate and the substrate, there are four side walls for the surrounding tool of the substrate, each in the side wall
Portion is equipped with a notch, and the indentation, there is equipped with microswitch, and the movable part of the microswitch can be in the processor
The notch is opened or closed under instruction, and the movable part is equipped with close to the side of the movable plate along the movable part width side
To the electric contact of the bar shaped of laying, the substrate is equipped with the temperature control circuit that is connected with the electric contact, the processor according to
The camera lens jitter direction that gyroscope detects controls the opening and closing of the temperature control circuit, and the middle part of four sides of the movable plate is equal
Equipped with shape-memory alloy wire, described shape-memory alloy wire one end is fixedly connected with the movable plate, the other end and the electricity
Contact wipe coordinates, and elastic component is equipped between the madial wall of the surrounding of the substrate and the movable plate, when on the substrate
A temperature control circuit connection when, be connected with the circuit shape-memory alloy wire elongation, meanwhile, far from the shape memory close
The movable part of the microswitch of spun gold opens the notch, is shunk with the elastic component of the shape-memory alloy wire homonymy, separate to be somebody's turn to do
The elastic component of shape-memory alloy wire extends.
Further, the elastic component is spring.
Further, the mobile terminal is mountable on holder, and the holder includes mounting base, support shaft, three hinges
Supporting rack in the support shaft；
The mounting base includes orthogonal first mounting plate and the second mounting plate, and first mounting plate and second are pacified
Loading board is used equally for installing the mobile terminal, and the support shaft is vertically mounted on the bottom surface of first mounting plate, the branch
It supports bottom end of the axis far from the mounting base and is equipped with the periphery that radial dimension is more than the support shaft, three support frames as described above are by upper
It is mounted in the support shaft to lower, and the floor projection after the expansion of each two support frame as described above is in an angle, the support shaft
For telescoping rod comprising the tube body and part that are connected with the mounting base may contract to the body of rod in the tube body, described
The part that the body of rod stretches into the tube body includes hinged successively first segment, second segment, third section and the 4th section, the first segment with
The tube body is connected, and the first segment is equipped with mounting groove close to the end of the second segment, and lock is hinged in the mounting groove
Stop member, the second segment are equipped with the locking hole detachably coordinated with lock piece, the second segment close to the end of the first segment
It is equipped with mounting groove close to the end of the third section, is hinged with lock piece in the mounting groove, the third section is close to described the
Two sections of end is equipped with the locking hole detachably coordinated with lock piece, and the third section is equipped with peace close to the 4th section of the end
Tankage, is hinged with lock piece in the mounting groove, described 4th section be equipped with close to the end of the third section it is removable with lock piece
Unload the locking hole of cooperation.
Further, the bottom end of each support frame as described above is also associated with roll-setting gear, and the roll-setting gear includes being mounted on
The bearing race of support frame as described above bottom, the swivel becket being connected with the bearing race, tube body, screw rod, swivel nut and supporting rod, it is described
One end of tube body, which is equipped with, to be blocked, and the screw portion is mounted on by described block in the tube body, and described block is equipped with and institute
The compatible internal thread of screw rod is stated, described screw rod another part is connected with the swivel becket, and described swivel nut one end is mounted on institute
It states in tube body and is connect with the screw flight, the other end of the swivel nut is stretched out outside the tube body and fixed with the supporting rod
It connects, the inner wall of the swivel nut is equipped with a protrusion, and the lateral wall of the swivel nut is provided along its length mutually fits with the protrusion
The slideway matched, the tube body include adjacent first part and second part, and the internal diameter of the first part is less than described second
Partial internal diameter, the closure are arranged on the outer end of the second part, and the swivel nut is equipped with close to the end of the screw rod
Outer diameter is more than the positive stop end of first part's internal diameter.
The another aspect of the embodiment of the present invention provide it is a kind of based on infrared AR imaging systems, including：Mobile terminal, increasing
Strong real world devices and server；Wherein,
The mobile terminal includes detection module and the first sending module, and the detection module is set for detecting augmented reality
The infrared signal that preparation goes out, and corresponding augmented reality device identification is determined according to the infrared signal；Described first sends mould
Block is used for the operational order in response to user, and the video frame images of currently playing video and the augmented reality device identification are sent out
It send to the server；Wherein, the video is the video that user is shot by the mobile terminal；
The augmented reality equipment includes acquisition module, and the acquisition module is for acquiring facial image, and by the people
Face image is sent to the server；
The server includes the first determining module, processing module and the second sending module, and first determining module is used
In determining target facial image from the facial image according to the augmented reality device identification；The processing module is used for root
Augmented reality processing is carried out to the video frame images according to the target facial image；Second sending module will be for that will enhance
Treated that the video frame images are sent to the corresponding targets improvement real world devices of the augmented reality device identification for reality.
Further, the mobile terminal further includes the second determining module, and second determining module is used for according to
Infrared signal determines that the first object location information in the video, first sending module are additionally operable to the first object
Location information is sent to the server.
Further, the processing module is used to, according to the first object location information, the facial image be added
To in the video frame images.
Further, the camera of the mobile terminal include camera lens, automatic Focus voice coil motor, imaging sensor and
Minisize memory alloy optical anti-vibration device, the camera lens are packed on the automatic Focus voice coil motor, and described image sensor will
The optical scene that the camera lens obtains is converted to image data, and the automatic Focus voice coil motor is closed mounted on the minisize memory
On golden optical anti-vibration device, the processor of mobile terminal shakes minisize memory described in data-driven according to the camera lens that gyroscope detects
The action of alloy optical anti-vibration device, realizes the jitter compensation of camera lens；
The minisize memory alloy optical anti-vibration device includes movable plate and substrate, and the automatic Focus voice coil motor is mounted on
On the movable plate, the size of the substrate is more than the movable plate, and the movable plate is installed on the substrate, the activity
Multiple movable supportings are equipped between plate and the substrate, there are four side walls for the surrounding tool of the substrate, each in the side wall
Portion is equipped with a notch, and the indentation, there is equipped with microswitch, and the movable part of the microswitch can be in the processor
The notch is opened or closed under instruction, and the movable part is equipped with close to the side of the movable plate along the movable part width side
To the electric contact of the bar shaped of laying, the substrate is equipped with the temperature control circuit that is connected with the electric contact, the processor according to
The camera lens jitter direction that gyroscope detects controls the opening and closing of the temperature control circuit, and the middle part of four sides of the movable plate is equal
Equipped with shape-memory alloy wire, described shape-memory alloy wire one end is fixedly connected with the movable plate, the other end and the electricity
Contact wipe coordinates, and elastic component is equipped between the madial wall of the surrounding of the substrate and the movable plate, when on the substrate
A temperature control circuit connection when, be connected with the circuit shape-memory alloy wire elongation, meanwhile, far from the shape memory close
The movable part of the microswitch of spun gold opens the notch, is shunk with the elastic component of the shape-memory alloy wire homonymy, separate to be somebody's turn to do
The elastic component of shape-memory alloy wire extends.
Further, the elastic component is spring.
Further, the mobile terminal is mountable on holder, and the holder includes mounting base, support shaft, three hinges
Supporting rack in the support shaft；
The mounting base includes orthogonal first mounting plate and the second mounting plate, and first mounting plate and second are pacified
Loading board is used equally for installing the mobile terminal, and the support shaft is vertically mounted on the bottom surface of first mounting plate, the branch
It supports bottom end of the axis far from the mounting base and is equipped with the periphery that radial dimension is more than the support shaft, three support frames as described above are by upper
It is mounted in the support shaft to lower, and the floor projection after the expansion of each two support frame as described above is in an angle, the support shaft
For telescoping rod comprising the tube body and part that are connected with the mounting base may contract to the body of rod in the tube body, described
The part that the body of rod stretches into the tube body includes hinged successively first segment, second segment, third section and the 4th section, the first segment with
The tube body is connected, and the first segment is equipped with mounting groove close to the end of the second segment, and lock is hinged in the mounting groove
Stop member, the second segment are equipped with the locking hole detachably coordinated with lock piece, the second segment close to the end of the first segment
It is equipped with mounting groove close to the end of the third section, is hinged with lock piece in the mounting groove, the third section is close to described the
Two sections of end is equipped with the locking hole detachably coordinated with lock piece, and the third section is equipped with peace close to the 4th section of the end
Tankage, is hinged with lock piece in the mounting groove, described 4th section be equipped with close to the end of the third section it is removable with lock piece
Unload the locking hole of cooperation.
Further, the bottom end of each support frame as described above is also associated with roll-setting gear, and the roll-setting gear includes being mounted on
The bearing race of support frame as described above bottom, the swivel becket being connected with the bearing race, tube body, screw rod, swivel nut and supporting rod, it is described
One end of tube body, which is equipped with, to be blocked, and the screw portion is mounted on by described block in the tube body, and described block is equipped with and institute
The compatible internal thread of screw rod is stated, described screw rod another part is connected with the swivel becket, and described swivel nut one end is mounted on institute
It states in tube body and is connect with the screw flight, the other end of the swivel nut is stretched out outside the tube body and fixed with the supporting rod
It connects, the inner wall of the swivel nut is equipped with a protrusion, and the lateral wall of the swivel nut is provided along its length mutually fits with the protrusion
The slideway matched, the tube body include adjacent first part and second part, and the internal diameter of the first part is less than described second
Partial internal diameter, the closure are arranged on the outer end of the second part, and the swivel nut is equipped with close to the end of the screw rod
Outer diameter is more than the positive stop end of first part's internal diameter.
The another aspect of the embodiment of the present invention provides a kind of electronic equipment, including：At least one processor；And with institute
State the memory of at least one processor communication connection；Wherein,
The memory is stored with the instruction that can be executed by least one processor, and described instruction is by described at least one
A processor executes, so that at least one processor is able to carry out any of the above-described of the embodiment of the present invention based on infrared AR
Imaging method.
The another further aspect of the embodiment of the present invention provides a kind of server, including：At least one processor；And with it is described
The memory of at least one processor communication connection；Wherein,
The memory is stored with the instruction that can be executed by least one processor, and described instruction is by described at least one
A processor executes, so that at least one processor is able to carry out any of the above-described of the embodiment of the present invention based on infrared AR
Imaging method.
It is by above technical scheme as it can be seen that provided in an embodiment of the present invention based on infrared AR imaging methods, system and electronics
Equipment can determine augmented reality scene based on the wish of user itself, user is made to place oneself in the midst of in currently playing video, enhancing
The feeling of immersion and experience sense of user.
Description of the drawings
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below
There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments described in inventive embodiments can also obtain according to these attached drawings for those of ordinary skill in the art
Obtain other attached drawings.
Fig. 1 is provided by one embodiment of the present invention based on infrared AR imaging method flow charts；
Fig. 2 is provided by one embodiment of the present invention based on infrared AR imaging method flow charts；
Fig. 3 is the method flow diagram provided by one embodiment of the present invention that shadow processing is carried out to target facial image；
Fig. 4 is provided by one embodiment of the present invention based on infrared AR imaging system structure charts；
Fig. 5 is provided by one embodiment of the present invention based on infrared AR imaging system structure charts；
Fig. 6 is the hardware knot for executing the electronic equipment based on infrared AR imaging methods that the method for the present invention embodiment provides
Structure schematic diagram；
Fig. 7 is the structure chart of camera provided by one embodiment of the present invention；
Fig. 8 is the structure chart of minisize memory alloy optical anti-vibration device provided by one embodiment of the present invention；
Fig. 9 is a kind of working state structure of minisize memory alloy optical anti-vibration device provided by one embodiment of the present invention
Figure；
Figure 10 is rack assumption diagram provided by one embodiment of the present invention；
Figure 11 is axle assemble supporting figure provided by one embodiment of the present invention；
Figure 12 is roll-setting gear structure chart provided by one embodiment of the present invention.
Specific implementation mode
In order to make those skilled in the art more fully understand the technical solution in the embodiment of the present invention, below in conjunction with the present invention
Attached drawing in embodiment, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described reality
It is a part of the embodiment of the embodiment of the present invention to apply example only, instead of all the embodiments.Based on the implementation in the embodiment of the present invention
Example, the every other embodiment that those of ordinary skill in the art are obtained should all belong to the range of protection of the embodiment of the present invention.
Augmented reality equipment in the embodiment of the present invention may include the eyes and the helmet that can be worn by the user.The enhancing is existing
It is provided with man face image acquiring component in setting in fact, when the equipment body is worn by the user, the face image acquisition component direction
User face, and there are pre-determined distances with the user face, i.e., it is not direct to be contacted with the face of user.In the embodiment of the present invention
Mobile terminal includes but not limited to mobile phone, tablet computer etc..
Below in conjunction with the accompanying drawings, it elaborates to some embodiments of the present invention.In the absence of conflict, following
Feature in embodiment and embodiment can be combined with each other.
Fig. 1 is provided in an embodiment of the present invention based on infrared AR imaging method flow charts.As shown in Figure 1, the present invention is real
Apply example offer based on infrared AR imaging methods, including：
S101, the infrared signal that mobile terminal detection augmented reality equipment is sent out, and according to infrared signal determination pair
The augmented reality device identification answered.
Specifically, user advances with mobile terminal and has taken one or more videos, is set when user wears augmented reality
For when video, which can send out infrared signal, which can be unique described in mobile terminal playing
Identify the augmented reality equipment.After mobile terminal detects the infrared signal, it is corresponding that its can be obtained from the infrared signal
The mark of augmented reality equipment wishes to establish the targets improvement real world devices interacted with it so as to determine by the mark.
S103, the mobile terminal in response to user operational order, by the video frame images of currently playing video and institute
It states augmented reality device identification and is sent to server, so that the server is by augmented reality treated video frame images
It is sent to the corresponding targets improvement real world devices of the augmented reality device identification.
It specifically, can be to movement when user wants and currently playing video pictures carry out the interaction of augmented reality
Terminal sends out operational order, which can double-click the screen of mobile terminal, the screen of long-press mobile terminal or triggering
The predeterminated position etc. of mobile terminal, the present invention do not limit herein.
Optionally, before carrying out step S103, further include：Augmented reality equipment acquires facial image, and by the people
Face image is sent to the server.
Augmented reality equipment acquires the facial image of user by the man face image acquiring component of its setting, and will be described
Facial image is sent to server.It should be noted that augmented reality equipment may be to be acquired according to the instruction of user,
Can be that user acquires after wearing the augmented reality equipment in preset time, can also be in response to user to mobile terminal into
It is acquired when row operational order, the present invention does not limit herein.
It should be noted that since the equipment for wanting to carry out augmented reality may have this multiple, to be sent to server
The corresponding augmented reality device identification of the augmented reality equipment is carried in facial image, for determining which the facial image comes from
One augmented reality equipment.
In step s 103, server is true from the facial image according to the augmented reality device identification received
Set the goal facial image.Specifically, the augmented reality device identification that server is detected according to mobile terminal, to search storage
The facial image is determined as target by facial image when there is the facial image to match with the augmented reality device identification
Facial image.
Then, server carries out augmented reality processing according to the video frame images that target facial image docking receives,
By augmented reality treated the video frame images the are sent to corresponding targets improvement reality of the augmented reality device identification
Equipment.
Optionally, as described in Figure 3, before carrying out the enhancing processing, the method further includes to the target face
Image carries out shadow processing and specifically comprises the following steps to keep the face of face more three-dimensional：
S1031, server obtain characteristic information from the target facial image, according to characteristic information generation and institute
State the matched first 3D facial images of target facial image.
Specifically, characteristic information includes but not limited to the location information of key point, people in the face in target facial image
Face size and depth information.Target facial image can be inputted face characteristic information identification model, export target facial image
The crucial point coordinates of face.Coordinate system can be using the lower left corner of target face figure Xixiang as origin, and right direction is that X-axis is square
To upward direction is Y-axis positive direction, and coordinate value is measured with the number of pixel.It is carried out according to above-mentioned crucial point coordinates whole
Conjunction obtains facial size.Further, it is also possible to export the depth information of face by the model.
It is possible to further pre-loaded faceform's data file, standard 3D faceforms are established, and according to above-mentioned spy
Reference breath handles standard 3D faceforms, generates and the matched first 3D facial images of the target facial image.
Optionally, first, according to the size of target facial image in the characteristic information to the standard 3D faceforms
Whole scaling is carried out, the most upper vertex of forehead is made most to descend at a distance from vertex to be equal to step S1031 with chin perpendicular to two sides of Y-axis
The distance between boundary line, make the distance between two ears be equal to step S101 between two boundary lines of X-axis away from
From.Secondly, according to the coordinate position of each key point obtained in step S1031, eyebrow, eye in standard 3D faceforms are determined
Position and the profile of eyeball, nose, mouth and face, it is position and profile in target facial image to make their shaped position and its
It is consistent.Finally, it according to the coordinate position of above-mentioned each key point, is completed using the facial image identified in step S1031
Textures, and texture mapping is carried out to the model according to above-mentioned face information, it generates and matched first 3D of target facial image
Facial image.Optionally, the texture can be the three primary colors RGB of each pixel.
S1032, server carry out polishing processing to the first 3D facial images, obtain the 2nd 3D facial images.
In this step, illumination render parameter can be determined by analyzing the Lighting information in video frame images, so that
Target facial image, to matching, carries out at polishing the first 3D facial images in conjunction with illumination model with video frame images
Reason.Available light, which is stamped, on the first 3D facial images beats light and the moon on face to simulate real light
Shadow.Specific illumination model includes multiple types, and the present invention does not limit herein.
S1033, server is according to the first 3D facial images and the 2nd 3D facial images, to the target face
Image carries out shadow processing.
The 2nd 3D facial images of available light are accomplished fluently according to step S1032, bright place is beaten due to its light can highlight,
Light beat less than place can form shade, for the pixel of same coordinate position, in the 2nd 3D facial images and first
There can be texture difference in 3D facial images, by the difference, the corresponding position of the pixel described in facial image is reinforced or weakened
Its texture difference so that facial image will produce the polishing effect as the 2nd 3D facial images.It, can basis in this step
Texture difference in first 3D rendering and second 3D rendering carries out shadow processing to the facial image.
Through the above steps, it can make that collected facial image face are more three-dimensional, more have layer on the basis of highlighting light
Secondary sense improves the interaction interest of user.
Further, the infrared signal that mobile terminal is sent out in detection augmented reality equipment, and according to the infrared signal
After determining corresponding augmented reality device identification, the first object in the video can also be determined according to the infrared signal
Location information, the video frame images together with currently playing video and the augmented reality equipment by the first object location information
Mark, is sent to the server together.
Specifically, the infrared facility of augmented reality equipment may include one, be mounted on the center of the augmented reality equipment
Place；It can also include multiple, be evenly distributed in the augmented reality equipment surrounding, the infrared light meeting direct projection that infrared facility is sent out is arrived
On the screen of mobile terminal, mobile terminal can determine its coordinate position on the screen according to the incoming position of the infrared light.
It is alternatively possible to using the mobile terminal lower left corner as coordinate origin, origin is to the right the positive direction of X-axis along mobile terminal edge,
It is the positive direction of Y-axis upwards along mobile terminal edge, it is of course also possible to there is other methods for establishing coordinate system.
When hot exterior is set to one, since it is arranged at the center of augmented reality equipment, which namely uses
The focal position of family eyes illustrates that active user is desired with the focusing position of the target point of augmented reality interaction just in video
Setting (may make user want the personage of the focal position being substituted for oneself, it is also possible to which user wishes the face figure of oneself
As being added on the image of the position), therefore can be directly using infrared light coordinate position on the screen as first object
Location information.
When hot exterior is set to multiple, since it is evenly distributed on the surrounding of augmented reality equipment, multiple infrared facility
Mean place i.e. user's eyes focal position, illustrate active user be desired with augmented reality interaction target point just
The focal position in video, therefore can average to the coordinate position of multi beam infrared light on the screen, this is average
The coordinate position of value is first object location information.
After first object position is determined, the server is according to the first object location information, by target facial image
It is added on the first object position in the video frame images.Specifically, server can be to the first object location information
Corresponding image is analyzed, and when corresponding image is facial image, which can be substituted for target face figure
Picture；When the inhuman face image of corresponding image, the adjustment of angle can be carried out to the target facial image, allowed it to and be somebody's turn to do
Landscape etc. near image matches, then the inhuman face image is substituted for the target facial image after adjustment.Optionally, it replaces
Method can be that pixel is replaced, and can also be other methods customary in the art.
As the optional embodiment of the present embodiment, it can not also determine that target location is believed by the positioning of mobile terminal
Breath.At this point, augmented reality processing specifically includes：Server analyzes the video frame images, determines the second target location
Information；The target facial image is added in the video frame images by server according to second target position information.
In the present embodiment, mobile terminal can be by the analysis to video frame images, and determination is desired with interactive
Target object for example, some personage in video is replaced oneself, or oneself is arranged by some scenery etc., server
Position coordinates of the target object in the video are determined as the second target position information, and according to second target position
Confidence ceases, and the target facial image is added in the video frame images.Specific adding method is as described above, herein not
It repeats.
After carrying out augmented reality processing to video frame images by any of the above-described method, server handles augmented reality
The video frame images afterwards are sent to the corresponding targets improvement real world devices of the augmented reality device identification.Due to receiving
After the operational order of user, the processing that above-mentioned steps to carry out every frame video frame images augmented reality can be constantly read again, therefore
The user for wearing the targets improvement real world devices can see in the video for oneself appearing in broadcasting, complete the friendship of augmented reality
Mutually.
It is provided in an embodiment of the present invention based on infrared AR imaging methods, can be determined based on the wish of user itself is enhanced
Reality scene makes user place oneself in the midst of in currently playing video, enhances the feeling of immersion and experience sense of user.
Fig. 3 is provided in an embodiment of the present invention based on infrared AR imaging method flow charts.As shown in figure 3, the present embodiment
For the specific implementation of Fig. 1 and embodiment illustrated in fig. 2, therefore repeat no more the tool of each step in Fig. 1 and embodiment illustrated in fig. 2
Body implementation method and advantageous effect, it is provided in an embodiment of the present invention based on infrared AR imaging methods, it specifically includes：
S301, the infrared signal that mobile terminal detection augmented reality equipment is sent out, and according to infrared signal determination pair
The augmented reality device identification answered.
S302, augmented reality equipment acquires facial image, and the facial image is sent to the server.
S303, the mobile terminal in response to user operational order, by the video frame images of currently playing video and institute
It states augmented reality device identification and is sent to server.
S304, the server determine target face figure according to the augmented reality device identification from the facial image
Picture.
S305, the server carry out augmented reality processing according to the target facial image to the video frame images,
And treated that the video frame images are sent to the corresponding targets improvement of the augmented reality device identification shows by augmented reality
Real equipment.
It is provided in an embodiment of the present invention based on infrared AR imaging methods, can be determined based on the wish of user itself is enhanced
Reality scene makes user place oneself in the midst of in currently playing video, enhances the feeling of immersion and experience sense of user.
Fig. 4, Fig. 5 are provided in an embodiment of the present invention based on infrared AR imaging system structure charts.As shown in Figure 4, Figure 5,
The system specifically includes：Mobile terminal 10, augmented reality equipment 20 and server 30.Wherein,
Mobile terminal 10 includes detection module 110 and the first sending module 120, and detection module 110 is existing for detecting enhancing
The infrared signal that real equipment is sent out, and corresponding augmented reality device identification is determined according to the infrared signal；First sends mould
Block 120 is used for the operational order in response to user, by the video frame images of currently playing video and the augmented reality equipment mark
Knowledge is sent to the server；Wherein, the video is the video that user is shot by the mobile terminal；
Augmented reality equipment 20 includes acquisition module 210, and acquisition module 210 is for acquiring facial image, and by the people
Face image is sent to the server；
Server 30 includes the first determining module 310, processing module 320 and the second sending module 330, the first determining module
310 from the facial image according to the augmented reality device identification for determining target facial image；Second sending module
330 to the video frame images according to the target facial image for carrying out augmented reality processing；Second sending module
For by augmented reality, treated that the video frame images are sent to the corresponding targets improvement of the augmented reality device identification
Real world devices.
Further, mobile terminal 10 further includes the second determining module 130, and the second determining module 130 is used for according to
Infrared signal determines that the first object location information in the video, the first sending module 120 are additionally operable to the first object
Location information is sent to the server.
Further, processing module 320 is used to, according to the first object location information, the facial image be added to
In the video frame images.
Further, server 30 further includes analysis module, is not shown in figure, and the analysis module is used for the video
Frame image is analyzed, and determines the second target position information；Processing module 320 is according to second target position information, by institute
Target facial image is stated to be added in the video frame images.
Further, server further includes target image processing module, is not shown in figure, the target image processing module
For obtaining characteristic information from the target facial image, generated and the target facial image according to the characteristic information
The first 3D facial images matched；Polishing processing is carried out to the first 3D facial images, obtains the 2nd 3D facial images；According to institute
The first 3D facial images and the 2nd 3D facial images are stated, shadow processing is carried out to the target facial image.
It is provided in an embodiment of the present invention to be specifically used for executing Fig. 1 to embodiment illustrated in fig. 3 based on infrared AR imaging systems
The method of offer, realization principle, method and function and usage etc. are similar to embodiment illustrated in fig. 3 with Fig. 1, no longer superfluous herein
It states.
These above-mentioned embodiment of the present invention can be used as one of software or hard based on infrared AR imaging systems
Part functional unit is independently arranged in above-mentioned electronic equipment, can also be used as integration one of in the processor function mould
Block, execute the embodiment of the present invention based on infrared AR imaging methods.
Fig. 6 is the hardware knot for executing the electronic equipment based on infrared AR imaging methods that the method for the present invention embodiment provides
Structure schematic diagram.According to Fig.6, which includes：
One or more processors 610 and memory 620, in Fig. 6 by taking a processor 610 as an example.
Executing the equipment based on infrared AR imaging methods can also include：Input unit 630 and output device
630。
Processor 610, memory 620, input unit 630 and output device 640 can pass through bus or other modes
It connects, in Fig. 6 for being connected by bus.
Memory 620 is used as a kind of non-volatile computer readable storage medium storing program for executing, can be used for storing non-volatile software journey
Sequence, non-volatile computer executable program and module, based on the infrared imaging sides AR as described in the embodiment of the present invention
Corresponding program instruction/the module of method.Processor 610 is by running the non-volatile software program being stored in memory 620, referring to
Enable and module, the various function application to execute server and data processing, that is, realize it is described based on infrared AR at
Image space method.
Memory 620 may include storing program area and storage data field, wherein storing program area can store operation system
System, the required application program of at least one function；Storage data field can store provide according to embodiments of the present invention based on red
Outer AR imaging systems use created data etc..In addition, memory 620 may include high-speed random access memory
620, can also include nonvolatile memory 620, a for example, at least magnetic disk storage 620, flush memory device or other are non-
Volatile solid-state 620.In some embodiments, it includes remotely located relative to processor 66 that memory 620 is optional
Memory 620, these remote memories 620 can by network connection to described based on infrared AR imaging systems.It is above-mentioned
The example of network includes but not limited to internet, intranet, LAN, mobile radio communication and combinations thereof.
Input unit 630 can receive input number or character information, and generate with based on infrared AR imaging systems
User setting and function control related key signals input.Input unit 630 may include pressing the equipment such as module.
One or more of modules are stored in the memory 620, when by one or more of processors
When 610 execution, execute described based on infrared AR imaging methods.
The electronic equipment of the embodiment of the present invention exists in a variety of forms, including but not limited to:
(1) mobile communication equipment:The characteristics of this kind of equipment is that have mobile communication function, and to provide speech, data
Communication is main target.This Terminal Type includes:Smart mobile phone (such as iPhone), multimedia handset, functional mobile phone and low
Hold mobile phone etc..
(2) super mobile personal computer equipment:This kind of equipment belongs to the scope of personal computer, there is calculating and processing work(
Can, generally also have mobile Internet access characteristic.This Terminal Type includes:PDA, MID and UMPC equipment etc., such as iPad.
(3) portable entertainment device:This kind of equipment can show and play multimedia content.Such equipment includes:Audio,
Video player (such as iPod), handheld device, e-book and intelligent toy and portable car-mounted navigation equipment.
System embodiment described above is only schematical, wherein the module illustrated as separating component can
It is physically separated with being or may not be, the component shown as module may or may not be physics mould
Block, you can be located at a place, or may be distributed on multiple network modules.It can be selected according to the actual needs
In some or all of module achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness
Labour in the case of, you can to understand and implement.
Storage medium is deposited an embodiment of the present invention provides a kind of non-transient computer is readable, the computer storage media is deposited
Contain computer executable instructions, wherein when the computer executable instructions are executed by electronic equipment, the electronics is made to set
It is standby it is upper execute in above-mentioned any means embodiment based on infrared AR imaging methods.
An embodiment of the present invention provides a kind of computer program products, wherein the computer program product includes storage
Computer program in non-transient computer readable storage medium, the computer program include program instruction, wherein work as institute
When stating program instruction and being executed by electronic equipment, make the electronic equipment execute in above-mentioned any means embodiment based on infrared
AR imaging methods.
In another embodiment, in order to enhance AR imaging effects, specially the video effect of mobile terminal acquisition is carried
It rises, the present embodiment provides a kind of camera of the mobile terminal with more preferable anti-shudder performance thus, is obtained by the camera
Picture, video be more clear compared to common camera, can more meet the needs of users.Camera shooting especially in the present embodiment
It is better when the video that head obtains is used for the AR imaging methods in above-described embodiment.
Specifically, existing mobile terminal camera (mobile terminal is mobile phone or DV etc.) include camera lens 1, from
The prior art that dynamic Focus voice coil motor 2, imaging sensor 3 are known to the skilled person, therefore do not describe excessively here.
Generally use minisize memory alloy optical anti-vibration device is because existing stabilization device generates Lip river by hot-wire coil in magnetic field mostly
Human relations magnetic drive camera lens moves, and to realize optical anti-vibration, needs to drive camera lens at least two directions, it means that needs
It arranges multiple coils, integrally-built micromation can be given to bring certain challenge, and be easy to be interfered by external magnetic field, and then influence
Stabilization effect, some prior arts are realized the stretching and shortening of memory alloy wire by temperature change, automatic focusing are pulled with this
Voice coil motor moves, and realizes that the jitter compensation of camera lens, the control chip of minisize memory alloy optical anti-vibration actuator can control
The variation of drive signal changes the temperature of memory alloy wire, controls the elongation and shortening of memory alloy wire with this, and according to
The resistance of memory alloy wire calculates the position and movement distance of actuator.When minisize memory alloy optical anti-vibration actuator moves up
Memory alloy wire resistance at this time is fed back after moving to designated position, it, can be with by comparing the deviation of this resistance value and desired value
Correct the movement deviation on minisize memory alloy optical anti-vibration actuator.Applicant have discovered that due to shake randomness and
Uncertainty, the structure for relying solely on above-mentioned technical proposal are that cannot achieve can be to camera lens in the case where multiple shake occurs
It is precisely compensated for, this is because the heating and cooling of marmem are required to the regular hour, when shake is to first
When direction occurs, the compensation that camera lens shakes first direction may be implemented in above-mentioned technical proposal, but works as the thing followed second
When the shake in direction occurs, since memory alloy wire has little time, in short time set, to be easy to cause compensation not in time, Wu Fajing
Standard realizes which results in the picture qualities of acquisition not to repeatedly shaking and the camera lens jitter compensation of different directions continuously shaken
It is good, it is therefore desirable to being improved on camera or camera structure.
As shown in fig. 7, the camera of the present embodiment includes camera lens 1, automatic Focus voice coil motor 2, imaging sensor 3
And minisize memory alloy optical anti-vibration device 4, the camera lens 1 are packed on the automatic Focus voice coil motor 2, described image passes
The image transmitting that sensor 3 obtains the camera lens 1 to the identification module 100, the automatic Focus voice coil motor 2 is mounted on institute
It states on minisize memory alloy optical anti-vibration device 4, the mobile terminal internal processor is according to gyroscope inside mobile terminal (in figure
It is not shown) shake of the camera lens that detects drives the action of the minisize memory alloy optical anti-vibration device 4, realize that the shake of camera lens is mended
It repays；
In conjunction with shown in attached drawing 8, the improvements of the minisize memory alloy optical anti-vibration device are described below：
The minisize memory alloy optical anti-vibration device includes movable plate 5 and substrate 6, and movable plate 5 and substrate 6 are rectangular slab
Shape part, the automatic Focus voice coil motor 2 are mounted on the movable plate 5, and the size of the substrate 6 is more than the movable plate 5
Size, the movable plate 5 be mounted on the substrate 6 on, between the movable plate 5 and the substrate 6 be equipped with it is multiple activity prop up
Support 7, the movable supporting 7 is specially the ball being arranged at 6 four angles of the substrate in groove, convenient for movable plate 5 in substrate 6
On movement, the surrounding tool of the substrate 6 is equipped with a notch 8, the notch there are four side wall in the middle part of each side wall
Microswitch 9 is installed, the movable part 10 of the microswitch 9 can be opened or be sealed under the instruction of the processing module at 8
Close the notch, the movable part 10 is equipped with close to the side of the movable plate 5 to be laid along 10 width direction of the movable part
The electric contact 11 of bar shaped, the substrate 6 are equipped with the temperature control circuit (not shown) being connected with the electric contact 11, the place
Reason module can control the opening and closing of the temperature control circuit according to the camera lens jitter direction that gyroscope detects, the movable plate 5
Shape-memory alloy wire 12 is equipped in the middle part of four sides, 12 one end of the shape-memory alloy wire is solid with the movable plate 5
Fixed connection, the other end is slidably matched with the electric contact 11, between the madial wall of the surrounding of the substrate 6 and the movable plate 5
It is equipped with the elastic component 13 for reset, specifically, the elastic component of the present embodiment is preferably miniature spring.
The course of work of the minisize memory alloy optical anti-vibration device of the present embodiment is carried out with reference to above structure detailed
Description：By taking the camera lens opposite shake in direction twice as an example, when camera lens occurs to shake to first direction, gyroscope will detect
Camera lens jitter direction and distance feed back to the processor, processor, which calculates, to be needed to control the shape that can compensate the shake
The elongation of memory alloy wire, and corresponding temperature control circuit is driven to heat up the shape-memory alloy wire, the shape memory
B alloy wire extend and drive movable plate to can compensate for first direction shake direction move, at the same time with the marmem
The movable part that the symmetrical another shape-memory alloy wire of silk does not change, but is connected with another shape-memory alloy wire
Corresponding notch can be opened, is stretched out to outside notch under the drive of movable plate convenient for another shape-memory alloy wire,
At this point, the elastic component near two shape-memory alloy wires is stretched and is compressed (as shown in Figure 9) respectively, when minisize memory alloy light
Learn the resistance for being moved on stabilization actuator behind designated position and feeding back the shape-memory alloy wire, by comparing this resistance value with
The deviation of desired value can correct the movement deviation on minisize memory alloy optical anti-vibration actuator；And when second of shake hair
When raw, processor closes notch by the movable part abutted against with another shape and B alloy wire first, and opens and be in
The movable part that the shape-memory alloy wire of elongation state abuts against abuts against turning for movable part with another shape and B alloy wire
It is dynamic that another shape-memory alloy wire can be pushed to reset, the activity abutted against with the shape-memory alloy wire in elongation state
The opening of part can stretch out in order to the shape-memory alloy wire of elongation state, and in the elastic reaction of two above-mentioned elastic components
Under can ensure that movable plate resets rapidly, simultaneous processor, which calculates to need to control again, can compensate the shape of second of shake
The elongation of memory alloy wire, and corresponding temperature control circuit is driven to heat up another shape-memory alloy wire, another shape
Memory alloy wire extends and movable plate is driven to be moved to can compensate for the direction that second direction is shaken, due to the shape note formerly extended
Recall the notch at B alloy wire to open, therefore does not interfere with another shape and B alloy wire drive movable plate movement, and due to activity
The opening speed of part and the reset response of spring, therefore when repeatedly shake occurs, the minisize memory alloy optics of the present embodiment
Stabilization device can be made and accurately compensate, and effect is far superior to minisize memory alloy optical anti-vibration device in the prior art.
Certainly above-mentioned is only simple double pump, and when repeatedly shake occurs, or the direction of shake is not reciprocal
When movement, can by driving the elongation of two adjacent shape-memory alloy wires to compensate shake, element task process with it is upper
It is identical to state description principle, does not repeat excessively here, further with regards to the detection of the detection feedback, gyroscope of marmem resistance
Feedback etc. is the prior art, is not also repeated here.
In another embodiment, certain special occasions, which need mobile terminal being installed on the holder of the video camera, to be regarded
The acquisition of frequency or image, but applicant has found in use, the holder of existing video camera has following defect：1, existing
Some camera mounts are all made of tripod support, but tripod structure is in ground out-of-flatness that there are larger rough positions
The level of holder mounting base can not be ensured by setting when being installed, be easy to happen shake or inclination, be easy tod produce to shooting bad
Influence；2, existing holder can not be used as the anti-formula camera stand of shoulder, and structure and function is single, must when needing the anti-shooting of shoulder
The anti-formula camera stand of shoulder must be individually equipped with.
Therefore, applicant is improved supporting structure, and as shown in FIG. 10 and 11, the holder of the present embodiment includes peace
Fill the supporting rack 16 of 15, three seat 14, support shaft hinges in the support shaft；The mounting base 14 includes orthogonal the
One mounting plate 141 and the second mounting plate 142, first mounting plate, 141 and second mounting plate 142 are used equally for taking the photograph described in installation
Camera, the support shaft 15 are vertically mounted on the bottom surface of first mounting plate 141, and the support shaft 15 is far from the mounting base
14 bottom end is equipped with the periphery 17 that radial dimension is slightly larger than the support shaft, and three support frames as described above 16 are from top to bottom mounted on
In the support shaft 15, and the floor projection after the expansion of each two support frame as described above 16 is in an inclination angle, and above structure is being propped up
When the erection of frame, periphery 17 is assumed to a pocket more smooth in rough plane first, by opening simultaneously
The position of three telescopic supporting racks of adjustment realizes that the erection of holder is smooth, even therefore broken terrain also can be fast
Speed sets up holder smooth, adapts to various landform, ensures that mounting base is in horizontality.
More favorable, the support shaft 15 of the present embodiment is also telescoping rod comprising is connected with the mounting base 14
The tube body 151 and part that connect may contract to the body of rod 152 in the tube body 151, and the body of rod 152 stretches into the part of the tube body
Including first segment 1521 hinged successively, second segment 1522, third section 1523 and the 4th section 1524, the first segment 1521 and institute
It states tube body 151 to be connected, the first segment 1521 is equipped with mounting groove 18, the mounting groove close to the end of the second segment 1522
Lock piece 19 is hinged in 18, the second segment 1522 is equipped with detachable with lock piece 19 close to the end of the first segment 1521
The locking hole 20 of cooperation, similarly, the second segment 1522 are equipped with mounting groove 18, the peace close to the end of the third section 1523
Lock piece 19 is hinged in tankage 18, the third section 1523 is equipped with close to the end of the second segment 1522 can with lock piece 19
The locking hole 20 of cooperation is dismantled, the third section 1523 is equipped with mounting groove 18, the peace close to the 4th section 1524 of the end
It is hinged with lock piece 19 in tankage 18, described 4th section 1524 be equipped with close to the end of the third section 1523 can with lock piece 19
The locking hole 20 of cooperation is dismantled, the lock piece can be hidden in mounting groove, can be by turning when needing using lock piece
Dynamic lock piece, lock piece is fastened on the locking hole, specifically, the lock piece 19 can be that there are one the items of protrusion for tool
Shape part, the protrusion are adapted with the size dimension of the locking hole, and protrusion is pressed in locking hole complete two neighboring section of (example
Such as first segment and second segment) fixation of position, it prevents from relatively rotating, and passes through first segment 1521, second segment 1522, third section
1523 and the 4th section 1524 cooperation can by the part formed oneShape structure, and fixed respectively by lock piece 19
A section of relative position can also be equipped with soft material, when needing using holder as the anti-formula video camera of shoulder in the bottom of the structure
When holder, this is partially disposed in the shoulder of user, is used as the hand-held of the anti-formula holder of shoulder by holding one in three supporting racks
Portion can quickly realize the switching to the anti-formula holder of shoulder by fixed bracket, very convenient.
In addition, applicant further found that, telescopic supporting rack is stretched mostly flexible to realize by manpower pull-out telescopic section
The adjusting of length, but this apart from uncontrollable, randomness is larger, therefore usually occur adjusting inconvenient problem, especially need
It when collapsing length part is finely tuned, is often not easily accomplished, therefore applicant also optimizes 16 structures of supporting rack, ties
It closes shown in attached drawing 12, the bottom end of each support frame as described above 16 of the present embodiment is also associated with roll-setting gear 21, the roll-setting gear
21 include the bearing race 211 for being mounted on 16 bottom of support frame as described above, swivel becket 212, the tube body being connected with the bearing race 211
213, screw rod 214, swivel nut 215 and supporting rod 216, one end of the tube body 213, which is equipped with, blocks 217, and 215 part of the screw rod is logical
The closure 217 to be crossed to be mounted in the tube body 213, the closure 217 is equipped with internal thread compatible with the screw rod 214,
214 another part of the screw rod is connected with the swivel becket 212, and 215 one end of the swivel nut is mounted in the tube body 213 simultaneously
It is threadedly coupled with the screw rod 214, the other end of the swivel nut 215 stretches out outside the tube body 213 and consolidates with the supporting rod 216
The inner wall of fixed connection, the swivel nut 215 is equipped with a protrusion 218, and the lateral wall of the swivel nut 215 is provided along its length and institute
State the compatible slideway 219 of protrusion, the tube body 213 includes adjacent first part 2131 and second part 2132, and described the
The internal diameter of a part 2131 is less than the internal diameter of the second part 2132, described to block 217 settings in the second part 2132
Outer end on, the swivel nut 215 close to the end of the screw rod 214 be equipped with outer diameter be more than first part's internal diameter positive stop end
2151, the rotation in tube body 213 of screw rod 214 is driven by rotating the swivel becket 212, and rotation trend is passed into the spiral shell
Set 215, and since swivel nut is influenced by protrusion 218 and the cooperation of slideway 219, can not rotate, therefore rotatory force be turned to outside
Linear movement, and then supporting rod 216 is driven to move, realizes the length fine adjustment of supporting rack bottom end, convenient for the flat holder of user's frame and
Its mounting base provides good basic guarantee for subsequent shooting work.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of software plus required general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on
Stating technical solution, substantially the part that contributes to existing technology can be expressed in the form of software products in other words, should
Computer software product can store in a computer-readable storage medium, the computer readable recording medium storing program for performing include for
Any mechanism of the readable form storage of computer (such as computer) or transmission information.For example, machine readable media includes only
Read memory (ROM), random access memory (RAM), magnetic disk storage medium, optical storage media, flash medium, electricity, light,
The transmitting signal (for example, carrier wave, infrared signal, digital signal etc.) etc. of sound or other forms, which includes
Some instructions are used so that a computer equipment (can be personal computer, server or the network equipment etc.) executes respectively
Method described in certain parts of a embodiment or embodiment.
Finally it should be noted that：Above example is only to illustrate the technical solution of the embodiment of the present invention, rather than limits it
System；Although the present invention is described in detail referring to the foregoing embodiments, it will be understood by those of ordinary skill in the art that：Its
Still can be with technical scheme described in the above embodiments is modified, or which part technical characteristic is equal
It replaces；And these modifications or replacements, various embodiments of the present invention technical solution that it does not separate the essence of the corresponding technical solution
Spirit and scope.
Claims (10)
1. a kind of based on infrared AR imaging methods, which is characterized in that including：
The infrared signal that mobile terminal detection augmented reality equipment is sent out, and determine that corresponding enhancing is existing according to the infrared signal
Real device identification；
The mobile terminal in response to user operational order, by the video frame images of currently playing video and the augmented reality
Device identification is sent to server, so that the server is by augmented reality, treated that the video frame images are sent to is described
The corresponding targets improvement real world devices of augmented reality device identification；
Wherein, the video is the video that user is shot by the mobile terminal.
2. according to the method described in claim 1, which is characterized in that the method further includes：
Augmented reality equipment acquires facial image, and the facial image is sent to the server；
The server determines target facial image according to the augmented reality device identification from the facial image.
3. according to the method described in claim 2, it is characterized in that, the method further includes：
The server obtains characteristic information from the target facial image, is generated and the target according to the characteristic information
The matched first 3D facial images of facial image；
The server carries out polishing processing to the first 3D facial images, obtains the 2nd 3D facial images；
The server according to the first 3D facial images and the 2nd 3D facial images, to the target facial image into
The processing of row shadow.
4. according to the method in claim 2 or 3, which is characterized in that the method further includes：
The mobile terminal determines the first object location information in the video according to the infrared signal, by first mesh
Cursor position information is sent to the server.
5. according to the method described in claim 4, it is characterized in that, augmented reality processing specifically includes:
The server is added to the video frame images according to the first object location information, by the target facial image
In.
6. according to the method in claim 2 or 3, which is characterized in that the augmented reality processing specifically includes：
The server analyzes the video frame images, determines the second target position information；
The server is added to the video frame images according to second target position information, by the target facial image
In.
7. a kind of based on infrared AR imaging systems, which is characterized in that including：
Mobile terminal, augmented reality equipment and server；Wherein,
The mobile terminal includes detection module and the first sending module, and the detection module is for detecting augmented reality equipment hair
The infrared signal gone out, and corresponding augmented reality device identification is determined according to the infrared signal；First sending module is used
In the operational order in response to user, the video frame images of currently playing video and the augmented reality device identification are sent to
The server；Wherein, the video is the video that user is shot by the mobile terminal；
The augmented reality equipment includes acquisition module, and the acquisition module is for acquiring facial image, and by the face figure
As being sent to the server；
The server includes the first determining module, processing module and the second sending module, and first determining module is used for root
Target facial image is determined from the facial image according to the augmented reality device identification；The processing module is used for according to institute
It states target facial image and augmented reality processing is carried out to the video frame images；Second sending module is used for augmented reality
Treated, and the video frame images are sent to the corresponding targets improvement real world devices of the augmented reality device identification.
8. system according to claim 7, which is characterized in that the mobile terminal further includes the second determining module, described
Second determining module is used to determine the first object location information in the video, first transmission according to the infrared signal
Module is additionally operable to the first object location information being sent to the server.
9. system according to claim 8, which is characterized in that the processing module is used for according to the first object position
The facial image is added in the video frame images by information.
10. a kind of electronic equipment, which is characterized in that including：At least one processor；And
The memory being connect at least one processor communication；Wherein,
The memory is stored with the instruction that can be executed by least one processor, and described instruction is by least one place
It manages device to execute, so that at least one processor is able to carry out being imaged based on infrared AR described in claims 1 or 2 or 4
Method.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810364811.8A CN108377398B (en) | 2018-04-23 | 2018-04-23 | Infrared-based AR imaging method and system and electronic equipment |
| PCT/CN2018/094074 WO2019205283A1 (en) | 2018-04-23 | 2018-07-02 | Infrared-based ar imaging method, system, and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810364811.8A CN108377398B (en) | 2018-04-23 | 2018-04-23 | Infrared-based AR imaging method and system and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108377398A true CN108377398A (en) | 2018-08-07 |
| CN108377398B CN108377398B (en) | 2020-04-03 |
Family
ID=63032562
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810364811.8A Active CN108377398B (en) | 2018-04-23 | 2018-04-23 | Infrared-based AR imaging method and system and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108377398B (en) |
| WO (1) | WO2019205283A1 (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109862286A (en) * | 2019-03-28 | 2019-06-07 | 深圳创维－Rgb电子有限公司 | Image display method, device, equipment and computer storage medium |
| CN111640166A (en) * | 2020-06-08 | 2020-09-08 | 上海商汤智能科技有限公司 | AR group photo method, AR group photo device, computer equipment and storage medium |
| CN112633303A (en) * | 2020-12-18 | 2021-04-09 | 上海影创信息科技有限公司 | Height-limiting picture deformation detection method and system and vehicle |
| WO2021088691A1 (en) * | 2019-11-08 | 2021-05-14 | 华为技术有限公司 | Augmented reality (ar) communication system and ar-based communication method |
| CN113842171A (en) * | 2021-09-29 | 2021-12-28 | 北京清智图灵科技有限公司 | Effectiveness judgment device for throat swab machine sampling |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111401461A (en) * | 2020-03-24 | 2020-07-10 | 郭俊 | Wine information management method and device, computer equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2525559A1 (en) * | 2011-05-20 | 2012-11-21 | Ricoh Company, Ltd. | Apparatus, method, and system of image processing |
| CN205430495U (en) * | 2016-03-25 | 2016-08-03 | 京东方科技集团股份有限公司 | Augmented reality equipment and system |
| CN106993181A (en) * | 2016-11-02 | 2017-07-28 | 大辅科技（北京）有限公司 | Many VR/AR equipment collaborations systems and Synergistic method |
| CN107506714A (en) * | 2017-08-16 | 2017-12-22 | 成都品果科技有限公司 | A kind of method of face image relighting |
| CN107657662A (en) * | 2016-07-26 | 2018-02-02 | 金德奎 | Augmented reality equipment and its system and method that can be directly interactive between a kind of user |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20130053466A (en) * | 2011-11-14 | 2013-05-24 | 한국전자통신연구원 | Apparatus and method for playing contents to provide an interactive augmented space |
| CN204028887U (en) * | 2014-07-24 | 2014-12-17 | 央数文化(上海)股份有限公司 | A kind of reading of the hand-held based on augmented reality equipment |
| CN106780754B (en) * | 2016-11-30 | 2021-06-18 | 福建北极光虚拟视觉展示科技有限公司 | Mixed reality method and system |
-
2018
- 2018-04-23 CN CN201810364811.8A patent/CN108377398B/en active Active
- 2018-07-02 WO PCT/CN2018/094074 patent/WO2019205283A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2525559A1 (en) * | 2011-05-20 | 2012-11-21 | Ricoh Company, Ltd. | Apparatus, method, and system of image processing |
| CN205430495U (en) * | 2016-03-25 | 2016-08-03 | 京东方科技集团股份有限公司 | Augmented reality equipment and system |
| CN107657662A (en) * | 2016-07-26 | 2018-02-02 | 金德奎 | Augmented reality equipment and its system and method that can be directly interactive between a kind of user |
| CN106993181A (en) * | 2016-11-02 | 2017-07-28 | 大辅科技（北京）有限公司 | Many VR/AR equipment collaborations systems and Synergistic method |
| CN107506714A (en) * | 2017-08-16 | 2017-12-22 | 成都品果科技有限公司 | A kind of method of face image relighting |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109862286A (en) * | 2019-03-28 | 2019-06-07 | 深圳创维－Rgb电子有限公司 | Image display method, device, equipment and computer storage medium |
| CN109862286B (en) * | 2019-03-28 | 2021-08-17 | 深圳创维－Rgb电子有限公司 | Image display method, device, equipment and computer storage medium |
| WO2021088691A1 (en) * | 2019-11-08 | 2021-05-14 | 华为技术有限公司 | Augmented reality (ar) communication system and ar-based communication method |
| CN111640166A (en) * | 2020-06-08 | 2020-09-08 | 上海商汤智能科技有限公司 | AR group photo method, AR group photo device, computer equipment and storage medium |
| CN111640166B (en) * | 2020-06-08 | 2024-03-26 | 上海商汤智能科技有限公司 | AR group photo method, device, computer equipment and storage medium |
| CN112633303A (en) * | 2020-12-18 | 2021-04-09 | 上海影创信息科技有限公司 | Height-limiting picture deformation detection method and system and vehicle |
| CN113842171A (en) * | 2021-09-29 | 2021-12-28 | 北京清智图灵科技有限公司 | Effectiveness judgment device for throat swab machine sampling |
| CN113842171B (en) * | 2021-09-29 | 2024-03-01 | 北京清智图灵科技有限公司 | Validity judging device for throat swab machine sampling |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019205283A1 (en) | 2019-10-31 |
| CN108377398B (en) | 2020-04-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108377398A (en) | Based on infrared AR imaging methods, system and electronic equipment | |
| US11509817B2 (en) | Autonomous media capturing | |
| RU2679316C1 (en) | Method and device for playback of video content from any location and at any time | |
| CN109151340B (en) | Video processing method and device and electronic equipment | |
| US10445917B2 (en) | Method for communication via virtual space, non-transitory computer readable medium for storing instructions for executing the method on a computer, and information processing system for executing the method | |
| CN107079141B (en) | Image mosaic for 3 D video | |
| CN108614638A (en) | AR imaging methods and device | |
| US10666856B1 (en) | Gaze-directed photography via augmented reality feedback | |
| US20180373413A1 (en) | Information processing method and apparatus, and program for executing the information processing method on computer | |
| CN108596827B (en) | Three-dimensional face model generation method and device and electronic equipment | |
| CN108537870B (en) | Image processing method, device and electronic equipment | |
| WO2017086263A1 (en) | Image processing device and image generation method | |
| CN108573480A (en) | Ambient light compensation method, apparatus based on image procossing and electronic equipment | |
| EP3268096A1 (en) | Avatar control system | |
| CN109271911A (en) | Three-dimensional face optimization method, device and electronic equipment based on light | |
| CN109981944A (en) | Electronic device and its control method | |
| CN106559664A (en) | The filming apparatus and equipment of three-dimensional panoramic image | |
| CN109218697A (en) | Rendering method, device and the electronic equipment at a kind of video content association interface | |
| CN109214351A (en) | A kind of AR imaging method, device and electronic equipment | |
| US20180124374A1 (en) | System and Method for Reducing System Requirements for a Virtual Reality 360 Display | |
| CN109521869A (en) | A kind of information interacting method, device and electronic equipment | |
| CN109474801A (en) | A kind of generation method of interactive object, device and electronic equipment | |
| JPWO2016157996A1 (en) | Information processing apparatus, information processing method, program, and image display system | |
| CN207744074U (en) | A kind of virtual reality image processing unit | |
| CN116440495A (en) | Scene picture display method and device, terminal and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |