CN109427101A - A kind of method and system obtaining augmented reality image - Google Patents

A kind of method and system obtaining augmented reality image Download PDF

Info

Publication number
CN109427101A
CN109427101A CN201710759069.6A CN201710759069A CN109427101A CN 109427101 A CN109427101 A CN 109427101A CN 201710759069 A CN201710759069 A CN 201710759069A CN 109427101 A CN109427101 A CN 109427101A
Authority
CN
China
Prior art keywords
image
lighting information
virtual architecture
reality scene
segment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201710759069.6A
Other languages
Chinese (zh)
Inventor
李炜
孙其民
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inlife Handnet Co Ltd
Original Assignee
Inlife Handnet Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inlife Handnet Co Ltd filed Critical Inlife Handnet Co Ltd
Priority to CN201710759069.6A priority Critical patent/CN109427101A/en
Publication of CN109427101A publication Critical patent/CN109427101A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/50Lighting effects

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The embodiment of the invention discloses a kind of method and systems for obtaining augmented reality image, wherein the described method includes: obtaining the Lighting information in reality scene;The image of reality scene is acquired, and obtains the corresponding virtual architecture segment of image of reality scene in information bank;According to the Lighting information in the Lighting information adjustment virtual architecture segment in reality scene, keep the Lighting information in virtual architecture segment consistent with the Lighting information in reality scene;And virtual architecture segment adjusted is superimposed in the image of reality scene, form augmented reality image.The program improves the amalgamation of reality scene and virtual architecture segment, so that the sense of reality to user can greatly improve.

Description

A kind of method and system obtaining augmented reality image
Technical field
The present invention relates to fields of communication technology, and in particular to a kind of method and system for obtaining augmented reality image.
Background technique
In the prior art, by increasing virtual architecture segment in reality scene, to achieve the effect that augmented reality.So And the lighting effect in virtual architecture segment is generally preset lighting effect, can produce with the lighting effect in reality scene Raw difference, so that the sense of reality to user will be greatly reduced.
Therefore, how to make the lighting effect of virtual architecture segment consistent with the lighting effect of reality scene, improve real field The amalgamation of scape and virtual architecture segment, and then the sense of reality being used for is promoted, it is that this field counting personnel pay close attention to all the time Emphasis.
Summary of the invention
The purpose of the present invention is to provide a kind of method and systems for obtaining augmented reality image, and real field can be improved The amalgamation of scape and virtual architecture segment, so that the sense of reality to user can greatly improve.
To solve the above problems, the embodiment of the present invention provides a kind of method for obtaining augmented reality image, comprising:
Obtain the Lighting information in reality scene;
The image of the reality scene is acquired, and obtains the corresponding virtual knot of image of the reality scene in information bank Tile section;
The Lighting information in the virtual architecture segment is adjusted according to the Lighting information in the reality scene, makes the void Lighting information in quasi- structure fragment is consistent with the Lighting information in the reality scene;And
Virtual architecture segment adjusted is superimposed in the image of the reality scene, augmented reality image is formed.
Similarly, to solve the above problems, the embodiment of the present invention also provides a kind of system for obtaining augmented reality image, packet It includes:
Lighting information acquisition device, for obtaining the Lighting information in reality scene;
Virtual architecture segment acquisition device, for acquiring the image of the reality scene, and in information bank described in acquisition The corresponding virtual architecture segment of the image of reality scene;
Lighting information adjusts device, for adjusting the virtual architecture segment according to the Lighting information in the reality scene In Lighting information, keep the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene;With And
Augmented reality image forming apparatus, for virtual architecture segment adjusted to be superimposed on to the figure of the reality scene As in, augmented reality image is formed.
Compared in the prior art, the embodiment of the present invention adjusts virtual architecture according to the Lighting information in reality scene image Lighting information in segment keeps the Lighting information in virtual architecture segment consistent with the Lighting information in reality scene image, mentions The amalgamation of high reality scene and virtual architecture segment, so that the sense of reality to user can greatly improve.
Detailed description of the invention
To describe the technical solutions in the embodiments of the present invention more clearly, make required in being described below to embodiment Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for For those skilled in the art, without creative efforts, it can also be obtained according to these attached drawings other attached Figure.
Fig. 1 is a kind of flow diagram of method for obtaining augmented reality image provided in an embodiment of the present invention;
Fig. 2 is a kind of another flow chart of method for obtaining augmented reality image provided in an embodiment of the present invention;
Fig. 3 is a kind of system schematic for obtaining augmented reality image provided in an embodiment of the present invention;
Fig. 4 is a kind of another schematic diagram of system for obtaining augmented reality image provided in an embodiment of the present invention;
Fig. 5 is the schematic diagram of the server provided in an embodiment of the present invention for obtaining augmented reality image.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation description.It is understood that described herein, the specific embodiments are only for explaining the present invention, rather than to limit of the invention It is fixed.It also should be noted that only the parts related to the present invention are shown for ease of description, in attached drawing and not all knot Structure.Based on the embodiments of the present invention, obtained by those of ordinary skill in the art without making creative efforts Every other embodiment, shall fall within the protection scope of the present invention.
Term " first ", " second " and " third " in the present invention etc. are for distinguishing different objects, rather than for retouching State particular order.In addition, term " includes " and " having " and their any deformations, it is intended that cover and non-exclusive include. Such as contain series of steps or module process, method, system, product or equipment be not limited to listed step or Module, but optionally further comprising the step of not listing or module, or optionally further comprising for these process, methods, produce The other steps or module of product or equipment inherently.
Referenced herein " embodiment " is it is meant that a particular feature, structure, or characteristic described can wrap in conjunction with the embodiments Containing at least one embodiment of the present invention.Each position in the description occur the phrase might not each mean it is identical Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and Implicitly understand, embodiment described herein can be combined with other embodiments.
A kind of executing subject of method obtaining augmented reality image provided in an embodiment of the present invention, can be real for the present invention The system that a kind of acquisition augmented reality image of example offer is provided, or it is integrated with the meter of the system for obtaining augmented reality image It calculates machine equipment (for example desktop computer, notebook, palm PC, tablet computer, smart phone etc.).The embodiment of the present invention is to obtain As being illustrated for executing subject, the system for obtaining augmented reality image can use the system of augmented reality image The mode of hardware or software is realized.
Referring to Fig. 1, Fig. 1 is a kind of process signal of method for obtaining augmented reality image provided in an embodiment of the present invention Figure.The method includes the steps S101, step S102, step S103 and step S104.
Specifically, the method for obtaining augmented reality image includes step S101: obtaining the Lighting information in reality scene;
The method for obtaining augmented reality image includes step S102: acquiring the image of the reality scene, and in information bank The middle corresponding virtual architecture segment of image for obtaining the reality scene;
The method for obtaining augmented reality image includes step S103: adjusting institute according to the Lighting information in the reality scene The Lighting information in virtual architecture segment is stated, the light in the Lighting information and the reality scene in the virtual architecture segment is made It is consistent according to information;
The method for obtaining augmented reality image includes step S104: virtual architecture segment adjusted being superimposed on described existing In the image of real field scape, augmented reality image is formed.
In step s101, the Lighting information in reality scene is obtained.
In the present embodiment, the Lighting information obtained in reality scene can be obtained by light sensor, the light level The Lighting information in reality scene that device can also will acquire is transferred in the system of the acquisition augmented reality image.
In step s 102, the image of the reality scene is acquired, and obtains the figure of the reality scene in information bank As corresponding virtual architecture segment.Wherein, the image of the reality scene can pass through certainly for the system for obtaining augmented reality image The camera that body has carries out the realtime graphic of real time scan acquisition to any scene in the real world or target.Due to the letter Store is many corresponding virtual architecture segments of template and the template in breath library, need by the image of reality scene with Many templates in information bank are matched, and identify the template with the images match of the reality scene, can just be obtained corresponding Virtual architecture segment.
In the present embodiment, the image of the acquisition reality scene, and the reality scene is obtained in information bank The corresponding virtual architecture segment of image, specifically includes: acquiring the image of the reality scene, and to the image of the reality scene Carry out picture retrieval, the corresponding virtual architecture segment of image to obtain the reality scene in information bank.
For example, storing A image template, B image template and C image template in the information bank, and also store each mould The corresponding virtual architecture segment of plate, it is assumed that the realtime graphic is found after carrying out images match with above-mentioned several image templates, is somebody's turn to do Realtime graphic is matched with A image template, then shows that the A image template is the corresponding template of the realtime graphic, further, the A The corresponding virtual architecture segment of the virtual architecture segment of image template namely realtime graphic.
In step s 103, the illumination in the virtual architecture segment is adjusted according to the Lighting information in the reality scene Information keeps the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene.
In the present embodiment, the Lighting information according in the reality scene adjusts the light in the virtual architecture segment According to information, keeps the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene, specifically includes: The virtual architecture piece is adjusted according to illumination intensity value, preset ratio and the pre-set illumination parameter in the reality scene Lighting information in section, keeps the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene.
Specifically, generally requiring when presetting the illumination parameter and directly considering that direct illumination and indirect light are shone, directly It connects illumination and refers to and shine directly into from what light source issued and be formed by illuminating effect on object, indirect light is according to referring to what light source issued Light is reflected from other body surfaces is formed by illuminating effect in certain body surfaces, and global illumination is by direct illumination and indirectly The illuminating effect that illumination is collectively formed, in practice, global illumination are more in line with the lighting effect in reality scene.The present embodiment In, mainly consider direct illumination, therefore, 0 can be set by the parameter of indirect illumination intensity value, wherein when the parameter is greater than 1, indicate that forcing to increase indirect light shines.
In addition, the present embodiment can be according in the illumination intensity value and virtual architecture segment in pre-set reality scene Illumination intensity value ratio realize.Preferably, it can be adjusted according to the ratio of 1:1, to realize virtual architecture segment In illumination intensity value it is consistent with the illumination intensity value in reality scene image.For example, when the intensity of illumination in reality scene Value is 400, then the illumination intensity value in virtual architecture segment can be adjusted to 400 accordingly.It should be noted that the ratio It can be configured according to actual needs, it's not limited to that.
Further, in the present embodiment, the Lighting information according in the reality scene adjusts the virtual knot Lighting information in tile section makes the Lighting information one in the Lighting information and the reality scene in the virtual architecture segment It causes, specifically further include: judge the position that the virtual architecture segment is in the image of the reality scene;According to described virtual Structure fragment is in the position in the image of the reality scene and the Lighting information in the reality scene, adjusts the void The Lighting information of quasi- structure fragment makes the Lighting information in the Lighting information and the reality scene in the virtual architecture segment Unanimously.
For example, when the position in the image that the virtual architecture segment is located at the reality scene is blocked by other objects, also The Lighting information in the virtual architecture segment should be accordingly adjusted, so that empty according to the influence blocked to the virtual architecture segment Lighting information in quasi- structure fragment is consistent with the Lighting information in reality scene, to be more nearly true effect.
In step S104, virtual architecture segment adjusted is superimposed in the image of the reality scene, is formed and is increased Strong real world images.
The method of the acquisition augmented reality image of the present embodiment obtains the Lighting information in reality scene first;Then it acquires The image of reality scene, and in information bank obtain reality scene the corresponding virtual architecture segment of image;Then according to reality The Lighting information in Lighting information adjustment virtual architecture segment in scene, makes the Lighting information and reality in virtual architecture segment Lighting information in scene is consistent;Finally virtual architecture segment adjusted is superimposed in the image of reality scene, is formed and is increased Strong real world images improve the amalgamation of reality scene Yu virtual architecture segment, so that the sense of reality to user can greatly improve.
Referring to Fig. 2, Fig. 2 is a kind of another process of method for obtaining augmented reality image provided in an embodiment of the present invention Figure, the method includes the steps S201, step S202, step S203, step S204 and step S205.Wherein, the step in Fig. 2 S201, step S202, step S203 and step S204 respectively with step S101, step S102, step S103 and the step in Fig. 1 S104 is identical, and details are not described herein.
In the present embodiment, in step S205, according to the Lighting information in virtual architecture segment adjusted, described in adjustment Effect is presented to improve the color of the virtual architecture segment in the coloring of virtual architecture segment.For example, the illumination in reality scene Information has very big influence to the color displays in reality scene, and equally, the Lighting information in the virtual architecture segment can shadow Ring the color of the virtual architecture segment.
Referring to Fig. 3, Fig. 3 is a kind of system schematic for obtaining augmented reality image provided in an embodiment of the present invention.Such as Shown in Fig. 3, the system of the acquisition augmented reality image includes: Lighting information acquisition device 301, virtual architecture segment acquisition device 302, Lighting information adjustment device 303 and augmented reality image forming apparatus 304.
Wherein, Lighting information acquisition device 301, for obtaining the Lighting information in reality scene.In the present embodiment, it obtains Take the Lighting information in reality scene that can obtain by light sensor, the reality scene which can also will acquire In Lighting information be transferred to obtain augmented reality image system in.
Wherein, virtual architecture segment acquisition device 302, for acquiring the image of the reality scene, and in information bank Obtain the corresponding virtual architecture segment of image of the reality scene.The image of the reality scene can be acquisition augmented reality figure The camera that the system of picture has by itself carries out the reality of real time scan acquisition to any scene in the real world or target When image.Since what is stored in the information bank is many corresponding virtual architecture segments of template and the template, need to show The image of real field scape is matched with many templates in information bank, identifies the template with the images match of the reality scene, Corresponding virtual architecture segment can just be obtained.
In the present embodiment, the image of the acquisition reality scene, and the reality scene is obtained in information bank The corresponding virtual architecture segment of image, specifically includes: acquiring the image of the reality scene, and to the image of the reality scene Carry out picture retrieval, the corresponding virtual architecture segment of image to obtain the reality scene in information bank.
For example, storing A image template, B image template and C image template in the information bank, and also store each mould The corresponding virtual architecture segment of plate, it is assumed that the realtime graphic is found after carrying out images match with above-mentioned several image templates, is somebody's turn to do Realtime graphic is matched with A image template, then shows that the A image template is the corresponding template of the realtime graphic, further, the A The corresponding virtual architecture segment of the virtual architecture segment of image template namely realtime graphic.
Wherein, Lighting information adjusts device 303, for described virtual according to the Lighting information adjustment in the reality scene Lighting information in structure fragment makes the Lighting information in the Lighting information and the reality scene in the virtual architecture segment Unanimously.
In the present embodiment, the Lighting information according in the reality scene adjusts the light in the virtual architecture segment According to information, keeps the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene, specifically includes: The virtual architecture piece is adjusted according to illumination intensity value, preset ratio and the pre-set illumination parameter in the reality scene Lighting information in section, keeps the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene.
Specifically, generally requiring when presetting the illumination parameter and directly considering that direct illumination and indirect light are shone, directly It connects illumination and refers to and shine directly into from what light source issued and be formed by illuminating effect on object, indirect light is according to referring to what light source issued Light is reflected from other body surfaces is formed by illuminating effect in certain body surfaces, and global illumination is by direct illumination and indirectly The illuminating effect that illumination is collectively formed, in practice, global illumination are more in line with the lighting effect in reality scene.The present embodiment In, mainly consider direct illumination, therefore, 0 can be set by the parameter of indirect illumination intensity value, wherein when the parameter is greater than 1, indicate that forcing to increase indirect light shines.
In addition, the present embodiment can be according in the illumination intensity value and virtual architecture segment in pre-set reality scene Illumination intensity value ratio realize.Preferably, it can be adjusted according to the ratio of 1:1, to realize virtual architecture segment In illumination intensity value it is consistent with the illumination intensity value in reality scene image.For example, when the intensity of illumination in reality scene Value is 400, then the illumination intensity value in virtual architecture segment can be adjusted to 400 accordingly.It should be noted that the ratio It can be configured according to actual needs, it's not limited to that.
Further, in the present embodiment, the Lighting information according in the reality scene adjusts the virtual knot Lighting information in tile section makes the Lighting information one in the Lighting information and the reality scene in the virtual architecture segment It causes, specifically further include: judge the position that the virtual architecture segment is in the image of the reality scene;According to described virtual Structure fragment is in the position in the image of the reality scene and the Lighting information in the reality scene, adjusts the void The Lighting information of quasi- structure fragment makes the Lighting information in the Lighting information and the reality scene in the virtual architecture segment Unanimously.
For example, when the position in the image that the virtual architecture segment is located at the reality scene is blocked by other objects, also The Lighting information in the virtual architecture segment should be accordingly adjusted, so that empty according to the influence blocked to the virtual architecture segment Lighting information in quasi- structure fragment is consistent with the Lighting information in reality scene, to be more nearly true effect.
Wherein, enhancing display image forming apparatus 304, for virtual architecture segment adjusted to be superimposed on the reality In the image of scene, augmented reality image is formed.
The system Lighting information acquisition device first of the acquisition augmented reality image of the present embodiment obtains in reality scene Lighting information;Then the image of virtual architecture segment acquisition device acquisition reality scene, and reality scene is obtained in information bank The corresponding virtual architecture segment of image;Then Lighting information adjustment device adjusts virtual according to the Lighting information in reality scene Lighting information in structure fragment keeps the Lighting information in virtual architecture segment consistent with the Lighting information in reality scene;Most Virtual architecture segment adjusted is superimposed in the image of reality scene by augmented reality image forming apparatus afterwards, and it is existing to form enhancing Real image improves the amalgamation of reality scene Yu virtual architecture segment, so that the sense of reality to user can greatly improve.
Referring to Fig. 4, Fig. 4 is a kind of another signal of system for obtaining augmented reality image provided in an embodiment of the present invention Figure.As shown in figure 4, the system of the acquisition augmented reality image includes: that Lighting information acquisition device 401, virtual architecture segment obtain Take device 402, Lighting information adjustment device 403, augmented reality image forming apparatus 404 and color adjustment device 405.
Wherein, the Lighting information acquisition device 401 in Fig. 4, virtual architecture segment acquisition device 402, Lighting information adjustment Device 403 and enhancing display image forming apparatus 404 and the Lighting information acquisition device 301 in Fig. 3, virtual architecture segment obtain Device 302, Lighting information adjustment device 303 and augmented reality image forming apparatus 304 are identical, and details are not described herein.
Wherein, color adjustment device 405, for adjusting institute according to the Lighting information in virtual architecture segment adjusted The coloring of virtual architecture segment is stated, effect is presented to improve the color of the virtual architecture segment.For example, the light in reality scene There are very big influence, equally, the Lighting information meeting in the virtual architecture segment to the color displays in reality scene according to information Influence the color of the virtual architecture segment.
The embodiment of the present invention also provides a kind of server for obtaining augmented reality image, as shown in figure 5, acquisition enhancing is existing The server of real image may include radio frequency (RF, Radio Frequency) circuit 501, include one or more meter Memory 502, input unit 503, display unit 504, sensor 505, the voicefrequency circuit 506, nothing of calculation machine readable storage medium storing program for executing Line fidelity (WiFi, Wireless Fidelity) module 507, the processor for including one or more than one processing core The components such as 508 and power supply 509.It will be understood by those skilled in the art that obtaining the clothes of augmented reality image shown in Fig. 5 Business device structure does not constitute the restriction to the server for obtaining augmented reality image, may include than illustrating more or fewer portions Part perhaps combines certain components or different component layouts.Wherein:
RF circuit 501 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station After downlink information receives, one or the processing of more than one processor 508 are transferred to;In addition, the data for being related to uplink are sent to Base station.In general, RF circuit 501 includes but is not limited to antenna, at least one amplifier, tuner, one or more oscillators, uses Family identity module (SIM, Subscriber Identity Module) card, transceiver, coupler, low-noise amplifier (LNA, Low Noise Amplifier), duplexer etc..In addition, RF circuit 501 can also by wireless communication with network and its He communicates equipment.Any communication standard or agreement, including but not limited to global system for mobile telecommunications system can be used in the wireless communication Unite (GSM, Global System of Mobile communication), general packet radio service (GPRS, General Packet Radio Service), CDMA (CDMA, Code Division Multiple Access), wideband code division it is more Location (WCDMA, Wideband Code Division Multiple Access), long term evolution (LTE, Long Term Evolution), Email, short message service (SMS, Short Messaging Service) etc..
Memory 502 can be used for storing software program and module, and processor 508 is stored in memory 502 by operation Software program and module, thereby executing various function application and data processing.Memory 502 can mainly include storage journey Sequence area and storage data area, wherein storing program area can the (ratio of application program needed for storage program area, at least one function The display of such as virtual information);Storage data area can be stored to be created according to using for the server for obtaining augmented reality image Data (such as template and the corresponding virtual information of template) etc..In addition, memory 502 may include high random access Memory, can also include nonvolatile memory, a for example, at least disk memory, flush memory device or other are volatile Property solid-state memory.Correspondingly, memory 502 can also include Memory Controller, single to provide processor 508 and input The access of first 503 pairs of memories 502.
Input unit 503 can be used for receiving the number or character information of input, and generate and user setting and function Control related keyboard, mouse, operating stick, optics or trackball signal input.Specifically, in a specific embodiment In, input unit 503 may include touch sensitive surface and other input equipments.Touch sensitive surface, also referred to as touch display screen or touching Control plate, collect user on it or nearby touch operation (such as user using any suitable object such as finger, stylus or Operation of the attachment on touch sensitive surface or near touch sensitive surface), and corresponding connection dress is driven according to preset formula It sets.Optionally, touch sensitive surface may include both touch detecting apparatus and touch controller.Wherein, touch detecting apparatus is examined The touch orientation of user is surveyed, and detects touch operation bring signal, transmits a signal to touch controller;Touch controller from Touch information is received on touch detecting apparatus, and is converted into contact coordinate, then gives processor 508, and can reception processing Order that device 508 is sent simultaneously is executed.Furthermore, it is possible to a variety of using resistance-type, condenser type, infrared ray and surface acoustic wave etc. Type realizes touch sensitive surface.In addition to touch sensitive surface, input unit 503 can also include other input equipments.Specifically, other are defeated Entering equipment can include but is not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse One of mark, operating stick etc. are a variety of.
Display unit 504 can be used for showing information input by user or be supplied to user information and terminal it is various Graphical user interface, these graphical user interface can be made of figure, text, icon, video and any combination thereof.Display Unit 504 may include display panel, optionally, can using liquid crystal display (LCD, Liquid Crystal Display), The forms such as Organic Light Emitting Diode (OLED, Organic Light-Emitting Diode) configure display panel.Further , touch sensitive surface can cover display panel, after touch sensitive surface detects touch operation on it or nearby, send processing to Device 508 is followed by subsequent processing device 508 and is provided on a display panel accordingly according to the type of touch event to determine the type of touch event Visual output.Although touch sensitive surface and display panel are to realize input and input as two independent components in Fig. 5 Function, but in some embodiments it is possible to touch sensitive surface and display panel are integrated and realizes and outputs and inputs function.
The server for obtaining augmented reality image may also include at least one sensor 505, for example optical sensor, movement pass Sensor and other sensors.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein environment light Sensor can adjust the brightness of display panel according to the light and shade of ambient light, and proximity sensor can obtain augmented reality image Server when being moved in one's ear, close display panel and/or backlight.As a kind of motion sensor, acceleration of gravity passes Sensor can detect the size of (generally three axis) acceleration in all directions, can detect that size and the direction of gravity when static, Application (such as horizontal/vertical screen switching, dependent game, magnetometer pose calibrating), the Vibration identification that can be used to identify mobile phone posture are related Function (such as pedometer, percussion) etc.;Gyroscope, barometer, hygrometer, thermometer, the infrared ray that can also configure as terminal The other sensors such as sensor, details are not described herein.
Voicefrequency circuit 506, loudspeaker, microphone can provide the audio interface between user and terminal.Voicefrequency circuit 506 can By the electric signal after the audio data received conversion, it is transferred to loudspeaker, voice signal output is converted to by loudspeaker;It is another The voice signal of collection is converted to electric signal by aspect, microphone, is converted to audio data after being received by voicefrequency circuit 506, then After the processing of audio data output processor 508, it is sent to such as another terminal through RF circuit 501, or by audio data Output is further processed to memory 502.Voicefrequency circuit 506 is also possible that earphone jack, with provide peripheral hardware earphone with The communication of terminal.
WiFi belongs to short range wireless transmission technology, and terminal can help user's transceiver electronics postal by WiFi module 507 Part, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 5 is shown WiFi module 507, but it is understood that, and be not belonging to obtain must be configured into for the server of augmented reality image, it is complete It can according to need within the scope of not changing the essence of the invention and omit entirely.
Processor 508 is the control centre of terminal, entirely obtains augmented reality image using various interfaces and connection Server various pieces, by running or execute the software program and/or module that are stored in memory 502, and adjust With the data being stored in memory 502, the various functions of obtaining the server of augmented reality image and processing data are executed, from And integral monitoring is carried out to the server for obtaining augmented reality image.Optionally, processor 508 may include one or more processing Core;Preferably, processor 508 can integrate application processor and modem processor, wherein application processor is mainly handled Operating system, user interface and application program etc., modem processor mainly handle wireless communication.On it is understood that Stating modem processor can not also be integrated into processor 508.
The server for obtaining augmented reality image further includes the power supply 509 (such as battery) powered to all parts, preferably , power supply can be logically contiguous by power-supply management system and processor 508, to realize that management is filled by power-supply management system The functions such as electricity, electric discharge and power managed.Power supply 509 can also include one or more direct current or AC power source, again The random components such as charging system, power failure detection circuit, power adapter or inverter, power supply status indicator.
Although being not shown, the server for obtaining augmented reality image can also be including camera, bluetooth module etc., herein not It repeats again.Specifically in the present embodiment, the processor 508 obtained in the server of augmented reality image can be according to following finger It enables, the corresponding executable file of the process of one or more application program is loaded into memory 502, and by handling Device 508 runs the application program being stored in memory 502, to realize various functions:
Obtain the Lighting information in reality scene;The image of the reality scene is acquired, and in information bank described in acquisition The corresponding virtual architecture segment of the image of reality scene;The virtual architecture is adjusted according to the Lighting information in the reality scene Lighting information in segment makes the Lighting information one in the Lighting information and the reality scene in the virtual architecture segment It causes;And virtual architecture segment adjusted is superimposed in the image of the reality scene, form augmented reality image.
Preferably, the processor 508 can be also used for, and acquire the image of the reality scene, and to the real field The image of scape carries out picture retrieval, the corresponding virtual architecture segment of image to obtain the reality scene in information bank.
Preferably, the processor 508 can be also used for, according to illumination intensity value, the default ratio in the reality scene Example and pre-set illumination parameter adjust the Lighting information in the virtual architecture segment, make in the virtual architecture segment Lighting information is consistent with the Lighting information in the reality scene.
Preferably, the processor 508 can be also used for, and be in the reality scene according to the virtual architecture segment The Lighting information in position and the reality scene in image, adjusts the Lighting information of the virtual architecture segment, makes institute The Lighting information stated in virtual architecture segment is consistent with the Lighting information in the reality scene.
Preferably, the processor 508 can be also used for, according to the Lighting information in virtual architecture segment adjusted, The coloring of the virtual architecture segment is adjusted, effect is presented to improve the color of the virtual architecture segment.
It can be seen from the above, the Lighting information in terminal provided in this embodiment, first in acquisition reality scene;Then it acquires The image of reality scene, and in information bank obtain reality scene the corresponding virtual architecture segment of image;Then according to reality The Lighting information in Lighting information adjustment virtual architecture segment in scene, makes the Lighting information and reality in virtual architecture segment Lighting information in scene is consistent;Finally virtual architecture segment adjusted is superimposed in the image of reality scene, is formed and is increased Strong real world images improve the amalgamation of reality scene Yu virtual architecture segment, so that the sense of reality to user can greatly improve.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment Point, it may refer to the detailed description above with respect to information sharing method, details are not described herein again.
It should be noted that this field common test personnel can for the present invention obtains the method for augmented reality image It is that can be controlled by computer program to understand all or part of the process for realizing teaching method described in the embodiment of the present invention Relevant hardware is completed, and the computer program can be stored in a computer-readable storage medium, be such as stored in acquisition In the memory of the server of augmented reality image, and by least one processing in the server of the acquisition augmented reality image Device executes, and in the process of implementation may include the process such as the embodiment of the display methods.Wherein, the storage medium can be Magnetic disk, CD, read-only memory (ROM, Read Only Memory), random access memory (RAM, Random Access Memory) etc..
For the display system of the virtual information of the embodiment of the present invention, each functional module can integrate to be handled at one In chip, it is also possible to modules and physically exists alone, can also be integrated in two or more modules in a module. Above-mentioned integrated module both can take the form of hardware realization, can also be realized in the form of software function module.It is described If integrated module is realized and when sold or used as an independent product in the form of software function module, also can store In a computer readable storage medium, the storage medium is for example read-only memory, disk or CD etc..
The method and system for being provided for the embodiments of the invention a kind of acquisition augmented reality image above has carried out in detail It introduces, used herein a specific example illustrates the principle and implementation of the invention, the explanation of above embodiments It is merely used to help understand method and its core concept of the invention;Meanwhile for those skilled in the art, according to the present invention Thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not be understood For limitation of the present invention.

Claims (10)

1. a kind of method for obtaining augmented reality image, which is characterized in that the described method includes:
Obtain the Lighting information in reality scene;
The image of the reality scene is acquired, and obtains the corresponding virtual architecture piece of image of the reality scene in information bank Section;
The Lighting information in the virtual architecture segment is adjusted according to the Lighting information in the reality scene, makes the virtual knot Lighting information in tile section is consistent with the Lighting information in the reality scene;And
Virtual architecture segment adjusted is superimposed in the image of the reality scene, augmented reality image is formed.
2. the method according to claim 1 for obtaining augmented reality image, which is characterized in that the acquisition real field The image of scape, and obtain in information bank the corresponding virtual architecture segment of image of the reality scene, comprising:
The image of the reality scene is acquired, and picture retrieval is carried out to the image of the reality scene, to be obtained in information bank Take the corresponding virtual architecture segment of the image of the reality scene.
3. the method according to claim 1 for obtaining augmented reality image, which is characterized in that described according to the real field Lighting information in scape adjusts the Lighting information in the virtual architecture segment, makes the Lighting information in the virtual architecture segment It is consistent with the Lighting information in the reality scene, comprising:
The virtual knot is adjusted according to illumination intensity value, preset ratio and the pre-set illumination parameter in the reality scene Lighting information in tile section makes the Lighting information one in the Lighting information and the reality scene in the virtual architecture segment It causes.
4. the method according to claim 3 for obtaining augmented reality image, which is characterized in that described according to the real field Lighting information in scape adjusts the Lighting information in the virtual architecture segment, makes the Lighting information in the virtual architecture segment It is consistent with the Lighting information in the reality scene, further includes:
Judge the position that the virtual architecture segment is in the image of the reality scene;
The position being according to the virtual architecture segment in the image of the reality scene and the light in the reality scene According to information, adjust the Lighting information of the virtual architecture segment, make Lighting information in the virtual architecture segment with it is described existing Lighting information in real field scape is consistent.
5. the method according to claim 1 for obtaining augmented reality image, which is characterized in that the method, further includes:
According to the Lighting information in virtual architecture segment adjusted, the coloring of the virtual architecture segment is adjusted, to improve Effect is presented in the color for stating virtual architecture segment.
6. a kind of system for obtaining augmented reality image characterized by comprising
Lighting information acquisition device, for obtaining the Lighting information in reality scene;
Virtual architecture segment acquisition device for acquiring the image of the reality scene, and obtains the reality in information bank The corresponding virtual architecture segment of the image of scene;
Lighting information adjusts device, for being adjusted in the virtual architecture segment according to the Lighting information in the reality scene Lighting information keeps the Lighting information in the virtual architecture segment consistent with the Lighting information in the reality scene;And
Augmented reality image forming apparatus, for virtual architecture segment adjusted to be superimposed on to the image of the reality scene In, form augmented reality image.
7. the system according to claim 6 for obtaining augmented reality image, which is characterized in that the virtual architecture segment obtains Device is taken specifically to be configured as:
The image of the reality scene is acquired, and picture retrieval is carried out to the image of the reality scene, to be obtained in information bank Take the corresponding virtual architecture segment of the image of the reality scene.
8. the system according to claim 6 for obtaining augmented reality image, which is characterized in that the Lighting information adjustment dress It sets and is specifically configured as:
The virtual knot is adjusted according to illumination intensity value, preset ratio and the pre-set illumination parameter in the reality scene Lighting information in tile section makes the Lighting information one in the Lighting information and the reality scene in the virtual architecture segment It causes.
9. the system according to claim 8 for obtaining augmented reality image, which is characterized in that the Lighting information adjustment dress It sets and is specifically also configured to
Judge the position that the virtual architecture segment is in the image of the reality scene;
The position being according to the virtual architecture segment in the image of the reality scene and the light in the reality scene According to information, adjust the Lighting information of the virtual architecture segment, make Lighting information in the virtual architecture segment with it is described existing Lighting information in real field scape is consistent.
10. the system according to claim 6 for obtaining augmented reality image, which is characterized in that the system, further includes: Color adjustment device, described the color adjustment device be specifically configured as
According to the Lighting information in virtual architecture segment adjusted, the coloring of the virtual architecture segment is adjusted, to improve Effect is presented in the color for stating virtual architecture segment.
CN201710759069.6A 2017-08-29 2017-08-29 A kind of method and system obtaining augmented reality image Pending CN109427101A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710759069.6A CN109427101A (en) 2017-08-29 2017-08-29 A kind of method and system obtaining augmented reality image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710759069.6A CN109427101A (en) 2017-08-29 2017-08-29 A kind of method and system obtaining augmented reality image

Publications (1)

Publication Number Publication Date
CN109427101A true CN109427101A (en) 2019-03-05

Family

ID=65501963

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710759069.6A Pending CN109427101A (en) 2017-08-29 2017-08-29 A kind of method and system obtaining augmented reality image

Country Status (1)

Country Link
CN (1) CN109427101A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110349526A (en) * 2019-07-11 2019-10-18 Oppo广东移动通信有限公司 Augmented reality adjusting method, device, storage medium and augmented reality equipment
CN111583420A (en) * 2020-05-27 2020-08-25 上海乂学教育科技有限公司 Intelligent learning system and method based on augmented reality mode
CN113191843A (en) * 2021-04-28 2021-07-30 北京市商汤科技开发有限公司 Simulation clothing fitting method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130118761A (en) * 2012-04-20 2013-10-30 삼성전자주식회사 Method and system for generating augmented reality scene
CN103679204A (en) * 2013-12-23 2014-03-26 上海安琪艾可网络科技有限公司 Image identification and creation application system and method based on intelligent mobile device platform
CN103761763A (en) * 2013-12-18 2014-04-30 微软公司 Method for constructing reinforced reality environment by utilizing pre-calculation
CN105844714A (en) * 2016-04-12 2016-08-10 广州凡拓数字创意科技股份有限公司 Augmented reality based scenario display method and system
CN106981087A (en) * 2017-04-05 2017-07-25 杭州乐见科技有限公司 Lighting effect rendering intent and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20130118761A (en) * 2012-04-20 2013-10-30 삼성전자주식회사 Method and system for generating augmented reality scene
CN103761763A (en) * 2013-12-18 2014-04-30 微软公司 Method for constructing reinforced reality environment by utilizing pre-calculation
CN103679204A (en) * 2013-12-23 2014-03-26 上海安琪艾可网络科技有限公司 Image identification and creation application system and method based on intelligent mobile device platform
CN105844714A (en) * 2016-04-12 2016-08-10 广州凡拓数字创意科技股份有限公司 Augmented reality based scenario display method and system
CN106981087A (en) * 2017-04-05 2017-07-25 杭州乐见科技有限公司 Lighting effect rendering intent and device

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110349526A (en) * 2019-07-11 2019-10-18 Oppo广东移动通信有限公司 Augmented reality adjusting method, device, storage medium and augmented reality equipment
CN111583420A (en) * 2020-05-27 2020-08-25 上海乂学教育科技有限公司 Intelligent learning system and method based on augmented reality mode
CN111583420B (en) * 2020-05-27 2021-11-12 上海松鼠课堂人工智能科技有限公司 Intelligent learning system and method based on augmented reality mode
CN113191843A (en) * 2021-04-28 2021-07-30 北京市商汤科技开发有限公司 Simulation clothing fitting method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
US11429276B2 (en) Method for displaying graphical user interface and mobile terminal
CN106778585B (en) A kind of face key point-tracking method and device
CN105404585B (en) Obtain the method and device of code coverage
CN104519485B (en) Communication means, device and system between a kind of terminal
US20170078561A1 (en) Method for controlling cameras, storage medium and terminal
CN106933525B (en) A kind of method and apparatus showing image
CN104967790B (en) Method, photo taking, device and mobile terminal
CN106547844B (en) A kind for the treatment of method and apparatus of user interface
KR20150104302A (en) User input detection method of electronic apparatus and electronic apparatus thereof
KR20150123493A (en) Method of processing input and electronic device thereof
CN106504303B (en) A kind of method and apparatus playing frame animation
KR20150111632A (en) Fingerprint identifying method and electronic device thereof
KR20150122476A (en) Method and apparatus for controlling gesture sensor
CN104915625B (en) A kind of method and device of recognition of face
KR20150128299A (en) Sensor module and device therewith
CN106200897B (en) A kind of method and apparatus of display control menu
CN110046497A (en) A kind of function hook implementation method, device and storage medium
CN109427101A (en) A kind of method and system obtaining augmented reality image
CN104820546A (en) Functional information exhibition method and apparatus
CN105278795B (en) A kind of method and apparatus on display function column
CN110413639A (en) Data check method and device, electronic equipment and computer readable storage medium
CN109688611A (en) A kind of configuration method, device, terminal and the storage medium of frequency range parameter
CN109062643A (en) A kind of display interface method of adjustment, device and terminal
CN104811898B (en) A kind of method of acquisition of information, server, terminal and system
CN108924357A (en) A kind of method, apparatus and terminal that adjustment terminal desktop is shown

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190305

RJ01 Rejection of invention patent application after publication