WO2013017046A1 - Method and device for implementing program interface in application, computer program and storage medium - Google Patents
Method and device for implementing program interface in application, computer program and storage medium Download PDFInfo
- Publication number
- WO2013017046A1 WO2013017046A1 PCT/CN2012/079271 CN2012079271W WO2013017046A1 WO 2013017046 A1 WO2013017046 A1 WO 2013017046A1 CN 2012079271 W CN2012079271 W CN 2012079271W WO 2013017046 A1 WO2013017046 A1 WO 2013017046A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- interface
- real
- mathematical
- coordinate system
- real scene
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F8/00—Arrangements for software engineering
- G06F8/30—Creation or generation of source code
Definitions
- the present invention relates to the field of terminal technologies, and in particular, to a method, an apparatus, a computer program, and a storage medium for implementing a program interface in an application.
- an implementation method of the program interface in the application is obtained by software simulation and simulation, and specifically, the operation component in the application calculates the graphic to be displayed on the screen, and displays the stereoscopic image on the screen through simulation and simulation calculation. , graphics of simulation effects.
- graphics libraries dedicated to graphics processing such as DirectX and OpenGL
- application developers can use these graphics libraries to develop applications with complex program interfaces. It can make a subtle simulation of the real environment, making the user feel immersive.
- the above graphics library to develop the program interface in the application the resource exploitation of the terminal is large, which is not conducive to the development of the terminal application.
- another implementation method of the program interface in the existing application is that the image acquired by the camera directly serves as the background of the program interface, and does not modify any image obtained by using the camera, thereby exhibiting a transparent background effect; After the image obtained by the camera is used as the background of the program interface, the position information of the key graphic in the image is collected, and the position information is applied to the application, for example, searching for the position information of a specific paper in the image acquired from the camera. And display the mathematical image of the basket on the location information.
- the above two methods compared with the software simulation calculation simulation program interface method, only the image acquired by the camera (real scene interface) as the background of the application or as an information point (position information of the key graphics), as the program interface in the application
- the structure provides a reference to reduce the resources occupied by the application on the terminal.
- the program interface created by the above two methods is not closely combined with the mathematical interface calculated by the real scene interface and the application program, so the program interface effect is presented. Not real enough.
- the embodiment of the invention provides a method, a device, a computer program and a storage medium for implementing a program interface in an application program, which are used to solve the problem that the existing program interface generation technology has large resource overhead to the terminal and the rendering effect is not real.
- An implementation method of a program interface in an application program includes: constructing a real scene interface according to the acquired real scene image, and establishing a real scene coordinate system of the real scene interface; constructing a mathematical interface according to the mathematical image, and establishing a mathematical interface Mathematical coordinate system;
- the real scene interface is combined with the mathematical interface to generate a program interface.
- An apparatus for implementing a program interface in an application program includes: a real scene module, configured to construct a real scene interface according to the acquired real scene image, and establish a real scene coordinate system of the real scene interface;
- a math module for constructing a mathematical interface from a mathematical image and establishing a mathematical coordinate system of the mathematical interface
- a binding module configured to establish a binding relationship between the real coordinate system and the mathematical coordinate system
- a calculation module configured to calculate, according to the binding relationship, a real scene interface of the real coordinate system at the mathematical coordinate Location in the system
- the program interface generating module is configured to combine the real scene interface and the mathematical interface to generate a program interface in a mathematical coordinate system.
- Embodiments of the present invention also provide a computer program comprising instructions that, when executed by a processor, are arranged to cause the processor to perform an implementation of a program interface in an application as described above.
- Embodiments of the present invention also provide a storage medium storing a computer program as described above.
- Advantageous effects of embodiments of the present invention include:
- the method and device for realizing the program interface in the application program, the computer program and the storage medium provided by the embodiment of the present invention after constructing the real scene interface and the mathematical interface, establishing a real coordinate system of the real scene interface and a mathematical coordinate system of the mathematical interface
- the binding relationship, and according to the binding relationship, the coordinates of the real scene interface are converted to the mathematical coordinate system, and the real scene interface and the mathematical interface are combined in the mathematical coordinate system.
- the method of the present invention uses the obtained real-life interface as a part of the program interface, the calculation amount of the program interface generation can be reduced, and the resource overhead of the terminal can be saved;
- the present invention organically combines the real-life interface and the mathematical interface to achieve a realistic effect of the program interface screen.
- FIG. 1 is a flowchart of a method for implementing a program interface in an application program according to an embodiment of the present invention
- FIG. 2 is a schematic diagram of a program interface of an application program according to an embodiment of the present invention
- FIG. 3 is a flowchart of a method for implementing a program interface in an application program according to an embodiment of the present invention
- FIG. 4 is a schematic diagram of an embodiment of the present invention
- FIG. 5 is a structural diagram of an apparatus for implementing a program interface in an application program according to an embodiment of the present invention. detailed description
- the method for implementing the program interface in the application program provided by the embodiment of the present invention is as shown in FIG. 1 , and the specific process includes:
- the real scene interface and the mathematical interface are combined to generate a program interface.
- the real-time image is obtained by using hardware and/or a software tool such as a camera on the terminal, which is not limited in the embodiment of the present invention.
- various image filtering methods for example, image displacement, shape, color change, blurring, sharpening, etc.
- image displacement, shape, color change, blurring, sharpening, etc. may be used for the mathematical interface or the real scene interface to create a natural depth of field.
- the light effect interface may be used for the mathematical interface or the real scene interface to create a natural depth of field.
- the light effect interface may be used for the mathematical interface or the real scene interface to create a natural depth of field.
- the light effect interface further enhance the final generated program boundary The realism of the face.
- the binding relationship between the real coordinate system and the mathematical coordinate system in the above S103 may include the following steps:
- the implementation method of the program interface in the application program when the mathematical interface is displaced from the real-world interface, the implementation method of the program interface in the application program provided by the embodiment of the present invention also needs to perform the following operations: re-establishing the binding of the real coordinate system and the mathematical coordinate system relationship.
- the method for implementing the program interface in the application program provided by the embodiment of the present invention, as shown in FIG. 3, can also perform the following steps:
- the specific calculation method for calculating the relative displacement of the real scene interface and the real frame interface of the previous frame in the above S302 is as follows:
- N where is represented as the relative displacement between the nth small block of the N small blocks and the nth small block in the real frame interface of the previous frame, and the range of n is [1-N].
- the first type For the image of the nth small block, after the whole image is changed by the displacement k, the error of the nth small block image vector data of the N small blocks and the nth small block image vector data of the previous frame is calculated. » - ⁇ )
- the displacement k is the relative displacement between the nth small block in the N small blocks and the nth small block in the real frame interface of the previous frame.
- the second type For the image of the nth small block, after the whole image is changed by the displacement k, the correlation between the nth small block image vector data of the N small blocks and the nth small block image vector data of the previous frame is calculated: Arg maxj ⁇ ) - ⁇ )] 2 , where n has a value range of [ 1-N].
- the displacement k is the relative displacement between the nth small block in the N small blocks and the nth small block in the real frame interface of the previous frame.
- the program interface of an application is shown in Figure 4.
- the camera of the terminal device is used to obtain the real interface (including the interface of the table) and the mathematical interface (the interface containing the cup) is established; the real coordinate system of the real scene interface and the mathematics of the mathematical interface are established. After the binding relationship between the coordinate systems, the program interface is generated.
- the displacement a of the real scene interface is calculated; after that, the displacement a of the real scene interface is coordinate-transformed to obtain the mathematical coordinate system.
- the displacement a' in the mathematical coordinate system the mathematical interface is also moved to the corresponding displacement, reaching the position shown by the dotted line, that is, in the program interface, the position of the solid cup.
- the displacement b between the positions of the dotted cups is equal to the displacement a'.
- the mathematical interface is processed (for example, the cup is broken), when the real interface is displaced and the mathematical interface is moved to the corresponding position, the effect that the cup is always broken can be presented.
- an embodiment of the present invention further provides an apparatus for implementing a program interface in an application. Since the principle of solving the problem is similar to the implementation method of the program interface in the foregoing application, the implementation of the apparatus may be See the implementation of the method, and the repetition will not be repeated.
- An apparatus for implementing a program interface in an application program according to an embodiment of the present invention, as shown in FIG. 5, includes:
- a real scene module 501 configured to construct a real scene interface according to the acquired real scene image, and establish a real scene coordinate system of the real scene interface;
- a math module 502 configured to construct a mathematical interface according to the mathematical image, and establish a mathematical coordinate system of the mathematical interface
- the binding module 503 is configured to establish a binding relationship between the real coordinate system and the mathematical coordinate system; and the calculating module 504 is configured to calculate, according to the binding relationship, a position of the real scene interface of the real coordinate system in the mathematical coordinate system;
- the program interface generation module 505 is configured to combine the real scene interface and the mathematical interface to generate a program interface in the mathematical coordinate system.
- the binding module 503 in the foregoing apparatus provided by the embodiment of the present invention, as shown in FIG. 5, specifically includes:
- the origin coordinate sub-module 5031 is determined to determine the coordinate of the origin of the real coordinate system in the mathematical coordinate system is O(P, g);
- the computing module 504 in the foregoing apparatus specifically includes: a determining coordinate sub-module 5041, configured to determine a coordinate of a point in the real-world interface in the real-world coordinate system; a coordinate conversion sub-module 5042, configured to calculate a point P in the mathematical coordinate system by coordinate transformation
- the binding module 503 in the above device provided by the embodiment of the present invention is further configured to re-establish the binding relationship between the real coordinate system and the mathematical coordinate system when the mathematical interface is displaced relative to the real scene interface.
- the device for implementing the program interface in the application program provided by the embodiment of the present invention, as shown in FIG. 5, further includes:
- the displacement calculation module 506 is configured to calculate a relative displacement between the current real scene interface and the previous frame real scene interface when the real scene interface changes;
- the moving module 507 is configured to move the mathematical interface to the corresponding position according to the relative displacement of the calculated real scene interface and the previous frame real scene interface in the mathematical coordinates.
- the displacement calculation module 506 as shown in FIG. 5, specifically includes:
- the image blocking sub-module 5061 is configured to divide the real-view interface and the previous frame real-time interface into 16 X 16 small blocks;
- the displacement calculation sub-module 5062 is configured to select N small blocks in the real scene interface, and respectively calculate relative displacements between each of the selected N small blocks and each small block in the previous frame real scene interface; The following formula calculates the relative displacement D of the real scene interface and the previous frame real scene interface:
- N where is represented as the relative displacement between the nth small block of the N small blocks and the nth small block in the real frame interface of the previous frame, and the value of n ranges from [1-N].
- Embodiments of the present invention also provide a computer program comprising instructions that, when executed by a processor, are arranged to cause the processor to perform an implementation of a program interface in an application as described above.
- Embodiments of the present invention also provide a storage medium storing a computer program as described above.
- the method and device for realizing the program interface in the application program, the computer program and the storage medium provided by the embodiment of the present invention after constructing the real scene interface and the mathematical interface, establishing a real coordinate system of the real scene interface and a mathematical coordinate system of the mathematical interface
- the binding relationship, and according to the binding relationship, the coordinates of the real scene interface are converted to the mathematical coordinate system, and the real scene interface and the mathematical interface are combined in the mathematical coordinate system.
- the computer program and the storage medium of the present invention use the acquired real-life interface as part of the program interface, the calculation amount generated by the program interface can be reduced.
- the invention organically combines the real-life interface and the mathematical interface, and can achieve the realistic effect of the program interface picture.
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Processing Or Creating Images (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
A method and device for implementing a program interface in an application, a computer program and a storage medium. After a real scene interface and a mathematical interface are constructed, a binding relationship between a real scene coordinate system of the real scene interface and a mathematical coordinate system of the mathematical interface is established, and according to the binding relationship, the coordinates in the real scene interface are transformed to the mathematical coordinate system, and in the mathematical coordinate system, the real scene interface is combined with the mathematical interface to generate a program interface. Compared with the prior art, the method of the present invention uses the obtained real scene interface as a part of the program interface, so that the computation amount for generating the program interface is reduced, and the resource overhead of the terminal is saved. In addition, the present invention organically combines the real scene interface with the mathematical interface, thereby achieving a vivid image of the program interface.
Description
一种应用程序中程序界面的实现方法、 装置、 计算机程序及存储介质 技术领域 Method, device, computer program and storage medium for implementing program interface in application program
本发明涉及终端技术领域， 尤其涉及一种应用程序中程序界面的实现方 法、 装置、 计算机程序及存储介质。 The present invention relates to the field of terminal technologies, and in particular, to a method, an apparatus, a computer program, and a storage medium for implementing a program interface in an application.
背景技术 Background technique
随着终端技术以及终端上硬件能力的不断发展， 应用在终端上的各种软 件 （应用程序） 越来越多， 并且各种应用程序中程序界面的展现方式也在快 速发展。 With the continuous development of terminal technologies and hardware capabilities on terminals, more and more software (applications) are applied to terminals, and the display manner of program interfaces in various applications is also rapidly developing.
目前应用程序中程序界面的一种实现方法是通过软件仿真模拟计算得到 的， 具体是由应用程序中的运算元件计算出将要显示在屏幕上的图形， 通过 仿真模拟计算在屏幕上显示出具有立体、仿真效果的图形。尤其是在近些年， 随着专用于图形处理的图形库（如 DirectX和 OpenGL) 的快速发展， 应用程 序的开发者可以利用这些图形库开发出具有复杂的程序界面的应用程序， 这 些程序界面能对现实环境作出精妙的模拟， 使得用户有身临其境的感觉。 但 是， 使用上述图形库对应用程序中的程序界面进行开发， 对于终端的资源开 销很大， 不利于终端的应用程序发展。 At present, an implementation method of the program interface in the application is obtained by software simulation and simulation, and specifically, the operation component in the application calculates the graphic to be displayed on the screen, and displays the stereoscopic image on the screen through simulation and simulation calculation. , graphics of simulation effects. Especially in recent years, with the rapid development of graphics libraries dedicated to graphics processing (such as DirectX and OpenGL), application developers can use these graphics libraries to develop applications with complex program interfaces. It can make a subtle simulation of the real environment, making the user feel immersive. However, using the above graphics library to develop the program interface in the application, the resource exploitation of the terminal is large, which is not conducive to the development of the terminal application.
此外， 在现有的应用程序中程序界面的另一种实现方法是采用摄像头获 取的图像直接作为程序界面的背景， 不对使用摄像头获取得到的图像做任何 修改， 从而呈现出透明的背景效果； 或者是利用摄像头获取得到的图像作为 程序界面的背景后， 采集图像中关键图形的位置信息， 将该位置信息应用于 应用程序中， 例如， 在从摄像头获取的图像中搜索一张特定纸的位置信息， 并在该位置信息上显示篮筐的数学图像。 上述两种方法， 相对于软件模拟计 算仿真构造程序界面的方法， 只是将摄像头获取的图像 （实景界面） 作为应 用程序的背景或者作为信息点（关键图形的位置信息）， 为应用程序中程序界 面的构造提供参考， 从而减少应用程序在终端上所占资源， 但是， 用上述两 种方法制作出的程序界面由于实景界面和应用程序计算出的数学界面结合不 够紧密， 因此呈现出的程序界面效果不够真实。 In addition, another implementation method of the program interface in the existing application is that the image acquired by the camera directly serves as the background of the program interface, and does not modify any image obtained by using the camera, thereby exhibiting a transparent background effect; After the image obtained by the camera is used as the background of the program interface, the position information of the key graphic in the image is collected, and the position information is applied to the application, for example, searching for the position information of a specific paper in the image acquired from the camera. And display the mathematical image of the basket on the location information. The above two methods, compared with the software simulation calculation simulation program interface method, only the image acquired by the camera (real scene interface) as the background of the application or as an information point (position information of the key graphics), as the program interface in the application The structure provides a reference to reduce the resources occupied by the application on the terminal. However, the program interface created by the above two methods is not closely combined with the mathematical interface calculated by the real scene interface and the application program, so the program interface effect is presented. Not real enough.
发明内容
本发明实施例提供了一种应用程序中程序界面的实现方法、 装置、 计算 机程序及存储介质， 用以解决现有程序界面生成技术对终端的资源开销大以 及呈现效果不够真实的问题。 Summary of the invention The embodiment of the invention provides a method, a device, a computer program and a storage medium for implementing a program interface in an application program, which are used to solve the problem that the existing program interface generation technology has large resource overhead to the terminal and the rendering effect is not real.
本发明实施例提供的一种应用程序中程序界面的实现方法， 包括： 根据获取到的实景图像构造实景界面， 并建立实景界面的实景坐标系； 根据数学图像构造数学界面， 并建立数学界面的数学坐标系； An implementation method of a program interface in an application program according to an embodiment of the present invention includes: constructing a real scene interface according to the acquired real scene image, and establishing a real scene coordinate system of the real scene interface; constructing a mathematical interface according to the mathematical image, and establishing a mathematical interface Mathematical coordinate system;
建立所述实景坐标系和所述数学坐标系的绑定关系； Establishing a binding relationship between the real coordinate system and the mathematical coordinate system;
根据所述绑定关系， 计算出所述实景坐标系的实景界面在所述数学坐标 系中的位置； Calculating, according to the binding relationship, a position of the real scene interface of the real coordinate system in the mathematical coordinate system;
在数学坐标系中， 将所述实景界面与数学界面结合生成程序界面。 In the mathematical coordinate system, the real scene interface is combined with the mathematical interface to generate a program interface.
本发明实施例提供的一种应用程序中程序界面的实现装置， 包括： 实景模块， 用于根据获取到的实景图像构造实景界面， 并建立实景界面 的实景坐标系； An apparatus for implementing a program interface in an application program according to an embodiment of the present invention includes: a real scene module, configured to construct a real scene interface according to the acquired real scene image, and establish a real scene coordinate system of the real scene interface;
数学模块， 用于根据数学图像构造数学界面， 并建立数学界面的数学坐 标系； a math module for constructing a mathematical interface from a mathematical image and establishing a mathematical coordinate system of the mathematical interface;
绑定模块， 用于建立所述实景坐标系和所述数学坐标系的绑定关系； 计算模块， 用于根据所述绑定关系， 计算出所述实景坐标系的实景界面 在所述数学坐标系中的位置； a binding module, configured to establish a binding relationship between the real coordinate system and the mathematical coordinate system; a calculation module, configured to calculate, according to the binding relationship, a real scene interface of the real coordinate system at the mathematical coordinate Location in the system;
程序界面生成模块， 用于在数学坐标系中， 将所述实景界面与数学界面 结合生成程序界面。 The program interface generating module is configured to combine the real scene interface and the mathematical interface to generate a program interface in a mathematical coordinate system.
本发明的实施例还提供一种包括指令的计算机程序， 所述指令在由处理 器执行时被设置成使所述处理器执行如上所述的应用程序中程序界面的实现 方法。 Embodiments of the present invention also provide a computer program comprising instructions that, when executed by a processor, are arranged to cause the processor to perform an implementation of a program interface in an application as described above.
本发明的实施例还提供一种存储了如上所述的计算机程序的存储介质。 本发明实施例的有益效果包括： Embodiments of the present invention also provide a storage medium storing a computer program as described above. Advantageous effects of embodiments of the present invention include:
本发明实施例提供的一种应用程序中程序界面的实现方法及装置、 计算 机程序及存储介质， 在构造实景界面和数学界面后， 建立实景界面的实景坐 标系和数学界面的数学坐标系之间的绑定关系， 并根据绑定关系， 将实景界 面的坐标转换到数学坐标系下， 并在数学坐标系中将实景界面与数学界面结
合生成程序界面； 一方面， 较现有技术来说， 由于本发明的方法使用获取到 的实景界面作为程序界面的一部分， 能够达到减少程序界面生成的计算量， 节省终端的资源开销的效果； 另一方面， 本发明将实景界面和数学界面有机 地结合到一起， 能够达到程序界面画面逼真的效果。 The method and device for realizing the program interface in the application program, the computer program and the storage medium provided by the embodiment of the present invention, after constructing the real scene interface and the mathematical interface, establishing a real coordinate system of the real scene interface and a mathematical coordinate system of the mathematical interface The binding relationship, and according to the binding relationship, the coordinates of the real scene interface are converted to the mathematical coordinate system, and the real scene interface and the mathematical interface are combined in the mathematical coordinate system. On the one hand, compared with the prior art, since the method of the present invention uses the obtained real-life interface as a part of the program interface, the calculation amount of the program interface generation can be reduced, and the resource overhead of the terminal can be saved; On the other hand, the present invention organically combines the real-life interface and the mathematical interface to achieve a realistic effect of the program interface screen.
附图说明 DRAWINGS
图 1为本发明实施例提供的应用程序中程序界面的实现方法的流程图之 图 2为本发明实施例提供的应用程序的程序界面的示意图； 1 is a flowchart of a method for implementing a program interface in an application program according to an embodiment of the present invention; FIG. 2 is a schematic diagram of a program interface of an application program according to an embodiment of the present invention;
图 3为本发明实施例提供的应用程序中程序界面的实现方法的流程图之 图 4为本发明实施例提供的实施例的示意图； 3 is a flowchart of a method for implementing a program interface in an application program according to an embodiment of the present invention; FIG. 4 is a schematic diagram of an embodiment of the present invention;
图 5为本发明实施例提供的应用程序中程序界面的实现装置的结构图。 具体实施方式 FIG. 5 is a structural diagram of an apparatus for implementing a program interface in an application program according to an embodiment of the present invention. detailed description
下面结合附图， 对本发明实施例提供的一种应用程序中程序界面的实现 方法及装置的具体实施方式进行详细地说明。 The implementation method of the program interface and the specific implementation manner of the device in the application program according to the embodiment of the present invention are described in detail below with reference to the accompanying drawings.
本发明实施例提供的一种应用程序中程序界面的实现方法，如图 1所示， 具体流程包括： The method for implementing the program interface in the application program provided by the embodiment of the present invention is as shown in FIG. 1 , and the specific process includes:
5101、 根据获取到的实景图像构造实景界面， 并建立实景界面的实景坐 标系； 5101. Construct a real scene interface according to the obtained real scene image, and establish a real scene coordinate system of the real scene interface;
5102、 根据数学图像构造数学界面， 并建立数学界面的数学坐标系； 5102. Construct a mathematical interface according to the mathematical image, and establish a mathematical coordinate system of the mathematical interface;
5103、 建立实景坐标系和数学坐标系的绑定关系； 5103. Establish a binding relationship between the real coordinate system and the mathematical coordinate system;
5104、 根据绑定关系， 计算出实景坐标系的实景界面在数学坐标系中的 位置； 5104. Calculate, according to the binding relationship, a position of the real scene interface of the real coordinate system in the mathematical coordinate system;
5105、 在数学坐标系中， 将实景界面与数学界面结合生成程序界面。 其中， S101中， 实景图像的获取可以使用终端上的摄像头等硬件和 /或软 件工具， 在本发明实施例中不做限定。 5105. In the mathematical coordinate system, the real scene interface and the mathematical interface are combined to generate a program interface. In S101, the real-time image is obtained by using hardware and/or a software tool such as a camera on the terminal, which is not limited in the embodiment of the present invention.
实施中， 在上述 S101和 S102中， 还可以对数学界面或实景界面分别使 用各种图像过滤方式 （例如： 图像的位移、 形状、 颜色变化、 模糊化、 锐化 等）， 创造出具有自然景深和光线效果的界面， 进一歩增强最终生成的程序界
面的真实感。 In the implementation, in the above S101 and S102, various image filtering methods (for example, image displacement, shape, color change, blurring, sharpening, etc.) may be used for the mathematical interface or the real scene interface to create a natural depth of field. And the light effect interface, further enhance the final generated program boundary The realism of the face.
具体地， 如图 2所示的程序界面示意图， 上述 S103中建立实景坐标系和 数学坐标系的绑定关系， 可以包括以下歩骤： Specifically, as shown in the schematic diagram of the program interface shown in FIG. 2, the binding relationship between the real coordinate system and the mathematical coordinate system in the above S103 may include the following steps:
确定实景坐标系的原点在数学坐标系的坐标为 O(p,w ; Determine the origin of the real coordinate system in the mathematical coordinate system coordinates O (p, w;
确定实景坐标系的 '轴到数学坐标系的 轴顺时针夹角 θ。 Determine the clockwise angle θ of the axis of the real coordinate system from the axis to the mathematical coordinate system.
上述 S104中根据绑定关系，计算出位于实景坐标系的实景界面在数学坐 标系中的位置， 可以通过下述流程实现： In the above S104, according to the binding relationship, the position of the real scene interface in the real coordinate system in the mathematical coordinate system is calculated, which can be realized by the following process:
确定实景界面中点 Ρ在实景坐标系中的坐标为 )； Determine the coordinates of the real scene interface Ρ in the real coordinate system is );
通过坐标变换， 计算点 Ρ在数学坐标系中的坐标 P^, y)为： Through the coordinate transformation, the coordinates P^, y) of the point Ρ in the mathematical coordinate system are calculated as:
CosO SinO 0 CosO SinO 0
-Sin0 CosO 0 -Sin0 CosO 0
P Q 1 具体实施中， 当数学界面相对实景界面发生位移时， 本发明实施例提供 的应用程序中程序界面的实现方法， 还需要执行下述操作： 重新建立实景坐 标系与数学坐标系的绑定关系。 In the implementation of the PQ 1 , when the mathematical interface is displaced from the real-world interface, the implementation method of the program interface in the application program provided by the embodiment of the present invention also needs to perform the following operations: re-establishing the binding of the real coordinate system and the mathematical coordinate system relationship.
本发明实施例提供的应用程序中程序界面的实现方法， 如图 3所示， 还 可以执行以下歩骤： The method for implementing the program interface in the application program provided by the embodiment of the present invention, as shown in FIG. 3, can also perform the following steps:
5301、 判断实景界面是否发生位移， 如果是， 执行 S302 , 如果否， 执行 S304; 5301, determining whether the real scene interface is displaced, if yes, executing S302, if not, executing S304;
5302、 计算实景界面与上一帧实景界面之间的相对位移； 5302. Calculate a relative displacement between the real scene interface and the previous frame real scene interface;
5303、 在数学坐标中， 根据计算出的实景界面与上一帧实景界面的相对 位移， 将数学界面移动到对应位置； 5303. In the mathematical coordinate, move the mathematical interface to the corresponding position according to the calculated relative displacement between the real scene interface and the real frame interface of the previous frame;
5304、 结束。 5304, the end.
具体地，上述 S302中计算实景界面与上一帧实景界面的相对位移的具体 计算方法如下： Specifically, the specific calculation method for calculating the relative displacement of the real scene interface and the real frame interface of the previous frame in the above S302 is as follows:
将所述实景界面与上一帧实景界面分为 16 X 16个小块； Dividing the real scene interface and the previous frame real scene interface into 16 X 16 small blocks;
选取实景界面中的 N个小块， 分别计算选取的 N个小块中每个小块与上 一帧实景界面中的每个小块之间的相对位移； Selecting N small blocks in the real scene interface, respectively calculating the relative displacement between each of the selected N small blocks and each small block in the previous frame real scene interface;
基于下述公式计算所述实景界面与上一帧实景界面的相对位移 D:
∑ d{n) Calculating the relative displacement D of the real scene interface and the previous frame real scene interface based on the following formula: ∑ d{n)
D =厶" =1 ； D = 厶"=1;
N 其中， 表征为所述 N个小块中第 n小块与上一帧实景界面中第 n小 块之间的相对位移，所述 n的取值范围为 [ 1-N]。 N where is represented as the relative displacement between the nth small block of the N small blocks and the nth small block in the real frame interface of the previous frame, and the range of n is [1-N].
上述计算实景界面与上一帧实景界面的相对位移的过程中， 计算选取的 N个小块中每个小块与上一帧实景界面中的每个小块之间的相对位移的具体 实施方式属于现有技术的范畴， 例如可以使用下述两种方法： In the process of calculating the relative displacement between the real scene interface and the real frame interface of the previous frame, a specific implementation manner for calculating the relative displacement between each of the selected N small blocks and each small block in the previous frame real scene interface is calculated. In the scope of the prior art, for example, the following two methods can be used:
第一种： 对于第 n小块的图像， 将图像整体经位移 k变化后， 计算 N个 小块中第 n小块图像矢量数据 与上一帧中第 n小块图像矢量数据 的误 差 » | » -^)|2 ， 其中 n的取值范围为 [ 1-N]。 The first type: For the image of the nth small block, after the whole image is changed by the displacement k, the error of the nth small block image vector data of the N small blocks and the nth small block image vector data of the previous frame is calculated. » -^)| 2 , where n has a value range of [ 1-N].
确定当计算得到的误差 2(«)数值最小时， 位移 k为 N个小块中第 n小块 与上一帧实景界面中第 n小块之间的相对位移 。 It is determined that when the calculated error 2 («) value is the smallest, the displacement k is the relative displacement between the nth small block in the N small blocks and the nth small block in the real frame interface of the previous frame.
第二种： 对于第 n小块的图像， 将图像整体经位移 k变化后， 计算 N个 小块中第 n小块图像矢量数据 与上一帧中第 n小块图像矢量数据 的相 关度： arg maxj ^) - ^)]2 ， 其中 n的取值范围为 [ 1-N]。 The second type: For the image of the nth small block, after the whole image is changed by the displacement k, the correlation between the nth small block image vector data of the N small blocks and the nth small block image vector data of the previous frame is calculated: Arg maxj ^) - ^)] 2 , where n has a value range of [ 1-N].
确定当计算得到的相关度数值最大时， 位移 k为 N个小块中第 n小块与 上一帧实景界面中第 n小块之间的相对位移 。 It is determined that when the calculated correlation value is the largest, the displacement k is the relative displacement between the nth small block in the N small blocks and the nth small block in the real frame interface of the previous frame.
此外， 还可以采用其他现有的实施方式， 例如 《结合两歩估算和运动补 偿的子像素运动估计》 （《计算机工程与应用》， 2009. 45 ( 7)， 190-191 页） 中提到的三种计算方法， 在此不再赘述。 In addition, other existing implementations can be used, such as "Sub-pixel motion estimation combined with two-dimensional estimation and motion compensation" (Computer Engineering and Applications, 2009. 45 (7), pp. 190-191) The three calculation methods are not repeated here.
下面通过一个具体地实施例对本发明实施例提供的应用程序中程序界面 的实现方法进行详细地说明。 The implementation method of the program interface in the application program provided by the embodiment of the present invention is described in detail below through a specific embodiment.
一款应用程序的程序界面如图 4所示， 利用终端设备的摄像头获取实景 界面（包含桌子的界面）并建立数学界面（包含杯子的界面）； 建立实景界面 的实景坐标系和数学界面的数学坐标系之间的绑定关系后， 生成程序界面。 The program interface of an application is shown in Figure 4. The camera of the terminal device is used to obtain the real interface (including the interface of the table) and the mathematical interface (the interface containing the cup) is established; the real coordinate system of the real scene interface and the mathematics of the mathematical interface are established. After the binding relationship between the coordinate systems, the program interface is generated.
当实景界面发生位移时 （在图 4中从实线桌子的位置移动到虚线所示桌 子的位置）， 计算出实景界面的位移 a; 之后， 对实景界面的位移 a进行坐标 变换得到在数学坐标系下的位移 a' ； 在数学坐标系中， 将数学界面也移动 到相应的位移， 到达虚线所示的位置， 即在程序界面中， 实线杯子的位置与
虚线杯子的位置之间的位移 b等于位移 a' 。 这样， 可以实现不论实景界面 如何发生变化， 程序界面能够始终呈现杯子放置在作为实景的桌子上面的逼 真显示效果。 When the real scene interface is displaced (moving from the position of the solid table to the position of the table shown by the dotted line in Fig. 4), the displacement a of the real scene interface is calculated; after that, the displacement a of the real scene interface is coordinate-transformed to obtain the mathematical coordinate system. The displacement a' in the mathematical coordinate system, the mathematical interface is also moved to the corresponding displacement, reaching the position shown by the dotted line, that is, in the program interface, the position of the solid cup The displacement b between the positions of the dotted cups is equal to the displacement a'. In this way, regardless of how the real-world interface changes, the program interface can always present a realistic display effect of the cup placed on the table as a real scene.
此外， 如果对数学界面进行效果处理（例如杯子被打碎）， 当实景界面发 生位移时， 数学界面也移动到相对应的位置过程中， 那么可以呈现杯子一直 处于被打碎的状态的效果。 In addition, if the mathematical interface is processed (for example, the cup is broken), when the real interface is displaced and the mathematical interface is moved to the corresponding position, the effect that the cup is always broken can be presented.
基于同一发明构思， 本发明实施例还提供了一种应用程序中程序界面的 实现装置， 由于该装置解决问题的原理与前述一种应用程序中程序界面的实 现方法相似， 因此该装置的实施可以参见方法的实施， 重复之处不再赘述。 Based on the same inventive concept, an embodiment of the present invention further provides an apparatus for implementing a program interface in an application. Since the principle of solving the problem is similar to the implementation method of the program interface in the foregoing application, the implementation of the apparatus may be See the implementation of the method, and the repetition will not be repeated.
本发明实施例提供的一种应用程序中程序界面的实现装置，如图 5所示， 包括： An apparatus for implementing a program interface in an application program according to an embodiment of the present invention, as shown in FIG. 5, includes:
实景模块 501， 用于根据获取到的实景图像构造实景界面， 并建立实景 界面的实景坐标系； a real scene module 501, configured to construct a real scene interface according to the acquired real scene image, and establish a real scene coordinate system of the real scene interface;
数学模块 502， 用于根据数学图像构造数学界面， 并建立数学界面的数 学坐标系； a math module 502, configured to construct a mathematical interface according to the mathematical image, and establish a mathematical coordinate system of the mathematical interface;
绑定模块 503， 用于建立实景坐标系和数学坐标系的绑定关系； 计算模块 504， 用于根据绑定关系， 计算出实景坐标系的实景界面在数 学坐标系中的位置； The binding module 503 is configured to establish a binding relationship between the real coordinate system and the mathematical coordinate system; and the calculating module 504 is configured to calculate, according to the binding relationship, a position of the real scene interface of the real coordinate system in the mathematical coordinate system;
程序界面生成模块 505， 用于在数学坐标系中， 将实景界面与数学界面 结合生成程序界面。 The program interface generation module 505 is configured to combine the real scene interface and the mathematical interface to generate a program interface in the mathematical coordinate system.
具体地， 本发明实施例提供的上述装置中的绑定模块 503， 如图 5所示， 具体包括： Specifically, the binding module 503 in the foregoing apparatus provided by the embodiment of the present invention, as shown in FIG. 5, specifically includes:
确定原点坐标子模块 5031， 用于确定实景坐标系的原点在数学坐标系的 坐标为 O(P, g) ; The origin coordinate sub-module 5031 is determined to determine the coordinate of the origin of the real coordinate system in the mathematical coordinate system is O(P, g);
确定夹角子模块 5032， 用于确定所述实景坐标系的 x'轴到所述数学坐标 系的 r轴顺时针夹角 Θ ., Determining an angle sub-module 5032 for determining a clockwise angle x of the x' axis of the real coordinate system to the r coordinate of the mathematical coordinate system,
具体地， 上述装置中的计算模块 504， 如图 5所示， 具体包括： 确定坐标子模块 5041， 用于确定实景界面中点 ^在所述实景坐标系中的 坐标为 ；
坐标转换子模块 5042， 用于通过坐标变换， 计算点 P在所述数学坐标系 Specifically, the computing module 504 in the foregoing apparatus, as shown in FIG. 5, specifically includes: a determining coordinate sub-module 5041, configured to determine a coordinate of a point in the real-world interface in the real-world coordinate system; a coordinate conversion sub-module 5042, configured to calculate a point P in the mathematical coordinate system by coordinate transformation
Cos0 Sin0 0 Cos0 Sin0 0
中的坐标/^, 为/3 -SinO CosO 0 The coordinates in /^, are / 3 -SinO CosO 0
P Q 1 本发明实施例提供的上述装置中的绑定模块 503， 还用于当数学界面相 对实景界面发生位移时， 重新建立实景坐标系与数学坐标系的绑定关系。 P Q 1 The binding module 503 in the above device provided by the embodiment of the present invention is further configured to re-establish the binding relationship between the real coordinate system and the mathematical coordinate system when the mathematical interface is displaced relative to the real scene interface.
本发明实施例提供的应用程序中程序界面的实现装置， 如图 5所示， 还 包括： The device for implementing the program interface in the application program provided by the embodiment of the present invention, as shown in FIG. 5, further includes:
位移计算模块 506， 用于当实景界面发生变化时， 计算当前实景界面与 上一帧实景界面之间的相对位移； The displacement calculation module 506 is configured to calculate a relative displacement between the current real scene interface and the previous frame real scene interface when the real scene interface changes;
移动模块 507， 用于在数学坐标中， 根据计算出的实景界面与上一帧实 景界面的相对位移， 将数学界面移动到对应位置。 The moving module 507 is configured to move the mathematical interface to the corresponding position according to the relative displacement of the calculated real scene interface and the previous frame real scene interface in the mathematical coordinates.
具体地， 上述位移计算模块 506， 如图 5所示， 具体包括： Specifically, the displacement calculation module 506, as shown in FIG. 5, specifically includes:
图像分块子模块 5061， 用于将实景界面与上一帧实景界面分为 16 X 16 个小块； The image blocking sub-module 5061 is configured to divide the real-view interface and the previous frame real-time interface into 16 X 16 small blocks;
位移计算子模块 5062， 用于选取实景界面中的 N个小块， 分别计算选取 的 N个小块中每个小块与上一帧实景界面中的每个小块之间的相对位移； 基 于下述公式计算实景界面与上一帧实景界面的相对位移 D: The displacement calculation sub-module 5062 is configured to select N small blocks in the real scene interface, and respectively calculate relative displacements between each of the selected N small blocks and each small block in the previous frame real scene interface; The following formula calculates the relative displacement D of the real scene interface and the previous frame real scene interface:
D D
N 其中， 表征为 N个小块中第 n小块与上一帧实景界面中第 n小块之 间的相对位移， n的取值范围为 [ 1-N]。 N where is represented as the relative displacement between the nth small block of the N small blocks and the nth small block in the real frame interface of the previous frame, and the value of n ranges from [1-N].
本发明的实施例还提供一种包括指令的计算机程序， 所述指令在由处理 器执行时被设置成使所述处理器执行如上所述的应用程序中程序界面的实现 方法。 Embodiments of the present invention also provide a computer program comprising instructions that, when executed by a processor, are arranged to cause the processor to perform an implementation of a program interface in an application as described above.
本发明的实施例还提供一种存储了如上所述的计算机程序的存储介质。 本发明实施例提供的一种应用程序中程序界面的实现方法及装置、 计算 机程序及存储介质， 在构造实景界面和数学界面后， 建立实景界面的实景坐 标系和数学界面的数学坐标系之间的绑定关系， 并根据绑定关系， 将实景界 面的坐标转换到数学坐标系下， 并在数学坐标系中将实景界面与数学界面结
合生成程序界面； 一方面， 较现有技术来说， 由于本发明的方法及装置、 计 算机程序及存储介质使用获取到的实景界面作为程序界面的一部分， 能够达 到减少程序界面生成的计算量， 节省终端的资源开销的效果； 另一方面， 本 发明将实景界面和数学界面有机地结合到一起， 能够达到程序界面画面逼真 的效果。 Embodiments of the present invention also provide a storage medium storing a computer program as described above. The method and device for realizing the program interface in the application program, the computer program and the storage medium provided by the embodiment of the present invention, after constructing the real scene interface and the mathematical interface, establishing a real coordinate system of the real scene interface and a mathematical coordinate system of the mathematical interface The binding relationship, and according to the binding relationship, the coordinates of the real scene interface are converted to the mathematical coordinate system, and the real scene interface and the mathematical interface are combined in the mathematical coordinate system. On the one hand, compared with the prior art, since the method and device, the computer program and the storage medium of the present invention use the acquired real-life interface as part of the program interface, the calculation amount generated by the program interface can be reduced. The effect of saving the resource overhead of the terminal; on the other hand, the invention organically combines the real-life interface and the mathematical interface, and can achieve the realistic effect of the program interface picture.
显然， 本领域的技术人员可以对本发明进行各种改动和变型而不脱离本 发明的精神和范围。 这样， 倘若本发明的这些修改和变型属于本发明权利要 求及其等同技术的范围之内， 则本发明也意图包含这些改动和变型在内。
It is apparent that those skilled in the art can make various modifications and variations to the invention without departing from the spirit and scope of the invention. Thus, it is intended that the present invention cover the modifications and variations of the inventions
Claims
1、 一种应用程序中程序界面的实现方法， 其特征在于， 包括： 根据获取到的实景图像构造实景界面， 并建立实景界面的实景坐标系； 根据数学图像构造数学界面， 并建立数学界面的数学坐标系； A method for implementing a program interface in an application, comprising: constructing a real scene interface according to the acquired real scene image, and establishing a real scene coordinate system of the real scene interface; constructing a mathematical interface according to the mathematical image, and establishing a mathematical interface Mathematical coordinate system;
建立所述实景坐标系和所述数学坐标系的绑定关系； Establishing a binding relationship between the real coordinate system and the mathematical coordinate system;
根据所述绑定关系， 计算出所述实景坐标系的实景界面在所述数学坐标 系中的位置； Calculating, according to the binding relationship, a position of the real scene interface of the real coordinate system in the mathematical coordinate system;
在数学坐标系中， 将所述实景界面与数学界面结合生成程序界面。 In the mathematical coordinate system, the real scene interface is combined with the mathematical interface to generate a program interface.
2、 如权利要求 1所述的方法， 其特征在于， 建立所述实景坐标系和所述 数学坐标系的绑定关系， 具体包括： The method of claim 1, wherein the binding relationship between the real-world coordinate system and the mathematical coordinate system is established, which specifically includes:
确定所述实景坐标系的原点在所述数学坐标系的坐标为 O(P, g)； Determining that the origin of the real coordinate system is in the coordinate of the mathematical coordinate system is O(P, g);
确定所述实景坐标系的 '轴到所述数学坐标系的 X轴顺时针夹角 Θ; 所述根据所述绑定关系， 计算出位于所述实景坐标系的实景界面在所述 数学坐标系中的位置， 具体包括： Determining an X axis of the real coordinate system to an X axis clockwise angle Θ of the mathematical coordinate system; and calculating, according to the binding relationship, a real scene interface located in the real coordinate system in the mathematical coordinate system The location in the specific includes:
确定实景界面中点 P在所述实景坐标系中的坐标为 Ρ(χ', ;>； Determining the coordinates of the point P in the real scene interface in the real scene interface is Ρ(χ', ;>;
通过坐标变换， 计算所述点 P在所述数学坐标系中的坐标 P(X, J 为 Calculating the coordinate P(X, J of the point P in the mathematical coordinate system by coordinate transformation
CosO SinO 0 CosO SinO 0
-Sin0 CosO 0 -Sin0 CosO 0
P q 1 P q 1
3、 如权利要求 1或 2所述的方法， 其特征在于， 还包括： 当所述数学界 面相对实景界面发生位移时， 重新建立所述实景坐标系与所述数学坐标系的 绑定关系。 3. The method of claim 1 or 2, further comprising: re-establishing a binding relationship between the real-world coordinate system and the mathematical coordinate system when the mathematical interface is displaced relative to the real-world interface.
4、 如权利要求 1或 2所述的方法， 其特征在于， 还包括： 当所述实景界面发生变化时， 计算当前所述实景界面与上一帧实景界面 之间的相对位移； The method according to claim 1 or 2, further comprising: calculating a relative displacement between the current real scene interface and the previous frame real scene interface when the real scene interface changes;
在所述数学坐标中， 根据计算出的所述实景界面与上一帧实景界面的相 对位移， 将所述数学界面移动到对应位置。 In the mathematical coordinate, the mathematical interface is moved to a corresponding position according to the calculated relative displacement of the real scene interface and the previous frame real scene interface.
5、 如权利要求 4所述的方法， 其特征在于， 所述计算所述实景界面与上 一帧实景界面的相对位移， 具体包括： The method according to claim 4, wherein the calculating the relative displacement between the real scene interface and the real frame interface of the previous frame comprises:
将所述实景界面与上一帧实景界面分为 16x16个小块； Dividing the real scene interface and the previous frame real scene interface into 16×16 small blocks;
选取所述实景界面中的 N个小块，分别计算选取的 N个小块中每个小块 与上一帧实景界面中的每个小块之间的相对位移； Selecting N small blocks in the real scene interface, respectively calculating a relative displacement between each of the selected N small blocks and each small block in the real frame interface of the previous frame;
基于下述公式计算所述实景界面与上一帧实景界面的相对位移 D: Calculating the relative displacement of the real scene interface and the previous frame real scene interface based on the following formula D:
D ∑:——A D ∑:——A
N ， N,
其中， 表征为所述 N个小块中第 n小块与上一帧实景界面中第 n小 块之间的相对位移,所述 n的取值范围为 [1-N]。 The representation is the relative displacement between the nth small block of the N small blocks and the nth small block in the real frame interface of the previous frame, and the value of the n is [1-N].
6、 一种应用程序中程序界面的实现装置， 其特征在于， 包括： 实景模块， 用于根据获取到的实景图像构造实景界面， 并建立实景界面 的实景坐标系； An apparatus for implementing a program interface in an application, comprising: a real scene module, configured to construct a real scene interface according to the acquired real scene image, and establish a real scene coordinate system of the real scene interface;
数学模块， 用于根据数学图像构造数学界面， 并建立数学界面的数学坐 标系； a math module for constructing a mathematical interface from a mathematical image and establishing a mathematical coordinate system of the mathematical interface;
绑定模块， 用于建立所述实景坐标系和所述数学坐标系的绑定关系； 计算模块， 用于根据所述绑定关系， 计算出所述实景坐标系的实景界面 在所述数学坐标系中的位置； a binding module, configured to establish a binding relationship between the real coordinate system and the mathematical coordinate system; a calculation module, configured to calculate, according to the binding relationship, a real scene interface of the real coordinate system at the mathematical coordinate Location in the system;
程序界面生成模块， 用于在数学坐标系中， 将所述实景界面与数学界面 结合生成程序界面。 The program interface generating module is configured to combine the real scene interface and the mathematical interface to generate a program interface in a mathematical coordinate system.
7、 如权利要求 6所述的装置， 其特征在于， 所述绑定模块， 具体包括： 确定原点坐标子模块， 用于确定所述实景坐标系的原点在所述数学坐标 系的坐标为 O(A g) ; The device according to claim 6, wherein the binding module specifically includes: determining an origin coordinate submodule, configured to determine that an origin of the real coordinate system is in a coordinate of the mathematical coordinate system (A g);
确定夹角子模块，用于确定所述实景坐标系的 ^ '轴到所述数学坐标系的 X 轴顺时针夹角 Θ; Determining an angle sub-module for determining a clockwise angle of the ^ 'axis of the real coordinate system to the X axis of the mathematical coordinate system;
所述计算模块， 包括： 确定坐标子模块， 用于确定实景界面中点 P在所述实景坐标系中的坐标 为 P(x ', y '"T, The calculation module includes: Determining a coordinate sub-module for determining that the coordinates of the point P in the real-world coordinate system in the real-time interface are P(x ', y '"T,
坐标转换子模块， 用于通过坐标变换， 计算所述点 P在所述数学坐标系 中的坐标 Ρ(χ, 为 P(X，J a coordinate conversion submodule, configured to calculate a coordinate of the point P in the mathematical coordinate system by coordinate transformation χ(χ, is P(X, J)
8、 如权利要求 6或 7所述的装置， 其特征在于， 所述绑定模块， 还用于 当所述数学界面相对实景界面发生位移时， 重新建立所述实景坐标系与所述 数学坐标系的绑定关系。 The device according to claim 6 or 7, wherein the binding module is further configured to re-establish the real-frame coordinate system and the mathematical coordinate when the mathematical interface is displaced from the real-life interface. The binding relationship of the system.
9、 如权利要求 6或 7所述的装置， 其特征在于， 还包括： The device according to claim 6 or 7, further comprising:
位移计算模块， 用于当所述实景界面发生变化时， 计算当前所述实景界 面与上一帧实景界面之间的相对位移； a displacement calculation module, configured to calculate a relative displacement between the current real scene interface and a real frame of the previous frame when the real scene interface changes;
移动模块， 用于在所述数学坐标中， 根据计算出的所述实景界面与上一 帧实景界面的相对位移， 将所述数学界面移动到对应位置。 And a movement module, configured to move the mathematical interface to the corresponding position according to the calculated relative displacement of the real scene interface and the real frame interface of the previous frame in the mathematical coordinates.
10、 如权利要求 11所述的装置， 其特征在于， 所述位移计算模块， 具体 包括： The apparatus of claim 11, wherein the displacement calculation module comprises:
图像分块子模块， 用于将所述实景界面与上一帧实景界面分为 16x 16个 小块； An image blocking sub-module, configured to divide the real-view interface and the previous frame real-time interface into 16×16 small blocks;
位移计算子模块， 用于选取所述实景界面中的 N个小块， 分别计算选取 的 N个小块中每个小块与上一帧实景界面中的每个小块之间的相对位移； 基 于下述公式计算所述实景界面与上一帧实景界面的相对位移 D: 
其中， 表征为所述 N个小块中第 n小块与上一帧实景界面中第 n小块之 间的相对位移，所述 n的取值范围为 [1-N]。 a displacement calculation submodule, configured to select N small blocks in the real scene interface, and respectively calculate a relative displacement between each of the selected N small blocks and each small block in the real frame interface of the previous frame; Calculating the relative displacement D of the real scene interface and the previous frame real scene interface based on the following formula: The representation is a relative displacement between the nth small block of the N small blocks and the nth small block in the real frame interface of the previous frame, where the value of n ranges from [1-N].
11、 一种包括指令的计算机程序， 所述指令在由处理器执行时被设置成 使所述处理器执行如权利要求 1-5中任一项所述的方法。 种存储了如权利要求 11所述计 11. A computer program comprising instructions, which when executed by a processor, are arranged to cause the processor to perform the method of any of claims 1-5. Stored as claimed in claim 11
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011102224836A CN102915234A (en) | 2011-08-04 | 2011-08-04 | Method and device for realizing program interface in application program |
| CN201110222483.6 | 2011-08-04 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2013017046A1 true WO2013017046A1 (en) | 2013-02-07 |
Family
ID=47613610
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2012/079271 WO2013017046A1 (en) | 2011-08-04 | 2012-07-27 | Method and device for implementing program interface in application, computer program and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN102915234A (en) |
| WO (1) | WO2013017046A1 (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10904906B2 (en) | 2017-09-15 | 2021-01-26 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for transmitting data, terminal device and network device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101261730A (en) * | 2007-03-06 | 2008-09-10 | 阮伟 | Video digitalized large-scale imaging method |
| CN101729739A (en) * | 2009-11-16 | 2010-06-09 | 潘林岭 | Method for rectifying deviation of image |
| CN101907459A (en) * | 2010-07-12 | 2010-12-08 | 清华大学 | Monocular video based real-time posture estimation and distance measurement method for three-dimensional rigid body object |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1157650C (en) * | 2001-01-16 | 2004-07-14 | 郭方红 | System and method for inputting coordinate and control information to computer |
| CN100470452C (en) * | 2006-07-07 | 2009-03-18 | 华为技术有限公司 | Method and system for implementing three-dimensional enhanced reality |
| US8634604B2 (en) * | 2008-05-05 | 2014-01-21 | Sonavation, Inc. | Method and system for enhanced image alignment |
| JP4978575B2 (en) * | 2008-06-25 | 2012-07-18 | 富士通株式会社 | Image coding method and image coding program in thin client system |
| US8803951B2 (en) * | 2010-01-04 | 2014-08-12 | Disney Enterprises, Inc. | Video capture system control using virtual cameras for augmented reality |
| CN101951464A (en) * | 2010-05-19 | 2011-01-19 | 上海稳像信息技术有限公司 | Real-time video image stabilizing method based on integral image characteristic block matching |
| CN102110379A (en) * | 2011-02-22 | 2011-06-29 | 黄振强 | Multimedia reading matter giving readers enhanced feeling of reality |
-
2011
- 2011-08-04 CN CN2011102224836A patent/CN102915234A/en active Pending
-
2012
- 2012-07-27 WO PCT/CN2012/079271 patent/WO2013017046A1/en active Application Filing
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101261730A (en) * | 2007-03-06 | 2008-09-10 | 阮伟 | Video digitalized large-scale imaging method |
| CN101729739A (en) * | 2009-11-16 | 2010-06-09 | 潘林岭 | Method for rectifying deviation of image |
| CN101907459A (en) * | 2010-07-12 | 2010-12-08 | 清华大学 | Monocular video based real-time posture estimation and distance measurement method for three-dimensional rigid body object |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10904906B2 (en) | 2017-09-15 | 2021-01-26 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Method for transmitting data, terminal device and network device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102915234A (en) | 2013-02-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR102590841B1 (en) | virtual object driving Method, apparatus, electronic device, and readable storage medium | |
| CN111465962B (en) | Depth of motion for augmented reality of handheld user device | |
| US10026230B2 (en) | Augmented point cloud for a visualization system and method | |
| US8988435B1 (en) | Deforming a skin representation using muscle geometries | |
| JP2024505995A (en) | Special effects exhibition methods, devices, equipment and media | |
| US20090243957A1 (en) | Systems and methods for information visualization in multi-display environments | |
| KR20090087807A (en) | Method for implementing augmented reality | |
| CN109754464B (en) | Method and apparatus for generating information | |
| JP7277548B2 (en) | SAMPLE IMAGE GENERATING METHOD, APPARATUS AND ELECTRONIC DEVICE | |
| CN114494328B (en) | Image display method, device, electronic equipment and storage medium | |
| WO2024016930A1 (en) | Special effect processing method and apparatus, electronic device, and storage medium | |
| CN115810101A (en) | Three-dimensional model stylizing method and device, electronic equipment and storage medium | |
| CN110570357A (en) | mirror image implementation method, device, equipment and storage medium based on UE4 engine | |
| JP7477596B2 (en) | Method, depth estimation system, and computer program for depth estimation | |
| WO2024109646A1 (en) | Image rendering method and apparatus, device, and storage medium | |
| US11706395B2 (en) | Apparatus and method for selecting camera providing input images to synthesize virtual view images | |
| WO2023231926A1 (en) | Image processing method and apparatus, device, and storage medium | |
| WO2024027820A1 (en) | Image-based animation generation method and apparatus, device, and storage medium | |
| US9460549B2 (en) | Method and device for generating perspective image | |
| CN109584148A (en) | A kind of method and apparatus handling two-dimentional interface in VR equipment | |
| CN114067030A (en) | Dynamic fluid effect processing method and device, electronic equipment and readable medium | |
| CN115619986B (en) | Scene roaming method, device, equipment and medium | |
| TWI694355B (en) | Tracking system, tracking method for real-time rendering an image and non-transitory computer-readable medium | |
| WO2013017046A1 (en) | Method and device for implementing program interface in application, computer program and storage medium | |
| US20230154102A1 (en) | Representing 3d shapes with probabilistic directed distance fields |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12819682 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 12819682 Country of ref document: EP Kind code of ref document: A1 |