CN110996119A - AR communication method and device for intelligent recall information - Google Patents
AR communication method and device for intelligent recall information Download PDFInfo
- Publication number
- CN110996119A CN110996119A CN201911200141.7A CN201911200141A CN110996119A CN 110996119 A CN110996119 A CN 110996119A CN 201911200141 A CN201911200141 A CN 201911200141A CN 110996119 A CN110996119 A CN 110996119A
- Authority
- CN
- China
- Prior art keywords
- information
- terminal
- point
- user
- multimedia
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 42
- 238000004891 communication Methods 0.000 title claims abstract description 39
- 230000005540 biological transmission Effects 0.000 claims description 2
- 230000015654 memory Effects 0.000 abstract description 23
- 238000005516 engineering process Methods 0.000 abstract description 8
- 230000003190 augmentative effect Effects 0.000 abstract description 5
- 230000010365 information processing Effects 0.000 abstract description 2
- 230000006870 function Effects 0.000 description 12
- 238000010586 diagram Methods 0.000 description 10
- 238000004590 computer program Methods 0.000 description 9
- 230000008569 process Effects 0.000 description 5
- 230000003287 optical effect Effects 0.000 description 3
- 238000004422 calculation algorithm Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/231—Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/10—File systems; File servers
- G06F16/17—Details of further file system functions
- G06F16/176—Support for shared access to files; File sharing support
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/261—Image signal generators with monoscopic-to-stereoscopic image conversion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/275—Image signal generators from 3D object models, e.g. computer-generated stereoscopic image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
- H04N21/2335—Processing of audio elementary streams involving reformatting operations of audio signals, e.g. by converting from one coding standard to another
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
- H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
- H04N21/2355—Processing of additional data, e.g. scrambling of additional data or processing content descriptors involving reformatting operations of additional data, e.g. HTML pages
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
- H04N21/4355—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream involving reformatting operations of additional data, e.g. HTML pages on a television screen
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
- H04N21/47205—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/816—Monomedia components thereof involving special video data, e.g 3D video
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application provides an AR communication method and device for intelligently recalling information, and relates to the technical field of AR information processing. The method comprises the following steps: the terminal responds to a multimedia editing request of a user, provides a multimedia information editing control and receives scene recall information edited by the user through the information editing control; binding the scene recall information with terminal position information to generate AR information points; receiving a shared directory specified by a user, the shared directory including numbers of one or more shared terminals capable of displaying the AR information points at the terminal locations; and sending the AR information point and the shared directory to a server. According to the method and the device, the memories can be reserved in the places where the memories occur, the scene memory information stored in the places where the memories occur is digitally displayed through the augmented reality technology, the user can record, store, share and display the scene memory information through AR information points, and user experience is improved.
Description
Technical Field
The application belongs to the technical field of AR information processing, and particularly relates to an AR communication method and device for intelligently recalling information.
Background
At present, with the improvement of life quality, tourism has become an essential part in the life of people. After busy work, the travel can relax the body and mind, widen the eyes, wash the mind and know the customs in various places. After a happy trip, most people want to record the good memories during the trip, such as writing a travel note or taking a picture, recording a video, etc., to record the information during the trip, and share the information to their relatives and friends.
However, it is very troublesome to complete a complete travel note, even for video and image information, in the process of classifying photos, hundreds or thousands of photos are always left out, and a lot of time is needed for classification.
The above-described information-memorizing method is often used after a trip, and the recorded memory information is stored in the user's own hand and cannot be stored in the place where the memory is generated, and there are some undeniable phenomena that damage is caused to the environment and the ancient writing, and a memory generated in a certain place is recorded in the local place by, for example, "go to the trip". Therefore, there is an urgent need for a technique that can leave memories in places where memories are generated so that they can be seen in a real scene when passing through a home where they have been living, passing through a place where they have been working, or passing through streets where they have been frequently taken.
Disclosure of Invention
In order to solve at least one of the above technical problems, the present application provides an AR communication method and an AR communication device for intelligently recalling information, where a scene is stored in an intelligent mobile device in a digital multimedia form, and then the information is bound with a place of a real scene to form a multimedia recall point, which is stored in a database. After the location of the intelligent mobile device end of the user is detected through the algorithm, the multimedia recall point is displayed in a preset visual range in an augmented reality mode, and then the screen of the intelligent mobile device end is used for obtaining and attaching the multimedia recall point, so that the same-location different-time communication of the recall information is realized based on the AR technology.
In a first aspect of the present application, an AR communication method for intelligently recalling information is applied to a terminal, and the method includes: responding to a multimedia editing request of a user, providing a multimedia information editing control, and receiving scene recall information edited by the user through the information editing control; binding the scene recall information with terminal position information to generate AR information points; receiving a shared directory specified by a user, the shared directory including numbers of one or more shared terminals capable of displaying the AR information points at the terminal locations; and sending the AR information point and the shared directory to a server.
Preferably, the binding the scene recall information and the terminal location information includes: the method comprises the steps of obtaining position information of a terminal through a terminal positioning program, wherein the positioning program comprises but is not limited to GPS and WIFI, and the position information comprises longitude and latitude information and height information.
Preferably, the providing the multimedia information editing control comprises: responding to a multimedia editing request of a user, and giving a plurality of input controls related to terminal hardware; and calling corresponding hardware equipment with an information acquisition function to acquire information according to the input control selected by the user, wherein the acquired information comprises video information, audio information, image information or character information.
In a second aspect of the present application, an AR communication method for intelligently recalling information is applied to a server, and the method includes: receiving and storing an AR information point and a shared directory which are sent by a first terminal for creating scene recall information; determining whether a terminal number of a second terminal for displaying scene recall information is located in the shared directory, if so, setting the AR information point to be visible to the second terminal; and judging whether the AR information point is positioned in the visible range of the second terminal, if so, sending the AR information point to the second terminal.
Preferably, the determining whether the AR information point is located within a visible range of the second terminal includes: acquiring the position information of a second terminal; determining whether the distance between the AR information point and the second terminal is within a preset distance according to the bound coordinate point in the AR information point; and if so, sending the AR information point to the second terminal, and loading the AR information point by the second terminal according to the screen orientation of the second terminal.
This application third aspect, an intelligent AR communication device who recalls information, includes the terminal, the terminal includes: the information editing module is used for responding to a multimedia editing request of a user, providing a multimedia information editing control and receiving scene recall information edited by the user through the information editing control; the AR information point generating module is used for binding the scene recall information with the terminal position information to generate AR information points; a sharing editing module for receiving a sharing directory specified by a user, the sharing directory including numbers of one or more sharing terminals capable of displaying the AR information points at the terminal positions; and the information uploading module is used for sending the AR information points and the shared directory to a server.
Preferably, the system further comprises a positioning module, configured to acquire the location information of the terminal before the scene recall information is bound with the location information of the terminal, where the positioning module includes, but is not limited to, GPS and WIFI, and the location information includes latitude and longitude information and altitude information.
Preferably, the information editing module includes: the input control calling unit is used for responding to a multimedia editing request of a user and giving a plurality of input controls related to the terminal hardware; and the input hardware calling unit is used for calling corresponding hardware equipment with an information acquisition function to acquire information according to the input control selected by the user, wherein the acquired information comprises video information, audio information, image information or character information.
In a fourth aspect of the present application, an AR communication device for intelligently recalling information includes a server, the server includes: the AR information point storage module is used for receiving and storing the AR information points and the shared directory which are sent by the first terminal for creating the scene recall information; the shared terminal identification module is used for determining whether a terminal number of a second terminal for displaying scene recall information is located in the shared directory, and if so, setting the AR information point to be visible to the second terminal; and the AR information point sending module is used for judging whether the AR information point is positioned in the visible range of the second terminal, and if so, sending the AR information point to the second terminal.
Preferably, the AR information point transmission module includes: a second terminal position information acquiring unit for acquiring position information of a second terminal; the information sending unit is used for determining whether the distance between the AR information point and the second terminal is within a preset distance according to the bound coordinate point in the AR information point; and if so, sending the AR information point to the second terminal, and loading the AR information point by the second terminal according to the screen orientation of the second terminal.
According to the method and the device, the memories can be reserved in the places where the memories occur, the scene memory information stored in the places where the memories occur is digitally displayed through the augmented reality technology, the user can record, store, share and display the scene memory information through AR information points, and user experience is improved.
Drawings
Fig. 1 is a flowchart of an embodiment of an AR communication method for intelligently recalling information, which is applied to a terminal.
Fig. 2 is a terminal interface diagram of editing recall points according to the embodiment shown in fig. 1 of the present application.
Fig. 3 is a flowchart of an embodiment of the AR communication method for intelligently recalling information, which is applied to the server side.
Fig. 4 is a terminal interface diagram of loading recall points according to the embodiment shown in fig. 2 of the present application.
Fig. 5 is a terminal architecture diagram of the AR communication device for intelligently recalling information according to the present application.
Fig. 6 is a diagram illustrating a server architecture of an AR communication device for intelligently recalling information according to the present application.
Detailed Description
In order to make the implementation objects, technical solutions and advantages of the present application clearer, the technical solutions in the embodiments of the present application will be described in more detail below with reference to the accompanying drawings in the embodiments of the present application. In the drawings, the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The described embodiments are some, but not all embodiments of the present application. The embodiments described below with reference to the drawings are exemplary and intended to be used for explaining the present application, and should not be construed as limiting the present application. All other embodiments obtained by a person of ordinary skill in the art without any inventive work based on the embodiments in the present application are within the scope of protection of the present application. Embodiments of the present application will be described in detail below with reference to the drawings.
The application provides an AR communication method and device for intelligent recall information, wherein scenes are stored in an intelligent mobile device in a digital multimedia mode, and then the information is bound with places of actual scenes to form multimedia recall points which are stored in a database.
After the location of the user intelligent mobile device end is detected through an algorithm based on the AR technology, the multimedia recall point is displayed in a preset visual range in an augmented reality mode, and the screen of the intelligent mobile device end is used for obtaining and attaching the multimedia recall point.
The AR (augmented reality) technology is a novel human-computer interaction technology which utilizes a camera, a sensor, real-time calculation and matching technology to superimpose real environment and virtual objects to the same picture or space in real time and exist simultaneously.
As a novel human-computer interface and simulation tool, AR is receiving more and more attention, plays an important role and shows great potential. In an AR implementation based on a computer or terminal display, the real world image captured by a camera is input into the computer or terminal, composited with a virtual scene generated by the computer graphics system, and output to a screen display. Typically, the virtual scene is stored in a remote server and in response to a request from the terminal, the virtual scene is transmitted to the terminal which then loads the virtual scene onto the image of the real world.
The AR communication method for intelligently recalling information comprises a method implemented at a terminal and a method implemented at a server side, wherein the terminal generally refers to mobile portable equipment such as a mobile phone and a tablet with image acquisition and information editing functions, and the server side is equipment which can be in data communication with the terminal and can be used for storing a large amount of data relative to the terminal. The AR communication device capable of intelligently recalling information mainly refers to an app program installed on a terminal and an application program installed on a server side.
According to a first aspect of the present application, an AR communication method for intelligently recalling information is applied to a terminal, as shown in fig. 1, and mainly includes:
step S1, responding to a multimedia editing request of a user, providing a multimedia information editing control, and receiving scene recall information edited by the user through the information editing control;
step S2, binding the scene recall information with terminal position information to generate AR information points;
step S3 of receiving a shared directory specified by a user, the shared directory including numbers of one or more shared terminals capable of displaying the AR information point at the terminal position;
and step S4, sending the AR information points and the shared directory to a server.
The multimedia information editing control of step S1 in the present application generally refers to an image capture control, an audio/video editing control, a text editing control, and the like, and the edited multimedia information includes, but is not limited to, text, image, audio/video information.
Step S2 is preceded by: the method comprises the steps of obtaining position information of a terminal through a terminal positioning program, wherein the positioning program comprises but is not limited to GPS and WIFI, and the position information comprises longitude and latitude information and height information.
It should be noted that, after the multimedia information is edited in step S1, the user selects a fixed location for binding the information, and after carrying the terminal device to the fixed location, selects the location binding key, and the system obtains the geographical location information of the terminal through positioning programs such as GPS or WIFI, and completes the binding program.
In some alternative embodiments, said providing a multimedia information editing control comprises: responding to a multimedia editing request of a user, and giving a plurality of input controls related to terminal hardware; and calling corresponding hardware equipment with an information acquisition function to acquire information according to the input control selected by the user, wherein the acquired information comprises video information, audio information, image information or character information.
It can be understood that the above multimedia information editing is usually immediate information acquisition, that is, information acquisition is performed by calling an image acquisition device or a text and voice input device, and the like, it should be noted that the multimedia information editing can also edit multimedia information, such as a video clip, an information point mark, and the like, besides acquiring information immediately by using information acquisition software and hardware, or calling other existing data, these functions can be designed in an app of a terminal, and can also call other apps through an interface to implement the above video editing function, one example of the multimedia information editing is shown in fig. 2, and this schematic diagram is a terminal interface diagram for editing recall point 1.
In step S2, after the multimedia information is edited and the location information is bound, the terminal stores the generated AR information points, and after the user completes one or more AR information points, the user may send the AR information points to the server through step S4.
In step S3, before uploading the AR information point (to the server), the terminal user needs to specify the access authority of the AR information point, that is, specify which other users (terminals) can access the AR information point, and after clicking the upload button, the terminal pops up a shared directory addition menu, and the user can add friends capable of accessing the AR information point from the friend list, and at the server, each friend corresponds to a terminal number. And the user adds the friend to the accessible list, namely, the sharing terminal number visible to the AR information point in the sharing directory is clarified.
The shared directory may include only one terminal for creating an AR information point by default, and the AR information point may be opened to all persons in a special case.
It should be understood that the permission for the terminal to open the AR information point is selectively added based on the buddy list, and thus, the setting of the permission may refer to the existing personnel management mode, such as grouping the buddies, adding a black list, and so on.
In a second aspect of the present application, an AR communication method for intelligently recalling information is applied to a server, as shown in fig. 3, and mainly includes:
step S5, receiving and storing an AR information point and a shared directory sent by a first terminal for scene recall information creation;
step S6, determining whether a terminal number of a second terminal for displaying scene recall information is located in the shared directory, and if so, setting the AR information point to be visible to the second terminal;
and step S7, judging whether the AR information point is located in the visible range of the second terminal, if so, sending the AR information point to the second terminal.
In some optional embodiments, the step S7 of determining whether the AR information point is located within the visible range of the second terminal includes:
step S71, acquiring the position information of the second terminal;
step S72, determining whether the distance between the AR information point and the second terminal is within a preset distance according to the bound coordinate points in the AR information point; and if so, sending the AR information point to the second terminal, and loading the AR information point by the second terminal according to the screen orientation of the second terminal.
It should be noted that the server is configured to store the AR information point created by the first terminal and provide the stored AR information point to other second terminals, where as described above, the second terminal is the same terminal as the first terminal in a default condition, and the terminal that creates the AR information point can only read the created AR information point.
When the server executes step S6, it is preferable that the server determines whether to send the AR information point to the second terminal according to the position of the second terminal, that is, determines whether the terminal number of the second terminal performing the scene recall information display is located in the shared directory, and if so, sets the AR information point to be visible to the second terminal. It can be understood that, on the premise that the first terminal creates the AR information point and sets the second terminal visible, the server may directly transmit the message that the AR information point is visible to the second terminal, without waiting for the second terminal to reach the vicinity of the location of the AR information point, that is, the server may first send a push message, for example, "your friend xx creates an AR information point shared to your at xx", and after the second terminal reaches the designated location, as shown in fig. 4, the server sends the AR information point to the second terminal.
The process of loading the AR information point by the second terminal is as shown in fig. 4, the app of the second terminal device is started, the AR scene is initialized, and when the orientation and the position of the terminal device are changed, the orientation of the terminal is obtained through the positioning technology of the mobile terminal and the gyroscope according to the position of the terminal device, the position and the height information of the AR information point; then determining the coordinates of the AR information points projected to the screen of the intelligent mobile device (such as a mobile phone) end, and updating the AR information point positions falling in the display range of the screen of the intelligent mobile device (such as the mobile phone) end in real time; when an AR information point in the screen display range is clicked, information contained in the information point is displayed.
In this embodiment, initializing the AR scene according to the location of the terminal device includes: and setting the position of the terminal equipment when the AR is started as the center of the scene, and establishing an AR three-dimensional scene. After an application program (app) of an intelligent mobile device (such as a mobile phone) end is started, a system automatically starts an image acquisition device (such as a mobile phone camera or other acquisition modes set in a background); at this time, the open source AR software package in the corresponding operating system of the smart mobile device (such as a mobile phone) end is automatically triggered to start AR scene initialization: acquiring gyroscope data and GPS data of the mobile phone through app, establishing an AR three-dimensional scene by pointing an x axis to the east, pointing a y axis to the opposite direction of gravity and pointing a z axis to the south according to the gyroscope and GPS data, and finishing initialization by setting the position of the equipment as a (0, 0, 0) point during starting.
In the present application, the visible range in step S7 or the preset distance in step S72 is that after the initialization of the second terminal is completed, the terminal requests the server to obtain an AR information point with the current terminal GPS coordinate as the center and a certain distance (which the server can configure) around as the radius. If the information coordinate submitted by the first terminal is within the distance range, the AR recall point is placed in the corresponding direction and position in the terminal AR scene, and the text, picture, audio or video information associated with the AR recall point is displayed.
A third aspect of the present application provides an AR communication apparatus for intelligently recalling information corresponding to the terminal method, where as shown in fig. 5, the terminal mainly includes: the information editing module is used for responding to a multimedia editing request of a user, providing a multimedia information editing control and receiving scene recall information edited by the user through the information editing control; the AR information point generating module is used for binding the scene recall information with the terminal position information to generate AR information points; a sharing editing module for receiving a sharing directory specified by a user, the sharing directory including numbers of one or more sharing terminals capable of displaying the AR information points at the terminal positions; and the information uploading module is used for sending the AR information points and the shared directory to a server.
In some optional embodiments, the system further includes a positioning module, configured to acquire location information of the terminal before the scene recall information is bound with the location information of the terminal, where the positioning module includes, but is not limited to, GPS and WIFI, and the location information includes latitude and longitude information and altitude information.
In some optional embodiments, the information editing module comprises: the input control calling unit is used for responding to a multimedia editing request of a user and giving a plurality of input controls related to the terminal hardware; and the input hardware calling unit is used for calling corresponding hardware equipment with an information acquisition function to acquire information according to the input control selected by the user, wherein the acquired information comprises video information, audio information, image information or character information.
In a fourth aspect of the present application, there is provided an AR communication apparatus for intelligently recalling information corresponding to the server-side method, as shown in fig. 6, the server includes: the AR information point storage module is used for receiving and storing the AR information points and the shared directory which are sent by the first terminal for creating the scene recall information; the shared terminal identification module is used for determining whether a terminal number of a second terminal for displaying scene recall information is located in the shared directory, and if so, setting the AR information point to be visible to the second terminal; and the AR information point sending module is used for judging whether the AR information point is positioned in the visible range of the second terminal, and if so, sending the AR information point to the second terminal.
In some optional embodiments, the AR information point transmitting module comprises: a second terminal position information acquiring unit for acquiring position information of a second terminal; the information sending unit is used for determining whether the distance between the AR information point and the second terminal is within a preset distance according to the bound coordinate point in the AR information point; and if so, sending the AR information point to the second terminal, and loading the AR information point by the second terminal according to the screen orientation of the second terminal.
In other aspects of the present application, a terminal device includes a processor, a memory, and a computer program stored on the memory and executable on the processor, wherein the processor executes the computer program to implement an AR communication method for intelligently recalling information.
In other aspects of the present application, a readable storage medium stores a computer program which, when executed by a processor, implements the AR communication method for intelligently recalling information as described above. The computer-readable storage medium may be included in the apparatus described in the above embodiment; or may be present separately and not assembled into the device. The computer readable storage medium carries one or more programs which, when executed by the apparatus, process data in the manner described above.
A terminal device, such as a mobile device such as a mobile phone, which is suitable for implementing the embodiments of the present application, includes a Central Processing Unit (CPU) that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) or a program loaded from a storage section into a Random Access Memory (RAM). In the RAM, various programs and data necessary for the operation of the apparatus are also stored. The CPU, ROM, and RAM are connected to each other via a bus. An input/output (I/O) interface is also connected to the bus.
The following components are connected to the I/O interface: an input section including a touch screen, a key, a scan/camera, and the like; an output section including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section including a hard disk and the like; and a communication section including a network interface card such as a LAN card, a modem, or the like. The communication section performs communication processing via a network such as the internet.
In particular, according to embodiments of the present application, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present application include a computer program product comprising a computer program embodied on a computer readable medium, the computer program comprising program code for performing the method illustrated by the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication section, and/or installed from a removable medium. The computer program, when executed by a Central Processing Unit (CPU), performs the above-described functions defined in the method of the present application.
It should be noted that the computer storage media of the present application can be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present application, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In this application, however, a computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present application. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The modules or units described in the embodiments of the present application may be implemented by software or hardware. The modules or units described may also be provided in a processor, the names of which in some cases do not constitute a limitation of the module or unit itself.
The above description is only for the specific embodiments of the present application, but the scope of the present application is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present application should be covered within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.
Claims (10)
1. An AR communication method for intelligently recalling information is applied to a terminal and is characterized by comprising the following steps:
responding to a multimedia editing request of a user, providing a multimedia information editing control, and receiving scene recall information edited by the user through the information editing control;
binding the scene recall information with terminal position information to generate AR information points;
receiving a shared directory specified by a user, the shared directory including numbers of one or more shared terminals capable of displaying the AR information points at the terminal locations;
and sending the AR information point and the shared directory to a server.
2. The AR communication method of intelligent recall information of claim 1 wherein binding the scene recall information with terminal location information prior comprises:
the method comprises the steps of obtaining position information of a terminal through a terminal positioning program, wherein the positioning program comprises but is not limited to GPS and WIFI, and the position information comprises longitude and latitude information and height information.
3. The AR communication method for intelligent recall of information of claim 1 wherein the providing a multimedia information editing control comprises:
responding to a multimedia editing request of a user, and giving a plurality of input controls related to terminal hardware;
and calling corresponding hardware equipment with an information acquisition function to acquire information according to the input control selected by the user, wherein the acquired information comprises video information, audio information, image information or character information.
4. An AR communication method for intelligently recalling information is applied to a server and is characterized by comprising the following steps:
receiving and storing an AR information point and a shared directory which are sent by a first terminal for creating scene recall information;
determining whether a terminal number of a second terminal for displaying scene recall information is located in the shared directory, if so, setting the AR information point to be visible to the second terminal;
and judging whether the AR information point is positioned in the visible range of the second terminal, if so, sending the AR information point to the second terminal.
5. The AR communication method for intelligently recalling information as claimed in claim 4, wherein the determining whether the AR information point is located within a visible range of the second terminal comprises:
acquiring the position information of a second terminal;
determining whether the distance between the AR information point and the second terminal is within a preset distance according to the bound coordinate point in the AR information point; and if so, sending the AR information point to the second terminal, and loading the AR information point by the second terminal according to the screen orientation of the second terminal.
6. An AR communication device capable of intelligently recalling information comprises a terminal, and is characterized in that the terminal comprises:
the information editing module is used for responding to a multimedia editing request of a user, providing a multimedia information editing control and receiving scene recall information edited by the user through the information editing control;
the AR information point generating module is used for binding the scene recall information with the terminal position information to generate AR information points;
a sharing editing module for receiving a sharing directory specified by a user, the sharing directory including numbers of one or more sharing terminals capable of displaying the AR information points at the terminal positions;
and the information uploading module is used for sending the AR information points and the shared directory to a server.
7. The AR communication device of intelligent recall information of claim 6, further comprising a positioning module for obtaining location information of a terminal before binding the scene recall information with location information of the terminal, wherein the positioning module includes but is not limited to GPS and WIFI, and the location information includes latitude and longitude information and altitude information.
8. The AR communication device for intelligently recalling information as recited in claim 6, wherein the information editing module comprises:
the input control calling unit is used for responding to a multimedia editing request of a user and giving a plurality of input controls related to the terminal hardware;
and the input hardware calling unit is used for calling corresponding hardware equipment with an information acquisition function to acquire information according to the input control selected by the user, wherein the acquired information comprises video information, audio information, image information or character information.
9. An AR communication device for intelligently recalling information, comprising a server, wherein the server comprises:
the AR information point storage module is used for receiving and storing the AR information points and the shared directory which are sent by the first terminal for creating the scene recall information;
the shared terminal identification module is used for determining whether a terminal number of a second terminal for displaying scene recall information is located in the shared directory, and if so, setting the AR information point to be visible to the second terminal;
and the AR information point sending module is used for judging whether the AR information point is positioned in the visible range of the second terminal, and if so, sending the AR information point to the second terminal.
10. The AR communication apparatus for intelligently recalling information as claimed in claim 9, wherein said AR information point transmission module comprises:
a second terminal position information acquiring unit for acquiring position information of a second terminal;
the information sending unit is used for determining whether the distance between the AR information point and the second terminal is within a preset distance according to the bound coordinate point in the AR information point; and if so, sending the AR information point to the second terminal, and loading the AR information point by the second terminal according to the screen orientation of the second terminal.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911200141.7A CN110996119A (en) | 2019-11-29 | 2019-11-29 | AR communication method and device for intelligent recall information |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911200141.7A CN110996119A (en) | 2019-11-29 | 2019-11-29 | AR communication method and device for intelligent recall information |
Publications (1)
Publication Number | Publication Date |
---|---|
CN110996119A true CN110996119A (en) | 2020-04-10 |
Family
ID=70088245
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911200141.7A Pending CN110996119A (en) | 2019-11-29 | 2019-11-29 | AR communication method and device for intelligent recall information |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN110996119A (en) |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103002410A (en) * | 2012-11-21 | 2013-03-27 | 北京百度网讯科技有限公司 | Augmented reality method and system for mobile terminals and mobile terminals |
CN106844604A (en) * | 2017-01-17 | 2017-06-13 | 维沃移动通信有限公司 | The information providing method and mobile terminal of electronic map |
CN109325080A (en) * | 2018-07-05 | 2019-02-12 | 桐乡市乌镇人家网络科技股份有限公司 | The display methods of electronic tag, mobile terminal, server on electronic map |
CN109618055A (en) * | 2018-12-25 | 2019-04-12 | 维沃移动通信有限公司 | A kind of position sharing method and mobile terminal |
CN110286773A (en) * | 2019-07-01 | 2019-09-27 | 腾讯科技(深圳)有限公司 | Information providing method, device, equipment and storage medium based on augmented reality |
-
2019
- 2019-11-29 CN CN201911200141.7A patent/CN110996119A/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103002410A (en) * | 2012-11-21 | 2013-03-27 | 北京百度网讯科技有限公司 | Augmented reality method and system for mobile terminals and mobile terminals |
CN106844604A (en) * | 2017-01-17 | 2017-06-13 | 维沃移动通信有限公司 | The information providing method and mobile terminal of electronic map |
CN109325080A (en) * | 2018-07-05 | 2019-02-12 | 桐乡市乌镇人家网络科技股份有限公司 | The display methods of electronic tag, mobile terminal, server on electronic map |
CN109618055A (en) * | 2018-12-25 | 2019-04-12 | 维沃移动通信有限公司 | A kind of position sharing method and mobile terminal |
CN110286773A (en) * | 2019-07-01 | 2019-09-27 | 腾讯科技(深圳)有限公司 | Information providing method, device, equipment and storage medium based on augmented reality |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11566915B2 (en) | Method, device and system for processing a flight task | |
CN111179435B (en) | Augmented reality processing method, device, system, storage medium and electronic equipment | |
US20190279432A1 (en) | Method and device for editing virtual scene, and non-transitory computer-readable storage medium | |
CN106845470B (en) | Map data acquisition method and device | |
CN112074797A (en) | System and method for anchoring virtual objects to physical locations | |
EP3125163A1 (en) | Method and device for flight notification, and method and device for flight setting | |
CN105466414B (en) | The recommendation method and server of a kind of navigation routine | |
CN113806306B (en) | Media file processing method, device, equipment, readable storage medium and product | |
CN114554092A (en) | Equipment control method and device and electronic equipment | |
CN113536063A (en) | Information processing method, device, equipment and storage medium | |
CN110390641B (en) | Image desensitizing method, electronic device and storage medium | |
CN113315924A (en) | Image special effect processing method and device | |
US20240220081A1 (en) | Template selection method, electronic device and non-transitory computer-readable storage medium | |
JP6617547B2 (en) | Image management system, image management method, and program | |
CN113190307A (en) | Control adding method, device, equipment and storage medium | |
CN110969704A (en) | Marker generation tracking method and device based on AR guide | |
CN110942521A (en) | AR information point display method and device | |
CN110996119A (en) | AR communication method and device for intelligent recall information | |
CN105204718A (en) | Information processing method and electronic equipment | |
CN115082368A (en) | Image processing method, device, equipment and storage medium | |
CN110992859B (en) | Advertising board display method and device based on AR guide | |
US10165019B2 (en) | Shared experience information construction system | |
CN116349220A (en) | Real-time video editing | |
CN116136876A (en) | Video recommendation processing method and device and electronic equipment | |
CN114827060A (en) | Interaction method and device and electronic equipment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200410 |
|
RJ01 | Rejection of invention patent application after publication |