CN108052277A - A kind of AR positioning learning methods and device - Google Patents

A kind of AR positioning learning methods and device Download PDF

Info

Publication number
CN108052277A
CN108052277A CN201711335705.9A CN201711335705A CN108052277A CN 108052277 A CN108052277 A CN 108052277A CN 201711335705 A CN201711335705 A CN 201711335705A CN 108052277 A CN108052277 A CN 108052277A
Authority
CN
China
Prior art keywords
image information
information
input
image
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201711335705.9A
Other languages
Chinese (zh)
Inventor
李国俊
罗鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Edward Interconnected Network Co Ltd
Original Assignee
Shenzhen Edward Interconnected Network Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Edward Interconnected Network Co Ltd filed Critical Shenzhen Edward Interconnected Network Co Ltd
Priority to CN201711335705.9A priority Critical patent/CN108052277A/en
Publication of CN108052277A publication Critical patent/CN108052277A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0489Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using dedicated keyboard keys or combinations thereof
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B15/00Teaching music
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/0053Computers, e.g. programming
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00Simulators for teaching or training purposes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Engineering & Computer Science (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Data Mining & Analysis (AREA)
  • Computer Hardware Design (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Artificial Intelligence (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Evolutionary Computation (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Electrically Operated Instructional Devices (AREA)

Abstract

The present invention provides a kind of AR positioning learning methods and devices, are related to technical field of information processing, the described method includes:The first image information is obtained, described first image information is real world images information;The second image information is obtained, second image information is template image information;Described first image information is matched with second image information;According to AR location algorithms, described first image information, second image information, the 3rd image information is determined;Wherein, the 3rd image information display is on the display device.The technical issues of solve needs the long period due to learning various keyboard in the prior art, and process is dry as dust, and learning difficulty is larger, has reached trick sync instruction, has greatly reduced the technique effect of learning difficulty.

Description

A kind of AR positioning learning methods and device
Technical field
The present invention relates to technical field of information processing more particularly to a kind of AR positioning learning methods and devices.
Background technology
At present, work, many things with human-computer interaction behavior can be contacted in learning process, come improve work efficiency or Person enriches free life, such as the habit of the input of computor-keyboard, piano study or other musical instruments is played.
But present inventor during inventive technique scheme, has found above-mentioned technology extremely in the embodiment of the present application is realized It has the following technical problems less:
Need the long period due to learning various keyboard in the prior art, learning process is dry as dust, learning difficulty compared with Greatly.
The content of the invention
An embodiment of the present invention provides a kind of AR positioning learning methods and devices, solve numerous due to learning in the prior art The technical issues of more keyboards needs the long period, and process is dry as dust, and learning difficulty is larger has reached trick sync instruction, Greatly reduce the technique effect of learning difficulty.
In view of the above problems, it is proposed that the embodiment of the present application positions learning method and device in order to provide a kind of AR.
In a first aspect, the present invention provides a kind of AR to position learning method, facility for study, the AR are positioned applied to an AR Positioning facility for study includes a display device and an input equipment, the described method includes:Obtain the first image information, described first Image information is real world images information;The second image information is obtained, second image information is template image information;By described in First image information is matched with second image information;According to AR location algorithms, described first image information, described Two image informations determine the 3rd image information;Wherein, the 3rd image information display is on the display device.
Preferably, it is described according to AR location algorithms, described first image information, second image information, determine the 3rd Image information specifically includes:By described first image information compared with second image information, coordinate ratio is obtained; According to described first image information, the first coordinate is obtained;According to the coordinate ratio and first coordinate, obtain second and sit Mark;According to described first image information and second coordinate, the 3rd image information is determined.
Preferably, second image information has the first coding information, first coding information and second figure As information match.
Preferably, the method further includes:The first input information is obtained, the first input information is to pass through the input The information of equipment input;According to first coding information, the first input information, whether the first input information is judged Correctly.
Preferably, it is described according to first coding information, it is described first input information, judge it is described first input information It is whether correct, it specifically includes:If the first input information matches with first coding information, the first input letter Breath is correct;If the first input information is mismatched with first coding information, the first input information errors.
Preferably, the method further includes:If the first input information is correct, the 3rd image information display is defeated Enter correct;If the first input information errors, the 3rd image information display input error.
Second aspect, the present invention provides a kind of AR to position learning device, and described device includes:
First obtains unit, for obtaining the first image information, described first image information is the first obtains unit Real world images information;
Second obtaining unit, for obtaining the second image information, second image information is second obtaining unit Template image information;
First matching unit, first matching unit are used for described first image information and second image information It is matched;
First determination unit, first determination unit are used for according to AR location algorithms, described first image information, described Second image information determines the 3rd image information;Wherein, the 3rd image information display is on the display device.
Preferably, described device further includes:
3rd obtaining unit, the 3rd obtaining unit are used for described first image information and second image information It is compared, obtains coordinate ratio;
4th obtaining unit, the 4th obtaining unit are used to, according to described first image information, obtain the first coordinate;
5th obtaining unit, the 5th obtaining unit are used to, according to the coordinate ratio and first coordinate, obtain Second coordinate;
Second determination unit, second determination unit are used for according to described first image information and second coordinate, Determine the 3rd image information.
Preferably, described device further includes:
Second matching unit, second matching unit have the first coding information, institute for second image information The first coding information is stated with second image information to match.
Preferably, described device further includes:
6th obtaining unit, for obtaining the first input information, the first input information is the 6th obtaining unit The information inputted by the input equipment;
First judging unit, first judging unit are used to be believed according to first coding information, first input Breath judges whether the first input information is correct.
Preferably, described device further includes:
Second judgment unit, if the second judgment unit is believed for the described first input information and the described first coding Manner of breathing matches, and the first input information is correct;
3rd judging unit, if the 3rd judging unit is believed for the described first input information and the described first coding Breath mismatches, the first input information errors.
Preferably, described device further includes:
First display unit, if first display unit is correct for the described first input information, the 3rd figure As presentation of information input is correct;
Second display unit, if second display unit is for the described first input information errors, the 3rd figure As presentation of information input error.
The third aspect, the present invention provides a kind of computer readable storage mediums, are stored thereon with computer program, the journey Following steps are realized when sequence is executed by processor:The first image information is obtained, described first image information is real world images information; The second image information is obtained, second image information is template image information;By described first image information and described second Image information is matched;According to AR location algorithms, described first image information, second image information, the 3rd figure is determined As information;Wherein, the 3rd image information display is on the display device.
Fourth aspect, the present invention provides a kind of AR to position learning device, including memory, processor and is stored in storage On device and the computer program that can run on a processor, the processor realize following steps when performing described program:It obtains First image information, described first image information are real world images information;Obtain the second image information, second image information For template image information;Described first image information is matched with second image information;According to AR location algorithms, institute The first image information, second image information are stated, determines the 3rd image information;Wherein, the 3rd image information display exists On the display device.
Said one or multiple technical solutions in the embodiment of the present application at least have following one or more technology effects Fruit:
1. a kind of AR positioning learning methods provided by the embodiments of the present application and device, by obtaining the first image information, institute The first image information is stated as real world images information;The second image information is obtained, second image information is template image information; Described first image information is matched with second image information;According to AR location algorithms, described first image information, Second image information, determines the 3rd image information;Wherein, the 3rd image information display is on the display device. Solve needs the long period due to learning various keyboard in the prior art, and process is dry as dust, the larger skill of learning difficulty Art problem has reached trick sync instruction, greatly reduces the technique effect of learning difficulty.
2. the embodiment of the present application is by the way that described first image information compared with second image information, is sat Mark ratio;According to described first image information, the first coordinate is obtained;According to the coordinate ratio and first coordinate, obtain Second coordinate;According to described first image information and second coordinate, the 3rd image information is determined.It further solves The long period is needed due to learning various keyboard in the prior art, the technical issues of process is dry as dust, and learning difficulty is larger, So as to reach the precise positioning to keyboard, each piano key can be navigated to, greatly improve expression effect and mutually The technique effect of dynamic effect.
If the 3, the embodiment of the present application is matched by the described first input information with first coding information, described the One input information is correct;If the first input information is mismatched with first coding information, the first input information Mistake;If the first input information is correct, the 3rd image information display input is correct;If the first input letter Cease mistake, the 3rd image information display input error.It further solves in the prior art due to learning various keyboard The long period is needed, the technical issues of process is dry as dust, and learning difficulty is larger, so as to reach through AR interactive teachings, knot Element of entertainment is closed, drastically increases the interesting technique effect of study piano.
Above description is only the general introduction of technical solution of the present invention, in order to better understand the technological means of the present invention, And can be practiced according to the content of specification, and in order to allow above and other objects of the present invention, feature and advantage can It is clearer and more comprehensible, below the special specific embodiment for lifting the present invention.
Description of the drawings
Fig. 1 is the flow diagram that a kind of AR positions learning method in the embodiment of the present invention;
Fig. 2 is the structure diagram that a kind of AR positions learning device in the embodiment of the present invention;
Fig. 3 is the structure diagram that another kind AR positions learning device in the embodiment of the present invention
Drawing reference numeral explanation:Bus 300, receiver 301, processor 302, transmitter 303, memory 304, bus interface 306。
Specific embodiment
An embodiment of the present invention provides a kind of AR positioning learning methods and device, for solving in the prior art due to learning The technical issues of practising various keyboard needs the long period, and process is dry as dust, and learning difficulty is larger, technology provided by the invention Scheme general thought is as follows:
In the technical solution of the embodiment of the present invention, by obtaining the first image information, described first image information is existing Real image information;The second image information is obtained, second image information is template image information;By described first image information It is matched with second image information;According to AR location algorithms, described first image information, second image information, Determine the 3rd image information;Wherein, the 3rd image information display is on the display device.Reach trick synchronously to teach It learns, greatly reduces learning difficulty and the precise positioning to keyboard, each piano key can be navigated to, greatly improved The technique effect of expression effect and interaction effect.
Technical solution of the present invention is described in detail below by attached drawing and specific embodiment, it should be understood that the application Specific features in embodiment and embodiment are to the detailed description of technical scheme rather than to present techniques The restriction of scheme, in the case where there is no conflict, the technical characteristic in the embodiment of the present application and embodiment can be mutually combined.
The terms "and/or", is only a kind of incidence relation for describing affiliated partner, and expression may have three kinds of passes System, for example, A and/or B, can represent:Individualism A exists simultaneously A and B, these three situations of individualism B.In addition, herein Middle character "/", it is a kind of relation of "or" to typically represent forward-backward correlation object.
Embodiment one
Fig. 1 is the flow diagram that a kind of AR positions learning method in the embodiment of the present invention.As shown in Figure 1,
Facility for study is positioned applied to an AR, the AR positioning facility for study includes a display device and an input equipment, There is image input module, image processing module, memory, signal input module, the input is set inside the input equipment It is standby can with computor-keyboard, piano key or Chinese zither etc. by press either play etc. actions generate output signal or The equipment of sound is attached, and the display device is connected with the input equipment, can be by the computor-keyboard or key The equipment such as the display screen that grade input equipments are shown.The described method includes:
Step 110:The first image information is obtained, described first image information is real world images information;
Specifically, described first image information is the original image information in reality, for example, when people carry out steel When qin learns, the piano key in reality scene is described first image information.Described first image information is defeated by image Enter module to obtain in real time, so as to obtain described first image information.Described first image information includes the characteristic point of real world images The length and width information of things in information and real world images, and described first image information further includes a dynamic image data, example Such as the location information of the hand of learner.
Step 120:Obtain the second image information, second image information is template image information, second image Information has the first coding information, and first coding information matches with second image information;
Specifically, second image information is the template image information prestored in memory, i.e. standard drawing As information, in the pre-stored template image information, thing in characteristic point information and template image including template image The length and width information of object.First coding information is further included, for example, it is assumed that under the application scenarios of study piano, storage A certain amount of exercises for the piano can be stored in device, and first coding information is according to song note in above-mentioned etude The coding of each note of order;It gives one example again, it is assumed that can be under the application scenarios of computor-keyboard study, in memory Some texts that contact typewriting is provided are stored, and first coding information is each input through keyboard according to sequences of text The coding of character.Also, first coding matches with corresponding position in second image information, in other words, if Piano, i.e., the described corresponding key for corresponding note in second image information of first coding;If computor-keyboard, First coding is corresponding for corresponding keyboard in second image.
Step 130:Described first image information is matched with second image information;
Specifically, it is similar with the template image information progress to the real world images information by image processing module Degree extraction, the real world images information is matched with the template image information, when described first image information with it is described Second image information is completely superposed, and as matching is correct.
Step 140:According to AR location algorithms, described first image information, second image information, the 3rd image is determined Information;Wherein, the 3rd image information display is on the display device.
Further, it is described according to AR location algorithms, described first image information, second image information, determine Three image informations, specifically include:By described first image information compared with second image information, coordinate ratio is obtained Example;According to described first image information, the first coordinate is obtained;According to the coordinate ratio and first coordinate, second is obtained Coordinate;According to described first image information and second coordinate, the 3rd image information is determined.
Specifically, the concrete methods of realizing of the AR location algorithms is as follows:Described is extracted by central processing module Characteristic point in one image information and the template image prestored in memory carry out algorithmic match, so establish reality- Virtually (Reality To Virtual) coordinate system, and pass through geometrical relationship and obtain width height of the image in screen.By by institute The high information of width for stating things in the first image information and the high information of width for being stored in advance in things in the original image of memory into Row compares, and obtains real relative coordinate system and virtual image coordinate system proportionate relationship scale=Size (r)/Size (v), i.e. institute State coordinate ratio.It illustrates, it is assumed that in the application scenarios of piano study, according to the coordinate ratio, by real key position It puts and carries out coordinate transform and obtain the position coordinates Pr under virtual coordinate system, above-mentioned reality position of piano key, that is, first coordinate, on It is second coordinate to state the position coordinates under virtual coordinate system, in the case of known real position of piano key, can be obtained Any position of piano key coordinate under virtual image.3rd image information is described first image information and second image The superposition of information can rationally set the size and effect of each superimposed image in virtual image by coordinate transform, so as to Reach reality and be virtually perfectly combined and realize the virtually accurate matched technique effect with real data.
Further, the method further includes:The first input information is obtained, the first input information is by described defeated Enter the information of equipment input;According to first coding information, the first input information, judge that the first input information is It is no correct;If the first input information matches with first coding information, the first input information is correct;If The first input information is mismatched with first coding information, the first input information errors.
Further, if the first input information is correct, the 3rd image information display input is correct;If institute State the first input information errors, the 3rd image information display input error.
For example, it is assumed that in the application scenarios of piano study, the first input information is playing steel for learner During qin, the key information pressed, the signal input module that the key information pressed passes through in the input equipment inputs institute It states in AR positioning learning devices, at this moment, when learner is playing pre-stored etude in memory, described first compiles Code information can be shown on the display device, and learner presses key, input institute according to the prompting of first coding information The first input information is stated, if the first input information matches with the corresponding image information of the first coding information, Then explanation has input correct key, and at this moment, display device can show the correct dynamic effect of input;If first input Information is mismatched with the corresponding image information of first coding information, then explanation has input the key of mistake, at this moment, display Equipment can show the dynamic effect of input error, so as to reach through AR interactive teachings, trick sync instruction, combination with entertainment member Element reduces learning difficulty, improves learning efficiency, and increases the technique effect of study enjoyment.
Embodiment 2
Based on the same inventive concept of learning method is positioned with a kind of AR in previous embodiment, the present invention also provides a kind of AR Learning device is positioned, as shown in Fig. 2, including:
First obtains unit, for obtaining the first image information, described first image information is the first obtains unit Real world images information;
Second obtaining unit, for obtaining the second image information, second image information is second obtaining unit Template image information;
First matching unit, first matching unit are used for described first image information and second image information It is matched;
First determination unit, first determination unit are used for according to AR location algorithms, described first image information, described Second image information determines the 3rd image information;Wherein, the 3rd image information display is on the display device.
Further, described device further includes:
3rd obtaining unit, the 3rd obtaining unit are used for described first image information and second image information It is compared, obtains coordinate ratio;
4th obtaining unit, the 4th obtaining unit are used to, according to described first image information, obtain the first coordinate;
5th obtaining unit, the 5th obtaining unit are used to, according to the coordinate ratio and first coordinate, obtain Second coordinate;
Second determination unit, second determination unit are used for according to described first image information and second coordinate, Determine the 3rd image information.
Further, described device further includes:
Second matching unit, second matching unit have the first coding information, institute for second image information The first coding information is stated with second image information to match.
Further, described device further includes:
6th obtaining unit, for obtaining the first input information, the first input information is the 6th obtaining unit The information inputted by the input equipment;
First judging unit, first judging unit are used to be believed according to first coding information, first input Breath judges whether the first input information is correct.
Further, described device further includes:
Second judgment unit, if the second judgment unit is believed for the described first input information and the described first coding Manner of breathing matches, and the first input information is correct;
3rd judging unit, if the 3rd judging unit is believed for the described first input information and the described first coding Breath mismatches, the first input information errors.
Further, described device further includes:
First display unit, if first display unit is correct for the described first input information, the 3rd figure As presentation of information input is correct;
Second display unit, if second display unit is for the described first input information errors, the 3rd figure As presentation of information input error.
The various change mode and specific example of a kind of AR positioning learning methods in 1 embodiment 1 of earlier figures are equally applicable Learning device is positioned in a kind of AR of the present embodiment, passes through a kind of foregoing detailed description that learning method is positioned to AR, this field Technical staff is clear that a kind of implementation of AR positioning learning device in the present embodiment, so in order to illustrate book Succinctly, this will not be detailed here.
Embodiment 3
Based on the same inventive concept of learning method is positioned with a kind of AR in previous embodiment, the present invention also provides a kind of meters Calculation machine readable storage medium storing program for executing, is stored thereon with computer program, which realizes a kind of AR described previously when being executed by processor The step of positioning the either method of learning method.
Wherein, in figure 3, bus architecture (being represented with bus 300), bus 300 can include any number of interconnection Bus and bridge, bus 300 deposited what the one or more processors including being represented by processor 302 and memory 304 represented The various circuits of reservoir link together.Bus 300 can also will peripheral equipment, voltage-stablizer and management circuit etc. it Various other circuits of class link together, these are all it is known in the art, therefore, no longer being carried out further to it herein Description.Bus interface 306 provides interface between bus 300 and receiver 301 and transmitter 303.Receiver 301 and transmitter 303 can be same element, i.e. transceiver, provide the unit for communicating over a transmission medium with various other devices.
Processor 302 is responsible for bus 300 and common processing, and memory 304 can be used to store processor 302 perform operate when used information.
Said one or multiple technical solutions in the embodiment of the present application at least have following one or more technology effects Fruit:
1. a kind of AR positioning learning methods provided by the embodiments of the present application and device, by obtaining the first image information, institute The first image information is stated as real world images information;The second image information is obtained, second image information is template image information; Described first image information is matched with second image information;According to AR location algorithms, described first image information, Second image information, determines the 3rd image information;Wherein, the 3rd image information display is on the display device. Solve needs the long period due to learning various keyboard in the prior art, and process is dry as dust, the larger skill of learning difficulty Art problem has reached trick sync instruction, greatly reduces the technique effect of learning difficulty.
2. the embodiment of the present application is by the way that described first image information compared with second image information, is sat Mark ratio;According to described first image information, the first coordinate is obtained;According to the coordinate ratio and first coordinate, obtain Second coordinate;According to described first image information and second coordinate, the 3rd image information is determined.It further solves The long period is needed due to learning various keyboard in the prior art, the technical issues of process is dry as dust, and learning difficulty is larger, So as to reach the precise positioning to keyboard, each piano key can be navigated to, greatly improve expression effect and mutually The technique effect of dynamic effect.
If 3. the embodiment of the present application is matched by the described first input information with first coding information, described the One input information is correct;If the first input information is mismatched with first coding information, the first input information Mistake;If the first input information is correct, the 3rd image information display input is correct;If the first input letter Cease mistake, the 3rd image information display input error.It further solves in the prior art due to learning various keyboard The long period is needed, the technical issues of process is dry as dust, and learning difficulty is larger, so as to reach through AR interactive teachings, knot Element of entertainment is closed, drastically increases the interesting technique effect of study piano.
It should be understood by those skilled in the art that, the embodiment of the present invention can be provided as method, system or computer program Product.Therefore, the reality in terms of complete hardware embodiment, complete software embodiment or combination software and hardware can be used in the present invention Apply the form of example.Moreover, the computer for wherein including computer usable program code in one or more can be used in the present invention The computer program production that usable storage medium is implemented on (including but not limited to magnetic disk storage, CD-ROM, optical memory etc.) The form of product.
The present invention be with reference to according to the method for the embodiment of the present invention, the flow of equipment (system) and computer program product Figure and/or block diagram describe.It should be understood that it can be realized by computer program instructions every first-class in flowchart and/or the block diagram The combination of flow and/or box in journey and/or box and flowchart and/or the block diagram.These computer programs can be provided The processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable information processing equipments is instructed to produce A raw machine so that the instruction performed by computer or the processor of other programmable information processing equipments is generated for real The device for the function of being specified in present one flow of flow chart or one box of multiple flows and/or block diagram or multiple boxes.
These computer program instructions, which may also be stored in, can guide computer or other programmable information processing equipments with spy Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to Make the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable information processing equipments so that counted Series of operation steps is performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one The step of function of being specified in a box or multiple boxes.
Obviously, various changes and modifications can be made to the invention without departing from essence of the invention by those skilled in the art God and scope.In this way, if these modifications and changes of the present invention belongs to the scope of the claims in the present invention and its equivalent technologies Within, then the present invention is also intended to comprising including these modification and variations.

Claims (9)

1. a kind of AR positions learning method, facility for study is positioned applied to an AR, the AR positioning facility for study includes a display Equipment and an input equipment, which is characterized in that the described method includes:
The first image information is obtained, described first image information is real world images information;
The second image information is obtained, second image information is template image information;
Described first image information is matched with second image information;
According to AR location algorithms, described first image information, second image information, the 3rd image information is determined;Wherein, institute The 3rd image information display is stated on the display device.
2. the method as described in claim 1, which is characterized in that described according to AR location algorithms, described first image information, institute The second image information is stated, the 3rd image information is determined, specifically includes:
By described first image information compared with second image information, coordinate ratio is obtained;
According to described first image information, the first coordinate is obtained;
According to the coordinate ratio and first coordinate, the second coordinate is obtained;
According to described first image information and second coordinate, the 3rd image information is determined.
3. the method as described in claim 1, which is characterized in that second image information has the first coding information, described First coding information matches with second image information.
4. the method as described in claim 1, which is characterized in that the method further includes:
The first input information is obtained, the first input information is the information inputted by the input equipment;
According to first coding information, the first input information, judge whether the first input information is correct.
5. method as claimed in claim 4, which is characterized in that it is described according to first coding information, it is described first input Information judges whether the first input information is correct, specifically includes:
If the first input information matches with first coding information, the first input information is correct;
If the first input information is mismatched with first coding information, the first input information errors.
6. method as claimed in claim 5, which is characterized in that the method further includes:
If the first input information is correct, the 3rd image information display input is correct;
If the first input information errors, the 3rd image information display input error.
7. a kind of AR positions learning device, which is characterized in that described device includes:
First obtains unit, for the first obtains unit for obtaining the first image information, described first image information is reality Image information;
Second obtaining unit, for second obtaining unit for obtaining the second image information, second image information is template Image information;
First matching unit, first matching unit are used to carry out described first image information and second image information Matching;
First determination unit, first determination unit are used for according to AR location algorithms, described first image information, described second Image information determines the 3rd image information;Wherein, the 3rd image information display is on the display device.
8. a kind of computer readable storage medium, is stored thereon with computer program, which is characterized in that the program is held by processor Following steps are realized during row:
The first image information is obtained, described first image information is real world images information;
The second image information is obtained, second image information is template image information;
Described first image information is matched with second image information;
According to AR location algorithms, described first image information, second image information, the 3rd image information is determined;Wherein, institute The 3rd image information display is stated on the display device.
9. a kind of AR positions learning device, can be run on a memory and on a processor including memory, processor and storage Computer program, which is characterized in that the processor realizes following steps when performing described program:
The first image information is obtained, described first image information is real world images information;
The second image information is obtained, second image information is template image information;
Described first image information is matched with second image information;
According to AR location algorithms, described first image information, second image information, the 3rd image information is determined;Wherein, institute The 3rd image information display is stated on the display device.
CN201711335705.9A 2017-12-14 2017-12-14 A kind of AR positioning learning methods and device Pending CN108052277A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711335705.9A CN108052277A (en) 2017-12-14 2017-12-14 A kind of AR positioning learning methods and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711335705.9A CN108052277A (en) 2017-12-14 2017-12-14 A kind of AR positioning learning methods and device

Publications (1)

Publication Number Publication Date
CN108052277A true CN108052277A (en) 2018-05-18

Family

ID=62132218

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711335705.9A Pending CN108052277A (en) 2017-12-14 2017-12-14 A kind of AR positioning learning methods and device

Country Status (1)

Country Link
CN (1) CN108052277A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109559593A (en) * 2018-12-29 2019-04-02 深圳市掌网科技股份有限公司 A kind of piano training system and method based on mixed reality
CN109657052A (en) * 2018-12-12 2019-04-19 中国科学院文献情报中心 A kind of abstract of a thesis contains the abstracting method and device of fine granularity Knowledge Element
WO2019237766A1 (en) * 2018-06-14 2019-12-19 Sunland Information Technology Co., Ltd. Systems and methods for assisting a user in practicing a musical instrument
CN110706553A (en) * 2019-11-13 2020-01-17 北京音悦荚科技有限责任公司 Musical instrument auxiliary learning system, method and device based on AR augmented reality
CN112037092A (en) * 2020-08-19 2020-12-04 王强 Model-based online education course distribution method and system
CN112085560A (en) * 2020-08-19 2020-12-15 王娟 Intelligent education method and system based on cloud computing
CN112084510A (en) * 2020-08-19 2020-12-15 喻婷婷 Data processing method and system for block chain
WO2022052941A1 (en) * 2020-09-09 2022-03-17 桂林智神信息技术股份有限公司 Intelligent identification method and system for giving assistance with piano teaching, and intelligent piano training method and system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106254848A (en) * 2016-07-29 2016-12-21 宇龙计算机通信科技(深圳)有限公司 A kind of learning method based on augmented reality and terminal
CN106484119A (en) * 2016-10-24 2017-03-08 网易(杭州)网络有限公司 Virtual reality system and virtual reality system input method
CN106527718A (en) * 2016-11-09 2017-03-22 大连文森特软件科技有限公司 AR augmented reality-based musical instrument-assisted play and concerto experience system
CN106845335A (en) * 2016-11-29 2017-06-13 歌尔科技有限公司 Gesture identification method, device and virtual reality device for virtual reality device
CN107168619A (en) * 2017-03-29 2017-09-15 腾讯科技(深圳)有限公司 User-generated content treating method and apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106254848A (en) * 2016-07-29 2016-12-21 宇龙计算机通信科技(深圳)有限公司 A kind of learning method based on augmented reality and terminal
CN106484119A (en) * 2016-10-24 2017-03-08 网易(杭州)网络有限公司 Virtual reality system and virtual reality system input method
CN106527718A (en) * 2016-11-09 2017-03-22 大连文森特软件科技有限公司 AR augmented reality-based musical instrument-assisted play and concerto experience system
CN106845335A (en) * 2016-11-29 2017-06-13 歌尔科技有限公司 Gesture identification method, device and virtual reality device for virtual reality device
CN107168619A (en) * 2017-03-29 2017-09-15 腾讯科技(深圳)有限公司 User-generated content treating method and apparatus

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019237766A1 (en) * 2018-06-14 2019-12-19 Sunland Information Technology Co., Ltd. Systems and methods for assisting a user in practicing a musical instrument
US11417233B2 (en) 2018-06-14 2022-08-16 Sunland Information Technology Co., Lid. Systems and methods for assisting a user in practicing a musical instrument
CN109657052A (en) * 2018-12-12 2019-04-19 中国科学院文献情报中心 A kind of abstract of a thesis contains the abstracting method and device of fine granularity Knowledge Element
CN109657052B (en) * 2018-12-12 2023-01-03 中国科学院文献情报中心 Method and device for extracting fine-grained knowledge elements contained in paper abstract
CN109559593A (en) * 2018-12-29 2019-04-02 深圳市掌网科技股份有限公司 A kind of piano training system and method based on mixed reality
CN110706553A (en) * 2019-11-13 2020-01-17 北京音悦荚科技有限责任公司 Musical instrument auxiliary learning system, method and device based on AR augmented reality
CN112037092A (en) * 2020-08-19 2020-12-04 王强 Model-based online education course distribution method and system
CN112085560A (en) * 2020-08-19 2020-12-15 王娟 Intelligent education method and system based on cloud computing
CN112084510A (en) * 2020-08-19 2020-12-15 喻婷婷 Data processing method and system for block chain
WO2022052941A1 (en) * 2020-09-09 2022-03-17 桂林智神信息技术股份有限公司 Intelligent identification method and system for giving assistance with piano teaching, and intelligent piano training method and system

Similar Documents

Publication Publication Date Title
CN108052277A (en) A kind of AR positioning learning methods and device
JP7253570B2 (en) Contextual in-game element recognition, annotation and interaction based on remote user input
Grammatikopoulou et al. An adaptive framework for the creation of exergames for intangible cultural heritage (ICH) education
Hackl et al. HoloKeys-an augmented reality application for learning the piano.
US20170011722A1 (en) Interactive Performance Direction for a Simultaneous Multi-Tone Instrument
CN111667728B (en) Voice post-processing module training method and device
CN106981282A (en) A kind of piano performance key reminding method and system
CN112818981B (en) Musical instrument playing key position prompting method and device, electronic equipment and storage medium
Sghaier et al. Development of an intelligent system based on metaverse learning for students with disabilities
CN110062290A (en) Video interactive content generating method, device, equipment and medium
KR20100058843A (en) Method and system for teaching hangeul using augmented reality
Torrente et al. Introducing accessibility features in an educational game authoring tool: The< e-Adventure> experience
US11580868B2 (en) AR-based supplementary teaching system for guzheng and method thereof
JP7432127B2 (en) Information processing method, information processing system and program
CN112802439B (en) Performance data identification method, device, equipment and storage medium
Compton et al. Generominos: Ideation cards for interactive generativity
CN115712473A (en) Music score display method and device, electronic equipment and storage medium
KR102251867B1 (en) System and method for providing coding education using star topology in Internet of things
US11393359B2 (en) System to teach mathematics using virtual musical instruments and associated methods
Correa et al. AR musical app for children's musical education
KR102241494B1 (en) METHOD FOR PROVIDING A PHONICS GAME FOR Cognitive Processing Ability Development for Korean DYSLEXIA INTERVENTION SERVICE AND GAME SERVER USING THE SAME
Svane Get your students to SMILE!: Exploring emerging interaction technologies
KR20210082592A (en) Method and system for coding education based on augmented reality
Antoshchuk et al. Creating an interactive musical experience for a concert hall
El Raheb et al. Symbolising space: From notation to movement interaction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180518