CN106202269A - A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal - Google Patents
A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal Download PDFInfo
- Publication number
- CN106202269A CN106202269A CN201610503710.5A CN201610503710A CN106202269A CN 106202269 A CN106202269 A CN 106202269A CN 201610503710 A CN201610503710 A CN 201610503710A CN 106202269 A CN106202269 A CN 106202269A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- reality content
- destination object
- search
- relevant
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/951—Indexing; Web crawling techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/583—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
- G06F16/5854—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using shape and object relationship
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Library & Information Science (AREA)
- Data Mining & Analysis (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses and a kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal.The method includes: identify acquisition for mobile terminal to image in destination object；According to the augmented reality content that the search of described destination object is relevant, wherein, described augmented reality content is the operational approach relevant to described destination object；Show described augmented reality content.Use such scheme can optimize existing search procedure, improve search accuracy rate.
Description
Technical field
The present invention relates to augmented reality field, particularly relate to a kind of obtain the method for augmented reality Operating Guideline, dress
Put and mobile terminal.
Background technology
Augmented reality (Augmented Reality, AR) technology is that the information provided by computer system increases user
Technology to real world perception, by virtual Information application to real world, and by the dummy object of computer generation, scene
Or system prompt information superposition is in real scene, thus realize the enhancing to reality.In the environment of augmented reality, user
Can be around seeing while true environment, it is seen that the enhancing information that computer produces.
At present, user, when searching for manufacture method, is required for being manually entered and demonstrating the method by search engine
Concrete steps are checked for user, but, user's term of possible input error in actual mechanical process makes Search Results
Do not meet being actually needed of user.
Summary of the invention
In view of this, embodiment of the present invention offer is a kind of obtains the method for augmented reality Operating Guideline, device and moves eventually
End, to optimize existing search procedure, improves search accuracy rate.
First aspect, embodiments provides a kind of method obtaining augmented reality Operating Guideline, including:
Identify acquisition for mobile terminal to image in destination object；
According to the augmented reality content that the search of described destination object is relevant, wherein, described augmented reality content is with described
The operational approach that destination object is relevant；
Show described augmented reality content.
Second aspect, the embodiment of the present invention additionally provides a kind of device obtaining augmented reality Operating Guideline, including:
Identification module, for identify acquisition for mobile terminal to image in destination object；
Search module, for the augmented reality content relevant according to the search of described destination object, wherein, described augmented reality
Content is the operational approach relevant to described destination object；
Display module, is used for showing described augmented reality content.
The third aspect, the embodiment of the present invention additionally provides a kind of mobile terminal, and a kind of acquisition the including above-mentioned offer strengthens
The device that real operation instructs.
The a kind of of embodiment of the present invention offer obtains the method for augmented reality Operating Guideline, device and mobile terminal, passes through
Identifying the augmented reality content that the destination object search in the image of acquisition for mobile terminal is relevant, wherein, augmented reality content is
The operational approach relevant to destination object, and show the technological means of augmented reality content in the terminal, user only needs
Obtain the picture of destination object, it is possible to obtain the operational approach being correlated with, improve search accuracy rate, optimize existing search
Technology, and improve the experience of user.
Accompanying drawing explanation
By the detailed description that non-limiting example is made made with reference to the following drawings of reading, other of the present invention
Feature, purpose and advantage will become more apparent upon:
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 1 provides for the embodiment of the present invention one；
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 2 provides for the embodiment of the present invention two；
The first machine interactive interface schematic diagram that Fig. 3 provides for the embodiment of the present invention two；
The second human-computer interaction interface schematic diagram that Fig. 4 provides for the embodiment of the present invention two；
The 3rd human-computer interaction interface schematic diagram that Fig. 5 provides for the embodiment of the present invention two；
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 6 provides for the embodiment of the present invention three；
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 7 provides for the embodiment of the present invention four；
The structural representation of a kind of device obtaining augmented reality Operating Guideline that Fig. 8 provides for the embodiment of the present invention five.
Detailed description of the invention
The present invention is described in further detail with embodiment below in conjunction with the accompanying drawings.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention, rather than limitation of the invention.It also should be noted that, in order to just
Part related to the present invention is illustrate only rather than full content in description, accompanying drawing.
Embodiment one
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 1 provides for the embodiment of the present invention one.This reality
The operating process that the method obtaining augmented reality Operating Guideline that executing example provides is applicable to be actually needed user scans for
Situation.The method obtaining augmented reality Operating Guideline that the present embodiment provides can be by the device obtaining augmented reality Operating Guideline
Performing, this device can be realized by software and/or hardware, and is integrated in the mobile terminal with augmented reality function.
Wherein, the equipment that mobile terminal is held including but not limited to users such as mobile phone, panel computer, digital cameras.
With reference to Fig. 1, the method obtaining augmented reality Operating Guideline that the present embodiment provides specifically includes:
Step 110, identify acquisition for mobile terminal to image in destination object.
In the embodiment of the present invention, destination object is to need to strengthen it according to corresponding augmented reality content,
To reach to realize the object of augmented reality effect on the basis of this object.Concrete, destination object is can to grasp it
The article made, it is also possible to be to need certain operation just available article.Such as, destination object can be completing of a course
Product or raw material.For another example, destination object can also is that Conclaves grass etc. needs the article that specific operation just can be untied.
Concrete, the method for acquisition for mobile terminal image is specifically as follows: shoot image by the photographic head of mobile terminal.
Can also be: the image occurred in the photograph album of acquisition mobile terminal or other application software.Can also be: by mobile whole
The screenshotss operation of end obtains image.
Further, identify that the method for the destination object in image may include that the effective information obtained in image, pass through
Analyze effective information and determine destination object.Wherein, effective information may include that keyword message, the profile information of destination object,
At least one in the action message of the graphical information of destination object, the colouring information of destination object and destination object.Concrete,
By to the analysis of pixel in image, determining effective information.It should be noted that effective information not only includes set forth above
Information, any information that may determine that destination object can be referred to as effective information.
Optionally, can be to identify a destination object in image, it is also possible to be to identify the multiple targets pair in image
As.Optional again, can be to identify the destination object in piece image, it is also possible to identify the destination object in multiple image.
Such as, identify that the destination object in the piece image obtained is Fructus Lycopersici esculenti, identify in the another piece image obtained
Destination object is egg, it is determined that destination object is Fructus Lycopersici esculenti and egg.For another example, the target pair in the piece image obtained is identified
As for seven pieces of planks in a seven-piece puzzle, it is determined that destination object be seven pieces of a seven-piece puzzle.
Step 120, the augmented reality content being correlated with according to the search of described destination object.
Concrete, can be by from mobile terminal local search, from far-end server search or search from the Internet
Search for relevant augmented reality content etc. mode, be preferably from server, search for relevant augmented reality content.
In the embodiment of the present invention, augmented reality content is the operational approach relevant to destination object.Menu, family such as food
The mount scheme etc. of tool.
Further, after obtaining destination object, the augmented reality content relevant to destination object is searched for.
Optionally, when identifying multiple destination object, the augmented reality content associated with multiple destination objects can be obtained.
Concrete, using information such as the title of multiple destination objects or attributes as search key word, and the enhancing of association can be searched for
Real content.
It should be noted that searching for, according to destination object, the relevant augmented reality content obtained can be multinomial augmented reality
Content.
Such as, the destination object of identification is Fructus Lycopersici esculenti and egg, then it can be western red for searching for relevant augmented reality content
The operational approach of Fructus Kaki scrambled eggs, or the operational approach of tomato-egg soup, or be the operation side in tomato egg face
Method.
Step 130, show described augmented reality content.
Concrete, augmented reality content can be shown on the basis of destination object.Wherein, the display of augmented reality content
Form can be word, image and video etc. at least one.Optionally, augmented reality content can also be broadcast by sound
Put.
Optionally, user, by the augmented reality content of display, can obtain the operating procedure of needs, and then can basis
Operating procedure operates accordingly.
A kind of method obtaining augmented reality Operating Guideline that the embodiment of the present invention one provides, by identifying that mobile terminal obtains
The augmented reality content that destination object search in the image taken is correlated with, wherein, augmented reality content is relevant to destination object
Operational approach, and show the technological means of augmented reality content in the terminal, user only needs to obtain destination object
Picture, it is possible to obtain the operational approach being correlated with, improve search accuracy rate, optimizes existing search technique, and improves
The experience of user.
Embodiment two
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 2 provides for the embodiment of the present invention two.This reality
Executing example is on the basis of above-described embodiment, makees the step of the augmented reality content relevant according to the search of described destination object
Further limit.
With reference to Fig. 2, the method obtaining augmented reality Operating Guideline that the present embodiment provides specifically includes:
Step 210, identify acquisition for mobile terminal to image in destination object.
Step 220, determine the classification belonging to described destination object according to classification chart set in advance.
Concrete, preset classification chart, and this classification chart is stored in the terminal.Can be true according to this classification chart
Set the goal the classification belonging to object.
Further, the classification foundation of classification chart can be according to the attribute of destination object, such as, is divided into food, intelligence
Class, electric type, operable article class etc..Wherein, operable article class operates for can assemble it, split, folding etc.
Article.The classification foundation of classification chart can also be set by staff.
Further, after identifying destination object, can be determined belonging to destination object by the method searching classification chart
Classification.
Step 230, determine the action type that the classification belonging to described destination object is corresponding.
Concrete, preset the classification chart about destination object, meanwhile, each classification also sets the operation class of correspondence
Type.Concrete setting rule can be set according to actual, and the present embodiment is not construed as limiting.
Such as, when destination object is food, the action type of setting can be culinary art.For another example, when destination object it is
During operable article class, the action type of setting can be to assemble or fold.And for example, when destination object is intelligence class, set
Action type can be intelligence method.
Further, after determining the classification belonging to destination object, determine the action type of correspondence.Concrete, can be pre-
The classification of first target setting object and the corresponding relation of action type.And the corresponding relation determined is stored in the terminal,
Or it is stored in background server, after determining the classification belonging to destination object, determines the operation of correspondence according to corresponding relation
Type.
Step 240, search augmented reality content that is relevant to described destination object and that mate with described action type.
Concrete, based on the augmented reality content that destination object and respective operations type search are relevant.Wherein, the increasing of search
Strong real content is relevant to destination object, and with the augmented reality content of setting operation type matching.
Optionally, destination object can be without any operation, also in the article of initial condition.
As a example by food.After identifying destination object, determine destination object is categorized as food, further, determines and food
The action type that thing is corresponding is culinary art.Further, identification destination object is that raw material, i.e. destination object are also without cooking
Prepare food, then searching for described food is raw-material recipe augmented reality content.Such as, the destination object of identification is Rhizoma Solani tuber osi, determines
Destination object be categorized as food, corresponding mode of operation is culinary art, and judge Rhizoma Solani tuber osi also without any culinary art, now,
The food augmented reality content of search can be to be raw-material vegetable manufacture method with Rhizoma Solani tuber osi, such as, element stir-fry cooking shredded potato, three
Fresh etc..
As a example by operable article.After identifying destination object, determine the operable article that are categorized as of destination object, further
, determine that the action type corresponding with operable article is for assembling or folding.Further, identify destination object be in without
When assembling or folded state, search for these operable article and assemble or the augmented reality content of folding operation.Such as, target pair is identified
As the shelf for Simple wardrobe, determining the operable article that are categorized as of destination object, corresponding action type is for assembling or folds,
And judge that the shelf of Simple wardrobe is without the state assembled, now, in the assembling of search or the augmented reality of folding operation
Hold the operating procedure for easily assembled wardrobe.
Optionally, destination object can be after sequence of operations, already at the article of completion status.
As a example by food.After identifying destination object, determine destination object is categorized as food, further, determines and food
The action type that thing is corresponding is culinary art.Further, identification destination object be finished goods, i.e. destination object be one through cooking
The vegetable prepared food, then search for the recipe augmented reality content with described food as finished goods.Such as, identification destination object is Pizza,
Determining the food that is categorized as of destination object, corresponding action type is culinary art, and judges that Pizza is completion status, now, and search
Food augmented reality content be the manufacture method of Pizza.
As a example by operable article.After identifying destination object, determine the operable article that are categorized as of destination object, further
, determine that the action type corresponding with operable article is for assembling or folding.Further, identify that destination object is in pass through
When assembling or folded state, search for the augmented reality content that these operable article split or launch operation.Such as, target pair is identified
As for Conclaves grass, determining the operable article that are categorized as of destination object, corresponding action type is for assembling or folding, and judges nine
The a chain of state for assembling, now, the fractionation of search or the augmented reality content of expansion operation are to untie the operation step of Conclaves grass
Suddenly.It should be noted that splitting and assembling is relative state, launching and folding is relative state, therefore, at destination object
It is in through assembling or folded state, it is also possible to search for these operable article and assemble or in the augmented reality of folding operation
Hold.Such as, identification destination object is chest, determines the operable article that are categorized as of destination object, and corresponding action type is group
Dress or fold, and judge chest be fold after the state that can use, now, assembling or the augmented reality of folding of search
Content is the operating procedure making this chest.
Further, when identifying at least two destination object, determine the common category belonging at least two destination object,
Determine the operational attribute that this classification is corresponding again.Increasing that is that search associates with at least two destination object and that mate with operational attribute
Strong real content.
Step 250, show described augmented reality content.
The most exemplary provide semantic object extraction and augmented reality content shows realizes process.Fig. 3 is the present invention
The first machine interactive interface schematic diagram that embodiment two provides, as it is shown on figure 3, what mobile terminal was formed in shooting operation for the first time
Shooting image has got first aim object 31.The second human-computer interaction interface that Fig. 4 provides for the embodiment of the present invention two
Schematic diagram, as shown in Figure 4, mobile terminal has got second target pair in the shooting image that second time shooting operation is formed
As 41.It is of course also possible to by obtaining destination object 31 and 41 with once shooting.Mobile terminal is getting destination object 31
After 41, local from mobile terminal or from far-end server or to obtain destination object 31 and 41 from the Internet common corresponding
Augmented reality content.
Concrete, determine that destination object 31 and destination object 41 belong to food according to default classification chart, and determine food
Corresponding operational attribute is culinary art, and destination object 31 and destination object 41 are the raw material making vegetable, and the most described enhancing is existing
Real content is with destination object 31 and destination object 41 for raw-material vegetable manufacturing process.Fig. 5 is that the embodiment of the present invention two carries
3rd human-computer interaction interface schematic diagram of confession, as it is shown in figure 5, augmented reality content shows in a text form at mobile terminal
In screen.User can realize the making of vegetable according to augmented reality content.
A kind of method obtaining augmented reality Operating Guideline that the embodiment of the present invention two provides, by identifying that mobile terminal obtains
Destination object in the image taken, and determine the classification belonging to destination object and operational attribute corresponding to the category, search and mesh
The relevant augmented reality content with operation object matching of mark object, wherein, augmented reality content is relevant to destination object
Operational approach, and show the technological means of augmented reality content in the terminal, user only needs to obtain the figure of destination object
Sheet, it is possible to obtain the operational approach being correlated with, improve search accuracy rate, optimizes existing search technique, and improves use
The experience at family.
Embodiment three
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 6 provides for the embodiment of the present invention three.This reality
Executing example is on the basis of above-described embodiment, at least two augmented reality content relevant according to the search of described destination object
The step of step and the described augmented reality content of display has made further restriction.
With reference to Fig. 6, the method obtaining augmented reality Operating Guideline that the present embodiment provides specifically includes:
Step 610, identify acquisition for mobile terminal to image in destination object.
Step 620, at least two augmented reality content being correlated with according to the search of described destination object.
Concrete, after identifying destination object, according to the augmented reality content that destination object search is relevant, can be with setting search
The quantity of augmented reality content.
Step 630, show described augmented reality content.
Concrete, when at least two augmented reality content that search is relevant, this step can include following two class schemes:
Scheme one, the key message identified at least two augmented reality content, and show the key message that identification obtains；
Monitoring information selects instruction, when the information listening to input selects instruction, selects instruction according to described information, shows and selects
The relevant augmented reality content of key message.
Concrete, key message is the information that user may determine that augmented reality content.Such as, as a example by Fructus Lycopersici esculenti, increase
The key message of strong real content may is that the operational approach such as the practice of Tomato omelette or the practice of tomato beef brisket
Title.For another example, as a example by a seven-piece puzzle, the key message of augmented reality content can be square, rectangle or rhombus etc. seven
The title of skilful plate assembly shape.Concrete key message determines that rule the present embodiment is not construed as limiting.
Further, the key message that at least two augmented reality content of display search is corresponding.
More specifically, the number of at most display key message can be pre-set.Such as, at most 10 keys of display are set
Information.According to destination object search augmented reality content time, if the number of the augmented reality content of setting search less than or etc.
In 10 time, then show the key message that the whole augmented reality contents searched are corresponding.If in the augmented reality of setting search
When the number held is more than 10, then select rule according to set in advance, whole augmented reality contents selects display 10
The key message that individual augmented reality content is corresponding.
Optionally, the key message that display at least two augmented reality content is corresponding can be according to being easily selected by a user rate
Just, key message corresponding for augmented reality content the highest for selected rate showing the top at screen, selected rate is
The key message that low augmented reality content is corresponding shows the bottom at screen.
Concrete, after the key message that display at least two augmented reality content is corresponding, whether monitoring receives user is sent out
The information gone out selects instruction.Wherein, user can send information selection instruction by clicking on the mode such as screen or sound instruction.
Further, when listening to input information and selecting instruction, show at least two key message of display comprises
The information that user needs.Now, select instruction according to the information of input, show the augmented reality relevant to the key message selected
Content.Wherein, augmented reality content can be on the basis of key message, adds other information, with abundant destination object
Augmented reality content.
Optionally, if the information not hearing input selects instruction, show in currently displaying at least two key message
Do not comprise the information of user's needs.Now, the described at least two key message of display is exited.
Further, after exiting display at least two key message, destination object can be re-recognized and search for association
Augmented reality content, and show according to the augmented reality content searched.Further, exiting described in display extremely
After few two key messages, it is also possible to reacquire image, and identify the destination object in image, to search for according to destination object
Augmented reality content.
Optionally, when monitoring key message and selecting instruction, time interval is set.If in setting time interval, not supervising
Hear that the information of input selects instruction, then exit display at least two key message.Wherein, time interval can be according to actual feelings
Condition is set, such as 60s or 100s etc..
Scheme two, at least two augmented reality content, select rule selective enhancement real content according to setting, and show
Show the augmented reality content of selection.
Concrete, mobile terminal sets and selects rule, after search at least two augmented reality content, according to the choosing set
Select rule selective enhancement real content.Wherein, selecting rule can be the augmented reality content selecting searched rate the highest, it is possible to
To be the augmented reality content selecting the rate that is chosen the highest.That is, at least two augmented reality content, select searched rate
High augmented reality content, and show the augmented reality content of selection.Or, at least two augmented reality content, select quilt
The augmented reality content that selection rate is the highest, and show the augmented reality content of selection.Wherein, in searched rate refers to a period of time
The frequency searched for by user, concrete a period of time can be three months, six months etc..Selected rate refers to be easily selected by a user time
Number and the ratio of searched number of times.
A kind of method obtaining augmented reality Operating Guideline that the embodiment of the present invention three provides, by identifying that mobile terminal obtains
Destination object in the image taken searches at least two augmented reality content relevant to destination object, wherein, in augmented reality
Holding is the operational approach relevant to destination object, and shows the skill of augmented reality content in the terminal according to the rule set
Art means, user only needs to obtain the picture of destination object, it is possible to obtains the operational approach being correlated with, improves search accurately
Rate, and when searching for multiple augmented reality content, reasonably augmented reality content is shown, improve the use body of user
Test.
Embodiment four
The flow chart of a kind of method obtaining augmented reality Operating Guideline that Fig. 7 provides for the embodiment of the present invention four.This reality
Execute example on the basis of above-described embodiment, after display augmented reality content, add the step instructing user operation.
With reference to Fig. 7, the method obtaining augmented reality Operating Guideline that the present embodiment provides specifically includes:
Step 710, identify acquisition for mobile terminal to image in destination object.
Step 720, the augmented reality content being correlated with according to the search of described destination object.
Step 730, show described augmented reality content.
The operation information that step 740, acquisition user perform according to described augmented reality content.
Concrete, can obtain, by the photographic head of mobile terminal, the operation letter that user performs according to augmented reality content
Breath.Operation information can include following at least one: user perform operation movement range, user perform operation duration, use
Family perform operation direction, user perform operation object.
Step 750, the operation information that the operation information of acquisition is corresponding with augmented reality content is compared, in basis
When comparison result determines the operation information errors of user, point out user operation mistake.
Exemplary, corresponding with corresponding augmented reality content for the operation information of acquisition operation is compared.
Such as, movement range user performing operation compares with the movement range of respective operations in augmented reality content
Right, the comparison result that obtains can be that user performs the movement range of operation in the range of movement range, or, user performs
The movement range of operation is not in the range of movement range, and wherein, movement range scope is based on behaviour corresponding in augmented reality content
The scope that the movement range made sets, if not in movement range scope, then explanation current operating information mistake, movement range scope
Value range can be set according to practical situation.
It should be noted that other comparison method can also be used to compare.
Further, can confirm that the mode of operation of user according to comparison result, including correct mode of operation or mistake behaviour
Make state.
Concrete, when mode of operation is faulty operation state, warning information can be triggered.Wherein, warning information is permissible
Including audio alarm and/or word alarm.Audio alarm can be prompt tone, the sound such as " ticked ".Word alarm can
To be to write word alarm in the prompting frame of display screen exactly, in the prompting frame of display screen, such as, write " current operation mistake " exactly.
User, when knowing current operation mistake according to warning information, can select continue operation or stop behaviour according to the judgement of self
Make or revise operation.
Optionally, after triggering warning information, can again show in the augmented reality content corresponding to current operation relevant
Operation.User, after receiving warning information, just can determine according to the associative operation in the augmented reality content again shown
True operation information, and be adjusted according to correct operation information and revise.
Further, when the operation information determining user according to comparison result is correct, then continue to obtain under user's execution
The operation information of one operation.
Step 760, after completing augmented reality content, obtain the operating result of user, and operating result be evaluated
And/or scoring.
Concrete, mobile terminal can confirm that all operations completes, profit after last the operation information obtaining user
Comprise the image of operating result with photographic head automatic shooting, and identify operating result, operating result is evaluated and/or comments
Point.
Optionally, a preferable operating result can be preset, by the operating result obtained with preferably operate knot
Fruit is compared, and determines evaluation and/or scoring according to comparison result.Concrete, can by the CF of operating result with
Preferably the CF of operating result is compared, and determines evaluation and/or scoring according to comparison result.
Further, evaluate and/or mark and can be illustrated in display screen.Concrete, video, image, literary composition can be passed through
The mode such as word and voice shows evaluation and/or scoring.
A kind of method obtaining augmented reality Operating Guideline that the embodiment of the present invention four provides, by identifying that mobile terminal obtains
The augmented reality content that destination object search in the image taken is correlated with, wherein, augmented reality content is relevant to destination object
Operational approach, and show augmented reality content in the terminal, when user operates according to augmented reality content, can
To obtain the operation information of user, and the operation information that the operation information of acquisition is corresponding with augmented reality content is compared
Right, according to comparison result, the operation of user is instructed, and user complete operation after, operating result is evaluated and/
Or the technological means of scoring, user only needs to obtain the picture of destination object, it is possible to obtains the operational approach being correlated with, improves
Search accuracy rate, and reach to instruct the purpose of user operation, reduces user's error rate in actual mechanical process, meanwhile,
Operating result can be evaluated and/or mark, the deficiency of oneself can be let the user know that, and improve interest.
Embodiment five
The structural representation of a kind of device obtaining augmented reality Operating Guideline that Fig. 8 provides for the embodiment of the present invention five.
With reference to Fig. 8, this device includes；Identification module 801, search module 802 and display module 803.
Wherein, identification module 801, for identify acquisition for mobile terminal to image in destination object；Search module
802, for the augmented reality content relevant according to the search of described destination object, wherein, described augmented reality content is with described
The operational approach that destination object is relevant；Display module 803, is used for showing described augmented reality content.
A kind of device obtaining augmented reality Operating Guideline that the embodiment of the present invention five provides, by identifying that mobile terminal obtains
The augmented reality content that destination object search in the image taken is correlated with, wherein, augmented reality content is relevant to destination object
Operational approach, and show the technological means of augmented reality content in the terminal, user only needs to obtain destination object
Picture, it is possible to obtain the operational approach being correlated with, improve search accuracy rate, optimizes existing search technique, and improves
The experience of user.
On the basis of above-described embodiment, described search module 802 includes: taxon, for according to set in advance
Classification chart determines the classification belonging to described destination object；Determine unit, corresponding for determining the classification belonging to described destination object
Action type；Matching unit, existing for searching for enhancing that is relevant to described destination object and that mate with described action type
Real content.
On the basis of above-described embodiment, if being categorized as food, the behaviour that described food is corresponding belonging to described destination object
Make type for culinary art, the most described matching unit specifically for: when described food is raw material, search is former material with described food
The recipe augmented reality content of material；When described food is finished goods, the search recipe with described food as finished goods strengthens existing
Real content；Or, if being categorized as operable article, the action type that described operable article are corresponding belonging to described destination object
For assembling or folding, the most described matching unit specifically for: be not assembled or during folded state when described operable article are in,
Search for described operable article to assemble or the augmented reality content of folding operation；When described operable article are in through assembling
Or during folded state, search for the augmented reality content that described operable article split or launch operation.
On the basis of above-described embodiment, described search module 802 specifically for: relevant according to the search of described destination object
At least two augmented reality content.
Accordingly, described display module 803 includes: key message display unit, is used for identifying at least two augmented reality
Key message in content, and show the key message that identification obtains；Monitoring unit, selects instruction for monitoring information, at prison
Hear when the information of input selects to instruct, select instruction according to described information, show the enhancing relevant to the key message selected
Real content.
On the basis of above-described embodiment, described search module 802 specifically for: relevant according to the search of described destination object
At least two augmented reality content.
Accordingly, described display module 803 specifically for: at least two augmented reality content, select searched rate
The highest augmented reality content, and show the augmented reality content of selection；Or, at least two augmented reality content, select
The augmented reality content that selected rate is the highest, and show the augmented reality content of selection.
The device obtaining augmented reality Operating Guideline that the embodiment of the present invention five provides may be used for performing above-mentioned any reality
Execute the method obtaining augmented reality Operating Guideline that example provides, possess corresponding function and beneficial effect.
The embodiment of the present invention five additionally provides a kind of mobile terminal, and the integrated above-mentioned any embodiment of described mobile terminal provides
Obtain augmented reality Operating Guideline device, possess corresponding function and beneficial effect.
Note, above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that
The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various obvious change,
Readjust and substitute without departing from protection scope of the present invention.Therefore, although by above example, the present invention is carried out
It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also
Other Equivalent embodiments more can be included, and the scope of the present invention is determined by scope of the appended claims.
Claims (11)
1. the method obtaining augmented reality Operating Guideline, it is characterised in that including:
Identify acquisition for mobile terminal to image in destination object；
According to the augmented reality content that the search of described destination object is relevant, wherein, described augmented reality content is and described target
The operational approach that object is relevant；
Show described augmented reality content.
Method the most according to claim 1, it is characterised in that according in the augmented reality that the search of described destination object is relevant
Appearance includes:
The classification belonging to described destination object is determined according to classification chart set in advance；
Determine the action type that the classification belonging to described destination object is corresponding；
Search for augmented reality content that is relevant to described destination object and that mate with described action type.
Method the most according to claim 2, it is characterised in that if being categorized as food belonging to described destination object, described
The action type that food is corresponding is culinary art, then search for enhancing that is relevant to described destination object and that mate with described action type
Real content includes:
When described food is raw material, search is raw-material recipe augmented reality content with described food；
When described food is finished goods, the search recipe augmented reality content with described food as finished goods；Or,
If being categorized as operable article belonging to described destination object, action type corresponding to described operable article for assembling or
Fold, then search for augmented reality content that is relevant to described destination object and that mate with described action type and include:
It is not assembled or during folded state when described operable article are in, searches for described operable article and assemble or folding operation
Augmented reality content；
When described operable article are in through assembling or folded state, search for described operable article and split or launch behaviour
The augmented reality content made.
Method the most according to claim 1, it is characterised in that according in the augmented reality that the search of described destination object is relevant
Appearance includes:
According at least two augmented reality content that the search of described destination object is relevant；
Accordingly, show that described augmented reality content includes:
Identify the key message at least two augmented reality content, and show the key message that identification obtains；
Monitoring information select instruction, listen to input information select instruction time, according to described information select instruction, display with
The augmented reality content that the key message selected is relevant.
Method the most according to claim 1, it is characterised in that according in the augmented reality that the search of described destination object is relevant
Appearance includes:
According at least two augmented reality content that the search of described destination object is relevant；
Accordingly, show that described augmented reality content includes:
In at least two augmented reality content, select the augmented reality content that searched rate is the highest, and show the enhancing of selection
Real content；Or,
In at least two augmented reality content, select the augmented reality content that the rate that is chosen is the highest, and show the enhancing of selection
Real content.
6. the device obtaining augmented reality Operating Guideline, it is characterised in that including:
Identification module, for identify acquisition for mobile terminal to image in destination object；
Search module, for the augmented reality content relevant according to the search of described destination object, wherein, described augmented reality content
It is the operational approach relevant to described destination object；
Display module, is used for showing described augmented reality content.
Device the most according to claim 6, it is characterised in that described search module includes:
Taxon, for determining the classification belonging to described destination object according to classification chart set in advance；
Determine unit, for determining the action type that the classification belonging to described destination object is corresponding；
Matching unit, for searching for augmented reality content that is relevant to described destination object and that mate with described action type.
Device the most according to claim 7, it is characterised in that if being categorized as food belonging to described destination object, described
Action type corresponding to food is culinary art, the most described matching unit specifically for:
When described food is raw material, search is raw-material recipe augmented reality content with described food；
When described food is finished goods, the search recipe augmented reality content with described food as finished goods；Or,
If being categorized as operable article belonging to described destination object, action type corresponding to described operable article for assembling or
Fold, the most described matching unit specifically for:
It is not assembled or during folded state when described operable article are in, searches for described operable article and assemble or folding operation
Augmented reality content；
When described operable article are in through assembling or folded state, search for described operable article and split or launch behaviour
The augmented reality content made.
Device the most according to claim 6, it is characterised in that described search module specifically for:
According at least two augmented reality content that the search of described destination object is relevant；
Accordingly, described display module includes:
Key message display unit, for identifying the key message at least two augmented reality content, and shows that identification obtains
Key message；
Monitoring unit, selects instruction for monitoring information, when the information listening to input selects instruction, selects according to described information
Select instruction, show the augmented reality content relevant to the key message selected.
Device the most according to claim 6, it is characterised in that described search module specifically for:
According at least two augmented reality content that the search of described destination object is relevant；
Accordingly, described display module specifically for:
In at least two augmented reality content, select the augmented reality content that searched rate is the highest, and show the enhancing of selection
Real content；Or,
In at least two augmented reality content, select the augmented reality content that the rate that is chosen is the highest, and show the enhancing of selection
Real content.
11. 1 kinds of mobile terminals, it is characterised in that described mobile terminal is integrated with obtaining described in any one of claim 6-10
Take the device of augmented reality Operating Guideline.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610503710.5A CN106202269A (en) | 2016-06-28 | 2016-06-28 | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610503710.5A CN106202269A (en) | 2016-06-28 | 2016-06-28 | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106202269A true CN106202269A (en) | 2016-12-07 |
Family
ID=57463624
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610503710.5A Pending CN106202269A (en) | 2016-06-28 | 2016-06-28 | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106202269A (en) |
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106791748A (en) * | 2017-01-25 | 2017-05-31 | 触景无限科技（北京）有限公司 | A kind of projection process method and device of desk lamp |
| CN106791777A (en) * | 2016-12-12 | 2017-05-31 | 大连文森特软件科技有限公司 | Culinary art accessory system based on AR augmented realities and wireless communication technology |
| CN106817574A (en) * | 2017-01-25 | 2017-06-09 | 触景无限科技（北京）有限公司 | The image processing method and device of a kind of desk lamp |
| CN106851235A (en) * | 2017-01-25 | 2017-06-13 | 触景无限科技（北京）有限公司 | The interaction display method and device of desk lamp |
| CN107273678A (en) * | 2017-06-09 | 2017-10-20 | 张碧波 | A kind of food nourishment composition based on smart mobile phone automatically analyzes calculating system |
| CN107305589A (en) * | 2017-05-22 | 2017-10-31 | 朗动信息咨询（上海）有限公司 | The STI Consultation Service platform of acquisition system is analyzed based on big data |
| CN107370821A (en) * | 2017-08-03 | 2017-11-21 | 深圳增强现实技术有限公司 | Machine Operating Guideline system, method and ustomer premises access equipment |
| CN107422710A (en) * | 2017-07-28 | 2017-12-01 | 歌尔股份有限公司 | The method and system of assembling product or plant maintenance are aided in based on AR |
| CN108038761A (en) * | 2017-12-08 | 2018-05-15 | 快创科技（大连）有限公司 | Shopping Propagate and management system based on AR technologies |
| CN108168555A (en) * | 2017-12-08 | 2018-06-15 | 李志新 | Operation guidance method and system based on coordinate setting |
| CN108595107A (en) * | 2018-05-02 | 2018-09-28 | 维沃移动通信有限公司 | A kind of interface content processing method and mobile terminal |
| CN109062523A (en) * | 2018-06-14 | 2018-12-21 | 北京三快在线科技有限公司 | Methods of exhibiting, device, electronic equipment and the storage medium of augmented reality data |
| CN109087376A (en) * | 2018-07-31 | 2018-12-25 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN109144244A (en) * | 2018-07-03 | 2019-01-04 | 世雅设计有限公司 | A kind of method, apparatus, system and the augmented reality equipment of augmented reality auxiliary |
| CN109782902A (en) * | 2018-12-17 | 2019-05-21 | 中国科学院深圳先进技术研究院 | A kind of operation indicating method and glasses |
| CN110447000A (en) * | 2018-02-28 | 2019-11-12 | 华为技术有限公司 | Terminal passes through picture searching VR resource |
| CN111147750A (en) * | 2019-12-31 | 2020-05-12 | 维沃移动通信有限公司 | Object display method, electronic device, and medium |
| CN111540054A (en) * | 2020-04-03 | 2020-08-14 | 北京明略软件***有限公司 | Guidance method and device based on AR technology |
| WO2021102991A1 (en) * | 2019-11-29 | 2021-06-03 | SideChef Group Limited | Crowd-sourced data collection and labelling using gaming mechanics for machine learning model training |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103227726A (en) * | 2011-11-04 | 2013-07-31 | 佳能株式会社 | Information processing apparatus and method for the same |
| CN103810284A (en) * | 2014-02-21 | 2014-05-21 | 北京微酷客科技有限公司 | Kitchen management method and device |
| CN105096180A (en) * | 2015-07-20 | 2015-11-25 | 北京易讯理想科技有限公司 | Commodity information display method and apparatus based augmented reality |
| CN105094794A (en) * | 2014-05-06 | 2015-11-25 | 霍尼韦尔国际公司 | Apparatus and method for providing augmented reality for maintenance applications |
| US20160091964A1 (en) * | 2014-09-26 | 2016-03-31 | Intel Corporation | Systems, apparatuses, and methods for gesture recognition and interaction |
-
2016
- 2016-06-28 CN CN201610503710.5A patent/CN106202269A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103227726A (en) * | 2011-11-04 | 2013-07-31 | 佳能株式会社 | Information processing apparatus and method for the same |
| CN103810284A (en) * | 2014-02-21 | 2014-05-21 | 北京微酷客科技有限公司 | Kitchen management method and device |
| CN105094794A (en) * | 2014-05-06 | 2015-11-25 | 霍尼韦尔国际公司 | Apparatus and method for providing augmented reality for maintenance applications |
| US20160091964A1 (en) * | 2014-09-26 | 2016-03-31 | Intel Corporation | Systems, apparatuses, and methods for gesture recognition and interaction |
| CN105096180A (en) * | 2015-07-20 | 2015-11-25 | 北京易讯理想科技有限公司 | Commodity information display method and apparatus based augmented reality |
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106791777A (en) * | 2016-12-12 | 2017-05-31 | 大连文森特软件科技有限公司 | Culinary art accessory system based on AR augmented realities and wireless communication technology |
| CN106817574A (en) * | 2017-01-25 | 2017-06-09 | 触景无限科技（北京）有限公司 | The image processing method and device of a kind of desk lamp |
| CN106851235A (en) * | 2017-01-25 | 2017-06-13 | 触景无限科技（北京）有限公司 | The interaction display method and device of desk lamp |
| CN106791748A (en) * | 2017-01-25 | 2017-05-31 | 触景无限科技（北京）有限公司 | A kind of projection process method and device of desk lamp |
| CN107305589A (en) * | 2017-05-22 | 2017-10-31 | 朗动信息咨询（上海）有限公司 | The STI Consultation Service platform of acquisition system is analyzed based on big data |
| CN107273678A (en) * | 2017-06-09 | 2017-10-20 | 张碧波 | A kind of food nourishment composition based on smart mobile phone automatically analyzes calculating system |
| CN107422710A (en) * | 2017-07-28 | 2017-12-01 | 歌尔股份有限公司 | The method and system of assembling product or plant maintenance are aided in based on AR |
| CN107370821B (en) * | 2017-08-03 | 2020-10-09 | 深圳增强现实技术有限公司 | Machine operation guidance system |
| CN107370821A (en) * | 2017-08-03 | 2017-11-21 | 深圳增强现实技术有限公司 | Machine Operating Guideline system, method and ustomer premises access equipment |
| CN108168555A (en) * | 2017-12-08 | 2018-06-15 | 李志新 | Operation guidance method and system based on coordinate setting |
| CN108038761A (en) * | 2017-12-08 | 2018-05-15 | 快创科技（大连）有限公司 | Shopping Propagate and management system based on AR technologies |
| EP3751431A4 (en) * | 2018-02-28 | 2020-12-16 | Huawei Technologies Co., Ltd. | Terminal searching for vr resource by means of image |
| CN110447000A (en) * | 2018-02-28 | 2019-11-12 | 华为技术有限公司 | Terminal passes through picture searching VR resource |
| CN108595107A (en) * | 2018-05-02 | 2018-09-28 | 维沃移动通信有限公司 | A kind of interface content processing method and mobile terminal |
| CN109062523A (en) * | 2018-06-14 | 2018-12-21 | 北京三快在线科技有限公司 | Methods of exhibiting, device, electronic equipment and the storage medium of augmented reality data |
| CN109062523B (en) * | 2018-06-14 | 2021-09-24 | 北京三快在线科技有限公司 | Augmented reality data display method and device, electronic equipment and storage medium |
| CN109144244A (en) * | 2018-07-03 | 2019-01-04 | 世雅设计有限公司 | A kind of method, apparatus, system and the augmented reality equipment of augmented reality auxiliary |
| CN109087376A (en) * | 2018-07-31 | 2018-12-25 | Oppo广东移动通信有限公司 | Image processing method, device, storage medium and electronic equipment |
| CN109782902A (en) * | 2018-12-17 | 2019-05-21 | 中国科学院深圳先进技术研究院 | A kind of operation indicating method and glasses |
| WO2021102991A1 (en) * | 2019-11-29 | 2021-06-03 | SideChef Group Limited | Crowd-sourced data collection and labelling using gaming mechanics for machine learning model training |
| US11712633B2 (en) | 2019-11-29 | 2023-08-01 | SideChef Group Limited | Crowd-sourced data collection and labelling using gaming mechanics for machine learning model training |
| CN111147750B (en) * | 2019-12-31 | 2021-08-10 | 维沃移动通信有限公司 | Object display method, electronic device, and medium |
| CN111147750A (en) * | 2019-12-31 | 2020-05-12 | 维沃移动通信有限公司 | Object display method, electronic device, and medium |
| CN111540054A (en) * | 2020-04-03 | 2020-08-14 | 北京明略软件***有限公司 | Guidance method and device based on AR technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106202269A (en) | A kind of obtain the method for augmented reality Operating Guideline, device and mobile terminal | |
| CN105338419B (en) | A kind of generation method and equipment of the subtitle collection of choice specimens | |
| CN109905782B (en) | Control method and device | |
| CN105608005B (en) | The test method and system of a kind of television system | |
| US11123636B2 (en) | Runtime animation substitution | |
| CN105933783A (en) | Bullet screen play method and device and terminal equipment | |
| CN105912699A (en) | Data analysis method and device | |
| CN109862379A (en) | A kind of log processing method, device, mobile terminal and storage medium | |
| US10918955B2 (en) | Techniques for displaying character play records on a game map | |
| CN105718543B (en) | The methods of exhibiting and device of sentence | |
| CN107247740A (en) | Direct broadcasting room customizing functions method and device | |
| CN106777206A (en) | Movie and television play class keywords search for exhibiting method and device | |
| CN105446592A (en) | Application icon classification and displaying method and device | |
| CN103428165A (en) | Method and device for grouping social network nodes | |
| KR20180093582A (en) | Method and apparatus for indexing event sections from video using end-to-end learning | |
| CN105117400B (en) | Information search method and system | |
| CN104881431B (en) | A kind of method and apparatus for obtaining search results pages in computer equipment | |
| CN106294483A (en) | For mating data processing method and the device of mouthpiece for product brand | |
| CN106649738A (en) | Method and device for aggregating personage information message in search engine result page | |
| CN105893427A (en) | Resource searching method and server | |
| CN107562750A (en) | A kind of method and apparatus for providing search result | |
| CN110058829A (en) | A kind of image processing method, device and storage medium | |
| CN102708102B (en) | Retrieval information demonstrating method and the electronic equipment of application the method | |
| CN104156391A (en) | Device and method for displaying menus in mobile search results | |
| CN106681994A (en) | Method and device for automatically digging search term classification samples and recommending game projects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161207 |
|
| RJ01 | Rejection of invention patent application after publication |