CN109145088A - A kind of searching method and private tutor's machine based on private tutor's machine - Google Patents
A kind of searching method and private tutor's machine based on private tutor's machine Download PDFInfo
- Publication number
- CN109145088A CN109145088A CN201810905751.6A CN201810905751A CN109145088A CN 109145088 A CN109145088 A CN 109145088A CN 201810905751 A CN201810905751 A CN 201810905751A CN 109145088 A CN109145088 A CN 109145088A
- Authority
- CN
- China
- Prior art keywords
- searched
- user
- information
- machine
- private tutor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 52
- 238000001514 detection method Methods 0.000 claims abstract description 32
- 238000012790 confirmation Methods 0.000 claims description 28
- 230000008859 change Effects 0.000 claims description 4
- 238000012216 screening Methods 0.000 claims description 4
- 230000002452 interceptive effect Effects 0.000 abstract description 11
- 208000011293 voice disease Diseases 0.000 abstract description 10
- 230000006870 function Effects 0.000 description 42
- 230000015654 memory Effects 0.000 description 30
- 238000004590 computer program Methods 0.000 description 11
- 238000010586 diagram Methods 0.000 description 11
- 230000001815 facial effect Effects 0.000 description 11
- 230000008569 process Effects 0.000 description 9
- 238000003860 storage Methods 0.000 description 9
- 238000012545 processing Methods 0.000 description 8
- 230000006854 communication Effects 0.000 description 7
- 230000009471 action Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 238000005457 optimization Methods 0.000 description 6
- 230000004888 barrier function Effects 0.000 description 5
- 230000006399 behavior Effects 0.000 description 4
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 235000013399 edible fruits Nutrition 0.000 description 3
- 238000012905 input function Methods 0.000 description 3
- 238000007726 management method Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000011946 reduction process Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000002411 adverse Effects 0.000 description 2
- 230000008878 coupling Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006698 induction Effects 0.000 description 2
- 230000003993 interaction Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 230000004630 mental health Effects 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000007958 sleep Effects 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- PEDCQBHIVMGVHV-UHFFFAOYSA-N Glycerine Chemical compound OCC(O)CO PEDCQBHIVMGVHV-UHFFFAOYSA-N 0.000 description 1
- 241000209140 Triticum Species 0.000 description 1
- 235000021307 Triticum Nutrition 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 229910052799 carbon Inorganic materials 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000005314 correlation function Methods 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000000151 deposition Methods 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000005192 partition Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
- G10L2015/088—Word spotting
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/225—Feedback of the input speech
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Computational Linguistics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Acoustics & Sound (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Business, Economics & Management (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Psychiatry (AREA)
- Social Psychology (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
A kind of searching method and private tutor's machine based on private tutor's machine, comprising: detect whether to occur the phonetic search operation for starting phonetic search function；If detecting that phonetic search operates, start speech detection and video record；If user speech is not detected, user's Shape of mouth for being identified by the user video that video record obtains；Information to be searched is determined according to user's Shape of mouth, and exports the result to be output corresponding with information to be searched searched.Implement the embodiment of the present invention, the student that there are problems that voice disorder is enabled to search for by private tutor's machine, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity.
Description
Technical field
The present invention relates to private tutor's machine technical fields, and in particular to a kind of searching method and private tutor's machine based on private tutor's machine.
Background technique
With popularizing for private tutor's machine, more and more students are ready more accurate to that can provide when encountering problems
Private tutor's machine of answer is sought help.Specifically, when student is when encountering problems, it will usually private tutor's machine or family using the unified purchase of school
The speech voice input function input phonetic problem of the long private tutor's machine bought to oneself so that private tutor's machine to phonetic problem carry out identification and
It searches for and then exports search result.But this mode is not applicable that there are the students of voice disorder, so, allow there are voice barriers
The student hindered, which can search for problem by private tutor's machine, becomes the emphasis for needing to solve instantly.
Summary of the invention
The embodiment of the invention discloses a kind of searching method based on private tutor's machine and private tutor's machine, enable to that there are voice barriers
The student hindered searches for problem by private tutor's machine, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then improve private tutor
The user of machine uses viscosity.
First aspect of the embodiment of the present invention discloses a kind of searching method based on private tutor's machine, which comprises
Detect whether to occur the phonetic search operation for starting phonetic search function；
If detecting the phonetic search operation, start speech detection and video record；
Judge whether to detect user speech, if the user speech is not detected, is identified by video record and obtains
User video in user's Shape of mouth；
Determine information to be searched according to user's Shape of mouth, and export search it is corresponding with the information to be searched
Result to be output.
As an alternative embodiment, in first aspect of the embodiment of the present invention, it is described to use the registered permanent residence according to described
After type information determines information to be searched, the method also includes:
The information to be searched is exported with preview mode, and detects whether that confirmation operation occurs；Wherein, the confirmation operation
The information to be searched is searched for for triggering private tutor's machine；
If detecting the confirmation operation, search for the information to be searched and execute that the output searches with
The operation of the corresponding result to be output of the information to be searched；
If the confirmation operation is not detected, the prompt letter for prompting user to be manually entered problem to be searched is exported
Breath；
Judge whether to detect the input operation for inputting the problem to be searched；
If detecting the input operation, searches for the problem to be searched and export corresponding with the problem to be searched
Answer.
As an alternative embodiment, judging to detect for defeated in first aspect of the embodiment of the present invention
After the input operation for entering the problem to be searched, the method also includes:
Determine the matching degree of the problem to be searched Yu the information to be searched, and it is pre- to judge whether the matching degree is lower than
If matching degree；
If being lower than the preset matching degree, according to the problem to be searched and user's Shape of mouth to the family
The Mouth-Shape Recognition function of religion machine optimizes, and executes the search problem to be searched and export and to be searched ask with described
Inscribe the operation of corresponding answer.
As an alternative embodiment, in first aspect of the embodiment of the present invention, the output search with
The corresponding result to be output of the information to be searched, comprising:
User information is determined according to the user video；Wherein, the user information includes at least age of user；
It is screened, is obtained to search result corresponding with the information to be searched is searched according to the user information
Result to be output；
Export the result to be output.
As an alternative embodiment, judging to detect the use in first aspect of the embodiment of the present invention
After the voice of family, the method also includes:
Terminate video record, and identifies the user speech and search text information corresponding with the user speech；
Export object content corresponding with the text information.
Second aspect of the embodiment of the present invention discloses a kind of private tutor's machine, and private tutor's machine includes:
First detection unit, for detecting whether the phonetic search occurred for starting phonetic search function operates；
Opening unit, for starting voice inspection after the first detection unit detects the phonetic search operation
Survey and video record；
Judging unit detects user speech for judging whether；
Recognition unit, for being identified by video record and obtaining after the judging unit detects the user speech
To user video in user's Shape of mouth；
First determination unit, for determining information to be searched according to user's Shape of mouth；
First output unit, for exporting the result to be output corresponding with the information to be searched searched.
As an alternative embodiment, in second aspect of the embodiment of the present invention, private tutor's machine further include:
Second output unit, it is described to be searched for being determined in first determination unit according to user's Shape of mouth
After information, the information to be searched is exported with preview mode；
Second detection unit, for detecting whether confirmation operation occurs；Wherein, the confirmation operation is for triggering the family
Religion machine searches for the information to be searched；
First search unit, for after the second detection unit detects the confirmation operation, search it is described to
Search for information；
First output unit is specifically used for after first search unit searches for the information to be searched, defeated
The result to be output corresponding with the information to be searched searched out；
Second output unit, is also used to after the confirmation operation is not detected in the second detection unit, defeated
Out for prompting user to be manually entered the prompt information of problem to be searched；
The judging unit is also used to judge whether to detect the input operation for inputting the problem to be searched；
Second search unit, for searching for described to be searched after the judging unit detects the input operation
Problem simultaneously exports answer corresponding with the problem to be searched.
As an alternative embodiment, in second aspect of the embodiment of the present invention, private tutor's machine further include:
Second determination unit, for determining described to be searched after the judging unit detects the input operation
The matching degree of problem and the information to be searched；
The judging unit, is also used to judge whether the matching degree is lower than preset matching degree；
Optimize unit, for the judging unit judge the matching degree lower than after the preset matching degree, root
The Mouth-Shape Recognition function of private tutor's machine is optimized according to the problem to be searched and user's Shape of mouth；
Second search unit, specifically for after the judging unit detects input operation, Yi Ji
The optimization unit according to the problem to be searched and user's Shape of mouth to the Mouth-Shape Recognition function of private tutor's machine into
After row optimization, searches for the problem to be searched and export answer corresponding with the problem to be searched.
As an alternative embodiment, in second aspect of the embodiment of the present invention, first output unit, packet
It includes:
It determines subelement, is used for after first search unit searches for the information to be searched, according to the user
Video determines user information；Wherein, the user information includes at least age of user；
Screen subelement, for according to the user information to searching search knot corresponding with the information to be searched
Fruit is screened, and result to be output is obtained；
Subelement is exported, for exporting the result to be output.
As an alternative embodiment, in second aspect of the embodiment of the present invention, the recognition unit is also used to
After the judging unit detects the user speech, terminate video record, and identify the user speech and search with
The corresponding text information of the user speech；
Second output unit is also used to export object content corresponding with the text information.
The third aspect of the embodiment of the present invention discloses a kind of private tutor's machine, comprising:
It is stored with the memory of executable program code；
The processor coupled with the memory；
The processor calls the executable program code stored in the memory, executes the embodiment of the present invention the
On the one hand the disclosed searching method based on private tutor's machine.
Fourth aspect of the embodiment of the present invention discloses a kind of computer readable storage medium, stores computer program,
In, the computer program makes computer execute the searcher based on private tutor's machine disclosed in first aspect of the embodiment of the present invention
Method.
The 5th aspect of the embodiment of the present invention discloses a kind of computer program product, when the computer program product is being counted
When being run on calculation machine, so that the computer executes the searching method based on private tutor's machine disclosed in first aspect.
Compared with prior art, the embodiment of the present invention has the advantages that
In the embodiment of the present invention, private tutor's machine can detecte the phonetic search behaviour whether occurred for starting phonetic search function
Make；If detecting that phonetic search operates, start speech detection and video record；If user speech is not detected,
The user's Shape of mouth being identified by the user video that video record obtains；In turn, private tutor's machine can also be according to user's shape of the mouth as one speaks
Information determines information to be searched (for example, bright moon light before bed), and exports the knot to be output corresponding with information to be searched searched
Fruit.In conclusion implementing the embodiment of the present invention, the student that there are problems that voice disorder is enabled to search for by private tutor's machine, also
The interactive mode between private tutor's machine and student can be enriched, and then the user for improving private tutor's machine uses viscosity.
Detailed description of the invention
It to describe the technical solutions in the embodiments of the present invention more clearly, below will be to needed in the embodiment
Attached drawing is briefly described, it should be apparent that, drawings in the following description are only some embodiments of the invention, for ability
For the those of ordinary skill of domain, without creative efforts, it can also be obtained according to these attached drawings other attached
Figure.
Fig. 1 is a kind of flow diagram of searching method based on private tutor's machine disclosed by the embodiments of the present invention；
Fig. 2 is the flow diagram of another searching method based on private tutor's machine disclosed by the embodiments of the present invention；
Fig. 3 is the flow diagram of another searching method based on private tutor's machine disclosed by the embodiments of the present invention；
Fig. 4 is a kind of structural schematic diagram of private tutor's machine disclosed by the embodiments of the present invention；
Fig. 5 is the structural schematic diagram of another private tutor's machine disclosed by the embodiments of the present invention；
Fig. 6 is the structural schematic diagram of another private tutor's machine disclosed by the embodiments of the present invention；
Fig. 7 is the structural schematic diagram of another private tutor's machine disclosed by the embodiments of the present invention.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that the described embodiment is only a part of the embodiment of the present invention, instead of all the embodiments.Based on this
Embodiment in invention, every other reality obtained by those of ordinary skill in the art without making creative efforts
Example is applied, shall fall within the protection scope of the present invention.
It should be noted that term " includes " and " having " and their any changes in the embodiment of the present invention and attached drawing
Shape, it is intended that cover and non-exclusive include.Such as contain the process, method of a series of steps or units, system, product or
Equipment is not limited to listed step or unit, but optionally further comprising the step of not listing or unit or optional
Ground further includes the other step or units intrinsic for these process, methods, product or equipment.
The embodiment of the invention discloses a kind of searching method based on private tutor's machine and private tutor's machine, enable to that there are voice barriers
The student hindered searches for problem by private tutor's machine, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then improve private tutor
The user of machine uses viscosity.It is described in detail separately below.
Embodiment one
Referring to Fig. 1, Fig. 1 is a kind of process signal of searching method based on private tutor's machine disclosed by the embodiments of the present invention
Figure.Being somebody's turn to do the searching method based on private tutor's machine as shown in Figure 1 may comprise steps of:
101, whether private tutor's machine testing occurs the operation of the phonetic search for starting phonetic search function, if it is, holding
Row step 102, if not, thening follow the steps 101.
In the embodiment of the present invention, phonetic search function can be user by pressing virtual/physical button on private tutor's machine
Triggering, it is also possible to private tutor's machine by infrared sensor and detects that there are (such as users) when barrier to trigger in induction range
, the embodiment of the present invention is not construed as limiting.
102, private tutor's machine starts speech detection and video record, and judges whether to detect user speech, if it is,
The corresponding text information of identification user speech simultaneously exports the object content corresponding with text information searched, if it is not, then holding
Row step 103.
In the embodiment of the present invention, optionally, private tutor's machine starts speech detection and video record, and judges whether to detect
The mode of user speech is specifically as follows:
Private tutor's machine opens camera to carry out video record, and acquires ambient sound by multiple microphones；Wherein, multiple
Microphone includes a main microphon and multiple secondary microphones；Main microphon can be to establish independently of private tutor's machine but with private tutor's machine
The microphone of connection, for acquiring the voice of user's input；Secondary microphone can be set on private tutor's machine, for acquiring ambient sound
Sound；
Private tutor's machine carries out the collected ambient sound of main microphon according to the collected ambient sound of multiple secondary microphones
Noise reduction process obtains target sound；
Whether private tutor's machine judges comprising voice in target sound, if including voice, it is determined that detect user speech, and
The corresponding text information of identification user speech is executed, and exports the behaviour of the object content corresponding with text information searched
Make；If not including voice, 103 are thened follow the steps.
As it can be seen that implementing the embodiment of the present invention, can be obtained more by carrying out noise reduction process to the ambient sound detected
Pure target sound can be improved private tutor's machine and know by the voice in target sound if in target sound including voice
Not Wei text information when recognition accuracy.
103, private tutor's machine is identified by user's Shape of mouth in the user video that video record obtains.
In the embodiment of the present invention, user's Shape of mouth includes at least multiple sounds that private tutor's machine is identified from user video
Section.In addition, above-mentioned user video starting record the moment be detect phonetic search operation at the time of, terminate record the moment be
At the time of detecting that the shape of the mouth as one speaks of user does not change in preset duration (for example, 10 seconds).
In the embodiment of the present invention, optionally, private tutor's machine is identified by the user video that video record obtains and uses the registered permanent residence
The mode of type information is specifically as follows:
Private tutor's machine determines the user video acquired by camera, and judges whether to identify that mouth is believed from user video
Breath；
If identifying mouth information, private tutor's eedle carries out the shape of the mouth as one speaks to the mouth information in frame image each in user video
Identification obtains user's Shape of mouth, and executes step 104；
If unidentified mouth information out, private tutor's machine judge with the presence or absence of facial characteristics in user video, if there is face
Portion's feature then determines moving direction and target range according to the facial characteristics；Wherein, target range is that user needs to move
Distance；
The output of private tutor's machine is identifying mouth for prompting user according to the prompt information of the mobile target range of moving direction
After portion's information, the operation that Mouth-Shape Recognition is carried out for the mouth information in each frame image in user video is executed.
As it can be seen that implement the embodiment of the present invention, can when in user video it is unidentified go out mouth information when according to detecting
Facial characteristics determines moving direction and target range, and then user is guided to be moved according to moving direction and target range,
So that private tutor's machine can identify mouth information from user video, and then determine user's Shape of mouth, improves user couple
The usage experience of the Mouth-Shape Recognition function of private tutor's machine.
104, private tutor's machine determines information to be searched according to user's Shape of mouth, and exports searching with information pair to be searched
The result to be output answered.
In the embodiment of the present invention, optionally, private tutor's machine determines that the mode of information to be searched is specific according to user's Shape of mouth
It can be with are as follows:
Private tutor's machine determines the multiple syllables for including in user's Shape of mouth, and according to the character in multiple syllables and character repertoire
Comparison, determine the corresponding information to be searched of user's Shape of mouth.
In the embodiment of the present invention, optionally, private tutor's machine exports the result to be output corresponding with information to be searched searched
Mode be specifically as follows:
Private tutor's machine searches for information to be searched, and will result to be output corresponding with information to be searched according to matching degree by height to
Low sequence exports result to be output；Wherein, matching degree is the matching degree of information to be searched and result to be output.
As it can be seen that implementing method described in Fig. 1, enable to there are the students of voice disorder to ask by the search of private tutor's machine
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity；In addition, also
It can be improved recognition accuracy of private tutor's machine when voice is identified as text information；Additionally it is possible to improve user to private tutor
The usage experience of the Mouth-Shape Recognition function of machine.
Embodiment two
Referring to Fig. 2, Fig. 2 is the process signal of another searching method based on private tutor's machine disclosed by the embodiments of the present invention
Figure.As shown in Fig. 2, being somebody's turn to do the searching method based on private tutor's machine may comprise steps of:
Step 201~step 203 please refers in embodiment one for the description of step 201~step 203 for step
The detailed description of 101~step 103, the embodiment of the present invention repeat no more.
204, private tutor's machine determines information to be searched according to user's Shape of mouth.
205, private tutor's machine exports information to be searched with preview mode, and detects whether that confirmation operation occurs；Wherein, confirmation behaviour
It acts on triggering private tutor's machine and searches for information to be searched；If so, 206 are thened follow the steps, if not, thening follow the steps 207.
In the embodiment of the present invention, optionally, private tutor's machine is specifically as follows in such a way that preview mode exports information to be searched:
The output of private tutor's machine includes the bullet frame of information to be searched；Alternatively,
Private tutor's machine is exported information to be searched with speech form by loudspeaker；Alternatively,
Private tutor's machine jumps search interface, and information to be searched is shown in search box.
In the embodiment of the present invention, optionally, the mode whether private tutor's machine testing occurs confirmation operation is specifically as follows:
Private tutor's machine judges whether the facial characteristics that user is collected by camera；
If collecting the facial characteristics of user, private tutor's machine judges whether detect use in preset duration (for example, 10 seconds)
The nodding action at family；Wherein, the starting timer time of preset duration is at the time of exporting information to be searched；
If detecting nodding action, confirmation operation is had occurred in the determination of private tutor's machine, if nodding action is not detected, private tutor
Confirmation operation does not occur for machine determination.
As it can be seen that implement the embodiment of the present invention, can by way of preview convenient for user to private tutor's machine identify wait search
Rope information is confirmed, can improve user to the use viscosity of private tutor's machine by the interaction between private tutor's machine and user in this way.
206, private tutor's machine searches for information to be searched and exports the result to be output corresponding with information to be searched searched.
In the embodiment of the present invention, private tutor's machine search for information to be searched and export search it is corresponding with information to be searched
It is to be output as a result, terminating this process.
207, the output of private tutor's machine is for prompting user to be manually entered the prompt information of problem to be searched.
208, private tutor's machine judges whether to detect that the input for inputting problem to be searched operates, if it is, executing step
Rapid 209, if it is not, then terminating this process.
In the embodiment of the present invention, optionally, private tutor's machine judges whether to detect that the input for inputting problem to be searched is grasped
The mode of work is specifically as follows:
Private tutor's machine judges whether current interface is search interface；
If not search interface, private tutor's machine jumps current interface for search interface；Wherein, search interface includes having
The search box of write-in functions；
Private tutor's machine judges whether write operation occurs in search box；
In case of write operation, private tutor's machine confirmly detects the operation of the input for inputting problem to be searched, if not
Write operation occurs, private tutor's machine, which determines, is not detected input operation.
209, private tutor's machine searches for problem to be searched and exports answer corresponding with problem to be searched.
As it can be seen that implementing method described in Fig. 2, enable to there are the students of voice disorder to ask by the search of private tutor's machine
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity；In addition, also
It can be improved recognition accuracy of private tutor's machine when voice is identified as text information；Additionally it is possible to improve user to private tutor
The usage experience of the Mouth-Shape Recognition function of machine.
Embodiment three
Referring to Fig. 3, Fig. 3 is the process signal of another searching method based on private tutor's machine disclosed by the embodiments of the present invention
Figure.Being somebody's turn to do the searching method based on private tutor's machine as shown in Figure 3 may comprise steps of:
301, whether private tutor's machine testing occurs the operation of the phonetic search for starting phonetic search function, if it is, holding
Row step 302, if not, thening follow the steps 301.
302, private tutor's machine starts speech detection and video record, and judges whether to detect user speech, if it is,
Step 304 is executed, if not, thening follow the steps 303.
303, private tutor's machine is identified by user's Shape of mouth in the user video that video record obtains.
304, private tutor's machine terminates video record, and identifies user speech.
305, private tutor's machine searches for text information corresponding with user speech, and exports in target corresponding with text information
Hold.
In the embodiment of the present invention, optionally, the mode that private tutor's machine searches for text information corresponding with user speech specifically may be used
With are as follows:
Private tutor's machine determines the corresponding text information of user speech (for example, gaining an immediate victory is what meaning or spring to sleep and can not help
Dawn)；
Private tutor's machine sends searching request to server, so that server search object content corresponding with text information；
It wherein, include text information in searching request；
Private tutor's machine receives the object content sent by server；Wherein, an entry is included at least in object content.
In the embodiment of the present invention, optionally, the mode that private tutor's machine exports object content corresponding with text information specifically may be used
With are as follows:
Private tutor's machine determines the number of entries for including in object content, and judges whether number of entries is higher than default entry number
Amount；
If being higher than default number of entries, private tutor's machine sorts the entry in object content according to search temperature, and determines
Out search for temperature ranking before ten entry；
Private tutor's machine according to before the above-mentioned search temperature ranking of search temperature Sequential output from high to low ten entry.
It can be that user is defeated according to search temperature by being screened to object content as it can be seen that implementing the embodiment of the present invention
The higher content of temperature is searched for out, is enabled a user to faster required for finding oneself in the content that private tutor's machine exports
Content, and then improve user experience.
The embodiment of the present invention can also include: that step 306~step 309 is asked for the description of step 306~step 309
Referring to the detailed description for being directed to 204~step 207 in embodiment two, the embodiment of the present invention is repeated no more.
310, private tutor's machine judges whether to detect that the input for inputting problem to be searched operates, if it is, executing step
Rapid 311, if it is not, then terminating this process.
311, private tutor's machine determines the matching degree of problem to be searched Yu information to be searched, and it is default to judge whether matching degree is lower than
Matching degree, if so, 312 are thened follow the steps, if not, thening follow the steps 313.
312, private tutor's machine optimizes the Mouth-Shape Recognition function of private tutor's machine according to problem to be searched and user's Shape of mouth.
In the embodiment of the present invention, optionally, private tutor's machine is according to problem to be searched and user's Shape of mouth to the mouth of private tutor's machine
The mode that type identification function optimizes is specifically as follows:
Private tutor's machine determines that the corresponding each frame of user's Shape of mouth includes the image of mouth information；
Private tutor's machine determines the corresponding each character of problem to be searched and the corresponding syllable of each character；
Private tutor's machine is matched according to the image that the above-mentioned corresponding syllable of each character and each frame include mouth information,
Obtain matching result；
Private tutor's machine updates Mouth-Shape Recognition database according to matching result, to reach the Mouth-Shape Recognition function optimization to private tutor's machine
Purpose.
As it can be seen that implementing the embodiment of the present invention, user can got to information to be searched when being fed back to inaccuracy, root
According to the problem to be searched that user inputs, optimized in conjunction with the lip-sync identification function of user's Shape of mouth, to improve Mouth-Shape Recognition
Accuracy.
In the embodiment of the present invention, in private tutor's machine according to problem to be searched and user's Shape of mouth to the Mouth-Shape Recognition of private tutor's machine
Function optimizes, and triggering step 313 executes corresponding operation.
313, private tutor's machine searches for problem to be searched and exports answer corresponding with problem to be searched.
As an alternative embodiment, private tutor's machine exports the knot to be output corresponding with information to be searched searched
Fruit may comprise steps of:
Private tutor's machine determines user information according to user video；Wherein, user information includes at least age of user；
Private tutor's machine screens the search result corresponding with information to be searched searched according to user information, obtain to
Export result；
Private tutor's machine exports result to be output.
It should be noted that can also include in user grade, user's gender and region where user in user information
At least one, the embodiment of the present invention are not construed as limiting.In addition, above-mentioned private tutor's machine according to user information to search with it is to be searched
The corresponding search result of information is screened, and the result of acquisition is that result to be output corresponding with age of user (is suitable for using
The result to be output at family age).
As it can be seen that implementing the optional embodiment, search result can be screened according to age of user, export and use
Family age-matched to be output to reduce as a result, being not suitable for the search result of user and generating adverse effect to user, and then protect
The physical and mental health of user.
As it can be seen that method described in implementing Fig. 3, enables to there are the students of voice disorder to ask by the search of private tutor's machine
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity；In addition, also
It can be improved recognition accuracy of private tutor's machine when voice is identified as text information；Additionally it is possible to improve user to private tutor
The usage experience of the Mouth-Shape Recognition function of machine；Additionally it is possible to improve user experience；Additionally it is possible to improve Mouth-Shape Recognition standard
True property.
Example IV
Referring to Fig. 4, Fig. 4 is a kind of structural schematic diagram of private tutor's machine disclosed by the embodiments of the present invention.As shown in figure 4, should
Private tutor's machine may include: first detection unit 401, opening unit 402, judging unit 403, the determining list of recognition unit 404, first
Member 405 and the first output unit 406, in which:
First detection unit 401, for detecting whether the phonetic search occurred for starting phonetic search function operates.
In the embodiment of the present invention, phonetic search function can be user by pressing virtual/physical button on private tutor's machine
Triggering, it is also possible to private tutor's machine by infrared sensor and detects that there are (such as users) when barrier to trigger in induction range
, the embodiment of the present invention is not construed as limiting.
Opening unit 402, for starting speech detection after first detection unit 401 detects phonetic search operation
And video record.
In the embodiment of the present invention, optionally, opening unit 402 starts speech detection and the mode of video record specifically may be used
With are as follows:
Start speech detection and opens camera to carry out video record.
Judging unit 403 detects user speech for judging whether.
In the embodiment of the present invention, optionally, judging unit 403 judges whether to detect that the mode of user speech specifically can be with
Are as follows:
Ambient sound is acquired by multiple microphones；Wherein, multiple microphones include a main microphon and multiple secondary wheats
Gram wind；Main microphon can be microphone that connection is established independently of private tutor's machine but with private tutor's machine, for acquiring user's input
Voice；Secondary microphone can be set on private tutor's machine, for acquiring ambient sound；
The collected ambient sound of main microphon is carried out at noise reduction according to multiple secondary microphones collected ambient sound
Reason obtains target sound；
Judge whether comprising voice in target sound, if including voice, it is determined that detect user speech, and execute knowledge
The corresponding text information of other user speech, and the operation of object content corresponding with text information that output searches；If
Not comprising voice, then triggers recognition unit 404 and execute the user's shape of the mouth as one speaks letter being identified by the user video that video record obtains
The operation of breath.
As it can be seen that implementing the embodiment of the present invention, can be obtained more by carrying out noise reduction process to the ambient sound detected
Pure target sound can be improved private tutor's machine and know by the voice in target sound if in target sound including voice
Not Wei text information when recognition accuracy.
In the embodiment of the present invention, after opening unit 402 opens camera, triggering judging unit 403 starts.
Recognition unit 404, for being identified by video record and obtaining after judging unit 403 detects user speech
User video in user's Shape of mouth.
In the embodiment of the present invention, user's Shape of mouth includes at least multiple sounds that private tutor's machine is identified from user video
Section.In addition, above-mentioned user video starting record the moment be detect phonetic search operation at the time of, terminate record the moment be
At the time of detecting that the shape of the mouth as one speaks of user does not change in preset duration (for example, 10 seconds).
In the embodiment of the present invention, optionally, recognition unit 404 is identified by the use in the user video that video record obtains
The mode of family Shape of mouth is specifically as follows:
It determines the user video acquired by camera, and judges whether to identify mouth information from user video；
If identifying mouth information, Mouth-Shape Recognition is carried out for the mouth information in frame image each in user video,
User's Shape of mouth is obtained, and triggers the first determination unit 405 and executes the behaviour for determining information to be searched according to user's Shape of mouth
Make；
If it is unidentified go out mouth information, judge in user video with the presence or absence of facial characteristics, if there is facial characteristics,
Moving direction and target range are then determined according to the facial characteristics；Wherein, target range is that user needs mobile distance；
The prompt information for prompting user according to the mobile target range of moving direction is exported, and is identifying mouth information
Later, the operation that Mouth-Shape Recognition is carried out for the mouth information in each frame image in user video is executed.
As it can be seen that implement the embodiment of the present invention, can when in user video it is unidentified go out mouth information when according to detecting
Facial characteristics determines moving direction and target range, and then user is guided to be moved according to moving direction and target range,
So that private tutor's machine can identify mouth information from user video, and then determine user's Shape of mouth, improves user couple
The usage experience of the Mouth-Shape Recognition function of private tutor's machine.
First determination unit 405, for determining information to be searched according to user's Shape of mouth.
In the embodiment of the present invention, optionally, the first determination unit 405 determines information to be searched according to user's Shape of mouth
Mode is specifically as follows:
Determine the multiple syllables for including in user's Shape of mouth, and according to the ratio of the character in multiple syllables and character repertoire
It is right, determine the corresponding information to be searched of user's Shape of mouth.
First output unit 406, for exporting the result to be output corresponding with information to be searched searched.
In the embodiment of the present invention, optionally, the first output unit 406 output search it is corresponding with information to be searched to
The mode of output result is specifically as follows:
Search for information to be searched, and by result to be output corresponding with information to be searched according to matching degree from high to low suitable
Sequence exports result to be output；Wherein, matching degree is the matching degree of information to be searched and result to be output.
As it can be seen that implementing private tutor's machine described in Fig. 4, enable to there are the students of voice disorder to ask by the search of private tutor's machine
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity；In addition, also
It can be improved recognition accuracy of private tutor's machine when voice is identified as text information；Additionally it is possible to improve user to private tutor
The usage experience of the Mouth-Shape Recognition function of machine.
Embodiment five
Referring to Fig. 5, Fig. 5 is the structural schematic diagram of another private tutor's machine disclosed by the embodiments of the present invention.Wherein, Fig. 5 institute
The private tutor's machine shown is that private tutor's machine as shown in Figure 4 optimizes.It is shown in fig. 5 compared with private tutor's machine shown in Fig. 4
Private tutor's machine can also include: the second output unit 407, second detection unit 408, the first search unit 409, the second search unit
410, the second determination unit 411 and optimization unit 412, in which:
Second output unit 407, for the first determination unit 405 according to user's Shape of mouth determine information to be searched it
Afterwards, information to be searched is exported with preview mode.
In the embodiment of the present invention, optionally, the second output unit 407 has in such a way that preview mode exports information to be searched
Body can be with are as follows:
Output includes the bullet frame of information to be searched；Alternatively,
Information to be searched is exported with speech form by loudspeaker；Alternatively,
Search interface is jumped, and shows information to be searched in search box.
In the embodiment of the present invention, after the second output unit 407 exports information to be searched with preview mode, triggering second
Detection unit 408 starts.
Second detection unit 408, for detecting whether confirmation operation occurs；Wherein, confirmation operation is for triggering private tutor's machine
Search for information to be searched.
In the embodiment of the present invention, optionally, second detection unit 408 detects whether that the mode that confirmation operation occurs specifically may be used
With are as follows:
Judge whether the facial characteristics that user is collected by camera；
If collecting the facial characteristics of user, judge whether detect user's in preset duration (for example, 10 seconds)
Nodding action；Wherein, the starting timer time of preset duration is at the time of exporting information to be searched；
If detecting nodding action, it is determined that confirmation operation has occurred, if nodding action is not detected, it is determined that not
Confirmation operation occurs.
As it can be seen that implement the embodiment of the present invention, can by way of preview convenient for user to private tutor's machine identify wait search
Rope information is confirmed, can improve user to the use viscosity of private tutor's machine by the interaction between private tutor's machine and user in this way.
First search unit 409, for searching for letter to be searched after second detection unit 408 detects confirmation operation
Breath.
First output unit 406, specifically for after the first search unit 409 searches for information to be searched, output is searched for
The result to be output corresponding with information to be searched arrived.
Second output unit 407, is also used to after confirmation operation is not detected in second detection unit 408, output is used for
Prompt user is manually entered the prompt information of problem to be searched.
In the embodiment of the present invention, export in the second output unit 407 for prompting user to be manually entered problem to be searched
After prompt information, triggering judging unit 403, which executes, judges whether to detect the input operation for inputting problem to be searched
Operation.
Judging unit 403 is also used to judge whether to detect the input operation for inputting problem to be searched.
In the embodiment of the present invention, optionally, judging unit 403 judges whether to detect for inputting the defeated of problem to be searched
The mode for entering operation is specifically as follows:
Judge whether current interface is search interface；
If not search interface, then current interface is jumped as search interface；Wherein, search interface includes having write-in
The search box of function；
Judge whether write operation occurs in search box；
In case of write operation, it is determined that the input operation for inputting problem to be searched is detected, if do not occurred
Write operation, it is determined that input operation is not detected.
Second search unit 410, for searching for problem to be searched simultaneously after judging unit 403 detects input operation
Export answer corresponding with problem to be searched.
Second determination unit 411, for judging unit 403 detect input operation after, determine problem to be searched with
The matching degree of information to be searched.
In the embodiment of the present invention, the second determination unit 411 determine problem to be searched and information to be searched matching degree it
Afterwards, the execution of triggering judging unit 403 judges whether matching degree is lower than the operation of preset matching degree.
Judging unit 403, is also used to judge whether matching degree is lower than preset matching degree.
Optimize unit 412, for judging matching degree lower than after preset matching degree, according to wait search in judging unit 403
Suo Wenti and user's Shape of mouth optimize the Mouth-Shape Recognition function of private tutor's machine.
In the embodiment of the present invention, optionally, optimize unit 412 according to problem to be searched and user's Shape of mouth to private tutor's machine
The mode that optimizes of Mouth-Shape Recognition function be specifically as follows:
Determine that the corresponding each frame of user's Shape of mouth includes the image of mouth information；
Determine the corresponding each character of problem to be searched and the corresponding syllable of each character；
It is matched according to the image that the above-mentioned corresponding syllable of each character and each frame include mouth information, acquisition
With result；
Mouth-Shape Recognition database is updated according to matching result, to reach the mesh to the Mouth-Shape Recognition function optimization of private tutor's machine
's.
As it can be seen that implementing the embodiment of the present invention, user can got to information to be searched when being fed back to inaccuracy, root
According to the problem to be searched that user inputs, optimized in conjunction with the lip-sync identification function of user's Shape of mouth, to improve Mouth-Shape Recognition
Accuracy.
Second search unit 410, specifically for single after judging unit 403 detects input operation, and in optimization
After member 412 optimizes the Mouth-Shape Recognition function of private tutor's machine according to problem to be searched and user's Shape of mouth, search for wait search
Suo Wenti simultaneously exports answer corresponding with problem to be searched.
As it can be seen that implementing private tutor's machine described in Fig. 5, enable to there are the students of voice disorder to ask by the search of private tutor's machine
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity；In addition, also
It can be improved recognition accuracy of private tutor's machine when voice is identified as text information；Additionally it is possible to improve user to private tutor
The usage experience of the Mouth-Shape Recognition function of machine.
Embodiment six
Referring to Fig. 6, Fig. 6 is the structural schematic diagram of another private tutor's machine disclosed by the embodiments of the present invention.Wherein, Fig. 6 institute
The private tutor's machine shown is that private tutor's machine as shown in Figure 5 optimizes.It is shown in Fig. 6 compared with private tutor's machine shown in fig. 5
Private tutor's machine in, the first output unit 406 may include: that determining subelement 4061, screening subelement 4062 and output are single
Member 4063, in which:
Determine subelement 4061, it is true according to user video for after the first search unit 409 searches for information to be searched
Determine user information；Wherein, user information includes at least age of user.
It should be noted that can also include in user grade, user's gender and region where user in user information
At least one, the embodiment of the present invention are not construed as limiting.
Screen subelement 4062, for according to user information to the search result corresponding with information to be searched searched into
Row screening, obtains result to be output.
In the embodiment of the present invention, screening subelement 4062 is corresponding with information to be searched to what is searched according to user information
Search result is screened, the result of acquisition be corresponding with age of user result to be output (i.e. suitable for age of user to
Export result).
Subelement 4063 is exported, for exporting result to be output.
As it can be seen that implementing the optional embodiment, search result can be screened according to age of user, export and use
Family age-matched to be output to reduce as a result, being not suitable for the search result of user and generating adverse effect to user, and then protect
The physical and mental health of user.
Recognition unit 404 is also used to after judging unit 403 detects user speech, terminates video record, and identify
User speech and search text information corresponding with user speech.
In the embodiment of the present invention, optionally, the mode that recognition unit 404 searches for text information corresponding with user speech has
Body can be with are as follows:
Determine the corresponding text information of user speech (for example, what meaning is gained an immediate victory is, or in spring, one sleeps and wakes up to find it is already day)；
Searching request is sent to server, so that server search object content corresponding with text information；Wherein, it searches
It include text information in rope request；
Receive the object content sent by server；Wherein, an entry is included at least in object content.
Second output unit 407 is also used to export object content corresponding with text information.
In the embodiment of the present invention, optionally, the second output unit 407 exports the side of object content corresponding with text information
Formula is specifically as follows:
It determines the number of entries for including in object content, and judges whether number of entries is higher than default number of entries；
If being higher than default number of entries, by the entry in object content according to search temperature sequence, and determine to search for
Ten entry before temperature ranking；
According to before the above-mentioned search temperature ranking of the Sequential output of search temperature from high to low ten entry.
It can be that user is defeated according to search temperature by being screened to object content as it can be seen that implementing the embodiment of the present invention
The higher content of temperature is searched for out, is enabled a user to faster required for finding oneself in the content that private tutor's machine exports
Content, and then improve user experience.
As it can be seen that implementing private tutor's machine described in Fig. 6, enable to there are the students of voice disorder to ask by the search of private tutor's machine
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity；In addition, also
It can be improved recognition accuracy of private tutor's machine when voice is identified as text information；Additionally it is possible to improve user to private tutor
The usage experience of the Mouth-Shape Recognition function of machine；Additionally it is possible to improve user experience；Additionally it is possible to improve Mouth-Shape Recognition standard
True property.
Embodiment seven
Referring to Fig. 7, Fig. 7 is the structural schematic diagram of another private tutor's machine disclosed by the embodiments of the present invention.As shown in fig. 7,
For ease of description, only parts related to embodiments of the present invention are shown, disclosed by specific technical details, please refers to this hair
Bright embodiment method part.
With reference to Fig. 7, private tutor's machine includes: radio frequency (Radio Frequency, RF) circuit 710, memory 720, input unit
730, display unit 740, sensor 750, voicefrequency circuit 760, Wireless Fidelity (wireless fidelity, WiFi) module
770, the components such as processor 780, power supply 790 and camera 800.It will be understood by those skilled in the art that family shown in Fig. 7
Religion machine structure does not constitute the restriction to private tutor's machine, may include than illustrating more or fewer components, or the certain portions of combination
Part or different component layouts.
It is specifically introduced below with reference to each component parts of the Fig. 7 to private tutor's machine:
RF circuit 710 can be used for receiving and sending messages or communication process in, signal sends and receivees, particularly, by base station
After downlink information receives, handled to processor 780；In addition, the data for designing uplink are sent to base station.In general, RF circuit 710
Including but not limited to antenna, at least one amplifier, transceiver, coupler, low-noise amplifier (Low Noise
Amplifier, LNA), duplexer etc..In addition, RF circuit 710 can also be communicated with network and other equipment by wireless communication.
Any communication standard or agreement, including but not limited to global system for mobile communications (Global can be used in above-mentioned wireless communication
System of Mobile communication, GSM), general packet radio service (General Packet Radio
Service, GPRS), CDMA (Code Division Multiple Access, CDMA), wideband code division multiple access
(Wideband Code Division Multiple Access, WCDMA), long term evolution (Long Term Evolution,
LTE), Email, short message service (Short Messaging Service, SMS) etc..
Memory 720 can be used for storing executable program code, and processor 780 is stored in memory 720 by operation
Executable program code, thereby executing the various function application and data processing of private tutor's machine.Memory 720 can mainly include depositing
Store up program area and storage data area, wherein storing program area can application program needed for storage program area, at least one function
(such as sound-playing function, image player function etc.) etc.；Storage data area can be stored to be created according to using for private tutor machine
Data (such as audio data, phone directory etc.) etc..It, can be in addition, memory 720 may include high-speed random access memory
Including nonvolatile memory, for example, at least a disk memory, flush memory device or other volatile solid-states
Part.
Above-mentioned memory 720 includes read-only memory (Read-Only Memory, ROM), random access memory (Random
Access Memory, RAM), it is programmable read only memory (Programmable Read-only Memory, PROM), erasable
Only except programmable read only memory (Erasable Programmable Read Only Memory, EPROM), disposable programmable
Reading memory (One-time Programmable Read-Only Memory, OTPROM), the electronics formula of erasing can make carbon copies read-only
Memory (Electrically-Erasable Programmable Read-Only Memory, EEPROM), CD-ROM
(Compact Disc Read-Only Memory, CD-ROM) or other disc memories, magnetic disk storage, magnetic tape storage,
Or it can be used in any other computer-readable medium of carrying or storing data.
Input unit 730 can be used for receiving the number or character information of input, and generate the user setting with private tutor's machine
And the related key signals input of function control.Specifically, input unit 730 may include touch panel 731 and other inputs
Equipment 732.Touch panel 731, also referred to as touch screen, collecting the touch operation of user on it or nearby, (for example user makes
With the operation of any suitable object or attachment such as finger, stylus on touch panel 731 or near touch panel 731), and
Corresponding attachment device is driven according to preset formula.Optionally, touch panel 731 may include touch detecting apparatus and touching
Touch two parts of controller.Wherein, the touch orientation of touch detecting apparatus detection user, and detect touch operation bring letter
Number, transmit a signal to touch controller；Touch controller receives touch information from touch detecting apparatus, and is converted into
Contact coordinate, then give processor 780, and order that processor 780 is sent can be received and executed.Furthermore, it is possible to using
The multiple types such as resistance-type, condenser type, infrared ray and surface acoustic wave realize touch panel 731.It is defeated in addition to touch panel 731
Entering unit 730 can also include other input equipments 732.Specifically, other input equipments 732 can include but is not limited to physics
One of keyboard, function key (such as volume control button, switch key etc.), trace ball, mouse, operating stick etc. are a variety of.
Display unit 740 can be used for showing information input by user or be supplied to user information and private tutor's machine it is each
Kind menu.Display unit 740 may include display panel 741, optionally, can use liquid crystal display (Liquid Crystal
Display, LCD), the forms such as Organic Light Emitting Diode (Organic Light-Emitting Diode, OLED) it is aobvious to configure
Show panel 741.Further, touch panel 731 can cover display panel 741, when touch panel 731 detect it is on it or attached
After close touch operation, processor 780 is sent to determine the type of touch event, is followed by subsequent processing device 780 according to touch event
Type corresponding visual output is provided on display panel 741.Although in Fig. 7, touch panel 731 and display panel 741
It is the input and input function of private tutor's machine to be realized as two independent components, but in some embodiments it is possible to will touch
Control panel 731 and display panel 741 are integrated and that realizes private tutor's machine output and input function.
Private tutor's machine may also include at least one sensor 750, such as optical sensor, motion sensor and other sensings
Device.Specifically, optical sensor may include ambient light sensor and proximity sensor, wherein ambient light sensor can be according to environment
The light and shade of light adjusts the brightness of display panel 741, and proximity sensor can close display surface when private tutor's machine is moved in one's ear
Plate 741 and/or backlight.As a kind of motion sensor, accelerometer sensor can detect in all directions (generally three axis)
The size of acceleration can detect that size and the direction of gravity when static, the application that can be used to identify private tutor's machine posture is (such as horizontal
Vertical screen switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, tap) etc.；As for family
The other sensors such as gyroscope, barometer, hygrometer, thermometer, infrared sensor that religion machine can also configure, it is no longer superfluous herein
It states.
Voicefrequency circuit 760, loudspeaker 761, microphone 762 can provide the audio interface between user and private tutor's machine.Audio
Electric signal after the audio data received conversion can be transferred to loudspeaker 761, be converted to sound by loudspeaker 761 by circuit 760
Sound signal output；On the other hand, the voice signal of collection is converted to electric signal by microphone 762, after being received by voicefrequency circuit 760
Audio data is converted to, then by after the processing of audio data output processor 780, such as another family is sent to through RF circuit 710
Religion machine, or audio data is exported to memory 720 to be further processed.
WiFi belongs to short range wireless transmission technology, and private tutor's machine can help user's transceiver electronics by WiFi module 770
Mail, browsing webpage and access streaming video etc., it provides wireless broadband internet access for user.Although Fig. 7 is shown
WiFi module 770, but it is understood that, and it is not belonging to must be configured into for private tutor's machine, it can according to need completely
Do not change in the range of the essence of invention and omits.
Processor 780 is the control centre of private tutor's machine, utilizes each portion of various interfaces and the entire private tutor's machine of connection
Point, by running or execute the software program and/or module that are stored in memory 720, and calls and be stored in memory 720
Interior data execute the various functions and processing data of private tutor's machine, to carry out integral monitoring to private tutor's machine.Optionally, it handles
Device 780 may include one or more processing units；Preferably, processor 780 can integrate application processor and modulation /demodulation processing
Device, wherein the main processing operation system of application processor, user interface and application program etc., modem processor is mainly located
Reason wireless communication.It is understood that above-mentioned modem processor can not also be integrated into processor 780.
Private tutor's machine further includes the power supply 790 (such as battery) powered to all parts, it is preferred that power supply can pass through power supply
Management system and processor 780 are logically contiguous, to realize management charging, electric discharge and power consumption pipe by power-supply management system
The functions such as reason.
Although being not shown, private tutor's machine can also be including bluetooth module etc., and details are not described herein.
In embodiments of the present invention, processor 780 included by private tutor's machine calls the software being stored in memory 720
Program specifically executes following operation:
Detect whether to occur the phonetic search operation for starting phonetic search function；
After detecting phonetic search operation, start speech detection and video record；
Judge whether to detect user speech；
After detecting user speech, user's Shape of mouth for being identified by the user video that video record obtains；
Information to be searched is determined according to user's Shape of mouth；
Export the result to be output corresponding with information to be searched searched.
Enable to there are the students of voice disorder to ask by the search of private tutor's machine as it can be seen that implementing private tutor's machine described in Fig. 7
Topic, additionally it is possible to the interactive mode between abundant private tutor's machine and student, and then the user for improving private tutor's machine uses viscosity.
The embodiment of the invention also discloses a kind of computer readable storage mediums, store computer program, wherein described
Computer program makes computer execute the searching method based on private tutor's machine disclosed in one~embodiment of the embodiment of the present invention three.
The embodiment of the invention also discloses a kind of computer program product, when the computer program product on computers
When operation, so that the computer executes the searching method based on private tutor's machine disclosed in one~embodiment of the embodiment of the present invention three.
Detailed Jie has been carried out to a kind of searching method and private tutor's machine based on private tutor's machine disclosed by the embodiments of the present invention above
It continues, used herein a specific example illustrates the principle and implementation of the invention, and the explanation of above embodiments is only
It is to be used to help understand method and its core concept of the invention；At the same time, for those skilled in the art, according to this hair
Bright thought, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification should not manage
Solution is limitation of the present invention.
In the above-described embodiments, it can be realized wholly or partly by software, hardware, firmware or any combination thereof.When
When using software realization, can entirely or partly it realize in the form of a computer program product.The computer program product packet
Include one or more computer instructions.When loading on computers and executing the computer program instructions, entirely or partly
It generates according to process or function described in the embodiment of the present application.The computer can be general purpose computer, special purpose computer, calculating
Machine network or other programmable devices.The computer instruction may be stored in a computer readable storage medium, Huo Zhecong
One computer readable storage medium is transmitted to another computer readable storage medium, for example, the computer instruction can be with
Pass through wired (such as coaxial cable, optical fiber, Digital Subscriber Line) from a web-site, computer, server or data center
Or wireless (such as infrared, wireless, microwave etc.) mode is transmitted to another web-site, computer, server or data center.
The computer-readable medium can be any usable medium that computer can access or include one or more available
The data storage devices such as medium integrated server, data center.The usable medium can be magnetic medium (magnetic medium example
Such as can be floppy disk, hard disk, tape), optical medium (such as CD) or semiconductor medium (such as solid state hard disk).Above-mentioned
It in embodiment, all emphasizes particularly on different fields to the description of each embodiment, there is no the part being described in detail in some embodiment, may refer to other
The associated description of embodiment.
In several embodiments provided herein, it should be understood that disclosed device, it can be by others side
Formula is realized.For example, the apparatus embodiments described above are merely exemplary, such as the division of said units, only
A kind of logical function partition, there may be another division manner in actual implementation, for example, multiple units or components can combine or
Person is desirably integrated into another system, or some features can be ignored or not executed.Another point, shown or discussion phase
Coupling, direct-coupling or communication connection between mutually can through some interfaces, the INDIRECT COUPLING or communication link of device or unit
It connects, can be electrical or other forms.
Above-mentioned unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, can be in one place, or may be distributed over multiple nets
On network unit.Some or all of units can be selected to achieve the purpose of the solution of this embodiment according to the actual needs.
In addition, each functional unit in each embodiment of the application can integrate in one processing unit, it is also possible to
Each unit physically exists alone, and can also be integrated in one unit with two or more units.Above-mentioned integrated unit
Both it can take the form of hardware realization, can also realize in the form of software functional units.
If above-mentioned integrated unit is realized in the form of SFU software functional unit and when sold or used as an independent product,
It can store in a retrievable memory of computer.Based on this understanding, the technical solution of the application substantially or
Say all or part of of the part that contributes to existing technology or the technical solution, it can body in the form of software products
Reveal and, which is stored in a memory, including several requests are used so that a computer equipment
(can be personal computer, server or network equipment etc., specifically can be the processor in computer equipment) executes sheet
The all or part of the steps of each embodiment above method of application.
The above, above embodiments are only to illustrate the technical solution of the application rather than its limitations；Although referring to before
Embodiment is stated the application is described in detail, however those skilled in the art should understand that；It still can be with
It modifies the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features；And
These are modified or replaceed, the spirit and model of each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution
It encloses.
Claims (10)
1. a kind of searching method based on private tutor's machine, which is characterized in that the described method includes:
Detect whether to occur the phonetic search operation for starting phonetic search function；
If detecting the phonetic search operation, start speech detection and video record；
Judge whether to detect user speech, if the user speech is not detected, is identified by the use that video record obtains
User's Shape of mouth in the video of family；
Determine information to be searched according to user's Shape of mouth, and export search it is corresponding with the information to be searched to
Export result.
2. the method according to claim 1, wherein it is described determined according to user's Shape of mouth it is to be searched
After information, the method also includes:
The information to be searched is exported with preview mode, and detects whether that confirmation operation occurs；Wherein, the confirmation operation is used for
It triggers private tutor's machine and searches for the information to be searched；
If detecting the confirmation operation, search for the information to be searched and execute that the output searches with it is described
The operation of the corresponding result to be output of information to be searched；
If the confirmation operation is not detected, export for prompting user to be manually entered the prompt information of problem to be searched；
Judge whether to detect the input operation for inputting the problem to be searched；
If detecting the input operation, searches for the problem to be searched and export answer corresponding with the problem to be searched
Case.
3. according to the method described in claim 2, it is characterized in that, judging to detect for inputting the problem to be searched
The input operation after, the method also includes:
It determines the matching degree of the problem to be searched Yu the information to be searched, and judges whether the matching degree is lower than default
With degree；
If being lower than the preset matching degree, according to the problem to be searched and user's Shape of mouth to private tutor's machine
Mouth-Shape Recognition function optimize, and execute the search problem to be searched and export and the problem pair to be searched
The operation for the answer answered.
4. according to the method described in claim 3, it is characterized in that, the output is searching with the information pair to be searched
The result to be output answered, comprising:
User information is determined according to the user video；Wherein, the user information includes at least age of user；
It is screened, is obtained to defeated to search result corresponding with the information to be searched is searched according to the user information
Result out；
Export the result to be output.
5. described according to the method described in claim 4, it is characterized in that, after judging to detect the user speech
Method further include:
Terminate video record, and identifies the user speech and search text information corresponding with the user speech；
Export object content corresponding with the text information.
6. a kind of private tutor's machine, which is characterized in that private tutor's machine includes:
First detection unit, for detecting whether the phonetic search occurred for starting phonetic search function operates；
Opening unit, for after the first detection unit detects phonetic search operation, start speech detection with
And video record；
Judging unit detects user speech for judging whether；
Recognition unit, for being identified by what video record obtained after the judging unit detects the user speech
User's Shape of mouth in user video；
First determination unit, for determining information to be searched according to user's Shape of mouth；
First output unit, for exporting the result to be output corresponding with the information to be searched searched.
7. private tutor's machine according to claim 6, which is characterized in that private tutor's machine further include:
Second output unit, for determining the information to be searched according to user's Shape of mouth in first determination unit
Later, the information to be searched is exported with preview mode；
Second detection unit, for detecting whether confirmation operation occurs；Wherein, the confirmation operation is for triggering private tutor's machine
Search for the information to be searched；
First search unit, for searching for described to be searched after the second detection unit detects the confirmation operation
Information；
First output unit is specifically used for after first search unit searches for the information to be searched, and output is searched
The result to be output corresponding with the information to be searched that rope arrives；
Second output unit, is also used to after the confirmation operation is not detected in the second detection unit, and output is used
The prompt information of problem to be searched is manually entered in prompt user；
The judging unit is also used to judge whether to detect the input operation for inputting the problem to be searched；
Second search unit, for searching for the problem to be searched after the judging unit detects the input operation
And export answer corresponding with the problem to be searched.
8. private tutor's machine according to claim 7, which is characterized in that private tutor's machine further include:
Second determination unit, for determining the problem to be searched after the judging unit detects the input operation
With the matching degree of the information to be searched；
The judging unit, is also used to judge whether the matching degree is lower than preset matching degree；
Optimize unit, for judging the matching degree lower than after the preset matching degree, according to institute in the judging unit
It states problem to be searched and user's Shape of mouth optimizes the Mouth-Shape Recognition function of private tutor's machine；
Second search unit, specifically for after the judging unit detects input operation, and described
It is excellent to the Mouth-Shape Recognition function progress of private tutor's machine according to the problem to be searched and user's Shape of mouth to optimize unit
After change, searches for the problem to be searched and export answer corresponding with the problem to be searched.
9. private tutor's machine according to claim 8, which is characterized in that first output unit, comprising:
It determines subelement, is used for after first search unit searches for the information to be searched, according to the user video
Determine user information；Wherein, the user information includes at least age of user；
Screen subelement, for according to the user information to search search result corresponding with the information to be searched into
Row screening, obtains result to be output；
Subelement is exported, for exporting the result to be output.
10. private tutor's machine according to claim 9, which is characterized in that
The recognition unit is also used to after the judging unit detects the user speech, terminates video record, and know
The not described user speech and search text information corresponding with the user speech；
Second output unit is also used to export object content corresponding with the text information.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810905751.6A CN109145088A (en) | 2018-08-10 | 2018-08-10 | A kind of searching method and private tutor's machine based on private tutor's machine |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810905751.6A CN109145088A (en) | 2018-08-10 | 2018-08-10 | A kind of searching method and private tutor's machine based on private tutor's machine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109145088A true CN109145088A (en) | 2019-01-04 |
Family
ID=64792508
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810905751.6A Pending CN109145088A (en) | 2018-08-10 | 2018-08-10 | A kind of searching method and private tutor's machine based on private tutor's machine |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109145088A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766826A (en) * | 2019-01-08 | 2019-05-17 | 广东小天才科技有限公司 | A kind of method and system of automatic identification job information |
| CN109817046A (en) * | 2019-01-23 | 2019-05-28 | 广东小天才科技有限公司 | A kind of study householder method and private tutor's equipment based on private tutor's equipment |
| CN111028843A (en) * | 2019-04-11 | 2020-04-17 | 广东小天才科技有限公司 | Dictation method and electronic equipment |
| CN113421565A (en) * | 2021-07-19 | 2021-09-21 | 北京百度网讯科技有限公司 | Search method, search device, electronic equipment and storage medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101510256A (en) * | 2009-03-20 | 2009-08-19 | 深圳华为通信技术有限公司 | Mouth shape language conversion method and device |
| KR20100049201A (en) * | 2008-11-03 | 2010-05-12 | 윤병원 | Electronic dictionary service method having drill on pronunciation and electronic dictionary using the same |
| CN105844978A (en) * | 2016-05-18 | 2016-08-10 | 华中师范大学 | Primary school Chinese word learning auxiliary speech robot device and work method thereof |
| CN106875941A (en) * | 2017-04-01 | 2017-06-20 | 彭楚奥 | A kind of voice method for recognizing semantics of service robot |
| CN107799125A (en) * | 2017-11-09 | 2018-03-13 | 维沃移动通信有限公司 | A kind of audio recognition method, mobile terminal and computer-readable recording medium |
-
2018
- 2018-08-10 CN CN201810905751.6A patent/CN109145088A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20100049201A (en) * | 2008-11-03 | 2010-05-12 | 윤병원 | Electronic dictionary service method having drill on pronunciation and electronic dictionary using the same |
| CN101510256A (en) * | 2009-03-20 | 2009-08-19 | 深圳华为通信技术有限公司 | Mouth shape language conversion method and device |
| CN105844978A (en) * | 2016-05-18 | 2016-08-10 | 华中师范大学 | Primary school Chinese word learning auxiliary speech robot device and work method thereof |
| CN106875941A (en) * | 2017-04-01 | 2017-06-20 | 彭楚奥 | A kind of voice method for recognizing semantics of service robot |
| CN107799125A (en) * | 2017-11-09 | 2018-03-13 | 维沃移动通信有限公司 | A kind of audio recognition method, mobile terminal and computer-readable recording medium |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109766826A (en) * | 2019-01-08 | 2019-05-17 | 广东小天才科技有限公司 | A kind of method and system of automatic identification job information |
| CN109817046A (en) * | 2019-01-23 | 2019-05-28 | 广东小天才科技有限公司 | A kind of study householder method and private tutor's equipment based on private tutor's equipment |
| CN111028843A (en) * | 2019-04-11 | 2020-04-17 | 广东小天才科技有限公司 | Dictation method and electronic equipment |
| CN113421565A (en) * | 2021-07-19 | 2021-09-21 | 北京百度网讯科技有限公司 | Search method, search device, electronic equipment and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109063583A (en) | A kind of learning method and electronic equipment based on read operation | |
| CN104298436B (en) | A kind of quickly revert operating method and terminal | |
| CN108287739A (en) | A kind of guiding method of operating and mobile terminal | |
| CN108364644A (en) | A kind of voice interactive method, terminal and computer-readable medium | |
| CN109145088A (en) | A kind of searching method and private tutor's machine based on private tutor's machine | |
| CN110197662A (en) | Sound control method, wearable device and computer readable storage medium | |
| CN108845853A (en) | A kind of application program launching method and mobile terminal | |
| CN108735216A (en) | A kind of voice based on semantics recognition searches topic method and private tutor's equipment | |
| CN103501485B (en) | Push the method, apparatus and terminal device of application | |
| CN109035914A (en) | A kind of learning method and intelligent desk lamp based on intelligent desk lamp | |
| CN106874091A (en) | A kind of application call method, device and mobile terminal | |
| CN109284592A (en) | A kind of topic recommended method and private tutor's equipment | |
| CN109857245A (en) | A kind of gesture identification method and terminal | |
| CN110231900A (en) | A kind of application icon display methods and terminal | |
| CN110046015A (en) | Using sharing method and terminal | |
| CN110134306A (en) | A kind of data sharing method, device and computer readable storage medium | |
| CN106940997A (en) | A kind of method and apparatus that voice signal is sent to speech recognition system | |
| CN108228902A (en) | A kind of document display method and mobile terminal | |
| CN109495638A (en) | A kind of information display method and terminal | |
| CN105550316B (en) | The method for pushing and device of audio list | |
| CN105808043B (en) | A kind of setting method and mobile terminal of terminal applies | |
| CN105807908B (en) | A kind of method and apparatus of switching working mode | |
| CN108595107A (en) | A kind of interface content processing method and mobile terminal | |
| CN106126171B (en) | A kind of sound effect treatment method and mobile terminal | |
| CN107154262A (en) | A kind of voice operating method, device and mobile terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190104 |