CN104461545B - Content in mobile terminal is provided to the method and device of user - Google Patents
Content in mobile terminal is provided to the method and device of user Download PDFInfo
- Publication number
- CN104461545B CN104461545B CN201410773743.2A CN201410773743A CN104461545B CN 104461545 B CN104461545 B CN 104461545B CN 201410773743 A CN201410773743 A CN 201410773743A CN 104461545 B CN104461545 B CN 104461545B
- Authority
- CN
- China
- Prior art keywords
- sectional drawing
- layout pattern
- current sectional
- current
- mobile terminal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a kind of methods that content in mobile terminal is provided to user, including：Obtain the current sectional drawing of mobile terminal screen；Current sectional drawing is analyzed to obtain the corresponding layout pattern of current sectional drawing；Current sectional drawing is identified according to layout pattern to obtain the information of current sectional drawing；And voice is converted information into, and play.The method of the embodiment of the present invention converts the information on mobile terminal screen to voice output by OCR, so that user can obtain the content in mobile terminal current screen by the sense of hearing, the eyes for having liberated user alleviate the burden that user obtains information, and the user experience is improved.The invention also discloses a kind of devices that content in mobile terminal is provided to user.
Description
Technical field
The present invention relates to mobile terminal device technical field more particularly to a kind of content in mobile terminal is provided to user
Method and device.
Background technology
Currently, mobile terminal device is very universal in people's life, it is the various aspects bands such as people's Working Life
Come various informations, the extreme enrichment range of people's acquisition of information.
User (such as checking) can obtain the content in mobile terminal current screen by way of vision at present.But
For special population, such as blind person, the people etc. for having protection visual needs, cannot easily it be led to due to they certain
The mode for crossing vision obtains content in mobile terminal current screen, accordingly, it is desirable to provide one kind can be in a manner of auditorial
(such as speech play) come assist user read mobile terminal screen in content.
Invention content
The purpose of the present invention is intended to solve at least some of the technical problems in related technologies.
For this purpose, first purpose of the present invention is to propose a kind of method that content in mobile terminal is provided to user.
This method can make user that can obtain the content in mobile terminal current screen by the sense of hearing, liberate the eyes of user,
The burden that user obtains information is alleviated, the user experience is improved.
Second object of the present invention is to propose a kind of device that content in mobile terminal is provided to user.
In order to realize that content in mobile terminal is provided to user's by above-described embodiment, first aspect present invention embodiment
Method, including：Obtain the current sectional drawing of mobile terminal screen；The current sectional drawing is analyzed to obtain the current sectional drawing
Corresponding layout pattern；The current sectional drawing is identified to obtain the letter of the current screen according to the layout pattern
Breath；And voice is converted that information to, and play.
The method that content in mobile terminal is provided to user of the embodiment of the present invention, can first obtain mobile terminal screen
Current sectional drawing later can analyze current sectional drawing to obtain the corresponding layout pattern of current sectional drawing, and according to layout pattern
Current sectional drawing is identified to obtain the information of current sectional drawing, and converts information into voice, and played, i.e., it will be mobile whole
Information on the screen of end is converted into voice output by OCR so that user can obtain mobile terminal current screen by the sense of hearing
In content, liberated the eyes of user, alleviate user obtain information burden, the user experience is improved.
In order to realize that content in mobile terminal is provided to user's by above-described embodiment, second aspect of the present invention embodiment
Device, including：Acquisition module, the current sectional drawing for obtaining mobile terminal screen；Analysis module, for the current sectional drawing
It is analyzed to obtain the corresponding layout pattern of the current sectional drawing；Identification module is used for according to the layout pattern to described
Current sectional drawing is identified to obtain the information of the current sectional drawing；Conversion module, for converting that information to voice；With
And playing module, for playing the voice.
The device that content in mobile terminal is provided to user of the embodiment of the present invention can be obtained by acquisition module and be moved
The current sectional drawing of terminal screen, analysis module are analyzed current sectional drawing to obtain the corresponding layout pattern of current sectional drawing, are known
Other module is identified current sectional drawing according to layout pattern to obtain the information of current sectional drawing, and conversion module converts information into
Voice, playing module play voice, i.e., convert the information on mobile terminal screen to voice output by OCR so that user
The content in mobile terminal current screen can be obtained by the sense of hearing, has liberated the eyes of user, user is alleviated and obtains information
Burden, the user experience is improved.
The additional aspect of the present invention and advantage will be set forth in part in the description, and will partly become from the following description
Obviously, or practice through the invention is recognized.
Description of the drawings
Above-mentioned and/or additional aspect and advantage of the invention will become from the following description of the accompanying drawings of embodiments
Obviously and it is readily appreciated that, wherein
Fig. 1 is the flow chart of the method according to an embodiment of the invention that content in mobile terminal is provided to user；
Fig. 2 is the exemplary plot that layout pattern according to an embodiment of the invention is class letter formula layout pattern；
Fig. 3 is the exemplary plot that layout pattern according to an embodiment of the invention is class newspaper formula layout pattern；
Fig. 4 is according to an embodiment of the invention to be shown what current sectional drawing was identified by the preset OCR in high in the clouds
Illustration；
Fig. 5 is the structural representation of the device according to an embodiment of the invention that content in mobile terminal is provided to user
Figure；And
Fig. 6 is the structural schematic diagram of analysis module according to an embodiment of the invention.
Specific implementation mode
The embodiment of the present invention is described below in detail, examples of the embodiments are shown in the accompanying drawings, wherein from beginning to end
Same or similar label indicates same or similar element or element with the same or similar functions.Below with reference to attached
The embodiment of figure description is exemplary, it is intended to for explaining the present invention, and is not considered as limiting the invention.
It is certain due to them in order to solve for special population, such as blind person, the people etc. for having protection visual needs
The problem of reason cannot obtain the content in mobile terminal current screen conveniently by the mode of vision, the present invention proposes one
Content in mobile terminal is provided to the method and device of user by kind.Specifically, below with reference to the accompanying drawings the embodiment of the present invention is described
The method and device that content in mobile terminal is provided to user.
The present invention proposes a kind of method that content in mobile terminal is provided to user, including：Obtain mobile terminal screen
The current sectional drawing of curtain；Current sectional drawing is analyzed to obtain the corresponding layout pattern of current sectional drawing；According to layout pattern to working as
Preceding sectional drawing is identified to obtain the information of current sectional drawing；And voice is converted information into, and play.
Fig. 1 is the flow chart of the method according to an embodiment of the invention that content in mobile terminal is provided to user.
It should be noted that in an embodiment of the present invention, mobile terminal can be the tools such as mobile phone, tablet computer, personal digital assistant
There is the hardware device of various operating systems.
As shown in Figure 1, the method that content in mobile terminal is provided to user be may include by this：
S101 obtains the current sectional drawing of mobile terminal screen.
For example, it is assumed that the method that content in mobile terminal is provided to user is applied in mobile terminal, mobile terminal is
User provides the application program with automatic interception mobile terminal screen function, which can be transported in back way
Row, when detecting that user reads news or reading electronic book or browsing webpage etc. by news client, the application program
Mobile terminal screen can be intercepted automatically, to get the current sectional drawing of mobile terminal screen.
S102 analyzes current sectional drawing to obtain the corresponding layout pattern of current sectional drawing.
Specifically, in an embodiment of the present invention, can analyze current sectional drawing, to identify the master in current sectional drawing
Want information module.Later, the corresponding layout pattern of current sectional drawing can be obtained according to main information module.For example, can pass through
Data cleansing algorithm carries out analyzing processing to current sectional drawing, such as can be to current sectional drawing by increasing contrast, noise reduction, at gray scale
The modes such as reason, for another example can be by reduction processing by non-principal information module (such as advertisement in current sectional drawing to promote discrimination
Deng) get rid of, to identify the main information module in current sectional drawing.It later, can be according to main information module in current sectional drawing
In distribution situation determine the corresponding layout pattern of current sectional drawing.
Wherein, in an embodiment of the present invention, layout pattern can be that class letter formula layout pattern or class newspaper formula are laid out mould
Formula.For example, when distribution sequence of the main information mould information in the block in current sectional drawing be from top to bottom, from left to right when, can
Determine that the layout pattern corresponding to it is class letter formula layout pattern, as shown in Fig. 2, the scene of this class letter formula layout pattern
Usually user reads news, e-book etc.；For another example, it when main information module is multiple, and is distributed in current sectional drawing not
When with position, it may be determined that the layout pattern corresponding to it is class newspaper formula layout pattern, as shown in figure 3, this type newspaper formula cloth
The scene of office's pattern is usually that user browses webpage, using other applications (such as wechat).
S103 is identified current sectional drawing according to layout pattern to obtain the information of current sectional drawing.
Specifically, in one embodiment of the invention, preset OCR (Optical can be passed through according to layout pattern
Character Recognition, optical character identification) library is identified current sectional drawing to obtain the information of current sectional drawing.
Wherein, in an embodiment of the present invention, the preset libraries OCR can be located locally or high in the clouds etc..
It should be noted that for example, when user more pays close attention to flow consumption, it can be by the preset libraries OCR that are located locally
Current sectional drawing is identified, the local preset libraries OCR can be in suitable conditions (such as Wi-Fi (Wireless Fidelity, nothing
Line fidelity) environment or user force) under synchronous and update high in the clouds the preset libraries OCR.For another example, when user is more concerned with identifier
When testing, current sectional drawing can be identified by the preset libraries OCR in high in the clouds.
It should also be noted that, due to contents and distribution's pattern in mobile terminal screen be it is different, according to cloth
The process that current sectional drawing is identified in office's pattern is also different.It can respectively introduce according to different layout patterns to working as below
The various process that preceding sectional drawing is identified.
For example, in one embodiment of the invention, when layout pattern is class letter formula layout pattern, according to cloth
Current sectional drawing, which is identified, in office's pattern may particularly include：According to the recognition sequence corresponding to class letter formula layout pattern to current
Sectional drawing is identified, wherein recognition sequence is sequence from top to bottom, from left to right.For example, when detecting that it is new that user wants to read
When news or e-book, it is class letter formula layout pattern to analyze the layout pattern corresponding to current sectional drawing, can be according to current sectional drawing
Current sectional drawing is identified in the sequence of the information of layout from top to bottom, from left to right.
In one embodiment of the invention, when layout pattern is class newspaper formula layout pattern, according to layout pattern pair
Current sectional drawing, which is identified, may particularly include：First current sectional drawing can be identified according to class newspaper formula layout pattern, to obtain
At least two information blocks of current sectional drawing.It later, can be according to the recognition sequence corresponding to class letter formula layout pattern to each
Information block is identified.For example, when detecting that user browses webpage or uses other applications (such as wechat), it can be first
Current sectional drawing is identified according to class newspaper formula layout pattern, identifies the information block in current sectional drawing.Later, can pass through
The selection instruction of user first selects a certain block, then according to the recognition sequence corresponding to class letter formula layout pattern to the block
It is identified, after end of identification, its selected block is identified in next selection instruction to user, until institute
Until thering is the selected block of user all to identify.
Current sectional drawing is identified respectively by different modes according to different layout patterns as a result, promotes identification
As a result accuracy rate.
S104 converts information into voice, and plays.
For example, voice can be converted information by speech recognition technology, and by the voice exported for user into
Corresponding content in the current sectional drawing of row broadcasting mobile terminal screen.
It should be noted that in one embodiment of the invention, can provide to the user the interface of an interactive controlling with
It is operated for user.For example, can be carried out to mobile terminal current screen by the gesture operation of user in interactive process
Page turning (such as page up, lower one page)；For another example, user can be also class newspaper to layout pattern by the interactive controlling interface
Some block in the current sectional drawing of formula layout pattern is selected, and the block is identified with realizing.The present invention is implemented
The method that content in mobile terminal is provided to user of example, can first obtain the current sectional drawing of mobile terminal screen, later can be right
Current sectional drawing is analyzed to obtain the corresponding layout pattern of current sectional drawing, and current sectional drawing is identified according to layout pattern
To obtain the information of current sectional drawing, and voice is converted information into, and played, i.e., passed through the information on mobile terminal screen
OCR is converted into voice output so that user can obtain the content in mobile terminal current screen by the sense of hearing, liberate user
Eyes, alleviate user obtain information burden, the user experience is improved.
It should be noted that in one embodiment of the invention, as shown in figure 4, when preset OCR warehouse compartments are in high in the clouds
When, current sectional drawing can be uploaded to high in the clouds by mobile terminal, and high in the clouds is according to layout pattern by the preset libraries OCR in high in the clouds to current
Sectional drawing is identified to get the information of current sectional drawing, and high in the clouds can return this information to mobile terminal later.Then, mobile
Terminal can convert information into voice, and the voice is exported to be played out for user.
It should also be noted that, in one embodiment of the invention, when user is small in one long news of browsing or treatise
Whens saying etc., voice is being played, i.e., during voice output, can determine whether also have content behind current information, if so, then may be used
Auto Scroll is controlled, to obtain the sectional drawing of next screen；If no, speech play terminates.
In order to realize that above-described embodiment, the present invention also propose a kind of device that content in mobile terminal is provided to user,
Including：Acquisition module, the current sectional drawing for obtaining mobile terminal screen；Analysis module, for analyzing current sectional drawing
To obtain the corresponding layout pattern of current sectional drawing；Identification module, for being identified current sectional drawing to obtain according to layout pattern
Take the information of current sectional drawing；Conversion module, for converting information into voice；And playing module, for playing voice.
Fig. 5 is the structural representation of the device according to an embodiment of the invention that content in mobile terminal is provided to user
Figure.It should be noted that in an embodiment of the present invention, mobile terminal can be mobile phone, tablet computer, personal digital assistant etc.
Hardware device with various operating systems.
As shown in figure 5, the device that content in mobile terminal is provided to user may include：Acquisition module 10, analysis
Module 20, identification module 30, conversion module 40 and playing module 50.
Specifically, acquisition module 10 can be used for obtaining the current sectional drawing of mobile terminal screen.For example, it is assumed that by mobile terminal
The device that middle content is provided to user is applied in mobile terminal, and mobile terminal provides to the user with automatic interception mobile terminal
The application program of screen function, the application program can be run in back way, when detecting that user passes through news client
Whens reading news or reading electronic book or browsing webpage etc., which can intercept mobile terminal screen automatically, obtain mould
Block 10 can get the current sectional drawing of mobile terminal screen.
Analysis module 20 can be used for analyzing current sectional drawing to obtain the corresponding layout pattern of current sectional drawing.It is specific and
Speech, in one embodiment of the invention, as shown in fig. 6, analysis module 20 may include analytic unit 21 and acquiring unit 22.Tool
Body, analytic unit 21 can be used for analyzing current sectional drawing, to identify the main information module in current sectional drawing.It obtains single
Member 22 can be used for obtaining the corresponding layout pattern of current sectional drawing according to main information module.
For example, analytic unit 21 can carry out analyzing processing by data cleansing algorithm to current sectional drawing, such as can be right
For current sectional drawing by increasing the modes such as contrast, noise reduction, gray proces to promote discrimination, can for another example be handled by reduction will
Non-principal information module (such as advertisement) in current sectional drawing is got rid of, to identify the main information module in current sectional drawing.
Acquiring unit 22 can determine the corresponding layout mould of current sectional drawing according to distribution situation of the main information module in current sectional drawing
Formula.
Wherein, in an embodiment of the present invention, layout pattern can be that class letter formula layout pattern or class newspaper formula are laid out mould
Formula.For example, when distribution sequence of the main information mould information in the block in current sectional drawing be from top to bottom, from left to right when, can
Determine that the layout pattern corresponding to it is class letter formula layout pattern, as shown in Fig. 2, the scene of this class letter formula layout pattern
Usually user reads news, e-book etc.；For another example, it when main information module is multiple, and is distributed in current sectional drawing not
When with position, it may be determined that the layout pattern corresponding to it is class newspaper formula layout pattern, as shown in figure 3, this type newspaper formula cloth
The scene of office's pattern is usually that user browses webpage, using other applications (such as wechat).
Identification module 30 can be used for current sectional drawing being identified to obtain the information of current sectional drawing according to layout pattern.Tool
For body, in an embodiment of the present invention, identification module 30 can according to layout pattern by the preset libraries OCR to current sectional drawing into
Row identification is to obtain the information of current sectional drawing.Wherein, in an embodiment of the present invention, the preset libraries OCR can be located locally or cloud
End.
It should be noted that for example, when user more pays close attention to flow consumption, identification module 30 can be pre- by what is be located locally
If the libraries OCR current sectional drawing is identified, the local preset libraries OCR can be in suitable conditions (such as Wi-Fi (Wireless
Fidelity, Wireless Fidelity) environment or user force) under synchronous and update high in the clouds the preset libraries OCR.For another example, when user more
When being concerned about identification experience, identification module 30 can be identified current sectional drawing by the preset libraries OCR in high in the clouds.
It should also be noted that, due to contents and distribution's pattern in mobile terminal screen be it is different, according to cloth
The process that current sectional drawing is identified in office's pattern is also different.It can respectively introduce according to different layout patterns to working as below
The various process that preceding sectional drawing is identified.
For example, in one embodiment of the invention, when layout pattern is class letter formula layout pattern, mould is identified
Block 30 can be specifically used for：Current sectional drawing is identified according to the recognition sequence corresponding to class letter formula layout pattern, wherein know
Sequence is not sequence from top to bottom, from left to right.For example, when detecting that user wants to read news or e-book, mould is analyzed
It is class letter formula layout pattern that block 20, which can analyze the layout pattern corresponding to current sectional drawing, and identification module 30 can be cut according to current
Scheme the sequence of the information of layout from top to bottom, from left to right current sectional drawing is identified.
In one embodiment of the invention, when layout pattern is class newspaper formula layout pattern, identification module 30 can have
Body is used for：First current sectional drawing is identified according to class newspaper formula layout pattern, to obtain at least two information of current sectional drawing
Block.Each information block can be identified according to the recognition sequence corresponding to class letter formula layout pattern later.For example, working as
When detecting that user browses webpage or uses other applications (such as wechat), identification module 30 can be first according to class newspaper formula cloth
Current sectional drawing is identified in office's pattern, identifies the information block in current sectional drawing.Later, the selection instruction of user can be passed through
A certain block is first selected, then the block is identified according to the recognition sequence corresponding to class letter formula layout pattern, is identified
After end, its selected block is identified in next selection instruction to user, until selected by all users
Block all identification until.Current sectional drawing is known respectively by different modes according to different layout patterns as a result,
Not, the accuracy rate of recognition result is promoted.
Conversion module 40 can be used for converting information into voice.Playing module 50 can be used for playing voice.For example, modulus of conversion
Block 40 can convert information into voice by speech recognition technology.Playing module 50 voice can be exported for user into
Corresponding content in the current sectional drawing of row broadcasting mobile terminal screen.
It should be noted that in one embodiment of the invention, can provide to the user the interface of an interactive controlling with
It is operated for user.For example, can be carried out to mobile terminal current screen by the gesture operation of user in interactive process
Page turning (such as page up, lower one page)；For another example, user can be also class newspaper to layout pattern by the interactive controlling interface
Some block in the current sectional drawing of formula layout pattern is selected, and the block is identified with realizing.
The device that content in mobile terminal is provided to user of the embodiment of the present invention can be obtained by acquisition module and be moved
The current sectional drawing of terminal screen, analysis module are analyzed current sectional drawing to obtain the corresponding layout pattern of current sectional drawing, are known
Other module is identified current sectional drawing according to layout pattern to obtain the information of current sectional drawing, and conversion module converts information into
Voice, playing module play voice, i.e., convert the information on mobile terminal screen to voice output by OCR so that user
The content in mobile terminal current screen can be obtained by the sense of hearing, has liberated the eyes of user, user is alleviated and obtains information
Burden, the user experience is improved.
It should be noted that in one embodiment of the invention, as shown in figure 4, when preset OCR warehouse compartments are in high in the clouds
When, current sectional drawing can be uploaded to high in the clouds by mobile terminal, and high in the clouds is according to layout pattern by the preset libraries OCR in high in the clouds to current
Sectional drawing is identified to get the information of current sectional drawing, and high in the clouds can return this information to mobile terminal later.Then, mobile
Terminal can convert information into voice, and the voice is exported to be played out for user.
It should also be noted that, in one embodiment of the invention, when user is small in one long news of browsing or treatise
Whens saying etc., voice is being played, i.e., during voice output, can determine whether also have content behind current information, if so, then may be used
Auto Scroll is controlled, to obtain the sectional drawing of next screen；If no, speech play terminates.
In the description of this specification, reference term " one embodiment ", " some embodiments ", " example ", " specifically show
The description of example " or " some examples " etc. means specific features, structure, material or spy described in conjunction with this embodiment or example
Point is included at least one embodiment or example of the invention.In the present specification, schematic expression of the above terms are not
It must be directed to identical embodiment or example.Moreover, particular features, structures, materials, or characteristics described can be in office
It can be combined in any suitable manner in one or more embodiments or example.In addition, without conflicting with each other, the skill of this field
Art personnel can tie the feature of different embodiments or examples described in this specification and different embodiments or examples
It closes and combines.
In addition, term " first ", " second " are used for description purposes only, it is not understood to indicate or imply relative importance
Or implicitly indicate the quantity of indicated technical characteristic.Define " first " as a result, the feature of " second " can be expressed or
Implicitly include at least one this feature.In the description of the present invention, the meaning of " plurality " is at least two, such as two, three
It is a etc., unless otherwise specifically defined.
Any process described otherwise above or method description are construed as in flow chart or herein, and expression includes
It is one or more for realizing specific logical function or process the step of executable instruction code module, segment or portion
Point, and the range of the preferred embodiment of the present invention includes other realization, wherein can not press shown or discuss suitable
Sequence, include according to involved function by it is basic simultaneously in the way of or in the opposite order, to execute function, this should be of the invention
Embodiment person of ordinary skill in the field understood.
Expression or logic and/or step described otherwise above herein in flow charts, for example, being considered use
In the order list for the executable instruction for realizing logic function, may be embodied in any computer-readable medium, for
Instruction execution system, device or equipment (system of such as computer based system including processor or other can be held from instruction
The instruction fetch of row system, device or equipment and the system executed instruction) it uses, or combine these instruction execution systems, device or set
It is standby and use.For the purpose of this specification, " computer-readable medium " can any can be included, store, communicating, propagating or passing
Defeated program is for instruction execution system, device or equipment or the dress used in conjunction with these instruction execution systems, device or equipment
It sets.The more specific example (non-exhaustive list) of computer-readable medium includes following：Electricity with one or more wiring
Interconnecting piece (electronic device), portable computer diskette box (magnetic device), random access memory (RAM), read-only memory
(ROM), erasable edit read-only storage (EPROM or flash memory), fiber device and portable optic disk is read-only deposits
Reservoir (CDROM).In addition, computer-readable medium can even is that the paper that can print described program on it or other are suitable
Medium, because can be for example by carrying out optical scanner to paper or other media, then into edlin, interpretation or when necessary with it
His suitable method is handled electronically to obtain described program, is then stored in computer storage.
It should be appreciated that each section of the present invention can be realized with hardware, software, firmware or combination thereof.Above-mentioned
In embodiment, software that multiple steps or method can in memory and by suitable instruction execution system be executed with storage
Or firmware is realized.It, and in another embodiment, can be under well known in the art for example, if realized with hardware
Any one of row technology or their combination are realized：With the logic gates for realizing logic function to data-signal
Discrete logic, with suitable combinational logic gate circuit application-specific integrated circuit, programmable gate array (PGA), scene
Programmable gate array (FPGA) etc..
Those skilled in the art are appreciated that realize all or part of step that above-described embodiment method carries
Suddenly it is that relevant hardware can be instructed to complete by program, the program can be stored in a kind of computer-readable storage medium
In matter, which includes the steps that one or a combination set of embodiment of the method when being executed.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing module, it can also
That each unit physically exists alone, can also two or more units be integrated in a module.Above-mentioned integrated mould
The form that hardware had both may be used in block is realized, can also be realized in the form of software function module.The integrated module is such as
Fruit is realized in the form of software function module and when sold or used as an independent product, can also be stored in a computer
In read/write memory medium.
Storage medium mentioned above can be read-only memory, disk or CD etc..
Although the embodiments of the present invention has been shown and described above, it is to be understood that above-described embodiment is example
Property, it is not considered as limiting the invention, those skilled in the art within the scope of the invention can be to above-mentioned
Embodiment is changed, changes, replacing and modification.
Claims (6)
1. a kind of method that content in mobile terminal is provided to user, which is characterized in that include the following steps：
Obtain the current sectional drawing of mobile terminal screen；
The current sectional drawing is analyzed to obtain the corresponding layout pattern of the current sectional drawing；
The current sectional drawing is identified according to the layout pattern to obtain the information of the current sectional drawing；And
Voice is converted that information to, and is played；
Wherein, described analyzed the current sectional drawing is specifically included with obtaining the corresponding layout pattern of the current sectional drawing：
The current sectional drawing is analyzed, to identify the main information module in the current sectional drawing；And
The corresponding layout pattern of the current sectional drawing is obtained according to the main information module；
It is described that the current sectional drawing is analyzed, to identify the main information module in the current sectional drawing, including：
Analyzing processing is carried out to the current sectional drawing using data cleansing algorithm；
The current sectional drawing obtained after data cleansing Algorithm Analysis processing is carried out reducing processing to remove described work as
Non-principal information module in preceding sectional drawing identifies the main information module in the current sectional drawing in turn；
Further include：When playing the voice, judge whether also have content behind current information；
If so, auto Scroll is then controlled, to obtain the sectional drawing of next screen；If no, speech play terminates；
Wherein, the layout pattern is class letter formula layout pattern or class newspaper formula layout pattern；
It is described that the current sectional drawing is carried out according to the layout pattern when the layout pattern is class letter formula layout pattern
Identification specifically includes：
The current sectional drawing is identified according to the recognition sequence corresponding to the class letter formula layout pattern, wherein described
Recognition sequence is sequence from top to bottom, from left to right；
It is described that the current sectional drawing is carried out according to the layout pattern when the layout pattern is class newspaper formula layout pattern
Identification specifically includes：
The current sectional drawing is identified according to the class newspaper formula layout pattern, to obtain at least the two of the current sectional drawing
A information block；And
Each information block is identified according to the recognition sequence corresponding to the class letter formula layout pattern.
2. the method that content in mobile terminal is provided to user as described in claim 1, which is characterized in that described according to institute
It states layout pattern the current sectional drawing is identified and specifically included with the information for obtaining the current sectional drawing：
The current sectional drawing is identified to obtain by the libraries preset optical character identification OCR according to the layout pattern
State the information of current sectional drawing.
3. the method that content in mobile terminal is provided to user as claimed in claim 2, which is characterized in that described preset
The libraries optical character identification OCR are located locally or high in the clouds.
4. a kind of device that content in mobile terminal is provided to user, which is characterized in that including：
Acquisition module, the current sectional drawing for obtaining mobile terminal screen；
Analysis module, for being analyzed the current sectional drawing to obtain the corresponding layout pattern of the current sectional drawing；
Identification module, for the current sectional drawing being identified according to the layout pattern to obtain the letter of the current sectional drawing
Breath；
Conversion module, for converting that information to voice；And
Playing module, for playing the voice；Wherein, the analysis module includes：
Analytic unit, for analyzing the current sectional drawing, to identify the main information module in the current sectional drawing；With
And
Acquiring unit, for obtaining the corresponding layout pattern of the current sectional drawing according to the main information module；
Wherein, the analytic unit, is specifically used for：Analyzing processing is carried out to the current sectional drawing using data cleansing algorithm；
The current sectional drawing obtained after data cleansing Algorithm Analysis processing is carried out reducing processing to remove described work as
Non-principal information module in preceding sectional drawing identifies the main information module in the current sectional drawing in turn；
The playing module is additionally operable to when playing the voice, judges whether also have content behind current information；
If so, auto Scroll is then controlled, to obtain the sectional drawing of next screen；If no, speech play terminates；
Wherein, the layout pattern is class letter formula layout pattern or class newspaper formula layout pattern；
When the layout pattern is class letter formula layout pattern, the identification module is specifically used for：
The current sectional drawing is identified according to the recognition sequence corresponding to the class letter formula layout pattern, wherein described
Recognition sequence is sequence from top to bottom, from left to right；
When the layout pattern is class newspaper formula layout pattern, the identification module is specifically used for：
The current sectional drawing is identified according to the class newspaper formula layout pattern, to obtain at least the two of the current sectional drawing
A information block；And
Each information block is identified according to the recognition sequence corresponding to the class letter formula layout pattern.
5. content in mobile terminal to be provided to the device of user as claimed in claim 4, which is characterized in that the identification mould
Block is specifically used for：
The current sectional drawing is identified to obtain by the libraries preset optical character identification OCR according to the layout pattern
State the information of current sectional drawing.
6. content in mobile terminal to be provided to the device of user as claimed in claim 5, which is characterized in that described preset
The libraries optical character identification OCR are located locally or high in the clouds.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410773743.2A CN104461545B (en) | 2014-12-12 | 2014-12-12 | Content in mobile terminal is provided to the method and device of user |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410773743.2A CN104461545B (en) | 2014-12-12 | 2014-12-12 | Content in mobile terminal is provided to the method and device of user |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104461545A CN104461545A (en) | 2015-03-25 |
| CN104461545B true CN104461545B (en) | 2018-09-07 |
Family
ID=52907656
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410773743.2A Active CN104461545B (en) | 2014-12-12 | 2014-12-12 | Content in mobile terminal is provided to the method and device of user |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104461545B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106162636B (en) * | 2015-04-09 | 2019-05-17 | 厦门众联世纪科技有限公司 | The method of screenshot unlock WIFI hot spot |
| US10158549B2 (en) * | 2015-09-18 | 2018-12-18 | Fmr Llc | Real-time monitoring of computer system processor and transaction performance during an ongoing performance test |
| CN108605074B (en) * | 2017-01-26 | 2021-01-05 | 华为技术有限公司 | Method and equipment for triggering voice function |
| CN108229481B (en) * | 2017-12-25 | 2020-09-11 | ***通信集团江苏有限公司 | Screen content analysis method and device, computing equipment and storage medium |
| CN108269460B (en) * | 2018-01-04 | 2020-05-08 | 高大山 | Electronic screen reading method and system and terminal equipment |
| CN110427929B (en) * | 2019-07-19 | 2023-04-28 | 易诚高科（大连）科技有限公司 | APP interface mode identification method based on multilevel element fusion |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751568A (en) * | 2008-12-12 | 2010-06-23 | 汉王科技股份有限公司 | ID No. locating and recognizing method |
| CN102782703A (en) * | 2010-03-11 | 2012-11-14 | 微软公司 | Page layout determination of an image undergoing optical character recognition |
| CN103365988A (en) * | 2013-07-05 | 2013-10-23 | 百度在线网络技术（北京）有限公司 | Method and device for loud reading pictures and characters of mobile terminal and mobile terminal |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4771804B2 (en) * | 2005-12-20 | 2011-09-14 | 富士通株式会社 | Layout analysis program, layout analysis apparatus, layout analysis method |
| CN102681986A (en) * | 2012-05-23 | 2012-09-19 | 董名垂 | Webpage instant translation system and webpage instant translation method |
-
2014
- 2014-12-12 CN CN201410773743.2A patent/CN104461545B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101751568A (en) * | 2008-12-12 | 2010-06-23 | 汉王科技股份有限公司 | ID No. locating and recognizing method |
| CN102782703A (en) * | 2010-03-11 | 2012-11-14 | 微软公司 | Page layout determination of an image undergoing optical character recognition |
| CN103365988A (en) * | 2013-07-05 | 2013-10-23 | 百度在线网络技术（北京）有限公司 | Method and device for loud reading pictures and characters of mobile terminal and mobile terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104461545A (en) | 2015-03-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104461545B (en) | Content in mobile terminal is provided to the method and device of user | |
| CN104156405B (en) | searching method, system and device | |
| CN106155675B (en) | The page switching method and device of application program | |
| CN102868830A (en) | Switching control method and device of mobile terminal themes | |
| CN106210545A (en) | Video shooting method and device and electronic equipment | |
| CN108647305A (en) | document format conversion method and device | |
| CN112532897A (en) | Video clipping method, device, equipment and computer readable storage medium | |
| CN105069013B (en) | The control method and device of input interface are provided in search interface | |
| CN106250012A (en) | Screen intensity and color temperature adjusting method, device and terminal unit | |
| CN103823561A (en) | Expression input method and device | |
| CN103076950B (en) | A kind of management method of threads of conversation list | |
| CN106502493A (en) | A kind of multi-screen display method and terminal | |
| CN106776078A (en) | Clipboard content processing method and device and terminal equipment | |
| CN113238741A (en) | Form configuration method and device, electronic equipment and storage medium | |
| CN109582153A (en) | information input method and device | |
| CN104871122B (en) | Display control apparatus and display control method | |
| CN105279778A (en) | Method and terminal for picture color filling | |
| KR20160064040A (en) | Method and device for selecting information | |
| CN107728873A (en) | The method and its device of contents selection | |
| CN105760059A (en) | Message reading control method and device | |
| CN105094736A (en) | Display control method and device and electronic device | |
| CN104298654A (en) | Method and device for displaying information | |
| CN108959495A (en) | Page display method, device, equipment and the computer storage medium of H5 webpage | |
| CN102265610A (en) | Edited information provision device, edited information provision method, program, and storage medium | |
| US20130212500A1 (en) | Method and device for setting user interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |