CN102023805B - Method for assisting in browsing text messages on software interface - Google Patents
Method for assisting in browsing text messages on software interface Download PDFInfo
- Publication number
- CN102023805B CN102023805B CN2010105934993A CN201010593499A CN102023805B CN 102023805 B CN102023805 B CN 102023805B CN 2010105934993 A CN2010105934993 A CN 2010105934993A CN 201010593499 A CN201010593499 A CN 201010593499A CN 102023805 B CN102023805 B CN 102023805B
- Authority
- CN
- China
- Prior art keywords
- text
- screen cursor
- target window
- coordinate map
- current location
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a method for assisting in browsing text messages on a software interface, which comprises the following steps of: A, generating a text coordinate mapping table of a target window, wherein the text coordinate mapping table comprises texts and corresponding position coordinates in the target window; B, after a user moves a cursor on a screen by using input equipment, searching for the texts of interface elements closest to the current position of the cursor on the screen from the text coordinate mapping table; and C, displaying the contents of the found texts. In the method, the text coordinate mapping table is generated by acquiring the texts displayed on the software interface and the corresponding position coordinates, and is used for searching for the texts of the interface elements closest to the current position of the cursor on the screen to further realize the function of assisting the user in browsing the text messages on the software interface. In the method, the user can rapidly and conveniently skip to and browse each text message on the software interface.
Description
Technical field
The present invention relates to computer software technical field, relate in particular to a kind of auxiliary browsing method of software interface text message.
Background technology
Along with the progress at full speed of computer hardware technique, current society has got into informationalized epoch, and computing machine, the Internet, mobile communication have become the important component part of people's daily life, study and work.In information society, obtaining information and exchange of information through computing machine has become one of basic means of people's work and life, thereby information equality has become the basis that Everyone is equal in the information society.So-called information equality is exactly anyone under any circumstance can both equality, convenience, obtain information, exchange of information and utilize information without barrier.
The information accessibility is a people's livelihood engineering; It is the inevitable requirement that care spirit embodies in country and society; It is the substance of building comprehensive informationization society; Be realize industry comprehensively, the necessary ways of coordination and sustainable development, also be an important process that dwindles digital divide, sets up fair information society.
At present, the researchist has developed the multiple technology that is used to eliminate the various obstacles that exist when the blind person uses a computer, and MSAA (Microsoft Active Accessibility, Microsoft is active auxiliary) technology is exactly one of them.For the application program that meets the MSAA technical standard, when blind users through input equipment (keyboard, mouse etc.) when screen cursor is navigated to a certain position of Application Program Interface, application program or read to shield software and can brightly read the text that this position comprises.For example, when the current location of screen cursor was button, application program can be read the literal that shows on this button.
Simultaneously, in order to satisfy the user to the ease for use of software product, extendability and personalized demand, that the exploitation of software interface is more and more stressed is efficient, be easy to expansion and art up, and the shared proportion in the common standardization interface of people is in continuous reduction.For example; The software client product of exploitations such as the software developer Tengxun of China, a sudden peal of thunder adopts aforesaid way to come the design software interface more, thereby well software interface is separated with function logic, is easy to realize various interfacial effects simultaneously; As change skin, transparent etc.But this software interface development technique is not supported the MSAA technical standard, causes existingly reading to shield software and can't obtaining the text message that comprises in these softwares, and blind users can't be operated these softwares, uses a computer to the blind person and brings very big inconvenience.
Summary of the invention
Technical matters to be solved by this invention is, overcomes the deficiency of prior art, provides a kind of under the situation that technical standards such as not needing MSAA is supported, realizes the auxiliary method of browsing of software interface text message.
In order to address the above problem, the present invention provides a kind of auxiliary browsing method of software interface text message, and this method comprises the steps:
A: the text coordinate map that generates target window; Comprise the text and the corresponding position coordinates that show on the said target window in the said text coordinate map;
B: after the user uses input equipment moving screen pointer, in said text coordinate map, search text with the immediate interface element of current location of screen cursor;
C: the content of playing the text that finds.
In addition, after said step B, also comprise following steps:
If in said text coordinate map, find the text with the immediate interface element of current location of screen cursor, then, screen cursor navigated to corresponding position according to the pairing position coordinates of the text that writes down in the said text coordinate map.
In addition, in said step B, adopt following mode in said text coordinate map, to search the text with the immediate interface element of current location of screen cursor:
According to the moving direction of screen cursor, in said text coordinate map, search on this moving direction text with the immediate interface element of current location of screen cursor.
In addition, in said step B, adopt following mode to realize moving direction, in said text coordinate map, search on this moving direction text with the immediate interface element of current location of screen cursor according to screen cursor:
When the moving direction of screen cursor for upwards the time, if there is text the top of the row under the screen cursor current location, then obtain be positioned at these row with the immediate text of screen cursor current location; Otherwise screen cursor is moved row or multiple row to the left or to the right and upwards searches in respective column, reach the left margin or the right margin of said target window up to finding text or screen cursor;
When the moving direction of screen cursor when being downward, if there is text the below of the row under the screen cursor current location, then obtain be positioned at these row with the immediate text of screen cursor current location; Otherwise reach the right margin or the left margin of said target window up to finding text or screen cursor to the right downwards with screen cursor or be moved to the left row or multiple row and search, in respective column;
When the moving direction of screen cursor for left the time, if the left of the row under the screen cursor current location has text, then obtain be positioned at this row with the immediate text of screen cursor current location; Otherwise screen cursor is moved up or down delegation or multirow and searches left in corresponding row, reach the coboundary or the lower boundary of said target window up to finding text or screen cursor;
When the moving direction of screen cursor for to the right the time, if there is text on the row under the screen cursor current location right-hand, then obtain be positioned at this row with the immediate text of screen cursor current location; Otherwise screen cursor is moved delegation or multirow downward or upward and searches to the right in corresponding row, reach the lower boundary or the coboundary of target window up to finding text or screen cursor.
In addition, in said step B, the user uses after the input equipment moving screen pointer, in said text coordinate map, search before the text with the immediate interface element of current location of screen cursor, also comprises the steps:
B1: whether the current location of judging screen cursor is inner at said target window, if do not exist, then the current location of screen cursor navigated to the inside of said target window.
In addition, in said step B1, the inside of said target window is the border of said target window.
In addition, in said step B1, the border of said target window is the upper left corner of said target window.
In addition, in said step B1,, then adopt the current location of one of following mode positioning screen pointer if judge that the current location of screen cursor is not inner at said target window:
When the user moves right screen cursor, the initial position fix of screen cursor is arrived the left margin of said target window;
When the user is moved to the left screen cursor, the initial position fix of screen cursor is arrived the right margin of said target window;
When the user moves down screen cursor, the initial position fix of screen cursor is arrived the coboundary of said target window;
When the user moves up screen cursor, the initial position fix of screen cursor is arrived the lower boundary of said target window.
In addition, after said steps A, also comprise the steps:
When receiving prospect conversion message, empty the content in the said text coordinate map, the current active window as new target window, is generated the text coordinate map of this new target window.
In addition, after said steps A, also comprise the steps:
When the drag and drop that receive said target window begin message, empty the content in the said text coordinate map;
When message is accomplished in the drag and drop that receive said target window, regenerate the text coordinate map of said target window.
In addition, after said steps A, also comprise the steps:
Repeat following operation with pre-set time interval: empty the content in the said text coordinate map; Regenerate the text coordinate map of said target window or with the current active window as new target window, generate the text coordinate map of this new target window.
In sum; The invention provides a kind of method that does not rely on the assisted user browsing software interface text message of MSAA technology realization; This method generates the text coordinate map through obtaining the text and the corresponding position coordinates that show on the software interface; And use the text coordinate map to search the text with the immediate interface element of current screen pointer position, and then realize the function of assisted user browsing software interface text message.This method can let the user between each text message on the software interface, carry out redirect quickly, browse.In addition, method of the present invention has been used shortcut seldom, operates convenient and hommization, greatly reduces the threshold of blind users function software.Method of the present invention has good versatility, can support various softwares based on Windows (Windows) environment.
Description of drawings
Fig. 1 is the process flow diagram of the auxiliary browsing method of embodiment of the invention software interface text message.
Embodiment
Core of the present invention is; Generation comprises the text that shows on the software interface and the text coordinate map of corresponding position coordinates; When the user uses input equipment moving screen pointer; In the text coordinate map, search the text with the immediate interface element of current screen pointer position, and play the content of the text that finds.
To combine accompanying drawing and embodiment to describe the present invention below.
Fig. 1 is the process flow diagram of the auxiliary browsing method of embodiment of the invention software interface text message.As shown in Figure 1, this method comprises following steps:
Step 101: the system's operation information that obtains the current software that is using of user's (being generally blind users) (can be described as target software or target program);
The said system operation information comprises: process ID (Identification, identifier), window handle.
Above-mentioned process ID is used in and carries out the operation that remote thread injects DLL (Dynamic LinkLibrary, dynamic link library) in the subsequent step; Above-mentioned window handle can be used for obtaining target program position of window information.
Step 102: carry out the operation that remote thread injects DLL;
Specifically; Can be in this step through the process ID of target program; In the process (can be described as target process) of correspondence, create remote thread, and in this remote thread, load the dynamic link library (can be called text intercepting api calls chained library) that also initialization is used to tackle the text output function.
Step 103: operation below in text intercepting api calls chained library, carrying out: the DLL of target process import find in the list item name be called GDI32.DLL, the entry address that corresponding self-defined text output function is revised as in the entry address of the text output function (can be described as system's text output function) that is provided by system that wherein comprises; And the entry address of the system's text output function before the record modification;
Said system text output function comprises: TextOutA, TextOutW, ExtTextOutA, ExtTextOutW and ScriptShape etc.; Corresponding self-defined text output function can be remembered work: MyTextOutA, MyTextOutW, MyExtTextOutA, MyExtTextOutW and MyScriptShape etc.
Step 104: the target window that initiatively refreshes target program (is generally the active window when front desktop; Or be called foreground window); Or the wait target window is refreshed, and (can be called passive refreshing, for example, target window is switched to active window by inactive window; Target window will be refreshed), with initiating system calling to the text output function.
Above-mentioned active refresh with the passive scope that refreshes that refreshes can be whole target window, also can be the part of target window.
Step 105: when drawing when system call system text output function so that to the interface element that comprises text in the window; Because the entry address of in step 103, self-defined text output function being revised as in the entry address of system's text output function; Therefore caused system's calling to self-defined text output function; Self-defined text output function generates the text coordinate map of target window according to the function call parameter of systems communicate;
The above-mentioned interface element that comprises text can be: title block, menu, toolbar, address field, client area etc.
Comprise in the above-mentioned function call parameter: text and corresponding relative position coordinates.Above-mentioned relative position coordinates is the position coordinates (be generally position coordinates with respect to the target window upper left corner) of text with respect to target window.
Comprised the target window Chinese version in the above-mentioned text coordinate map, and the pairing position coordinates of the text.In the present embodiment, above-mentioned position coordinates is a relative position coordinates.
In other embodiments of the invention, above-mentioned position coordinates can be absolute location coordinates (being the position coordinates of text with respect to desktop).The absolute location coordinates of text can draw according to the relative position coordinates of text and the positional information conversion of target window.
In the present embodiment; In self-defined text output function; After text and corresponding position coordinates write the text coordinate map, can call corresponding system's text output function and accomplish follow-up text output function (promptly drawing corresponding text) at the ad-hoc location of target window.Certainly, also can never call corresponding system's text output function, accomplish follow-up text output function by self-defined text output function.
It should be noted that; One or more systems text output function may repeatedly call in system in this step; Thereby can repeatedly call one or more self-defined text output functions; Call all at every turn and can in the text coordinate map, write a record, finally generate complete target window text coordinate map.
Step 106: when the user uses input equipment (for example; Keyboard) carries out after the operation of moving screen pointer (for example, when pressing a certain directionkeys), (for example obtain screen cursor; Mouse pointer, cursor etc.) current location; And whether judge current screen cursor in the inside of target window, if do not exist, then execution in step 107; Otherwise jump to step 108;
In the present embodiment, can the window handle through target window obtain the positional information of target window, and judge that according to the positional information of the current location of screen cursor and target window screen cursor is whether in the inside of target window.
Above-mentioned position of window information is generally the coordinate in the window rectangle upper left corner, and the length and width value of window; Certainly,, also can otherwise represent position of window information, for example, represent the positional information of rectangular window with the coordinate in the rectangle upper left corner and the lower right corner according to the difference of system.
Step 107: the inside (border that comprises window) that the initial position (current location) of screen cursor is navigated to target window;
For the ease of user's subsequent operation, usually the initial position fix of screen cursor is arrived the border (for example, coboundary or lower boundary or left margin or right margin) of target window in this step.
In the present embodiment, if current screen cursor not in the inside of target window, then arrives the initial position fix of screen cursor the upper left corner of target window.
In other embodiments of the invention, can also confirm the initial position of screen cursor according to user's direction of operating (being the moving direction of screen cursor).For example:
When the user presses directionkeys to the right, and the current location of screen cursor is when the inside of target window, and with the initial position fix of the screen cursor left margin (comprising the upper left corner and the lower left corner) to target window, preferred version is for navigating to the upper left corner;
When the user presses directionkeys left, and the current location of screen cursor is when the inside of target window, and with the initial position fix of the screen cursor right margin (comprising the upper right corner and the lower right corner) to target window, preferred version is for navigating to the upper right corner;
When the user presses downward directionkeys, and the current location of screen cursor is when the inside of target window, and with the initial position fix of the screen cursor coboundary (comprising the upper left corner and the upper right corner) to target window, preferred version is for navigating to the upper left corner;
When the user presses directionkeys upwards, and the current location of screen cursor is when the inside of target window, and with the initial position fix of the screen cursor lower boundary (comprising the lower left corner and the lower right corner) to target window, preferred version is for navigating to the lower left corner.
Step 108: in the text coordinate map, search text with the immediate interface element of current screen pointer position; This step can be through doing the position coordinates of each text in the coordinate of current screen pointer and the text coordinate map to recently realizing;
In addition, carry out follow-up operation, behind the text that finds with the immediate interface element of current screen pointer position, also need screen cursor be navigated to the corresponding position of the text in this step for the ease of the user.
As preferred scheme, in the present embodiment, can in the text coordinate map, search on this direction the text with the immediate interface element of current screen pointer position according to user's direction of operating (being the moving direction of screen cursor); For example:
When the user presses directionkeys upwards, if there is text the top of the row under the screen cursor current location, then obtain be positioned at these row with the immediate text of screen cursor current location; Otherwise with screen cursor left (or to the right) move row or multiple row and upwards search in respective column, reach the left margin (or right margin) of target window up to finding text or screen cursor.
When the user presses downward directionkeys, if there is text the below of row under the screen cursor current location, then obtain be positioned at these row with the immediate text of screen cursor current location; Otherwise with screen cursor to the right (or left) move row or multiple row and search downwards in respective column, reach the right margin (or left margin) of target window up to finding text or screen cursor.
When the user presses directionkeys left, if the left of row under the screen cursor current location has text, then obtain be positioned at this row with the immediate text of screen cursor current location; Otherwise screen cursor is made progress (or downwards) moves delegation or multirow and searches left in corresponding row, reaches the coboundary (or lower boundary) of target window up to finding text or screen cursor.
When the user presses directionkeys to the right, if there is text on row right-hand under the screen cursor current location, then obtain be positioned at this row with the immediate text of screen cursor current location; Otherwise with screen cursor downwards (or upwards) move delegation or multirow and search to the right in corresponding row, reach the lower boundary (or coboundary) of target window up to finding text or screen cursor.
Step 109: the content of the text that broadcast (adopting the mode of reading aloud usually) finds.
Step 110: when the user closes target program, empty the text coordinate map;
When the user closes target program; Usually can trigger the dynamic link library unloading event (DLL_PROCESS_DETACH incident) of text intercepting api calls chained library; And this incident is handled in the entrance function (being generally the DllMain function) of text intercepting api calls chained library usually; Therefore can differentiate in the entrance function of text intercepting api calls chained library whether the dynamic link library unloading event takes place; When this incident of generation, empty the text coordinate map, and (recovery) entry address for the system's text output function before revising is revised in the entry address of the text output function that comprises among the GDI32.DLL.
The pairing flow process of Fig. 1 described in detail target window text coordinate map generation (step 101～105), screen cursor initial position location (step 106～107) and to browsing the whole process of (step 108～109) with the text of the immediate interface element of screen cursor current location.Do not carry out the switching of application/window the user, and do not carry out window and move under the situation with operation such as convergent-divergent, adopt said method can help the user fast and accurately the text message of software interface (window) to be browsed.
For conserve system resources, only generate and use a text coordinate map usually, the corresponding active window of text coordinate map when front desktop.In this case; When carrying out application/window, the user switches or carries out window when moving with operation such as convergent-divergent; Text in the text coordinate map and/or corresponding position coordinates can with the pairing information inconsistency of active window when front desktop; Need upgrade operation to the text coordinate map, will briefly introduce corresponding method below.
The update method of text coordinate map when carrying out the application program switching
When the user starts new application program; The window of this new application program is switched to the active window when front desktop automatically; Or the user manually carries out the application program switching; For when the active window of front desktop, can adopt one of following mode to carry out the renewal of text coordinate map the window manual switchover of other application program:
Mode one (manual refreshing): when window that the user receives notice that new application program launching accomplishes or new application program has switched to after the notice of the active window of front desktop; Use the text coordinate map updating interface that is provided with in advance to accomplish following operation: to empty the content in the current text coordinate map; The current active window is regenerated text coordinate map (can adopt the method for Fig. 1 step 101～105) as target window; If adopt method shown in Figure 1, also need (recovery) entry address for the system's text output function before revising be revised in the entry address of the text output function that comprises among the former application program GDI32.DLL;
Above-mentioned text coordinate map updating interface is realized by shortcut that is provided with in advance and corresponding button handling procedure usually.
Mode two (refreshing automatically): the prospect conversion message of sending when the system that receives (for example; EVENT_SYSTEM_FOREGROUND message); Show when new window becomes current active window; In corresponding message processing program, accomplish following operation: judge whether the pairing application program of current active window (process) is consistent with the pairing application program of text coordinate map (process); Inconsistent if (showing the switching that application program has taken place); Then empty the content in the current text coordinate map; The current active window is regenerated text coordinate map (can adopt the method for Fig. 1 step 101～105) as target window,, also need (recovery) entry address for the system's text output function before revising be revised in the entry address of the text output function that comprises among the former application program GDI32.DLL if adopt method shown in Figure 1;
Need write down the process ID of the pairing application program of current text coordinate map when adopting this mode to refresh the text coordinate map, so that carry out above-mentioned judgement.
Mode three (periodic refreshing): (for example with pre-set time interval; 10 seconds) repeat following operation: judge whether the pairing application program of current active window (process) is consistent with the pairing application program of text coordinate map (process); Inconsistent if (showing the switching that application program has taken place); Then empty the content in the current text coordinate map; The current active window is regenerated text coordinate map (can adopt the method for Fig. 1 step 101～105) as target window; If adopt method shown in Figure 1, also need (recovery) entry address for the system's text output function before revising be revised in the entry address of the text output function that comprises among the former application program GDI32.DLL;
Need write down the process ID of the pairing application program of current text coordinate map when adopting this mode to refresh the text coordinate map, so that carry out above-mentioned judgement.
The update method of text coordinate map when carrying out switching between the different windows of same application
Mode four (refreshing automatically): the prospect conversion message of sending when the system that receives (for example; EVENT_SYSTEM_FOREGROUND message); Show when new window becomes current active window; In corresponding message processing program, accomplish following operation: judge whether the pairing application program of current active window (process) is consistent with the pairing application program of text coordinate map (process); If consistent (showing that the window that same application has taken place switches) then empties the content in the current text coordinate map, force to refresh window interface (can realize) through draw modes such as transparent window in window surface; To trigger step 105, accomplish the regenerating of text coordinate map of current active window (being new target window);
Need write down the process ID of the pairing application program of current text coordinate map when adopting this mode to refresh the text coordinate map, so that carry out above-mentioned judgement.
Mode five (periodic refreshing): (for example with pre-set time interval; 10 seconds) repeat following operation: judge whether pairing application program of current active window (process) and window be consistent with pairing application program of text coordinate map (process) and window; If application-consistent and window inconsistent (showing that the window that same application has taken place switches); Then empty the content in the current text coordinate map; And pressure refreshes current active window (can realize through draw modes such as transparent window in window surface); To trigger step 105, accomplish the regenerating of text coordinate map of current active window (being new target window);
Need write down the process ID of the pairing application program of current text coordinate map when adopting this mode to refresh the text coordinate map, and corresponding window handle, so that carry out above-mentioned judgement.
Carry out that window moves or the update method of text coordinate map during zoom operations
When the user moves target window or during zoom operations, the text of target window and corresponding position coordinates thereof can change, and can adopt one of following mode to carry out the renewal of text coordinate map:
Mode six (refreshing automatically): the drag and drop of the target window that sends when the system that receives (for example begin message; EVENT_SYSTEM_DRAGDROPSTART message); Show that the user begins to carry out that window moves or during zoom operations, in corresponding message processing program, accomplish following operation: empty the content in the current text coordinate map; When the drag and drop of the target window that receives system's transmission (are for example accomplished message; EVENT_SYSTEM_DRAGDROPEND message); Show that the user has accomplished that window moves or during zoom operations; In corresponding message processing program, accomplish following operation: force to refresh window interface (can realize),, accomplish regenerating of text coordinate map to trigger step 105 through draw modes such as transparent window in window surface.
Mode seven (periodic refreshing): (for example with pre-set time interval; 10 seconds) repeat following operation: judge whether pairing application program of current active window (process) and window be consistent with pairing application program of text coordinate map (process) and window; All if consistent (showing the switching that application program and window do not take place); Then empty the content in the current text coordinate map; And force to refresh current active window (can realize) through draw modes such as transparent window in window surface, to trigger step 105, accomplish regenerating of text coordinate map;
Need write down the process ID of the pairing application program of current text coordinate map when adopting this mode to refresh the text coordinate map, and corresponding window handle, so that carry out above-mentioned judgement.
In addition, employing mode seven is carried out the part that can also prevent window interior of refreshing of text coordinate map and is refreshed the text coordinate map information errors that is caused.
It should be noted that; The above embodiment of the present invention is through interception API (ApplicationProgramming Interface; API) calls; Be the function call parameter that mode that intercepting system text output function calls is obtained system's text output function, and the function call parameter of using system text output function (comprising text and corresponding position coordinates) generate the text coordinate map; In other embodiments of the invention; Can also adopt alternate manner to obtain the function call parameter of system's text output function; For example: directly rewrite (replacement) system text output function, in system's text output function, in the text coordinate map of current active window, write this function calls parameter (comprising text and corresponding position coordinates).
In addition, except the described API hold-up interception method of the embodiment of the invention, can also adopt modes such as Hook Function (SetWindowsHookEx), modification registration table are set to carry out the interception of API, concrete grammar sees also relevant documentation.
In addition; For application designer; Also can adopt following mode to generate the text coordinate map: in application program, to add the code that is used to generate the text coordinate map; For example, (in the function of normally ON_PAINT message being handled) will be to be drawn when carrying out the window drafting text and corresponding position coordinates write the text coordinate map voluntarily.
Compared with prior art, beneficial effect of the present invention is embodied in following several aspect:
(1) high efficiency: the present invention has realized that the assisted user (being generally blind users) based on the API interception carries out browsing method to the software interface text message under the Windows environment; This method makes the user pass through shortcut can be at Word message on the rapid browsing software of the four direction interface up and down; This mode of operation has been utilized existing software layout well; Make the operating habit of blind users gradually consistent, manipulate software more efficiently with normal users;
(2) ease for use: method of the present invention has been used less shortcut, operates convenient and hommization, has reduced the threshold that blind users carries out software operation widely;
(3) versatility: method of the present invention need not to adopt the MSAA technology, supports the software of various windows platform more widely, makes blind users when using software, more selection can be arranged.
Claims (11)
1. the auxiliary browsing method of a software interface text message is characterized in that, this method comprises the steps:
A: the system's operation information that obtains the current target program that is using of user; Said system operation information comprises process ID; In target process, create remote thread through process ID; And in this remote thread, load the dynamic link library (DLL) that also initialization is used to tackle the text output function; Import in the list item at the dynamic link library (DLL) of target process and to find an item, the entry address that corresponding self-defined text output function is revised as in the entry address of the text output function that the system that comprises in this is provided is when system draws the target window of target program; Word content that can obtain to export on the target window and respective coordinates finally generate the text coordinate map of target window; Comprise the text and the corresponding position coordinates that show on the said target window in the said text coordinate map;
B: after the user uses input equipment moving screen pointer, in said text coordinate map, search text with the immediate interface element of current location of screen cursor;
C: the content of playing the text that finds.
2. the method for claim 1 is characterized in that,
After said step B, also comprise following steps:
If in said text coordinate map, find the text with the immediate interface element of current location of screen cursor, then, screen cursor navigated to corresponding position according to the pairing position coordinates of the text that writes down in the said text coordinate map.
3. according to claim 1 or claim 2 method is characterized in that,
In said step B, adopt following mode in said text coordinate map, to search the text with the immediate interface element of current location of screen cursor:
According to the moving direction of screen cursor, in said text coordinate map, search on this moving direction text with the immediate interface element of current location of screen cursor.
4. method as claimed in claim 3 is characterized in that,
In said step B, adopt following mode to realize moving direction according to screen cursor, in said text coordinate map, search on this moving direction text with the immediate interface element of current location of screen cursor:
When the moving direction of screen cursor for upwards the time, if there is text the top of the row under the screen cursor current location, then obtain be positioned at these row with the immediate text of screen cursor current location; Otherwise screen cursor is moved row or multiple row to the left or to the right and upwards searches in respective column, reach the left margin or the right margin of said target window up to finding text or screen cursor;
When the moving direction of screen cursor when being downward, if there is text the below of the row under the screen cursor current location, then obtain be positioned at these row with the immediate text of screen cursor current location; Otherwise reach the right margin or the left margin of said target window up to finding text or screen cursor to the right downwards with screen cursor or be moved to the left row or multiple row and search, in respective column;
When the moving direction of screen cursor for left the time, if the left of the row under the screen cursor current location has text, then obtain be positioned at this row with the immediate text of screen cursor current location; Otherwise screen cursor is moved up or down delegation or multirow and searches left in corresponding row, reach the coboundary or the lower boundary of said target window up to finding text or screen cursor;
When the moving direction of screen cursor for to the right the time, if there is text on the row under the screen cursor current location right-hand, then obtain be positioned at this row with the immediate text of screen cursor current location; Otherwise screen cursor is moved delegation or multirow downward or upward and searches to the right in corresponding row, reach the lower boundary or the coboundary of target window up to finding text or screen cursor.
5. the method for claim 1 is characterized in that,
In said step B, the user uses after the input equipment moving screen pointer, in said text coordinate map, search before the text with the immediate interface element of current location of screen cursor, also comprises the steps:
B1: whether the current location of judging screen cursor is inner at said target window, if do not exist, then the current location of screen cursor navigated to the inside of said target window.
6. method as claimed in claim 5 is characterized in that,
In said step B1, the inside of said target window is the border of said target window.
7. method as claimed in claim 6 is characterized in that,
In said step B1, the border of said target window is the upper left corner of said target window.
8. method as claimed in claim 6 is characterized in that,
In said step B1,, then adopt the current location of one of following mode positioning screen pointer if judge that the current location of screen cursor is not inner at said target window:
When the user moves right screen cursor, the initial position fix of screen cursor is arrived the left margin of said target window;
When the user is moved to the left screen cursor, the initial position fix of screen cursor is arrived the right margin of said target window;
When the user moves down screen cursor, the initial position fix of screen cursor is arrived the coboundary of said target window;
When the user moves up screen cursor, the initial position fix of screen cursor is arrived the lower boundary of said target window.
9. the method for claim 1 is characterized in that,
After said steps A, also comprise the steps:
When receiving the message of foreground window conversion, empty the content in the said text coordinate map, the current active window as new target window, is generated the text coordinate map of this new target window.
10. the method for claim 1 is characterized in that,
After said steps A, also comprise the steps:
When the drag and drop that receive said target window begin message, empty the content in the said text coordinate map;
When message is accomplished in the drag and drop that receive said target window, regenerate the text coordinate map of said target window.
11. the method for claim 1 is characterized in that,
After said steps A, also comprise the steps:
Repeat following operation with pre-set time interval: empty the content in the said text coordinate map; Regenerate the text coordinate map of said target window or with the current active window as new target window, generate the text coordinate map of this new target window.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105934993A CN102023805B (en) | 2010-12-16 | 2010-12-16 | Method for assisting in browsing text messages on software interface |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2010105934993A CN102023805B (en) | 2010-12-16 | 2010-12-16 | Method for assisting in browsing text messages on software interface |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN102023805A CN102023805A (en) | 2011-04-20 |
| CN102023805B true CN102023805B (en) | 2012-08-22 |
Family
ID=43865141
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2010105934993A Expired - Fee Related CN102023805B (en) | 2010-12-16 | 2010-12-16 | Method for assisting in browsing text messages on software interface |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102023805B (en) |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103365555A (en) | 2012-03-31 | 2013-10-23 | 国际商业机器公司 | Data processing method and system and data collecting method and system |
| CN104951188A (en) * | 2015-06-18 | 2015-09-30 | 烟台朱葛软件科技有限公司 | Visual information interactive method and control system |
| CN109597541A (en) * | 2018-10-30 | 2019-04-09 | 北京五岳鑫信息技术股份有限公司 | A kind of character method for transformation and system |
| CN113490025A (en) * | 2021-08-03 | 2021-10-08 | Vidaa美国公司 | Display apparatus and electronic program guide display method |
| CN114816401B (en) * | 2022-04-13 | 2022-12-23 | 上海弘玑信息技术有限公司 | Interface element positioning method, electronic equipment and storage medium |
| CN115061685B (en) * | 2022-06-30 | 2023-07-21 | 上海弘玑信息技术有限公司 | Interface element positioning method of software client, electronic equipment and storage medium |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5374924A (en) * | 1991-08-19 | 1994-12-20 | International Business Machines Corporation | Computer user interface with stereo and filtered sound effects |
| CN101201718A (en) * | 2006-09-14 | 2008-06-18 | 阿瓦雅技术有限公司 | Audible computer user interface method and apparatus |
-
2010
- 2010-12-16 CN CN2010105934993A patent/CN102023805B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5374924A (en) * | 1991-08-19 | 1994-12-20 | International Business Machines Corporation | Computer user interface with stereo and filtered sound effects |
| CN101201718A (en) * | 2006-09-14 | 2008-06-18 | 阿瓦雅技术有限公司 | Audible computer user interface method and apparatus |
Non-Patent Citations (1)
| Title |
|---|
| 郑志.残疾人人机交互辅助***设计与实现.《中国优秀硕士论文全文数据库》.2010,全文. * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN102023805A (en) | 2011-04-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102023805B (en) | Method for assisting in browsing text messages on software interface | |
| US7017118B1 (en) | Method and apparatus for reordering data items | |
| US20210141523A1 (en) | Platform-independent user interface system | |
| US20140089824A1 (en) | Systems And Methods For Dynamically Altering A User Interface Based On User Interface Actions | |
| JP3372261B2 (en) | Method and apparatus for reformatting a mobile device screen using hypertext | |
| US20120297341A1 (en) | Modified Operating Systems Allowing Mobile Devices To Accommodate IO Devices More Convenient Than Their Own Inherent IO Devices And Methods For Generating Such Systems | |
| JP2001014079A (en) | User interface, user interface method, and computer program product capable of preserving space on computer display screen by relating icon to multiple operations | |
| US20050216834A1 (en) | Method, apparatus, and computer-readable medium for dynamically rendering a user interface menu | |
| CN110417988A (en) | A kind of interface display method, device and equipment | |
| CN106293315A (en) | The method and apparatus that floating frame shows | |
| JPH06208448A (en) | Method for supplying set-browser having browser item to application and computer control display device therefor | |
| CN101661498A (en) | Information search method and device | |
| CN102141868B (en) | Method for quickly operating information interaction page, input method system and browser plug-in | |
| US20130067394A1 (en) | Pointer invocable navigational user interface | |
| JP2014533403A (en) | Providing keyboard shortcuts mapped to the keyboard | |
| CN102929556A (en) | Method and equipment for interaction control based on touch screen | |
| CN101493750A (en) | Application program control input method and device based on touch screen input | |
| WO2014052082A1 (en) | Automatically creating tables of content for web pages | |
| CN105247470A (en) | Multiple displays for displaying workspaces | |
| CN110347459B (en) | Window minimization method and device, storage medium and interactive intelligent panel | |
| WO2014158221A1 (en) | Start and application navigation | |
| KR20160073714A (en) | Electronic Device and Method of Displaying Web Page Using the same | |
| WO2018112856A1 (en) | Location positioning method and device based on voice control, user equipment, and computer program product | |
| CN108492349B (en) | Processing method, device and equipment for writing strokes and storage medium | |
| CN102637125A (en) | Display method and mobile terminal of grid interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120822 Termination date: 20121216 |