CN101645966A - Automation operating system on mobile phone terminal - Google Patents
Automation operating system on mobile phone terminal Download PDFInfo
- Publication number
- CN101645966A CN101645966A CN200910034734A CN200910034734A CN101645966A CN 101645966 A CN101645966 A CN 101645966A CN 200910034734 A CN200910034734 A CN 200910034734A CN 200910034734 A CN200910034734 A CN 200910034734A CN 101645966 A CN101645966 A CN 101645966A
- Authority
- CN
- China
- Prior art keywords
- mobile phone
- script
- operating system
- script file
- shortcut
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Telephone Function (AREA)
Abstract
The invention relates to an automation operating system on a mobile phone terminal, which comprises hardware and software capable of receiving a user command. The automation operating system on the mobile phone terminal is characterized in that after the software existing in the prior PC is compiled and installed in an operating system of a mobile phone, a script generator is realized by a pythonscript language; the script generator is communicated with a desktop application by Accessibility technologies software, and an executable python script file is generated when a desktop application program is operated to record a system event and information relevant to the application; when the script file is executed, the script generator is communicated with the desktop application to transmitthe recorded system event to the application and play back the desktop application program so as to realize the automation operation of recognition memory and playback of the mobile phone. The systemcan simplify the function operation of the mobile phone, is particular suitable for being adopted on a mobile phone of a blind person, can reduce the error operation probability of the blind person inthe process of using the mobile phone and is simplifier and effective to operate.
Description
Technical field
The present invention relates to mobile phone, the automation operating system on particularly a kind of mobile phone terminal.
Background technology
In general mobile phone, the feature operation major part is by graphical interfaces prompting down, button operation or the touch operation feature operation of finishing appointment of user by step by step.The mode that this progressively button operation is finished appointed function is a kind of original method of operation.The memoryless function of this method will be finished function corresponding at every turn and all must repeat identical complicated button.For seeking feature operation more efficiently,, realized following several methods of operation by the customization of program:
1, shortcut: be to make a kind of more efficiently mode of operation.Shortcut can be regarded as the pointer that points to certain object (program or file), and when you clicked, system just found this object according to the information that writes down in the shortcut, carries out corresponding operation (move certain program or open certain file) again.
2, shortcut: it can make you only by just the menu of complexity being controlled and operated by a fewer keys, thereby finishes a function.
Become simple though above-mentioned shortcut makes a program of operation or opens a file, and can customize the shortcut of oneself, customizable content is very limited.The shortcut method can be finished a function by a fewer keys, such as, can be used for starting certain program, perhaps alternative menu item mode is come a certain function in the executive utility operating process.Shortcut and shortcut have obtained widespread usage at present, also above certain Cheng Du the user to the use of cell-phone function.But the inside that two kinds of methods generally all are the mobile phone software and hardwares realizes, the user can't own definition, even can user defined shortcut and shortcut, but the function that defines also be limited.Can only be at certain application or someone file, or a feature operation of certain application defines.
Summary of the invention
The objective of the invention is to overcome the deficiency of prior art, the automation operating system on a kind of mobile phone terminal is provided, to realize the automation of mobile phone operation.Can remember the automation mechanized operation that realizes mobile phone with playback by the feature operation that makes mobile phone.This operating system can be remembered the sequence of operation that application program of mobile phone is done, and can playback.Thereby make the customizable content of original shortcut or shortcut abundanter; Not only can customize static object or single feature operation but also can define a series of feature operation.Generally speaking, the method for the invention is simplified more with effective the operating process of mobile phone, and the effect that reaches batch processing.
In order to realize the foregoing invention purpose, the technical solution used in the present invention is: the automation operating system on a kind of mobile phone terminal, comprise the hardware and software two parts that can receive user instruction, it is characterized in that: will have existing seven sections of software AT-SPI enabled desktop in the PC system now, Python 2.3 or highest version more, Rpm-python or python-apt, Xorg-x11-xinit, Gnome-python2-gconf, after Pygtk2 and Xorg-x11-server-Xvfb compile in mobile phone operating system and install, realize script generator with the python script, script generator communicates by accessible technology Accessibility technologies software and desktop application, thereby generate the pythhon script file that can carry out in the operation multipad, relevant system event and information used in record; When carrying out script file, script generator and desktop application communicate, and the system event that is write down is sent to application, and multipad is carried out playback, realize the automation mechanized operation of " recognition memory " and " playback " of mobile phone.
The mobile phone terminal interface of said automation operating system is provided with functional areas and script viewing area, functional areas comprise records/stops, playing, remove and preserve button. after recording key is pressed, script generator just becomes recording status, any operation that mobile phone is used all can be by the script generator record, and the content of the script file that generates is synchronously shown in the script viewing area; After the operation that will write down is finished, press stop key, finish this writing task; After this operation, click play button and repeat application operating just now or click to preserve key and preserve the script file that is generated (whether the user can come the inspection automation content of operation consistent with recording operation before by " broadcast ".If unanimity can be preserved this execution script; If inconsistent, can delete this script and withdraw from).
After obtaining script file, the user utilizes on the current phone ubiquitous shortcut, shortcut that function is set and is mapped to script file on this shortcut, the shortcut or is set to menu item, thereby reaches the quickly starting script file, carries out customization operations.
Advantage of the present invention and beneficial effect: the present invention is structured on the existing relevant mobile phone technique basis and a kind of mobile phone automatized operation that proposes, can more effectively bring into play the application of prior art, the cell-phone function operation can be remembered, can repeat with customizable, thereby the operation that mobile phone is used is simplified more and is effective.
" can remember " and " playback " realizes automation mechanized operation on the mobile phone by the feature operation that makes mobile phone." can remember " system of being meant can discern and remember the incident that operation produced of application information and user's application programs, and is that carrier carries out record with executable script file." playback " is meant that system carries out the script file of gained, by starting application and information and the incident that is write down being sent to application, finishes the function corresponding operation.Can make the customizable content of original shortcut of mobile phone or shortcut abundanter; Not only can customize static object or single feature operation but also can define a series of feature operation.If the editor possesses the relevant knowledge of script, can also make modification at the content of script file, thereby reach the effect of customization, operating process is simplified more with effective.The present invention also can be applicable to various portable terminals such as palmtop PC, personal digital assistant.
The present invention is applied in the smart mobile phone, can make one to have the function items of complicated button operation to be able to the simple operations realization; Make the cell-phone function that often is performed be able to high-speeding; Make the mobile phone operation handbook be able to represent with true process.
Description of drawings
Fig. 1 is the accessible technical architecture figure of Gnome;
Fig. 2 realizes software architecture of the present invention;
An INTERFACE MODEL of the script generator that Fig. 3 is among the present invention to be set forth;
Fig. 4 is an example of the present invention operational flowchart.
Embodiment
System of the present invention comprises hardware (keyboard or touch-screen) and software two parts, and wherein hardware components is a prior art.The demand of software section is as follows:
Architecture: Noarch
Operating system: Linux
Needed software kit:
1.AT-SPI?enabled?desktop
2.Python 2.3 or higher version
3.Rpm-python or python-apt
4.Xorg-x11-xinit
5.Gnome-python2-gconf
6.Xorg-x11-server-Xvfb
7.Pygtk2
Above software kit all is to possess in the PC system, needs to use fully (successfully compile and these software is installed, obtain the function that these software is realized) in mobile phone operating system on the mobile phone operation system.System of the present invention comprises above software kit, realize script generator with python, script generator communicates (reception information and incident) with desktop application by Accessibility technologies (accessible technology) thereby generating the python script logging that can carry out in the operation multipad uses relevant information and incident (recording process); In like manner, when carrying out script file, script generator communicates (transmission information and incident) by Accessibility technologies and desktop application, thereby multipad is carried out the operation (replayed section) of appointment.The mobile phone operating system that possesses above requirement can be remembered the sequence of operation that application program of mobile phone is done, and can playback.Method of operation is:
(1) recording function of startup script generator.
(2) user just can carry out the operation to designated program (user's appointment) after starting the script generator recording function.
(3) after EO, script generator has generated corresponding script file (this script file is to write with a kind of concrete regime type script, such as python) automatically according to user's operation.Carrying out this script file will repeat to start to the operation that the user did between tailend from the script generator recording function.Whether the user can also come the inspection automation content of operation with to use the operation of being done consistent to specifying after starting the script generator recording function by ' play '.If unanimity can be preserved this script file.If inconsistent, can re-execute step 2 or select and delete this script file and withdraw from.
(4) if the editor possesses the relevant knowledge of script, can also make modification at the content of script file, thereby reach the effect of customization.
(5) obtain script file after, thereby the user can utilize on the current phone ubiquitous shortcut, shortcut that function is set and be mapped to script file on this shortcut, the shortcut or be set to menu item and reach the quickly starting script file, carries out the function of customization operations.
The present invention is described in further detail below in conjunction with accompanying drawing.Mobile phone operation automated method (address list, conversation, file browser, short message etc.) in different application can obtain different employing forms.Provide the common-mode of this method of operation in the following description and in certain specific application, how to have adopted this method of operation.
Fig. 1 is a description to Gnome Accessibility architecture, and it is the prior art that the present invention relies on.The purpose of this architecture is to provide standard interface between accessible technology (AT client in the corresponding diagram) and system desktop and multipad (GTK+/Gnome application in the corresponding diagram).The Gtk application program depends on the GTK kit, and the GTK kit is communicated by letter with ATK by loading GAIL.ATK communicates by letter by a dynamic base with AT-SPI.Accessibility Broker is a finger daemon, coordinates the application program of identification AT-SPI agreement and the communication between the accessible technology.The application program of each identification AT-SPI agreement is by registering the information that self is provided to broker.Accessible technology is added event sniffer so that application message is notified or trigger certain behavior (KeyEvent, mouse event etc.) of application program when changing to broker.Among the figure, GAIL-GNOME Accessibility ImplementationLibrary (the accessible technology of GNOME realizes the storehouse), ATK-Accessibility Toolkit (accessible tool set), AT-SPI-Assistive Technology Service Provider Interface (ancillary technique supplier interface).
Fig. 2 realizes software architecture of the present invention.Script generator is to realize with Python among the figure, mainly forms Python modules and PYSPI modules by two parts.Python module part is main to be realized function interface and catches the interface element discerned in the application and keyboard, mouse event, and uses the python script describing.PYSPI modules partly is responsible for and AT-SPI communicates.Script generator carries out alternately via middleware (seven software kits described in the summary of the invention) and application program like this, thereby catch KeyEvent in the application operating process or mouse click event and use in the interface element discerned, and generate executable script file and describe record; Carry out script file conversely, start and use, send keyboard or mouse click event to application.
A mobile phone interface model of the script generator that Fig. 3 is among the present invention to be set forth.Graphical interfaces is made up of the two large divisions shown in the figure, is function button above, is the script viewing area below.Function button comprises four buttons, be respectively and record, play, remove and preserve. after recording key is pressed, script generator just becomes recording status (videotex of recording button this moment stops by recording to become, please referring to figure a, figure b), this time, any operation of mobile phone being used when you all can be by the script generator record, and the content of the script file that generates synchronously below the script viewing area show.After the operation that will write down is finished, just can press stop key, finish this writing task.After this operation, you can select to click play button and repeat just now application operating, perhaps click to preserve key and preserve the script file that is generated.
Fig. 4 is one embodiment of the present of invention, and common-mode of the present invention has been described.When the cellphone subscriber selects script generator menu item (321) in top menu (301) lining of main screen, script generator application program (302) will start up.If the user presses record button (322), the script generator Application Program Interface will be hidden, and beginning executive logging function.Master interface in this time (303) will show, and just can carry out the user this time and want the operating process (comprising keyboard and touch event) of recording, and start certain application program, carry out certain function (304).In the time of the EO that will record, by changeover program script generator Application Program Interface (305) is accessed, and activate stop button (323) and finish recording process.This time, the user can select to preserve operation (306,324), to eject a dialog box (307), and make the user select script preserving type (326) (be kept in the menu or save as shortcut) and insert the name (325) of script, and click and determine left soft key end operation.Whole operations of being carried out during perhaps selecting play operation (306) system to automatically perform to record just now.
Use 1: this example has been used this method of operation the shortcut that application start is set.For example the user can come broadcast listening through mobile phone commonly used.This application of broadcast receiver will often be activated so.Under common operator scheme, the user need enter menu list, navigates to the broadcast receiver icon then, thereby starts the broadcast receiver program, and selects to want the channel listened to.After adopting method of the present invention, the user can record into script file with sequence of operations recited above, can this script file be mapped on certain key of keyboard by a key dial feature then.Like this, the user just only need start broadcast receiver by this key, listens to the channel of oneself setting.
Use 2:.This example is that method of operation of the present invention is applied to the blind person to the specific descriptions in a kind of application of mobile phone.The blind person goes out under unmanned situation of assisting, and loses one's way easily.When where it does not know in, and under the situation of no one's emergency then and there, the blind person just need obtain to succour by mobile phone.At first the blind person can obtain gps coordinate by the GPS device of mobile phone, enters short message then, pastes coordinate information in short message, and this short message of seeking help is sent to the people that can seek help, and waits for rescue.This process need multistep operation can't be finished sequence of operations, thereby can't obtain relief concerning the blind person.When adopting method of the present invention is this serial operation note script file, just can finish this task under the operation of a few step operations or a key.
Claims (3)
1, automation operating system on a kind of mobile phone terminal, comprise the hardware and software two parts that can receive user instruction, it is characterized in that: will have existing seven sections of software AT-SPI enabled desktop in the PC system now, Python 2.3 or highest version more, Rpm-python or python-apt, Xorg-x11-xinit, Gnome-python2-gconf, after Pygtk2 and Xorg-x11-server-Xvfb compile in mobile phone operating system and install, realize script generator with the python script, script generator communicates by accessible technology Accessibility technologies software and desktop application, thereby generate the pythhon script file that can carry out in the operation multipad, relevant system event and information used in record; When carrying out script file, script generator and desktop application communicate, and the system event that is write down is sent to application, and multipad is carried out playback, realize the automation mechanized operation of " recognition memory " and " playback " of mobile phone.
2, the automation operating system on the mobile phone terminal according to claim 1, it is characterized in that mobile phone interface is provided with functional areas and script viewing area, functional areas comprise records/stops, playing, remove and preserve button. after recording key is pressed, script generator just becomes recording status, any operation that mobile phone is used all can be by the script generator record, and the content of the script file that generates is synchronously shown in the script viewing area; After the operation that will write down is finished, press stop key, finish this writing task; After this operation, the click play button repeats application operating just now or clicks the preservation key and preserve the script file that is generated.
3, the automation operating system on the mobile phone terminal according to claim 2, after it is characterized in that obtaining script file, the user utilizes on the current phone ubiquitous shortcut, shortcut that function is set and is mapped to script file on this shortcut, the shortcut or is set to menu item, thereby reach the quickly starting script file, carry out customization operations.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910034734A CN101645966A (en) | 2009-09-04 | 2009-09-04 | Automation operating system on mobile phone terminal |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200910034734A CN101645966A (en) | 2009-09-04 | 2009-09-04 | Automation operating system on mobile phone terminal |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101645966A true CN101645966A (en) | 2010-02-10 |
Family
ID=41657677
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200910034734A Pending CN101645966A (en) | 2009-09-04 | 2009-09-04 | Automation operating system on mobile phone terminal |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101645966A (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103049208A (en) * | 2012-12-31 | 2013-04-17 | 广东欧珀移动通信有限公司 | Method, device and mobile terminal for customizing rapid touch operation |
| CN103336656A (en) * | 2013-07-23 | 2013-10-02 | 百度在线网络技术（北京）有限公司 | Portable restoration operating method and terminal equipment |
| CN103793321A (en) * | 2012-11-01 | 2014-05-14 | 腾讯科技（深圳）有限公司 | Method and system for detecting application programs |
| CN103870100A (en) * | 2012-12-13 | 2014-06-18 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN104793836A (en) * | 2014-01-16 | 2015-07-22 | 中兴通讯股份有限公司 | Information processing method and device based on user operations and terminal |
| CN105446650A (en) * | 2015-12-07 | 2016-03-30 | 北京奇虎科技有限公司 | Keyboard input information recording method, apparatus and system |
| CN105740153A (en) * | 2016-02-29 | 2016-07-06 | 网易（杭州）网络有限公司 | Cloud testing method and device |
| CN106034174A (en) * | 2015-03-13 | 2016-10-19 | 展讯通信（上海）有限公司 | Operation playback system, operation playback method and mobile terminal |
| WO2016188227A1 (en) * | 2015-10-23 | 2016-12-01 | 中兴通讯股份有限公司 | Intelligent terminal shortcut establishment method and device |
| CN106528178A (en) * | 2016-12-07 | 2017-03-22 | 浙江齐治科技股份有限公司 | Program automatic control method and apparatus |
| CN106933628A (en) * | 2017-03-06 | 2017-07-07 | 青岛海信移动通信技术股份有限公司 | Application program performs method, mobile terminal and the computer equipment of operation |
| CN107729073A (en) * | 2017-09-22 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of method that systemd services are created based on Python multi-process storehouse |
| CN108280343A (en) * | 2017-01-06 | 2018-07-13 | 广州市动景计算机科技有限公司 | The method, apparatus and system of application security are detected under Android environment |
| CN109542303A (en) * | 2018-11-02 | 2019-03-29 | 北京硬壳科技有限公司 | Touch control device and its response method, device |
| CN114945054A (en) * | 2022-03-29 | 2022-08-26 | 南京点明软件科技有限公司 | Element combination method applied to mobile phone operating system for blind person |
-
2009
- 2009-09-04 CN CN200910034734A patent/CN101645966A/en active Pending
Cited By (19)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103793321B (en) * | 2012-11-01 | 2017-11-21 | 腾讯科技（深圳）有限公司 | application program detection method and system |
| CN103793321A (en) * | 2012-11-01 | 2014-05-14 | 腾讯科技（深圳）有限公司 | Method and system for detecting application programs |
| CN103870100A (en) * | 2012-12-13 | 2014-06-18 | 联想(北京)有限公司 | Information processing method and electronic device |
| CN103870100B (en) * | 2012-12-13 | 2017-11-28 | 联想(北京)有限公司 | The method and electronic equipment of a kind of information processing |
| CN103049208A (en) * | 2012-12-31 | 2013-04-17 | 广东欧珀移动通信有限公司 | Method, device and mobile terminal for customizing rapid touch operation |
| CN103336656A (en) * | 2013-07-23 | 2013-10-02 | 百度在线网络技术（北京）有限公司 | Portable restoration operating method and terminal equipment |
| CN104793836A (en) * | 2014-01-16 | 2015-07-22 | 中兴通讯股份有限公司 | Information processing method and device based on user operations and terminal |
| CN106034174A (en) * | 2015-03-13 | 2016-10-19 | 展讯通信（上海）有限公司 | Operation playback system, operation playback method and mobile terminal |
| CN106034174B (en) * | 2015-03-13 | 2019-09-24 | 展讯通信（上海）有限公司 | A kind of operation playback system and method and mobile terminal |
| WO2016188227A1 (en) * | 2015-10-23 | 2016-12-01 | 中兴通讯股份有限公司 | Intelligent terminal shortcut establishment method and device |
| CN106610825A (en) * | 2015-10-23 | 2017-05-03 | 中兴通讯股份有限公司 | Shortcut establishment method and apparatus for intelligent terminal |
| CN105446650A (en) * | 2015-12-07 | 2016-03-30 | 北京奇虎科技有限公司 | Keyboard input information recording method, apparatus and system |
| CN105740153A (en) * | 2016-02-29 | 2016-07-06 | 网易（杭州）网络有限公司 | Cloud testing method and device |
| CN106528178A (en) * | 2016-12-07 | 2017-03-22 | 浙江齐治科技股份有限公司 | Program automatic control method and apparatus |
| CN108280343A (en) * | 2017-01-06 | 2018-07-13 | 广州市动景计算机科技有限公司 | The method, apparatus and system of application security are detected under Android environment |
| CN106933628A (en) * | 2017-03-06 | 2017-07-07 | 青岛海信移动通信技术股份有限公司 | Application program performs method, mobile terminal and the computer equipment of operation |
| CN107729073A (en) * | 2017-09-22 | 2018-02-23 | 郑州云海信息技术有限公司 | A kind of method that systemd services are created based on Python multi-process storehouse |
| CN109542303A (en) * | 2018-11-02 | 2019-03-29 | 北京硬壳科技有限公司 | Touch control device and its response method, device |
| CN114945054A (en) * | 2022-03-29 | 2022-08-26 | 南京点明软件科技有限公司 | Element combination method applied to mobile phone operating system for blind person |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101645966A (en) | Automation operating system on mobile phone terminal | |
| US9564149B2 (en) | Method for user communication with information dialogue system | |
| EP3051782B1 (en) | Method and system for sending contact information in call process | |
| CN106126424B (en) | A kind of visual automated testing method of script, device and mobile terminal | |
| CN111628897B (en) | Intelligent equipment initialization method, device and system | |
| CN101510125A (en) | Method for implementing computer keyboard mouse action control using mobile phone by bluetooth | |
| CN101128007A (en) | Testing method for mobile communication terminal | |
| CN103035240A (en) | Speech recognition repair using contextual information | |
| CA2760993A1 (en) | Touch anywhere to speak | |
| CN101873383B (en) | Terminal operation configuration method and terminal | |
| CN106980457A (en) | Operating method of touch panel and touch screen terminal | |
| CN102081501A (en) | Method and device for providing shortcut operation application programs for user and mobile terminal | |
| CN105208015A (en) | Application multi-account login processing method and device and terminal device | |
| CN105824755A (en) | Automation test method, automation test device and mobile terminal | |
| US20100333034A1 (en) | Handheld device, method, and computer program product for user selecting control component of application program | |
| CN109036398A (en) | Voice interactive method, device, equipment and storage medium | |
| CN103379204B (en) | Terminal and coordinated operation instruction processing method | |
| CN104184889A (en) | Wearable equipment and dialing method based on wearable equipment | |
| CN106445671B (en) | A kind of management method of application program, device and terminal | |
| US10127203B2 (en) | Information processing apparatus and mail creating method | |
| KR20130071136A (en) | Method and apparatus for providing short-cut number in a user device | |
| CN102387250A (en) | Method and apparatus for operating call function of portable terminal | |
| CN113342330B (en) | Front-end engineering generation method and device | |
| CN106484514A (en) | A kind of operation management method, device and intelligent terminal for opening application more | |
| CN106897172A (en) | System method to set up, device and terminal |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Open date: 20100210 |