CN106873982A - A kind of software search multiplexing method and system based on graphic user interface - Google Patents

A kind of software search multiplexing method and system based on graphic user interface Download PDF

Info

Publication number
CN106873982A
CN106873982A CN201710023059.6A CN201710023059A CN106873982A CN 106873982 A CN106873982 A CN 106873982A CN 201710023059 A CN201710023059 A CN 201710023059A CN 106873982 A CN106873982 A CN 106873982A
Authority
CN
China
Prior art keywords
interface
project
graphic user
user interface
code
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201710023059.6A
Other languages
Chinese (zh)
Other versions
CN106873982B (en
Inventor
范碧天
陈湘萍
罗笑南
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sun Yat Sen University
Original Assignee
Sun Yat Sen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Yat Sen University filed Critical Sun Yat Sen University
Priority to CN201710023059.6A priority Critical patent/CN106873982B/en
Publication of CN106873982A publication Critical patent/CN106873982A/en
Application granted granted Critical
Publication of CN106873982B publication Critical patent/CN106873982B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/36Software reuse
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/38Creation or generation of source code for implementing user interfaces

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Stored Programmes (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the invention discloses a kind of software search multiplexing method based on graphic user interface and system, wherein, the method includes:Collect graphical interfaces view, component property and layout information;Source item is extracted, is that each independent interface generates an independent project;According to the graphical interfaces view, component property and the layout information that are collected into and the project extracted, the contact links between foundation;For each independent project generates description information and sets up index;Display search result list and reusable project.In embodiments of the present invention, according to the characteristics of graphic user interface, using the thought of software repeated usage, software is decomposed into interface independent one by one, these interfaces can be multiplexed when programmer carries out the search of graphic user interface, can it is quick with helper person, easily and accurately find the code that can be multiplexed.

Description

A kind of software search multiplexing method and system based on graphic user interface
Technical field
The present invention relates to code search multiplexing technology field, more particularly to a kind of software search based on graphic user interface Multiplexing method and system.
Background technology
Software repeated usage is a kind of computer software engineering method and theory.With the development of computer and internet, software Scale become more and more huger.Cost for safeguarding software is very expensive, even if having put into substantial amounts of fund, also not One surely obtains reliable product, and the thought of software repeated usage can solve this problem.The main thought of software repeated usage is handle Software is divided into a series of modules with specific function, after each module is set up, writes software just into assembling module Problem.And each module with specific function can just be recycled.
The characteristics of graphic user interface be with human vision direct interaction, and with repetitive rate higher.For program For member, the view of the user interface of the time of running is immediately seen, it is quicker, accurate than imagining user interface by reading code Really much.The result that present main flow search engine is returned is mainly the character description information or code segment of project.For journey For sequence person, the user interface that demand is found in these results is not easy to, in this process, when spending substantial amounts of Between read code, can just find desired result.
The content of the invention
It is an object of the invention to overcome the deficiencies in the prior art, the invention provides a kind of based on graphic user interface Software search multiplexing method and system, can it is quick with helper person, easily and accurately find the code that can be multiplexed.
In order to solve the above problems, the present invention proposes a kind of software search multiplexing method based on graphic user interface, Methods described includes:
Collect graphical interfaces view, component property and layout information;
Source item is extracted, is that each independent interface generates an independent project;
According to the graphical interfaces view, component property and the layout information that are collected into and the project extracted, between foundation Contact links;
For each independent project generates description information and sets up index;
Display search result list and reusable project.
Preferably, the step of collection graphical interfaces view, component property and layout information, including:
Source item is operated in real equipment, redirecting between interface is carried out using Black-box Testing instrument;
All executable events on interface are collected, software is traveled through using the algorithm of depth-first, owned Accessibility interface.
Preferably, it is described that source item is extracted, it is the step of each independent interface generates an independent project, Including:
The code realized code, filter out non-interface realization at each interface is extracted using AST instruments;
Code to extracting is modified, and generation one can be with the project of independent operating.
Preferably, it is described for each independent project generation description information and the step of set up index, including:
Text message and the keyword for realizing code at interface to occurring on interface carry out participle, and search corresponding word Root;
Respectively to the text message and the keyword for the realizing code calculating TF-IDF at interface that occur on interface, and according to Weight is combined to TF-IDF.
Preferably, the display search result list includes the view of multiple graphic user interfaces, and and graphical user The corresponding description information in interface;The reusable project includes file catalogue view, code reading view, graphic user interface View.
Correspondingly, the embodiment of the present invention also provides a kind of software search multiplex system based on graphic user interface, described System includes:
Collection module, for collecting graphical interfaces view, component property and layout information;
Extraction module, is that each independent interface generates an independent project for being extracted to source item;
Module is set up, for according to the graphical interfaces view, component property and the layout information that are collected into and the item for extracting Mesh, the contact links between foundation;
Generation module, for for each independent project generates description information and sets up index;
Display module, for showing search result list and reusable project.
Preferably, the collection module includes:
Running unit, for source item to be operated in real equipment, is carried out between interface using Black-box Testing instrument Redirect;
Collector unit, for collecting all executable events on interface, is carried out using the algorithm of depth-first to software Traversal, obtains all accessibility interfaces.
Preferably, the extraction module includes:
Extraction unit, the generation realized code, filter out non-interface realization for extracting each interface using AST instruments Code;
Modification unit, for being modified to the code for extracting, generation one can be with the project of independent operating.
Preferably, the module of setting up includes:
Participle unit, for carrying out participle to the text message and the keyword for realizing code at interface that occur on interface, And search corresponding root;
Computing unit, calculates for the text message and the keyword for realizing code at interface respectively to occurring on interface TF-IDF, and TF-IDF is combined according to weight.
Preferably, the display search result list includes the view of multiple graphic user interfaces, and and graphical user The corresponding description information in interface;The reusable project includes file catalogue view, code reading view, graphic user interface View.
In embodiments of the present invention, according to the characteristics of graphic user interface, using the thought of software repeated usage, software is decomposed It is interface independent one by one, these interfaces can be multiplexed when programmer carries out the search of graphic user interface, can helps Programmer is quick, easily and accurately find the code that can be multiplexed.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with Other accompanying drawings are obtained according to these accompanying drawings.
Fig. 1 is the schematic flow sheet of the software search multiplexing method based on graphic user interface of the embodiment of the present invention;
Fig. 2 is collected information schematic diagram in the embodiment of the present invention;
Fig. 3 is search result list schematic diagram in the embodiment of the present invention;
Fig. 4 is reusable project result schematic diagram in the embodiment of the present invention;
Fig. 5 is that the structure composition of the software search multiplex system based on graphic user interface of the embodiment of the present invention is illustrated Figure.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than whole embodiments.It is based on Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made Embodiment, belongs to the scope of protection of the invention.
Fig. 1 is the schematic flow sheet of the software search multiplexing method based on graphic user interface of the embodiment of the present invention, such as Shown in Fig. 1, the method includes:
S1, collects graphical interfaces view, component property and layout information;
S2, extracts to source item, is that each independent interface generates an independent project;
S3, according to the graphical interfaces view, component property and the layout information that are collected into and the project extracted, between foundation Contact links;
S4 is each independent project generation description information and sets up index;
S5, shows search result list and reusable project.
S1 is further included:
Source item is operated in real equipment, redirecting between interface is carried out using Black-box Testing instrument;
All executable events on interface are collected, software is traveled through using the algorithm of depth-first, owned Accessibility interface.
Wherein, using events such as Black-box Testing instrument analog mouse, keyboard, gestures, redirecting between interface is realized.
In specific implementation, source item is operated in real equipment;Using Black-box Testing instrument analog mouse, keyboard, The events such as gesture;If current interface is a new interface, the interface view of current interface is collected, all of component on interface The information such as attribute, the layout at interface;The event not being performed in current interface is performed, if so event was all performed , then it is returned to an interface;After event execution, in the event of redirecting, and the interface for jumping to is one new Interface, then the process of repeated collection;In the event of redirecting, but the interface for jumping to is old interface, just retracted; If redirected, then be carried out next event.If the event of current interface is all performed be over, then just terminate Collect.
As shown in Fig. 2 the information being collected into includes the graphical interfaces view on the left side, component property and layout information with The form of json files is stored.Component property information is not limited to the content that example is shown.
S2 is further included:
The code realized code, filter out non-interface realization at each interface is extracted using AST instruments;
Code to extracting is modified, and generation one can be with the project of independent operating.
Specifically, modification code can be completed by the preparation information for increasing a complete projects and needing;And extract each Realize code and filter out the code that non-interface is realized in interface, it is ensured that the integrality at interface, make the code for extracting It is as few as possible.
In first having to determine a kind of language, which code can (API such as related with interface) directly related to interface, if this Individual collection is combined into RCSL (Relative code set of language).The interface independent for one, finds this boundary of generation The main method in face, then extracts code RCSUI (the Relative code set of directly related with interface to main method UI).RCSL (code) represents code in RCSL, and UIMethod (code) represents that code is generating the main method at this interface In, RCSUI (code) represents code in RCSUI, then:
If code1 is in RCSUI, code1 can use the result to code2, then code2 is also in RCSUI.Use (code1, code2) represents that code1 can use the result to code2, then:
When RCSUI no longer increases, increase it preparation information that complete projects need etc., generation one can be independent The project of operation.
In S3, component and their attribute are included in the information that Black-box Testing instrument is collected into, set up each component To their link for realizing code.Graphical interfaces view, component property and layout can be collected into using Black-box Testing instrument Information, and can extract a single interface using AST instruments.In code, must contain and realize each component Code.According to this relation, module information is got up with corresponding code association, and establish the link.
S4 is further included:
Text message and the keyword for realizing code at interface to occurring on interface carry out participle, and search corresponding word Root;
Respectively to the text message and the keyword for the realizing code calculating TF-IDF at interface that occur on interface, and according to Weight is combined to TF-IDF.
In specific implementation, to the text message occurred on interface, the function at this interface can be more shown, and in code The keyword of appearance is relative weaker with contacting for function.The information in terms of the two is collected first, and these information are carried out Participle, finds their root.Respectively to the text message occurred on interface, the keyword for realizing code at interface calculates TF- IDF, and combined them with certain weight.Result according to calculating is that index is set up at each independent interface, there is provided To search engine retrieving.
In S5, search result list is shown with the mode of image combination text, the image combination code linked with band Mode shows reusable project.
In embodiments of the present invention, display search result list includes the view of multiple graphic user interfaces, and with figure The corresponding description information of shape user interface;Reusable project includes file catalogue view, code reading view, graphical user circle Face view.Each component inside graphical user interface view, the code that can be directly targeted to this component realizes position.
As shown in figure 3, when user retrieves on a search engine, its list for returning is the letter combined with text with image Breath.The information that the image at interface is collected into from Black-box Testing instrument, text message comes from the generation of description information.With this Mode shows every content, and programmer with each result of fast browsing, and can find the interface for meeting exploitation demand.Work as programmer When selecting result therein, the content shown in Fig. 4 can be carried out.As shown in figure 4, interface is divided into three parts, the left side The file structure view of project, middle is the current code for browsing, the right be the interface that current project is realized fortune The view at row moment.Each component wherein in the interface view on the right contains the link of location code.It is therein when clicking on During component, on the code that can jump directly to realize current component.
Correspondingly, as shown in figure 5, the embodiment of the present invention also provides a kind of software search multiplexing based on graphic user interface System, the system includes:
Collection module 1, for collecting graphical interfaces view, component property and layout information;
Extraction module 2, is that each independent interface generates an independent project for being extracted to source item;
Module 3 is set up, for according to the graphical interfaces view, component property and the layout information that are collected into and the item for extracting Mesh, the contact links between foundation;
Generation module 4, for for each independent project generates description information and sets up index;
Display module 5, for showing search result list and reusable project.
Further, collection module 1 includes:
Running unit, for source item to be operated in real equipment, is carried out between interface using Black-box Testing instrument Redirect;
Collector unit, for collecting all executable events on interface, is carried out using the algorithm of depth-first to software Traversal, obtains all accessibility interfaces.
Extraction module 2 includes:
Extraction unit, the code realized code, filter out non-interface realization for extracting each interface using AST instruments;
Modification unit, for being modified to the code for extracting, generation one can be with the project of independent operating.
Setting up module 3 includes:
Participle unit, for carrying out participle to the text message and the keyword for realizing code at interface that occur on interface, And search corresponding root;
Computing unit, calculates for the text message and the keyword for realizing code at interface respectively to occurring on interface TF-IDF, and TF-IDF is combined according to weight.
Wherein, display search result list includes the view of multiple graphic user interfaces, and with graphic user interface pair The description information answered;The reusable project includes file catalogue view, code reading view, graphical user interface view.
Specifically, the operation principle of the system related functions module of the embodiment of the present invention can be found in the correlation of embodiment of the method Description, repeats no more here.
In embodiments of the present invention, according to the characteristics of graphic user interface, using the thought of software repeated usage, software is decomposed It is interface independent one by one, these interfaces can be multiplexed when programmer carries out the search of graphic user interface, can helps Programmer is quick, easily and accurately find the code that can be multiplexed.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can Completed with instructing the hardware of correlation by program, the program can be stored in a computer-readable recording medium, storage Medium can include:Read-only storage (ROM, Read Only Memory), random access memory (RAM, Random Access Memory), disk or CD etc..
In addition, the software search multiplexing method based on graphic user interface for being provided the embodiment of the present invention above and being System is described in detail, and specific case used herein is set forth to principle of the invention and implementation method, the above The explanation of embodiment is only intended to help and understands the method for the present invention and its core concept;Simultaneously for the general skill of this area Art personnel, according to thought of the invention, will change in specific embodiments and applications, in sum, this Description should not be construed as limiting the invention.

Claims (10)

1. a kind of software search multiplexing method based on graphic user interface, it is characterised in that methods described includes:
Collect graphical interfaces view, component property and layout information;
Source item is extracted, is that each independent interface generates an independent project;
According to the graphical interfaces view, component property and the layout information that are collected into and the project extracted, the contact between foundation Link;
For each independent project generates description information and sets up index;
Display search result list and reusable project.
2. the software search multiplexing method of graphic user interface is based on as claimed in claim 1, it is characterised in that the collection The step of graphical interfaces view, component property and layout information, including:
Source item is operated in real equipment, redirecting between interface is carried out using Black-box Testing instrument;
All executable events on interface are collected, software is traveled through using the algorithm of depth-first, obtain all arriving The interface for reaching.E.
3. the software search multiplexing method of graphic user interface is based on as claimed in claim 1, it is characterised in that described to source Project is extracted, and is the step of each independent interface generates an independent project, including:
The code realized code, filter out non-interface realization at each interface is extracted using AST instruments;
Code to extracting is modified, and generation one can be with the project of independent operating.
4. the software search multiplexing method of graphic user interface is based on as claimed in claim 1, it is characterised in that described is every The step of individual independent project generates description information and sets up index, including:
Text message and the keyword for realizing code at interface to occurring on interface carry out participle, and search corresponding root;
TF-IDF is calculated to the text message and the keyword for realizing code at interface that occur on interface respectively, and according to weight TF-IDF is combined.
5. the software search multiplexing method of graphic user interface is based on as claimed in claim 4, it is characterised in that the display Search result list includes the view of multiple graphic user interfaces, and description information corresponding with graphic user interface;It is described Reusable project includes file catalogue view, code reading view, graphical user interface view.
6. a kind of software search multiplex system based on graphic user interface, it is characterised in that the system includes:
Collection module, for collecting graphical interfaces view, component property and layout information;
Extraction module, is that each independent interface generates an independent project for being extracted to source item;
Module is set up, for according to the graphical interfaces view, component property and the layout information that are collected into and the project extracted, building Contact links between vertical;
Generation module, for for each independent project generates description information and sets up index;
Display module, for showing search result list and reusable project.
7. the software search multiplex system of graphic user interface is based on as claimed in claim 6, it is characterised in that the collection Module includes:
Running unit, for source item to be operated in real equipment, the jump between interface is carried out using Black-box Testing instrument Turn;
Collector unit, for collecting all executable events on interface, is traveled through using the algorithm of depth-first to software, Obtain all accessibility interfaces.
8. the software search multiplex system of graphic user interface is based on as claimed in claim 6, it is characterised in that the extraction Module includes:
Extraction unit, the code realized code, filter out non-interface realization for extracting each interface using AST instruments;
Modification unit, for being modified to the code for extracting, generation one can be with the project of independent operating.
9. the software search multiplex system of graphic user interface is based on as claimed in claim 6, it is characterised in that the foundation Module includes:
Participle unit, for carrying out participle to the text message and the keyword for realizing code at interface that occur on interface, and looks into Look for corresponding root;
Computing unit, TF- is calculated for the text message and the keyword for realizing code at interface respectively to occurring on interface IDF, and TF-IDF is combined according to weight.
10. the software search multiplex system of graphic user interface is based on as claimed in claim 9, it is characterised in that described aobvious Show that search result list includes the view of multiple graphic user interfaces, and description information corresponding with graphic user interface;Institute Stating reusable project includes file catalogue view, code reading view, graphical user interface view.
CN201710023059.6A 2017-01-12 2017-01-12 Software search multiplexing method and system based on graphical user interface Active CN106873982B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201710023059.6A CN106873982B (en) 2017-01-12 2017-01-12 Software search multiplexing method and system based on graphical user interface

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201710023059.6A CN106873982B (en) 2017-01-12 2017-01-12 Software search multiplexing method and system based on graphical user interface

Publications (2)

Publication Number Publication Date
CN106873982A true CN106873982A (en) 2017-06-20
CN106873982B CN106873982B (en) 2020-04-07

Family

ID=59158449

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201710023059.6A Active CN106873982B (en) 2017-01-12 2017-01-12 Software search multiplexing method and system based on graphical user interface

Country Status (1)

Country Link
CN (1) CN106873982B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108345600A (en) * 2017-01-23 2018-07-31 阿里巴巴集团控股有限公司 A kind of management, data search method and its device of search application
CN109783139A (en) * 2019-02-21 2019-05-21 四川大学 Software interface feature extracting method, device and electronic equipment

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079048A (en) * 2006-05-24 2007-11-28 上海万纬信息技术有限公司 Internet information search engine and method based on software robot exclusion standard
CN105512233A (en) * 2015-11-30 2016-04-20 北京奇虎科技有限公司 Application shop application search method and device

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101079048A (en) * 2006-05-24 2007-11-28 上海万纬信息技术有限公司 Internet information search engine and method based on software robot exclusion standard
CN105512233A (en) * 2015-11-30 2016-04-20 北京奇虎科技有限公司 Application shop application search method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
KAIYUAN LI 等: "A Platform for Searching UI Component of Android Application", 《2014 5TH INTERNATIONAL CONFERENCE ON DIGITAL HOME (ICDH)》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108345600A (en) * 2017-01-23 2018-07-31 阿里巴巴集团控股有限公司 A kind of management, data search method and its device of search application
CN108345600B (en) * 2017-01-23 2022-02-22 阿里巴巴集团控股有限公司 Management of search application, data search method and device thereof
CN109783139A (en) * 2019-02-21 2019-05-21 四川大学 Software interface feature extracting method, device and electronic equipment

Also Published As

Publication number Publication date
CN106873982B (en) 2020-04-07

Similar Documents

Publication Publication Date Title
US20130204874A1 (en) Hyper Adapter and Method for Accessing Documents in a Document Base
JP6542612B2 (en) Test scenario generation support apparatus and test scenario generation support method
CN107885857B (en) A kind of search results pages user's behavior pattern mining method, apparatus and system
Garcia et al. Systematic analysis of mobile diabetes management applications on different platforms
Chen et al. Visualizing traceability links between source code and documentation
JP5926386B2 (en) Rankings extended by users of information objects
Lee et al. A tool to visualize architectural design decisions
CN106873982A (en) A kind of software search multiplexing method and system based on graphic user interface
Kirsh Using mouse movement heatmaps to visualize user attention to words
Kirsh Directions and speeds of mouse movements on a website and reading patterns: a web usage mining case study
Jiang et al. Log-it: Supporting Programming with Interactive, Contextual, Structured, and Visual Logs
Sharafi A systematic analysis of software architecture visualization techniques
Al-Msie'deen Tag clouds for object-oriented source code visualization
Seifert et al. Crowdsourcing fact extraction from scientific literature
Cheng et al. KVS: a tool for knowledge-driven vulnerability searching
Aziz et al. Domain and challenges of big data and archaeological photogrammetry with blockchain
Menin et al. From linked data querying to visual search: towards a visualization pipeline for LOD exploration
CN103823667A (en) Method and system for automatic turning of value-series analysis tasks based on visual feedback
Rothlisberger et al. Supporting task-oriented navigation in IDEs with configurable HeatMaps
Walk et al. How to apply markov chains for modeling sequential edit patterns in collaborative ontology-engineering projects
Ekşioğlu et al. A user experience study of airline websites
Kawamoto et al. A visualization technique for access patterns and link structures of web sites
CN107590044A (en) A kind of method of testing, device and the equipment of distributed storage cluster
Zamakhsyari et al. A Systematic Literature Review of Design Thinking Approach for User Interface Design
Cui et al. VineMap: A metaphor visualization method for public opinion hierarchy from text data

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant