GB2609110A - Executing tests in deterministic order - Google Patents

Executing tests in deterministic order Download PDF

Info

Publication number
GB2609110A
GB2609110A GB2214168.3A GB202214168A GB2609110A GB 2609110 A GB2609110 A GB 2609110A GB 202214168 A GB202214168 A GB 202214168A GB 2609110 A GB2609110 A GB 2609110A
Authority
GB
United Kingdom
Prior art keywords
attribute
value
test
test cases
generating
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2214168.3A
Other languages
English (en)
Other versions
GB202214168D0 (en
Inventor
Hicks Andrew
Thomas Rawlings Ryan
Furman Deborah
Gildein Michael
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
International Business Machines Corp
Original Assignee
International Business Machines Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corp filed Critical International Business Machines Corp
Publication of GB202214168D0 publication Critical patent/GB202214168D0/en
Publication of GB2609110A publication Critical patent/GB2609110A/en
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3676—Test management for coverage analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3684—Test management for test design, e.g. generating new test cases
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3688—Test management for test execution, e.g. scheduling of test suites
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00—Error detection; Error correction; Monitoring
    • G06F11/36—Preventing errors by testing or debugging software
    • G06F11/3668—Software testing
    • G06F11/3672—Test management
    • G06F11/3692—Test management for test results analysis

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Test And Diagnosis Of Digital Computers (AREA)
  • Debugging And Monitoring (AREA)
  • Eye Examination Apparatus (AREA)
  • Production Of Liquid Hydrocarbon Mixture For Refining Petroleum (AREA)
GB2214168.3A 2020-02-28 2021-02-09 Executing tests in deterministic order Pending GB2609110A (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US16/804,164 US11182282B2 (en) 2020-02-28 2020-02-28 Executing tests in deterministic order
PCT/IB2021/051033 WO2021171117A1 (en) 2020-02-28 2021-02-09 Executing tests in deterministic order

Publications (2)

Publication Number Publication Date
GB202214168D0 GB202214168D0 (en) 2022-11-09
GB2609110A true GB2609110A (en) 2023-01-25

Family

ID=77463096

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2214168.3A Pending GB2609110A (en) 2020-02-28 2021-02-09 Executing tests in deterministic order

Country Status (8)

Country Link
US (1) US11182282B2 (de)
JP (1) JP2023514999A (de)
KR (1) KR20220116330A (de)
CN (1) CN115176233B (de)
AU (1) AU2021227739B2 (de)
DE (1) DE112021000240T5 (de)
GB (1) GB2609110A (de)
WO (1) WO2021171117A1 (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11442839B2 (en) * 2020-03-10 2022-09-13 International Business Machines Corporation Runtime metrics based test ordering

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140266243A1 (en) * 2013-03-14 2014-09-18 National Instruments Corporation Power leveling of a system under test
US20150234007A1 (en) * 2014-02-20 2015-08-20 International Business Machines Corporation Generation device, generation method, and program
US20160154728A1 (en) * 2009-09-11 2016-06-02 International Business Machines Corporation System and method for resource modeling and simulation in test planning

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7024589B2 (en) * 2002-06-14 2006-04-04 International Business Machines Corporation Reducing the complexity of finite state machine test generation using combinatorial designs
US10338993B1 (en) * 2018-04-22 2019-07-02 Sas Institute Inc. Analysis of failures in combinatorial test suite
US10754764B2 (en) * 2018-04-22 2020-08-25 Sas Institute Inc. Validation sets for machine learning algorithms
US8397104B2 (en) * 2009-04-22 2013-03-12 International Business Machines Corporation Creation of test plans
US9665350B1 (en) 2009-05-29 2017-05-30 The Mathworks, Inc. Automatic test generation for model-based code coverage
US8271950B2 (en) 2009-07-06 2012-09-18 Microsoft Corporation Test generation from captured user interface status
US8627295B2 (en) 2009-10-09 2014-01-07 General Electric Company Methods and apparatus for testing user interfaces
US8732299B2 (en) 2010-08-23 2014-05-20 Intuit Inc. Scalability breakpoint calculator for a software product
US8260826B2 (en) * 2010-09-23 2012-09-04 Hewlett-Packard Development Company, L.P. Data processing system and method
US8832839B2 (en) 2011-01-04 2014-09-09 Siemens Aktiengesellschaft Assessing system performance impact of security attacks
US8756460B2 (en) * 2011-04-05 2014-06-17 International Business Machines Corporation Test selection based on an N-wise combinations coverage
US8649995B2 (en) 2011-04-07 2014-02-11 Infosys Technologies, Ltd. System and method for efficient test case generation using input dependency information
US9262307B2 (en) * 2011-10-05 2016-02-16 International Business Machines Corporation Modeling test space for system behavior with optional variable combinations
US9244819B2 (en) 2011-10-31 2016-01-26 International Business Machines Corporation Attribute value properties for test selection with cartesian product models
US8887112B2 (en) * 2012-11-14 2014-11-11 International Business Machines Corporation Test validation planning
US8990626B2 (en) * 2012-12-17 2015-03-24 International Business Machines Corporation Method and apparatus for determining relevance of assignments in combinatorial models
US9122801B2 (en) * 2013-08-07 2015-09-01 International Business Machines Corporation Test planning with order coverage requirements
US9454466B2 (en) * 2013-10-02 2016-09-27 Globalfoundries Inc. Explaining partially illegal combinations in combinatorial models
US9740505B2 (en) 2014-07-15 2017-08-22 The Mathworks, Inc. Accurate static dependency analysis via execution-context type prediction
GB2530516A (en) 2014-09-24 2016-03-30 Ibm Intelligent Software Test Augmenting
US9846633B2 (en) * 2015-10-06 2017-12-19 Ca, Inc. Generating tests for testing software applications
US20210326228A1 (en) 2016-11-17 2021-10-21 Vestel Elektronik Sanayi Ve Ticaret A.S. System testing method and system test kit
CN109726093B (zh) * 2017-10-27 2022-03-22 伊姆西Ip控股有限责任公司 用于执行测试用例的方法、设备和计算机程序产品
US10489280B2 (en) * 2017-11-21 2019-11-26 International Business Machines Corporation Method and apparatus for test modeling
US11061811B2 (en) * 2017-12-15 2021-07-13 International Business Machines Corporation Optimizing software testing via group testing
US10782986B2 (en) * 2018-04-20 2020-09-22 Facebook, Inc. Assisting users with personalized and contextual communication content

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160154728A1 (en) * 2009-09-11 2016-06-02 International Business Machines Corporation System and method for resource modeling and simulation in test planning
US20140266243A1 (en) * 2013-03-14 2014-09-18 National Instruments Corporation Power leveling of a system under test
US20150234007A1 (en) * 2014-02-20 2015-08-20 International Business Machines Corporation Generation device, generation method, and program

Also Published As

Publication number Publication date
AU2021227739B2 (en) 2023-11-23
JP2023514999A (ja) 2023-04-12
US20210271592A1 (en) 2021-09-02
AU2021227739A1 (en) 2022-07-07
GB202214168D0 (en) 2022-11-09
KR20220116330A (ko) 2022-08-22
US11182282B2 (en) 2021-11-23
CN115176233A (zh) 2022-10-11
WO2021171117A1 (en) 2021-09-02
CN115176233B (zh) 2023-07-21
DE112021000240T5 (de) 2022-09-22

Similar Documents

Publication Publication Date Title
Campos et al. Entropy-based test generation for improved fault localization
US10089217B2 (en) Identification of software test cases
US10152406B2 (en) Software program repair
US20120167060A1 (en) System and Method for Software Immunization Based on Static and Dynamic Analysis
US9846637B2 (en) Machine learning based software program repair
US20190278572A1 (en) Representing software with an abstract code graph
US10664383B2 (en) Automated software program repair of similar code snippets
Yan et al. A dynamic test cluster sampling strategy by leveraging execution spectra information
US11080179B2 (en) Device, system, and method for automatically detecting and repairing a bug in a computer program using a genetic algorithm
Bandyopadhyay Mitigating the effect of coincidental correctness in spectrum based fault localization
US10268572B2 (en) Interactive software program repair
Casanova et al. Diagnosing unobserved components in self-adaptive systems
US11663113B2 (en) Real time fault localization using combinatorial test design techniques and test case priority selection
Zhang et al. An Application of Adaptive Random Sequence in Test Case Prioritization.
Nagamoto et al. Locating a faulty interaction in pair-wise testing
KR100919222B1 (ko) 테스트 케이스의 성능 평가 방법 및 장치
US10180897B2 (en) Automated software program repair
GB2609110A (en) Executing tests in deterministic order
US8402421B2 (en) Method and system for subnet defect diagnostics through fault compositing
Raunak et al. Combinatorial testing of full text search in web applications
CN113486358A (zh) 一种漏洞检测方法及装置
US10853051B2 (en) Automated candidate repair patch generation
Gonzalez-Sanchez et al. Modeling the diagnostic efficiency of regression test suites
Pang et al. A Clustering-Based Test Case Classification Technique for Enhancing Regression Testing.
Chen et al. An approach to determine the optimal k-value of k-means clustering in adaptive random testing