Combinatorial First Order Polynomial Coverage Based Test Suites Prioritization for Improving Software System Quality

M.Bharathi Mathankumar


Combinatorial Testing (CT) is performed to ensure the development of a software system quality. In CT, many research works has been designed for test suite minimization. But, existing test suite minimization techniques does not covers the more number of test cases for detecting the maximum faults in software programs. Therefore, there is a requirement for new test suite minimization technique for improving software system quality with higher number of test cases. To optimize the order of interactions being tested and to reduce the number of test suites generated best in terms of coverage, Combinatorial First Order Polynomial Coverage Based Prioritization (CFOP-CP) technique is proposed. For monitoring the order of interactions at time interval ‘ t ’ and time interval ‘ t-1 ’, First Order Polynomial (FOP) function is used. Therefore, FOP function predicts the faults interactions in software program efficiently which resulting in higher fault interaction prediction accuracy. After that, Coverage-based Test Suites Prioritization is performed to prioritize test suites best in terms of coverage and therefore provides global coverage for finding faults in software programs. Finally, Similarity-based Test Suite Selection is performed to reduce the number of test suites for detecting maximum number of faults in software programs which in turn helps for improving the software system quality. The CFOP-CP technique conducts the experimental works on parameters such as fault interaction prediction accuracy, testing cost and coverage rate. The experimental result shows that the CFOP-CP technique is able to improve the coverage rate for software fault detection and also reduces the testing cost for improving the software system quality when compared to state-of-the-art-works.

Keywords: Combinatorial Testing, Test Suite, Fault Interaction, Coverage, Test Cases, Prioritization


Combinatorial Testing, Test Suite, Fault Interaction, Coverage, Test Cases, Prioritization

Full Text:



Wei Zheng, Xiaoxue Wu, Desheng Hu, and Qihai Zhu, “Locating Minimal Fault Interaction in Combinatorial Testing”, Hindawi Publishing Corporation, Advances in Software Engineering, Volume 2016, Article ID 2409521, Pages 1-10, 2016

Bestoun S. Ahmed, “Test case minimization approach using fault detection and combinatorial optimization techniques for configuration-aware structural testing”, Engineering Science and Technology, an International Journal, Elsevier, Volume 19, Issue 2, Pages 737–753, June 2016

Bestoun S. Ahmed, Taib Sh. Abdulsamad and Moayad Y. Potrus, “Achievement of Minimized Combinatorial Test Suite for Configuration-Aware Software Functional Testing Using the Cuckoo Search Algorithm”, Information and Software Technology, Volume 66, Pages 13-29, Oct 2015

Sangeeta Sabharwal, Manuj Aggarwal, “A novel approach for deriving interactions for combinatorial testing”, Engineering Science and Technology, an International Journal, Elsevier, Volume 20, Pages 59–71, 2017

Ana Emilia Victor Barbosa Coutinho, Emanuela Gadelha Cartaxo, Patricia Duarte de Lima Machado, “Analysis of distance functions for similarity-based test suite reduction in the context of model-based testing”, Software Quality Journal, Volume 24, Issue 2, Pages 407–445, June 2016

T. Prem Jacob and T. Ravi, “Optimization of Test Cases by Prioritization”, Journal of Computer Science, Volume 9, Issue 8, Pages 972-980, 2013

Chuanyang Ruan and Jianhui Yang, “Software Quality Evaluation Model Based on Weighted Mutation Rate Correction Incompletion G1 Combination Weights”, Hindawi Publishing Corporation, Mathematical Problems in Engineering, Volume 2014, Article ID 541292, Pages 1-9, 2014

Renée C. Bryce, Sreedevi Sampath, Jan B. Pedersen, Schuyler Manchester, “Test suite prioritization by cost-based combinatorial interaction coverage”, International Journal of System Assurance Engineering and Management, Springer, June 2011, Volume 2, Issue 2, Pages 126–134

Chunrong Fang, Zhenyu Chen, Zhihong Zhao, “Similarity-based test case prioritization using ordered sequences of program entities”, Software Quality Control, Volume 22, Issue 2, Pages 335–361, June 2014

Hadi Hemmati, Andrea Arcuri, Lionel Briand, “Achieving Scalable Model-Based Testing Through Test Case Diversity”, ACM Transactions on Software Engineering and Methodology, Volume 22, Issue 1, Pages 1-42, February 2013

Shilpi Singh, Raj Shree, “An Analysis of Test Suite Minimization Techniques”, international Journal of Engineering Sciences and Research Technology, Volume 5, Pages 252-260, 2016

Avinash Gupta, Nayneesh Mishra, Aprna Tripathi, Manu Vardhan, Dharmender Singh Kushwaha, “An Improved History-Based Test Prioritization Technique Using Code Coverage”, Advanced Computer and Communication Engineering Technology, Pages 437-448, 2014

Xiaofang QI , Junhe, Peng Wang, Huayang Zhou, “Variable strength combinatorial testing of concurrent programs”, Springer, Frontiers of Computer Science, Volume 10, Issue 4, Pages 631–643, August 2016

Sangeeta Sabharwal, Priti Bansal, Nitish Mittal, Shreya Malik, “Construction of Mixed Covering Arrays for Pair-wise Testing Using Probabilistic Approach in Genetic Algorithm”, Arabian Journal for Science and Engineering, Springer, Volume 41, Issue 8, Pages 2821–2835, August 2016

Justyna Petke, Myra B. Cohen, Mark Harman, and Shin Yoo, “Practical Combinatorial Interaction Testing: Empirical Findings on Efficiency and Early Fault Detection”, IEEE Transactions on Software Engineering, Volume 41, Issue 9, Pages 901 – 924, 2015

Qiang He, Jun Yan, Hai Jin and Yun Yang, “Quality-Aware Service Selection for Service-Based Systems Based on Iterative Multi-Attribute Combinatorial Auction”, IEEE Transactions On Software Engineering, Volume 40, Issue 2, Pages 192-215, February 2014

Beatriz Perez Lamancha, Macario Polo, Mario Piattini, “PROW: A Pairwise algorithm with constraints, Order and Weight”, The Journal of Systems and Software, Elsevier, Volume 99, Pages 1–19, 2015

Pragya Agarwal, Arun Prakash Agrawal, “Fault-Localization Techniques for Software Systems: A Literature Review”, ACM SIGSOFT Software Engineering, Volume 39, Issue 5, Pages 1-8, September 2014

Hui He, Lei Zhao, Qiao Li, Weizhe Zhang, Dongmin Gao and Yongtan Liu, “Fault Localization Method of Software Defects based on Dependencies Analysis of Program Structure”, International Journal of Security and Its Applications, Volume 7, Issue 3, Pages 413- 422, May 2013

Xiaobing Sun, Xin Peng Bin, LiBixin Li, Wanzhi Wen, “IPSETFUL: an iterative process of selecting test cases for effective fault localization by exploring concept lattice of program spectra”, Frontiers of Computer Science, Springer, Volume 10, Issue 5, Pages 812–831, October 2016



  • There are currently no refbacks.

Copyright (c) 2017 International Journal of Advanced Research in Computer Science