Home   >   CSC-OpenAccess Library   >    Manuscript Information
Comprehensive Testing Tool for Automatic Test Suite Generation, Prioritization and Testing of Object Oriented Software Products
C. Prakasa Rao, P. Govindarajulu
Pages - 1 - 15     |    Revised - 29-02-2016     |    Published - 01-04-2016
Volume - 7   Issue - 1    |    Publication Date - April 2016  Table of Contents
MORE INFORMATION
KEYWORDS
Software Engineering, Testing, Test Case Prioritization, Dependency Structures, Branch Coverage.
ABSTRACT
Testing has been an essential part of software development life cycle. Automatic test case and test data generation has attracted many researchers in the recent past. Test suite generation is the concept given importance which considers multiple objectives in mind and ensures core coverage. The test cases thus generated can have dependencies such as open dependencies and closed dependencies. When there are dependencies, it is obvious that the order of execution of test cases can have impact on the percentage of flaws detected in the software under test. Therefore test case prioritization is another important research area that complements automatic test suite generation in objects oriented systems. Prior researches on test case prioritization focused on dependency structures. However, in this paper, we automate the extraction of dependency structures. We proposed a methodology that takes care of automatic test suite generation and test case prioritization for effective testing of object oriented software. We built a tool to demonstrate the proof of concept. The empirical study with 20 case studies revealed that the proposed tool and underlying methods can have significant impact on the software industry and associated clientele.
1 Google Scholar 
2 CiteSeerX 
3 Scribd 
4 SlideShare 
5 PdfSR 
A. Arcuri and L. Briand, “A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering,” Proc. 33rd Int’l Conf. Software Eng., pp. 1-10. 2011.
A. Arcuri, “A Theoretical and Empirical Analysis of the Role of Test Sequence Length in Software Testing for Structural Coverage,” IEEE Trans. Software Eng., vol. 38, no. 3, pp.497-519, May/ June 2011.
A. Baars, M. Harman, Y. Hassoun, K. Lakhotia, P. McMinn, P. Tonella, and T. Vos, “Symbolic Search-Based Testing,” Proc. IEEE/ ACM 26th Int’l Conf. Automated Software Eng., 2011.
Andrea Arcuri,Muhammad Zohaib Iqbal and Lionel Briand. (2012). Random Testing: Theoretical Results and Practical Implications. IEEE. 38 p258-277.
B. Baudry, F. Fleurey, J.-M. Je´ze´quel, and Y. Le Traon, “Automatic Test Cases Optimization: A Bacteriologic Algorithm,” IEEE Software, vol. 22, no. 2, pp. 76-82, Mar./Apr. 2005.
B. Jiang, Z. Zhang, W. Chan, and T. Tse, “Adaptive Random Test Case Prioritization,” Proc. IEEE/ACM Int’l Conf. Automated Software Eng., pp. 233-244, 2009.
C. Csallner and Y. Smaragdakis, “JCrasher: An Automatic Robustness Tester for Java,” Software Practice and Experience, vol. 34, pp. 1025-1050, 2004.
C. Prakasa Rao and P.Govindarajulu. (2014). “A Comprehensive Survey of Recent Developments in Software Testing Methodologies”, IJSR. 3 (n.d), p-1889-1895.
C. Prakasa Rao and P.Govindarajulu. (2015). “Automatic Discovery of Dependency Structures for Test Case Prioritization” . IJCSNS. 15 (n.d), p-52-57.
C. Prakasa Rao and P.Govindarajulu. (2015). “Genetic Algorithm for Automatic Generation of Representative Test Suite for Mutation Testing”. IJCSNS. 15 (n.d), p-11-17.
D. Jeffrey and N. Gupta, “Experiments with Test Case Prioritization Using Relevant Slices,” J.Systems and Software, vol. 81, no. 2, pp. 196-221, 2008.
D. Kundu, M. Sarma, D. Samanta, and R. Mall, “System Testing for Object-Oriented Systems with Test Case Prioritization,” Software Testing, Verification, and Reliability, vol. 19, no. 4, pp.97- 333, 2009.
F. Basanieri, A. Bertolino, and E. Marchetti, “The Cow_Suite Approach to Planning and Deriving Test Suites in UML Projects,” Proc. Fifth Int’l Conf. Unified Modeling Language, pp. 275-303, 2002.
G. Rothermel, R.H. Untch, C. Chu, and M.J. Harrold, “Prioritizing Test Cases for Regression Testing,” IEEE Trans. Software Eng., vol. 27, no. 10, pp. 929-948, Sept. 2001.
G. Rudolph, “Convergence Analysis of Canonical Genetic Algorithms,” IEEE Trans. Neural Networks, vol. 5, no. 1, pp. 96-101, Jan. 1994.
Gordon Fraser, and Andrea Arcuri. (2013). “Whole Test Suite Generation “ IEEE, VOL. 39, NO. 2, p276-291.
Gordon Fraser, and Andreas Zeller. (2012). Mutation-Driven Generation of Unit Tests and Oracles, IEEE, VOL. 38, NO. 2 p1-15.
Greegg Rothermel, Sebastian Elbaum, Alexey Malishevsky, Praveen Kallakrui and Brian Davia (2011), The impact of test suite granularity on the cost-effectiveness of Regression Testing, University of Nebraska – Lincoln, p1-12.
H. Srikanth, L. Williams, and J. Osborne, “System Test Case Prioritization of New and Regression Test Cases,” Proc. Fourth Int’l Symp. Empirical Software Eng., pp. 62-71, 2005.
Hema Srikanth, Laurie Williams, Jason Osborne. (2000). System Test Case Prioritization of New and Regression Test Cases. Department of Computer Science. 2 (4), p1-23.
J. Jenny Li. (2001). Prioritize Code for Testing to Improve Code Coverage of Complex Software. CID. p1-18.
J. Kim and D. Bae, “An Approach to Feature Based Modeling by Dependency Alignment for the Maintenance of the Trustworthy System,” Proc. 28th Ann. Int’l Computer Software and Applications Conf., pp. 416-423, 2004.
J. Li, D. Weiss, and H. Yee, “Code-Coverage Guided Prioritized Test Generation,” J. Information and Software Technology, vol. 48, no. 12, pp. 1187-1198, 2006.
J. Li, “Prioritize Code for Testing to Improve Code Coverage of Complex Software,” Proc. 16th IEEE Int’l Symp. Software Reliability Eng., pp. 75-84, 2005.
J. Malburg and G. Fraser, “Combining Search-Based and Constraint-Based Testing,” Proc. IEEE/ACM 26th Int’l Conf. Automated Software Eng., 2011.
J. Ryser and M. Glinz, “Using Dependency Charts to Improve Scenario-Based Testing,” Proc 17th Int’l Conf. Testing Computer Software, 2000.
Jiang, B; Zhang, Z; Chan, WK; Tse, TH. (2009). Adaptive random test case prioritization. International Conference On Automated Software Engineering. 4 (24), p233-244.
Johannes Ryser. (2000). Using Dependency Charts to Improve Scenario-Based Testing. International Conference on Testing Computer Software TCS. 18 (3), p1-10.
K. Inkumsah and T. Xie, “Improving Structural Testing of Object-Oriented Programs via Integrating Evolutionary Testing and Symbolic Execution,” Proc. 23rd IEEE/ACM Int’l Conf. Automated Software Eng., pp. 297-306, 2008.
M. Islam and C. Csallner, “Dsc+Mock: A Test Case + Mock Class Generator in Support of Coding against Interfaces,” Proc. Eighth Int’l Workshop Dynamic Analysis, pp. 26-31, 2010.
P. Godefroid, N. Klarlund, and K. Sen, “DART: Directed Automated Random Testing,” Proc. ACM SIGPLAN Conf. Programming Language Design and Implementation, pp. 213-223, 2005.
P. Tonella, P. Avesani, and A. Susi, “Using the Case-Based Ranking Methodology for Test Case Prioritization,” Proc. 22nd IEEE Int’l Conf. Software Maintenance, pp. 123-133, 2006.
Paolo Tonella, Paolo Avesani, Angelo Susi. (1997). Using the Case-Based Ranking Methodology for Test Case Prioritization. IEEE.p1-10.
R. Krishnamoorthi and S.A. Sahaaya Arul Mary, “Factor Oriented Requirement Coverage Based System Test Case Prioritization ofNew and Regression Test Cases,” Information and Software Technology, vol. 51, no. 4, pp. 799-808, 2009.
Richard Baker and Ibrahim Habli. (2010). An Empirical Evaluation of Mutation Testing For Improving the Test Quality of Safety- Critical Software. IEEE. p1-32.
S. Zhang, D. Saff, Y. Bu, and M. Ernst, “Combined Static and Dynamic Automated Test Generation,” Proc. ACM Int’l Symp. Software Testing and Analysis, 2011.
Saswat Ananda, Edmund K. Burkeb, Tsong Yueh Chenc, John Clarkd, Myra B. Cohene, Wolfgang Grieskampf, Mark Harmang, Mary Jean Harroldh and Phil McMinni. (2013). “An orchestrated survey of methodologies for automated software test case generation.” p1979 2001.
Sebastian Elbaum. (2001). Incorporating Varying Test Costs and Fault Severities into Test Case Prioritization. Proceedings of the 23rd International Conference on Software Engineering. 23 (5), p1-10.
W. Eric Wong, J. R. Horgan, Saul London, Hira Agrawal. (1997). A Study of Effective Regression Testing in Practice. IEEE. 8 (1), p 264-274.
W. Visser, C.S. Pasareanu, and S. Khurshid, “Test Input Generation with Java PathFinder,” Proc. ACM SIGSOFT Int’l Symp. Software Testing and Analysis, pp. 97-107, 2004.
Wong, J.R. Horgan, S. London, and H. Agrawal, “A Study of Effective Regression Testing in Practice,” Proc. Eighth Int’l Symp. Software Reliability Eng., pp. 230-238, 1997.
X. Qu, M.B. Cohen, and K.M. Woolf, “Combinatorial Interaction Regression Testing: A Study of Test Case Generation and Prioritization,” Proc. IEEE Int’l Conf. Software Maintenance, pp. 255-264, 2007.
Xiao Qu, Myra B. Cohen, Katherine M. Woolf. (2006). Combinatorial Interaction Regression Testing: A Study of Test Case Generation and Prioritization. Department of Computer Science and Engineering, p149-170.
Z. Li, M. Harman, and R. Hierons, “Search Algorithms for Regression Test Case Prioritization,”IEEE Trans. Software Eng., vol. 33, no. 4, pp. 225-237, Apr. 2007.
Z. Ma and J. Zhao, “Test Case Prioritization Based on Analysis of Program Structure,” Proc. 15th Asia-Pacific Software Eng. Conf., pp. 471-478, 2008.
Zengkai Ma. (2001). Test Case Prioritization based on Analysis of Program Structure. Department of Computer Science, p149-170.
[8] Shifa-e-Zehra Haidry and Tim Miller. (2013). Using Dependency Structures for Prioritization of Functional Test Suites. IEEE. 39 p258-275.
Mr. C. Prakasa Rao
S. V University, Tirupathi, Chittoor(Dt) AP - India
prakashrao.pec@gmail.com
Mr. P. Govindarajulu
Dept. of Computer Science ,S.V. University, Tirupathi Chittoor (Dt) AP, India - India