Home   >   CSC-OpenAccess Library   >    Manuscript Information
Full Text Available

(462.58KB)
This is an Open Access publication published under CSC-OpenAccess Policy.
Publications from CSC-OpenAccess Library are being accessed from over 74 countries worldwide.
Comprehensive Testing Tool for Automatic Test Suite Generation, Prioritization and Testing of Object Oriented Software Products
C. Prakasa Rao, P. Govindarajulu
Pages - 1 - 15     |    Revised - 29-02-2016     |    Published - 01-04-2016
Volume - 7   Issue - 1    |    Publication Date - April 2016  Table of Contents
MORE INFORMATION
KEYWORDS
Software Engineering, Testing, Test Case Prioritization, Dependency Structures, Branch Coverage.
ABSTRACT
Testing has been an essential part of software development life cycle. Automatic test case and test data generation has attracted many researchers in the recent past. Test suite generation is the concept given importance which considers multiple objectives in mind and ensures core coverage. The test cases thus generated can have dependencies such as open dependencies and closed dependencies. When there are dependencies, it is obvious that the order of execution of test cases can have impact on the percentage of flaws detected in the software under test. Therefore test case prioritization is another important research area that complements automatic test suite generation in objects oriented systems. Prior researches on test case prioritization focused on dependency structures. However, in this paper, we automate the extraction of dependency structures. We proposed a methodology that takes care of automatic test suite generation and test case prioritization for effective testing of object oriented software. We built a tool to demonstrate the proof of concept. The empirical study with 20 case studies revealed that the proposed tool and underlying methods can have significant impact on the software industry and associated clientele.
1 Google Scholar 
2 CiteSeerX 
3 Scribd 
4 SlideShare 
5 PdfSR 
1 Gordon Fraser, and Andreas Zeller. (2012). Mutation-Driven Generation of Unit Tests and Oracles, IEEE, VOL. 38, NO. 2 p1-15.
2 J. Malburg and G. Fraser, “Combining Search-Based and Constraint-Based Testing,” Proc. IEEE/ACM 26th Int’l Conf. Automated Software Eng., 2011.
3 Gordon Fraser, and Andrea Arcuri. (2013). “Whole Test Suite Generation “ IEEE, VOL. 39, NO. 2, p276-291.
4 A. Baars, M. Harman, Y. Hassoun, K. Lakhotia, P. McMinn, P. Tonella, and T. Vos, “Symbolic Search-Based Testing,” Proc. IEEE/ ACM 26th Int’l Conf. Automated Software Eng., 2011.
5 Saswat Ananda, Edmund K. Burkeb, Tsong Yueh Chenc, John Clarkd, Myra B. Cohene, Wolfgang Grieskampf, Mark Harmang, Mary Jean Harroldh and Phil McMinni. (2013). “An orchestrated survey of methodologies for automated software test case generation.” p1979 2001.
6 Richard Baker and Ibrahim Habli. (2010). An Empirical Evaluation of Mutation Testing For Improving the Test Quality of Safety- Critical Software. IEEE. p1-32.
7 A. Arcuri and L. Briand, “A Practical Guide for Using Statistical Tests to Assess Randomized Algorithms in Software Engineering,” Proc. 33rd Int’l Conf. Software Eng., pp. 1-10. 2011.
8 [8] Shifa-e-Zehra Haidry and Tim Miller. (2013). Using Dependency Structures for Prioritization of Functional Test Suites. IEEE. 39 p258-275.
9 J. Ryser and M. Glinz, “Using Dependency Charts to Improve Scenario-Based Testing,” Proc 17th Int’l Conf. Testing Computer Software, 2000.
10 J. Kim and D. Bae, “An Approach to Feature Based Modeling by Dependency Alignment for the Maintenance of the Trustworthy System,” Proc. 28th Ann. Int’l Computer Software and Applications Conf., pp. 416-423, 2004.
11 G. Rothermel, R.H. Untch, C. Chu, and M.J. Harrold, “Prioritizing Test Cases for Regression Testing,” IEEE Trans. Software Eng., vol. 27, no. 10, pp. 929-948, Sept. 2001.
12 Z. Li, M. Harman, and R. Hierons, “Search Algorithms for Regression Test Case Prioritization,”IEEE Trans. Software Eng., vol. 33, no. 4, pp. 225-237, Apr. 2007.
13 G. Rudolph, “Convergence Analysis of Canonical Genetic Algorithms,” IEEE Trans. Neural Networks, vol. 5, no. 1, pp. 96-101, Jan. 1994.
14 D. Jeffrey and N. Gupta, “Experiments with Test Case Prioritization Using Relevant Slices,” J.Systems and Software, vol. 81, no. 2, pp. 196-221, 2008.
15 Wong, J.R. Horgan, S. London, and H. Agrawal, “A Study of Effective Regression Testing in Practice,” Proc. Eighth Int’l Symp. Software Reliability Eng., pp. 230-238, 1997.
16 J. Li, “Prioritize Code for Testing to Improve Code Coverage of Complex Software,” Proc. 16th IEEE Int’l Symp. Software Reliability Eng., pp. 75-84, 2005.
17 J. Li, D. Weiss, and H. Yee, “Code-Coverage Guided Prioritized Test Generation,” J. Information and Software Technology, vol. 48, no. 12, pp. 1187-1198, 2006.
18 Z. Ma and J. Zhao, “Test Case Prioritization Based on Analysis of Program Structure,” Proc. 15th Asia-Pacific Software Eng. Conf., pp. 471-478, 2008.
19 R. Krishnamoorthi and S.A. Sahaaya Arul Mary, “Factor Oriented Requirement Coverage Based System Test Case Prioritization ofNew and Regression Test Cases,” Information and Software Technology, vol. 51, no. 4, pp. 799-808, 2009.
20 H. Srikanth, L. Williams, and J. Osborne, “System Test Case Prioritization of New and Regression Test Cases,” Proc. Fourth Int’l Symp. Empirical Software Eng., pp. 62-71, 2005.
21 P. Tonella, P. Avesani, and A. Susi, “Using the Case-Based Ranking Methodology for Test Case Prioritization,” Proc. 22nd IEEE Int’l Conf. Software Maintenance, pp. 123-133, 2006.
22 X. Qu, M.B. Cohen, and K.M. Woolf, “Combinatorial Interaction Regression Testing: A Study of Test Case Generation and Prioritization,” Proc. IEEE Int’l Conf. Software Maintenance, pp. 255-264, 2007.
23 F. Basanieri, A. Bertolino, and E. Marchetti, “The Cow_Suite Approach to Planning and Deriving Test Suites in UML Projects,” Proc. Fifth Int’l Conf. Unified Modeling Language, pp. 275-303, 2002.
24 B. Jiang, Z. Zhang, W. Chan, and T. Tse, “Adaptive Random Test Case Prioritization,” Proc. IEEE/ACM Int’l Conf. Automated Software Eng., pp. 233-244, 2009.
25 D. Kundu, M. Sarma, D. Samanta, and R. Mall, “System Testing for Object-Oriented Systems with Test Case Prioritization,” Software Testing, Verification, and Reliability, vol. 19, no. 4, pp.97- 333, 2009.
26 Andrea Arcuri,Muhammad Zohaib Iqbal and Lionel Briand. (2012). Random Testing: Theoretical Results and Practical Implications. IEEE. 38 p258-277.
27 B. Baudry, F. Fleurey, J.-M. Je´ze´quel, and Y. Le Traon, “Automatic Test Cases Optimization: A Bacteriologic Algorithm,” IEEE Software, vol. 22, no. 2, pp. 76-82, Mar./Apr. 2005.
28 S. Zhang, D. Saff, Y. Bu, and M. Ernst, “Combined Static and Dynamic Automated Test Generation,” Proc. ACM Int’l Symp. Software Testing and Analysis, 2011.
29 P. Godefroid, N. Klarlund, and K. Sen, “DART: Directed Automated Random Testing,” Proc. ACM SIGPLAN Conf. Programming Language Design and Implementation, pp. 213-223, 2005.
30 W. Visser, C.S. Pasareanu, and S. Khurshid, “Test Input Generation with Java PathFinder,” Proc. ACM SIGSOFT Int’l Symp. Software Testing and Analysis, pp. 97-107, 2004.
31 K. Inkumsah and T. Xie, “Improving Structural Testing of Object-Oriented Programs via Integrating Evolutionary Testing and Symbolic Execution,” Proc. 23rd IEEE/ACM Int’l Conf. Automated Software Eng., pp. 297-306, 2008.
32 M. Islam and C. Csallner, “Dsc+Mock: A Test Case + Mock Class Generator in Support of Coding against Interfaces,” Proc. Eighth Int’l Workshop Dynamic Analysis, pp. 26-31, 2010.
33 A. Arcuri, “A Theoretical and Empirical Analysis of the Role of Test Sequence Length in Software Testing for Structural Coverage,” IEEE Trans. Software Eng., vol. 38, no. 3, pp.497-519, May/ June 2011.
34 C. Csallner and Y. Smaragdakis, “JCrasher: An Automatic Robustness Tester for Java,” Software Practice and Experience, vol. 34, pp. 1025-1050, 2004.
35 W. Eric Wong, J. R. Horgan, Saul London, Hira Agrawal. (1997). A Study of Effective Regression Testing in Practice. IEEE. 8 (1), p 264-274.
36 Greegg Rothermel, Sebastian Elbaum, Alexey Malishevsky, Praveen Kallakrui and Brian Davia (2011), The impact of test suite granularity on the cost-effectiveness of Regression Testing, University of Nebraska – Lincoln, p1-12.
37 Hema Srikanth, Laurie Williams, Jason Osborne. (2000). System Test Case Prioritization of New and Regression Test Cases. Department of Computer Science. 2 (4), p1-23.
38 J. Jenny Li. (2001). Prioritize Code for Testing to Improve Code Coverage of Complex Software. CID. p1-18.
39 Jiang, B; Zhang, Z; Chan, WK; Tse, TH. (2009). Adaptive random test case prioritization. International Conference On Automated Software Engineering. 4 (24), p233-244.
40 Johannes Ryser. (2000). Using Dependency Charts to Improve Scenario-Based Testing. International Conference on Testing Computer Software TCS. 18 (3), p1-10.
41 Paolo Tonella, Paolo Avesani, Angelo Susi. (1997). Using the Case-Based Ranking Methodology for Test Case Prioritization. IEEE.p1-10.
42 Sebastian Elbaum. (2001). Incorporating Varying Test Costs and Fault Severities into Test Case Prioritization. Proceedings of the 23rd International Conference on Software Engineering. 23 (5), p1-10.
43 Xiao Qu, Myra B. Cohen, Katherine M. Woolf. (2006). Combinatorial Interaction Regression Testing: A Study of Test Case Generation and Prioritization. Department of Computer Science and Engineering, p149-170.
44 Zengkai Ma. (2001). Test Case Prioritization based on Analysis of Program Structure. Department of Computer Science, p149-170.
45 C. Prakasa Rao and P.Govindarajulu. (2015). “Automatic Discovery of Dependency Structures for Test Case Prioritization” . IJCSNS. 15 (n.d), p-52-57.
46 C. Prakasa Rao and P.Govindarajulu. (2014). “A Comprehensive Survey of Recent Developments in Software Testing Methodologies”, IJSR. 3 (n.d), p-1889-1895.
47 C. Prakasa Rao and P.Govindarajulu. (2015). “Genetic Algorithm for Automatic Generation of Representative Test Suite for Mutation Testing”. IJCSNS. 15 (n.d), p-11-17.
Mr. C. Prakasa Rao
S. V University, Tirupathi, Chittoor(Dt) AP - India
prakashrao.pec@gmail.com
Mr. P. Govindarajulu
Dept. of Computer Science ,S.V. University, Tirupathi Chittoor (Dt) AP, India - India