The 2nd CREST Open Workshop

Software Testing

Date:

Tuesday, 8 December 2009

Venue:

CREST Centre, King's College London

Automated Developer Testing: Achievements and Challenges

Tao Xie, North Carolina State University, USA

Tao Xie is an Assistant Professor in the Department of Computer Science at North Carolina State University. He received his Ph.D. in Computer Science from the University of Washington in 2005. His research interests are in software engineering, under two major themes: automated software testing and mining software engineering data. Besides doing research, he has contributed to understanding the software engineering research community. He has served as ACM SIGSOFT History Liaison in the SIGSOFT Executive Committee. He received an NSF CAREER Award in 2009. He received 2008 and 2009 IBM Faculty Awards and a 2008 IBM Jazz Innovation Award. He received the ASE 2009 Best Paper Award and an ACM SIGSOFT Distinguished Paper Award. He served as Program Co-Chair of 2009 IEEE International Conference on Software Maintenance (ICSM). He has served on program committees of various conferences, including ICSE, ISSTA, ASE, and WWW. (http://www.csc.ncsu.edu/faculty/xie)

Developer testing, a common step in software development, involves generating sufficient test inputs and checking the behavior of the program under test during the execution of the test inputs. Complicated logics inside a method make generating appropriate arguments difficult. In testing object-oriented programs, generating method sequences to put the receiver object or argument objects into appropriate states further complicates test-input generation. After the generated test inputs are executed, program crashes or uncaught exceptions can be used to indicate program problems, especially robustness problems. However, some program problems such as producing wrong program outputs do not crash the program. This talk will present an overview of achievements and challenges in improving automation in developer testing, especially on test-input generation (i.e., generating sufficient test inputs) and test oracles (i.e., checking the behavior of the program under test). This talk will also discuss our recent automated testing approaches developed upon the Microsoft Research Pex tool (http://research.microsoft.com/en-us/projects/pex/) in collaboration with Microsoft Research.

Programme and Downloadable Resources:

Talks will be 25 minutes allowing 15 minutes for discussion and questions.

12:15    Sandwich Lunch

13:00    Welcome to CREST Open Workshop

              Mark Harman, CREST Centre, SSE Group, Department of Computer Science, UCL

13:15    Keynote: Automated Developer Testing: Achievements and Challenges (Slides: 1, Videos: 1,  2,  3, 4,  5)

              Tao Xie, North Carolina State University, USA

14:15    Discussion

15:15    Refreshments

15:45    Extension, Abbreviation and Refinement ? Identifying High?Level Dependence Structures Using Slice?Based Dependence Analysis (Slides: 1, Videos: 1, 2)

              Zheng Li, CREST Centre, SSE Group, Department of Computer Science, UCL

16:15    Discussion

16:45    Demo of tools and repositories (15 mins each) (Videos: 1,  2):             

•      MiLu (Slides: 1)

               Yue Jia, CREST Centre, SSE Group, Department of Computer Science, UCL

•      AUSTIN & Flag Remover

              Kiran Lakhotia, CREST Centre, SSE Group, Department of Computer Science, UCL

•     SBSE Repository

              Yuanyuan Zhang, CREST Centre, SSE Group, Department of Computer Science, UCL

•     Mutation Testing Repository

      Yue Jia, CREST Centre, SSE Group, Department of Computer Science, UCL

17:45    Wrap up

18:00    Close