The 61st CREST Open Workshop - Statistics, Learning,  Genetic Improvement and Testing for Programs.

Date: 21st and 22nd October 2019

Venue: Friends House, 173-177 Euston Road, London, NW1 2BJ

Overview:

Software testing is expanding, growing, and finding new connections and uses like some strange mutant changeling. This workshop aims to reflect and celebrate this. To this end we want to attract software engineering researchers with interest and expertise in some of the following areas: applications of statistics to problems in SE, applications of machine learning to problems in SE, Genetic Improvement of Programs and, last but not least, Software Testing. We are interested in both the intersections and the unions of these areas and hope to find new research synergies beyond those that exist already. Examples of illustrative developments in this union from within CREST  include Software Transplantation, novel approaches to testing machine learning systems, information theoretic models of failed error propagation and oracle improvement in software testing, the use of deep neural nets to create and reconfigure search landscapes in testing, the use of search in adversarial machine learning, and the use of testing in the application of GI to a long list of types of software improvement. To grow and deepen these connections, this workshop will present a list of talks in the union (and sometimes the intersections) of these areas. 

Organizers:

David Clark, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

Héctor D Menéndez, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

Justyna Petke, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

Bill W. Langdon, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

Speakers: 

Professor Paolo Tonella, Università della Svizzera Italiana (USI)

Dr. Andrea Stocco, Università della Svizzera Italiana (USI)

Dr. Michail Papadakis, University of Luxembourg

Dr. Maxime Cordy, University of Luxembourg

Dr. Annibale Panichella, Delft University of Technology

Professor Martin Shepperd, Brunel University London

Dr. Justyna Petke, University College London

Professor Bill W. Langdon, University College London

Professor Shin Yoo,  Korea Advanced Institute of Science and Technology

Dr. Felix Dobslaw, Chalmers University of Technology

Professor Battista Biggio, University of Cagliari, Co-Founder of Pluribus One

Dr. David Clark, University College London

Dr. Krishna Patel, University of Sheffield

Dr. Alessio Gambi, University of Passau

Dr. Jie Zhang, University College London

Mr. Leonid Joffe, University College London

Registration: The register is closed

Speakers and schedule:

Day 1 - 21st of October

10:00 Pastries

10:30 Welcome and introductions

11:00 Professor Paolo Tonella, Università della Svizzera Italiana (USI) -- "What is a bug in deep learning applications?"

11:30 Dr. Annibale Panichella, Delft University of Technology -- "Testing Autonomous Cars for Feature Interaction Failures using Evolutionary Intelligence"

12:00 Professor Martin Shepperd, Brunel University London -- "The prevalence of errors in computational experiments"

12:30 Lunch

13:30 Professor Battista Biggio, University of Cagliari, Co-Founder of Pluribus One -- "Wild Patterns: Ten Years After the Rise of Adversarial Machine Learning"

14:00 Dr. David Clark, University College London -- "Information Theory applications on Software Testing"

14:30 Dr. Michail Papadakis, University of Luxembourg -- "Applications of Deep Learning Adversarial data"

15:00 Refreshments

15:30 Dr. Alessio Gambi, University of Passau -- "Generating effective test cases for self-driving cars"

16:00 Dr. Maxime Cordy, University of Luxembourg -- "Search-Based Test and Improvement of Machine-Learning-Based Anomaly Detection Systems"

16:30 Final discussion and wrap up

17:00 Close

Day 2 - 22nd of October

10:00 Pastries

10:30 Professor Shin Yoo,  Korea Advanced Institute of Science and Technology -- "The role of SBSE in the age of deep neural networks"

11:00 Dr. Felix Dobslaw, Chalmers University of Technology - "Using Diversity for Automated Boundary Value Testing"

11:30 Dr. Andrea Stocco, Università della Svizzera Italiana (USI) -- "Black-box Confidence Estimation for Misbehavior Prediction in Autonomous Driving Systems"

12:00 Lunch

13:30 Dr. Justyna Petke, University College London -- "Genetic Improvement of Software"

14:00 Dr. Jie Zhang, University College London --  "Machine Learning Testing: Survey and Practices"

14:30 Dr. Krishna Patel, University of Sheffield -- "Normalised Squeeziness and Failed Error Propagation"

15:00 Refreshments

15:30 Professor Bill W. Langdon, University College London -- "Big Data Driven Genetic Improvement for Maintenance of Legacy Software Systems"

16:00 Mr. Leonid Joffe, University College London -- "Use of Neural Networks in SBST: from defining fitness functions to generating test inputs"

16:30 Final discussion and wrap up

17:00 Close

Registered Attendees:

1. Dr. David Clark, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

2. Dr. Héctor D Menéndez, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

3. Dr. Justyna Petke, CREST Centre, SSE Group, Department of Computer Science, UCL, UK 

4. Professor Bill W. Langdon, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

5. Professor Paolo Tonella, Università della Svizzera Italiana (USI)

6. Dr. Andrea Stocco, Università della Svizzera Italiana (USI)

7. Dr. Michail Papadakis, University of Luxembourg

8. Dr. Maxime Cordy, University of Luxembourg

9. Dr. Annibale Panichella, Delft University of Technology

10. Dr. Giovani Guizzo, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

11. Dr. Earl Barr, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

12. Mr. Robert White, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

13. Dr. Sergey Mechtaev, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

14. Dr. Maria Kechagia, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

15. Professor Martin Shepperd, Brunel University London

16. Dr. Marija Katic,  Independent Researcher, London, UK

17. Professor Shin Yoo,  Korea Advanced Institute of Science and Technology

18. Dr. Felix Dobslaw, Chalmers University of Technology

19. Dr. Vesna Nowack, Queen Mary University of London

20. Dr. Aymeric Blot, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

21. Professor Robert Hierons, University of Sheffield

22. Dr. Krishna Patel, University of Sheffield

23. Dr. Vincenzo Riccio, Università della Svizzera Italiana (USI)

24. Mr. David Kelly, University College London

25. Dr. Alessio Gambi, University of Passau

26. Dr. Jie Zhang, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

27. Professor Mark Harman, Facebook and CREST Centre, SSE Group, Department of Computer Science, UCL, UK

28. Dr. Kelly Androutsopoulos, Middlesex University London

29 Dr. Salah Ghamizi, SnT – University of Luxembourg

30 Mr. Alexander Wild, Lancaster University

31. Mr. Profir-Petru Partachi, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

32. Dr. Saúl Vargas, ASOS.com

33. Dr. Paolo Falcarin, University of East London

34. Mr. Sergi Bray, University College London

35. Dr. Mustafa Bozkurt, Queen Mary University of London

36. Mr. Alfredo Ibias, Universidad Complutense de Madrid

37. Mr. Iason Papapanagiotakis-Bousy, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

38. Dr. Daniel Strüber, Chalmers, University of Gothenburg

39. Dr. Jenjira Jaimunk, Department of Informatics, King's College London

40. Mr. James Callan, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

41. Professor Battista Biggio, University of Cagliari, Co-Founder of Pluribus One

42. Mr. Louis Vines, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

43. Dr. John Woodward, Queen Mary University of London

44. Dr. Nicolas Gold, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

45. Mr. Alex Burdusel, Kings College London

46. Dr. Ivan Postolski, Universidad de Buenos Aires

47. Mr. Max Hort, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

48. Ms. Rebecca Moussa, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

49. Mr. Leonid Joffe, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

50. Mr. Vali Towasi, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

51. Dr. Zheng Gao, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

52. Dr. Jens Krinke, CREST Centre, SSE Group, Department of Computer Science, UCL, UK

53. Dr Simos Gerasimou, University of York