Comparing the effort and effectiveness of automated and manual tests

Descripción:

This paper presents three case studies that compare the effort and effectiveness of automated versus manual testing, in the context of a multinational services organization. Effort is measured in terms of the total test time, which includes script creation and test execution in the case of automated testing, and comprises test execution and reporting in the case of manual testing. Effectiveness is measured in terms of the number and severity of defects found. The software under test is a set of Java web applications. The testing process was carried out by two testers within the organization. Our results show that automated testing needs a higher initial effort, mainly caused by the creation of the scripts, but this cost can be amortized in time as automated tests are executed multiple times for regression testing. Results also show that automated testing is more effective than manual testing at finding defects.

Tipo de publicación: Conference Paper

Publicado en: 14th Iberian Conference on Information Systems and Technologies (CISTI)

Autores
  • Ignacio Dobles
  • Alexandra Martinez
  • Christian Quesada-López

Investigadores del CITIC asociados a la publicación
Dra. Alexandra Martínez Porras
Dr. Christian Quesada-López

Proyecto asociado a la publicación
Evaluación de herramientas automatizadas para pruebas de software basadas en modelos

DOI BIBTEXT

Datos bibliográficos
Cita bibliográfica
Comparing the effort and effectiveness of automated and manual tests