Descripción:
The advancement of large-scale language models (LLMs) has opened up new possibilities for automating unit test generation, a traditionally manual and expensive task. This quantitative study evaluates the performance of three LLMs-ChatGPT 4o mini, DeepSeek v3, and Gemini 2.5 Flash Pro-in generating test cases for methods in C# developed in Unity. The execution success rate of the generated tests was measured using real and synthetic data. The synthetic data was intentionally created to represent common structures, while the real data came from existing project functions. The experimental design was controlled and included the factors LLM and data type and the blocks cyclomatic complexity and contextual memory with four replicates per combination, for a total of 96 experimental treatments. The results show that LLMs have a high potential to support the automatic generation of unit tests. Furthermore, it was evidenced that the choice of model has a significant effect on the success rate of the generated tests. These findings provide useful initial evidence to guide the selection and use of LLMs in test automation processes within software development environments
Tipo de publicación: Conference Paper
Publicado en: 2025 IEEE VIII Congreso Internacional en Inteligencia Ambiental, Ingenieria de Software y Salud Electronica y Movil (AmITIC)
Autores- Treviğno-Villalobos, Marlen
- Quesada-López, Christian
- Jiménez-Delgado, Efrén
- Quirós-Oviedo, Rocío
- Díaz-Oreiro, Ignacio
Investigadores del CITIC asociados a la publicación
Dr. Christian Quesada-López
Mag. Efrén Jiménez Delgado
Dr. Ignacio Díaz Oreiro
Proyecto asociado a la publicación
Integración de estrategias de inteligencia artificial en procesos de ingeniería de software