Towards LLM-Assisted System Testing for Microservices

Mustafa Almutawa*, Qusai Ghabrah, Marco Canini

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

As modern applications are being designed in a distributed, Microservices Architecture (MSA), it becomes increasingly difficult to debug and test those systems. Typically, it is the role of software testing engineers or Quality Assurance (QA) engineers to write software tests to ensure the reliability of applications, but such a task can be labor-intensive and time-consuming. In this paper, we explore the potential of Large Language Models (LLMs) in assisting software engineers in generating test cases for software systems, with a particular focus on performing end-to-end (black-box) system testing on web-based MSA applications. We present our experience building Kashef, a software testing tool that utilizes the advanced capabilities of current LLMs in code generation and reasoning, and builds on top of the concept of communicative agents.

Original languageEnglish (US)
Title of host publicationProceedings - 2024 IEEE 44th International Conference on Distributed Computing Systems Workshops, ICDCSW 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages29-34
Number of pages6
ISBN (Electronic)9798350354713
DOIs
StatePublished - 2024
Event44th IEEE International Conference on Distributed Computing Systems Workshops, ICDCSW 2024 - Jersey City, United States
Duration: Jul 23 2024Jul 26 2024

Publication series

NameProceedings - 2024 IEEE 44th International Conference on Distributed Computing Systems Workshops, ICDCSW 2024

Conference

Conference44th IEEE International Conference on Distributed Computing Systems Workshops, ICDCSW 2024
Country/TerritoryUnited States
CityJersey City
Period07/23/2407/26/24

Keywords

  • Communicative Agents
  • Large Language Models (LLMs)
  • Software Testing
  • Testing Automation

ASJC Scopus subject areas

  • Information Systems
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Modeling and Simulation
  • Computer Networks and Communications
  • Hardware and Architecture

Fingerprint

Dive into the research topics of 'Towards LLM-Assisted System Testing for Microservices'. Together they form a unique fingerprint.

Cite this