An LLM-based Approach to Recover Traceability Links between Security Requirements and Goal Models

Jameleddine Hassine*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

4 Scopus citations

Abstract

The recovery of requirements traceability links between goal models and requirements is crucial for ensuring alignment between stakeholder objectives and system specifications. Large Language Models (LLMs) show potential to transform automated traceability significantly, addressing challenges such as accurately capturing diverse relationships between requirements artifacts, and ensuring scalability and efficiency in large-scale software projects. In this paper, we propose an LLM-based approach to generate security-related traceability links between requirements (expressed in natural language) and goals (described as part of GRL models). We employ a Zero-Shot (0S) approach utilizing GPT-3.5-turbo, enhanced by employing a meticulously crafted prompt. The approach is implemented in a prototype tool, tailored for the textual GRL (TGRL) language. We evaluate the approach and tool using a GRL model describing the objectives of a Virtual Interior Designer application along with a set of 42 requirements addressing both security and non-security aspects. The approach and tool yielded positive results, demonstrating a precision of 100%, a recall of 78.5%, and an F1-score of 87.9%.

Original languageEnglish
Title of host publicationProceedings of 2024 28th International Conference on Evaluation and Assessment in Software Engineering, EASE 2024
PublisherAssociation for Computing Machinery
Pages643-651
Number of pages9
ISBN (Electronic)9798400717017
DOIs
StatePublished - 18 Jun 2024
Event28th International Conference on Evaluation and Assessment in Software Engineering, EASE 2024 - Salerno, Italy
Duration: 18 Jun 202421 Jun 2024

Publication series

NameACM International Conference Proceeding Series

Conference

Conference28th International Conference on Evaluation and Assessment in Software Engineering, EASE 2024
Country/TerritoryItaly
CitySalerno
Period18/06/2421/06/24

Bibliographical note

Publisher Copyright:
© 2024 ACM.

Keywords

  • Goal-oriented Language (GRL)
  • GPT-3.5-turbo
  • Large Language Model (LLM)
  • security requirements
  • traceability link

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Computer Networks and Communications
  • Computer Vision and Pattern Recognition
  • Software

Fingerprint

Dive into the research topics of 'An LLM-based Approach to Recover Traceability Links between Security Requirements and Goal Models'. Together they form a unique fingerprint.

Cite this