Papers
Topics
Authors
Recent
Search
2000 character limit reached

On Augmenting Scenario-Based Modeling with Generative AI

Published 4 Jan 2024 in cs.SE | (2401.02245v1)

Abstract: The manual modeling of complex systems is a daunting task; and although a plethora of methods exist that mitigate this issue, the problem remains very difficult. Recent advances in generative AI have allowed the creation of general-purpose chatbots, capable of assisting software engineers in various modeling tasks. However, these chatbots are often inaccurate, and an unstructured use thereof could result in erroneous system models. In this paper, we outline a method for the safer and more structured use of chatbots as part of the modeling process. To streamline this integration, we propose leveraging scenario-based modeling techniques, which are known to facilitate the automated analysis of models. We argue that through iterative invocations of the chatbot and the manual and automatic inspection of the resulting models, a more accurate system model can eventually be obtained. We describe favorable preliminary results, which highlight the potential of this approach.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (42)
  1. Reactive Systems: Modelling, Specification and Verification. Cambridge University Press.
  2. ChatGPT as an Educational Tool: Opportunities, Challenges, and Recommendations for Communication, Business Writing, and Composition Courses. Journal of Artificial Intelligence and Technology, 3(2):60–68.
  3. BPjs: An Extensible, Open Infrastructure for Behavioral Programming Research. In Proc. 21st ACM/IEEE Int. Conf. on Model Driven Engineering Languages and Systems (MODELS), pages 59–60.
  4. Systematic Review in Software Engineering. Technical Report. System Engineering and Computer Science Department COPPE/UFRJ, Report ES 679.
  5. Evaluating the Code Quality of AI-Assisted Code Generation Tools: An Empirical Study on GitHub Copilot, Amazon CodeWhisperer, and ChatGPT. Technical Report. https://arxiv.org/abs/2304.10778/.
  6. A Survey on Evaluation of Large Language Models. Technical Report. https://arxiv.org/abs/2307.03109/.
  7. LSCs: Breathing Life into Message Sequence Charts. J. on Formal Methods in System Design (FMSD), 19(1):45–80.
  8. Self-Collaboration Code Generation via ChatGPT. Technical Report. https://arxiv.org/abs/2304.07590/.
  9. Investigating Code Generation Performance of Chat-GPT with Crowdsourcing Social Data. In Proc. 47th IEEE Computer Software and Applications Conf. (COMPSAC), pages 1–10.
  10. Google (2023). Bard. https://bard.google.com/.
  11. ScenarioTools — A Tool Suite for the Scenario-based Modeling and Analysis of Reactive Systems. Journal of Science of Computer Programming (J. SCP), 149:15–27.
  12. Scenario-Based Modeling and Synthesis for Reactive Systems with Dynamic System Structure in ScenarioTools. In Proc. 19th ACM/IEEE Int. Conf. on Model Driven Engineering Languages and Systems (MODELS), pages 16–23.
  13. ChatGPT and the Frustrated Socrates. Physics Education, 58(2).
  14. Synthesizing Executable PLC Code for Robots from Scenario-Based GR(1) Specifications. In Proc. 4th Workshop of Model-Driven Robot Software Engineering (MORSE), pages 247–262.
  15. Toward Methodical Discovery and Handling of Hidden Assumptions in Complex Systems and Models. In Engineering Safe and Trustworthy Cyber Physical Systems – Essays Dedicated to Werner Damm on the Occasion of His 71st Birthday. To Appear. arXiV preprint. https://arxiv.org/abs/2312.16507.
  16. Relaxing Synchronization Constraints in Behavioral Programs. In Proc. 19th Int. Conf. on Logic for Programming, Artificial Intelligence and Reasoning (LPAR), pages 355–372.
  17. On Composing and Proving the Correctness of Reactive Behavior. In Proc. 13th Int. Conf. on Embedded Software (EMSOFT), pages 1–10.
  18. Scaling-Up Behavioral Programming: Steps from Basic Principles to Application Architectures. In Proc. 4th SPLASH Workshop on Programming based on Actors, Agents and Decentralized Control (AGERE!), pages 95–108.
  19. On the Succinctness of Idioms for Concurrent Programming. In Proc. 26th Int. Conf. on Concurrency Theory (CONCUR), pages 85–99.
  20. An Initial Wise Development Environment for Behavioral Models. In Proc. 4th Int. Conf. on Model-Driven Engineering and Software Development (MODELSWARD), pages 600–612.
  21. First Steps Towards a Wise Development Environment for Behavioral Models. Int. Journal of Information System Modeling and Design (IJISMD), 7(3):1–22.
  22. Wise Computing: Toward Endowing System Development with Proactive Wisdom. IEEE Computer, 51(2):14–26.
  23. Non-Intrusive Repair of Reactive Programs. In Proc. 17th IEEE Int. Conf. on Engineering of Complex Computer Systems (ICECCS), pages 3–12.
  24. Non-Intrusive Repair of Safety and Liveness Violations in Reactive Programs. Transactions on Computational Collective Intelligence (TCCI), 16:1–33.
  25. The Effect of Concurrent Programming Idioms on Verification. In Proc. 3rd Int. Conf. on Model-Driven Engineering and Software Development (MODELSWARD), pages 363–369.
  26. Model-Checking Behavioral Programs. In Proc. 9th ACM Int. Conf. on Embedded Software (EMSOFT), pages 279–288.
  27. Specifying and Executing Behavioral Requirements: The Play In/Play-Out Approach. Software and System Modeling (SoSyM), 2:82–107.
  28. Programming Coordinated Scenarios in Java. In Proc. 24th European Conf. on Object-Oriented Programming (ECOOP), pages 250–274.
  29. Behavioral Programming. Communications of the ACM (CACM), 55(7):90–100.
  30. Scenario-Based Algorithmics: Coding Algorithms by Automatic Composition of Separate Concerns. Computer, 54(10):95–101.
  31. On the Development of Reactive Systems. Logics and Models of Concurrent Systems, F-13:474–498.
  32. Katz, G. (2013). On Module-Based Abstraction and Repair of Behavioral Programs. In Proc. 19th Int. Conf. on Logic for Programming, Artificial Intelligence and Reasoning (LPAR), pages 518–535.
  33. ChatGPT in Healthcare: A Taxonomy and Systematic Review. Technical Report. https://www.medrxiv.org/content/10.1101/2023.03.30.23287899v1.
  34. Is your Code Generated by ChatGPT really Correct? Rigorous Evaluation of Large Language Models for Code Generation. Technical Report. https://arxiv.org/abs/2305.01210/.
  35. MuseCoco: Generating Symbolic Music from Text. Technical Report. https://arxiv.org/abs/2306.00110/.
  36. Chatting about ChatGPT: how may AI and GPT Impact Academia and Libraries? Library Hi Tech News, 40(3):26–29.
  37. MetaAI (2023). LLaMa. https://ai.meta.com/llama/.
  38. OpenAI (2022). ChatGPT. https://chat.openai.com/.
  39. A Survey of Modeling Approaches for Software Ecosystems. In Proc. 7th Int. Conf. on Software Business (ICSOB), pages 79–93.
  40. Use Chat GPT to Solve Programming Bugs. Int. Journal of Information Technology & Computer Engineering (IJITC), 3(1):17–22.
  41. Attention is all you Need. In Proc. 31st Conf. on Advances in Neural Information Processing Systems (NeurIPS).
  42. Yaacov, T. (2023). BPPy: Behavioral Programming in Python. SoftwareX, 24.
Citations (4)

Summary

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Continue Learning

We haven't generated follow-up questions for this paper yet.

Collections

Sign up for free to add this paper to one or more collections.

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.