Exploration of a Generative AI Assistant for Storyboarding and Scenario Generation

Abstract

Generative Artificial Intelligence (GenAI) has significantly impacted not only creative industries but has found a unique place in military-based applications in storyboarding and scenario generation. GenAI has streamlined this process, making it faster, more accessible, and often more flexible to a larger audience of users. One key advantage is its ability to quickly generate a range of textual and visual concepts from user prompting. GenAI-based storyboards facilitate innovation and collaboration, amongst program managers, engineers, computer scientists, designers and the developers. Use of Large Language Models (LLMs) can be structured to support many features of storyboard creation especially from other perspectives beyond the entertainment business. It supports story drafting, shot list creation, image generation and assembly of the storyboard. This supports communication amongst the stakeholders. This research incorporates an application from initial story creation to the assembly of the storyboard with embedded module functionality found in ComfyUI which is a node-based interface and inference engine for GenAI. This is an open-source tool aid in the execution and integration of features and processes to reach desired outcomes that align with defined goals and objectives of Navy projects.

Keywords: Storyboarding, Generative AI, ComfyUI, Shot List, Workflow

DOI: 10.54941/ahfe1006936