Author Login IJIRT Partner Network (IPN) Login

AI Story Craft: A Platform for collaborative storytelling, blending human creativity with AI driven text and visuals to craft engaging narratives

  • Unique Paper ID: 176719
  • Volume: 11
  • Issue: 11
  • PageNo: 6137-6141
  • Abstract:
  • The rapid advancements in both image generation and open-form text generation have opened new avenues for creating interleaved image-text content. This paper focuses on multimodal story generation, an innovative task that integrates narrative text with rich visual elements in a cohesive manner. While promising, this end story presents substantial challenges, particularly in understanding the intricate relationship between text and images, as well as in generating extended sequences of coherent, contextually relevant narratives and visuals. We introduce Story Teller, a groundbreaking approach that harnesses a Multimodal Large Language Model (MLLM) to create comprehensive multimodal stories. Our model excels in predicting both text and visual tokens, employing an adapted visual de tokenizer to generate images that maintain character consistency and stylistic coherence. We also introduce a novel multimodal attention sink mechanism that facilitates the efficient generation of stories with up to 25 interleaved sequences, surpassing the training limit of 10. To support our model and evaluate the multimodal story generation task, we present StoryStream, a large-scale, high-resolution dataset designed for comprehensive training and quantitative analysis. This work aims to advance the state of multimodal storytelling, offering insights and tools for future research in this dynamic field.
Download article email to a friend

Cite This Article

  • ISSN: 2349-6002
  • Volume: 11
  • Issue: 11
  • PageNo: 6137-6141

AI Story Craft: A Platform for collaborative storytelling, blending human creativity with AI driven text and visuals to craft engaging narratives

Related Articles

Impact Factor
8.01 (Year 2024)
UGC Approved
Journal no 47859

Join Our IPN

IJIRT Partner Network

Submit your research paper and those of your network (friends, colleagues, or peers) through your IPN account, and receive 800 INR for each paper that gets published.

Join Now

Latest Publication

Archive

View More

Recent Conferences

NCSEM 2024

National Conference on Sustainable Engineering and Management - 2024 Last Date: 15th March 2024

Submit inquiry