This paper presents a pipeline for creating consistent characters using open-source generative AI tools, aimed at enhancing educational content. Through the use of XTTS, Fooocus, and FaceFusion, a talking avatar of the marine biologist Raffaele Issel was developed, accurately replicating his facial and vocal features. This study demonstrates how these tools can generate high-quality, engaging educational materials with minimal technical expertise and resources. The methodology facilitates the creation of interactive avatars for use in graphic novels and comic books, enriching museum and educational experiences

Building Consistent Characters through Open-Source Generative AI

Luca Martini;Lara La Tessa;Daniele Zolezzi
2024-01-01

Abstract

This paper presents a pipeline for creating consistent characters using open-source generative AI tools, aimed at enhancing educational content. Through the use of XTTS, Fooocus, and FaceFusion, a talking avatar of the marine biologist Raffaele Issel was developed, accurately replicating his facial and vocal features. This study demonstrates how these tools can generate high-quality, engaging educational materials with minimal technical expertise and resources. The methodology facilitates the creation of interactive avatars for use in graphic novels and comic books, enriching museum and educational experiences
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11567/1239455
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact