Tolkien & Gen AI

Luis García Castro

XXVIII Mereth Aldaron Enyalië, 2024

El camino hacia GenAI

Definiciones

IA: "Disciplina científica que se ocupa de crear programas informáticos que ejecutan operaciones comparables a las que realiza la mente humana, como el aprendizaje o el razonamiento lógico". DRAE

Machine Learning: "Campo de estudio que confiere a los ordenadores la capacidad de aprender sin ser programados explícitamente.” Arthur Samuel, 1959

Aprendizaje en IA

Supervisado

No supervisado

Ejemplos de potencial

AlphaGo (2015)

AlphaGo Zero (2017)

Limitaciones

Gran cantidad de datos

Sesgos en los datos

Explicabilidad

Explicabilidad

Retos y limitaciones

Gran cantidad de datos
Sesgos en los datos
Interpretabilidad
Especialización
Requerimientos computacionales
Mantenimiento y actualización
Seguridad, privacidad, ...

Large Language Models

Hitos clave

Deep Learning (2012)

Transformers (2017)

Arquitectura de un Transformer

Entrenando un LLM

La capital de Francia es París
La energía no se crea ni se destruye, solamente se transforma
Los tipos de interés subirán a partir de Enero
En un agujero en el suelo vivía un Hobbit
def to_lower_case(string):
return string.lower()
Emosido engañados

GPT-1 (2018), GPT-2 (2019) & GPT-3 (2020)

Comportamiento emergente

Punto de inflexión con GPT-3

Embeddings

King - Man + Woman = Queen

Doctor - Man + Woman = Nurse

Unimodal vs Multimodal

Multimodal Recursivo

“In this image, a young individual is captured mid-movement on a sandy beach, holding a large red frisbee. Dressed in a casual white T-shirt and patterned shorts that showcase a mix of grey, black, and white, they are seemingly engaged in an active beach game. The backdrop features distinctive thatched beach umbrellas and benches, creating a relaxing and tropical atmosphere. The sandy terrain stretches into the distance, with patches of grass adding a hint of greenery to the otherwise neutral-toned landscape. The scene has a candid and energetic vibe, perfectly capturing the essence of beachside recreation”

Multimodal Recursivo

Analyzing Recursiveness in Multimodal Generative Artificial Intelligence: Stability or Divergence?

Multimodal Recursivo

“This captivating image portrays a mystical and cosmic scene that combines spiritual and celestial elements. The centerpiece is an intricate mandala, radiating vibrant colors and exquisite geometric patterns, creating a mesmerizing focal point. Surrounding the mandala are numerous celestial bodies, including planets and swirling galaxies, set against a rich, star-studded background that conveys an infinite, otherworldly landscape. Gathered in a large circular formation beneath the mandala, robed figures stand in reverence, each adorned with ornate, mandala-like symbols on their backs. Their garments are vibrant and elaborately designed, reflecting the swirling hues and patterns of the cosmos above them. Light beams and cosmic energy seem to connect the mandala with the assembly below, suggesting a deep spiritual connection and unity between the celestial and the earthly realms. The overall style is a blend of psychedelic art and visionary imagery, filled with rich, luminous colors, intricate details, and a profound sense of cosmic wonder and spiritual enlightenment”