https://arxiv.org/abs/2502.17437

https://github.com/LTH14/fractalgen

Modularization is a cornerstone of computer science, abstracting complex functions into atomic building blocks.

Fractal Generative Models

Recursively construct more advanced generative models from existing atomic generative modules.

Motivation and Intuition

  1. A fractal generator $g_i$ specifies how to produce a set of new data $x_{i+1}$ for the next-level generator based on one output $x_i$ from previous-level generator:

$$ {x_{i+1}} = g_i (x_i) $$

Because each generator level can produce multiple outputs from a single input, a fractal framework can achieve an exponential increase in generated outputs while only requiring a linear number of recursive levels.

Autoregressive Model as Fractal Generator