Categorical Flow Maps offer a continuous alternative to autoregressive language modeling. The approach applies continuous diffusion and flow matching to discrete data by mapping between a Gaussian distribution and one-hot encoded tokens. This technique unlocks continuous-modality advantages like accelerated sampling and tilting for discrete language generation.
Opening Kapyn…