Generative Interactive Environments - GENIE: After SORA the next step is interactive video environments: Synthetic world AI systems.
Technology: BERT, VQVAE - Vector Quantized Variational AutoEncoders, Text-to-Video, novel video tokenizer, subobject tokenizer, Subobject-level tokenization, MaskGIT - Masked Generative Image Transformer, Latent Action Model (LAM), Dynamics model, Spatial-Temporal Transformer (ST-Transformer), Vision Transformers (ViT), SORA, V-JEPA, World Models, Video Models, GENIE virtual video world generation. Interactive and controllable video environments. Synthetic generated interactive worlds.
All rights with authors:
Genie: Generative Interactive Environments
https://arxiv.org/pdf/2402.15391.pdf
by Google DeepMind
#airesearch
#games
#videogame
#newtechnology
7 Comments