viviaxenov / text_to_image_with_transformer Public

forked from stankevich-mipt/text_to_image_with_transformer

Notifications You must be signed in to change notification settings
Fork 0
Star 1

An educational project dedicated to text-to-image generation with neural networks. VQVAE and BPE autoencoders are used to learn the embedding of text and image respectively. A transformer-based model then is trained to predict the next token in the concatenated sequence of image and text tokens and used for generation.

1 star 1 fork Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 5 Commits
transformer		transformer
vqvae		vqvae
README.md		README.md
annotations.txt		annotations.txt

Repository files navigation

text_to_image_with_transformer

About

An educational project dedicated to text-to-image generation with neural networks. VQVAE and BPE autoencoders are used to learn the embedding of text and image respectively. A transformer-based model then is trained to predict the next token in the concatenated sequence of image and text tokens and used for generation.

machine-learning transformer neural-networks text-to-image bpe vqvae

Report repository

Languages

Python 100.0%