Choice for reduced order model / latent space

Hi,
anyone can suggest which model that can be used as encoder to reduced information as a latent space and recover back to original state? I can do it using AE based CNN but have no idea to use ViT based model.

thanks