Entirely VQGAN + CLIP, here's a link to the notebook.
https://colab.research.google.com/drive/16E3SWzDecA8W53EHghMvF3vk4FneiL9i