Optimizing workloads with Transformers and Diffusers