Video about this paper. Impressive results close to GPT4 but with a much smaller model. The interesting note in the paper is:

We are working with our legal team to publicly release a diff of the model weights in accordance with LLaMA’s release policy to be published at https://aka.ms/orca-lm