[Python] Can one use DPO (direct preference optimization) of GPT via CLI or Python on Azure?

Can one use DPO of GPT via CLI or Python on Azure?

• https://learn.microsoft.com/en-us/a...to/fine-tuning-direct-preference-optimization just shows how to do DPO of GPT via CLI on Azure via web UI
• https://learn.microsoft.com/en-us/azure/ai-services/openai/tutorials/fine-tune?tabs=command-line is CLI and Python but only SFT AFAIK

Continue reading...