This research explores the integration of iterative optimization schemes for enhancing reasoning within generative AI.### Findings

• Improved performance in generative reasoning with iterative preference optimization.

• Notable performance increases with Llama-2-70B-Chat model on multiple reasoning benchmarks.

  Implications

  The insights provided by iterative preference optimization can significantly benefit generative AI development, particularly in complex reasoning tasks.