Place apple juice in a medium sized saucepan. Add cloves, cinnamon sticks, cardamom, star anise, ginger and lemon zest. Cover and heat on low-med for 20 minutes, adding orange slices in last 5 minutes.
Remove from heat and strain spices and fruits. Serve immediately.