Is there any aeration in the soap? Micro bubbles would cause cloudiness. Or moisture?
I have never made it but if it is air or moisture then maybe letting the liquid stand for longer before letting it cool? Is the liquid nice and clear before it solidifies? Maybe a slower cooling curve?