If you add aqueous base, there will be some water around, and I would wonder whether the sodium carboxylate salt is soluble in water. For a non polar carboxylic acid, you could try dissolving in hot organic solvent, then adding water dropwise. In other words, you could use a mixed solvent to recrystallize.