It isn't a noble gas. Dictionaries and encyclopediaes are sometimes wrong.
That's correct, N2 doesn't react with much in room temperature conditions.
Phosphorus is different. Probably MOT can explain it. It has a few allotropes. White P burns with O2 at room temp.
According to wikipedia, "This P4 tetrahedron is also present in liquid and gaseous phosphorus up to the temperature of 800 °C when it starts decomposing to P2 molecules"
so perhaps in the gas phase, at the bp, you already have some P2. As temp goes up, the equilibrium shifts to the right
P4 <=> 2 P2