The wall-plate most probably has a AC-DC converter in it, and you're correct in thinking that these draw a small amount of power even under no load. However it would be almost trivial to completely turn this off when there is nothing physically plugged into the port using an electromechanical switch, and it makes sense to do this to avoid wasting power when the port is unused, so I suspect this is exactly what they have done.