A Wind Advisory has been issued for most of New Jersey Wednesday, as gusts potentially top 40 mph through the afternoon.