South Africa

Vodacom and others sell pay-as-you-go SIM cards in major airports. Top-up vouchers are available widely, at kiosks/vending machines and in retail establishments.

Vodacom (not sure about others) sells separate data packages as well -- and if you can tether your phone to your computer or use the phone as a hotspot, this can provide huge savings over hotel Internet charges.