Yep, you sure can - down in the Antarctic and here's the proof - but down under it's called the aurora australis!

...and...

Photos by courtesy of the British Antarctic Survey.