Why is midway geyser in yellowstone so colorful?

Where do all the colors come from? isnt it just water? are you allowed to go in it or is it super heated?