Water

My family uses a water cooler as our drinking water source, as our tap water isn't that great. Would a chinchilla be okay from drinking water from the water cooler, or do I need to get water that's more purified?