What is Normalization for, exactly?

What does it mean to normalize a database?
How does one normalize a database?

These are two really common software development interview questions. So common in fact that most candidates can offer a compelling answer quite readily. Possibly not as succinct as: