Regularly deleting emails is a good practice because it ensures that your inbox doesn't get too clogged up with junk mail or old emails that you no longer need.
Imagine saving all the physical mail you've ever received! Sounds a bit ridiculous. It would take up too much space and in most cases, would offer little to no value. This is true of email, too.