What makes accents so hard?

Having worked with thousands of actors, I have a few theories.