Likely the most stressful part of financial difficulties is dealing with collection agencies. The endless calls and letters, threats, even the manipulation that a debtor experiences is often overwhelming. Collection agencies must follow certain rules when they attempt to collect money, but it can still be difficult dealing with them.