Besides fines and angry employees, you also want to avoid penalties placed by the government because of mistakes made on your payroll taxes. Unless you outsource your payroll to a payroll service, like a professional employment organization or hire a properly trained payroll person to do your payroll and payroll taxes there are bound to be a couple mistakes. Here are five things you can do to avoid payroll mistakes.