which directors were the biggest jerks and hardest to work with?

Michael Curtiz.
Although he directed such classic films as THE ADVENTURES OF ROBIN HOOD, YANKEE DOODLE DANDY, CASABLANCA, and MILDRED PIERCE, he was heartily despised by the actors under his rule.
His most famous line is probably, "Bring on the empty horses!"