Does Every New Speaker Need a New Paragraph?

“Yes, in ordinary story dialogue. Begin a new paragraph whenever the speaker changes, even if each person says only a few words. Readers can follow the exchange without working out who is speaking. Keep an action by the same speaker in that speaker’s paragraph when their connection is evident.”