What is the consensus on who should get off the sidewalk first?

If I’m taking my dog for a walk, I would prefer to stay on it so he can poop and pee. Yes, I’m getting him exercise, but I’m also taking him out for a bathroom break.

I figure folks with kids in strollers get priority to stay on the sidewalk. And also parents playing with their kids on the sidewalk should not move. And this is coming from someone that finds most kids annoying.

But if you see me walking on the sidewalk with my dog, can you be the one to go into the empty street?