Getting killed while waiting for a duel would be pretty $hitful, but perhaps it would be worthwhile taking a quick look at where the other duel is so you can initiate the duel as soon as they're done.
I'd keep your sabers up, so if some 14M3® tries to fight you, then you and your would-be duel opponent can double-team kick their st00pid @$$. That should stop them from attacking peeps "in line" for duels again.
The Force will be with you, always.