If I remember right, documenting when the other side leaves and how much time that leaves you can help a lot. You can use it to bring it up with admin or a referee, though it's more to protect yourself if anyone gets angry over time, or a penalty.