I know exactly what you mean. I say take the chair and play dumb, chances are your suspicion of desertion was correct. Why should you miss out an opportunity of leisure due to someone else's inconsideration? Besides, I think that person would be too intimidated to accuse an innocent person of chair stealing and cause a fight themselves. And if they do, offer to buy them a drink, free drinks give up chairs very easily!!