If you don't want to chat to someone on facebook why add them as a friend at all? They're just as likely to pester you with messages in your inbox or write on your wall as to chat. Those distant contacts who you had a fleeting relationship with won't approach you for a chat for the same reason they don't contact you (or you contact them) because you both acknowledge the relationship as worthless.