Know your sender, know your caller, and know that they know you