Regardless of how you feel about it you probably need to clue your admin in. If they wanted to contact the ex assistant and ask them to stop they could, or they could just leave it alone. But worse case scenario, if something bad every happened you have covered yourself it would never look like you were covering for them.