The card you return with Acolyte of Affliction's ability may be one that you just put into your graveyard with its ability. This is because the ability doesn't target the card that you'll return.

A permanent card is an artifact, creature, enchantment, land, or planeswalker card.