You’ve been storing peanut butter the wrong way.
Never arm wrestle with a jar of peanut butter, just to make sure it’s not oily on top and crumby on the bottom, again. Store it upside down, so the oils distribute evenly.