Offal is definitely paleo food. Primitive hunting is often hard and dangerous. I bet ancient hunters who harvested dangerous animals tended to eat most every part of the animal that was edible.
PrincipleIntoPractice wrote about her offal weekend. Take a look.
PS: I saw a documentary about the Alaskan salmon run recently. I was quite surprised to learn that grizzlies during this time of abundance strip off and eat the skin of the fish, discarding the meat.