What's wrong with my fireplace?

My wood burning fireplace is taking the heat up the chimney and putting the smoke in the house. I've already opened the vent, the chimney is clean, and I've checked everything I can think of. Please help, it's cold.