Does Caffiene Prevent Weight Loss?

This is the second time I have given up caffeine in the past year. The first time, my weight dropped a lot. After a few weeks of this, I was down 5 pounds. This time after 2 weeks, I am down 5 pounds again. I am trying to see if this is because of the caffeine or other factors. It does seem strange that it has happened twice. I have noticed that I am not craving certain foods that I would love to sit and eat while drinking my coffee. One of those foods was chocolate chips, though I am still eating them a few times a week to give myself nice treat. This can’t be it. I am drinking a little more water than before, but not too much. Before, I would have 4-5 cups of coffee. Now I am drinking 1-2 cups of decaf, plus maybe 1-2 cups of hot water and 2-3 liters of water per day. Also, when I drank coffee, I always drank it black. There was no extra calories from sugar or milk. I tried to do a web search, but most items deal with caffeine and weight loss. Has anyone gone decaf and had similar results?