I had the same problem. When I remove the filter, it would dispense water. Based on the comments and solutions suggested here, I thought the filter was defective so tried it out with four new filters - all same results. So realized it can't be the filter.
So when the filter is removed, there is a part that looks like a plastic tray (it seems like its there to collect water when adding/removing filter). I tried adjusting that. I was able to push it in and out..so I pushed it in and then replaced the filter..and somehow it started dispensing water.
I am not sure if that fixed the problem or something else, for now I am afraid to take the filter out to prove the theory..but will try that when I have to replace the filter again.
For now I am good.