Yes thunder can happen in the winter months and sometimes you can even get thunder with snow which is called thunder snow.
Usually when you get thunder during winter it can sometimes mean that a major snow storm or other severe weather event is gonna happen sometime further into the winter or during a few weeks after the thunder.