Turns out that the Reply tool currently lacks the watchlist expiry feature. When I use the Reply tool, the watchlist star changes. Or I must say that I have to either permanently watch or un-watch a page. I recently disabled the tool, so I must await the problem to be fixed.
Topic on Talk:Talk pages project/Flow
Appearance