OK so after removing all my apps, it was still draining the battery. Turns out the VPN I had installed was causing it. Not sure why it suddenly went sideways. It had been working just fine for about a year.
Now I'm busy putting all my apps back. It's kind off refreshing though to start with a clean phone :).