I bought a blue drinking house from Bunnings but have to flush the hose for a while to get rid of the plastic taste each time I use it.
I don't know why I bother though. The hoses fitted to my Kimberley leave a plastic taste within a day of water being put into the tank.
The filter on the kitchen tap helps but I can still taste plastic unless I run it for awhile.
The front water tank, accessed by the hand pump, is undrinkable due to a plastic taste.
We now always carry separate jerries of water for cooking and drinking.
Cheers!