If you're driving it 2 miles down to the supermarket, turning it off and then turning it back on and driving 2 miles back and parking it up for 3 days, it probably doesn't matter how many journeys you do. It'll still discharge eventually.
Our IS300h was driven somewhat like that and the battery started playing up after 4-5 years. My car is fine as I do around 8k a year so it gets regularly used