Changing by such a small amount wouldn’t cause anymore stress on the bearings, if you keep the same size tyres you probably won’t notice any difference to the handling and retain speedo accuracy.
There are some websites where you can feed in your existing wheel and tyre specs then put in the proposed ones, it will then show the differences in rolling radius (affects speedo accuracy) and how far they stick in towards the suspension and out towards the arches.
Another thing to consider is the centre bore, this is normally 60.1 on Lexus cars, if the new wheels have less they will not fit the hub, if over you can fit spigot rings to reduce the bore to 60.1.
Finally check which type of wheel nuts the new wheels require, most aftermarket wheels use the taper nuts whereas Lexus tend to use the seated type, using the wrong nuts can damage your wheels and is potentially dangerous.