I did for a about 5 months, and the change is not too drastic, but I do prefer to leave the swaybar connected with the discos. But I have no idea what the trackbar will do to daily driving if I remove it...
I have heard it can cause bump steering, and some other stuff, but I am not sure what the real cause it will have... I do know the CJ's did not have them, so I am very tempted!