For 4" of lift an adjustable trackbar is needed, as is the TC drop.
The swaybar can be corrected one of three ways:
Swaybar drop brackets
Longer swaybar links
Longer swaybar links with quick disconnects (this is the way to go if you plan on hitting trails and spending the $$$ for JKS or similar is worth it)
As for control arms, at 4" of lift you can still get factory spec correct caster, but the ride will be harsh. Lower arms will help, all 4 arms will help more. 4-4.5" of lift is really the threshold at which a long arm kit becomes the correct way to address linking the front axle. It is much more expensive which is why 4" is a very popular lift height for XJ's and TJ's.
As you lift the Jeep, the axle is moved farther under the Jeep, and this puts the control arms at a severe angle compared to where they are in stock form. This makes them have to move up and forward to absorb an impact from a bump or obstacle, hence the rough ride. Adjustable or longer "short" arms will move the axle forward a bit to correct this somewhat, but "long arms" move the mounting location further back and lower, evening out the angle and restoring a stock like ride (not to mention awesome articulation).
I ran my XJ for several months at 4" and stock arms. Adding lower arms did more for wheel travel than it did for ride quality but it did help some.