I did that trade! Got a little bit hosed on the trade in value of my 04 4x4 TRD supercharged Tacoma, but I didn't want the hassle of selling it myself, so that was the trade off. I miss the bed capacity, but overall am much happier with the FJ! go for it! Just get the hitch, and you can always trailer your stuff around...
