This is true. If I try to think honestly about it, I spent a ton of my time abroad either bored or stressed about classwork (I was of the last class not to get the auto p/f on abroad coursework, and the grading scale conversion from the Chilean system was ridiculous, leading to my worst semester GPA-wise, FTL). Also, as in any 3rd world country, the infrastructure kinda sucked, leading to frequent frustration (e.g., the computers would just stop working when it rained, Chileans protest/strike/riot all the time, etc.). And I missed the entire OB season, and couldn't watch by Internet (see: sucky infrastructure). Even so, none of this even comes close to a regret. It was one of the best things I've ever done.
That said, I am glad I didn't spend an entire year abroad. I know several friends who did, and it seemed to me that their overall Wake experience was diminished because of it. Missing out on one semester didn't do too much damage. It was easy to get back in the same social circles 2nd semester junior year, not to mention being able to see my family over Christmas, attend my grandma's 100th birthday, etc. The people who stayed abroad for a whole year said goodbye at the end of sophomore year and didn't come back until we were seniors. It just felt like a much bigger sacrifice, and I'm glad I didn't do it.