No, that is not possible for everyone. I took my son to school by bike and trailer once, 2.5 miles at 8 AM in August, and I was literally dripping by the time I got there. It largely depends on the terrain and humidity outside.

However, for 4.3 miles I would definitely say that cycling specific clothes are NOT needed. Just use some gym shorts and maybe a tech shirt, and maybe lycra boxer briefs (cotton = gross when sweaty).