It depends on where you are trying to get to and where on the island you live. If you live near the ferry you can be in Manhattan within 30/40 minutes. If you live on the south shore of the island like me, it generally takes from an hour and a half to two hours. When I lived more towards the center of the island, my commute was door to door an hour and a half. The bus is like the tour buses, with reclining seats and overhead reading lights so it's really not that bad plus it's more time I generally spend reading a book or even doing work on my netbook.

The south shore is nicer in terms of houses and area, while the north shore is more convenient - but definitely a different type of neighborhood.