> I get an overwhelming sense of guilt

That guilt is proportional to the value you place on your work-time/daily output. The guilt will subside as your output importance does.

Also, the grass often appears greener, and many in academia are mired in its doldrums too.