As someone who has a shop in the back- yes you will regret it. First time you go around a corner and here smash from behind the wall. "WTF was that?" And have to stop to go round out back to check out what it was.
I have a pocket door between. Besides making the shop a place to throw stuff while driving down the road (out of sight), a simple "did I latch the cabinets?" doesn't require a rest stop.