Only challenge is it is more difficult to detect. That said, it’s less addictive and has way fewer negative health impacts than alcohol or tobacco. Having lived in Colorado, it’s absolutely a yes.
To my knowledge I’ve never been assaulted, threatened, robbed or otherwise put at risk by a user of weed, recreational or medicinal.
Having said that, the reality of a modern government legalising it gives me a headache. For all of our ‘safety’ they would need to regulate its sourcing, preparation/manufacture, packaging, storage, and sale. They would need an official body to monitor/control the industry and dish out fines to those transgressors putting everyone’s ‘safety’ at risk.