As the other person said, one may buy a bucket of municipal bonds through over the counter ETFs, such as VTEB, MUB, etc.
The dividends are only federally tax exempt. The portion for your state may be tax exempt for that state only. So if VTEB has 0.01 holdings for the state of Kentucky than I may not incur even $1 of saved KY tax as a KY resident. Something to be aware, if you're going the ETF route.
I have looked at state specific bonds for better state tax treatment, and it seems to me not every local/state bond is offered over the counter (OTC) to retail investors. I don't personally have the time to research a diversified bond portfolio that beats OTC muni ETFs.
I wouldn't bet on muni bonds outperforming general aggregate bond funds. It may be worth playing around with a small allocation in a taxable account. They aren't going to make or break your portfolio because of the tax treatment.