One thing to note on my board is that I bypassed the 5V regulator for the out supply going to the digital attenuator. The attenuator board is pretty power hungry, and that could overwhelm the onboard regulator.
Also, I added a 20K pull-up resistor on the pot's wiper for the larger board since the it's a 100K/3B taper. I've done some mapping work in code to give a smooth/consistent volume across the full dial (modeled after my encoder).