Just an idea: do the infusion in some strong neutral alcohol (vodka or food grade 80% alcohol) and add it afterwards to your liking.
I don’t have experience with using chilly peppers but someone asked about it few months or so ago so maybe you can look there if they get some more advice.
deleted by creator