Naa, you didn’t make any mistake using rubber bands. I make my scrunchies with rubber bands and they come out fine.

Maybe you should make sure you have large coverage of the band? And then you add one more double crochet in each stitch making 3 in a stitch and no Independent crochet. This will give it the ruffle you want.