This mini video tutorial describes a simple method to make small straps, or very thin straps. The technique requires a foot for zipper or piping, and a drawstring. I recommend you to test on a slightly slippery fabric to practice. You'll see it's simple and clever... inratable!
I tested it and it works very well, but for safety I used the zipper foot.