That's pretty much exactly what happened...
I bought a new beard trimmer, specifically because i wanted to make sure I did things right.
Started at number 7... Didn't see it cutting anything, dropped to 6, to 5, and then finally at 4 it seemed like hairs were getting trimmed... Next thing I know, my beard is pretty much all gone.