I created the same directory and this worked for me:

find . -name '2006*' -type d -delete

Brock