I think I'm going to try to go bigger for the drawing and then use my smallest fine-liner for the stubble. (I used a brown "ultra-fine" Sharpie on this latest one and Sharpie's definition of "ultra-fine" is still pretty thick.) Unfortunately, the only fine-liner I have in "005" is black and I think that will be too stark and unnatural looking. In other words, I may be rationalizing another art supply purchase this month. :-)
stubble