I think you need dye training to have an easier time at this, even if it isn't listed. When I fail, I lose around 23-25 durability 70% of the time. It's very discouraging.
Stats:
Rank 19 Weaver Bronze Needle (main hand) Cotton Coif, Cotton Halfgloves, Cotton Tights, Cotton Robe Common Clothshop Support
second hand failed miserably on me, i had much better luck with main hand - iron needle, guild workshop, skill preseve and tender touch. success rate 75% for rank 12
12/15 attempts successful, rank 10, dinging 11 at attempt 4, using iron needle, guild clothshop (Ul'Dah), Tender Touch and Maker's Muse (i love multiclass)
Not sure that this is a rank 10 recipe, I'm rank 17 and I can't make this with common or guild support. Mole-brown hempen cloth is easy and hardly ever fails - beige I'm lucky to succeed 1 in 4 times.