reference helps before I start, just a little thing his swords should be on his left hip, unless he is a rare left handed samurai, right about the model,
the best way to produce real cloth would be like this
here or you can try and reduce the size of the procedural texture and expriement using multiple layers.
try make the sleeves more baggy add some folds in both the jacket and the hakama also try an enlarge his obi (belt) and some straps for his geta (wooden sandals).
You got a good model there but it can be better.
Good luck dude
Dae