Better insight into white matter (WM) alterations after stroke onset could help to understand the underlying recovery mechanisms and improve future interventions. MR diffusion imaging enables to assess such changes. Our goal was to investigate the relation of WM diffusion characteristics derived from diffusion models of increasing complexity with the motor function of the upper limb. Moreover, we aimed to evaluate the variation of such characteristics across different WM structures of chronic stroke patients in comparison to healthy subjects. Subjects were scanned with a two b-value diffusion-weighted MRI protocol to exploit multiple diffusion models: single tensor, single tensor with isotropic compartment, bi-tensor model, bi-tensor with isotropic compartment. From each model we derived the mean tract fractional anisotropy (FA), mean (MD), radial (RD) and axial (AD) diffusivities outside the lesion site based on a WM tracts atlas. Asymmetry of these measures was correlated with the Fugl-Meyer upper extremity assessment (FMA) score and compared between patient and control groups. Eighteen chronic stroke patients and eight age-matched healthy individuals participated in the study. Significant correlation of the outcome measures with the clinical scores of stroke recovery was found. The lowest correlation of the corticospinal tract FAasymmetry and FMA was with the single tensor model (r = -0.3, p = 0.2) whereas the other models reported results in the range of r = -0.79 ÷ -0.81 and p = 4E-5 ÷ 8E-5. The corticospinal tract and superior longitudinal fasciculus showed most alterations in our patient group relative to controls. Multiple compartment models yielded superior correlation of the diffusion measures and FMA compared to the single tensor model.