Background: This is a dosimetric comparative study intended to establish appropriate low-to-intermediate dose-constraints for the rectal wall (Rwall) in the context of a randomized phase-II trial on urethra-sparing stereotactic body radiotherapy (SBRT) for prostate cancer. The effect of plan optimization on low-to-intermediate Rwall dose and the potential benefit of an endorectal balloon (ERB) are investigated. Methods: Ten prostate cancer patients, simulated with and without an ERB, were planned to receive 36.25Gy (7.25Gyx5) to the planning treatment volume (PTV) and 32.5Gy to the urethral planning risk volume (uPRV). Reference plans with and without the ERB, optimized with respect to PTV and uPRV coverage objectives and the organs at risk dose constraints, were further optimized using a standardized stepwise approach to push down dose constraints to the Rwall in the low to intermediate range in five sequential steps to obtain paired plans with and without ERB (Vm1 to Vm5). Homogeneity index for the PTV and the uPRV, and the Dice similarity coefficient (DSC) for the PTV were analyzed. Dosimetric parameters for Rwall including the median dose and the dose received by 10 to 60% of the Rwall, bladder wall (Bwall) and femoral heads (FHeads) were compared. The monitor units (MU) per plan were recorded. Results: Vm4 reduced by half D30%, D40%, D50%, and Dmed for Rwall and decreased by a third D60% while HIPTV, HIuPRV and DSC remained stable with and without ERB compared to Vmref. HIPTV worsened at Vm5 both with and without ERB. No statistical differences were observed between paired plans on Rwall, Bwall except a higher D2% for Fheads with and without an ERB. Conclusions: Further optimization to the Rwall in the context of urethra sparing prostate SBRT is feasible without compromising the dose homogeneity to the target. Independent of the use or not of an ERB, low-to-intermediate doses to the Rwall can be significantly reduced using a four-step sequential optimization approach.