Planting hornbeam hedge between fence and pavers

I’m interested in planting hornbeam hedge trees in my backyard, where there’s only a 40-45 centimeter gap between the pavement and the fence. The landscaper used limestone beneath the soil and pavers. Would removing the limestone between the pavers and…