Parents ‘argue it’s the result of the effect a growing Muslim population is having on the area’