Really nice...... Get yourself some Woodland Scenics Earth Blend. (picture below) I use that close to the track and then I phase the grass in with that.
I would just try to add some in places before you remove anything, it might just work.
But, I really like the look of your track, balast and the grass, very nice.
Cheers,
Evert