Casting flash in lifter valley

It should be ok to leave it alone or grind some of it down as long as you don't make the lifter bore wall too thin...
Here's some photos of the area I am concerned with . I was wondering if maybe a piece may have broken off causing the cam lifter failure.

20180513_100438.jpg

20180513_100606.jpg

20180513_100518.jpg