The person with those eyes...usually

Although his grandfather had authority and high social standing...and yet

Perhaps one day the grandfather killed someone, and then his predecessor became cross-eyed.

This reading also applies to people with eyes with 3-whites and 4-whites.

People with 1-whites in one eye may be rich...but people with 1-whites in both eyes usually suffer from the disease...especially in advanced ages.