Character has a sudden drop when walking off a ledge

The game is a platformer. I have an "anchorForce" that keeps the player glued to the ground that is only applied when the the character controller's "isGrounded" is true. The problem is, that for a split second when walking off a ledge, it says it is true and this causes the player to shoot downward with the force of anchorForce. Anyone know how to prevent this? Been wracking my brain on it:

Character has a sudden drop when walking off a ledge