Others here will probably explain it better than me. Sounds as if you’re making hard work of it. No need to keyframe every frame – you only need to set a start position and an end position. Premiere will interpolate all the intermediate frames ‘smoothly’.