The video card does not play a very important role in Premiere.

Storage space and data access times are more important, and my money is on this being a possible cause of your problems.

You are using an external drive. This might be the bottleneck. Is it USB?

I have heard of some people editing OK with external drives, but the preferred storage solution is a dedicated additional internal drive (or even better, a RAID).