Ethernet connections are almost always faster than Wi-Fi connections, and are usually more stable. You'll need to connect one end of the Ethernet cable to your router, and the other to your computer.
Your Ethernet cable isn't the bottleneck, and upgrading it won't fix your internet ...