I'm running Ubuntu Linux on an Amazon Workspace and have the same issue. Since the trackpad and mouse are seen as the same device it's a bit difficult to deal with.
For mouse scrolling you can try imwheel which worked really well for mouse but made no impact on the trackpad scrolling.
For trackpad I would say you could look at seeing if Dell now offers a separate app for trackpad settings (since it's been some time and they normally do offer that for windows) but for VMs I had to change the settings on my local windows machine to its slowest setting, and only then did it slow down the scrolling a bit (still very fast but doesn't jump miles at a time anymore).