Do I owe taxes on RSU shares I haven’t sold yet?

Not on the appreciation. You pay ordinary income tax on the value of the units when shares vested. If we assume that is in the past, any additional tax only applies when you sell, and only on gains above your cost basis (the FMV at vest). If the stock has dropped since vesting, you may actually have a capital loss to harvest.