Would funds invested offshore in ETFs and shares, resulting in capital gains while kept offshore, such as in USD, be exempt from Thai tax until they are brought back into Thailand?

Yes, Thailand is a remittance tax basis, so you are liable for tax on the capital gains, if they are remitted / transferred into Thailand. If they are not transferred to Thailand, they are not a taxable income source.