How to purge browse cache - index.html stuck in cache

I have a ReactJS app hosted in S3 and using Cloudflare as DNS & CDN.

I have a huge issue, a lot of visitors have old version of the application stored in their browser cache (index.html only). I have configured advanced cache control in the newest version, but it cannot be accessed because older version is shown instead.

Static file (CSS, JS) versioning is done using create-react-app, but I have discovered that index.html file is the only cached one.

What should I do now?
How to purge visitors cache now?

PS: I have purged Cloudflare cache already and setup rule to bypass cache.

from How to purge browse cache - index.html stuck in cache