How do I use Ajax to get data from a website after the site has processed data?

From your description I take that you are trying to do some web scraping and your problem is that the page you are trying to scrape has dynamically generated content which doesn't exist upon requesting a page, is that right?

As far as I am aware this is not possible directly from a browser using AJAX, either through C3's plugin or directly through Javascript using an XMLHttpRequest.

Don't think you will be able to do this directly from a C3 application.

Any website that is providing such a service is first making a request to a remote server, then the server uses what is known as a headless browser to navigate to the required website, scrape the data it needs, and finally returns the result to the client.

It sounds like yes, thats what Im trying to do. If I can find out where they get the data from themselves I may be able to get it from the source instead.

An easy way to find out the requests a page is doing is by opening dev tools in your browser, usually by pressing F12, and then going into the network tab.

You will see everything the page is doing, which usually is a lot more than you would think! It might take a while to go through everything but you will surely find it there.

If you are lucky you will be able to hit the endpoint yourself, unless it is somehow protected by either some sort of pass key or maybe a cross origin access policy.

I will dig through thanks.

I had an idea of loading the page into an iframe and then maybe accessing the data within the iframe after s few seconds. Is that even possible?

I found the location but it seems its protected by an Authentication Token. I guess that might be generated off limits. :(

I didn't think about the possibility of loading the page in an iframe, but you will have a similar problem, if the page you want to show doesn't like being shown in a different origin, then it won't work.