I'm working on a project to automate our dashboard refreshes by pulling data from our enterprise data management platform (Foundry Palantir).
Our workflow is: third party tool's data -> AWS S3 -> Foundry Palantir -> PowerBI grabs data to build dashboards.
Our analysts are currently manually downloading csv exports from a third party tool's website daily in order to refresh dashboards.
The problem that I'm trying to solve is to ingest our third party app's data into AWS S3 and then into our data platform.
Where do I start?
I'd imagine an ETL needs to be built. This third party tool has a REST API reference: https://developers.arcgis.com/survey123/api-reference/rest/encode-url-params/
S3 is a storage layer, you don't need it to do Analysis on top of Foundry, since you could import the data directly to Foundry using external transforms.