How to Export to Amazon S3

How to Export to Amazon S3

Info
Amazon S3 exports are a valuable way to deliver your Data Builder data tables to your own Amazon S3 storage bucket as structured CSV or JSON files. Data exports are available as a paid add-on on the Business, Grow, and Pro plans, and are included with the Custom plan when your negotiated agreement includes data exports. In this article, we will walk you through creating an Amazon S3 export, including connecting an Amazon S3 destination, choosing your data, scheduling data refreshes, and managing your exports.

Step 1: Create Your Export and Choose the Destination

  1. In your hub, select Amazon S3 from the left navigation pane under Exports.
  2. Click + Create export. The Create export wizard opens and walks you through four steps: Destination, Data, Schedule, and Review.
  3. Under Destination, select the Amazon S3 account you'd like to use.
    • If you haven't yet connected your account, click the plus button to add a destination account. Enter your Access Key Id, Secret Access Key, and Region Name, then click Connect. Once the account is added, return to the wizard and restart the export setup.
  4. Choose the Storage Bucket you want to use from the account.
  5. Choose a file format for your exported files: CSV or JSON.
  6. Optionally, enter a Directory Path to control where your files are saved in the bucket, then click Next.
Alert
PMA interacts with your Amazon S3 server from the IP addresses 35.188.118.242 and 35.209.185.69 (also shown in the Help panel when connecting your account). If your bucket restricts access by IP, whitelist these addresses before connecting.

Step 2: Choose the Data to Export

Notes
A Data Table is a single table in Data Builder. A Dataset groups related data tables. Exporting a whole dataset sends every data table in it.
  1. Under Data table or dataset, search for and select either a single data table or an entire dataset from Data Builder.
  2. Click Next.

Step 3: Set Your Export Schedule

  1. Choose a Refresh period: On demand, Monthly, Weekly, Daily, or Hourly.
    • On demand: Your export has no schedule and runs only when you run it manually from the exports list. Leave Run as soon as you create the export enabled to run the export immediately after you create it.
    • Monthly: Choose a day of the month (1 through 28), the hour, and the timezone.
    • Weekly: Choose a day of the week, the hour, and the timezone.
    • Daily: Choose the hour and the timezone.
    • Hourly: Your export runs every hour; no further settings are needed.
  2. For scheduled refresh periods, the Timezone is required and determines the local wall-clock time at which your export will run. We suggest setting the time for an hour before the start of your workday. Your export will run on this schedule until you pause or delete it.
  3. Click Next.
Notes
Remember: Each scheduled export will overwrite data in the date range of the Data Builder data table.
  • To accumulate data over time, choose a date range with an end date of today or yesterday. When you are creating your data table in Data Builder, choose a Custom Start option under Date Range to accumulate data over time.
  • Fixed time frame options like Last 7 days will export only the most recent 7 days of data with each refresh. Data from before that period will not be overwritten.

Step 4: Review and Create Your Export

  1. Under Review, check the Destination, Data, and Schedule summaries. Click Edit on any card to make a change.
  2. Click Create export. If you selected On demand and left Run as soon as you create the export enabled, your export runs immediately.

Manage Existing Exports

On the Exports to Amazon S3 page, click the three-dot action menu at the end of an export's row to View logs, Edit export, Pause export, Run export now, or Delete export. On demand exports run only when you select Run export now.

FAQ

What are the source IPs?

PMA exports are transmitted via Google Cloud using the IP addresses 35.188.118.242 and 35.209.185.69, which can be whitelisted. These IPs are also shown in the Help panel when you connect your Amazon S3 account.

What is the data format?

You can choose to export in CSV or JSON format. The file format is selected at the Destination step of the Create export wizard.