How to Export to Amazon S3

How to Export to Amazon S3

Info
Our Amazon S3 export feature enables flexible access to your data in the form of structured JSON or CSV files hosted on the Amazon S3 storage destination of your choice. Once you've prepared a report in Data Builder, you're ready to export your data to your Amazon S3 bucket. With our Amazon S3 export feature, you can run complex queries over your data and integrate your data with a variety of applications. Amazon S3 exports are available in the Enterprise plan or the Exports Addon.

How We Store Data in Amazon S3 Exports

Our Amazon S3 export feature will create CSV or JSON files according to your choice when configuring the export, with columns corresponding to the fields in the Data Builder data table or dataset (collection of data tables) being exported. You can learn more about how data tables and datasets work in the Data Builder Guide.

Requirements

  1. An Enterprise subscription, or the Exports Addon
    1. Create the Data Builder data table(s) you want to export
    2. An Amazon S3 storage bucket
    3. Your Amazon S3 credentials:
      1. Access key ID
      2. Secret access key
      3. Region name
    If you don't currently have an Amazon S3 storage bucket, you can follow Amazon's steps to create one at Getting started with Amazon S3.
    Notes
    PMA's connection to Amazon S3 will originate from the IP addresses 35.188.118.242 and 35.209.185.69.

    Configure Your Export

    Step 1: Add Your S3 Export

    1. Make sure you've created your data table(s) in Data Builder with the desired date range and fields you want to export.
    2. Click on Amazon S3 under Exports in the left sidebar of your hub.
    1. Click on + Create Export to begin configuring your new export.

    Step 2: Add Your Amazon S3 Destination

    1. In the Configure the Export dialog box, click the blue plus button (+) next to Amazon S3 to add a new Amazon S3 storage bucket as a destination.
    1. Enter the access key ID, secret access key, and region name for your Amazon S3 bucket.
    2. Then click Connect.
    1. Once your Amazon S3 bucket is added, select it as your data destination in the Destination dropdown.
    1. Next, choose the storage bucket you want to use in the Amazon S3 account, the file format for the exports (JSON or CSV), and a directory path to store the exported files (optional).
    2. Then click Next

    Step 3: Select Your Data and Schedule Your Export

    1. Under Reports, select whether you are exporting a Single report (data table) or a Group of reports (dataset).
    2. Then select the data table or dataset you want to export.
    1. Click Next.

    1. Under Schedule, select the refresh period for the export (monthly, weekly, daily, or hourly). Hourly refreshes are available via the hourly refreshes addon.
    2. Then choose the time that works best for you.
    1. When you're finished, click Add to complete setup for your export. Your export will now run automatically at the scheduled time.

    Alert
    Important: Ensure your report's date range in Data Builder is at least as long as the refresh period in the Amazon S3 export in order to avoid missing data. For example, if your report's date range is one week but your export refreshes monthly, your export will fail to include data from before the last week of the month.
    Make sure your report's date range in Data Builder is at least as long as the refresh period in your export. Failing to do so may result in data missing from your backfill. For example:
    1. If your report's date range is one week but your export refreshes monthly, your export will fail to include data from before the last week of the month.
    2. If your report's date range is one week and your export refreshes daily, your export will overwrite the past seven days, every day.

    Step 4: Run Your Export

    1. Your new export will appear under the Exports section of the hub.
    2. To begin running your export immediately, click the play button next to your data export to Run Export Now.

    1. When the export process is finished, you can click the paper icon to View Logs and confirm that the export to Amazon S3 was successful.

    Troubleshooting

    If you encounter any issues with your exports:

    1. Check the export logs by clicking the paper icon next to your export.
    2. Verify that your Amazon S3 credentials are correct.
    3. Check that your report's date range aligns with or exceeds your export schedule to prevent data gaps.
    For any persistent issues, please contact our support team for assistance.
      • Related Articles

      • How to Export to PostgreSQL

        Our PostgreSQL export feature enables flexible access to your data in the form of tables in a PostgreSQL database hosted on the server of your choice. Once you've prepared a report in Data Explorer, you're ready to export your data to your PostgreSQL ...
      • How to Export to MySQL

        Our MySQL export feature enables flexible access to your data in the form of tables in a MySQL database hosted on the server of your choice. Once you've prepared a report in Data Explorer, you're ready to export your data to your MySQL server. With ...
      • Amazon Ads Data Connector User Guide

        Amazon Ads is a powerful advertising platform that allows sellers and brands to promote their products on Amazon. This guide will walk you through how to connect Amazon Ads to Power My Analytics, create reports in Looker Studio, and understand key ...
      • How to Export to BigQuery

        Once you have a report ready in Data Explorer, you are able to export it to BigQuery. This export option is included in the Enterprise plan. Follow the instructions in this article to get started. Grant Required Roles and Permissions A successful ...
      • How to Export to Azure SQL Database

        Exporting your marketing data to Azure SQL allows you to integrate it with various applications and run complex data queries. This guide will walk you through the process of setting up and managing your Azure SQL exports using Power My Analytics. An ...