How to Export to Amazon S3

How to Export to Amazon S3

Info
Our Amazon S3 export feature enables flexible access to your data in the form of structured JSON or CSV files hosted on the Amazon S3 storage destination of your choice. Once you've prepared a report in Data Builder, you're ready to export your data to your Amazon S3 bucket. With our Amazon S3 export feature, you can run complex queries over your data and integrate your data with a variety of applications. Amazon S3 exports are available in the Custom plan.

How We Store Data in Amazon S3 Exports

Our Amazon S3 export feature will create CSV or JSON files according to your choice when configuring the export, with columns corresponding to the fields in the Data Builder data table or dataset (collection of data tables) being exported. You can learn more about how data tables and datasets work in the Data Builder Guide.

Requirements

  1. A Custom plan
    1. Create the Data Builder data table(s) you want to export
    2. An Amazon S3 storage bucket
    3. Your Amazon S3 credentials:
      1. Access key ID
      2. Secret access key
      3. Region name
    If you don't currently have an Amazon S3 storage bucket, you can follow Amazon's steps to create one at Getting started with Amazon S3.
    Notes
    PMA's connection to Amazon S3 will originate from the IP addresses 35.188.118.242 and 35.209.185.69.

    Configure Your Export

    Step 1: Add Your S3 Export

    1. Make sure you've created your data table(s) in Data Builder with the desired date range and fields you want to export.
    2. Click on Amazon S3 under Exports in the left sidebar of your hub.
    1. Click on + Create Export to begin configuring your new export.

    Step 2: Add Your Amazon S3 Destination

    1. In the Configure the Export dialog box, click the blue plus button (+) next to Amazon S3 to add a new Amazon S3 storage bucket as a destination.
    1. Enter the access key ID, secret access key, and region name for your Amazon S3 bucket.
    2. Then click Connect.
    1. Once your Amazon S3 bucket is added, select it as your data destination in the Destination dropdown.
    1. Next, choose the storage bucket you want to use in the Amazon S3 account, the file format for the exports (JSON or CSV), and a directory path to store the exported files (optional).
    2. Then click Next. 

    Step 3: Select Your Data and Schedule Your Export

    1. Under Reports, select whether you are exporting a Single report (data table) or a Group of reports (dataset).
    2. Then select the data table or dataset you want to export.
    1. Click Next.

    1. Under Schedule, select the refresh period for the export (monthly, weekly, daily, or hourly). Hourly refreshes are available via the hourly refreshes addon.
    2. Then choose the time that works best for you.
    1. When you're finished, click Add to complete setup for your export. Your export will now run automatically at the scheduled time.

    Alert
    Important: Ensure your report's date range in Data Builder is at least as long as the refresh period in the Amazon S3 export in order to avoid missing data. For example, if your report's date range is one week but your export refreshes monthly, your export will fail to include data from before the last week of the month.
    Make sure your report's date range in Data Builder is at least as long as the refresh period in your export. Failing to do so may result in data missing from your backfill. For example:
    1. If your report's date range is one week but your export refreshes monthly, your export will fail to include data from before the last week of the month.
    2. If your report's date range is one week and your export refreshes daily, your export will overwrite the past seven days, every day.

    Step 4: Run Your Export

    1. Your new export will appear under the Exports section of the hub.
    2. To begin running your export immediately, click the play button next to your data export to Run Export Now.

    1. When the export process is finished, you can click the paper icon to View Logs and confirm that the export to Amazon S3 was successful.

    Troubleshooting

    If you encounter any issues with your exports:

    1. Check the export logs by clicking the paper icon next to your export.
    2. Verify that your Amazon S3 credentials are correct.
    3. Check that your report's date range aligns with or exceeds your export schedule to prevent data gaps.
    For any persistent issues, please contact our support team for assistance.

      • Related Articles

      • How to Export to PostgreSQL

        Our PostgreSQL export feature enables flexible access to your data in the form of tables in a PostgreSQL database hosted on the server of your choice. Once you've prepared a report in Data Builder, you're ready to export your data to your PostgreSQL ...

      • How to Use the Exports Add-On

        Power My Analytics offers the option to export data from your reports into destinations like BigQuery, MySQL, Azure SQL Database, PostgreSQL, and FTP. With our easy-to-use Exports Add-On, you can set up a report in PMA's Data Explorer and schedule ...

      • How to Export to MySQL

        Our MySQL export feature enables flexible access to your data in the form of tables in a MySQL database hosted on the server of your choice. Once you've prepared a report in Data Builder, you're ready to export your data to your MySQL server. With ...

      • Amazon Ads Data Connector User Guide

        Amazon Ads is a powerful advertising platform that allows sellers and brands to promote their products on Amazon. This guide will walk you through how to connect Amazon Ads to Power My Analytics, create reports in Looker Studio, and understand key ...

      • How to Export to Snowflake

        Exporting your marketing data to Snowflake allows you to integrate it with various applications and run complex data queries. This guide will walk you through the process of setting up and managing your Snowflake exports using Power My Analytics. A ...