Backfill Connection Data

Backfill Connection Data

Data completeness is crucial for accurate analysis and reporting. While Power My Analytics automatically collects up to 13 months of historical data when you connect a new data source, there may be times when you need to address data issues or extend your historical data beyond this default range. This guide will walk you through the process of manually backfilling data for your connected data sources and accounts.

Why Backfill Data?

  • Resolve data discrepancies or gaps
  • Extend historical data beyond the default 13-month range
  • Ensure comprehensive reporting for specific time periods
The initial backfill when you first connect a data source spans 13 months by default and varies by data source. Some connectors support backfills of up to 2 years or more, depending on the platform's API limitations.

Step-by-Step Guide to Backfill Connection Data By Source or Account

Follow these steps to manually backfill data for your connected accounts:

  1. Access the Sources Page
  2. Choose Your Backfill Method
    You can backfill data at two different levels:
    • Data Source Level: Backfills all accounts under a data source
    • Individual Account Level: Backfills data for specific accounts only

Method 1: Backfill at Data Source Level

  1. Locate Your Data Source
    1. Find the data source you want to backfill in the main Sources table
    2. Use the Search or Filter options if needed to locate your specific data source
  2. Access the Backfill Menu
    1. Click the three-dot Action menu next to your data source and select Backfill data range from the dropdown menu



  3. Select Your Date Range
    1. Choose from the available options (24 hours, 7 days, 31 days, 3 months, 6 months, 1 year, Custom)
  4. Confirm the Backfill
    1. Click to confirm your selection and start the backfill process
    2. The backfill will apply to all connected accounts under the selected data source

Method 2: Backfill at Individual Account Level

  1. Open the Manage Accounts Panel
    1. Find your data source in the main Sources table
    2. Open the Manage Accounts panel for the data source (Action > Manage accounts)



  2. Locate the Specific Account
    1. In the Manage Accounts panel, find the specific account you want to backfill
    2. Use the Search function if you have many accounts
  3. Access the Account Action Menu
    1. Click the three-dot Action menu next to the specific account and select Backfill data range from the dropdown menu



  4. Select Your Date Range
    1. Choose from the available options (24 hours, 7 days, 31 days, 3 months, 6 months, 1 year, Custom)
  5. Confirm the Backfill
    1. Click to confirm your selection and start the backfill process
    2. The backfill will apply only to the selected account

Alternative Method: Bulk Backfill from Manage Accounts

You can also perform a bulk backfill for all accounts under a data source from within the Manage Accounts panel.

  1. Open the Manage Accounts panel for your data source (Action > Manage Accounts).
  2. Click the Backfill Data button (calendar icon) in the settings section in the upper right corner.



  3. This will perform an immediate backfill of all accounts under the data source within their configured data ranges.

Monitoring Your Backfill

After initiating a backfill, you can monitor its progress:

  1. View logs for the data source:



    • Click the Action menu next to your data source and select View logs to check data sync history and status



  2. View detailed History for the account:
    • In the Manage Accounts panel, click the Action menu next to an individual account and select History to view:



      • Chart: Visual history of backfills over time



      • Jobs: Log entries of data sync jobs by date



      • Data Gaps: Timeline of any missing data by table


Best Practices

  • Monitor the backfill process in the History section to track progress
  • Be aware that backfilling long date ranges may take some time to complete
  • Consider the data source's backfill limitations - some connectors allow up to 2 years, while others may be more limited
  • Use account-level backfilling when you only need to address issues with specific accounts rather than all accounts under a data source
    • Related Articles

    • How Data Sources Work with Power My Analytics

      We understand that getting started with a new tool can be a bit overwhelming. This article will explain how Power My Analytics connectors, data sources, and other core features work together to provide fast and reliable data for your reports. ...
    • Connect to a Data Source

      Power My Analytics has updated the Sources page to make it easier to view and manage your connected data sources. This article will guide you through the process of connecting a data source to Power My Analytics and managing your data source ...
    • How to Connect to BigCommerce

      This guide will walk you through the process of getting the credentials you need to connect to BigCommerce with Power My Analytics. You will need to create a store-level API account and obtain your API Path and Access Token. Before Getting Started ...
    • Manage and Configure Data Sources

      <div><span style="background-color: rgb(193, 225, 244); border-right: 5px solid rgb(167, 212, 234); margin: 10px 0px; position: relative; display: inline-block; padding: 10px 10px 10px 40px" ...
    • Getting started

      Everything you need in order to start automating reports and exports. Sign Up and Create Your Hub Connect to a Data Source Data Builder Guide (Beta) Integrate Data with a Reporting Tool Invite Team Members Add a Payment Method (optional)