BigQuery Export Limitations
Your data exports to BigQuery may encounter errors in certain situations such as large export sizes. This article will show you how to identify and correct errors with your BigQuery exports.
Export Limitations
If you are using connectors other than Facebook Ads or GA4, make sure the report you are trying to export contains fewer than 40,000 rows of data. If you are backfilling a large amount of your historical data into BigQuery, you may need to take additional steps to make sure your exports are under BigQuery's limits. This limitation does not apply to Facebook Ads or GA4.
Your export should run in under 10 minutes. If the export runs for 30 minutes or more, it has hung and needs to be cancelled. To stop the hung export, click Edit Export.
Do not make any changes to the export. Click Update.
The hung export is now stopped.
How to accommodate large datasets
If your data has caused the export to hang, try segmenting the overall date range into two smaller date ranges. Edit the report in Data Explorer to use the first date range, then go to BigQuery and run your export.
If your export completes successfully:
- Return to Data Explorer.
- Edit your report and set Date Range to the second date range.
- Go to BigQuery and run your export again.
If your export is unsuccessful:
You may need to segment the overall date range into four or more date ranges.
- Reduce the size of the date range until the export runs successfully, indicating this range is within BigQuery's export limits.
- Run the export for each date range according to the instructions above.
Still having issues?
Send us a ticket and we will get back to you.
Related Articles
Troubleshooting BigQuery
When troubleshooting BigQuery, you may need to view your BigQuery export logs. This article will show you how to check the logs and see details about any errors. Viewing Export Logs Your BigQuery export logs show a timestamped record of your exports ...How to Create a Report in Data Explorer
Data Explorer is a valuable tool that can be used to create reports for export to BigQuery or FTP , to test out a connection, or even to create a CSV file. This tool is available to all Power My Analytics customers and is included in the cost of your ...How to Export to BigQuery
Once you have a report ready in Data Explorer, you are able to export it to BigQuery. This export option is included in the Enterprise plan. Follow the instructions in this article to get started. Grant Required Roles and Permissions A successful ...How to Create an FTP Export
FTP can be a valuable way for Enterprise users to export their Data Explorer reports. In this article, we will walk you through creating an FTP export, including selecting an FTP destination, scheduling data refreshes, and managing your exports to ...How to Export to MySQL
Our MySQL export feature enables flexible access to your data in the form of tables in a MySQL database hosted on the server of your choice. Once you've prepared a report in Data Explorer, you're ready to export your data to your MySQL server. With ...