Skip to main content

Data Warehousing

This article covers how AgencyAnalytics warehouses your client data, how long historical data is stored for each integration, and what happens if a connection is lost.

Written by AgencyAnalytics Team

Data Warehousing

Data warehousing is how AgencyAnalytics stores your clients' historical data so it can be quickly and reliably pulled into reports and dashboards. Each integration has different rules for sharing data via its API, which can cause discrepancies when you're reporting across multiple integrations over time.

Warehousing solves this by retrieving data more often and more quickly, resulting in shorter load times for client dashboards and reports. In many cases, it also lets AgencyAnalytics provide much more historical data than the integration's API would normally allow.

What this means:

  • Shorter load times on dashboards and reports that use warehoused integrations

  • Access more historical data than the integration's API alone would provide

  • Check how much historical data has been warehoused for an integration at any time


Before You Start

Data warehousing only begins after you've connected a supported integration to a Client in AgencyAnalytics. If you haven't connected the integration yet, you'll need to do that first before any data can be pulled or warehoused.


Historical Data by Integration

Not every integration warehouses the same number of days. The table below shows each warehoused integration and the number of historical days of data warehoused (or the number of days first fetched before data layers in).

Integration

Days of historical data warehoused

Amazon Ads

60

BigCommerce

365

Brevo

1

ConvertKit

1

Google Display & Video 360*

365

Google Ad Manager**

365

Google Local Services Ads

365

GroundTruth

365

HubSpot

730

Pinterest Ads

365

Reddit Ads

730

Shopify

730

Simpli.fi

365

Snapchat Ads

365

StackAdapt***

365

TikTok

60

TikTok Ads

365

WooCommerce

730

Yelp Ads

88

  • *Apps & URLs data from Google Display & Video 360 (DV360) only has 31 days of historical data warehoused, due to Google API limitations

  • **Creative Advertisers and Order Line Items data from Google Ad Manager only has 1 day of historical data warehoused

  • ***City, Country, Demographic, Device, Supply Source, and Zip Code data from StackAdapt only has 1 day of historical data warehoused


How Data Warehousing Works

Once you connect a supported integration to a Client, AgencyAnalytics immediately begins pulling your data. Here's what happens step by step.

Step 1: After you connect the integration, either visit the prebuilt integration dashboard or add widgets using its data. During this initial period, you'll see a message that the integration is initializing.

Step 2: Wait for the initial period to finish. This usually takes 1 to 2 days, while AgencyAnalytics pulls the most recent data from the integration.

Step 3: Once the integration is initialized and the current data is available, AgencyAnalytics starts warehousing historical data. This process takes 4 to 14 days, depending on the amount of data in your connected account and the API data limits for each integration. This is done gradually to avoid hitting API rate or daily limits that could disrupt data flow from the integration.

Step 4: Check how much historical data has been warehoused by visiting the prebuilt integration dashboard and checking the tracker in the upper-right corner.


Data Freshness Indicators

When a number on your dashboard looks off, it's helpful to know whether AgencyAnalytics is still pulling in new data, everything's synced, and that's simply the correct number, or something's actually gone wrong. The data freshness indicator answers that at a glance, so you don't have to guess or open a support ticket to find out.

You'll find it as a clock icon in the tooltip at the top of your dashboard. Hovering over it tells you, in plain language, the last time your data was fetched, how current it is, and what (if anything) you need to do next.

What Each Status Means

🕐 Healthy

A grey clock icon means everything's syncing normally. The tooltip shows something like "Synced 3 hours ago" along with how current your data is. No action needed.

⚠️ Stopped

An amber triangle means a fetch failed. The tooltip explains what stopped it, the last time data synced successfully, how current your existing data is, any action you can take, and roughly when we'll try again.

⚠️ Stale

An amber triangle also appears if nothing has technically failed, but your data hasn't updated in 3 or more days. The tooltip shows how long it's been since the last sync.

⏳ Still Loading

While AgencyAnalytics is backfilling historical data for a new connection, the tooltip shows which date ranges have been fetched so far. This is normal and temporary; give it some time to finish.


Data Warehousing Privacy and Security

By default, all warehoused data is encrypted at rest. When possible, we warehouse 365 days of historical data. We backfill from the connected date and then store each new day to ensure up-to-date data is available. Anything older than 1 year will be removed from warehousing.


FAQ

What happens if my integration disconnects?

If an integration disconnects, AgencyAnalytics doesn't automatically delete the warehoused data. This means a brief disconnection won't require the integration to initialize and fetch all 365 days again. Simply reauthorize the connection, and your data will be available again.

Simpli.fi is an exception. While AgencyAnalytics doesn't automatically delete Simpli.fi data, Simpli.fi's API limits the number of days of data that can be pulled at a time. If Simpli.fi remains disconnected for a while, the warehoused data becomes outdated, and it takes time to fetch and update the data after reconnection.

How do I delete warehoused data?

At this time, you can't manually delete your warehoused data. This is to prevent accidental deletions that would disrupt your client reporting. If you'd like your warehoused data deleted, contact our Support team, and they'll start that process for you.

Why don't I see the data freshness indicator on some of my integrations?

Data freshness indicators apply to warehoused integrations, the ones where AgencyAnalytics stores and syncs your data on a schedule. Integrations with a live API connection already pull data in near real time, so there's nothing new to show for those.

What should I do if my integration shows "Stopped"?

Check the tooltip first, it'll tell you what caused the issue and whether there's an action you can take. If you're not sure what to do next, [contact our support team](https://help.agencyanalytics.com/en/articles/2571116-contact-customer-support) and they can help you sort it out.

How exact is the "next retry" time?

It's an estimate based on your local browser time, not an exact schedule. We intentionally keep it approximate rather than promising a precise time.

Can I see error codes or technical details about why a sync failed?

Not currently. The tooltip is designed to be plain-language, so you won't see error codes, IDs, or internal service names, just what happened and what it means for you.


What to Check Out Next


💬 Need additional help?

If you have any questions, please contact our friendly support team by following these instructions! We're available 24/5 to help 😄

Did this answer your question?