Initial load overview
When you connect a Seller, Vendor, or Amazon Ads account, DataDoe requests historical Amazon data to build a usable history. This first backfill is the initial load. After it finishes, DataDoe keeps the data current with the usual daily and intraday fetch periods.
The initial load runs in two phases: Phase 1 and Phase 2.
Initial load duration
The time depends on the account and the amount of history Amazon makes available. Some accounts may take more than 48 hours.
Why the initial load has two phases
Amazon limits the number of reports DataDoe can request at once. Requesting all historical data immediately would make the initial load take longer.
Phase 1 requests recent orders and a small set of other reports first. Phase 2 requests the remaining report history. Initial finances transactions and Vendor Data Kiosk queries can start earlier, but they count toward Phase 2 completion. This lets you use DataDoe before the full initial load is complete.
DataDoe starts requesting Phase 2 reports after all Phase 1 reports have a final status. You can use the seller or vendor, and DataDoe sends the Phase 1 email, only when every attached connection has finished Phase 1.
Data availability during the initial load
You can use a seller or vendor in Reports, Exports, and Actions after Phase 1 finishes for every attached connection. DataDoe continues loading historical data during Phase 2, so results may change as more data becomes available.
The rest of the app becomes available when at least one account reaches Phase 2. Onboarding closes when at least one Seller, Vendor, or Amazon Ads account completes its initial load.
Data that starts loading immediately
Phase 1 starts loading recent Order Line Items and the early reports needed to make basic data available. Profit by SKU & Date and Profit by Date can be used at this stage, but their values may change as the remaining sources load in Phase 2. See the Data Scheme for the available tables.
These sources run on their own schedules and do not count toward either phase's completion:
- Amazon catalog
- Amazon FBA inbound shipments
- Search Query Performance (SQP) reports
- FBA ledger reports
- Sales and Traffic reports
Data that loads during Phase 2
Phase 2 includes:
- remaining weeks of order data (about 2 years, excluding the first 4 weeks)
- settlements, returns, inventory, promotions, listings, and other initial reports
- Amazon finances transactions for Seller accounts
- Amazon Data Kiosk queries for Vendor accounts
These sources count toward Phase 2 completion. A source can finish with an error, so check its progress if data still looks incomplete after the completion email.
Emails DataDoe sends during the initial load
DataDoe emails Organization owners as each seller or vendor moves through the initial load:
- When a connection is added. This email is per connection. It includes the account, country, connection type, Selling Partner ID, and Profile ID when the connection is Amazon Ads. It explains the two phases and says the next email arrives when Phase 1 is complete for the seller or vendor.
- When Phase 1 is complete for the seller or vendor. This is when every attached connection has finished Phase 1, which is also when you can use that account. This email explains what you can use now, that history is still incomplete, and that the next email arrives when the initial load is complete.
- When Phase 2 is complete for the seller or vendor. This is when every attached connection has finished the initial load. This email confirms that the full history is available. If the data looks incomplete, contact DataDoe support (opens in a new tab).
Track initial load progress
You can also track progress on the Sellers and Vendors page (opens in a new tab).
Get help with a delayed initial load
If your initial load takes longer than expected, contact DataDoe support (opens in a new tab) and we will help.