How often does DataDoe fetch data?
There are three ways DataDoe fetches data:
- Fetch periods: Each morning, DataDoe pulls data according to the fetch period set for each table. Some tables also have intraday fetches for lower latency data.
- Real-time: DataDoe receives data in real time and makes it available to users as soon as possible.
- Continuous fetch: DataDoe detects changes in Amazon and updates the data accordingly.
What should I do if my data is not updated on time?
If your data is not updated on time, please contact us (opens in a new tab).
What time does the daily fetch happen?
The daily fetch starts every day at 2am in the local time zone of each Seller or Vendor. The first data is typically available by 3am, and 95% of the data is available by 5am.
Each table's fetch period defines when DataDoe refreshes it. You can check each table's refresh schedule in the interactive Data Scheme.
What is continuous fetch?
Continuously fetched data is updated automatically whenever DataDoe detects changes in Amazon.
Which tables have intraday updates?
The following raw tables have dynamic refresh periods, which allow intraday updates in selected Data Scheme tables. Dynamic refresh periods run in addition to the daily fetch and refresh data that changes during the day.
| Raw Data Source | Data Tables Affected | Real-time update | Refresh at |
|---|---|---|---|
raw_sp_api_report_orders | Order Line Items | Orders are available up to 1 hour after being placed. | 8am, 10am, 1pm, 4pm, 7pm |
raw_sp_api_orders_details_pii | Order Details PII | Data is available up to 1 hour after the order is fetched. | - |
raw_sp_api_report_listings_data | Listings | No | 10am, 1pm, 4pm |
raw_ads_api_report_advertised_products_sd raw_ads_api_report_advertised_products_sp raw_ads_api_report_purchased_products_sb | Ads Performance by ASIN & Date | No | 8am, 1pm, 4pm |
raw_ads_api_report_campaign_sb raw_ads_api_report_campaign_sd raw_ads_api_report_campaign_sp | Ads Performance by Campaign & Date | No | 8am, 1pm, 4pm |
raw_sp_api_report_fba_inventory_planning | FBA Inventory Health, Listings | No | 10am, 1pm, 4pm |
raw_sp_api_report_restock_inventory | FBA Restock Recommendations, FBA Inventory Health | No | 1pm |
raw_sp_api_report_v2_seller_performance | Seller Account Health Metrics | No | 1pm |
raw_sp_api_report_myi_all_inventory_data | none | No | 1pm |
What real-time data does DataDoe have?
DataDoe receives near real-time data from Amazon Marketing Stream (AMS) and Seller Central/Vendor Central SP-API Notifications. These are available as integrated Data Scheme tables (continuous fetch, disabled by default).
Can DataDoe send webhooks for real-time data?
Yes. See Webhooks for details.
SP-API Notifications
| Data Table | Data Latency | Webhook Latency |
|---|---|---|
| Order Change Notifications | < 1 hour | < 15min |
| Account Status Changed Notifications | < 2 hours | < 15min |
| Any Offer Changed Notifications | < 2 hours | < 15min |
| B2B Any Offer Changed Notifications | < 2 hours | < 15min |
| Branded Item Content Change Notifications | < 2 hours | < 15min |
| Detail Page Traffic Event Notifications | < 2 hours | < 15min |
| FBA Inventory Availability Changes Notifications | < 2 hours | < 15min |
| FBA Outbound Shipment Status Notifications | < 2 hours | < 15min |
| Fee Promotion Notifications | < 2 hours | < 15min |
| Item Inventory Event Change Notifications | < 2 hours | < 15min |
| Item Product Type Change Notifications | < 2 hours | < 15min |
| Item Sales Event Change Notifications | < 2 hours | < 15min |
| Listings Item Issues Change Notifications | < 2 hours | < 15min |
| Listings Item MFN Quantity Change Notifications | < 2 hours | < 15min |
| Listings Item Status Change Notifications | < 2 hours | < 15min |
| Transaction Update Notifications | < 2 hours | < 15min |
Amazon Marketing Stream (AMS)
| Data Table | Data Latency | Webhook Latency |
|---|---|---|
| AMS Campaigns | < 2 hours | < 15min |
| AMS Campaign Ad Groups | < 2 hours | < 15min |
| AMS Campaign Ads | < 2 hours | < 15min |
| AMS Budget Usage | < 2 hours | < 15min |
| AMS Campaign Diagnostics | < 2 hours | < 15min |
| AMS Campaign Targets | < 2 hours | < 15min |
| AMS Traffic | < 2 hours | < 15min |
| AMS Conversion | < 2 hours | < 15min |
| AMS SB Clickstream | < 2 hours | < 15min |
| AMS SB Rich Media | < 2 hours | < 15min |
| AMS SP Budget Recommendations | < 2 hours | < 15min |