Skip to main content

How often does DataDoe fetch data?

There are three ways DataDoe fetches data:

  • Fetch periods: Each morning, DataDoe pulls data according to the fetch period set for each table. Some tables also have intraday fetches for lower latency data.
  • Real-time: DataDoe receives data in real time and makes it available to users as soon as possible.
  • Continuous fetch: DataDoe detects changes in Amazon and updates the data accordingly.

What should I do if my data is not updated on time?

If your data is not updated on time, please contact us (opens in a new tab).

What time does the daily fetch happen?

The daily fetch starts every day at 2am in the local time zone of each Seller or Vendor. The first data is typically available by 3am, and 95% of the data is available by 5am.

Each table's fetch period defines when DataDoe refreshes it. You can check each table's refresh schedule in the interactive Data Scheme.

What is continuous fetch?

Continuously fetched data is updated automatically whenever DataDoe detects changes in Amazon.

Which tables have intraday updates?

The following tables receive intraday updates through scheduled fetches or continuous polling. These updates refresh data that changes during the day.

Raw Data SourceData Tables AffectedReal-time updateRefresh at
raw_sp_api_report_ordersOrder Line ItemsOrders are available up to 1 hour after being placed.2am, 8am, 10am, 1pm, 4pm, 7pm
refined_sp_api_finances_transactionsSettlements & P&L ComponentsNo2am, 10am, 4pm
raw_sp_api_vendor_purchase_ordersVendor Purchase OrdersNoEvery 2 hours
raw_sp_api_orders_details_piiOrder Details PIIData is available up to 1 hour after the order is fetched.-
raw_sp_api_report_listings_dataListingsNo2am, 10am, 1pm, 4pm
raw_ads_api_report_advertised_products_sd raw_ads_api_report_advertised_products_sp raw_ads_api_report_purchased_products_sbAds Performance by ASIN & DateNo2am, 8am, 1pm, 4pm
raw_ads_api_report_legacy_campaign_sb_all raw_ads_api_report_campaign_sd raw_ads_api_report_campaign_sp raw_ads_api_report_campaign_stAds Performance by Campaign & DateNo2am, 8am, 1pm, 4pm
raw_sp_api_report_fba_inventory_planningFBA Inventory Health, ListingsNo2am, 10am, 1pm, 4pm
raw_sp_api_report_restock_inventoryFBA Restock Recommendations, FBA Inventory HealthNo2am, 1pm
raw_sp_api_report_v2_seller_performanceSeller Account Health MetricsNo2am, 1pm
raw_sp_api_report_myi_all_inventory_datanoneNo2am, 1pm

Ads Performance by Campaign & Date and Ads Performance by ASIN & Date fetch data at 2am, 8am, 1pm and 4pm in the marketplace time zone. The daily fetch rereads 21 days; each intraday fetch rereads 5 days. This includes Sponsored Brands. Data becomes available after processing, and Amazon can revise it in later reports. These schedules do not confirm that a day is complete or final. Sponsored Brands ASIN estimates can also lag the source reports.

Settlements & P&L Components fetches start at 2am, 10am and 4pm, including weekends. The 2am fetch rereads 8 days. The 10am and 4pm fetches reread 2 days, including the current day. US and Canada use Pacific time (America/Los_Angeles) for the 10am and 4pm fetches, including daylight saving. Other marketplaces use their local time zone. Amazon may leave out orders from the last 48 hours. These times are when the fetch starts. Rows appear after Amazon publishes them and after DataDoe finishes processing and export.

Vendor Purchase Orders are checked for new and changed orders every 2 hours. Orders appear after Amazon makes them available and DataDoe completes sync and export processing.

What real-time data does DataDoe have?

DataDoe receives near real-time data from Amazon Marketing Stream (AMS) and Seller Central/Vendor Central SP-API Notifications. These are available as integrated Data Scheme tables (continuous fetch, disabled by default).

Can DataDoe send webhooks for real-time data?

Yes, for SP-API Notifications. Amazon Marketing Stream (AMS) data is not available as webhooks. See Webhooks for details.

SP-API Notifications

Vendor Central supports these notifications: Detail Page Traffic Event, Item Inventory Event Change, Item Sales Event Change, Listings Item Issues Change, and Shipment Tracking Milestone Changed. In Settings > Data and in the Data Scheme, they appear under both Seller Central and Vendor Central. Each table has one ON/OFF state and one retention setting for your Organization, so a change on one tab also applies to the other. Shipment Tracking Milestone Changed also requires the AMAZON_SHIPMENT_TRACKING_SUBSCRIBE Action for each tracking identifier.

Data TableData LatencyWebhook Latency
Order Change Notificationsless than 1 hour< 15min
Account Status Changed Notificationsless than 1 hour< 15min
Any Offer Changed Notificationsless than 1 hour< 15min
B2B Any Offer Changed Notificationsless than 1 hour< 15min
Branded Listing Content Changesless than 1 hour< 15min
Detail Page Traffic Event Notificationsless than 1 hour< 15min
FBA Inventory Availability Changes Notificationsless than 1 hour< 15min
FBA Outbound Shipment Status Notificationsless than 1 hour< 15min
Fee Promotion Notificationsless than 1 hour< 15min
Item Inventory Event Change Notificationsless than 1 hour< 15min
Item Product Type Change Notificationsless than 1 hour< 15min
Item Sales Event Change Notificationsless than 1 hour< 15min
Listings Item Issues Change Notificationsless than 1 hour< 15min
Listings Item MFN Quantity Change Notificationsless than 1 hour< 15min
Listings Item Status Change Notificationsless than 1 hour< 15min
MCF Fulfillment Order Status Notificationsless than 1 hour< 15min
Pricing Health Notificationsless than 1 hour< 15min
Shipment Tracking Milestone Changed Notificationsless than 1 hour< 15min
Transaction Update Notificationsless than 1 hour< 15min

Amazon Marketing Stream (AMS)

Data TableData Latency
AMS Campaignsless than 1 hour
AMS Campaign Ad Groupsless than 1 hour
AMS Campaign Adsless than 1 hour
AMS Budget Usageless than 1 hour
AMS Campaign Diagnosticsless than 1 hour
AMS Campaign Targetsless than 1 hour
AMS Trafficless than 1 hour
AMS Conversionless than 1 hour
AMS SB Clickstreamless than 1 hour
AMS SB Rich Medialess than 1 hour
AMS SP Budget Recommendationsless than 1 hour

AMS data is not available as webhooks.

Data Latency counts from when Amazon sends a message to DataDoe. These tables usually reach BigQuery in less than 1 hour. AMS Budget Usage usually reaches BigQuery about 30 minutes after Amazon sends a reading. It keeps the latest reading Amazon has sent for each campaign, and Amazon decides when to send a new one, so it does not match the ads console minute by minute.

AMS Traffic and AMS Conversion use hourly totals. Amazon sends the first rows for an hour about 1 to 2 hours after the hour starts and keeps sending corrections for that hour later. Each row adds to the hour's totals, so sum the rows instead of taking the latest one.