How often does DataDoe fetch data?
There are three ways DataDoe fetches data:
- Fetch periods: Each morning, DataDoe pulls data according to the fetch period set for each table. Some tables also have intraday fetches for lower latency data.
- Real-time: DataDoe receives data in real time and makes it available to users as soon as possible.
- Continuous fetch: DataDoe detects changes in Amazon and updates the data accordingly.
What should I do if my data is not updated on time?
If your data is not updated on time, please contact us (opens in a new tab).
What time does the daily fetch happen?
The daily fetch starts every day at 2am in the local time zone of each Seller or Vendor. The first data is typically available by 3am, and 95% of the data is available by 5am.
Each table's fetch period defines when DataDoe refreshes it. You can check each table's refresh schedule in the interactive Data Scheme.
What is continuous fetch?
Continuously fetched data is updated automatically whenever DataDoe detects changes in Amazon.
Which tables have intraday updates?
The following raw tables have dynamic refresh periods, which allow intraday updates in selected Data Scheme tables. Dynamic refresh periods run in addition to the daily fetch and refresh data that changes during the day.
| Raw Data Source | Data Tables Affected | Real-time update | Refresh at |
|---|---|---|---|
raw_sp_api_report_orders | Order Line Items | Orders are available up to 1 hour after being placed. | 10am, 1pm, 4pm, 7pm |
raw_sp_api_orders_details_pii | Order Details PII | Data is available up to 1 hour after the order is fetched. | - |
raw_sp_api_report_listings_data | Listings | No | 1pm |
raw_ads_api_report_advertised_products_sd raw_ads_api_report_advertised_products_sp | Ads Performance by ASIN & Date | No | 1pm |
raw_ads_api_report_campaign_sb raw_ads_api_report_campaign_sd raw_ads_api_report_campaign_sp | Ads Performance by Campaign & Date | No | 1pm |
raw_sp_api_report_fba_inventory_planning | FBA Inventory Health, Listings | No | 1pm |
raw_sp_api_report_myi_all_inventory_data | none | No | 1pm |
What real-time data does DataDoe have?
DataDoe fetches real-time data from Amazon Marketing Stream (AMS) and Seller Central SP API Notifications (SP API).
This data is currently available in our raw data sources. The following table lists the raw real-time data sources.
All this data will be available in our Data Scheme soon.
| Type | Raw Data Source | Latency |
|---|---|---|
| SP API | raw_sp_api_notifications_order_change | < 1 hour |
| SP API | raw_sp_api_notifications_account_status_changed | < 2 hours |
| SP API | raw_sp_api_notifications_any_offer_changed | < 2 hours |
| SP API | raw_sp_api_notifications_b2b_any_offer_changed | < 2 hours |
| SP API | raw_sp_api_notifications_branded_item_content_change | < 2 hours |
| SP API | raw_sp_api_notifications_fba_inventory_availability_changes | < 2 hours |
| SP API | raw_sp_api_notifications_item_inventory_event_change | < 2 hours |
| SP API | raw_sp_api_notifications_item_product_type_change | < 2 hours |
| SP API | raw_sp_api_notifications_item_sales_event_change | < 2 hours |
| SP API | raw_sp_api_notifications_listings_item_issues_change | < 2 hours |
| SP API | raw_sp_api_notifications_listings_item_mfn_quantity_change | < 2 hours |
| SP API | raw_sp_api_notifications_listings_item_status_change | < 2 hours |
| AMS | raw_ads_api_ams_adgroups | < 2 hours |
| AMS | raw_ads_api_ams_ads | < 2 hours |
| AMS | raw_ads_api_ams_budget_usage | < 2 hours |
| AMS | raw_ads_api_ams_campaign_diagnostics | < 2 hours |
| AMS | raw_ads_api_ams_campaigns | < 2 hours |
| AMS | raw_ads_api_ams_sb_clickstream | < 2 hours |
| AMS | raw_ads_api_ams_sb_conversion | < 2 hours |
| AMS | raw_ads_api_ams_sb_rich_media | < 2 hours |
| AMS | raw_ads_api_ams_sb_traffic | < 2 hours |
| AMS | raw_ads_api_ams_sd_conversion | < 2 hours |
| AMS | raw_ads_api_ams_sd_traffic | < 2 hours |
| AMS | raw_ads_api_ams_sp_budget_recommendations | < 2 hours |
| AMS | raw_ads_api_ams_sp_conversion | < 2 hours |
| AMS | raw_ads_api_ams_sp_traffic | < 2 hours |
| AMS | raw_ads_api_ams_targets | < 2 hours |
Do you plan to add webhooks for real-time data?
Yes. If you are interested in early access, please contact us (opens in a new tab).