Historical Data Best Practices

Article author
Jack Perkins
  • Updated

Description: This article will guide you through the methods of downloading historical data into an SFTP server or S3 bucket. 

 

Daily Scheduled Exports: 

To ensure timely delivery of your organization’s data it is highly recommended to set up daily extracts for the following reports (reports in BLUE are optional based on whether your organization leverages the service):

  • F&B Exports
  • Promotion Details Export
  • Account & Venue Exports
  • Marketplace Exports
  • Ticketing Export
  • Wallet Nonce Export 2.0 (QR Pay scans)
  • User Export
  • Wallet Exports (Loyalty)

This LINK provides a walkthrough into how to schedule exports in the DataNow portal. 

Upon the successful configuration of daily scheduled exports, the following steps can be utilized to download historical data.

 

Download Historical Data for Off-Season dates: 

In order to protect the health of our relational databases, there is a 750k row limit on all export datasets. Depending on the order volume produced, it should be possible to download sales data for the entire offseason without reaching this limit. 

Example setup for a venue with an off-season spanning from June-September below.

  1. Use the LINK provided on how to schedule exports. 
  2. For Schedule Name it helps to append the name with “Historical” or the Date Range (06-09.2023), that way you can identify the file in your server or S3 bucket. 
  3. In the Setting tab under Recurrence, you can elect to change this to schedule this delivery during off hours (2am-6am) or send now. We highly recommend scheduling historical data pulls outside of business hours.
  4. Change the Updated Date filter to is any time. 
  5. Change the Created Date filter to the month/s desired.
  6. After successful delivery of this report, please delete this schedule the next day (or edit it to send seasonal data). You can edit/delete by clicking the three vertical dot icon in the top right corner, select schedule delivery. Then click the three vertical dot icon on the schedule you want to edit/delete.

 

 

Download Historical Data for In-Season dates: 

Due to higher order volume in-season, it's necessary to shorten the time frame for pulling historical data to a month or 2 months max.  

Example setup for a venue in-season below.

  1. Use the LINK provided on how to schedule exports. 
  2. For Schedule Name it helps to append the name with “Historical” or the Month and Year (04.2024), that way you can identify the file in your server or S3 bucket. 
  3. In the Setting tab under Recurrence, you can elect to change this to schedule this delivery during off hours (2am-6am) or send now. We highly recommend scheduling historical data pulls outside of business hours.
  4. Change the Updated Date filter to is any time. 
  5. Change the Created Date filter to the month/s desired, please see the screenshot below for reference.
  6. After successful delivery of this report, please delete this schedule the next day (or edit it to send seasonal data). You can edit/delete by clicking the three vertical dot icon in the top right corner, select schedule delivery. Then click the three vertical dot icon on the schedule you want to edit/delete.

 

Was this article helpful?

0 out of 0 found this helpful

Have more questions? Submit a request

Comments

0 comments

Please sign in to leave a comment.