Scheduling Exports

Description: This article will assist you in creating a daily drop of Export reports in DataNow. 

Scheduling Exports

Exports can be scheduled and sent to a destination you define at a time you prefer, all controlled within DataNow. There are specific export tabs in DataNow where this can be configured as such:

1. Select the tab that you want to configure an export for
2. Make sure the appropriate time zone is selected on the top right
3. On the top right click the three vertical dot icon & then click schedule delivery
4. Select the method that the export should be received
   1. Amazon S3 Bucket: please do not add any leading or trailing “/” to the Bucket or Optional Path fields. This will cause the schedule to throw an error.
5. Select the format to receive it, this should almost always be changed to CSV
6. Select the time of day that the export should be sent
7. Ensure that the filters are set accordingly, by default any data updated in the last 24 hours should be selected
8. If having the data exported daily then the last 24 hours worth of data is perfect
9. DO NOT schedule the exports to run hourly or by minute. If more real-time data is needed we support a Kinesis data stream, please contact your account manager for setup.
10. Repeat these same steps for each export tab that is needed

Managing Exports

To modify the previously scheduled exports, just go back to the same place (three vertical dot icon > schedule delivery) and make your changes.

SFTP Schedules

When scheduling an SFTP export, the following IP addresses need to be added to the SFTP server allow list:

• 54.208.10.167
• 54.209.116.191
• 52.1.5.228
• 52.1.157.156
• 54.83.113.5
• 34.236.92.87
• 34.239.90.169
• 3.220.81.241
• 34.200.121.56
• 3.83.72.41
• 54.197.142.238

Please note the host key algorithms supported by our platform below:

• ssh-rsa
• ssh-dss
• ssh-rsa-cert-v01@openssh.com

• ssh-rsa-cert-v00@openssh.com

S3 Bucket Permission Requirements:

Encrypting bucket contents via KMS:

{

    "Version": "2012-10-17",

    "Statement": [

        {

            "Action": [

                "s3:PutObject",

                "s3:PutObjectAcl",

                "s3:List*"

            ],

            "Resource": [

                "arn:aws:s3:::<BUCKET NAME>",

                "arn:aws:s3:::<BUCKET NAME>/*"

            ],

            "Effect": "Allow"

        },

        {

            "Action": [

                "kms:Encrypt",

                "kms:Decrypt",

                "kms:ReEncrypt*",

                "kms:GenerateDataKey*",

                "kms:DescribeKey"

            ],

            "Resource": [

                "arn:aws:kms:<REGION>:<ACCOUNT-ID>:key/<KEY-UUID>"

            ],

            "Effect": "Allow"

        }

    ]

}

Without KMS:

{

    "Version": "2012-10-17",

    "Statement": [

        {

            "Action": [

                "s3:PutObject",

                "s3:PutObjectAcl",

                "s3:List*"

            ],

            "Resource": [

                "arn:aws:s3:::<BUCKET NAME>",

                "arn:aws:s3:::<BUCKET NAME>/*"

            ],

            "Effect": "Allow"

        }

    ]

}

Tips

1. The exports will include all data that has been modified in the past 24 hours.
   • If for example an order is created today it will be in the next export
   • If then 2 days later the same order is refunded it will appear again in that next export
2. When scheduling the export, be sure to confirm that the correct timezone is selected in Advanced Options
3. When scheduling the export to send to an email address or addresses, be sure to click tab after entering them

Data Dictionary

The definition of all fields available in the exports is defined here:
http://data.venuenext.com/exports

Sample data for the exports can be found here:
https://data.venuenext.com/exports-sample-data