Managing Data
      Back to home
      1. Daisychain Help
      2. Managing Data

      How can I sync Daisychain data to my data warehouse?

      Daisychain can keep an Amazon S3 bucket automatically synchronized with raw database table data from your account.

      The ability to sync your Daisychain data to an Amazon S3 Bucket is designed to allow customers to load data from Daisychain into data warehouses like AWS Redshift, Google BigQuery or Snowflake where analysts can query it and derive insights about your campaigns. 

      This is an advanced topic and requires additional data infrastructure engineering that is specific to your organization to get the files we provide on S3 into your data warehouse. There are a wide variety of tools and techniques for loading data into data warehouses, and choosing the best one is up to the customer. We simply provide the building blocks to make a secure data warehouse sync possible. 

      Setup

      1. Create an Amazon AWS account for your organization if you don't have one already. We will grant access to either the account as a whole or a specific AWS IAM Role within your account. 
      2. In your Daisychain account, set up a Daisychain S3 sync for your AWS Account via Settings > Integrations. We’ll grant cross-account access to your data by granting permissions to your AWS Account using its identifier. 
      3. Optionally, specify a specific IAM Role to further restrict the resources within your AWS Account that can access your Daisychain data via S3. When this is not specified, access is granted to your entire AWS Account. Using and configuring IAM Role permissions is an advanced feature. Use cases for this enhanced security option include:
        1. Allowing access for specific users using temporary credentials via Assume Role. 
        2. Allowing access only from specific resources within your AWS Account: for example, your Redshift Cluster, or a particular EC2 instance.  

      Data Details

      We currently expose the following tables:

      • people
        Each person with your Daisychain account

      • phones
        Phone numbers associated with people

      • emails
        Email addresses associated with people

      • addresses
        Physical addresses associated with people

      • messages
        Incoming and outgoing messages

      • conversations
        Messages are grouped into conversations

      • broadcasts
        Campaigns initiated from your account that send messages to people

      • sms_opt_outs
        Opt-outs associated with particular phone numbers

      • subscriptions
        Affirmative subscriptions to a particular communication channel based on an opt-in

      Each of these tables is offered in CSV format and is refreshed nightly shortly after midnight UTC.