Rudderstack

Our real-time data streaming infrastructure is built on-top of the AWS Kinesis Data Streams service, as such we will be connecting Rudderstack to Shaped via the Kinesis Data Stream Event Streaming Destination.

To begin connecting your Rudderstack account, create a Shaped dataset with schema_type: RUDDERSTACK, the event schema will be automatically created based on the Rudderstack event specification. Once in ACTIVE state, you can access the Kinesis Data Stream name and IAM Role ARN to configure the Rudderstack Data Destination, found via the Shaped CLI or API.

CLI

shaped view-dataset --dataset-name rudderstack_events

dataset_name: rudderstack_events
dataset_uri: https://api.shaped.ai/v1/datasets/rudderstack_events
schema_type: RUDDERSTACK
dataset_schema: <event_schema>
kinesis_stream_arn: arn:aws:kinesis:us-east-2:11111111111:stream/ShapedDatasetStream-abc123
kinesis_iam_role_arn: arn:aws:iam::11111111111:role/ShapedDatasetAccessRole-abc123

API

curl -X GET "https://api.shaped.ai/v1/datasets/rudderstack_events" \
  -H "x-api-key: <API_KEY>"

Configuring Rudderstack

In order to forward events from Rudderstack to Kinesis you will need to perform the following steps:

1. In Rudderstack, navigate to 'Cloud Destinations' then find 'Amazon Kinesis'. Enter a sync name, then click 'Create Sync'.
2. Click Edit, then enter the following details:
   • AWS Kinesis Stream Name "ShapedDatasetStream-*****"
   • AWS IAM Role Resource Name (ARN) "kinesisIamRoleArn": "arn:aws:iam::*****:role/ShapedDatasetAccessRole-*****"
   • AWS Region: us-east-2
3. Use the Rudderstack Sources tab to select the events you want to send. You can send all events, but our team recommends choosing the most important events that indicate user engagement on your content.
4. When finished, enable the destination and save.