Skip to main content

Tables

Tables are core datasets that hold records, documents, user profile information, or events.

Connectors​

Connectors establish a connection to where your data already lives. You can use a custom connector

Built-in Connectors​

Shaped supports out-of-the-box connectors to a range of systems, including:

  • Data Warehouses: Such as BigQuery, Snowflake, and Redshift.
  • Databases: Such as PostgreSQL and MySQL.
  • Blob Storage: Such as S3 and Google Cloud Storage (GCS).
  • Analytics Applications: Such as Segment and Amplitude.

Custom connectors​

If your datasource is not supported, you can declare a custom table.

Shaped provides a CREATE TABLE endpoint to declare a new table and its schema.

Shaped provides a /table/insert endpoint that you can use to add records to a table, instead of uising a connector.

Table schema​

The Table Schema is a formal definition that describes the structure of your data.

Built-in connectors infer the column structure from the datasource you connect.

For a custom dataset, it explicitly outlines:

  • columns: The names of the fields in your data.
  • unique_keys: A list of columns that uniquely identify each row in the dataset (e.g., ["id"]).
  • datetime_key: A unique datetime that is used as a replication key to identify new or updated data.