Preparation

To allow Shaped to connect to your BigQuery data warehouse, you need to grant Shaped’s GCP service account read-only access to your project, dataset, and tables. You can do this through the GCP portal or with the following steps:

  1. Install the gcloud command line tool.
  2. Receive our service account via email.
  3. Grant our service account permission to access your project, dataset, and tables via the roles/bigquery.dataViewer,roles/bigquery.jobUser and roles/bigquery.readSessionUser roles.
gcloud projects add-iam-policy-binding <YOUR_PROJECT> \
--member=<OUR_SERVICE_ACCOUNT> \
--role=roles/bigquery.dataEditor

gcloud projects add-iam-policy-binding <YOUR_PROJECT> \
--member=<OUR_SERVICE_ACCOUNT> \
--role=roles/bigquery.jobUser

gcloud projects add-iam-policy-binding <YOUR_PROJECT> \
--member=<OUR_SERVICE_ACCOUNT> \
--role=roles/bigquery.readSessionUser

Connector Config Definition

Below are the fields required for the BigQuery connection_config

"connector_configs": [{
    "type": "BigQuery",
    "id": "bigquery",
    "dataset": "ranking_dataset",
    "project_id": "project_name",
    "location": "warehouse_region"
}]
FieldExampleDescription
type“BigQuery”Specifies the connector type, in this case “BigQuery”.
id“bigquery”Specifies the connector id, in this case “bigquery”.
project_id“project_name_12345”The Google Cloud Platform project containing your dataset.
dataset“movielens”The name of the BigQuery dataset.
location“us-west1”The project’s region.