Store raw event data in Google BigQuery for custom analysis and reporting. This integration streams events from your Transmute Engine directly into a BigQuery dataset of your choice.
Status: Active
Requirements #
- A Google Cloud Project with billing enabled
- BigQuery API enabled on the project
- A Service Account with BigQuery Data Editor and BigQuery Job User roles
- A BigQuery Dataset ID
- A downloaded Service Account JSON key file
Step 1 – Create a Google Cloud Project #
- Go to Google Cloud Console
- Click the project dropdown at the top of the page
- Click New Project, give it a name, and click Create
- Once created, make sure the new project is selected in the dropdown
Note: Billing must be enabled on the project for BigQuery to function. Go to Billing in the left menu to link a billing account if you have not already done so.
Step 2 – Enable the BigQuery API #
- In Google Cloud Console, go to APIs & Services > Library
- Search for BigQuery API
- Click on it and then click Enable
Step 3 – Create a BigQuery Dataset #
- Navigate to BigQuery in the Cloud Console (search “BigQuery” in the top bar)
- In the Explorer panel on the left, click on your project name
- Click the three-dot menu next to the project and select Create dataset
- Enter a Dataset ID (e.g.
seresa_events) – note this down, you will need it later - Choose your data location (select the region closest to your users)
- Click Create dataset
Step 4 – Create a Service Account #
- In Google Cloud Console, go to IAM & Admin > Service Accounts
- Click Create Service Account
- Give it a name (e.g.
seresa-transmute-engine) and click Create and Continue - In the Grant this service account access to project section, add these two roles:
- BigQuery Data Editor – allows reading and writing data to datasets
- BigQuery Job User – allows the account to run query and load jobs
- Click Continue, then Done
Step 5 – Download the JSON Key #
- In IAM & Admin > Service Accounts, click on the service account you just created
- Go to the Keys tab
- Click Add Key > Create new key
- Select JSON as the key type and click Create
- The JSON key file will download automatically to your computer
- Rename the file so it starts with
bq-seresa-transmute-engine-(see File Requirements below)
Security note: Keep this file private. Anyone with the JSON key can access your Google Cloud project using the permissions granted to this service account.
File Requirements #
| Requirement | Details |
|---|---|
| File name prefix | Must start with bq-seresa-transmute-engine- |
| File extension | Must be .json |
| File type | Must be a valid Google Cloud service account JSON key |
Google gives you a JSON file with an auto-generated name when you download the key. You can rename any JSON file they give you – just add bq-seresa-transmute-engine- to the front of the filename.
Example: my-project-a1b2c3d4e5f6.json becomes bq-seresa-transmute-engine-my-project-a1b2c3d4e5f6.json
JSON Key Validation Requirements #
When you upload the key file, Transmute Engine validates the following fields:
| Field | Expected Value |
|---|---|
type | Must be service_account |
project_id | Must be a valid Google Cloud project ID |
private_key | Must begin with -----BEGIN PRIVATE KEY----- |
client_email | Service account email address |
private_key_id | Required field |
client_id | Required field |
auth_uri | Required field |
token_uri | Required field |
Connect BigQuery in inPIPE #
- Go to inPIPE > Connections
- Find the BigQuery integration and click Configure
- Upload your renamed Service Account JSON key file
- Enter the Dataset ID you created in Step 3
- Toggle the integration ON
- Events will now stream into BigQuery automatically
Service Setup Fee #
Prefer to have the BigQuery integration set up for you? Our team can handle the full setup on your behalf.
| Service | Fee |
|---|---|
| BigQuery Integration Setup (one-off) | SGD $197 / USD $187 |
This is a one-off pre-paid fee (2026 rates) and includes:
- Creating a Google Cloud project if you don’t have one
- Setting up a new BigQuery dataset on your Google Cloud project
- Integrating it into your inPIPE plugin
- Full end-to-end testing
To arrange setup, contact .