Step 2 - Authorize Pump


Before you begin, ensure you have the following permissions configured. See the Google Cloud Platform documentation for information on how to configure these permissions.

  • User with permission to create a project

  • User with permission to create a BigQuery dataset

  • User with permission to modify Billing settings

Create a Billing Export

Step 1: Select or Create a Project

Before you enable Cloud Billing data exports, you must create a project to store the data. If you have multiple Cloud Billing accounts, you will need to enable Cloud Billing exports, individually, on each account.

We recommend you create a dedicated project to store all Cloud Billing data, rather than using an existing project.

The project should be linked to the same Cloud Billing account that you plan to enable the Cloud Billing data export on. If you need help assigning a project to a Cloud Billing account, check out the Cloud Billing documentation.

Step 2: Create a BigQuery Dataset

In the GCP console, navigate to BigQuery, and follow the steps below to create a BigQuery dataset.

  1. From the Project dropdown list at the top of the BigQuery console, select the project you set for your Cloud Billing data export.

  2. In the Explorer panel, click the three vertical dots (next to your project ID).

  3. Click Create dataset.

  4. Configure your dataset:

    • Enter a Dataset ID. Rather than a project-specific ID, We recommend an ID that spans projects, such as all_billing_data.

    • For Location type, select US (multiple regions in United States) or EU (multiple regions in European Union). One of these is required to enable detailed usage cost data.

    • Leave the Enable table expiration checkbox unchecked to ensure that data never expires.

    • Click Advanced options. Set Encryption to Google-managed encryption key.

  5. Click the CREATE DATASET. The dataset should appear in the Explorer panel, under your project.

Step 3: Enable Cloud Billing Export to the BigQuery Dataset

  1. Still in BigQuery, click the hamburger menu (three horizontal lines) at the top left of the console, and select Billing.

  2. In the left Billing navigation menu, select Billing export. (You can also search for and navigate to Billing export from the main search bar at the top of the GCP console.)

  3. Ensure you are on the BIGQUERY EXPORT tab. (This tab should be selected by default). Then, under Detailed usage cost, click EDIT SETTINGS.

  4. Configure the following settings:

    • From the Projects list, select the project you set up to contain your billing data.

    • For Dataset, select the dataset that you set up to contain your exported Cloud Billing data (e.g., all_billing_data).

  5. Click the SAVE.

Next Steps: Complete Your Pump-GCP Integration

Your Cloud Billing data will start to be stored in the BigQuery dataset you created. To continue connecting your GCP account to Pump, return to the Autopilot Onboarding Modal.

Last updated