Our platform enables you to quickly and easily connect your data sources to Google BigQuery table. This enables a one-way synchronization to occur - where any changes in the Google BigQuery table are downloaded into your data source on a regular basis. Your data source will be automatically updated in this way until you remove the connector or an error occurs (such as losing authorization to access the database).
Before you add a Google BigQuery Connector, you must ensure that you have a valid Google Cloud Platform Connection set up on your organization. You also need to set up a few basic things in the GCP console.
To Set up a Google BigQuery Connector to your Data Source, follow these simple steps:
- Go to Connected Data -> Data Sources
- In the list of available data sources, hover your mouse over the listing of the data source you wish to connect.
A set of options will show; click on the settings link. - On the Settings page, mid-way down you should see a Connector heading.
- Click
- A new window will appear with the selection of connectors to choose from.
- Click on the Google BigQuery Connector. The page should refresh with your newly added connector.
Next, configure the following:
- Project Id: Specify the project id where your table and dataset is located.
- Dataset Name: Specify the dataset where your table can be located.
- Table Name: The Google BigQuery database table from which rows will be retrieved
- Ignore Internal Columns: If this is enabled, this connector will ignore all columns where the column name starts with an underscore (e.g., _lastupdated). If your table has a column named _identity and internal columns are not ignored, this column will always be the first column of the data source. Other internal columns are added to the end.
- Refresh Frequency: The frequency that data is pulled by this connector.
When you save your changes, the connector will be fired for the first time and after that will run at the interval you specified in the connector settings.
Wait a minute or so and then check the Rows page for your data source. If rows are not downloaded, then there may be an error with the connection to the Google BigQuery API. You can check this by clicking on the View Logs button shown next to your connector on the Settings page.