Skip to main content
This documentation page assumes you are already familiar with the general structure of Cloud Sources in Atoti as well as with Google Cloud Storage.
The Google Cloud Source relies on Google Cloud Storage SDK for Java. Make sure you are familiar with this SDK when using the Google Cloud Source. In order to use the Google Cloud Source, add the following lines to your pom.xml:

Cloud Source to Google Cloud Storage concepts

Entities

The Google implementation of ICloudEntity is GoogleEntity. It is essentially a wrapper around an object from the Google Cloud Storage SDK.

Locating entities

Entity paths

IGoogleEntityPath implements ICloudEntityPath. It is a reference to an object and its metadata.

Directories

The Google Cloud Storage implementation for ICloudDirectory is represented by the GoogleCloudDirectory implementation. A directory is tied to a bucket. It contains all objects whose names start with a certain prefix. For example, a directory on a certain container with the prefix directory1/subdirectory2 would contain the first three of the following objects:
A directory with an empty prefix corresponds to the root of the container. A Google Cloud Storage directory object can be constructed by specifying the Storage client, a bucket name and a prefix. The Storage client is the configuration of the connection to Google Cloud Storage. It can be configured as follows using the Google Cloud SDK.

CSVDataProviderFactory

To configure the CSV source to read Google object, you can use the GoogleCsvDataProviderFactory class to configure how the files are downloaded.

Configuration example: how to configure it with a CSV source

First let’s define a generic CSV source configuration. This abstract configuration contains all the part that is common to all the sources and can be used to switch from local to cloud sources easily.
Then let’s define the Google specific configuration: