This app creates two types of transfers using the Transfer Service tool.
- Set up a project on Google Developers Console.
- Go to the Developers Console and create or select your project. You will need the project ID later.
- Within Developers Console, select APIs & auth > Credentials.
- Select Add credentials > Service account > JSON key.
- Set the environment variable GOOGLE_APPLICATION_CREDENTIALS to point to your JSON key.
- Add the Storage Transfer service account as an editor of your project storage-transfer-5031963314028297433@partnercontent.gserviceaccount.com
- Set up gcloud for application default credentials.
gcloud components updategcloud auth logingcloud config set project PROJECT_ID
Creating a one-time transfer from Amazon S3 to Google Cloud Storage.
- Set up data sink.
- Go to the Developers Console and create a bucket under Cloud Storage > Storage Browser.
- Set up data source.
- Go to AWS Management Console and create a bucket.
- Under Security Credentials, create an IAM User with access to the bucket.
- Create an Access Key for the user. Note the Access Key ID and Secret Access Key.
- In AwsRequester.java, fill in the user-provided constants.
- Run with
mvn compileandmvn exec:java -Dexec.mainClass="com.google.cloud.storage.storagetransfer.samples.AwsRequester" - Note the job ID in the returned Transfer Job.
Creating a daily transfer from a standard Cloud Storage bucket to a Cloud Storage Nearline bucket for files untouched for 30 days.
- Set up data sink.
- Go to the Developers Console and create a bucket under Cloud Storage > Storage Browser.
- Select Nearline for Storage Class.
- Set up data source.
- Go to the Developers Console and create a bucket under Cloud Storage > Storage Browser.
- In NearlineRequester.java, fill in the user-provided constants.
- Run with
mvn compileandmvn exec:java -Dexec.mainClass="com.google.cloud.storage.storagetransfer.samples.NearlineRequester" - Note the job ID in the returned Transfer Job.
- In RequestChecker.java, fill in the user-provided constants. Use the Job Name you recorded earlier.
- Run with
mvn compileandmvn exec:java -Dexec.mainClass="com.google.cloud.storage.storagetransfer.samples.RequestChecker"