X Tutup
Skip to content

Latest commit

 

History

History
 
 

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 

README.md

Transfer Service sample using Java

This app creates two types of transfers using the Transfer Service tool.

Prerequisites

  1. Set up a project on Google Developers Console.
  2. Go to the Developers Console and create or select your project. You will need the project ID later.
  3. Within Developers Console, select APIs & auth > Credentials.
  4. Select Add credentials > Service account > JSON key.
  5. Set the environment variable GOOGLE_APPLICATION_CREDENTIALS to point to your JSON key.
  6. Add the Storage Transfer service account as an editor of your project storage-transfer-5031963314028297433@partnercontent.gserviceaccount.com
  7. Set up gcloud for application default credentials.
  8. gcloud components update
  9. gcloud auth login
  10. gcloud config set project PROJECT_ID

Transfer from Amazon S3 to Google Cloud Storage

Creating a one-time transfer from Amazon S3 to Google Cloud Storage.

  1. Set up data sink.
  2. Go to the Developers Console and create a bucket under Cloud Storage > Storage Browser.
  3. Set up data source.
  4. Go to AWS Management Console and create a bucket.
  5. Under Security Credentials, create an IAM User with access to the bucket.
  6. Create an Access Key for the user. Note the Access Key ID and Secret Access Key.
  7. In AwsRequester.java, fill in the user-provided constants.
  8. Run with mvn compile and mvn exec:java -Dexec.mainClass="com.google.cloud.storage.storagetransfer.samples.AwsRequester"
  9. Note the job ID in the returned Transfer Job.

Transfer data from a standard Cloud Storage bucket to a Cloud Storage Nearline bucket

Creating a daily transfer from a standard Cloud Storage bucket to a Cloud Storage Nearline bucket for files untouched for 30 days.

  1. Set up data sink.
  2. Go to the Developers Console and create a bucket under Cloud Storage > Storage Browser.
  3. Select Nearline for Storage Class.
  4. Set up data source.
  5. Go to the Developers Console and create a bucket under Cloud Storage > Storage Browser.
  6. In NearlineRequester.java, fill in the user-provided constants.
  7. Run with mvn compile and mvn exec:java -Dexec.mainClass="com.google.cloud.storage.storagetransfer.samples.NearlineRequester"
  8. Note the job ID in the returned Transfer Job.

Checking the status of a transfer

  1. In RequestChecker.java, fill in the user-provided constants. Use the Job Name you recorded earlier.
  2. Run with mvn compile and mvn exec:java -Dexec.mainClass="com.google.cloud.storage.storagetransfer.samples.RequestChecker"
X Tutup