Skip navigation links
A B C D E F G H I L M N O P R S T V 

A

addTraceFor(AbstractGoogleClient, String) - Method in class org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions.GoogleApiTracer
Creates a GoogleApiDebugOptions.GoogleApiTracer that sets the trace destination on all calls that match the given client type.
addTraceFor(AbstractGoogleClientRequest<?>, String) - Method in class org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions.GoogleApiTracer
Creates a GoogleApiDebugOptions.GoogleApiTracer that sets the trace traceDestination on all calls that match for the given request type.

B

bucketAccessible(GcsPath) - Method in class org.apache.beam.sdk.util.GcsUtil
Returns whether the GCS bucket exists and is accessible.
bucketOwner(GcsPath) - Method in class org.apache.beam.sdk.util.GcsUtil
Returns the project number of the project which owns this bucket.

C

CloudResourceManagerOptions - Interface in org.apache.beam.sdk.extensions.gcp.options
Properties needed when using Google CloudResourceManager with the Apache Beam SDK.
compareTo(Path) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
copy(Iterable<String>, Iterable<String>) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
copy(Iterable<String>, Iterable<String>) - Method in class org.apache.beam.sdk.util.GcsUtil
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.DefaultProjectFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.GcpTempLocationFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.GcpUserCredentialsFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcsOptions.ExecutorServiceFactory
 
create(PipelineOptions) - Method in class org.apache.beam.sdk.extensions.gcp.options.GcsOptions.PathValidatorFactory
 
create(String, String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
create(GcsPath, String) - Method in class org.apache.beam.sdk.util.GcsUtil
Creates an object in GCS.
create(PipelineOptions) - Method in class org.apache.beam.sdk.util.GcsUtil.GcsUtilFactory
Returns an instance of GcsUtil based on the PipelineOptions.
create(Storage, HttpRequestInitializer, ExecutorService, Integer) - Static method in class org.apache.beam.sdk.util.GcsUtil.GcsUtilFactory
Returns an instance of GcsUtil based on the given parameters.
create(StorageObject) - Static method in class org.apache.beam.sdk.util.GcsUtil.StorageObjectOrIOException
 
create(IOException) - Static method in class org.apache.beam.sdk.util.GcsUtil.StorageObjectOrIOException
 
createBucket(String, Bucket) - Method in class org.apache.beam.sdk.util.GcsUtil
Creates a Bucket under the specified project in Cloud Storage or propagates an exception.
CredentialFactory - Interface in org.apache.beam.sdk.extensions.gcp.auth
Construct an oauth credential to be used by the SDK and the SDK workers.

D

DefaultProjectFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.DefaultProjectFactory
 

E

endsWith(Path) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
endsWith(String) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
equals(Object) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
ExecutorServiceFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcsOptions.ExecutorServiceFactory
 
expand(GcsPath) - Method in class org.apache.beam.sdk.util.GcsUtil
Expands a pattern into matched paths.

F

fileSize(GcsPath) - Method in class org.apache.beam.sdk.util.GcsUtil
Returns the file size from GCS or throws FileNotFoundException if the resource does not exist.
fromComponents(String, String) - Static method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Creates a GcsPath from bucket and object components.
fromObject(StorageObject) - Static method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Creates a GcsPath from a StorageObject.
fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.extensions.gcp.auth.GcpCredentialFactory
 
fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.extensions.gcp.auth.NoopCredentialFactory
 
fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.util.GcsIOChannelFactory
Create a GcsIOChannelFactory with the given PipelineOptions.
fromOptions(PipelineOptions) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrar
 
fromOptions(PipelineOptions) - Static method in class org.apache.beam.sdk.util.GcsPathValidator
 
fromResourceName(String) - Static method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Creates a GcsPath from a OnePlatform resource name in string form.
fromUri(URI) - Static method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Creates a GcsPath from a URI.
fromUri(String) - Static method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Creates a GcsPath from a URI in string form.

G

GcpCredentialFactory - Class in org.apache.beam.sdk.extensions.gcp.auth
Construct an oauth credential to be used by the SDK and the SDK workers.
GcpCredentialFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.auth.GcpCredentialFactory
 
GcpOptions - Interface in org.apache.beam.sdk.extensions.gcp.options
Options used to configure Google Cloud Platform specific options such as the project and credentials.
GcpOptions.DefaultProjectFactory - Class in org.apache.beam.sdk.extensions.gcp.options
Attempts to infer the default project based upon the environment this application is executing within.
GcpOptions.GcpTempLocationFactory - Class in org.apache.beam.sdk.extensions.gcp.options
Returns PipelineOptions.getTempLocation() as the default GCP temp location.
GcpOptions.GcpUserCredentialsFactory - Class in org.apache.beam.sdk.extensions.gcp.options
Attempts to load the GCP credentials.
GcpPipelineOptionsRegistrar - Class in org.apache.beam.sdk.extensions.gcp.options
A registrar containing the default GCP options.
GcpPipelineOptionsRegistrar() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcpPipelineOptionsRegistrar
 
GcpTempLocationFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.GcpTempLocationFactory
 
GcpUserCredentialsFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcpOptions.GcpUserCredentialsFactory
 
GCS_URI - Static variable in class org.apache.beam.sdk.util.gcsfs.GcsPath
Pattern that is used to parse a GCS URL.
GcsIOChannelFactory - Class in org.apache.beam.sdk.util
Implements IOChannelFactory for GCS.
GcsIOChannelFactoryRegistrar - Class in org.apache.beam.sdk.util
AutoService registrar for the GcsIOChannelFactory.
GcsIOChannelFactoryRegistrar() - Constructor for class org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrar
 
GcsOptions - Interface in org.apache.beam.sdk.extensions.gcp.options
Options used to configure Google Cloud Storage.
GcsOptions.ExecutorServiceFactory - Class in org.apache.beam.sdk.extensions.gcp.options
Returns the default ExecutorService to use within the Apache Beam SDK.
GcsOptions.PathValidatorFactory - Class in org.apache.beam.sdk.extensions.gcp.options
Creates a PathValidator object using the class specified in GcsOptions.getPathValidatorClass().
GcsPath - Class in org.apache.beam.sdk.util.gcsfs
Implements the Java NIO Path API for Google Cloud Storage paths.
GcsPath(FileSystem, String, String) - Constructor for class org.apache.beam.sdk.util.gcsfs.GcsPath
Constructs a GcsPath.
GcsPathValidator - Class in org.apache.beam.sdk.util
GCP implementation of PathValidator.
GcsUtil - Class in org.apache.beam.sdk.util
Provides operations on GCS.
GcsUtil.GcsUtilFactory - Class in org.apache.beam.sdk.util
This is a DefaultValueFactory able to create a GcsUtil using any transport flags specified on the PipelineOptions.
GcsUtil.StorageObjectOrIOException - Class in org.apache.beam.sdk.util
A class that holds either a StorageObject or an IOException.
GcsUtilFactory() - Constructor for class org.apache.beam.sdk.util.GcsUtil.GcsUtilFactory
 
getBucket() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Returns the bucket name associated with this GCS path, or an empty string if this is a relative path component.
getCredential() - Method in interface org.apache.beam.sdk.extensions.gcp.auth.CredentialFactory
 
getCredential() - Method in class org.apache.beam.sdk.extensions.gcp.auth.GcpCredentialFactory
Returns a default GCP Credentials or null when it fails.
getCredential() - Method in class org.apache.beam.sdk.extensions.gcp.auth.NoopCredentialFactory
 
getCredentialFactoryClass() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
The class of the credential factory that should be created and used to create credentials.
getExecutorService() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
The ExecutorService instance to use to create threads, can be overridden to specify an ExecutorService that is compatible with the users environment.
getFileName() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
getFileSystem() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
getGcpCredential() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
The credential instance that should be used to authenticate against GCP services.
getGcpTempLocation() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
A GCS path for storing temporary files in GCP.
getGcsEndpoint() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
GCS endpoint to use.
getGcsUploadBufferSizeBytes() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
The buffer size (in bytes) to use when uploading files to GCS.
getGcsUtil() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
The GcsUtil instance that should be used to communicate with Google Cloud Storage.
getGlobPrefix(String) - Static method in class org.apache.beam.sdk.util.GcsUtil
Returns the prefix portion of the glob that doesn't contain wildcards.
getGoogleApiTrace() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions
This option enables tracing of API calls to Google services used within the Apache Beam SDK.
getJsonFactory() - Static method in class org.apache.beam.sdk.util.Transport
 
getName(int) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
getNameCount() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
getObject() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Returns the object name associated with this GCS path, or an empty string if no object is specified.
getObject(GcsPath) - Method in class org.apache.beam.sdk.util.GcsUtil
Returns the StorageObject for the given GcsPath.
getObjects(List<GcsPath>) - Method in class org.apache.beam.sdk.util.GcsUtil
Returns StorageObjectOrIOExceptions for the given GcsPaths.
getParent() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
Returns the parent path, or null if this path does not have a parent.
getPathValidator() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
The path validator instance that should be used to validate paths.
getPathValidatorClass() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
The class of the validator that should be created and used to validate paths.
getPipelineOptions() - Method in class org.apache.beam.sdk.extensions.gcp.options.GcpPipelineOptionsRegistrar
 
getProject() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
Project id to use when launching jobs.
getRoot() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
getScheme() - Method in class org.apache.beam.sdk.util.GcsIOChannelFactoryRegistrar
 
getSizeBytes(String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
getTransport() - Static method in class org.apache.beam.sdk.util.Transport
 
getZone() - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
GCP availability zone for operations.
globToRegexp(String) - Static method in class org.apache.beam.sdk.util.GcsUtil
Expands glob expressions to regular expressions.
GoogleApiDebugOptions - Interface in org.apache.beam.sdk.extensions.gcp.options
These options configure debug settings for Google API clients created within the Apache Beam SDK.
GoogleApiDebugOptions.GoogleApiTracer - Class in org.apache.beam.sdk.extensions.gcp.options
A GoogleClientRequestInitializer that adds the trace destination to Google API calls.
GoogleApiTracer() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions.GoogleApiTracer
 

H

hashCode() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 

I

initialize(HttpRequest) - Method in class org.apache.beam.sdk.extensions.gcp.auth.NullCredentialInitializer
 
initialize(AbstractGoogleClientRequest<?>) - Method in class org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions.GoogleApiTracer
 
initialize(HttpRequest) - Method in class org.apache.beam.sdk.util.RetryHttpRequestInitializer
 
ioException() - Method in class org.apache.beam.sdk.util.GcsUtil.StorageObjectOrIOException
Returns the IOException.
isAbsolute() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
isGcsPatternSupported(String) - Static method in class org.apache.beam.sdk.util.GcsUtil
Returns true if the given GCS pattern is supported otherwise fails with an exception.
isGlob(GcsPath) - Static method in class org.apache.beam.sdk.util.GcsUtil
Returns true if the given spec contains glob.
isReadSeekEfficient(String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
iterator() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 

L

listObjects(String, String, String) - Method in class org.apache.beam.sdk.util.GcsUtil
Lists Objects given the bucket, prefix, pageToken.

M

match(String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 

N

newStorageClient(GcsOptions) - Static method in class org.apache.beam.sdk.util.Transport
Returns a Cloud Storage client builder using the specified GcsOptions.
NoopCredentialFactory - Class in org.apache.beam.sdk.extensions.gcp.auth
Construct an oauth credential to be used by the SDK and the SDK workers.
NoopCredentialFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.auth.NoopCredentialFactory
 
normalize() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
NullCredentialInitializer - Class in org.apache.beam.sdk.extensions.gcp.auth
A HttpRequestInitializer for requests that don't have credentials.
NullCredentialInitializer() - Constructor for class org.apache.beam.sdk.extensions.gcp.auth.NullCredentialInitializer
 

O

open(String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
open(GcsPath) - Method in class org.apache.beam.sdk.util.GcsUtil
Opens an object in GCS.
org.apache.beam.sdk.extensions.gcp.auth - package org.apache.beam.sdk.extensions.gcp.auth
Defines classes related to interacting with Credentials for pipeline creation and execution containing Google Cloud Platform components.
org.apache.beam.sdk.extensions.gcp.options - package org.apache.beam.sdk.extensions.gcp.options
Defines PipelineOptions for configuring pipeline execution for Google Cloud Platform components.
org.apache.beam.sdk.util - package org.apache.beam.sdk.util
Defines Google Cloud Platform component utilities that can be used by Beam runners.
org.apache.beam.sdk.util.gcsfs - package org.apache.beam.sdk.util.gcsfs
Defines utilities used to interact with Google Cloud Storage.

P

PathValidatorFactory() - Constructor for class org.apache.beam.sdk.extensions.gcp.options.GcsOptions.PathValidatorFactory
 

R

register(WatchService, WatchEvent.Kind<?>[], WatchEvent.Modifier...) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
register(WatchService, WatchEvent.Kind<?>...) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
relativize(Path) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
remove(Collection<String>) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
remove(Collection<String>) - Method in class org.apache.beam.sdk.util.GcsUtil
 
resolve(Path) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
resolve(String) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
resolve(String, String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
resolveSibling(Path) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
resolveSibling(String) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
RetryHttpRequestInitializer - Class in org.apache.beam.sdk.util
Implements a request initializer that adds retry handlers to all HttpRequests.
RetryHttpRequestInitializer() - Constructor for class org.apache.beam.sdk.util.RetryHttpRequestInitializer
 
RetryHttpRequestInitializer(Collection<Integer>) - Constructor for class org.apache.beam.sdk.util.RetryHttpRequestInitializer
 
RetryHttpRequestInitializer(Collection<Integer>, HttpResponseInterceptor) - Constructor for class org.apache.beam.sdk.util.RetryHttpRequestInitializer
 

S

SCHEME - Static variable in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
setCredentialFactoryClass(Class<? extends CredentialFactory>) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
 
setExecutorService(ExecutorService) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
 
setFileSystem(FileSystem) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
setGcpCredential(Credentials) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
 
setGcpTempLocation(String) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
 
setGcsEndpoint(String) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
 
setGcsUploadBufferSizeBytes(Integer) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
 
setGcsUtil(GcsUtil) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
 
setGoogleApiTrace(GoogleApiDebugOptions.GoogleApiTracer) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GoogleApiDebugOptions
 
setPathValidator(PathValidator) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
 
setPathValidatorClass(Class<? extends PathValidator>) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcsOptions
 
setProject(String) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
 
setStorageClient(Storage) - Method in class org.apache.beam.sdk.util.GcsUtil
 
setZone(String) - Method in interface org.apache.beam.sdk.extensions.gcp.options.GcpOptions
 
startsWith(Path) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
startsWith(String) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
storageObject() - Method in class org.apache.beam.sdk.util.GcsUtil.StorageObjectOrIOException
Returns the StorageObject.
StorageObjectOrIOException() - Constructor for class org.apache.beam.sdk.util.GcsUtil.StorageObjectOrIOException
 
subpath(int, int) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 

T

throwNullCredentialException() - Static method in class org.apache.beam.sdk.extensions.gcp.auth.NullCredentialInitializer
 
toAbsolutePath() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
toFile() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
toPath(String) - Method in class org.apache.beam.sdk.util.GcsIOChannelFactory
 
toRealPath(LinkOption...) - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
toResourceName() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
toString() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
toUri() - Method in class org.apache.beam.sdk.util.gcsfs.GcsPath
 
Transport - Class in org.apache.beam.sdk.util
Helpers for cloud communication.
Transport() - Constructor for class org.apache.beam.sdk.util.Transport
 

V

validateInputFilePatternSupported(String) - Method in class org.apache.beam.sdk.util.GcsPathValidator
Validates the the input GCS path is accessible and that the path is well formed.
validateOutputFilePrefixSupported(String) - Method in class org.apache.beam.sdk.util.GcsPathValidator
Validates the the output GCS path is accessible and that the path is well formed.
verifyPath(String) - Method in class org.apache.beam.sdk.util.GcsPathValidator
 
A B C D E F G H I L M N O P R S T V 
Skip navigation links

Copyright © 2016–2017 The Apache Software Foundation. All rights reserved.