MBrace.Flow


CloudFlow

Namespace: MBrace.Flow

Provides CloudFlow producers.

Static members

Static memberDescription
OfArray(source)
Signature: (source:'T []) -> CloudFlow<'T>
Type parameters: 'T

Wraps array as a CloudFlow.

OfCloudArrays(cloudArrays)
Signature: cloudArrays:seq<'?29810> -> LocalCloud<PersistedCloudFlow<'T>>
Type parameters: '?29810, 'T

Creates a CloudFlow from a collection of provided cloud sequences.

OfCloudCollection(...)
Signature: (collection:ICloudCollection<'T> * sizeThresholdPerWorker:(unit -> int64) option) -> CloudFlow<'T>
Type parameters: 'T

Creates a CloudFlow according to partitions of provided cloud collection.

OfCloudDirectory(...)
Signature: (dirPath:string * deserializer:(TextReader -> seq<'T>) * encoding:Encoding option * sizeThresholdPerCore:int64 option) -> CloudFlow<'T>
Type parameters: 'T

Constructs a CloudFlow from all files in provided directory using the given reader.

OfCloudDirectory(...)
Signature: (dirPath:string * serializer:ISerializer * sizeThresholdPerCore:int64 option) -> CloudFlow<'T>
Type parameters: 'T

Constructs a CloudFlow of all files in provided cloud directory using the given serializer implementation.

OfCloudDirectory(...)
Signature: (dirPath:string * deserializer:(Stream -> seq<'T>) option * sizeThresholdPerCore:int64 option) -> CloudFlow<'T>
Type parameters: 'T

Constructs a CloudFlow of all files in provided cloud directory using the given deserializer.

OfCloudDirectoryByLine(...)
Signature: (dirPath:string * encoding:Encoding option * sizeThresholdPerCore:int64 option) -> CloudFlow<string>

Constructs a text CloudFlow by line from all files in supplied CloudDirectory.

OfCloudFileByLine(path, encoding)
Signature: (path:string * encoding:Encoding option) -> CloudFlow<string>

Constructs a CloudFlow of lines from a single large text file.

OfCloudFileByLine(...)
Signature: (paths:seq<string> * encoding:Encoding option * sizeThresholdPerCore:int64 option) -> CloudFlow<string>

Constructs a CloudFlow of lines from a collection of text files.

OfCloudFiles(...)
Signature: (paths:seq<string> * deserializer:(TextReader -> seq<'T>) * encoding:Encoding option * sizeThresholdPerCore:int64 option) -> CloudFlow<'T>
Type parameters: 'T

Constructs a CloudFlow from a collection of text files using the given reader.

OfCloudFiles(...)
Signature: (paths:seq<string> * serializer:ISerializer * sizeThresholdPerCore:int64 option) -> CloudFlow<'T>
Type parameters: 'T

Constructs a CloudFlow from a collection of CloudFiles using the given serializer implementation.

OfCloudFiles(...)
Signature: (paths:seq<string> * deserializer:(Stream -> seq<'T>) option * sizeThresholdPerCore:int64 option) -> CloudFlow<'T>
Type parameters: 'T

Constructs a CloudFlow from a collection of CloudFiles using the given deserializer.

OfCloudQueue(queue, degreeOfParallelism)
Signature: (queue:CloudQueue<'T> * degreeOfParallelism:int) -> CloudFlow<'T>
Type parameters: 'T

Creates a CloudFlow from the ReceivePort of a CloudQueue.

OfHttpFileByLine(urls, encoding)
Signature: (urls:seq<string> * encoding:Encoding option) -> CloudFlow<string>

Constructs a CloudFlow of lines from a collection of HTTP text files.

OfHttpFileByLine(url, encoding)
Signature: (url:string * encoding:Encoding option) -> CloudFlow<string>

Constructs a CloudFlow of lines from a single HTTP text file.

OfSeqs(enumerations)
Signature: enumerations:seq<'?29813> -> CloudFlow<'T>
Type parameters: '?29813, 'T

Creates a CloudFlow instance from a finite collection of serializable enumerations.

Fork me on GitHub