ParallelProcessing¶
The Block module provides a |
|
Module to process data in parallel for large data sets |
|
This sub-package provides functions for parallel processing of large data for functions that cannot be split into blocks or that have a more optimal way of parallelization. |
|
Decorator to traceback errors in parallel processes. |
|
Provides formatting tool to print text with parallel process header. |
|
Shared ctype memory arrays. |
|
Shared memory array manager for parallel processing using ctype shared arrays in |
This sub-package provides functions for parallel processing of data for ClearMap.
The main functionality is to dsitribute
Blocks
of data to be processed in parallel
manged by ClearMap.ParallelProcessing.BlockProcessing
.
The DataProcessing
sub-module
contains cython implementations for a set of functions to be applied to
large arrays in parallel with out sub-dividing the data into blocks
but using memory mapping and the buffer interface.