In scatter-gather, a typical parallel-programming pattern, data is distributed for processing. Then the results are gathered together, often with additional processing, to combine the results.

I highly recommend reading the document “Patterns of Parallel Programming” by Stephen Toub. It provides an in-depth discussion on the parallel programming patterns in .Net.

In this vein, a new architectural pattern for parallel programming has been introduced (pdf) by Prof. Jorge L. Ortega-Arjona from the Mathematics Department of the National Autonomous University ...

In short, traditional programming languages require programmers to adapt their ideas to a sequential execution model and manually identify parallel sections of code. Dataflow solutions are available ...

Parallel programming exploits the capabilities of multicore systems by dividing computational tasks into concurrently executed subtasks. This approach is fundamental to maximising performance and ...

In a lot of our programs, we run only one additional thing at a time and wait for it to complete; this is usually referred to with the more generic term "asynchronous programming." Parallel ...

Parallel patterns have emerged from recent research on parallel programming as powerful, high-level abstractions that can elegantly capture data locality, memory access patterns, and parallelism ...

In high performance computing, machine learning, and a growing set of other application areas, accelerated, heterogeneous systems are becoming the norm. With that state come several parallel ...

CUDA is a parallel computing platform and programming model developed by NVIDIA for general computing on its own GPUs (graphics processing units). CUDA enables developers to speed up compute ...