In scatter-gather, a typical parallel-programming pattern, data is distributed for processing. Then the results are gathered together, often with additional processing, to combine the results.

I highly recommend reading the document “Patterns of Parallel Programming” by Stephen Toub. It provides an in-depth discussion on the parallel programming patterns in .Net.

In this vein, a new architectural pattern for parallel programming has been introduced (pdf) by Prof. Jorge L. Ortega-Arjona from the Mathematics Department of the National Autonomous University ...

4) Data flowdecomposition breaks down the problem in terms of how data flowsbetween the tasks. 5) Most parallelprogramming problems fall into one of several well known patterns. 6) The constraintsof ...

In short, traditional programming languages require programmers to adapt their ideas to a sequential execution model and manually identify parallel sections of code. Dataflow solutions are available ...

An effort is underway, with cooperation of Berkeley UPCRC researchers, to put together an encyclopedia of parallel programming patterns. Dr. Ralph Johnson, one of the “Gang of Four” authors, is ...

In a lot of our programs, we run only one additional thing at a time and wait for it to complete; this is usually referred to with the more generic term "asynchronous programming." Parallel ...

Parallel programming exploits the capabilities of multicore systems by dividing computational tasks into concurrently executed subtasks. This approach is fundamental to maximising performance and ...

NVIDIA’s CUDA is a general purpose parallel computing platform and programming model that accelerates deep learning and other compute-intensive apps by taking advantage of the parallel ...