In scatter-gather, a typical parallel-programming pattern, data is distributed for processing. Then the results are gathered together, often with additional processing, to combine the results.

I highly recommend reading the document “Patterns of Parallel Programming” by Stephen Toub. It provides an in-depth discussion on the parallel programming patterns in .Net.

In this vein, a new architectural pattern for parallel programming has been introduced (pdf) by Prof. Jorge L. Ortega-Arjona from the Mathematics Department of the National Autonomous University ...

In short, traditional programming languages require programmers to adapt their ideas to a sequential execution model and manually identify parallel sections of code. Dataflow solutions are available ...

In a lot of our programs, we run only one additional thing at a time and wait for it to complete; this is usually referred to with the more generic term "asynchronous programming." Parallel ...

An effort is underway, with cooperation of Berkeley UPCRC researchers, to put together an encyclopedia of parallel programming patterns. Dr. Ralph Johnson, one of the “Gang of Four” authors, is ...

Parallel programming exploits the capabilities of multicore systems by dividing computational tasks into concurrently executed subtasks. This approach is fundamental to maximising performance and ...

Parallel patterns have emerged from recent research on parallel programming as powerful, high-level abstractions that can elegantly capture data locality, memory access patterns, and parallelism ...

In high performance computing, machine learning, and a growing set of other application areas, accelerated, heterogeneous systems are becoming the norm. With that state come several parallel ...