Foundations of parallel programming

the long version

The major reason for the lack of use 'of parallel' computing, is the mismatch between the complexity and variety of parallel hardware, and the software development tools to program it. The cost of the developing software needs to be amortised over decades, but the platforms on which it executes change every few years, requiring complete rewrites. The evident cost-effectiveness of parallel computation has not been realized because of this mismatch. This book presents an integrated approach to parallel software development that addresses software issues and performance issues together. It presents a methodology for software construction that produces software that is architecture-independent and intellectually abstract. The software can execute efficiently on a range of existing and potential hardware configurations. The approach is based on the construction of categorical data types, a generalisation of abstract data types, and of objects. Categorical data types abstract both from the representation of a data type and also from the detailed control flow necessary to perform operations on it. They thus impose a strong separation between the semantics, on which programs can depend, and the implementation, which is therefore free to hide the parallel machine properties that are used.