18.05 Philipp Haller: A Foundation for Lineage-Based Distributed Computation
ca 19.30 move over to a pub nearby
The most successful systems for “big data” processing have all adopted functional APIs. We presenta new programming model we call function passing designed to provide a more principled substrate, or middleware, upon which to build data-centric distributed systems like Spark. A key idea is to build up a persistent functional data structure representing transformations on distributed immutable data by passing well-typed serializable functions over the wire and applying them to this distributed data.
Philipp presents his latest work found at https://infoscience.epfl.ch/record/230304/files/fp-jfp.pdf