Scala Central May 2017
26/05/2017 LinuxRecruit community
Hosted at the exciting Telegraph offices, our eighth event was a great success, with a great crowd and insightful talks on building CI/CD pipeline with SBT, Spark Notebooks and expression problems. Below you can find videos and summaries each talk, which we hope you find useful.
Giuseppe Scopelliti, Expression Problem
Define a datatype by cases, where one can add new cases to the datatype and new functions over the datatype, without recompiling existing code, and while retaining static type safety (e.g. no casts)
Gerard Maas, Developing Data Analytics Jobs with Spark, Scala and the Spark Notebook
The Spark Notebook is a Scala-centric, interactive web app that implements the 'notebook' paradigm: It combines descriptions and code to explore, analyse and learn from massive data sets using Apache Spark.
In this presentation, we will see how the Spark Notebook upgrades our Scala skills to address data-oriented problems and enables us to rapidly evolve through the full data application lifecycle: from exploring data to deployable jobs.
Gerard is the Lead Engineer at Kensu.io, an early-stage startup working on Big Data Governance. He often shares tech knowledge and lessons learned at meetups and conferences about Scala, Spark and Cassandra (Devoxx, Spark Summit, BeScala, Spark Belgium, SkillsMatter). He is also a DataStax Cassandra MVP ('15, '16), Open Source and Stack Overflow contributor.
Antonio Rodrigues, CI/CD Pipeline with SBT
Antonio and Daniel from the Telegraph talk through how their team have created a CI/CD pipeline solution based on SBT. In this presentation, they discuss how they have achieved CI/CD approach and how the process standardised among all services. It also includes a demo to show how flexible and customisable the solution is.