The successful student will have a deeper understanding of the challenges imposed by Big Data and know state of the art data engineering methods and techniques focusing on big data applications. 

The VC will be a mixture of a classical lecture, presentations of assignment solutions and student presentations. 

Introduction to Big Data, Data Engineering and Data Science.Recap on RDBMS and common file formats. Managing XML and JSON in RDBMS. Advanced SQL queries.Scaling of RDBMS. Data WarehousesBig Data FrameworksMapReduceApache SparkSQL on Big Data Architectures(Big) Data IntegrationData Provenance and Data QualityData LakesUsed Programming Languages: Java, Scala. Scala assignments can optionally be solved in Python.

Relational Databases (Lecture "Datenbanken"),  Java Programming

Principles of Database Management: The Practical Guide to Storing, Managing and Analyzing Big and Small Data. Cambridge University Press New York, NY, USA ©2018 ISBN:1107186129 9781107186125

Credits for assignments.Final Exam. The first exam will be a written exam. The alternative exam will be oral or written depending on the number of participants. 

All topics addressed by the lecture or practical parts.

The successful participant will have reached at least 50% of all parts (weekly assignments and final exam).70% of the grade are based on assignmnets and 30% are based on the final exam.Please see the moodle course for details.