Data engineers prepare and manage big data for data scientists and analysts. Data engineers are responsible for designing, building and integrating data from multiple sources across multiple storages.
Programming, big data, cloud, DWH, system design
Core tech stacks:
Java, Python, SQL, cluster computing (e.g. Hadoop, MapReduce), data processing and streaming (e.g. Pig, Spark, Kafka), containers