Preguntas sobre kafka, estrategias de procesar datos en continua transformación (UPSERT) de forma distribuida en un delta lake. Otras relacionadas con el ETL y spark.
Sr Data Engineer Interview Questions
2,564 sr data engineer interview questions shared by candidates
The HR interview was just a relaxed chat based around values and general compatibility for the role. They ensured that you have done your reading around the company and role. The tech challenge was python based, using a provided API to gather/filter/resubmit data. You had to upload the solution along with appropriate tests to Git. The engineer interview didn’t cover the tech challenge solution at all (surprisingly). It was a general discussion on past experience and projects. Later it switched gears to some more general questions like ‘what is etl?’ or ‘tell us about data streaming products?’ or ‘what problems have you had using semi-structured or unstructured data?’. AWS experience and services used was also covered. The whiteboard session I found the hardest part and was again scenario based where you had to diagnose problems in a process and work with the other engineers to come up with a solution. Later (once the main problem had been covered) more requirements/problems were added to see how you thought on your feed and you were questioned on which products you would use (and why)
Db questions, data structures , sql, oops
1. Given a list of strings, extract numbers from the string. 2. Design a streaming application with the data model
3 task 1) Python coding for array or math problem 2) Application on python with simple logic 3) Spark ingestion task from json and database into database
1> Technical questions related to job role 2> Current project work flows 3> Some programming and Infra related questions 4> English test including speaking, writing and others
Basic top 20 python questions Why data engineer
Qu'est-ce qu'un bon commit message selon vous ?
Describe your background, explain your data engineering expertise and so on.
a python exercise which consists in developing a simple pipeline
Viewing 721 - 730 interview questions