I Data engineer sono professionisti informatici richiesti pressoché in tutti i settori. Si occupano di monitorare i trend dei dati per pianificare le azioni più adeguate che un'azienda deve intraprendere. Uno degli aspetti più critici del lavoro di un Data engineer è l'elaborazione dei dati grezzi e la loro trasformazione in dati utilizzabili per creare pipeline e sistemi di dati.
I am not sure if I can say this is a question but that is what they asked : we have a flat file with all transaction coming from third party, that data need to be pushed into our database and then give a result for reporting purpose with an open source ETL tool. how would you do that? ( they are not specific about what ETL tool, no details on flat file and etc.)
Spark out of memory handling
What is the difference between Java and Python?
Did you work with NOSQL databases before?
*For the coding questions in previous rounds, they may ask to write algorithm on paper and also may ask to implement on coderpad in our favorite language. *Round 8 (HR round, phone, 20 mins ): - He explained about the company, role and asked about my interests. Salary negotiation. Availability to join.
SQL
They asked if I had ever worked at a data center before. I laughed and told them I've literally worked at the data center that I'm applying to work for them at for them as a contractor. They had no idea and don't seem to communicate in between offices
How would you monitor dbt in a production capacity?
what is meant by driving table?
Describe a time you had to recover from a DR event
Viewing 371 - 380 interview questions