Data Engineer

Client of Xperts4

Participate in the development cycle of the Airflow product

Implement/develop the necessary tooling and functionalities of the platform, in alignment with the Data Architect and the group s Data Experts.br> Contribute to the development of Directed Acyclic Graphs (DAGs) required for the proper operation of the datalake and datamart platforms (AWS and Snowflake).br> Provide technical support to end-users during their use of the platform.br> Handle deliveries and code deployments.br> Ensure the platform s run mode

Provide level 2 production support and participate in crisis situations.br> Contribute to the product s Knowledge Base.br> Report to the Airflow platform manager on IT performance, real-time health status, and main operational risks of the platform.br> Contribute to the Data Orchestration community

Act as a key user liaison with the teams using the platform: BI, business projects, Data Science, DataLake, etc.br> Participate in regular meetings with users to share best practices in usage and development.br> Knowledge transfer to the offshore support team

Produce the necessary documentation for knowledge transfer: tutorials, operational documents, etc.br> Conduct and lead knowledge transfer sessions through product demos.br> Support the offshore team in their initial developments.br> Assist the support team in resolving incidents/problems.

Deliverables:

Coding and production deployment of DAGs in Airflow.br> Unit test reports of implemented DAGs.br> Contribution to documents proposing platform evolutions.br> Delivery/roadmap implementation planning via JIRA.br> Documentation of development best practices in Confluence.br> Updates of incident and request tickets in JIRA.br> Support knowledge base (in ServiceNow and Confluence).br> Meeting materials and minutes.

Required Skills:

AWS Cloud/Data Engineerbr> Process orchestration: Airflowbr> ETL/ELT principles: dbtbr> Agile Scrum/Kanban methodologybr> Knowledge of the data management ecosystem (Data Engineer profile)br> DevOps basicsbr> Basics of IT system observability

Soft skills:

Proactivebr> Autonomousbr> Dynamicbr> Team player / Good communicator (a plus)br> Knowledge of the following tools:

Airflow (mandatory)br> AWSbr> Pythonbr> Snowflakebr> dbtbr> JIRA/Confluencebr> Jenkinsbr> Gitlabbr> Terraformbr> Kubernetes/Containersbr> Elasticsearch/Kibana (a plus)