EV - Sr. Data Engineer - 0066 at Thaloz

We are redirecting you to the source. If you are not redirected in 3 seconds, please click here.

EV - Sr. Data Engineer - 0066 at Thaloz. We are seeking a highly skilled Senior Data Engineer to join our dynamic team and lead the migration of our existing datamarts from Amazon Redshift and Microsoft SQL Server to Snowflake. This pivotal role is essential to modernizing our data infrastructure, ensuring scalable, reliable, and efficient data platforms that empower business intelligence and analytics. The ideal candidate will bring deep expertise in data engineering, data modeling, ETL/ELT processes, and cloud data platforms, working collaboratively within an Agile environment to deliver high-quality data solutions that drive strategic decision-making.. Job Responsibilities. . Lead the migration of existing datamarts currently hosted on Amazon Redshift and Microsoft SQL Server to Snowflake, ensuring minimal disruption and optimized performance.. . Plan and execute the decommissioning of legacy datamarts post-migration, ensuring data integrity and continuity.. . Design and implement robust, scalable data models tailored for Snowflake’s architecture to support efficient querying and analytics.. . Rework and optimize existing ingestion and transformation pipelines, transitioning from traditional ETL to modern ELT paradigms where appropriate.. . Develop and maintain orchestration workflows using tools such as Apache Airflow to automate data ingestion, transformation, and pipeline execution.. . Establish and enforce data quality standards and validation processes to ensure accuracy, consistency, and reliability of data across platforms.. . Implement continuous integration and continuous deployment (CI/CD) practices for data pipelines to accelerate development cycles and improve deployment reliability.. . Work closely with cross-functional teams including data engineers, software engineers, data analysts, and business stakeholders in an Agile environment to deliver iterative improvements and meet project goals.. . Proactively identify bottlenecks and inefficiencies in data workflows and propose innovative solutions to enhance system performance and scalability.. . Maintain comprehensive documentation of data models, pipelines, and processes, and share knowledge to foster team growth and best practices.. . . . Snowflake:.  Expertise in Snowflake data warehousing platform, including schema design, performance tuning, and leveraging Snowflake’s unique features such as micro-partitioning, zero-copy cloning, and time travel to optimize data storage and retrieval.. . . Amazon Redshift:.  Strong experience with Amazon Redshift, including understanding of its architecture, query optimization, and migration challenges when transitioning to Snowflake.. . . Microsoft SQL Server:.  Proficiency in Microsoft SQL Server for managing legacy datamarts, writing complex SQL queries, stored procedures, and understanding relational database concepts.. . . SQL:.  Advanced SQL skills for data querying, transformation, and troubleshooting across multiple database platforms.. . . Data Modeling:.  Ability to design normalized and denormalized data models that support efficient analytics and reporting, tailored specifically for cloud data warehouses like Snowflake.. . . Orchestration (e.g., Apache Airflow):.  Experience designing and managing data pipeline orchestration workflows to automate and monitor ETL/ELT processes, ensuring reliability and scalability.. . . ETL/ELT:.  Deep understanding of ETL and ELT methodologies, with hands-on experience in redesigning and optimizing data ingestion and transformation jobs to improve performance and maintainability.. . . Data Integration - Ingestion, Transformation, Orchestration:.  Proven track record in integrating diverse data sources, transforming raw data into usable formats, and orchestrating complex data workflows.. . . Data Quality & Integrity:.  Strong focus on implementing data validation, error handling, and monitoring mechanisms to maintain high data quality and integrity throughout the data lifecycle.. . . CI/CD & Agile Practices:.  Experience applying CI/CD pipelines to data engineering projects, using tools such as Jenkins, Bitbucket, or similar, and working effectively within Agile teams to deliver incremental value.. . . Problem Solving & Collaboration:.  Excellent analytical and problem-solving skills combined with the ability to collaborate effectively with engineers, analysts, and business stakeholders to achieve shared goals.. . Nice to Have. . Programming languages such as Python or Java for scripting and automation.. . Cloud platforms like Amazon S3 and Amazon EC2 to support data storage and compute resources.. . DevOps tools such as Jira, Jenkins, and Terraform to enhance pipeline automation and infrastructure management.. . . Experience with other databases like Oracle or MySQL to broaden data integration capabilities.. . Knowledge of Agile frameworks and best practices beyond basic familiarity.. . . This role offers a unique opportunity to shape the future of our data infrastructure by leveraging cutting-edge cloud data technologies and best practices. If you are a motivated Senior Data Engineer passionate about data migration, pipeline optimization, and delivering scalable data solutions, we encourage you to apply and join our innovative team.. . Company Location: Brazil.