Data Engineer (Python/Databricks) Contractor at Huckberry

We are redirecting you to the source. If you are not redirected in 3 seconds, please click here.

Data Engineer (Python/Databricks) Contractor at Huckberry. We are seeking an experienced and self-motivated Data Engineer to join our data team on a contract basis. This is a fantastic opportunity for a skilled engineer to make a significant impact on our core business operations, with the potential for future projects based on performance.. Project Objective 🎯. The primary goal is to enhance and optimize a critical data pipeline that connects our data warehouse in Google BigQuery with our operational hub in Airtable. This pipeline is essential for automating the creation of Purchase Orders in NetSuite and tracking their status, and your work will directly improve the efficiency and reliability of this process.. Responsibilities. Design, develop, and deploy robust enhancements to the existing Python-based batch ETL scripts.. Utilize Databricks to build, orchestrate, and schedule the data integration workflows.. Work extensively with the APIs of BigQuery and Airtable to ensure seamless and efficient data transfer.. Implement comprehensive error handling, logging, and monitoring to ensure pipeline reliability.. Collaborate with our data team to understand business requirements and translate them into technical solutions.. Provide clear documentation for the updated pipeline and workflows.. Proven experience as a Data Engineer, ETL Developer, or in a similar role.. Strong proficiency in Python, specifically for data manipulation and batch processing.. Hands-on experience developing and managing data pipelines using Databricks.. Demonstrated expertise in working with RESTful APIs for system integration.. Solid experience with cloud data warehouses, particularly Google BigQuery.. A big plus: A baseline understanding of Airtable or the ability to showcase a past project with a similar integration architecture (e.g., connecting a data warehouse to a business application via APIs).. Excellent problem-solving skills and the ability to work independently.. Company Location: Brazil.