Data Engineer - Data Quality
Share People Hub in partnership with ABI Growth Group | ABInBev, is searching for a Data Engineer - Data Quality (hybrid model).
About us
We are part of ABInBev’s ecosystem, the largest brewer in the world, and we work to help our costumer’s life using Zé Delivery, Ta Da and BEES Applications. As a tech cell of our organization, we have a simple goal: to grow. Grow as people, as professionals, as a company.To achieve it, we use technology to create digital solutions that make our costumers lives simpler, their decisions smarter and their businesses more profitable.
About ABI Growth Group
Created in 2022, the Growth Group unifies our business-to-business (B2B), direct-to-consumer (DTC), Sales & Distribution, and Marketing teams. By bringing together global tech and commercial functions, the Growth Group allows us to fully leverage data and drive digital transformation and organic growth for AB InBev around the world.
In addition to supporting well known global beer brands like Corona, Budweiser and Michelob Ultra, the Growth Group is home to a robust suite of digital products including our B2B digital commerce platform BEES, on-demand delivery services Ze Delivery and TaDa Delivery, and table top beer keg PerfectDraft.
About the role
We are looking for a talented and detail-oriented Data Engineer to join our team to focus on developing and optimizing data quality measurement tools and library formats. The successful candidate will play a critical role in ensuring the accuracy, reliability, and integrity of our data assets by building and maintaining sophisticated tools and libraries for data quality assessment.
What you'll do:
- Tool Development: Design, develop, and maintain data quality measurement tools that automate the process of assessing and improving data quality across various data sources and systems.
- Library Creation: Build and manage reusable libraries and frameworks for data quality checks, validations, and metrics that can be integrated across different data pipelines and platforms.
- Data Quality Metrics: Implement data quality metrics and standards, including accuracy, completeness, consistency, timeliness, and uniqueness.
- Integration: Collaborate with data engineers, data scientists, and analysts to integrate data quality tools and libraries into existing data workflows and pipelines.
- Performance Monitoring: Monitor the performance of data quality tools and libraries, ensuring they meet the required performance benchmarks and handle data volumes efficiently.
- Documentation: Create and maintain comprehensive documentation for data quality tools, libraries, and processes to support user training and future development.
- Troubleshooting: Identify and resolve issues related to data quality measurement tools, including debugging and optimizing code and processes.
- Best Practices: Establish and promote best practices for data quality management and measurement within the organization.
What you'll need:
- Education: Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field. Master’s degree preferred.
- Experience: Proven experience as a Data Engineer or in a similar role with a focus on data quality management, tool development, or library creation.
- Proficiency in SQL and experience with relational databases (e.g., MySQL, PostgreSQL, SQL Server).
- Strong programming skills in Python, with experience using PySpark for data processing.
- Hands-on experience with Databricks for managing and running big data workloads.
- Experience with data quality frameworks, tools, and techniques (e.g., Apache Griffin, Great Expectations).
- Familiarity with big data technologies (e.g., Hadoop, Spark) and data warehousing solutions.
- Knowledge of cloud platforms (e.g. Azure) and their data services.
- Excellent problem-solving skills and attention to detail.
- Strong communication skills and the ability to work collaboratively with cross-functional teams.
- Ability to manage multiple tasks and projects effectively.
Preferred Qualifications:
- Experience with data quality assessment methodologies and metrics.
- Familiarity with data governance and data privacy regulations.
- Experience with real-time data processing and streaming technologies.
- Knowledge of data visualization tools (e.g., Tableau, Power BI) for presenting data quality metrics.
What We Offer:
- Performance based bonus*
- Attendance Bonus*
- Private pension plan
- Meal Allowance
- Casual office and dress code
- Days off*
- Health, dental, and life insurance
- Medicines discounts
- Wellhub partnership
- Childcare subsidies
- Discounts on Ambev products*
- Clube Ben partnership
- Scholarship*
- School materials assurance
- Language and training platforms
- Transport allowance
- Rules applied
Equal Opportunity & Affirmative Action:
ABI Growth Group is proud to be an Equal Opportunity and Affirmative Action employer. We do not discriminate based upon of race, color, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other applicable legally protected characteristics.