Senior Integration Developer / Data Engineer
2024-08-16
Portugal
Keyrus Portugal
Empowered by our motto, "Making Data Matter", Keyrus stands at the forefront of global consultancy in Data & Analytics, AI & Machine Learning, and Digital Transformation. With a presence in 27 countries across 4 continents, we're on a mission to elevate the impact of data.We are data experts, guiding our clients through their data journey regardless of their level of maturity in analytics. As an end-to-end partner, we address varied challenges that our clients face, from Advanced Analytics, Cloud, Data Governance, Visualisation to Enterprise Performance Management, from advisory to delivery. With more than 3200 employees in all corners of the world, Keyrus is dedicated to helping businesses taking advantage of the Data and Digital paradigm to enhance their performance, facilitating, and accelerating their transformation, and generating new drivers of growth, competitiveness, and sustainability.Job Summary Keyrus is looking for a highly skilled Senior Integration Developer / Data Engineer to join our team and play a pivotal role in designing, developing, and maintaining robust data pipelines. You will be responsible for ensuring the efficient and accurate movement of data from various sources into our data platform. Your expertise in data integration technologies and cloud platforms will be instrumental in delivering high-quality data solutions. We value individuals who are detail-oriented, independent contributors with exceptional communication and problem-solving skills, ensuring that together, we continue to transform possibilities into reality. Note: All applications/CV’s must be submitted in English.Key Responsibilities
Design, develop, and implement efficient and scalable data pipelines to extract, transform, and load data into the target data platform
Conduct thorough testing and validation of data pipelines to ensure data accuracy, completeness, and consistency
Troubleshoot and resolve data integration issues in a timely manner
Optimize data pipelines for performance and cost-effectiveness
Collaborate with data analysts and data scientists to understand data requirements and translate them into technical specifications
Adhere to data quality standards and best practices
Mentor and guide junior team members in data integration techniques
Conduct data profiling to understand the completeness, accuracy, integrity, and validity of the data
Document data integrations clearly, including technical specifications and development assumptions
Requirements for the role
Solid experience in data integration, data warehousing, data modelling, data ingestion, data cleansing and data profiling
Strong proficiency in Python or other scripting languages
Proven expertise in data integration development within the Oracle Cloud Infrastructure (OCI) ecosystem/Oracle Cloud data platforms, databases, data lakes, and data warehouses
Skilled in utilizing OCI Data Integration services (ODI and DataFlow), and other tools such as Apigee, Managed File Transfers, Kafka, PySpark, Apache Spark
Familiarity with leveraging OCI's PaaS and SaaS offerings, including Object Store and Autonomous Database
Proven ability to design and implement complex data pipelines
Strong problem-solving and analytical skills
Fluent in English
Must be a Portuguese or European citizen or have a work permit for Portugal
Preferred Skills and Experience
Experience with data governance and metadata management tools (Alation)
Knowledge of data quality tools (Experian)
Understanding of cloud-native technologies and DevOps practices
Cross-cultural environment experience
What we offer at Keyrus Portugal
Competitive salary based on your skills & experience and according to the Data market practice
Meal allowance of €8.32 per day
Flexible benefits option
Private Medical Insurance
22 days of annual leave (increasing every 3 years up to a maximum of 25 days)
Training Program through KLX (Keyrus Learning Experience) Platform
Why Keyrus?Joining Keyrus means joining a market leader in the Data Intelligence field and an (inter)national player in Management Consultancy and Digital Experience.Keyrus Portugal operates on five guiding pillars that shape our approach to work and collaboration – Diversity; Trust; Flexibility; Ownership & Innovation - we're dedicated to cultivating a team as diverse as the challenges we take on. We embrace and celebrate the rich variety of backgrounds, perspectives, and talents that each individual brings. We firmly believe that diversity fuels innovation, ignites creativity, and propels us towards greatness. Regardless of race, ethnicity, gender, sexual orientation, disability, age, or any other dimension of diversity, everyone is not only welcome but valued here. Join us in shaping a future where everyone can thrive!
Design, develop, and implement efficient and scalable data pipelines to extract, transform, and load data into the target data platform
Conduct thorough testing and validation of data pipelines to ensure data accuracy, completeness, and consistency
Troubleshoot and resolve data integration issues in a timely manner
Optimize data pipelines for performance and cost-effectiveness
Collaborate with data analysts and data scientists to understand data requirements and translate them into technical specifications
Adhere to data quality standards and best practices
Mentor and guide junior team members in data integration techniques
Conduct data profiling to understand the completeness, accuracy, integrity, and validity of the data
Document data integrations clearly, including technical specifications and development assumptions
Requirements for the role
Solid experience in data integration, data warehousing, data modelling, data ingestion, data cleansing and data profiling
Strong proficiency in Python or other scripting languages
Proven expertise in data integration development within the Oracle Cloud Infrastructure (OCI) ecosystem/Oracle Cloud data platforms, databases, data lakes, and data warehouses
Skilled in utilizing OCI Data Integration services (ODI and DataFlow), and other tools such as Apigee, Managed File Transfers, Kafka, PySpark, Apache Spark
Familiarity with leveraging OCI's PaaS and SaaS offerings, including Object Store and Autonomous Database
Proven ability to design and implement complex data pipelines
Strong problem-solving and analytical skills
Fluent in English
Must be a Portuguese or European citizen or have a work permit for Portugal
Preferred Skills and Experience
Experience with data governance and metadata management tools (Alation)
Knowledge of data quality tools (Experian)
Understanding of cloud-native technologies and DevOps practices
Cross-cultural environment experience
What we offer at Keyrus Portugal
Competitive salary based on your skills & experience and according to the Data market practice
Meal allowance of €8.32 per day
Flexible benefits option
Private Medical Insurance
22 days of annual leave (increasing every 3 years up to a maximum of 25 days)
Training Program through KLX (Keyrus Learning Experience) Platform
Why Keyrus?Joining Keyrus means joining a market leader in the Data Intelligence field and an (inter)national player in Management Consultancy and Digital Experience.Keyrus Portugal operates on five guiding pillars that shape our approach to work and collaboration – Diversity; Trust; Flexibility; Ownership & Innovation - we're dedicated to cultivating a team as diverse as the challenges we take on. We embrace and celebrate the rich variety of backgrounds, perspectives, and talents that each individual brings. We firmly believe that diversity fuels innovation, ignites creativity, and propels us towards greatness. Regardless of race, ethnicity, gender, sexual orientation, disability, age, or any other dimension of diversity, everyone is not only welcome but valued here. Join us in shaping a future where everyone can thrive!