Data Engineer

Job Description:

Job Description: Data Engineer (IT Services)

Experience: 3+ years
Location- Mumbai (Onsite)
Salary: 80k-1 lac per month

Position Overview:
We are looking for an experienced and skilled Data Engineer to join our IT services department. As a Data Engineer, you will be responsible for designing, developing, and maintaining data infrastructure and systems to support our clients' data needs. This position requires a candidate with a minimum of 3+ years of experience in data engineering and a strong background in handling large-scale data processing and analysis. You will play a vital role in ensuring efficient data workflows, optimizing data quality, and enabling data-driven decision-making for our clients.

Responsibilities:
1. Data Infrastructure Development:
- Design, develop, and maintain scalable and efficient data infrastructure, including data pipelines, ETL processes, and data warehouses.
- Collaborate with cross-functional teams, including software engineers, data scientists, and business analysts, to understand data requirements and implement appropriate data solutions.
- Implement and optimize data integration processes to extract, transform, and load data from various sources into the data ecosystem.
- Ensure data security, integrity, and compliance with data governance policies and regulations.

2. Data Modeling and Analysis:
- Design and implement data models and schemas to support efficient data retrieval, analysis, and reporting.
- Develop and optimize data processing algorithms and workflows to handle large volumes of structured and unstructured data.
- Perform data profiling, cleansing, and validation to ensure data quality and accuracy.
- Collaborate with data scientists and analysts to provide insights and support data-driven decision-making.

3. Performance Monitoring and Optimization:
- Monitor and troubleshoot data pipelines, ETL processes, and data infrastructure to ensure optimal performance and minimal downtime.
- Identify and resolve bottlenecks, data inconsistencies, and performance issues in collaboration with the IT operations team.
- Optimize data processing and storage for improved performance and cost efficiency.
- Conduct performance tuning and capacity planning to anticipate future data growth and requirements.

4. Documentation and Collaboration:
- Document data infrastructure design, data models, and processes to ensure clear understanding and knowledge transfer within the team.
- Collaborate with cross-functional teams to gather requirements, provide technical expertise, and contribute to the overall success of data projects.
- Stay up-to-date with emerging trends and technologies in data engineering and propose innovative solutions to improve data capabilities and efficiency.

Qualifications:
- Bachelor's degree in computer science, information technology, or a related field (preferred).
- Minimum of 3+ years of experience as a Data Engineer or in a similar role.
- Strong proficiency in data engineering concepts, data modeling, ETL processes, and data warehousing.
- Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
- Proficiency in programming languages like Python, SQL, and Java.
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Solid understanding of data governance, security, and compliance principles.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.

Interested candidate share CVs on shivi_fr@alliancerecruitmentagency.org / 9258191511

City: Bangalore

State: Karnataka

PostalCode: 560004

Recruiter: Anand Singh - +91 7300775377

Qualifications:

Qualifications:
- Bachelor's degree in computer science, information technology, or a related field (preferred).
- Minimum of 3+ years of experience as a Data Engineer or in a similar role.
- Strong proficiency in data engineering concepts, data modeling, ETL processes, and data warehousing.
- Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
- Proficiency in programming languages like Python, SQL, and Java.
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Solid understanding of data governance, security, and compliance principles.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.

Created Date: 10-07-2023

Desired Skills:

Strong proficiency in data engineering concepts, data modeling, ETL processes, and data warehousing.
- Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
- Proficiency in programming languages like Python, SQL, and Java.
- Familiarity with cloud-based data platforms and services (e.g., AWS, Azure, Google Cloud).
- Solid understanding of data governance, security, and compliance principles.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.

Responsibilities:

1. Data Infrastructure Development:
- Design, develop, and maintain scalable and efficient data infrastructure, including data pipelines, ETL processes, and data warehouses.
- Collaborate with cross-functional teams, including software engineers, data scientists, and business analysts, to understand data requirements and implement appropriate data solutions.
- Implement and optimize data integration processes to extract, transform, and load data from various sources into the data ecosystem.
- Ensure data security, integrity, and compliance with data governance policies and regulations.

2. Data Modeling and Analysis:
- Design and implement data models and schemas to support efficient data retrieval, analysis, and reporting.
- Develop and optimize data processing algorithms and workflows to handle large volumes of structured and unstructured data.
- Perform data profiling, cleansing, and validation to ensure data quality and accuracy.
- Collaborate with data scientists and analysts to provide insights and support data-driven decision-making.

3. Performance Monitoring and Optimization:
- Monitor and troubleshoot data pipelines, ETL processes, and data infrastructure to ensure optimal performance and minimal downtime.
- Identify and resolve bottlenecks, data inconsistencies, and performance issues in collaboration with the IT operations team.
- Optimize data processing and storage for improved performance and cost efficiency.
- Conduct performance tuning and capacity planning to anticipate future data growth and requirements.

4. Documentation and Collaboration:
- Document data infrastructure design, data models, and processes to ensure clear understanding and knowledge transfer within the team.
- Collaborate with cross-functional teams to gather requirements, provide technical expertise, and contribute to the overall success of data projects.
- Stay up-to-date with emerging trends and technologies in data engineering and propose innovative solutions to improve data capabilities and efficiency.

Experience Requirements:Experience: 3+ years