SQL Developer with ETL Experience

SQL Server Developer With 10 Years Experiences

Job Title: SQL Developer with ETL experience

Location: Coimbatore

Position Overview: We are looking for an experienced ETL Developer to join our team. The ideal candidate will have a minimum of 6 years of hands-on experience in SQL development with exposure to ETL process for 3 years (latest) and ETL tools for migrating the data from one system to another. Developer will be responsible for designing, implementing ETL pipelines and designing, developing, and maintaining complex SQL queries and procedures to support critical business applications. Additionally, the candidate shall have experience in database architecture and be capable of providing technical leadership in optimizing SQL code for maximum performance.

Key Responsibilities

ï· Data Management and Storage:

• Design and implement data storage solutions using Azure services like Azure SQL Database, Azure Data Lake Storage, and some experience of Azure Cosmos DB.
• Ensure data storage systems are scalable, performant, and cost-effective.
• Perform database performance tuning and optimization, including query optimization, index tuning, and database configuration would be an advantage
• Write Unit Tests for database objects like stored procedures.
  
  

Ï· Data Integration And ETL

• Develop and manage ETL (Extract, Transform, Load) processes using Azure Data Factory to integrate data from various sources.
• Ensure data is efficiently cleaned, transformed, and loaded into data warehouses or data lakes.
• Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, writing applications and good knowledge of Entity Framework)
• Primarily use the skills above to perform multiple data migrations from existing operational systems, or data extracts, into our live multi-tenanted system, to tight deadlines with minimal operational downtime.
• Investigating data to anticipate any pipeline issues.
  
  

Ï· Big Data And Analytics

• Utilize big data technologies such as Azure Databricks and Apache Spark for data processing and analytics.
• Create data processing workflows and pipelines to support data analytics and machine learning applications.
• Use Power BI and Embedded Power BI to visualise the data and create insights to effect Operational process improvements.
  
  

Ï· Data Security And Governance

• Implement data security measures and ensure compliance with data governance policies.
• Monitor and optimise data storage and processing solutions for security and performance.
  
  

Ï· Collaboration And Troubleshooting

• Work closely with data developers, migration experts, data scientists, analysts, and other stakeholders to understand data requirements and create effective data workflows and database schemas.
• Identify and troubleshoot operational and data quality issues and assist our development and support teams in identifying and rectifying production data issues
  
  

Ï· Collaboration & Upskilling

• Stay abreast of emerging trends and technologies.
• Document database design, schema, and procedures
  
  

Requirements

ï· Minimum of 3 years of hands-on experience in Azure services like Azure SQL Database, Azure Data Lake Storage, and some experience of Azure Cosmos DB.

ï· Expert level proficiency in ETL process and tools like SSIS or ADF.

ï· Experience with data assessments, mapping data between data structures and matching data to new data structures, data modelling & data quality management.

ï· Experience with effective resource management, risk identification and management, and progress monitoring.

ï· Expert-level proficiency in SQL programming and database concepts.

ï· Experience in performance tuning and optimization techniques.

ï· Strong analytical and problem-solving skills.

ï· Experience in database projects and DACPAC.

ï· Experience with TsqlT Unit Tests or database unit test concept.

ï· Ability to work independently and in a team environment.

ï· Experience in powerbi report creation is added advantage.

ï· Familiarity with database management systems such as MySQL, PostgreSQL is a plus.

ï· Familiarity with azure service like cosmos db, synaps analytical service is a plus.

ï· Experience with Azure data services including Azure Data Factory, Azure Synapse Analytics, Azure Stream Analytics, and Azure Event Hubs

ï· Strong understanding of data architecture patterns and parallel processing

Certifications

Microsoft Certified: Azure Data Engineer Associate: This certification demonstrates expertise in integrating, transforming, and consolidating data from various structured, unstructured, and streaming data systems.