Azure Data Engineer
Azure Data Engineer - Above position is expected to implement Data Orchestration -Data Transformation and Data integration using MS Azure services.
- Data Extraction, Transformation, Loading are main responsibilities considering enterprise data management for data lakes and data warehouses.
- MS Azure Data Engineer (MS Certified) is preferred.
Responsibilities - Implement Azure Cloud data warehouses, Azure and No-SQL databases and hybrid data scenarios
- Manage Azure DevOps pipelines
- Develop batch processing, streaming and integration solutions
- Automate Azure Data Factory pipelines
- Manage source data access security
- Configure authentication and authorization
- Manage and enforce data policies and standards
- Monitor databases and data processing for a specified scenario
- Implement big data real-time processing and integration solutions
Basic Qualifications .
- Experience: 5 - 7 years in Core Data Engineering.
- Minimum 3 Years in Azure Data Engineering
Knowledge & Skills - Very strong @ SQL-PL SQL-Spark SQL.
- Interaction with No SQL Databases
- Interaction with Event Hub, IoT Hub Databases
- Files Processing - XML, CSV, Excel, Jason, etc. Formats
- Structured and Non-Structured Data processing
- Data ETL Capabilities.
- Knowledge of Distributed Big Data Processing
- Data Warehouse and Data Lake Implementation experience in past.
- Interaction with REST APIs , Web Services
Required Competencies - Customer Focus
- Good verbal & written English communication
- Ability to work with globally diverse teams.
- Readiness to work in flexible work timings.
- Abstract& Analytical Thinking.
- An interpersonal savvy. A very good team player
- Nimble learning. Willingness to explore and adapt
