Data Engineer
Job Description
Expertise in designing and implementing logical and physical data models for cloud and hybrid data warehouse environments Implementing data architectures to support a variety of data formats and structures including structured, semi-structured and unstructured data Experience with multiple full life-cycle data warehouse implementations Understanding of data architectures required to support data integration processing Experience with data modeling technologies such as ER/Studio, ER/Win or similar Experience with Microsoft Azure Data Platform services including Azure Data Lake Store, Azure Storage, Azure Synapse, Azure Data Factory, Azure SQL database, Logic Apps, APIs Demonstrated ability to quickly learn, adopt and apply new technologies Data profiling and creation of source to target mappings Ability to provision and configure Azure data service resources
Qualification
Microsoft Azure Cosmos DB, Data Flows, Express Route, Azure Active Directory Experience creating strategies to migrate customers from on-premise environments to Azure Power BI and semantic modeling AWS Glue & Azure Data FactoryAWS S3 & Azure BlobAWS Athena & Azure DatabricksAWS Redshift & Azure SynapseAWS ECS & Azure AKS
Detailed Required Skills:
Python & SQL ScriptingSQL, PySparkGeneral Cloud Architecture competency skillset - Capable of taking requirements and is build out data pipelinesAPI Knowledge is required, but preference given to candidates who can create APIs
About The IT Outsourcing Company
The company offers IT operations management services to offshore clients.