Azure Data Engineer Job at VTal Technology Solutions, United States

  • VTal Technology Solutions
  • United States

Job Description

Azure Data Engineer

Azure Data Engineer will be responsible for implementing data ingestion and transformation pipelines. We are seeking someone with deep technical skills in a variety of technologies to play an important role in developing and delivering end-to-end production implementation. Performance Team and Damco Distribution, now part of the Maersk global organization under a combined Warehousing & Distribution division, offer third party logistics services to over 500 customers. Encompassing almost 15 million square feet of warehousing capacity throughout the country and a large transportation segment capturing a variety of services, we have key supply chain hubs in the Los Angeles and New Jersey/New York areas, and other facilities along the Western & Eastern coasts along with multiple locations in the Midwest. Delivering significant sales and profitability growth, we will drive the Inland Logistics and Services business for the combined US business units for Maersk.

Key Responsibilities

Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure tools Developing scalable and re-usable frameworks for ingesting of assorted data sets Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained Manage and lead junior data engineers and provide guidance, support and mentor other members of the team as well as do hands-on work Working with event based / streaming technologies to ingest and process data Working with other team members for implementing data pipelines and solutions in production using DevOps for deployment/automation Working with Azure CI/CD pipelines Delivering and presenting technical solutions to business users, technical teams and clients

Qualifications:
  • Strong knowledge of Data Management principles
  • Experience in building ETL / data warehouse transformation processes
  • Direct experience of building data pipelines using one of the following Azure Data Factory, Azure Synapse, Azure Databricks
  • Hands on experience designing and delivering solutions using the Azure Data Analytics platform (Azure AI), Azure Storage, Azure SQL Data Warehouse, Azure Data Lake, Azure Cosmos DB, Azure Stream Analytics
  • Ability to work seamlessly within a team, react quickly to a fast paced, and rapidly changing environment
  • Strong capacity for logical thinking with the ability to understand complex applications
  • 5+ years hands on experience using databases
  • Excellent written and verbal communication skills

Education and Preferred Experience:

  • Bachelor's degree or combination of equivalent education and experience in related fields.
  • 10+ years hands on experience providing solution design with BI systems and BI reports.
  • Experience using geospatial frameworks on Apache Spark and associated design and development patterns
  • Expert or professional level Azure certifications is a plus

Job Tags

Remote work

Similar Jobs

Virtual Vocations Inc

Azure Data Engineer Job at Virtual Vocations Inc

 ...To support a growing data management practice, the remote Azure Data Engineer will design, develop, and maintain scalable data engineering solutions on Azure and Snowflake platforms while building and optimizing ETL/ELT pipelines and collaborating with business stakeholders... 

Jobconversion, LLC

Remote Data Entry & Admin Assistant Flexible Hours Job at Jobconversion, LLC

 ...A nationwide remote company is seeking Data Entry Clerks to work from home. This flexible role requires accurate typing at a minimum speed of 30 words per minute and communication with clients as needed. Competitive pay ranges from $16 to $30 per hour, depending on experience... 

Oracle Corporation

Senior Site Reliability Engineer Job at Oracle Corporation

 .... Youll partner with customer support, service owners, and engineering teams around the globe to ensure high-quality service for customers...  ...posted.Career Level - IC3Escalation points for junior Site Reliability Engineers during complex or high-impact incidents.Manage and... 

DSV

Freight Forwarder Job at DSV

 ...Freight Forwarder Iselin, Nearest Major Market: New Jersey The Freight Forwarder, Air Export is a crucial role in the transportation and logistics industry, specializing in managing the exportation of goods via air transport. This position is responsible for coordinating... 

Globe Life American Income Schreiter Organization

Union Benefits Coordinator Job at Globe Life American Income Schreiter Organization

 ...Entry-Level | No Experience Required Looking for a rewarding career with unlimited growth potential? The Schreiter Agency is expanding...  ...For over 65 years, Schreiter Agency has served as a trusted 100% union label company, partnering with more than 30,000 unions...