Job Description
Role: Data Engineer Duration: FULL TIME (Accepting H1B Transfer ) Location: Atlanta, GA - On-Site ( Hybrid) Job Description
Data Engineer (ONSITE)- Receive requests from Business and perform architectural assessment and produce detailed data design documents, help translate business requirements to Technical requirements, be a SME for Azure Cloud and Databricks, bring Industry best practices to RT
Technical Skills, tools: - Azure Cloud technologies:
- Must Have: ADLS Gen2, Azure Data Factory, Azure Databricks, Synapse Analytics,Azure DevOps:-Boards, Repos, Pipelines, Test Plans
- Databases:
- Must Have: SQL servers/SQL databases, MongoDB,
- BI Platforms:
- Must Have: Power BI, Power BI Premium,
- Other MS tools:
- Must Have: SSMS, SSIS, Visual Studio
- Advanced Analytics/Data Scientists tools:
- Must Have: Google Analytics, FireBase, RStudio Server, PyCharm
- Programming Languages:
- Must Have: SQL, JavaScript,
- Agile tools:
Work Experience: -
- More than 10+ years of relevant experience in data engineering tools like Spark, Hadoop, Azure Data pipelines , Azure Data factory, Azure Data Lake Storage, Databricks, Delta Lake, Python, SQL Server, and experience with other cloud providers
- Minimum 8 years of experience working in IT department with Data & Analytics responsibilities
- 4+ years of hands-on programming experience (SQL, Python, Scala, Java, etc.,)
- Expertise in creating streaming and batch workflows in Databricks Lakehouse using Pyspark and Spark SQL
- Working experience with development and maintenance of data pipelines on the DataBricks platform in Azure
- xpertise in creating parameterized streaming and batch data processing using Azure Synapse and Azure Data Factory
- Experienced in delivering reporting solutions to stakeholders using tools like Power BI, Databricks SQL, Tableau and SSRS
- Recent 4+ years of experience working as Sr. Data Engineer on Azure Cloud Platforms
Work Experience: (continued) -
- 4+ years of experience working on Data and Analytics projects in support of Marketing/Loyalty/Digital Customer Experience Use Cases
- 2+ years of experience working with Google Analytics
- 1+ years of experience working or at least exposure on any Customer Data Platform (e.g. Microsoft CI, Segment, Tealium, Treasure Data, Informatica, Exponea, SalesForce CDP, etc.,)
- Experience working on Data & Analytics projects using Agile methodologies
- Previous Retail, Convenience Store/Petroleum industry experience a plus
- Previous experience working with Punchh Loyalty platform data is a huge plus
Education: -
- Masters or Bachelor's degree in Computer Science or Information technology with specialization in Data & Analytics, Data Science, Data Engineering or related fields.
- Any one of the generic Cloud Platform certifications (AWS, Azure, GCP, etc.,)
- Any one of the Data & Analytics certifications (Azure Fundamentals AZ-900, DP-200: Implementing an Azure Data Solution, DP-201: Designing an Azure Data Solution, DP-203: Data Engineering on Microsoft Azure, etc.,)
Job Tags
Full time, Work experience placement, H1b