AWS Data Engineer Job at TalentOla, South Dakota

VWUrM3RoZi81cTJJSkRFSlE2dHcyVmJI
  • TalentOla
  • South Dakota

Job Description

Role: AWS Data Engineer

Location: Remote

What is in it for you?

As an AWS Data Engineer, you will be a part of an Agile team to build healthcare applications and implement new features while adhering to the best coding development standards

Responsibilities: -

1. AWS (Amazon Web Services):

  • Core Services: Proficiency with core AWS services like EC2, S3, RDS, Lambda, and VPC.
  • Data Services: Experience with AWS data services Glue and EMR.
  • AWS DMS: Knowledge of AWS Database Migration Service (DMS) for migrating databases to AWS.
  • CDC: Understanding of Change Data Capture (CDC) techniques to capture and replicate changes from source databases to target databases.
  • Security: Understanding of AWS security best practices, IAM, and encryption.

2. Databricks:

  • PySpark & Spark SQL: Strong analytical skills in PySpark & Spark SQL for big data processing and analysis.
  • Delta Live Tables: Expertise in using Delta Live Tables for building reliable and scalable data pipelines.
  • Notebooks: Strong utilization of Databricks Notebooks for data analysis.
  • Workflows : Setting up and monitoring Databricks Workflows.
  • Data Integration: Experience integrating Databricks with AWS services.

3. DevOps Principles:

  • CI/CD Pipelines: CI/CD pipelines using Azure Pipelines.
  • Version Control: Proficiency with Azure Repos and Git for version control.
  • Automation: Scripting and automation using PowerShell, Bash, or Python. Automating the build, test, and deployment processes

4. Infrastructure as Code (IaC):

  • Terraform: Experience with Terraform for managing AWS and Azure infrastructure.

5. On Prem integration with AWS

  • Integrating on prem data with AWS and Databricks.
  • Thoroughly test and validate the data to ensure it has been transferred correctly and is fully functional.

6. Optimization and Monitoring:

  • Optimize AWS services and Databricks for performance and cost-efficiency.
  • Proficiency in setting up monitoring and logging using tools like AWS CloudWatch to track the performance and health of the complete data flow.

Job Tags

Remote work,

Similar Jobs

Domino's Franchise

Pizza Chefs - 620 West New Orleans Job at Domino's Franchise

 ...Level , a locally owned franchise, has proudly served communities across western and eastern Oklahoma with exceptional Dominos pizza and service. With22 stores and growing, we are committed to creating opportunities, delivering smiles, and building a team that feels... 

Teksky

Immigration Paralegal Job at Teksky

 ...work closely with attorneys to support clients throughout their immigration journey. This role is integral to managing casework,...  ...or an associate degree with additional legal experience Paralegal certification preferred Immigration law and customer service... 

Bechtel

2026 University Hire (U.S.) - Human Resources Job at Bechtel

 ...Employee Data Input, Employee Relations, Talent Acquisition, Employee Mobility, and Employment Administration. A summary of a few of these...  ...This position is designated as part-time telework per our global telework policy and may require at least three days of in-person... 

Portland State University, College of Urban and Public Affai...

Biology Adjunct Faculty Pool - Academic Year 2025 - 2026 Job at Portland State University, College of Urban and Public Affai...

 ...opportunity to over 21,000 students from all backgrounds. Our mission to Let Knowledge serve the...  ...Introduction to Plant Biology BI357 General Ecology BI380 Microbiology BI388...  ...to drive a motor vehicle? No Background Check Required Yes Search Details... 

Rocket

Data Engineer Intern - Summer 2026 Job at Rocket

 ...As the Data Engineer Intern, you'll support the design, development, and maintenance of data platforms and solutions under the guidance of senior engineers. You'll work with cross-functional teams to learn best practices in building data integration solutions and services...