Cloud Data Engineer – Consultant - SOSC

Job Title: Cloud Data Engineer – Consultant
Location: Columbia, SC
Duration: 12 Months
Pay Rate: $75 – $80/hour

Candidate must be a CURRENT South Carolina resident. No relocation allowed.

Scope of the Project:
Seeking a Cloud Data Engineer to support enterprise data initiatives, focusing on developing and optimizing cloud-based data pipelines and architectures supporting advanced analytics and reporting.

Daily Duties / Responsibilities:

• Design, build, and maintain data pipelines and ETL processes in AWS or Azure environments.
• Implement data ingestion and transformation frameworks using Python, SQL, and cloud-native services.
• Collaborate with business analysts and data scientists to ensure data pipelines support analytical needs.
• Monitor pipeline performance and troubleshoot system inefficiencies.
• Document data architectures, processes, and best practices.
• Ensure data security and compliance standards are met.

Required Skills:

• 3+ years of hands-on experience with Python, SQL, and cloud data engineering.
• Experience with AWS Glue, Lambda, Redshift, or Azure Data Factory and Synapse.
• Strong understanding of ETL development, pipeline optimization, and data architecture.
• Proficient in data modeling and data governance practices.
• Familiarity with data warehousing platforms such as Snowflake or Amazon Redshift.

Preferred Skills:

• AWS or Azure certifications.
• Experience working with healthcare data or Medicaid systems.