Posted today
Job id: a1Wcv0000009g3FEAQ
Data Engineer III
Charlotte, North Carolina
Hybrid
Analytics & Intelligence
Contract
Brooksource
-$68/hr
-k
Share This Job
Job Description:
AWS Data Engineer III
Hybrid role
Compensation: $68
ABOUT THE ROLE
Our client is seeking an experienced AWS Data Engineer III to design, develop, and maintain robust data warehousing solutions on AWS. In this role, you will leverage your deep expertise in AWS services—including S3, EMR, Glue, Lambda, Athena, and Redshift—to build and optimize scalable data pipelines and ensure high data quality. You will collaborate closely with lead developers, data architects, and solution architects to define technical requirements and deliver user-focused solutions that support analytical and business needs. The ideal candidate will have a strong background in Python, Spark, PySpark, and infrastructure as code tools such as Terraform or CloudFormation, as well as a solid understanding of networking, security, and DevOps practices. Your work will be critical in delivering reliable, high-performance data solutions that empower business decision-making.
WHAT YOU'LL DO
- Design, develop, and maintain scalable data pipelines using AWS services (S3, EMR, Glue, Lambda, Athena, etc.)
- Collaborate with lead developers, data architects, and solution architects to define technical requirements, outline technical scope, and lead delivery of technical solutions
- Confirm required developers and skill sets specific to the product and collaborate on key technical decisions
- Implement and optimize data warehousing solutions with a focus on performance, durability, and end-user experience
- Develop and refine ETL processes and workflows using tools such as Python, Spark, PySpark, and Pandas
- Utilize infrastructure as code (Terraform/CloudFormation) for provisioning and managing AWS resources
- Integrate messaging systems (e.g., Kafka, preferably Confluent Kafka) and event-driven architectures into data solutions
- Implement security best practices, including IAM roles, policies, and secrets management (Vault, AWS Secrets Manager)
- Monitor and automate alerts for production systems using AWS monitoring tools (CloudWatch, CloudTrail, CloudWatch Events)
- Participate in DevOps practices, including CI/CD pipeline management (Bitbucket, Concourse)
- Perform hands-on development, peer reviews, and stand up development instances with appropriate security controls and migration paths
- Identify data gaps and deliver automated solutions to enhance analytical capabilities and data enrichment
- Work with RDBMS platforms, write complex SQL queries, and integrate with REST APIs and API gateways
- Apply deep understanding of networking (DNS, TCP/IP, VPN) in cloud data engineering solutions
- Orchestrate workflows using AWS Step Functions or Airflow
- Manage and resolve issues in production data warehouse environments on AWS, ensuring high data quality and reliability
- Design data warehousing solutions with the end-user in mind, ensuring ease of use without compromising on performance
WHAT YOU BRING
- 5+ years of hands-on AWS experience
- Proficiency with AWS services: S3, EMR, Glue Jobs, Lambda, Athena, CloudTrail, SNS, SQS, CloudWatch, Step Functions, QuickSight
- Experience with Kafka/Messaging, preferably Confluent Kafka
- Hands-on experience with EMR databases: Glue Catalog, Lake Formation, Redshift, DynamoDB, Aurora
- Expertise in AWS data warehousing tools such as Amazon Redshift and Amazon Athena
- Proven track record in designing and implementing data warehouse solutions using AWS
- Skilled in data modeling and executing ETL processes for data warehousing
- Competence in developing and refining data pipelines within AWS
- Proficient in real-time and batch data processing
- Strong understanding of database management fundamentals
- Expertise in creating alerts and automated solutions for production issues
- Proficiency in Python, Spark, PySpark, and Pandas
- Experience with Infrastructure as Code: Terraform/CloudFormation
- Experience with Secrets Management platforms like Vault and AWS Secrets Manager
- Experience with Event Driven Architecture
- Familiarity with DevOps pipelines (CI/CD): Bitbucket, Concourse
- Experience with RDBMS platforms and strong SQL skills
- Experience with REST APIs and API Gateway
- Deep knowledge of IAM roles and policies
- Experience using AWS monitoring services: CloudWatch, CloudTrail, CloudWatch Events
- Understanding of networking: DNS, TCP/IP, VPN
- Experience with AWS workflow orchestration tools like Airflow or Step Functions
- Ability to collaborate with cross-functional teams and lead technical solution delivery
- Ability to manage and resolve issues in production data warehouse environments on AWS
- Ability to build new data pipelines, identify data gaps, and provide automated analytical solutions
- Ability to perform hands-on development and peer review for certain components/tech stack on the product
- Experience standing up development instances and migration paths with required security, access, and roles
- Strong communication and collaboration skills
Disclaimer: Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment.
EEO:
We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws.
Benefits & Perks:
Eight Eleven Group offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.
Pay Disclaimer:
The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.
Share This Job
Apply For This Job
Related Jobs
Posted 1 week ago
Software Engineer IVContract
Charlotte, North Carolina
Physical Location
-$79/hr
-k
Posted 2 weeks ago
Mid Revenue Cycle Integrity AnalystContract
Charlotte, North Carolina
Remote
-$23/hr
-k
About Us
Your need for talent is our reason for being. This driving mission has been at our core from the onset. When we started in 2000 at 811 Broad Ripple Avenue, we were a team of forward-thinking entrepreneurs determined to find a better way to connect the best and brightest talent with companies looking for future leaders. We still believe in this philosophy. Throughout the years, our passion, credibility, and grit have been the foundation and prowess of what is now Eight Eleven. Though our focus areas have continued to mindfully evolve, our unyielding commitment to relationships and our customers’ needs remain consistent and firmly rooted in our core values.