Posted 2 days ago
Job id: a1Wcv0000005XBREA2
Senior Spark Architect
Birmingham, Alabama
Cloud Journey
Contract
Brooksource
-/hr
-k
Share This Job
Job Description:
Senior Spark Architect/Engineer
Remote
6-month Contract
Our client is seeking a highly skilled Senior Spark Architect/Engineer for a remote, 6-month contract to lead the design, development, and deployment of scalable data solutions within an AWS cloud environment. This hands-on role blends architecture, engineering, and leadership to drive innovation in big data processing. The successful candidate will architect and implement robust Spark-based data pipelines, automate ETL processes, and drive data migration and transformation initiatives with precision and efficiency. You will also mentor and train internal team members—who are new to Spark—to ensure they can confidently support and maintain Spark-based systems after the engagement concludes. If you are passionate about building high-performance data systems, enjoy coaching others, and thrive in a fast-paced environment, we’d love to hear from you!
MINIMUM QUALIFICATIONS
- 7+ years of experience in data engineering or architecture roles
- Deep expertise in Apache Spark (Spark SQL, PySpark, Structured Streaming) and Kafka
- Proficiency in SQL, Python, Java, REST APIs, and Linux/RHEL 8
- Hands-on experience with AWS EMR, Delta Tables, and hybrid cloud architectures
- Experience with Kubernetes or similar frameworks for managing Spark clusters
- Strong interpersonal skills with the ability to communicate complex technical concepts to both technical and non-technical stakeholders
- Proven success in mentoring and coaching technical teams
PREFERRED QUALIFICATIONS
- Familiarity with HL7 FHIR specifications
- Experience with serverless architectures
- Exposure to machine learning APIs and performance tuning of Spark jobs
RESPONSIBILITIES
- Architect, develop, test, and deploy scalable data lake/warehouse solutions using modern development tools in AWS cloud infrastructure
- Design and implement robust data ingestion pipelines for high-volume datasets
- Lead data migration and transformation initiatives with precision and efficiency
- Automate end-to-end ETL processes for diverse datasets within the big data ecosystem
- Collaborate with Business Analysts, Architects, and Senior Developers to define and establish the AWS application framework
- Mentor and train internal team members to ensure long-term sustainability of the Spark-based solution
Disclaimer: Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment.
EEO:
We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws.
Benefits & Perks:
Eight Eleven Group offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.
Pay Disclaimer:
The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.
Share This Job
Apply For This Job
Related Jobs
Posted 1 year ago
Sr. Software EngineerDirect Hire
Birmingham, Alabama
Physical Location
-/hr
-$150,000k
Posted 1 year ago
Bilingual Sales SupportContract to Hire
Hoover, Alabama
Physical Location
-/hr
-$34,000k
Posted 1 year ago
Bilingual Sales SupportContract to Hire
Hoover, Alabama
Physical Location
-/hr
-k
About Us
Your need for talent is our reason for being. This driving mission has been at our core from the onset. When we started in 2000 at 811 Broad Ripple Avenue, we were a team of forward-thinking entrepreneurs determined to find a better way to connect the best and brightest talent with companies looking for future leaders. We still believe in this philosophy. Throughout the years, our passion, credibility, and grit have been the foundation and prowess of what is now Eight Eleven. Though our focus areas have continued to mindfully evolve, our unyielding commitment to relationships and our customers’ needs remain consistent and firmly rooted in our core values.