Posted 1 day ago
Job id: a1Wcv000000RO6HEAW
Data Engineer 3 – DENG3
Birmingham, Alabama
Electrical & Mechanical Engineering
Contract
Brooksource
$0-$60/hr
-k
Share This Job
Job Description:
Data Engineer III
On-Site Role
Compensation: $50
ABOUT THE ROLE
Our Client is seeking an experienced Data Engineer to design, develop, and support robust data engineering and analytics solutions. In this role, you will leverage your 5-10 years of experience manipulating data in a software engineering capacity to work with both relational and NoSQL systems, as well as data lakes. You will be responsible for normalizing databases, constructing analyzable datasets, and integrating raw data from multiple sources into consistent, machine-readable formats that support company requirements. The ideal candidate will possess deep knowledge of SQL, data modeling, and big data tools such as Spark, Hive, Airflow, and Databricks, with hands-on experience in both batch and real-time data processing. You will also work with data quality tools, data storage techniques, and develop solutions using on-premises (MSBI, Informatica, Oracle, SQL Server) and Microsoft cloud-based tools (Azure Data Lake, Data Factory, Databricks, Synapse, Power BI). Additional skills in containerization (Docker, OpenShift), Agile and DevOps methodologies, and developing data solutions using APIs and web services are highly valued. Experience with statistical models and AI/ML solutions using R or Python is also desirable.
WHAT YOU'LL DO
- Design, develop, test, deploy, and support data engineering and analytics solutions using both on-premises and cloud-based tools.
- Manipulate and normalize data across relational, NoSQL, and data lake environments to meet application and business requirements.
- Construct, combine, and transform raw data from multiple sources into consistent, machine-readable, and analysis-ready datasets.
- Develop and maintain Databricks pipelines for diverse data sources, ensuring efficient data integration and processing.
- Work with batch and real-time data processing frameworks to support various business needs.
- Implement and optimize data models, schemas, and storage techniques for a variety of data sources and structures.
- Utilize big data technologies such as Hadoop, Hive, and Spark to build scalable data engineering solutions.
- Develop and support statistical models and AI/ML solutions using R and/or Python.
- Create functional and technical designs for data engineering and analytics projects, ensuring alignment with business objectives.
- Ensure data quality and integrity using appropriate tools and methodologies.
- Apply containerization (Docker, OpenShift), Agile, DevOps, and CI/CD practices in solution development and deployment.
- Design and develop data sourcing, enrichment, and delivery solutions using APIs and web services.
WHAT YOU BRING
- 5-10 years of experience manipulating data in a software engineering capacity.
- Expertise with relational, NoSQL systems, and data lakes.
- Proficiency in database normalization and data structure design to meet application requirements.
- Ability to construct and combine datasets from multiple sources into machine-readable formats.
- Deep knowledge of SQL, data modeling, Spark, Hive, and Airflow.
- Experience creating and maintaining Databricks pipelines for diverse data sources.
- Hands-on experience with batch and real-time data processing frameworks.
- Experience with data modeling, data access, schemas, and storage techniques.
- Familiarity with data quality tools and methodologies.
- Experience creating functional and technical designs for data engineering and analytics solutions.
- Experience implementing data models with various schemas and data source types.
- Hands-on experience with big data technologies (Hadoop, Hive, Spark).
- Experience developing and supporting statistical models, R, and/or Python-based AI/ML solutions.
- 5+ years designing, developing, testing, deploying, and supporting data engineering solutions using on-premises tools (MSBI, Informatica, Oracle GoldenGate, SQL, Oracle, SQL Server).
- 3+ years designing, developing, testing, deploying, and supporting data engineering solutions using Microsoft cloud tools (Azure Data Lake, Data Factory, Databricks, Python, Synapse, Key Vault, Power BI).
- Experience with containerization (Docker, OpenShift, etc.).
- Experience with Agile, DevOps, and CI/CD methodologies.
- Hands-on experience with data sourcing, enrichment, and delivery using APIs and Web Services.
Disclaimer: Brooksource, Medasource, and Calculated Hire are part of the Eight Eleven Group family of companies and operate under Eight Eleven Group, LLC. All employees receive the same benefits, policies, and terms of employment.
EEO:
We are committed to creating an inclusive environment for all employees and applicants. We do not discriminate on the basis of race, color, religion, creed, sex, sexual orientation, gender identity or expression, national origin, ancestry, age, disability, genetic information, marital status, military or veteran status, citizenship, pregnancy (including childbirth, lactation, and related conditions), or any other protected status in accordance with applicable federal, state, and local laws.
Benefits & Perks:
Eight Eleven Group offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.
Pay Disclaimer:
The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.
Share This Job
Apply For This Job
Related Jobs
Posted 4 days ago
Cybersecurity Program ManagerContract
San Diego, Alabama
Physical Location
$80-$90/hr
-k
Posted 2 months ago
Substation Physical Designer Consultant – SPDCContract
Birmingham, Alabama
-$80/hr
-k
About Us
Your need for talent is our reason for being. This driving mission has been at our core from the onset. When we started in 2000 at 811 Broad Ripple Avenue, we were a team of forward-thinking entrepreneurs determined to find a better way to connect the best and brightest talent with companies looking for future leaders. We still believe in this philosophy. Throughout the years, our passion, credibility, and grit have been the foundation and prowess of what is now Eight Eleven. Though our focus areas have continued to mindfully evolve, our unyielding commitment to relationships and our customers’ needs remain consistent and firmly rooted in our core values.