Analytics & Intelligence

Sr. Data Engineer – Databricks



Apply Now

<< Return to Search Results

Sr. Data Engineer

Contract to Hire

100% Remote


About the role:

The Lead Data Engineer will support the design, development, and maintenance of data sourcing, ingestion, and transformation solutions that will be utilized in reporting & analytics, data science, and other consuming applications. This position will collaborate with IT team members and business stakeholders to identify required data sourcing to serve the business needs. You will support the ingestion and transformation pipelines in addition to contribute to the design of the data warehouse. This role is customer-focused and fast-paced, with a goal to empower the business users with a state-of-the-art platform to rapidly gain insights through data.


Primary Directives:

·        Develop technical data solutions for long-term growth.

·        Collaborate with software engineers to design and develop solutions that meet the business requirements.

·        Design, develop, implement, test, deploy, monitor, and maintain the delivery of data in a systematic method.

·        Ensure successful delivery of data and information in support of the organization’s reporting & analytics.

·        Create data migrations, processes, and designs that support data analysis and reporting.

·        Control high-volume production environments while maintaining compliant databases and application servers.

·        Perform data analysis and profiling of raw data sources.

·        Provide guidance and direction to support/development resources.

·        Communicate with other BI and IT team members to support and coordinate activities.

·        Assist with project identification and effort estimates for ETL development of new data sources.

·        Provide guidance, direction, and requirements to develop a platform that will render a blueprint, template, and guardrails to engineers and data analytics teams to get started quickly.

·        Design automation of pipelines and other data projects to establish a mechanism for proactive fault detection and mitigation.

·        Evaluate new tools, new techniques, and strategies for delivering high quality data to users.

·        Initiate documentation, knowledge-sharing, and creating of operating procedures.

·        Assist with training end users on acquiring necessary data.

Skillset Required:

·        5+ years of experience in the design and development of data pipelines, data marts, and data warehouses.

·        Excellent analytical and problem-solving ability with strong attention to detail and accuracy.

·        Excellent understanding of data warehousing concepts and dimensional data modeling.

·        Hands-on experience with troubleshooting performance issues and fine-tuning queries.

·        Strong ability to handle multiple tasks and adapt to evolving business and technical environments.

·        Self-starter with the ability to work independently, take initiative, and learn new skills.

·        Excellent written and oral communication skills, with the ability to articulate complex processes to individuals of varying technical abilities.

·        Firm knowledge of data engineering tools including version control systems using Git, Bitbucket, SVN, or Team Foundation.

·        Proficient in the programming languages: Python or PySpark, and SQL.  Expect to write code.

·        Experience in Microsoft SQL Server, SSIS, AWS Data Pipeline, DBT and Databricks.

·        Bachelor’s Degree in computer science or equivalent experience required.

Sr. Data Engineer – Databricks Chicago, IL

Brooksource is an equal opportunity employer that does not discriminate on the basis of actual or perceived race, color, creed, religion, national origin, ancestry, citizenship status, age, sex or gender (including pregnancy, childbirth, lactation and related medical conditions), gender identity or gender expression, sexual orientation, marital status, military service and veteran status, physical or mental disability, protected medical condition as defined by applicable state or local law, genetic information, or any other characteristic protected by applicable federal, state, or local laws and ordinances.

Benefits & Perks:

Eight Eleven Group offers competitive medical, dental, vision, Health Savings Account, Dependent Care FSA, and supplemental coverage with plans that can fit each employee’s needs. We offer a 401k plan that includes a company match and is fully vested after you become eligible, paid time off, sick time, and paid company holidays. We also offer an Employee Assistance Program (EAP) that provides services like virtual counseling, financial services, legal services, life coaching, etc.

Pay Disclaimer:

The pay range for this job level is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law.


Apply Now

Tagged as: Yes