Job Id: TL100113
Job Title: Databricks Lead
Location: Houston, TX (Hybrid)
Role: Contract
Duration: 12 Months
About Teckleap:
Teckleap is seeking passionate and innovative technologists to join our dynamic team. In this role, you will collaborate in a fast-paced, inclusive environment, solving complex business problems and driving transformative change for our clients. If you thrive on integrating data with emerging technologies and enjoy working with a team of creators, disruptors, and problem-solvers, this is the perfect opportunity for you. Join Teckleap and help shape the future of technology solutions for our diverse client base.
Role Overview:
Client is seeking an experienced Databricks Lead to drive the design, development, and optimization of big data solutions on the Databricks platform. The ideal candidate will have expertise in Databricks, Apache Spark, Delta Lake, and cloud-based data engineering while working with the teams and collaborating with business stakeholders to build scalable and efficient data pipelines, and analytics solutions.
Key Responsibilities:
- Lead the design and deployment of scalable data pipelines, ETL/ELT workflows, and real-time data streaming solutions in Databricks.
- Develop and automate ETL/ELT pipelines to process structured and unstructured data from multiple sources.
- Work with SQL, Python, Scala, and Spark to implement advanced data transformations.
- Integrate Databricks with cloud platforms (AWS, Azure, GCP), data warehouses (Snowflake, BigQuery, Redshift), and BI tools (Tableau, Power BI).
- Implement real-time data streaming using Kafka, Spark Streaming, and Delta Live Tables.
- Define and enforce best practices for data lineage, metadata management, and quality assurance.
- Implement role-based access control (RBAC) and identity management for secure data access.
- Work with a team of data engineers, architects, and analysts in Databricks development.
- Collaborate with business stakeholders, data scientists, and DevOps teams to align data solutions with business objectives.
- Provide technical guidance, hands-on development, and architecture recommendations.
Basic Qualifications:
- 6+ years of experience in big data engineering, cloud data platforms, and analytics.
- 3+ years of hands-on experience with Databricks, Apache Spark, Delta Lake, and cloud platforms (AWS, Azure, or GCP).
- Strong expertise in Python, Scala, SQL, and Spark for data transformations.
- Experience with ETL/ELT pipelines, data ingestion, and real-time processing.
- Proficiency in data lake architectures, Delta Lake, and Lakehouse principles.
- Hands-on experience with cloud-native services like AWS Glue, Azure Data Factory, Google Dataflow.
- Excellent problem-solving, communication, and stakeholder management skills.
Preferred Qualifications:
- Databricks Certification (Databricks Certified Data Engineer Associate/Professional) (Highly Preferred)
- Experience with Terraform, Kubernetes, and CI/CD pipelines for Databricks automation
- Familiarity with BI tools like Tableau, Power BI, Looker
What We Offer:
- Competitive salary with the industry’s best incentive structure.
- Opportunity to lead and drive cloud-based data transformation initiatives.
- Working hours from 9:00 AM CST to 5:00 PM CST.
- Career growth and development opportunities within a leading IT services and staffing company.
How to Apply:
If you are a motivated professional with a passion for information technology services, we want to hear from you! Send your resume to careers@teckleap.com to join Teckleap on our exciting journey.
Teckleap is hiring!
Stay connected with Teckleap for more opportunities—we’re hiring for multiple positions in application development, testing, operations and project management roles.
Apply today and be part of our success story.