Middle Data Engineer

#middle #dataengineer
Middle Data Engineer — Databricks / PySpark / Data Vault

We are looking for a Senior Data Engineer with strong Databricks, PySpark, and data modelling experience to join an enterprise data platform team building a Lakehouse that powers a web app, LLM agents, and ML models.

Company: Data Smart Solutions LLC
Role: Middle Data Engineer
Salary: $600 – $800 (Net) + performance-based bonus
Format: Remote

Core Requirements

- Strong experience with Databricks and Lakehouse medallion architecture (bronze / silver / gold)
- Advanced PySpark skills for building transformations in notebooks
- Hands-on experience with Delta Lake
- Experience with Data Vault modelling (hubs, links, satellites)
- Experience with dimensional modelling (facts and dimensions)
- Experience ingesting data with Fivetran and custom API integrations
- Experience working with Oracle SQL databases as source systems
- Spark performance tuning, including skew handling and Liquid Clustering
- Experience deploying with Databricks Asset Bundles (DABs)
- Experience with Unity Catalog, group-based RBAC, and PII masking

Nice to Have

- Experience with Great Expectations or similar data quality frameworks
- Experience handling unstructured files in Blob storage
- Experience supporting LLM / agent and ML use cases with curated data

What You'll Work On

- Building and maintaining a Databricks Lakehouse on a medallion architecture
- Ingesting data from Oracle systems and APIs into the bronze layer
- Modelling the silver layer with Data Vault and the gold layer with dimensional models
- Optimising Spark performance and Delta table layouts
- Implementing governance, access control, and PII masking in Unity Catalog
- Replacing manual scheduling processes and spreadsheets with a unified data platform
- Collaborating with the application team that builds on top of the gold layer for the web app, LLMs, and ML models

контакт скрыт

For questions/inquiries: @hr_uzbot


👉 контакт скрыт