Ihire - Washington, DC
posted 2 months ago
Innova Solutions is seeking a Databricks Developer to join our team in Washington, District Of Columbia. This is a permanent, full-time position where the successful candidate will be responsible for addressing real-world, cutting-edge problems to meet both functional and non-functional requirements. The Databricks Developer will work closely with architects and leads to design solutions that align with project goals. This role involves participating in the understanding of architecture and solution design artifacts, as well as proactively implementing engineering methodologies, standards, and leading practices. The developer will also be tasked with identifying, communicating, and mitigating risks, assumptions, issues, and decisions throughout the full lifecycle of projects. The ideal candidate will have a strong background in Databricks and AWS Big Data Architecture, with a solid experience in SQL-based databases. A minimum of two years of experience with Hadoop/Spark in an administrative, development, or support role is required. The candidate should be well-versed in engineering practices such as development, code refactoring, and leveraging design patterns, CI/CD, and building highly scalable data applications and processes. Knowledge of advanced data engineering concepts, including dimensional modeling, ETL, data governance, and data warehousing involving both structured and unstructured data, is essential. Excellent coding skills in either Python or Scala are a must, along with experience in the Data Engineering domain and the implementation of at least two end-to-end projects in Databricks. The role requires familiarity with various Databricks components, including Delta Lake, dbConnect, db API 2.0, and Databricks workflows orchestration. A good understanding of the Databricks Lakehouse concept, Medallion architecture, and its implementation in enterprise environments is also necessary. The candidate should possess the ability to create complex data pipelines and have extensive knowledge of Spark and Hive data processing frameworks. Preferred qualifications include knowledge of Unity catalog, MicroStrategy or Tableau reporting experience, Docker and Kubernetes, and Linux/Unix administration or development skills.