Data Engineer – Databricks

RO
January 24, 2025
Apply Now

Job Description

Industry: Software Development
Seniority for this role: Mid-Senior level
Who are we: mindit.io is an AI-driven custom software services company with +250 IT specialists with proven expertise in software & product engineering, artificial intelligence, business intelligence, data analytics & integration services. With offices in Switzerland, Germany and 4 delivery centers in Romania, we cover the entire development cycle from business research, consulting, and architecture to post-implementation testing and maintenance. Our values: Partner of choice: With a customer-centric approach, we build an environment where partnerships thrive and turn them into long-lasting relations. It’s a space of co-creation, innovation, and top-notch technologies to deliver outstanding custom software development Professional: We always deliver and this is one non-negotiable pillar of our culture. Be it product engineering or custom software development, the quality and ethics of our work are inherent to everything we do Authentic: We value everyone’s uniqueness in the pursuit of framing a culture of equality, diversity, and inclusion. Come as you are and stay true to yourself. We become the best version of ourselves together Team: Trust is our ultimate currency, and we use it to constantly enrich our kind community. When it comes to scaling, the team is our functional cell. We grow together, we learn together, we build together Location and Work Setup: We are looking for candidates based in Bucharest. This role follows a hybrid work model, requiring at least 2 day per week in the office and the flexibility to work remotely for the rest of the week. Responsibilities: Primary Technical Proficiencies: SQL Server Product Suite: Strong expertise in SQL Server Management Studio (SSMS), SQL Server Integration Services (SSIS), SQL Server Analysis Services (SSAS), and SQL Server Reporting Services (SSRS) Microsoft Azure Cloud Resources: Solid experience with Azure Data Factory (ADF), Logic Apps, and CI/CD practices for smooth data and process integration Python and PySpark: Proficient in Python and PySpark for complex data processing and analysis Main Technologies: Azure Databricks and Spark Ecosystem: Strong knowledge of Azure Databricks, Spark, Spark SQL, PySpark, Delta Tables, and Lakehouse architecture Data Integration with Azure Data Factory: Familiarity with data orchestration and transformation pipelines Nice to Have: Data Lake and Lakehouse Architecture: Experience with Azure Data Lake and a foundational understanding of the Lakehouse paradigm is a plus, with an eagerness to learn more DAX and Power BI for Data Visualization: Background in DAX for data modeling and Power BI for enhanced data insights Azure Fabric and ADF Dataflows: Experience with Azure Fabric for integration and ADF dataflows to enable streamlined data transformations What are we looking for: Bachelor’s or Master’s Degree in Computer Science, Data Engineering, Information Systems, or a related field 3+ years of experience in data engineering or a similar role Proven expertise in working with Databricks and its ecosystem Strong communication skills to articulate technical concepts to non-technical stakeholders Knowledge of data architecture, data modeling, and data warehousing principles. Experience with managing large-scale, complex datasets efficiently. Exposure to real-time data processing and streaming pipelines (e.g., Structured Streaming in Databricks) Problem-solving and analytical thinking Ability to collaborate effectively with cross-functional teams What we offer: Learning platforms: Udemy, Master Minds, LinkedIn Learning Internal Technical (including Training held by certified trainers) & Soft skills Training Medical Subscription Gym Deduction Bookster Subscription mindit.io library – we cover the costs for all specialized books our colleagues want to read Wellbeing activities Flexible working hours and all the needed equipment to set up an office at home Flexible office/Work from-home Policy Constant internal events such as team building, thematical parties, hackathons, team celebrations minditNomad – all mindit.io houses are available to book by mindit.io people to build a flexible context for all colleagues to work and have fun in great locations across the country (Constanta, Comarnic, Cluj, Iasi, Sibiu) An organizational culture that values employee contribution and empowerment 2 extra days of vacation designated for wellbeing Free Therapy Sessions provided by mindit.io Get to know us better here: www.mindit.io Show more Show less