Data Engineer

Andersen is hiring a Data Engineer for a project building an enterprise ML platform with scalable data management, governance, security, and modern data architecture.

The customer is a global investment management firm providing tailored investment solutions to institutional and private clients. It combines financial expertise with long-term investment strategies to help clients achieve their objectives while adapting to changing market conditions. The organization focuses on innovation, responsible investing, and operational excellence, continuously enhancing its capabilities to deliver sustainable value and support long-term growth.

The project is focused on building an enterprise ML platform on top of Databricks with a strong emphasis on data governance, security, and scalable data management. It includes implementing Data Mesh and Lakehouse principles, automating data access, managing sensitive data, and enabling secure, cost-efficient collaboration across data and machine learning teams.

Responsibilities:

• Developing, deploying, and maintaining data pipelines and data governance systems on Databricks (Unity Catalog, Delta Lake, Workflows).
• Contributing to building an ML Platform on Databricks in close collaboration with ML and Data Engineers.
• Monitoring and supporting deployed pipelines and quality checks to meet data quality and performance expectations.
• Designing and implementing data security and sharing models across teams and systems.
• Managing data access controls — grant/rollback automation via Terraform (IaC).
• Monitoring and controlling cloud infrastructure costs related to data workloads.
• Ensuring data products and access controls are deployed according to contracts without unintended side effects.
• Conducting in-depth data analysis, profiling, and processing to classify data by domain and detect PII.
• Contributing to the design of data contracts and catalog access systems.
• Creating and maintaining documentation for data contracts, access models, and governance processes.
• Working closely with ML Engineers and Data Engineers on platform development.
• Reviewing and ensuring access architectures and contracts are effective, flexible, and reusable.
• Actively seeking internal solutions to ensure reusability and adoption of common data platform technologies.

Must-haves:

• Experience in Data Engineering for 3+ years.
• Experience with Python + Spark/PySpark (streaming, batch, async).
• Proficiency in SQL, data modeling, DWH/lakehouse architecture fundamentals.
• Hands-on experience with Databricks and GCP/AWS.
• Experience with Terraform for cloud infrastructure provisioning.
• Understanding of data governance and access control patterns.
• Experience with distributed data processing systems.
• Strong communication and collaboration skills.
• Level of English – from Intermediate+ and above.

Nice-to-haves:

• Software engineering / backend development background.
• Specific experience with Databricks Unity Catalog & Delta Lake.
• Familiarity with Data Mesh principles.
• Experience designing data contracts.
• PII detection and data classification experience.
• Participation in architecture and access design reviews.
• Knowledge of design patterns for data access systems.
• Experience with Databricks Workflows.

Reasons why this job would be interesting to you:

• Experience in teamwork with leaders in FinTech, Healthcare, Retail, Telecom, and others. Andersen cooperates with such businesses as Samsung, Siemens, Johnson & Johnson, BNP Paribas, Ryanair, Mercedes, TUI, Verivox, Allianz, T-Systems, etc.
• The opportunity to change the project and/or develop expertise in an interesting business domain.
• Job conditions – you can work both fully remotely and from the office or can choose a hybrid variant.
• Guarantee of professional, financial, and career growth! The company has introduced systems of mentoring and adaptation for each new employee.
• The opportunity to earn up to an additional 1,000 USD per month, depending on the level of expertise, which will be included in the annual bonus, by participating in the company's activities.
• Access to the corporate training portal, where the entire knowledge base of the company is collected and which is constantly updated.
• Bright corporate life (parties / pizza days / PlayStation / fruits / coffee / snacks / movies).
• Certification compensation (AWS, PMP, etc).
• Referral program.
• Private health insurance and compensation for sports activities.

Your personal data is protected in accordance with GDPR regulations.

Join us!