Join Total Fund Management as a Data Engineer focused on building large-scale cloud data systems. Leverage your expertise in Spark and modern storage formats to drive impactful data solutions.
In this role, you will optimize Spark workloads in cloud environments while handling large datasets with Parquet and Iceberg. Your responsibility includes translating requirements into scalable solutions and ensuring system performance and reliability.
Key Responsibilities:
• Develop and optimize workloads using Spark in cloud environments
• Handle large datasets leveraging Parquet and Iceberg
• Translate requirements into actionable engineering solutions
• Ensure high performance, reliability, and maintainability
• Contribute to monitoring, documentation, and deployment efforts
Requirements:
• Proficiency in Python and PySpark
• Hands-on Apache Spark experience preferred in the cloud
• Experience with Databricks
• Background with large-scale data systems
• ...