The missions are to:

• Implement solutions using PySpark
• Design, build, and maintain efficient, reusable, and reliable code,
• Ensure the best possible performance, quality, and responsiveness
• Identify bottlenecks and bugs, and devise solutions to mitigate and address those issues,
• Help maintain code quality and organization.

Qualifications:

• Proven expertise in Hadoop , Spark , Scala , and PySpark .
• Significant professional experience in the Big Data domain , with in-depth expertise in the Hadoop , Spark , Scala , and PySpark ecosystem.
• Excellent command of the Java programming language, with advanced development and maintenance skills.
• Strong Scala or PySpark development skills, with experience in rewriting Java components in Scala or PySpark.
• Good knowledge of