Need 9+ years’ experience  in profile

Experience:

• Strong understanding of data structures and algorithms
• Strong understanding of the solution and technical design
• Has a strong problem-solving and analytical mindset?
• Able to influence and communicate effectively, both verbally and written, with team members and business stakeholders
• Able to quickly pick up new programming languages, technologies, and frameworks
• Advanced experience building cloud scalable, real-time and high-performance data lake solutions
• In-depth understanding of microservice architecture
• Strong understanding of developing complex data solutions
• Experience working on end-to-end solution design
• Able to lead others in solving complex problems by taking a broad perspective to identify innovative solutions 
• Willing to learn new skills and technologies
• Has a passion for data solutions

Required and Preferred Skill Sets:

• Hands-on expert-level experience in AWS - EMR [Hive, Pyspark], S3, Athena or any other equivalent cloud
• Hands-on expert level experience with Spark Batch Processing and some familiarity with Spark Structured Streaming
• Experience Working experience with Hadoop stack dealing with huge volumes of data in a scalable fashion
• Hands-on experience with SQL, ETL, data transformation, and analytics functions 
• Hands-on Python experience including Batch scripting, data manipulation, distributable packages
• Experience working with batch orchestration tools such as Apache Airflow  or equivalent
• Working with code versioning tools such as GitHub or BitBucket; expert-level understanding of repo design and best practices
• Working with deployment automation tools such as Jenkins and familiarity with containerization concepts such as Docker and Kubernetes
• Hands-on experience designing and building ETL pipelines; expert with data ingest, change data capture, and data quality