Python developer with Databricks

Project description

Luxoft is looking for a Senior Data Engineer for development of new application to be used by investors and investment committees to review their portfolio data, tailored to specific user groups.

Responsibilities

• Work with complex data structures and provide innovative ways to a solution for complex data delivery requirements
• Evaluate new and alternative data sources and new integration techniques
• Contribute to data models and designs for the data warehouse
• Establish standards for documentation and ensure your team adheres to those standards
• Influence and develop a thorough understanding of standards and best practices used by your team

SKILLS

Must have

• Seasoned data engineer who has hands-on experience in AWS to conduct end-to-end data analysis and data pipeline build-out using Python, Glue, S3, Airflow, DBT, Redshift, RDS, etc.
• PySpark experience
• Very solution-driven, and highly collaborative at providing thought leadership and soliciting diverse opinions
• Accountable for results. Experienced in leading team of data engineers to work collectively to deliver solutions on time
• Experience on operating in agile (scaled Agile) setting.

Nice to have

• Databricks experience massively preferred but not mandatory