Senior Big Data Software Engineer (AWS + Databricks)
- Remote (anywhere)
- Full-time
- Software engineering
- Posted recently
You’ll apply on Softserve’s own site.
About the role
SoftServe is a global digital services and consulting company with over 30 years of experience and more than 11,000 professionals across 16 countries, helping businesses worldwide solve complex challenges through technology.
Our Data & Analytics Center of Excellence (CoE) brings together data specialists to drive excellence in data, analytics, and business intelligence. We deliver solutions across Data Strategy & Governance, Data Platform Engineering, Data Migration, and Reporting & BI.
In this role, you’ll design and develop scalable data processing solutions in AWS environments, working with large-scale, distributed data. You’ll take ownership of reliable data pipelines and contribute to data platform development, collaborating with engineering, AI, and product teams to support analytics, automation, and AI-enabled solutions.
Responsibilities
- Design, develop, and maintain scalable batch and distributed data processing pipelines to support reliable data processing and integration
- Build and optimize data processing solutions, taking ownership of performance, reliability, scalability, and cost efficiency across data pipelines
- Collaborate with engineering, AI, and product teams to understand requirements and support analytics, automation, and AI-enabled use cases
- Develop data solutions using Python, SQL, Apache Spark, Databricks, and AWS services such as AWS Glue, Amazon Athena, and Amazon Aurora
- Work with relational databases such as PostgreSQL and MySQL to support data processing and integration workflows
- Develop and maintain workflow orchestration using technologies such as Apache Airflow and contribute to reliable data processing workflows
- Contribute to CI/CD, Infrastructure as Code, testing, troubleshooting, and production support activities using Terraform or similar technologies
- Participate in architecture discussions and contribute to the continuous improvement of data platforms and engineering practices
Requirements
- Strong experience in Big Data, Data Engineering, or related fields, with 5+ years of professional experience
- Strong proficiency in Python and SQL, with Java experience considered a plus
- Strong hands-on experience with Apache Spark, distributed data processing, and Databricks
- Solid experience developing data solutions on AWS using services such as AWS Glue, Amazon Athena, and Amazon Aurora
- Practical experience working with relational databases such as PostgreSQL and MySQL
- Familiarity with workflow orchestration technologies such as Apache Airflow and streaming technologies such as Apache Kafka
- Solid experience with CI/CD, version control, and Infrastructure as Code using Terraform or similar technologies
- Familiarity with GenAI, MLOps, machine learning workflows, or AI platform integrations is considered a plus
- Upper-intermediate or higher English proficiency for collaboration across teams
Some of our benefits
- SoftServe University: Access continuous learning opportunities, certification support, and leadership development programs to grow your skills and advance your career
- Medical insurance: Health coverage for you and your family
- Food vouchers: Additional support for your everyday expenses
- Extra days off: Enjoy additional time off to rest, recharge, and maintain a healthy work-life balance
- Dare to Care: Our holistic well-being program, designed to support your overall wellness
- Anniversary Program: Celebrating your milestones and recognizing your journey with SoftServe
