Data Engineer - Senior

SOFTSWISSWarsaw, MazoviaOn-siteFull-timeSenior, 5–8 yearsListed 2 hours ago

Apply now

About this role

Overview:We invite you to join our Data Platform team — building the data infrastructure that powers analytics and insights for SOFTSWISS. We process enterprise-scale data and serve multiple internal teams across the company.In this role, you'll have the opportunity to:Work with modern data stack and AI tools to build complex solutionsDesign solutions to technical challenges and influence platform architectureResearch, develop and integrate new data processing tools and technologiesKey responsibilities:Build business-critical, robust and self-service data products using Apache Spark, Kafka, Delta Lake and other big data technologiesEnsure pipeline performance and data quality through scalable architecture and optimizationRefine data solutions as business requirements and technical constraints evolveCollaborate with teams to understand data needs and support adoption of data products across the companyRequired Experience:5+ years of software engineering experience with expertise in development, deployment, and integrationProficiency in at least one high-level programming language (Scala, Java, Python or equivalent)Experience in data environments, such as Data Lakes, Data Warehouses, Data Marts, Data transformation concepts and working with large data volumesExperience in building ETL pipelines to perform feature engineering on large-scale datasets using Apache Spark and Delta LakeExperience with sourcing and modelling data from application APIsExperience with building stream-processing applications using Spark-Streaming, Kafka Streams or othersExperience designing and implementing monitoring, alerting, and observability solutions for data pipelines using Prometheus, Grafana, Alertmanager or othersStrong analytical and problem-solving skillsUpper-intermediate proficiency in English and strong command of RussianNice to have:Experience with workflow orchestration tools such as Apache AirflowExperience with Kubernetes and containerizationFamiliarity with cloud platforms (AWS, GCP, Azure, OCI)Familiarity with CDC and DebeziumFamiliarity with ClickhouseFamiliarity with data quality validation frameworks for data pipelinesFamiliarity with Data LineageFamiliarity with low-latency NoSQL datastores (such as HBase, Cassandra, MongoDB), Relational databases (such as MySQL, Postgres) and Search systems (such as ElasticSearch, Solr)Masters, PhD, or equivalent experience in Software Engineering, Mathematics or Computer ScienceOur Benefits:Private health insuranceSports benefitsComprehensive Mental Health ProgramFree English lessons (online)Local language coursesPaid time offMaternity leave supportReferral program rewardsUpskilling, internal workshops, and participation in professional conferences and corporate events