Вакансия: Senior Data Engineer
Snowflake (nice to have) Kinesis (regular) Lambda (regular) Kafka (regular) Hadoop (regular) PySpark (regular) English (advanced) ETL (advanced) AWS (advanced) Python (advanced) Please keep in mind that we are building a team comprised of all seniorities, so even though you don’t have expected years of experience, no worries - let us familiarize ourselves with your CV ;)Who are we?We are Semantive, an AWS certified team of software engineers focused on Cloud native application development and software engineering. If you join us, you can expect to get proficient with AWS & Python and work in a challenging project delivered for some Fortune 500 companies as well as start-ups. We are looking for a talented Senior Data Engineer, who would join our Client’s team and become part of the change! Who is our Client?It’s a bank from the USA, specialising in commercial banking, which is building their teams in both India and Poland. The Polish team is to be composed of 5-6 engineers and Team Leader. They have just started their rapid scaling-up, so we are looking for the best to join the growth! The current project is a long-term one, so be ready for many challenges! Who are we looking for?The Data Engineers we are seeking are proficient in the development of all aspects of data processing including data warehouse architecture/modeling and ETL processing. The position focuses research on development and delivery of analytical solutions using various tools including Confluent Kafka, Kinesis, Glue, Lambda, Snowflake and SQL Server. A Data Engineer in our team must be able to work autonomously with little guidance or instruction to deliver business value.What will you be doing?Partner with business stakeholders to gather requirements and translate them into technical specifications and process documentation for IT counterparts (on-prem and offshore)Highly proficient in the architecture and development of an event driven data warehouse; streaming, batch, data modeling, and storageAdvanced database knowledge; creating/optimizing SQL queries, stored procedures, functions, partitioning data, indexing, and reading execution plans Skilled experience in writing and troubleshooting Python/PySpark scripts to generate extracts, cleanse, conform and deliver data for consumptionExpert level of understanding and implementing ETL architecture; data profiling, process flow, metric logging and error handlingSupport continuous improvement by investigating and presenting alternatives to processes and technologies to an architectural review boardDevelop and ensure adherence to published system architectural decisions and development standardsLead and foster data engineers in their careers to produce higher quality solutions at a faster velocity through optimization training and code reviewMulti-task across several ongoing projects and daily duties of varying priorities as requiredMay require some interaction with offshore counterparts to communicate business requirements in a technical design documentRequirements:Must have:Robust experience with: AWS data engineering tools (Kinesis, Glue (Spark), EMR, S3, Lambda, and Athena), Python, PySpark,Hadoop,Expert level in data warehouse design/architecture, dimensional data modeling and ETL process development,Streaming Services – Confluent, Kafka or equivalent.Advanced level development in SQL/NoSQL scripting and complex stored procedures (e.g. SQL Server, DynamoDB),5+ years of development experience,Professional English proficiency both written and spoken (min. B2+/C1).Nice to have:Bachelor’s degree in Computer Science, MIS or related field (industry experience substitutable),Experience with Snowflake, NEO4J is a plus,Hands-on experience in designing and developing applications using:Java Spring Framework (Spring Boot, Spring Cloud, Spring Data etc.).Benefits:Modern technologies Knowledge-sharing sessions, Lightning TalksIndividual training budget (3600 pln/year) and personalized career pathEnglish lessonsSport, leisure and medical packageEmployee referral programFull-remote possible23 paid holiday days2 paid training days
