Requirements: English
Company: AVENGA (Agencja Pracy, nr KRAZ: 8448)
- Strong experience in Python development (4+ years) including writing clean, efficient, and maintainable code for data processing and automation tasks.
- Proficient use of AWS services, including but not limited to S3, Step Functions, Lambda, Fargate, AWS Glue, RDS. Strong hands-on experience with ETL (Extract, Transform, Load) processes, including the design and implementation of ETL solutions using AWS technologies.
- DWH/DL/Data Pipeline experience
- Experience with FastAPI is a plus, but not requiredexperience with other Python frameworks is also valuable.
- Strong understanding of RESTful API design and backend architecture.
- Solid knowledge of databases (SQL/NoSQL) and experience optimizing database queries.
- Experience with cloud technologies, preferably AWS, as well as Docker and CI/CD pipelines.
- Fluent in English
- Excellent communication skills to explain technical concepts to both technical and non-technical stakeholders.
,[Create and maintain optimal data pipeline architecture., Assemble large, complex data sets that meet functional / non-functional business requirements., Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc., Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ''big data'' technologies., Development of CI/CD pipelines (esp. GitLab and DataOps), Modeling data transformations using dbt (data build tool), including scripting and complex algorithms, Automation and simplification of processes (Bash, Docker, Python, GitLab, JIRA), Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics., Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs., Keep the data separated and secure across national boundaries through multiple data centers and AWS regions., Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader] Requirements: Python, AWS, REST API, SQL, Docker, CI/CD Additionally: Sport subscription, Private healthcare, International projects.