Requirements: English
Company: SQUARE ONE RESOURCES sp. z o.o.
Region: Warsaw , Masovian Voivodeship
technologies-expected :
technologies-optional :
responsibilities :
- Come up with Architecture options for the various use cases in the beginning and
- constantly revisit and refine this to match organizations technology landscape and
- capabilities
- Understand the Business Requirements and decompose this into a concept of what data products will be built which can be used as a blueprint by the developers
- Assistingdevelopment and operations Team on troubleshooting complex issues Working with Data Architects in upstream and downstream systems to align on the changes happening in theorganization
- Proactively proposing improvements to increase the stability and efficiency of data
- structures maintenance
- Lead the Data part of the Technical Backlog (from analysis to implementation)
- Review solutions proposed by the Development Team (if needed)
- Introduce effective and practical technical governance
- Lead discussions with the various internal stakeholders and bring all of them into alignment on the Architecture options and Data Products that the CXIM Team needs.
- Able to coach and guide the development team through the various sprints to ensure that the development meets the architecture patterns and the outcomes for the project.
- Define, enforce and apply data engineering practices and standards to develop robust
- and maintainable data pipelines
- Analyze and organize data pipelines
- Support senior business stakeholders in defining new data product use cases and their value
- Take ownership of data product pipelines and their maintenance
- Be constantly on the lookout for ways to improve best practices and efficiencies and
- make concrete proposals.
- Take leadership and collaborate with other teams proactively to keep things moving
- Work closely with Solution Architect and Stream Leads (AWS, Qualtrics) when doing
- changes impacting whole system landscape
- Be flexible and take on other responsibilities within the scope of the Agile Tea
requirements-expected :
- Good organizational, analytical, communication & consulting skills
- Knowledge about Data Mesh concept
- Knowledge about Data One Platform (Snowflake)
- Familiar with Data Vault Concept and Design
- Knowledge of ETL (Talend)
- Ability to understand the architecture of the existing legacy landscape and come up with architectural options to do this in the SF Platform
- Ability to understand the various technologies in the complex landscape and the analytical capabilities of these technologies
- Ability to troubleshoot issues / incidents in complex data models (support OPS and DEV Teams if needed)
- Have a good understanding of the Commercial Processes in DIA and the data behind
- Experience as a Data Engineer and Data Architect
- Good understanding of Data and Analytics Architecture patterns
- Proficiency in data transformation, with a preference for SQL (high-level of SQL skills
- required for complex queries), Snowflake and dbt (nice-to-have)
- Experience in a CI/CD setting (DataOps, GitLab)
- Experience in Data Products and Data Mesh Concepts and Information Architecture and Modeling
- Good understanding of data input & output formats - APIs, extracts, user inputs etc
- Solid understanding of data retrieval, storage, manipulation
- Experience setting up data sharing agreements
- Experience defining observability rules and mechanisms
- Knowledge of AWS (nice-to-have)