Few words about project
We’re looking for a Senior Data Engineer (Warsaw or remotely) to join one of our remote projects.
As a Senior Data Engineer you’ll design and implement a system supporting the investment process for the US-based venture capital firm. You’ll need to integrate data from multiple systems and sources to enable data insights, machine learning and data-driven decision processes.
You will be responsible for...
Designing and implementing system architecture and data flow,
Integrating third-party systems (via APIs) and external data sources into data warehouse,
Implementing integrations between systems to match and enrich data (e.g. CRM, Wiki and Slack),
Designing and building AWS infrastructure with best DevOps practices in mind,
Developing data technology stack including data warehouse and ETL pipelines,
Building data flows for fetching, aggregation and data modeling using batch pipelines,
Designing datasets and schemes for consistency and easy access,
Building and extending recommendation systems.
What's important for us?
Must have:
At least 5 years of professional experience in data-related role, software engineering or DevOps
Undergraduate or graduate degree in Computer Science, Engineering, Mathematics, or similar
Excellent command in spoken and written English, at least C1
Expertise in Python, SQL and Linux scripting
Experience in designing schemes in data warehouses
Experience in building ETL processes and data pipelines with platforms like Airflow or AWS services (Glue, Lambda, Batch, Data Pipelines).
Expertise in AWS stack, Docker as well as deployment automation
Great analytical skills and attention to detail - asking questions and proactively searching for answers
Creative problem-solving skills
Great customer service and troubleshooting skills
Nice to have:
Experience with infrastructure-as-code tools, like Terraform
Familiarity with Azure DevOps stack
Proficiency in statistics and machine learning, as well as Python libraries like Pandas, NumPy, matplotlib, seaborn, scikit-learn, etc
Experience in operating within a secure networking environment, like a corporate proxy