- Location: London
- Rate: Up to 0.00
- Start Date: 13/08/2019
- Duration: Contract
A Media Company based are seeking a Data Engineer for a 6 month contract based in London.
Scope, build, deploy, test and manage data pipelines. Responsible for the platforms data that feeds into subsystems such as Salesforce as well as driving analytics and insight into the platform.
AWS Cloud Experience is Essential!
Responsible for and own:
Development of infrastructure as code (Terraform/Cloudformation)
Management of AWS-based infrastructure (Lambda, Fargate, S3, CloudWatch etc.)
Management of AWS-based networks (VPC)
Management of the Snowflake data warehouse
Support of the Tableau BI platform and infrastructure (EC2, EBS, VPC)
Integrating data sources across many partners and subsystems
Building and management of ETL jobs and workflows within Talend (Big Data) / AWS (Lambda)
Coordinating and ensure platform data quality and integrity
Ensuring data security and privacy (GDPR)
Ensuring the long-term integrity of the architecture
Monitoring platform performance
Troubleshooting and resolving data platform issues
Communicating with business and technology teams on issues, progress and ideasSkills Required:
Batch, micro-batch and streaming data flow development experience
Skills in implementing and governing data pipelines
Experience with AWS Cloud
Understanding of virtualisation technologies like Docker
Experience with Python (preferred) and/or Java
Experience with RDBMS's such as MS SQL, MySQL, Postgres etc. Bonus
AWS Networking (VPC etc.)
Talend Big Data
Snowflake data warehouseIf you would like to be considered for this position please click 'Apply' and Outsource UK will be in touch or email your CV to Matt at (url removed).
Please visit our websiteApply